org.apache.spark.rdd

Class CoalescedRDDPartition

Object

org.apache.spark.rdd.CoalescedRDDPartition

All Implemented Interfaces:

java.io.Serializable, Partition, scala.Equals, scala.Product

public class CoalescedRDDPartition
extends Object
implements Partition, scala.Product, scala.Serializable

Class that captures a coalesced RDD by essentially keeping track of parent partitions

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CoalescedRDDPartition(int index, RDD<?> rdd, int[] parentsIndices, scala.Option<String> preferredLocation)

Method Summary

Methods

Modifier and Type	Method and Description
int	index() Get the partition's index within its parent RDD
double	localFraction() Computes the fraction of the parents' partitions containing preferredLocation within their getPreferredLocs.
scala.collection.Seq<Partition>	parents()
int[]	parentsIndices()
scala.Option<String>	preferredLocation()
Object	rdd()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Partition

hashCode

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Constructor Detail

CoalescedRDDPartition

public CoalescedRDDPartition(int index,
                     RDD<?> rdd,
                     int[] parentsIndices,
                     scala.Option<String> preferredLocation)

Method Detail

index

public int index()

Description copied from interface: Partition

Get the partition's index within its parent RDD

Specified by:

index in interface Partition

rdd

public Object rdd()

parentsIndices

public int[] parentsIndices()

preferredLocation

public scala.Option<String> preferredLocation()

parents

public scala.collection.Seq<Partition> parents()

localFraction

public double localFraction()

Computes the fraction of the parents' partitions containing preferredLocation within their getPreferredLocs.

Returns:

locality of this coalesced partition between 0 and 1