org.apache.spark.graphx.impl

Class VertexPartitionBaseOps<VD,Self extends VertexPartitionBase<Object>>

Object

org.apache.spark.graphx.impl.VertexPartitionBaseOps<VD,Self>

All Implemented Interfaces:

java.io.Serializable, Logging

Direct Known Subclasses:

ShippableVertexPartitionOps, VertexPartitionOps

public abstract class VertexPartitionBaseOps<VD,Self extends VertexPartitionBase<Object>>
extends Object
implements scala.Serializable, Logging

An class containing additional operations for subclasses of VertexPartitionBase that provide implicit evidence of membership in the VertexPartitionBaseOpsConstructor typeclass (for example, VertexPartition.VertexPartitionOpsConstructor).

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
VertexPartitionBaseOps(Self self, scala.reflect.ClassTag<VD> evidence$1, VertexPartitionBaseOpsConstructor<Self> evidence$2)

Method Summary

Methods

Modifier and Type	Method and Description
<VD2> Self	aggregateUsingIndex(scala.collection.Iterator<scala.Product2<Object,VD2>> iter, scala.Function2<VD2,VD2,VD2> reduceFunc, scala.reflect.ClassTag<VD2> evidence$14)
<VD2> Self	createUsingIndex(scala.collection.Iterator<scala.Product2<Object,VD2>> iter, scala.reflect.ClassTag<VD2> evidence$13) Similar effect as aggregateUsingIndex((a, b) => a)
Self	diff(Self other) Hides vertices that are the same between this and other.
Self	filter(scala.Function2<Object,VD,Object> pred) Restrict the vertex set to the set of vertices satisfying the given predicate.
<U,VD2> Self	innerJoin(scala.collection.Iterator<scala.Product2<Object,U>> iter, scala.Function3<Object,VD,U,VD2> f, scala.reflect.ClassTag<U> evidence$11, scala.reflect.ClassTag<VD2> evidence$12) Inner join an iterator of messages.
<U,VD2> Self	innerJoin(Self other, scala.Function3<Object,VD,U,VD2> f, scala.reflect.ClassTag<U> evidence$9, scala.reflect.ClassTag<VD2> evidence$10) Inner join another VertexPartition.
Self	innerJoinKeepLeft(scala.collection.Iterator<scala.Product2<Object,VD>> iter) Similar to innerJoin, but vertices from the left side that don't appear in iter will remain in the partition, hidden by the bitmask.
<VD2,VD3> Self	leftJoin(scala.collection.Iterator<scala.Tuple2<Object,VD2>> other, scala.Function3<Object,VD,scala.Option<VD2>,VD3> f, scala.reflect.ClassTag<VD2> evidence$7, scala.reflect.ClassTag<VD3> evidence$8) Left outer join another iterator of messages.
<VD2,VD3> Self	leftJoin(Self other, scala.Function3<Object,VD,scala.Option<VD2>,VD3> f, scala.reflect.ClassTag<VD2> evidence$5, scala.reflect.ClassTag<VD3> evidence$6) Left outer join another VertexPartition.
<VD2> Self	map(scala.Function2<Object,VD,VD2> f, scala.reflect.ClassTag<VD2> evidence$4) Pass each vertex attribute along with the vertex id through a map function and retain the original RDD's partitioning and index.
Self	reindex() Construct a new VertexPartition whose index contains only the vertices in the mask.
abstract Self	withIndex(org.apache.spark.util.collection.OpenHashSet<Object> index)
abstract Self	withMask(org.apache.spark.util.collection.BitSet mask)
abstract <VD2> Self	withValues(Object values, scala.reflect.ClassTag<VD2> evidence$3)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

VertexPartitionBaseOps

public VertexPartitionBaseOps(Self self,
                      scala.reflect.ClassTag<VD> evidence$1,
                      VertexPartitionBaseOpsConstructor<Self> evidence$2)

Method Detail

withIndex

public abstract Self withIndex(org.apache.spark.util.collection.OpenHashSet<Object> index)

withValues

public abstract <VD2> Self withValues(Object values,
                    scala.reflect.ClassTag<VD2> evidence$3)

withMask

public abstract Self withMask(org.apache.spark.util.collection.BitSet mask)

map

public <VD2> Self map(scala.Function2<Object,VD,VD2> f,
             scala.reflect.ClassTag<VD2> evidence$4)

Pass each vertex attribute along with the vertex id through a map function and retain the original RDD's partitioning and index.

Parameters:

f - the function applied to each vertex id and vertex attribute in the RDD

Returns:

a new VertexPartition with values obtained by applying f to each of the entries in the original VertexRDD. The resulting VertexPartition retains the same index.

filter

public Self filter(scala.Function2<Object,VD,Object> pred)

Restrict the vertex set to the set of vertices satisfying the given predicate.

Parameters:

pred - the user defined predicate

diff

public Self diff(Self other)

Hides vertices that are the same between this and other. For vertices that are different, keeps the values from other. The indices of this and other must be the same.

leftJoin

public <VD2,VD3> Self leftJoin(Self other,
                      scala.Function3<Object,VD,scala.Option<VD2>,VD3> f,
                      scala.reflect.ClassTag<VD2> evidence$5,
                      scala.reflect.ClassTag<VD3> evidence$6)

Left outer join another VertexPartition.

leftJoin

public <VD2,VD3> Self leftJoin(scala.collection.Iterator<scala.Tuple2<Object,VD2>> other,
                      scala.Function3<Object,VD,scala.Option<VD2>,VD3> f,
                      scala.reflect.ClassTag<VD2> evidence$7,
                      scala.reflect.ClassTag<VD3> evidence$8)

Left outer join another iterator of messages.

innerJoin

public <U,VD2> Self innerJoin(Self other,
                     scala.Function3<Object,VD,U,VD2> f,
                     scala.reflect.ClassTag<U> evidence$9,
                     scala.reflect.ClassTag<VD2> evidence$10)

Inner join another VertexPartition.

innerJoin

public <U,VD2> Self innerJoin(scala.collection.Iterator<scala.Product2<Object,U>> iter,
                     scala.Function3<Object,VD,U,VD2> f,
                     scala.reflect.ClassTag<U> evidence$11,
                     scala.reflect.ClassTag<VD2> evidence$12)

Inner join an iterator of messages.

createUsingIndex

public <VD2> Self createUsingIndex(scala.collection.Iterator<scala.Product2<Object,VD2>> iter,
                          scala.reflect.ClassTag<VD2> evidence$13)

Similar effect as aggregateUsingIndex((a, b) => a)

innerJoinKeepLeft

public Self innerJoinKeepLeft(scala.collection.Iterator<scala.Product2<Object,VD>> iter)

Similar to innerJoin, but vertices from the left side that don't appear in iter will remain in the partition, hidden by the bitmask.

aggregateUsingIndex

public <VD2> Self aggregateUsingIndex(scala.collection.Iterator<scala.Product2<Object,VD2>> iter,
                             scala.Function2<VD2,VD2,VD2> reduceFunc,
                             scala.reflect.ClassTag<VD2> evidence$14)

reindex

public Self reindex()

Construct a new VertexPartition whose index contains only the vertices in the mask.