org.apache.spark.graphx

Class GraphLoader

java.lang.Object

org.apache.spark.graphx.GraphLoader

public class GraphLoader
extends java.lang.Object

Provides utilities for loading Graphs from files.

Constructor Summary

Constructors

Constructor and Description
GraphLoader()

Method Summary

Methods

Modifier and Type	Method and Description
static Graph<java.lang.Object,java.lang.Object>	edgeListFile(SparkContext sc, java.lang.String path, boolean canonicalOrientation, int numEdgePartitions, StorageLevel edgeStorageLevel, StorageLevel vertexStorageLevel) Loads a graph from an edge list formatted file where each line contains two integers: a source id and a target id.
protected static void	initializeLogIfNecessary(boolean isInterpreter)
protected static boolean	isTraceEnabled()
protected static org.slf4j.Logger	log()
protected static void	logDebug(scala.Function0<java.lang.String> msg)
protected static void	logDebug(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logError(scala.Function0<java.lang.String> msg)
protected static void	logError(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logInfo(scala.Function0<java.lang.String> msg)
protected static void	logInfo(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static java.lang.String	logName()
protected static void	logTrace(scala.Function0<java.lang.String> msg)
protected static void	logTrace(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logWarning(scala.Function0<java.lang.String> msg)
protected static void	logWarning(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GraphLoader

public GraphLoader()

Method Detail

edgeListFile

public static Graph<java.lang.Object,java.lang.Object> edgeListFile(SparkContext sc,
                                                    java.lang.String path,
                                                    boolean canonicalOrientation,
                                                    int numEdgePartitions,
                                                    StorageLevel edgeStorageLevel,
                                                    StorageLevel vertexStorageLevel)

Loads a graph from an edge list formatted file where each line contains two integers: a source id and a target id. Skips lines that begin with #.

If desired the edges can be automatically oriented in the positive direction (source Id < target Id) by setting canonicalOrientation to true.

Parameters:

sc - SparkContext

path - the path to the file (e.g., /home/data/file or hdfs://file)

canonicalOrientation - whether to orient edges in the positive direction

numEdgePartitions - the number of partitions for the edge RDD Setting this value to -1 will use the default parallelism.

edgeStorageLevel - the desired storage level for the edge partitions

vertexStorageLevel - the desired storage level for the vertex partitions

Returns:

(undocumented)

logName

protected static java.lang.String logName()

log

protected static org.slf4j.Logger log()

logInfo

protected static void logInfo(scala.Function0<java.lang.String> msg)

logDebug

protected static void logDebug(scala.Function0<java.lang.String> msg)

logTrace

protected static void logTrace(scala.Function0<java.lang.String> msg)

logWarning

protected static void logWarning(scala.Function0<java.lang.String> msg)

logError

protected static void logError(scala.Function0<java.lang.String> msg)

logInfo

protected static void logInfo(scala.Function0<java.lang.String> msg,
           java.lang.Throwable throwable)

logDebug

protected static void logDebug(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

logTrace

protected static void logTrace(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

logWarning

protected static void logWarning(scala.Function0<java.lang.String> msg,
              java.lang.Throwable throwable)

logError

protected static void logError(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

isTraceEnabled

protected static boolean isTraceEnabled()

initializeLogIfNecessary

protected static void initializeLogIfNecessary(boolean isInterpreter)