org.apache.spark.streaming

Class Checkpoint

Object

org.apache.spark.streaming.Checkpoint

All Implemented Interfaces:

java.io.Serializable, Logging

public class Checkpoint
extends Object
implements Logging, java.io.Serializable

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
Checkpoint(StreamingContext ssc, Time checkpointTime)

Method Summary

Methods

Modifier and Type	Method and Description
static org.apache.hadoop.fs.Path	checkpointBackupFile(String checkpointDir, Time checkpointTime) Get the checkpoint backup file for the given checkpoint time
String	checkpointDir()
Duration	checkpointDuration()
static org.apache.hadoop.fs.Path	checkpointFile(String checkpointDir, Time checkpointTime) Get the checkpoint file for the given checkpoint time
Time	checkpointTime()
SparkConf	createSparkConf()
int	delaySeconds()
String	framework()
static scala.collection.Seq<org.apache.hadoop.fs.Path>	getCheckpointFiles(String checkpointDir, org.apache.hadoop.fs.FileSystem fs) Get checkpoint files present in the give directory, ordered by oldest-first
DStreamGraph	graph()
scala.collection.Seq<String>	jars()
String	master()
Time[]	pendingTimes()
static String	PREFIX()
static scala.util.matching.Regex	REGEX()
scala.Tuple2<String,String>[]	sparkConfPairs()
void	validate()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

Checkpoint

public Checkpoint(StreamingContext ssc,
          Time checkpointTime)

Method Detail

PREFIX

public static String PREFIX()

REGEX

public static scala.util.matching.Regex REGEX()

checkpointFile

public static org.apache.hadoop.fs.Path checkpointFile(String checkpointDir,
                                       Time checkpointTime)

Get the checkpoint file for the given checkpoint time

checkpointBackupFile

public static org.apache.hadoop.fs.Path checkpointBackupFile(String checkpointDir,
                                             Time checkpointTime)

Get the checkpoint backup file for the given checkpoint time

getCheckpointFiles

public static scala.collection.Seq<org.apache.hadoop.fs.Path> getCheckpointFiles(String checkpointDir,
                                                                 org.apache.hadoop.fs.FileSystem fs)

Get checkpoint files present in the give directory, ordered by oldest-first

checkpointTime

public Time checkpointTime()

master

public String master()

framework

public String framework()

jars

public scala.collection.Seq<String> jars()

graph

public DStreamGraph graph()

checkpointDir

public String checkpointDir()

checkpointDuration

public Duration checkpointDuration()

pendingTimes

public Time[] pendingTimes()

delaySeconds

public int delaySeconds()

sparkConfPairs

public scala.Tuple2<String,String>[] sparkConfPairs()

createSparkConf

public SparkConf createSparkConf()

validate

public void validate()