org.apache.spark.broadcast

Interface BroadcastFactory

public interface BroadcastFactory

An interface for all the broadcast implementations in Spark (to allow multiple broadcast implementations). SparkContext uses a BroadcastFactory implementation to instantiate a particular broadcast for the entire Spark job.

Method Summary

Modifier and Type	Method and Description
void	initialize(boolean isDriver, SparkConf conf, org.apache.spark.SecurityManager securityMgr)
<T> Broadcast<T>	newBroadcast(T value, boolean isLocal, long id, scala.reflect.ClassTag<T> evidence$1) Creates a new broadcast variable.
void	stop()
void	unbroadcast(long id, boolean removeFromDriver, boolean blocking)

Method Detail

initialize

void initialize(boolean isDriver,
                SparkConf conf,
                org.apache.spark.SecurityManager securityMgr)

newBroadcast

<T> Broadcast<T> newBroadcast(T value,
                              boolean isLocal,
                              long id,
                              scala.reflect.ClassTag<T> evidence$1)

Creates a new broadcast variable.

Parameters:

value - value to broadcast

isLocal - whether we are in local mode (single JVM process)

id - unique id representing this broadcast variable

evidence$1 - (undocumented)

Returns:

(undocumented)

stop

void stop()

unbroadcast

void unbroadcast(long id,
                 boolean removeFromDriver,
                 boolean blocking)