org.apache.spark.ml.util

Interface BaseReadWrite

All Known Implementing Classes:

CrossValidatorModel.CrossValidatorModelWriter, GeneralMLWriter, MLReader, MLWriter, TrainValidationSplitModel.TrainValidationSplitModelWriter

public interface BaseReadWrite

Trait for MLWriter and MLReader.

Method Summary

Modifier and Type	Method and Description
BaseReadWrite	context(SQLContext sqlContext) Deprecated. Use session instead. This method will be removed in 3.0.0.
scala.Option<SparkSession>	optionSparkSession()
SparkContext	sc() Returns the underlying `SparkContext`.
BaseReadWrite	session(SparkSession sparkSession) Sets the Spark Session to use for saving/loading.
SparkSession	sparkSession() Returns the user-specified Spark Session or the default.
SQLContext	sqlContext() Returns the user-specified SQL context or the default.

Method Detail

context

BaseReadWrite context(SQLContext sqlContext)

Deprecated. Use session instead. This method will be removed in 3.0.0.

Sets the Spark SQLContext to use for saving/loading.

Parameters:

sqlContext - (undocumented)

Returns:

(undocumented)

optionSparkSession

scala.Option<SparkSession> optionSparkSession()

sc

SparkContext sc()

Returns the underlying `SparkContext`.

session

BaseReadWrite session(SparkSession sparkSession)

Sets the Spark Session to use for saving/loading.

Parameters:

sparkSession - (undocumented)

Returns:

(undocumented)

sparkSession

SparkSession sparkSession()

Returns the user-specified Spark Session or the default.

Returns:

(undocumented)

sqlContext

SQLContext sqlContext()

Returns the user-specified SQL context or the default.

Returns:

(undocumented)