org.apache.spark.sql.json

Class DefaultSource

Object

org.apache.spark.sql.json.DefaultSource

All Implemented Interfaces:

CreatableRelationProvider, RelationProvider, SchemaRelationProvider

public class DefaultSource
extends Object
implements RelationProvider, SchemaRelationProvider, CreatableRelationProvider

Constructor Summary

Constructors

Constructor and Description
DefaultSource()

Method Summary

Methods

Modifier and Type	Method and Description
BaseRelation	createRelation(SQLContext sqlContext, scala.collection.immutable.Map<String,String> parameters) Returns a new base relation with the parameters.
BaseRelation	createRelation(SQLContext sqlContext, scala.collection.immutable.Map<String,String> parameters, org.apache.spark.sql.types.StructType schema) Returns a new base relation with the given schema and parameters.
BaseRelation	createRelation(SQLContext sqlContext, SaveMode mode, scala.collection.immutable.Map<String,String> parameters, DataFrame data) Creates a relation with the given parameters based on the contents of the given DataFrame.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultSource

public DefaultSource()

Method Detail

createRelation

public BaseRelation createRelation(SQLContext sqlContext,
                          scala.collection.immutable.Map<String,String> parameters)

Returns a new base relation with the parameters.

Specified by:

createRelation in interface RelationProvider

createRelation

public BaseRelation createRelation(SQLContext sqlContext,
                          scala.collection.immutable.Map<String,String> parameters,
                          org.apache.spark.sql.types.StructType schema)

Returns a new base relation with the given schema and parameters.

Specified by:

createRelation in interface SchemaRelationProvider

createRelation

public BaseRelation createRelation(SQLContext sqlContext,
                          SaveMode mode,
                          scala.collection.immutable.Map<String,String> parameters,
                          DataFrame data)

Description copied from interface: CreatableRelationProvider

Creates a relation with the given parameters based on the contents of the given DataFrame. The mode specifies the expected behavior of createRelation when data already exists. Right now, there are three modes, Append, Overwrite, and ErrorIfExists. Append mode means that when saving a DataFrame to a data source, if data already exists, contents of the DataFrame are expected to be appended to existing data. Overwrite mode means that when saving a DataFrame to a data source, if data already exists, existing data is expected to be overwritten by the contents of the DataFrame. ErrorIfExists mode means that when saving a DataFrame to a data source, if data already exists, an exception is expected to be thrown.

Specified by:

createRelation in interface CreatableRelationProvider