org.apache.spark.sql.hive

Class HiveContext

Object

org.apache.spark.sql.SQLContext

org.apache.spark.sql.hive.HiveContext

All Implemented Interfaces:

com.typesafe.scalalogging.slf4j.Logging, java.io.Serializable, SQLConf

Direct Known Subclasses:

LocalHiveContext

public class HiveContext
extends SQLContext

An instance of the Spark SQL execution engine that integrates with data stored in Hive. Configuration for Hive is read from hive-site.xml on the classpath.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HiveContext(SparkContext sc)

Method Summary

Methods

Modifier and Type	Method and Description
<A extends scala.Product> void	createTable(String tableName, boolean allowExisting, scala.reflect.api.TypeTags.TypeTag<A> evidence$1) Creates a table using the schema of the given class.
org.apache.spark.sql.SQLContext.SparkPlanner	hivePlanner()
SchemaRDD	hiveql(String hqlQuery) Executes a query expressed in HiveQL using Spark, returning the result as a SchemaRDD.
SchemaRDD	hql(String hqlQuery) An alias for `hiveql`.
void	set(String key, String value)

Methods inherited from class org.apache.spark.sql.SQLContext

cacheTable, createParquetFile, createSchemaRDD, isCached, jsonFile, jsonFile, jsonRDD, jsonRDD, logicalPlanToSparkQuery, parquetFile, registerRDDAsTable, sparkContext, sql, table, uncacheTable

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.typesafe.scalalogging.slf4j.Logging

logger

Methods inherited from interface org.apache.spark.sql.SQLConf

clear, contains, get, get, getAll, getOption, numShufflePartitions, set, settings, toDebugString

Constructor Detail

HiveContext

public HiveContext(SparkContext sc)

Method Detail

hiveql

public SchemaRDD hiveql(String hqlQuery)

Executes a query expressed in HiveQL using Spark, returning the result as a SchemaRDD.

hql

public SchemaRDD hql(String hqlQuery)

An alias for `hiveql`.

createTable

public <A extends scala.Product> void createTable(String tableName,
                                         boolean allowExisting,
                                         scala.reflect.api.TypeTags.TypeTag<A> evidence$1)

Creates a table using the schema of the given class.

Parameters:

tableName - The name of the table to create.

allowExisting - When false, an exception will be thrown if the table already exists.

set

public void set(String key,
       String value)

hivePlanner

public org.apache.spark.sql.SQLContext.SparkPlanner hivePlanner()