org.apache.spark.sql.hive.execution

Class InsertIntoHiveDirCommand

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

org.apache.spark.sql.catalyst.plans.logical.LogicalPlan

org.apache.spark.sql.hive.execution.InsertIntoHiveDirCommand

All Implemented Interfaces:

java.io.Serializable, Logging, org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper, org.apache.spark.sql.catalyst.plans.logical.Command, org.apache.spark.sql.catalyst.plans.logical.ConstraintHelper, org.apache.spark.sql.catalyst.plans.logical.QueryPlanConstraints, org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats, org.apache.spark.sql.execution.command.DataWritingCommand, SaveAsHiveFile, scala.Equals, scala.Product

public class InsertIntoHiveDirCommand
extends org.apache.spark.sql.catalyst.plans.logical.LogicalPlan
implements SaveAsHiveFile, scala.Product, scala.Serializable

Command for writing the results of query to file system.

The syntax of using this command in SQL is:

   INSERT OVERWRITE [LOCAL] DIRECTORY
   path
   [ROW FORMAT row_format]
   [STORED AS file_format]
   SELECT ...
 

param: isLocal whether the path specified in storage is a local directory param: storage storage format used to describe how the query result is stored. param: query the logical plan representing data to write to param: overwrite whether overwrites existing directory

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
InsertIntoHiveDirCommand(boolean isLocal, org.apache.spark.sql.catalyst.catalog.CatalogStorageFormat storage, org.apache.spark.sql.catalyst.plans.logical.LogicalPlan query, boolean overwrite, scala.collection.Seq<String> outputColumnNames)

Method Summary

Modifier and Type	Method and Description
abstract static R	apply(T1 v1, T2 v2, T3 v3, T4 v4, T5 v5)
boolean	isLocal()
scala.collection.Seq<String>	outputColumnNames()
boolean	overwrite()
org.apache.spark.sql.catalyst.plans.logical.LogicalPlan	query()
scala.collection.Seq<Row>	run(SparkSession sparkSession, org.apache.spark.sql.execution.SparkPlan child)
org.apache.spark.sql.catalyst.catalog.CatalogStorageFormat	storage()
static String	toString()

Methods inherited from class org.apache.spark.sql.catalyst.plans.logical.LogicalPlan

analyzed, assertNotAnalysisRule, childrenResolved, constraints, constructIsNotNullConstraints, inferAdditionalConstraints, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, invalidateStatsCache, isStreaming, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, maxRows, maxRowsPerPartition, org$apache$spark$internal$Logging$$log__$eq, org$apache$spark$internal$Logging$$log_, org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$_analyzed_$eq, org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$_analyzed, outputOrdering, refresh, resolve, resolve, resolveChildren, resolved, resolveExpressions, resolveOperators, resolveOperatorsDown, resolveOperatorsUp, resolveQuoted, setAnalyzed, statePrefix, stats, statsCache_$eq, statsCache, transformAllExpressions, transformDown, transformUp, validConstraints, verboseStringWithSuffix

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

allAttributes, canEvaluate, canEvaluateWithinJoin, canonicalized, conf, doCanonicalize, expressions, innerChildren, inputSet, isCanonicalizedPlan, mapExpressions, missingInput, normalizeExprId, normalizePredicates, org$apache$spark$sql$catalyst$plans$QueryPlan$$recursiveTransform$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$seqToExpressions$1, output, outputSet, printSchema, producedAttributes, references, replaceAlias, sameResult, schema, schemaString, semanticHash, simpleString, splitConjunctivePredicates, splitDisjunctivePredicates, subqueries, transformExpressions, transformExpressionsDown, transformExpressionsUp, verboseString

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, collectFirst, collectLeaves, containsChild, fastEquals, find, flatMap, foreach, foreachUp, generateTreeString, generateTreeString$default$5, generateTreeString$default$6, hashCode, jsonFields, makeCopy, map, mapChildren, mapProductIterator, nodeName, numberedTreeString, org$apache$spark$sql$catalyst$trees$TreeNode$$allChildren, org$apache$spark$sql$catalyst$trees$TreeNode$$collectJsonValue$1, org$apache$spark$sql$catalyst$trees$TreeNode$$getNodeNumbered, org$apache$spark$sql$catalyst$trees$TreeNode$$mapChild$1, org$apache$spark$sql$catalyst$trees$TreeNode$$mapChild$2, org$apache$spark$sql$catalyst$trees$TreeNode$$mapTreeNode$1, org$apache$spark$sql$catalyst$trees$TreeNode$$parseToJson, org$apache$spark$sql$catalyst$trees$TreeNode$$simpleClassName, origin, otherCopyArgs, p, prettyJson, productIterator, productPrefix, stringArgs, toJSON, toString, transform, treeString, treeString, treeString$default$2, withNewChildren

Methods inherited from class Object

equals, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.hive.execution.SaveAsHiveFile

createdTempDir, deleteExternalTmpPath, executionId, getExternalScratchDir, getExternalTmpPath, getExtTmpPathRelTo, getStagingDir, newVersionExternalTempPath, oldVersionExternalTempPath, saveAsHiveFile

Methods inherited from interface org.apache.spark.sql.execution.command.DataWritingCommand

basicWriteJobStatsTracker, children, metrics, outputColumns

Methods inherited from interface org.apache.spark.sql.catalyst.plans.logical.Command

output

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.internal.Logging

initializeLogging, log_

Constructor Detail

InsertIntoHiveDirCommand

public InsertIntoHiveDirCommand(boolean isLocal,
                                org.apache.spark.sql.catalyst.catalog.CatalogStorageFormat storage,
                                org.apache.spark.sql.catalyst.plans.logical.LogicalPlan query,
                                boolean overwrite,
                                scala.collection.Seq<String> outputColumnNames)

Method Detail

apply

public abstract static R apply(T1 v1,
                               T2 v2,
                               T3 v3,
                               T4 v4,
                               T5 v5)

toString

public static String toString()

isLocal

public boolean isLocal()

storage

public org.apache.spark.sql.catalyst.catalog.CatalogStorageFormat storage()

query

public org.apache.spark.sql.catalyst.plans.logical.LogicalPlan query()

Specified by:

query in interface org.apache.spark.sql.execution.command.DataWritingCommand

overwrite

public boolean overwrite()

outputColumnNames

public scala.collection.Seq<String> outputColumnNames()

Specified by:

outputColumnNames in interface org.apache.spark.sql.execution.command.DataWritingCommand

run

public scala.collection.Seq<Row> run(SparkSession sparkSession,
                                     org.apache.spark.sql.execution.SparkPlan child)

Specified by:

run in interface org.apache.spark.sql.execution.command.DataWritingCommand