org.apache.spark.sql.execution

Class ExtractPythonUdfs

Object

org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

org.apache.spark.sql.execution.ExtractPythonUdfs

All Implemented Interfaces:

Logging

public class ExtractPythonUdfs
extends org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

Extracts PythonUDFs from operators, rewriting the query plan so that the UDF can be evaluated alone in a batch.

This has the limitation that the input to the Python UDF is not allowed include attributes from multiple child operators.

Constructor Summary

Constructors

Constructor and Description
ExtractPythonUdfs()

Method Summary

Methods

Modifier and Type	Method and Description
static org.apache.spark.sql.catalyst.plans.logical.LogicalPlan	apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

Methods inherited from class org.apache.spark.sql.catalyst.rules.Rule

apply, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, org$apache$spark$Logging$$log__$eq, org$apache$spark$Logging$$log_, ruleName

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, log_

Constructor Detail

ExtractPythonUdfs

public ExtractPythonUdfs()

Method Detail

apply

public static org.apache.spark.sql.catalyst.plans.logical.LogicalPlan apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)