public interface StreamingQuery
Modifier and Type | Method and Description |
---|---|
void |
awaitTermination()
Waits for the termination of
this query, either by query.stop() or by an exception. |
boolean |
awaitTermination(long timeoutMs)
Waits for the termination of
this query, either by query.stop() or by an exception. |
scala.Option<StreamingQueryException> |
exception()
Returns the
StreamingQueryException if the query was terminated by an exception. |
void |
explain()
Prints the physical plan to the console for debugging purposes.
|
void |
explain(boolean extended)
Prints the physical plan to the console for debugging purposes.
|
long |
id()
Returns the unique id of this query.
|
boolean |
isActive()
Whether the query is currently active or not
|
String |
name()
Returns the name of the query.
|
void |
processAllAvailable()
Blocks until all available data in the source has been processed and committed to the sink.
|
SinkStatus |
sinkStatus()
Returns current status of the sink.
|
SourceStatus[] |
sourceStatuses()
Returns current status of all the sources.
|
SparkSession |
sparkSession()
Returns the
SparkSession associated with this . |
void |
stop()
Stops the execution of this query if it is running.
|
String name()
DataStreamWriter
as
dataframe.writeStream.queryName("query").start()
.long id()
SparkSession sparkSession()
SparkSession
associated with this
.boolean isActive()
scala.Option<StreamingQueryException> exception()
StreamingQueryException
if the query was terminated by an exception.SourceStatus[] sourceStatuses()
SinkStatus sinkStatus()
void awaitTermination()
this
query, either by query.stop()
or by an exception.
If the query has terminated with an exception, then the exception will be thrown.
If the query has terminated, then all subsequent calls to this method will either return
immediately (if the query was terminated by stop()
), or throw the exception
immediately (if the query has terminated with exception).
StreamingQueryException,
- if this
query has terminated with an exception.
boolean awaitTermination(long timeoutMs)
this
query, either by query.stop()
or by an exception.
If the query has terminated with an exception, then the exception will be thrown.
Otherwise, it returns whether the query has terminated or not within the timeoutMs
milliseconds.
If the query has terminated, then all subsequent calls to this method will either return
true
immediately (if the query was terminated by stop()
), or throw the exception
immediately (if the query has terminated with exception).
timeoutMs
- (undocumented)StreamingQueryException,
- if this
query has terminated with an exception
void processAllAvailable()
Source
prior to invocation. (i.e. getOffset
must immediately reflect the addition).void stop()
void explain()
void explain(boolean extended)
extended
- whether to do extended explain or not