org.apache.spark.ui

Class ConsoleProgressBar

Object

org.apache.spark.ui.ConsoleProgressBar

All Implemented Interfaces:

Logging

public class ConsoleProgressBar
extends Object
implements Logging

ConsoleProgressBar shows the progress of stages in the next line of the console. It poll the status of active stages from sc.statusTracker periodically, the progress bar will be showed up after the stage has ran at least 500ms. If multiple stages run in the same time, the status of them will be combined together, showed in one line.

Constructor Summary

Constructors

Constructor and Description
ConsoleProgressBar(SparkContext sc)

Method Summary

Methods

Modifier and Type	Method and Description
char	CR()
void	finishAll() Mark all the stages as finished, clear the progress bar if showed, then the progress will not interweave with output of jobs.
long	FIRST_DELAY()
long	lastFinishTime()
String	lastProgressBar()
long	lastUpdateTime()
int	TerminalWidth()
long	UPDATE_PERIOD()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

ConsoleProgressBar

public ConsoleProgressBar(SparkContext sc)

Method Detail

CR

public char CR()

UPDATE_PERIOD

public long UPDATE_PERIOD()

FIRST_DELAY

public long FIRST_DELAY()

TerminalWidth

public int TerminalWidth()

lastFinishTime

public long lastFinishTime()

lastUpdateTime

public long lastUpdateTime()

lastProgressBar

public String lastProgressBar()

finishAll

public void finishAll()

Mark all the stages as finished, clear the progress bar if showed, then the progress will not interweave with output of jobs.