org.apache.spark.scheduler

Class BlacklistTracker

Object

org.apache.spark.scheduler.BlacklistTracker

public class BlacklistTracker
extends Object

Constructor Summary

Constructors

Constructor and Description
BlacklistTracker()

Method Summary

Methods

Modifier and Type	Method and Description
static long	getBlacklistTimeout(SparkConf conf)
static boolean	isBlacklistEnabled(SparkConf conf) Returns true if the blacklist is enabled, based on checking the configuration in the following order: 1.
static void	validateBlacklistConfs(SparkConf conf) Verify that blacklist configurations are consistent; if not, throw an exception.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BlacklistTracker

public BlacklistTracker()

Method Detail

isBlacklistEnabled

public static boolean isBlacklistEnabled(SparkConf conf)

Returns true if the blacklist is enabled, based on checking the configuration in the following order: 1. Is it specifically enabled or disabled? 2. Is it enabled via the legacy timeout conf? 3. Default is off

Parameters:

conf - (undocumented)

Returns:

(undocumented)

getBlacklistTimeout

public static long getBlacklistTimeout(SparkConf conf)

validateBlacklistConfs

public static void validateBlacklistConfs(SparkConf conf)

Verify that blacklist configurations are consistent; if not, throw an exception. Should only be called if blacklisting is enabled.

The configuration for the blacklist is expected to adhere to a few invariants. Default values follow these rules of course, but users may unwittingly change one configuration without making the corresponding adjustment elsewhere. This ensures we fail-fast when there are such misconfigurations.

Parameters:

conf - (undocumented)