org.apache.spark.mllib.fpm

Class FPGrowth

java.lang.Object

org.apache.spark.mllib.fpm.FPGrowth

All Implemented Interfaces:

java.io.Serializable

public class FPGrowth
extends java.lang.Object
implements scala.Serializable

A parallel FP-growth algorithm to mine frequent itemsets. The algorithm is described in Li et al., PFP: Parallel FP-Growth for Query Recommendation. PFP distributes computation in such a way that each worker executes an independent group of mining tasks. The FP-Growth algorithm is described in Han et al., Mining frequent patterns without candidate generation.

param: minSupport the minimal support level of the frequent pattern, any pattern that appears more than (minSupport * size-of-the-dataset) times will be output param: numPartitions number of partitions used by parallel FP-growth

See Also:

http://en.wikipedia.org/wiki/Association_rule_learning Association rule learning (Wikipedia)}

, Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FPGrowth.FreqItemset<Item> Frequent itemset.

Constructor Summary

Constructors

Constructor and Description
FPGrowth() Constructs a default instance with default parameters {minSupport: 0.3, numPartitions: same as the input data}.

Method Summary

Methods

Modifier and Type	Method and Description
protected static void	initializeLogIfNecessary(boolean isInterpreter)
protected static boolean	isTraceEnabled()
protected static org.slf4j.Logger	log()
protected static void	logDebug(scala.Function0<java.lang.String> msg)
protected static void	logDebug(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logError(scala.Function0<java.lang.String> msg)
protected static void	logError(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logInfo(scala.Function0<java.lang.String> msg)
protected static void	logInfo(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static java.lang.String	logName()
protected static void	logTrace(scala.Function0<java.lang.String> msg)
protected static void	logTrace(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logWarning(scala.Function0<java.lang.String> msg)
protected static void	logWarning(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
<Item,Basket extends java.lang.Iterable<Item>> FPGrowthModel<Item>	run(JavaRDD<Basket> data) Java-friendly version of run.
<Item> FPGrowthModel<Item>	run(RDD<java.lang.Object> data, scala.reflect.ClassTag<Item> evidence$3) Computes an FP-Growth model that contains frequent itemsets.
FPGrowth	setMinSupport(double minSupport) Sets the minimal support level (default: 0.3).
FPGrowth	setNumPartitions(int numPartitions) Sets the number of partitions used by parallel FP-growth (default: same as input data).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FPGrowth

public FPGrowth()

Constructs a default instance with default parameters {minSupport: 0.3, numPartitions: same as the input data}.

Method Detail

logName

protected static java.lang.String logName()

log

protected static org.slf4j.Logger log()

logInfo

protected static void logInfo(scala.Function0<java.lang.String> msg)

logDebug

protected static void logDebug(scala.Function0<java.lang.String> msg)

logTrace

protected static void logTrace(scala.Function0<java.lang.String> msg)

logWarning

protected static void logWarning(scala.Function0<java.lang.String> msg)

logError

protected static void logError(scala.Function0<java.lang.String> msg)

logInfo

protected static void logInfo(scala.Function0<java.lang.String> msg,
           java.lang.Throwable throwable)

logDebug

protected static void logDebug(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

logTrace

protected static void logTrace(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

logWarning

protected static void logWarning(scala.Function0<java.lang.String> msg,
              java.lang.Throwable throwable)

logError

protected static void logError(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

isTraceEnabled

protected static boolean isTraceEnabled()

initializeLogIfNecessary

protected static void initializeLogIfNecessary(boolean isInterpreter)

setMinSupport

public FPGrowth setMinSupport(double minSupport)

Sets the minimal support level (default: 0.3).

Parameters:

minSupport - (undocumented)

Returns:

(undocumented)

setNumPartitions

public FPGrowth setNumPartitions(int numPartitions)

Sets the number of partitions used by parallel FP-growth (default: same as input data).

Parameters:

numPartitions - (undocumented)

Returns:

(undocumented)

run

public <Item> FPGrowthModel<Item> run(RDD<java.lang.Object> data,
                             scala.reflect.ClassTag<Item> evidence$3)

Computes an FP-Growth model that contains frequent itemsets.

Parameters:

data - input data set, each element contains a transaction

evidence$3 - (undocumented)

Returns:

an FPGrowthModel

run

public <Item,Basket extends java.lang.Iterable<Item>> FPGrowthModel<Item> run(JavaRDD<Basket> data)

Java-friendly version of run.