RandomRDDs.exponentialJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.exponentialJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.exponentialJavaRDD
with the default seed.
RandomRDDs.exponentialJavaRDD
with the default seed.
Java-friendly version of RandomRDDs.exponentialRDD
.
Java-friendly version of RandomRDDs.exponentialRDD
.
RandomRDDs.exponentialJavaVectorRDD
with the default number of partitions
and the default seed.
RandomRDDs.exponentialJavaVectorRDD
with the default number of partitions
and the default seed.
RandomRDDs.exponentialJavaVectorRDD
with the default seed.
RandomRDDs.exponentialJavaVectorRDD
with the default seed.
Java-friendly version of RandomRDDs.exponentialVectorRDD
.
Java-friendly version of RandomRDDs.exponentialVectorRDD
.
Generates an RDD comprised of i.i.d.
samples from the exponential distribution with
the input mean.
Generates an RDD comprised of i.i.d.
samples from the exponential distribution with
the input mean.
SparkContext used to create the RDD.
Mean, or 1 / lambda, for the exponential distribution.
Size of the RDD.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Double] comprised of i.i.d.
samples ~ Pois(mean).
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
exponential distribution with the input mean.
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
exponential distribution with the input mean.
SparkContext used to create the RDD.
Mean, or 1 / lambda, for the Exponential distribution.
Number of Vectors in the RDD.
Number of elements in each Vector.
Number of partitions in the RDD (default: sc.defaultParallelism
)
Random seed (default: a random long integer).
RDD[Vector] with vectors containing i.i.d.
samples ~ Exp(mean).
RandomRDDs.gammaJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.gammaJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.gammaJavaRDD
with the default seed.
RandomRDDs.gammaJavaRDD
with the default seed.
Java-friendly version of RandomRDDs.gammaRDD
.
Java-friendly version of RandomRDDs.gammaRDD
.
RandomRDDs.gammaJavaVectorRDD
with the default number of partitions and the default seed.
RandomRDDs.gammaJavaVectorRDD
with the default number of partitions and the default seed.
RandomRDDs.gammaJavaVectorRDD
with the default seed.
RandomRDDs.gammaJavaVectorRDD
with the default seed.
Java-friendly version of RandomRDDs.gammaVectorRDD
.
Java-friendly version of RandomRDDs.gammaVectorRDD
.
Generates an RDD comprised of i.i.d.
samples from the gamma distribution with the input
shape and scale.
Generates an RDD comprised of i.i.d.
samples from the gamma distribution with the input
shape and scale.
SparkContext used to create the RDD.
shape parameter (greater than 0) for the gamma distribution
scale parameter (greater than 0) for the gamma distribution
Size of the RDD.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Double] comprised of i.i.d.
samples ~ Pois(mean).
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
gamma distribution with the input shape and scale.
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
gamma distribution with the input shape and scale.
SparkContext used to create the RDD.
shape parameter (greater than 0) for the gamma distribution.
scale parameter (greater than 0) for the gamma distribution.
Number of Vectors in the RDD.
Number of elements in each Vector.
Number of partitions in the RDD (default: sc.defaultParallelism
)
Random seed (default: a random long integer).
RDD[Vector] with vectors containing i.i.d.
samples ~ Exp(mean).
RandomRDDs.logNormalJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.logNormalJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.logNormalJavaRDD
with the default seed.
RandomRDDs.logNormalJavaRDD
with the default seed.
Java-friendly version of RandomRDDs.logNormalRDD
.
Java-friendly version of RandomRDDs.logNormalRDD
.
RandomRDDs.logNormalJavaVectorRDD
with the default number of partitions and
the default seed.
RandomRDDs.logNormalJavaVectorRDD
with the default number of partitions and
the default seed.
RandomRDDs.logNormalJavaVectorRDD
with the default seed.
RandomRDDs.logNormalJavaVectorRDD
with the default seed.
Java-friendly version of RandomRDDs.logNormalVectorRDD
.
Java-friendly version of RandomRDDs.logNormalVectorRDD
.
Generates an RDD comprised of i.i.d.
samples from the log normal distribution with the input
mean and standard deviation
Generates an RDD comprised of i.i.d.
samples from the log normal distribution with the input
mean and standard deviation
SparkContext used to create the RDD.
mean for the log normal distribution
standard deviation for the log normal distribution
Size of the RDD.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Double] comprised of i.i.d.
samples ~ Pois(mean).
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from a
log normal distribution.
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from a
log normal distribution.
SparkContext used to create the RDD.
Mean of the log normal distribution.
Standard deviation of the log normal distribution.
Number of Vectors in the RDD.
Number of elements in each Vector.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Vector] with vectors containing i.i.d.
samples.
RandomRDDs.normalJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.normalJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.normalJavaRDD
with the default seed.
RandomRDDs.normalJavaRDD
with the default seed.
Java-friendly version of RandomRDDs.normalRDD
.
Java-friendly version of RandomRDDs.normalRDD
.
RandomRDDs.normalJavaVectorRDD
with the default number of partitions and the default seed.
RandomRDDs.normalJavaVectorRDD
with the default number of partitions and the default seed.
RandomRDDs.normalJavaVectorRDD
with the default seed.
RandomRDDs.normalJavaVectorRDD
with the default seed.
Java-friendly version of RandomRDDs.normalVectorRDD
.
Java-friendly version of RandomRDDs.normalVectorRDD
.
Generates an RDD comprised of i.i.d.
samples from the standard normal distribution.
Generates an RDD comprised of i.i.d.
samples from the standard normal distribution.
To transform the distribution in the generated RDD from standard normal to some other normal
N(mean, sigma2)
, use RandomRDDs.normalRDD(sc, n, p, seed).map(v => mean + sigma * v)
.
SparkContext used to create the RDD.
Size of the RDD.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Double] comprised of i.i.d.
samples ~ N(0.0, 1.0).
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
standard normal distribution.
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
standard normal distribution.
SparkContext used to create the RDD.
Number of Vectors in the RDD.
Number of elements in each Vector.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Vector] with vectors containing i.i.d.
samples ~ N(0.0, 1.0)
.
RandomRDDs.poissonJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.poissonJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.poissonJavaRDD
with the default seed.
RandomRDDs.poissonJavaRDD
with the default seed.
Java-friendly version of RandomRDDs.poissonRDD
.
Java-friendly version of RandomRDDs.poissonRDD
.
RandomRDDs.poissonJavaVectorRDD
with the default number of partitions and the default seed.
RandomRDDs.poissonJavaVectorRDD
with the default number of partitions and the default seed.
RandomRDDs.poissonJavaVectorRDD
with the default seed.
RandomRDDs.poissonJavaVectorRDD
with the default seed.
Java-friendly version of RandomRDDs.poissonVectorRDD
.
Java-friendly version of RandomRDDs.poissonVectorRDD
.
Generates an RDD comprised of i.i.d.
samples from the Poisson distribution with the input
mean.
Generates an RDD comprised of i.i.d.
samples from the Poisson distribution with the input
mean.
SparkContext used to create the RDD.
Mean, or lambda, for the Poisson distribution.
Size of the RDD.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Double] comprised of i.i.d.
samples ~ Pois(mean).
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
Poisson distribution with the input mean.
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
Poisson distribution with the input mean.
SparkContext used to create the RDD.
Mean, or lambda, for the Poisson distribution.
Number of Vectors in the RDD.
Number of elements in each Vector.
Number of partitions in the RDD (default: sc.defaultParallelism
)
Random seed (default: a random long integer).
RDD[Vector] with vectors containing i.i.d.
samples ~ Pois(mean).
:: DeveloperApi ::
RandomRDDs.randomJavaRDD
with the default seed & numPartitions
:: DeveloperApi ::
RandomRDDs.randomJavaRDD
with the default seed & numPartitions
:: DeveloperApi ::
RandomRDDs.randomJavaRDD
with the default seed.
:: DeveloperApi ::
RandomRDDs.randomJavaRDD
with the default seed.
:: DeveloperApi ::
Generates an RDD comprised of i.i.d.
samples produced by the input RandomDataGenerator.
:: DeveloperApi ::
Generates an RDD comprised of i.i.d.
samples produced by the input RandomDataGenerator.
JavaSparkContext used to create the RDD.
RandomDataGenerator used to populate the RDD.
Size of the RDD.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[T] comprised of i.i.d.
samples produced by generator.
:: DeveloperApi ::
RandomRDDs.randomJavaVectorRDD
with the default number of partitions and the default seed.
:: DeveloperApi ::
RandomRDDs.randomJavaVectorRDD
with the default number of partitions and the default seed.
:: DeveloperApi ::
RandomRDDs.randomJavaVectorRDD
with the default seed.
:: DeveloperApi ::
RandomRDDs.randomJavaVectorRDD
with the default seed.
:: DeveloperApi ::
Java-friendly version of RandomRDDs.randomVectorRDD
.
:: DeveloperApi ::
Java-friendly version of RandomRDDs.randomVectorRDD
.
:: DeveloperApi ::
Generates an RDD comprised of i.i.d.
samples produced by the input RandomDataGenerator.
:: DeveloperApi ::
Generates an RDD comprised of i.i.d.
samples produced by the input RandomDataGenerator.
SparkContext used to create the RDD.
RandomDataGenerator used to populate the RDD.
Size of the RDD.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[T] comprised of i.i.d.
samples produced by generator.
:: DeveloperApi ::
Generates an RDD[Vector] with vectors containing i.i.d.
samples produced by the
input RandomDataGenerator.
:: DeveloperApi ::
Generates an RDD[Vector] with vectors containing i.i.d.
samples produced by the
input RandomDataGenerator.
SparkContext used to create the RDD.
RandomDataGenerator used to populate the RDD.
Number of Vectors in the RDD.
Number of elements in each Vector.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Vector] with vectors containing i.i.d.
samples produced by generator.
RandomRDDs.uniformJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.uniformJavaRDD
with the default number of partitions and the default seed.
RandomRDDs.uniformJavaRDD
with the default seed.
RandomRDDs.uniformJavaRDD
with the default seed.
Java-friendly version of RandomRDDs.uniformRDD
.
Java-friendly version of RandomRDDs.uniformRDD
.
RandomRDDs.uniformJavaVectorRDD
with the default number of partitions and the default seed.
RandomRDDs.uniformJavaVectorRDD
with the default number of partitions and the default seed.
RandomRDDs.uniformJavaVectorRDD
with the default seed.
RandomRDDs.uniformJavaVectorRDD
with the default seed.
Java-friendly version of RandomRDDs.uniformVectorRDD
.
Java-friendly version of RandomRDDs.uniformVectorRDD
.
Generates an RDD comprised of i.i.d.
samples from the uniform distribution U(0.0, 1.0)
.
Generates an RDD comprised of i.i.d.
samples from the uniform distribution U(0.0, 1.0)
.
To transform the distribution in the generated RDD from U(0.0, 1.0)
to U(a, b)
, use
RandomRDDs.uniformRDD(sc, n, p, seed).map(v => a + (b - a) * v)
.
SparkContext used to create the RDD.
Size of the RDD.
Number of partitions in the RDD (default: sc.defaultParallelism
).
Random seed (default: a random long integer).
RDD[Double] comprised of i.i.d.
samples ~ U(0.0, 1.0)
.
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
uniform distribution on U(0.0, 1.0)
.
Generates an RDD[Vector] with vectors containing i.i.d.
samples drawn from the
uniform distribution on U(0.0, 1.0)
.
SparkContext used to create the RDD.
Number of Vectors in the RDD.
Number of elements in each Vector.
Number of partitions in the RDD.
Seed for the RNG that generates the seed for the generator in each partition.
RDD[Vector] with vectors containing i.i.d samples ~ U(0.0, 1.0)
.
Generator methods for creating RDDs comprised of
i.i.d.
samples from some distribution.