Package

org.apache.spark.streaming

kafka

Permalink

package kafka

Kafka receiver for spark streaming,

Source
package.scala
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. kafka
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. final class Broker extends Serializable

    Permalink

    Represents the host and port info for a Kafka broker.

    Represents the host and port info for a Kafka broker. Differs from the Kafka project's internal kafka.cluster.Broker, which contains a server ID.

  2. trait HasOffsetRanges extends AnyRef

    Permalink

    Represents any object that has a collection of OffsetRanges.

    Represents any object that has a collection of OffsetRanges. This can be used to access the offset ranges in RDDs generated by the direct Kafka DStream (see KafkaUtils.createDirectStream()).

    KafkaUtils.createDirectStream(...).foreachRDD { rdd =>
       val offsetRanges = rdd.asInstanceOf[HasOffsetRanges].offsetRanges
       ...
    }
  3. class KafkaCluster extends Serializable

    Permalink

    :: DeveloperApi :: Convenience methods for interacting with a Kafka cluster.

    :: DeveloperApi :: Convenience methods for interacting with a Kafka cluster. See A Guide To The Kafka Protocol for more details on individual api calls.

    Annotations
    @DeveloperApi()
  4. final class OffsetRange extends Serializable

    Permalink

    Represents a range of offsets from a single Kafka TopicAndPartition.

    Represents a range of offsets from a single Kafka TopicAndPartition. Instances of this class can be created with OffsetRange.create().

Value Members

  1. object Broker extends Serializable

    Permalink

    :: Experimental :: Companion object that provides methods to create instances of Broker.

    :: Experimental :: Companion object that provides methods to create instances of Broker.

    Annotations
    @Experimental()
  2. object KafkaCluster extends Serializable

    Permalink
    Annotations
    @DeveloperApi()
  3. object KafkaUtils

    Permalink
  4. object OffsetRange extends Serializable

    Permalink

    Companion object the provides methods to create instances of OffsetRange.

Inherited from AnyRef

Inherited from Any

Ungrouped