Packages

o

org.apache.spark.streaming.kafka010

ConsumerStrategies

object ConsumerStrategies

Object for obtaining instances of ConsumerStrategy

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ConsumerStrategies
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def Assign[K, V](topicPartitions: Collection[TopicPartition], kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Assign a fixed collection of TopicPartitions

    Assign a fixed collection of TopicPartitions

    topicPartitions

    collection of TopicPartitions to assign

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  5. def Assign[K, V](topicPartitions: Collection[TopicPartition], kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Assign a fixed collection of TopicPartitions

    Assign a fixed collection of TopicPartitions

    topicPartitions

    collection of TopicPartitions to assign

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  6. def Assign[K, V](topicPartitions: Iterable[TopicPartition], kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Assign a fixed collection of TopicPartitions

    Assign a fixed collection of TopicPartitions

    topicPartitions

    collection of TopicPartitions to assign

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  7. def Assign[K, V](topicPartitions: Iterable[TopicPartition], kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Assign a fixed collection of TopicPartitions

    Assign a fixed collection of TopicPartitions

    topicPartitions

    collection of TopicPartitions to assign

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  8. def Subscribe[K, V](topics: Collection[String], kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Subscribe to a collection of topics.

    Subscribe to a collection of topics.

    topics

    collection of topics to subscribe

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  9. def Subscribe[K, V](topics: Collection[String], kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Subscribe to a collection of topics.

    Subscribe to a collection of topics.

    topics

    collection of topics to subscribe

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  10. def Subscribe[K, V](topics: Iterable[String], kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Subscribe to a collection of topics.

    Subscribe to a collection of topics.

    topics

    collection of topics to subscribe

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  11. def Subscribe[K, V](topics: Iterable[String], kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Subscribe to a collection of topics.

    Subscribe to a collection of topics.

    topics

    collection of topics to subscribe

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  12. def SubscribePattern[K, V](pattern: Pattern, kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Subscribe to all topics matching specified pattern to get dynamically assigned partitions.

    Subscribe to all topics matching specified pattern to get dynamically assigned partitions. The pattern matching will be done periodically against topics existing at the time of check.

    pattern

    pattern to subscribe to

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  13. def SubscribePattern[K, V](pattern: Pattern, kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Subscribe to all topics matching specified pattern to get dynamically assigned partitions.

    Subscribe to all topics matching specified pattern to get dynamically assigned partitions. The pattern matching will be done periodically against topics existing at the time of check.

    pattern

    pattern to subscribe to

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  14. def SubscribePattern[K, V](pattern: Pattern, kafkaParams: Map[String, AnyRef]): ConsumerStrategy[K, V]

    Subscribe to all topics matching specified pattern to get dynamically assigned partitions.

    Subscribe to all topics matching specified pattern to get dynamically assigned partitions. The pattern matching will be done periodically against topics existing at the time of check.

    pattern

    pattern to subscribe to

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  15. def SubscribePattern[K, V](pattern: Pattern, kafkaParams: Map[String, AnyRef], offsets: Map[TopicPartition, Long]): ConsumerStrategy[K, V]

    Subscribe to all topics matching specified pattern to get dynamically assigned partitions.

    Subscribe to all topics matching specified pattern to get dynamically assigned partitions. The pattern matching will be done periodically against topics existing at the time of check.

    pattern

    pattern to subscribe to

    kafkaParams

    Kafka configuration parameters to be used on driver. The same params will be used on executors, with minor automatic modifications applied. Requires "bootstrap.servers" to be set with Kafka broker(s) specified in host1:port1,host2:port2 form.

  16. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  17. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  18. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  20. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  21. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  22. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  23. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  24. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  25. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  26. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  27. def toString(): String
    Definition Classes
    AnyRef → Any
  28. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  30. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated
    Deprecated

Inherited from AnyRef

Inherited from Any

Ungrouped