Index
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form
A
- ack(Object) - Method in class org.apache.storm.kafka.spout.KafkaSpout
- activate() - Method in class org.apache.storm.kafka.spout.KafkaSpout
- addToAckMsgs(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
- addToEmitMsgs(long) - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
- apply(ConsumerRecord<K, V>) - Method in class org.apache.storm.kafka.spout.ByTopicRecordTranslator
- apply(ConsumerRecord<K, V>) - Method in class org.apache.storm.kafka.spout.DefaultRecordTranslator
- apply(ConsumerRecord<K, V>) - Method in interface org.apache.storm.kafka.spout.RecordTranslator
-
Translate the ConsumerRecord into a list of objects that can be emitted.
- apply(ConsumerRecord<K, V>) - Method in class org.apache.storm.kafka.spout.SimpleRecordTranslator
- apply(V) - Method in interface org.apache.storm.kafka.spout.Func
- assignPartitions(Consumer<K, V>, Set<TopicPartition>, ConsumerRebalanceListener) - Method in class org.apache.storm.kafka.spout.subscription.TopicAssigner
-
Assign partitions to the KafkaConsumer.
- AT_LEAST_ONCE - Enum constant in enum org.apache.storm.kafka.spout.KafkaSpoutConfig.ProcessingGuarantee
-
An offset is ready to commit only after the corresponding tuple has been processed and acked (at least once).
- AT_MOST_ONCE - Enum constant in enum org.apache.storm.kafka.spout.KafkaSpoutConfig.ProcessingGuarantee
-
Every offset will be synchronously committed to Kafka right after being polled but before being emitted to the downstream components of the topology.
B
- beginCommit(Long) - Method in class org.apache.storm.kafka.trident.TridentKafkaState
- BOLT_KEY - Static variable in class org.apache.storm.kafka.bolt.mapper.FieldNameBasedTupleToKafkaMapper
- BOLT_MESSAGE - Static variable in class org.apache.storm.kafka.bolt.mapper.FieldNameBasedTupleToKafkaMapper
- boltKeyField - Variable in class org.apache.storm.kafka.bolt.mapper.FieldNameBasedTupleToKafkaMapper
- boltMessageField - Variable in class org.apache.storm.kafka.bolt.mapper.FieldNameBasedTupleToKafkaMapper
- build() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
- build() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
- build() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig.Builder
- builder(String, String...) - Static method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
-
Factory method that creates a Builder with String key/value deserializers.
- builder(String, String...) - Static method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig
-
Factory method that creates a Builder with String key/value deserializers.
- builder(String, Pattern) - Static method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
-
Factory method that creates a Builder with String key/value deserializers.
- builder(String, Pattern) - Static method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig
-
Factory method that creates a Builder with String key/value deserializers.
- builder(String, Set<String>) - Static method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
-
Factory method that creates a Builder with String key/value deserializers.
- builder(String, Set<String>) - Static method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig
-
Factory method that creates a Builder with String key/value deserializers.
- Builder(String, String...) - Constructor for class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
- Builder(String, String...) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
- Builder(String, String...) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig.Builder
- Builder(String, Pattern) - Constructor for class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
- Builder(String, Pattern) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
- Builder(String, Pattern) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig.Builder
- Builder(String, Set<String>) - Constructor for class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
- Builder(String, Set<String>) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
- Builder(String, Set<String>) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig.Builder
- Builder(String, TopicFilter, ManualPartitioner) - Constructor for class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Create a KafkaSpoutConfig builder with default property values and no key/value deserializers.
- Builder(String, TopicFilter, ManualPartitioner) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Create a KafkaSpoutConfig builder with default property values and no key/value deserializers.
- Builder(String, TopicFilter, ManualPartitioner) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig.Builder
- ByTopicRecordTranslator<K,
V> - Class in org.apache.storm.kafka.spout -
Based off of a given Kafka topic a ConsumerRecord came from it will be translated to a Storm tuple and emitted to a given stream.
- ByTopicRecordTranslator(Func<ConsumerRecord<K, V>, List<Object>>, Fields) - Constructor for class org.apache.storm.kafka.spout.ByTopicRecordTranslator
-
Create a simple record translator that will use func to extract the fields of the tuple, named by fields, and emit them to the default stream.
- ByTopicRecordTranslator(Func<ConsumerRecord<K, V>, List<Object>>, Fields, String) - Constructor for class org.apache.storm.kafka.spout.ByTopicRecordTranslator
-
Create a simple record translator that will use func to extract the fields of the tuple, named by fields, and emit them to stream.
- ByTopicRecordTranslator(RecordTranslator<K, V>) - Constructor for class org.apache.storm.kafka.spout.ByTopicRecordTranslator
-
Create a record translator with the given default translator.
C
- cleanup() - Method in class org.apache.storm.kafka.bolt.KafkaBolt
- close() - Method in class org.apache.storm.kafka.spout.KafkaSpout
- close() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentOpaqueSpoutEmitter
- close() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutCoordinator
- close() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutEmitter
- close() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentTransactionalSpoutEmitter
- collector - Variable in class org.apache.storm.kafka.spout.KafkaSpout
- commit(Long) - Method in class org.apache.storm.kafka.trident.TridentKafkaState
- commit(OffsetAndMetadata) - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
-
Marks an offset as committed.
- CommitMetadata - Class in org.apache.storm.kafka.spout.internal
-
Object representing metadata committed to Kafka.
- CommitMetadata(String, int, String) - Constructor for class org.apache.storm.kafka.spout.internal.CommitMetadata
-
Kafka metadata.
- CommitMetadataManager - Class in org.apache.storm.kafka.spout.internal
-
Generates and reads commit metadata.
- CommitMetadataManager(TopologyContext, KafkaSpoutConfig.ProcessingGuarantee) - Constructor for class org.apache.storm.kafka.spout.internal.CommitMetadataManager
-
Create a manager with the given context.
- CommonKafkaSpoutConfig<K,
V> - Class in org.apache.storm.kafka.spout.internal - CommonKafkaSpoutConfig(CommonKafkaSpoutConfig.Builder<K, V, ?>) - Constructor for class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
-
Creates a new CommonKafkaSpoutConfig using a Builder.
- CommonKafkaSpoutConfig.Builder<K,
V, T extends CommonKafkaSpoutConfig.Builder<K, V, T>> - Class in org.apache.storm.kafka.spout.internal - compare(TopicPartition, TopicPartition) - Method in class org.apache.storm.kafka.spout.TopicPartitionComparator
- ConsumerFactory<K,
V> - Interface in org.apache.storm.kafka.spout.internal -
This is here to enable testing.
- ConsumerFactoryDefault<K,
V> - Class in org.apache.storm.kafka.spout.internal - ConsumerFactoryDefault() - Constructor for class org.apache.storm.kafka.spout.internal.ConsumerFactoryDefault
- contains(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
- createConsumer(Map<String, Object>) - Method in interface org.apache.storm.kafka.spout.internal.ConsumerFactory
- createConsumer(Map<String, Object>) - Method in class org.apache.storm.kafka.spout.internal.ConsumerFactoryDefault
D
- deactivate() - Method in class org.apache.storm.kafka.spout.KafkaSpout
- declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
- declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.kafka.spout.KafkaSpout
- DEFAULT_FIRST_POLL_OFFSET_STRATEGY - Static variable in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- DEFAULT_MAX_RETRIES - Static variable in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- DEFAULT_MAX_UNCOMMITTED_OFFSETS - Static variable in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- DEFAULT_METRICS_TIME_BUCKET_SIZE_SECONDS - Static variable in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- DEFAULT_OFFSET_COMMIT_PERIOD_MS - Static variable in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- DEFAULT_PARTITION_REFRESH_PERIOD_MS - Static variable in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- DEFAULT_POLL_TIMEOUT_MS - Static variable in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- DEFAULT_PROCESSING_GUARANTEE - Static variable in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- DEFAULT_RETRY_SERVICE - Static variable in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- DEFAULT_START_TS - Static variable in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- DEFAULT_STREAM - Static variable in interface org.apache.storm.kafka.spout.RecordTranslator
- DEFAULT_TUPLE_LISTENER - Static variable in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- DefaultRecordTranslator<K,
V> - Class in org.apache.storm.kafka.spout - DefaultRecordTranslator() - Constructor for class org.apache.storm.kafka.spout.DefaultRecordTranslator
- DefaultTopicSelector - Class in org.apache.storm.kafka.bolt.selector
- DefaultTopicSelector - Class in org.apache.storm.kafka.trident.selector
- DefaultTopicSelector(String) - Constructor for class org.apache.storm.kafka.bolt.selector.DefaultTopicSelector
- DefaultTopicSelector(String) - Constructor for class org.apache.storm.kafka.trident.selector.DefaultTopicSelector
- delay() - Method in class org.apache.storm.kafka.spout.internal.Timer
E
- EARLIEST - Enum constant in enum org.apache.storm.kafka.spout.FirstPollOffsetStrategy
-
The kafka spout polls records starting in the first offset of the partition, regardless of previous commits.
- earliestRetriableOffsets() - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- earliestRetriableOffsets() - Method in interface org.apache.storm.kafka.spout.KafkaSpoutRetryService
-
Gets the earliest retriable offsets.
- emitPartitionBatch(TransactionAttempt, TridentCollector, KafkaTridentSpoutTopicPartition, Map<String, Object>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentOpaqueSpoutEmitter
- emitPartitionBatch(TransactionAttempt, TridentCollector, KafkaTridentSpoutTopicPartition, Map<String, Object>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentTransactionalSpoutEmitter
- emitPartitionBatchNew(TransactionAttempt, TridentCollector, KafkaTridentSpoutTopicPartition, Map<String, Object>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutEmitter
-
Emit a new batch.
- emitPartitionBatchNew(TransactionAttempt, TridentCollector, KafkaTridentSpoutTopicPartition, Map<String, Object>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentTransactionalSpoutEmitter
- EmptyKafkaTupleListener - Class in org.apache.storm.kafka.spout
- EmptyKafkaTupleListener() - Constructor for class org.apache.storm.kafka.spout.EmptyKafkaTupleListener
- equals(Object) - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- equals(Object) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTopicPartition
F
- fail(Object) - Method in class org.apache.storm.kafka.spout.KafkaSpout
- FieldIndexTopicSelector - Class in org.apache.storm.kafka.bolt.selector
-
Uses field with a given index to select the topic name from a tuple .
- FieldIndexTopicSelector(int, String) - Constructor for class org.apache.storm.kafka.bolt.selector.FieldIndexTopicSelector
-
Creates a new FieldIndexTopicSelector.
- FieldNameBasedTupleToKafkaMapper<K,
V> - Class in org.apache.storm.kafka.bolt.mapper - FieldNameBasedTupleToKafkaMapper<K,
V> - Class in org.apache.storm.kafka.trident.mapper - FieldNameBasedTupleToKafkaMapper() - Constructor for class org.apache.storm.kafka.bolt.mapper.FieldNameBasedTupleToKafkaMapper
- FieldNameBasedTupleToKafkaMapper(String, String) - Constructor for class org.apache.storm.kafka.bolt.mapper.FieldNameBasedTupleToKafkaMapper
- FieldNameBasedTupleToKafkaMapper(String, String) - Constructor for class org.apache.storm.kafka.trident.mapper.FieldNameBasedTupleToKafkaMapper
- FieldNameTopicSelector - Class in org.apache.storm.kafka.bolt.selector
-
Uses field name to select topic name from tuple .
- FieldNameTopicSelector(String, String) - Constructor for class org.apache.storm.kafka.bolt.selector.FieldNameTopicSelector
- FIELDS - Static variable in class org.apache.storm.kafka.spout.DefaultRecordTranslator
- findNextCommitOffset(String) - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
-
An offset can only be committed when all emitted records with lower offset have been acked.
- FIRST_OFFSET_KEY - Static variable in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
- FirstPollOffsetStrategy - Enum in org.apache.storm.kafka.spout
-
Defines how the spout seeks the offset to be used in the first poll to Kafka upon topology deployment.
- forTopic(String, Func<ConsumerRecord<K, V>, List<Object>>, Fields) - Method in class org.apache.storm.kafka.spout.ByTopicRecordTranslator
-
Configure a translator for a given topic with tuples to be emitted to the default stream.
- forTopic(String, Func<ConsumerRecord<K, V>, List<Object>>, Fields, String) - Method in class org.apache.storm.kafka.spout.ByTopicRecordTranslator
-
Configure a translator for a given topic.
- forTopic(String, RecordTranslator<K, V>) - Method in class org.apache.storm.kafka.spout.ByTopicRecordTranslator
-
Configure a translator for a given kafka topic.
- fromMap(Map<String, Object>) - Static method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
-
Constructs a metadata object from a Map in the format produced by
KafkaTridentSpoutBatchMetadata.toMap()
. - fromMap(Map<String, Object>) - Method in class org.apache.storm.kafka.spout.trident.TopicPartitionSerializer
-
Deserializes the given map into a TopicPartition.
- Func<V,
R> - Interface in org.apache.storm.kafka.spout -
A simple interface to allow compatibility with non java 8 code bases.
G
- getAllSubscribedPartitions(Consumer<?, ?>) - Method in class org.apache.storm.kafka.spout.subscription.NamedTopicFilter
- getAllSubscribedPartitions(Consumer<?, ?>) - Method in class org.apache.storm.kafka.spout.subscription.PatternTopicFilter
- getAllSubscribedPartitions(Consumer<?, ?>) - Method in interface org.apache.storm.kafka.spout.subscription.TopicFilter
-
Get the Kafka TopicPartitions subscribed to by this set of spouts.
- getCommitMetadata() - Method in class org.apache.storm.kafka.spout.internal.CommitMetadataManager
- getCommittedOffset() - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
- getComponentConfiguration() - Method in class org.apache.storm.kafka.spout.KafkaSpout
- getComponentConfiguration() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutOpaque
- getComponentConfiguration() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTransactional
- getConsumerGroupId() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- getCoordinator(Map<String, Object>, TopologyContext) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutOpaque
- getCoordinator(Map<String, Object>, TopologyContext) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTransactional
- getEmitter(Map<String, Object>, TopologyContext) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutOpaque
- getEmitter(Map<String, Object>, TopologyContext) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTransactional
- getFieldsFor(String) - Method in class org.apache.storm.kafka.spout.ByTopicRecordTranslator
- getFieldsFor(String) - Method in class org.apache.storm.kafka.spout.DefaultRecordTranslator
- getFieldsFor(String) - Method in interface org.apache.storm.kafka.spout.RecordTranslator
-
Get the fields associated with a stream.
- getFieldsFor(String) - Method in class org.apache.storm.kafka.spout.SimpleRecordTranslator
- getFirstOffset() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
- getFirstPollOffsetStrategy() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- getId() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTopicPartition
- getKafkaProps() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
- getKafkaProps() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
-
Gets the properties that will be passed to the KafkaConsumer.
- getKeyFromTuple(TridentTuple) - Method in class org.apache.storm.kafka.trident.mapper.FieldNameBasedTupleToKafkaMapper
- getKeyFromTuple(TridentTuple) - Method in interface org.apache.storm.kafka.trident.mapper.TridentTupleToKafkaMapper
- getKeyFromTuple(Tuple) - Method in class org.apache.storm.kafka.bolt.mapper.FieldNameBasedTupleToKafkaMapper
- getKeyFromTuple(Tuple) - Method in interface org.apache.storm.kafka.bolt.mapper.TupleToKafkaMapper
- getLastOffset() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
- getLatestEmittedOffset() - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
- getMaxUncommittedOffsets() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- getMessageFromTuple(TridentTuple) - Method in class org.apache.storm.kafka.trident.mapper.FieldNameBasedTupleToKafkaMapper
- getMessageFromTuple(TridentTuple) - Method in interface org.apache.storm.kafka.trident.mapper.TridentTupleToKafkaMapper
- getMessageFromTuple(Tuple) - Method in class org.apache.storm.kafka.bolt.mapper.FieldNameBasedTupleToKafkaMapper
- getMessageFromTuple(Tuple) - Method in interface org.apache.storm.kafka.bolt.mapper.TupleToKafkaMapper
- getMessageId(TopicPartition, long) - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- getMessageId(TopicPartition, long) - Method in interface org.apache.storm.kafka.spout.KafkaSpoutRetryService
-
Gets the
KafkaSpoutMessageId
for the record on the given topic partition and offset. - getMetrics() - Method in class org.apache.storm.kafka.spout.metrics2.KafkaOffsetPartitionMetrics
- getMetrics() - Method in class org.apache.storm.kafka.spout.metrics2.KafkaOffsetTopicMetrics
- getMetricsTimeBucketSizeInSecs() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- getNthUncommittedOffsetAfterCommittedOffset(int) - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
-
Gets the offset of the nth emitted message after the committed offset.
- getNumUncommittedOffsets() - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
- getOffsetsCommitPeriodMs() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- getOrderedPartitions(List<Map<String, Object>>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentOpaqueSpoutEmitter
- getOrderedPartitions(List<Map<String, Object>>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutEmitter
-
Get the input partitions in sorted order.
- getOrderedPartitions(List<Map<String, Object>>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentTransactionalSpoutEmitter
- getOutputFields() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutOpaque
- getOutputFields() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTransactional
- getOutputFields(KafkaTridentSpoutConfig<K, V>) - Method in class org.apache.storm.kafka.spout.trident.internal.OutputFieldsExtractor
-
Extract the output fields from the config.
- getPartitionRefreshPeriodMs() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- getPartitionsForBatch() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutCoordinator
- getPartitionsForTask(int, int, List<KafkaTridentSpoutTopicPartition>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentOpaqueSpoutEmitter
- getPartitionsForTask(int, int, List<KafkaTridentSpoutTopicPartition>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutEmitter
-
Get the partitions that should be handled by this task.
- getPartitionsForThisTask(List<TopicPartition>, TopologyContext) - Method in interface org.apache.storm.kafka.spout.subscription.ManualPartitioner
-
Filter the list of all partitions handled by this set of spouts to get only the partitions assigned to this task.
- getPartitionsForThisTask(List<TopicPartition>, TopologyContext) - Method in class org.apache.storm.kafka.spout.subscription.RoundRobinManualPartitioner
- getPollTimeoutMs() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- getProcessingGuarantee() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- getRetryService() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- getStartTimeStamp() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- getStream() - Method in class org.apache.storm.kafka.spout.KafkaTuple
- getTaskId() - Method in class org.apache.storm.kafka.spout.internal.CommitMetadata
- getThreadName() - Method in class org.apache.storm.kafka.spout.internal.CommitMetadata
- getTimeUnit() - Method in class org.apache.storm.kafka.spout.internal.Timer
- getTopic(TridentTuple) - Method in class org.apache.storm.kafka.trident.selector.DefaultTopicSelector
- getTopic(TridentTuple) - Method in interface org.apache.storm.kafka.trident.selector.KafkaTopicSelector
- getTopic(Tuple) - Method in class org.apache.storm.kafka.bolt.selector.DefaultTopicSelector
- getTopic(Tuple) - Method in class org.apache.storm.kafka.bolt.selector.FieldIndexTopicSelector
- getTopic(Tuple) - Method in class org.apache.storm.kafka.bolt.selector.FieldNameTopicSelector
- getTopic(Tuple) - Method in interface org.apache.storm.kafka.bolt.selector.KafkaTopicSelector
- getTopicFilter() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- getTopicMetricsMap() - Method in class org.apache.storm.kafka.spout.metrics2.KafkaOffsetMetricManager
- getTopicPartition() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- getTopicPartition() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTopicPartition
- getTopicPartitioner() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- getTopicPartitionMetricsMap() - Method in class org.apache.storm.kafka.spout.metrics2.KafkaOffsetMetricManager
- getTopicsPattern() - Method in class org.apache.storm.kafka.spout.subscription.PatternTopicFilter
- getTopicsString() - Method in class org.apache.storm.kafka.spout.subscription.NamedTopicFilter
- getTopicsString() - Method in class org.apache.storm.kafka.spout.subscription.PatternTopicFilter
- getTopicsString() - Method in interface org.apache.storm.kafka.spout.subscription.TopicFilter
-
Get the topics string.
- getTopologyId() - Method in class org.apache.storm.kafka.spout.internal.CommitMetadata
- getTopologyId() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
- getTranslator() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- getTupleListener() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
H
- hasCommitted() - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
-
Checks if this OffsetManager has committed to Kafka.
- hashCode() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- hashCode() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTopicPartition
I
- incrementNumFails() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- INSTANCE - Static variable in class org.apache.storm.kafka.spout.TopicPartitionComparator
- isEmitNullTuples() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- isExpiredResetOnTrue() - Method in class org.apache.storm.kafka.spout.internal.Timer
-
Checks if a call to this method occurs later than
period
since the timer was initiated or reset. - isNullTuple() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- isOffsetCommittedByThisTopology(TopicPartition, OffsetAndMetadata, Map<TopicPartition, OffsetManager>) - Method in class org.apache.storm.kafka.spout.internal.CommitMetadataManager
-
Checks if
OffsetAndMetadata
was committed by aKafkaSpout
instance in this topology. - isReady(long) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutCoordinator
- isReady(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- isReady(KafkaSpoutMessageId) - Method in interface org.apache.storm.kafka.spout.KafkaSpoutRetryService
-
Checks if a specific failed
KafkaSpoutMessageId
is ready to be retried, i.e is scheduled and has retry time that is less than current time. - isScheduled(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- isScheduled(KafkaSpoutMessageId) - Method in interface org.apache.storm.kafka.spout.KafkaSpoutRetryService
-
Checks if a specific failed
KafkaSpoutMessageId
is scheduled to be retried. - isTupleTrackingEnforced() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
K
- KafkaBolt<K,
V> - Class in org.apache.storm.kafka.bolt -
Bolt implementation that can send Tuple data to Kafka.
- KafkaBolt() - Constructor for class org.apache.storm.kafka.bolt.KafkaBolt
- KafkaOffsetMetricManager<K,
V> - Class in org.apache.storm.kafka.spout.metrics2 -
This class is used to manage both the partition and topic level offset metrics.
- KafkaOffsetMetricManager(Supplier<Map<TopicPartition, OffsetManager>>, Supplier<Consumer<K, V>>, TopologyContext) - Constructor for class org.apache.storm.kafka.spout.metrics2.KafkaOffsetMetricManager
- KafkaOffsetPartitionMetrics<K,
V> - Class in org.apache.storm.kafka.spout.metrics2 -
Partition level metrics.
- KafkaOffsetPartitionMetrics(Supplier<Map<TopicPartition, OffsetManager>>, Supplier<Consumer<K, V>>, TopicPartition, KafkaOffsetTopicMetrics) - Constructor for class org.apache.storm.kafka.spout.metrics2.KafkaOffsetPartitionMetrics
- KafkaOffsetTopicMetrics - Class in org.apache.storm.kafka.spout.metrics2
-
Topic level metrics.
- KafkaOffsetTopicMetrics(String) - Constructor for class org.apache.storm.kafka.spout.metrics2.KafkaOffsetTopicMetrics
- KafkaSpout<K,
V> - Class in org.apache.storm.kafka.spout - KafkaSpout(KafkaSpoutConfig<K, V>) - Constructor for class org.apache.storm.kafka.spout.KafkaSpout
- KafkaSpoutConfig<K,
V> - Class in org.apache.storm.kafka.spout -
KafkaSpoutConfig defines the required configuration to connect a consumer to a consumer group, as well as the subscribing topics.
- KafkaSpoutConfig(KafkaSpoutConfig.Builder<K, V>) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutConfig
-
Creates a new KafkaSpoutConfig using a Builder.
- KafkaSpoutConfig.Builder<K,
V> - Class in org.apache.storm.kafka.spout - KafkaSpoutConfig.ProcessingGuarantee - Enum in org.apache.storm.kafka.spout
-
This enum controls when the tuple with the
ConsumerRecord
for an offset is marked as processed, i.e. when the offset can be committed to Kafka. - KafkaSpoutMessageId - Class in org.apache.storm.kafka.spout
- KafkaSpoutMessageId(ConsumerRecord<?, ?>) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- KafkaSpoutMessageId(ConsumerRecord<?, ?>, boolean) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- KafkaSpoutMessageId(TopicPartition, long) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- KafkaSpoutMessageId(TopicPartition, long, boolean) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutMessageId
-
Creates a new KafkaSpoutMessageId.
- KafkaSpoutRetryExponentialBackoff - Class in org.apache.storm.kafka.spout
-
Implementation of
KafkaSpoutRetryService
using the exponential backoff formula. - KafkaSpoutRetryExponentialBackoff(KafkaSpoutRetryExponentialBackoff.TimeInterval, KafkaSpoutRetryExponentialBackoff.TimeInterval, int, KafkaSpoutRetryExponentialBackoff.TimeInterval) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
-
The time stamp of the next retry is scheduled according to the exponential backoff formula (geometric progression): nextRetry = failCount == 1 ?
- KafkaSpoutRetryExponentialBackoff.TimeInterval - Class in org.apache.storm.kafka.spout
- KafkaSpoutRetryService - Interface in org.apache.storm.kafka.spout
-
Represents the logic that manages the retrial of failed tuples.
- KafkaTopicSelector - Interface in org.apache.storm.kafka.bolt.selector
- KafkaTopicSelector - Interface in org.apache.storm.kafka.trident.selector
- KafkaTridentOpaqueSpoutEmitter<K,
V> - Class in org.apache.storm.kafka.spout.trident - KafkaTridentOpaqueSpoutEmitter(KafkaTridentSpoutEmitter<K, V>) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentOpaqueSpoutEmitter
- KafkaTridentSpoutBatchMetadata - Class in org.apache.storm.kafka.spout.trident
-
Wraps transaction batch information.
- KafkaTridentSpoutBatchMetadata(long, long, String) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
-
Builds a metadata object.
- KafkaTridentSpoutConfig<K,
V> - Class in org.apache.storm.kafka.spout.trident -
Defines the required Kafka-related configuration for the Trident spouts.
- KafkaTridentSpoutConfig(KafkaTridentSpoutConfig.Builder<K, V>) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutConfig
- KafkaTridentSpoutConfig.Builder<K,
V> - Class in org.apache.storm.kafka.spout.trident - KafkaTridentSpoutCoordinator<K,
V> - Class in org.apache.storm.kafka.spout.trident - KafkaTridentSpoutCoordinator(KafkaTridentSpoutConfig<K, V>) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutCoordinator
-
Creates a new coordinator based on the given spout config.
- KafkaTridentSpoutEmitter<K,
V> - Class in org.apache.storm.kafka.spout.trident - KafkaTridentSpoutEmitter(KafkaTridentSpoutConfig<K, V>, TopologyContext) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutEmitter
-
Create a new Kafka spout emitter.
- KafkaTridentSpoutOpaque<K,
V> - Class in org.apache.storm.kafka.spout.trident - KafkaTridentSpoutOpaque(KafkaTridentSpoutConfig<K, V>) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutOpaque
-
Creates a new opaque transactional Trident Kafka spout.
- KafkaTridentSpoutTopicPartition - Class in org.apache.storm.kafka.spout.trident
-
ISpoutPartition
that wrapsTopicPartition
information. - KafkaTridentSpoutTopicPartition(String, int) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTopicPartition
- KafkaTridentSpoutTopicPartition(TopicPartition) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTopicPartition
- KafkaTridentSpoutTransactional<K,
V> - Class in org.apache.storm.kafka.spout.trident - KafkaTridentSpoutTransactional(KafkaTridentSpoutConfig<K, V>) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTransactional
-
Creates a new non-opaque transactional Trident Kafka spout.
- KafkaTridentTransactionalSpoutEmitter<K,
V> - Class in org.apache.storm.kafka.spout.trident - KafkaTridentTransactionalSpoutEmitter(KafkaTridentSpoutEmitter<K, V>) - Constructor for class org.apache.storm.kafka.spout.trident.KafkaTridentTransactionalSpoutEmitter
- KafkaTuple - Class in org.apache.storm.kafka.spout
-
A list of Values in a tuple that can be routed to a given stream:
RecordTranslator.apply(org.apache.kafka.clients.consumer.ConsumerRecord<K, V>)
. - KafkaTuple() - Constructor for class org.apache.storm.kafka.spout.KafkaTuple
- KafkaTuple(Object...) - Constructor for class org.apache.storm.kafka.spout.KafkaTuple
- KafkaTupleListener - Interface in org.apache.storm.kafka.spout
-
The KafkaTupleListener handles state changes of a kafka tuple inside a KafkaSpout.
- keyFieldName - Variable in class org.apache.storm.kafka.trident.mapper.FieldNameBasedTupleToKafkaMapper
L
- LAST_OFFSET_KEY - Static variable in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
- LATEST - Enum constant in enum org.apache.storm.kafka.spout.FirstPollOffsetStrategy
-
The kafka spout polls records starting at the end of the partition, regardless of previous commits.
- lengthNanos() - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff.TimeInterval
- LOG - Static variable in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- LOG - Static variable in class org.apache.storm.kafka.spout.KafkaSpoutConfig
M
- makeState(Map<String, Object>, IMetricsContext, int, int) - Method in class org.apache.storm.kafka.trident.TridentKafkaStateFactory
- ManualPartitioner - Interface in org.apache.storm.kafka.spout.subscription
-
A function used to assign partitions to this spout.
- microSeconds(long) - Static method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff.TimeInterval
- milliSeconds(long) - Static method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff.TimeInterval
- mkProducer(Properties) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
-
Intended to be overridden for tests.
- msgFieldName - Variable in class org.apache.storm.kafka.trident.mapper.FieldNameBasedTupleToKafkaMapper
N
- NamedTopicFilter - Class in org.apache.storm.kafka.spout.subscription
-
Filter that returns all partitions for the specified topics.
- NamedTopicFilter(String...) - Constructor for class org.apache.storm.kafka.spout.subscription.NamedTopicFilter
-
Convenience constructor.
- NamedTopicFilter(Set<String>) - Constructor for class org.apache.storm.kafka.spout.subscription.NamedTopicFilter
-
Create filter based on a set of topic names.
- nextTuple() - Method in class org.apache.storm.kafka.spout.KafkaSpout
- NO_GUARANTEE - Enum constant in enum org.apache.storm.kafka.spout.KafkaSpoutConfig.ProcessingGuarantee
-
The polled offsets are ready to commit immediately after being polled.
- numFails() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
O
- offset() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- OffsetManager - Class in org.apache.storm.kafka.spout.internal
-
Manages acked and committed offsets for a TopicPartition.
- OffsetManager(TopicPartition, long) - Constructor for class org.apache.storm.kafka.spout.internal.OffsetManager
-
Creates a new OffsetManager.
- onAck(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.EmptyKafkaTupleListener
- onAck(KafkaSpoutMessageId) - Method in interface org.apache.storm.kafka.spout.KafkaTupleListener
-
Called when a tuple is acked.
- onEmit(List<Object>, KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.EmptyKafkaTupleListener
- onEmit(List<Object>, KafkaSpoutMessageId) - Method in interface org.apache.storm.kafka.spout.KafkaTupleListener
-
Called when the tuple is emitted and auto commit is disabled.
- onMaxRetryReached(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.EmptyKafkaTupleListener
- onMaxRetryReached(KafkaSpoutMessageId) - Method in interface org.apache.storm.kafka.spout.KafkaTupleListener
-
Called when the maximum number of retries have been reached.
- onPartitionsReassigned(Collection<TopicPartition>) - Method in class org.apache.storm.kafka.spout.EmptyKafkaTupleListener
- onPartitionsReassigned(Collection<TopicPartition>) - Method in interface org.apache.storm.kafka.spout.KafkaTupleListener
-
Called when kafka partitions are rebalanced.
- onRetry(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.EmptyKafkaTupleListener
- onRetry(KafkaSpoutMessageId) - Method in interface org.apache.storm.kafka.spout.KafkaTupleListener
-
Called when the Kafka spout sets a record for retry.
- open(Map<String, Object>, TopologyContext) - Method in class org.apache.storm.kafka.spout.EmptyKafkaTupleListener
- open(Map<String, Object>, TopologyContext) - Method in interface org.apache.storm.kafka.spout.KafkaTupleListener
-
Called during the initialization of the kafka spout.
- open(Map<String, Object>, TopologyContext, SpoutOutputCollector) - Method in class org.apache.storm.kafka.spout.KafkaSpout
- org.apache.storm.kafka.bolt - package org.apache.storm.kafka.bolt
- org.apache.storm.kafka.bolt.mapper - package org.apache.storm.kafka.bolt.mapper
- org.apache.storm.kafka.bolt.selector - package org.apache.storm.kafka.bolt.selector
- org.apache.storm.kafka.spout - package org.apache.storm.kafka.spout
- org.apache.storm.kafka.spout.internal - package org.apache.storm.kafka.spout.internal
- org.apache.storm.kafka.spout.metrics2 - package org.apache.storm.kafka.spout.metrics2
- org.apache.storm.kafka.spout.subscription - package org.apache.storm.kafka.spout.subscription
- org.apache.storm.kafka.spout.trident - package org.apache.storm.kafka.spout.trident
- org.apache.storm.kafka.spout.trident.internal - package org.apache.storm.kafka.spout.trident.internal
- org.apache.storm.kafka.trident - package org.apache.storm.kafka.trident
- org.apache.storm.kafka.trident.mapper - package org.apache.storm.kafka.trident.mapper
- org.apache.storm.kafka.trident.selector - package org.apache.storm.kafka.trident.selector
- OutputFieldsExtractor - Class in org.apache.storm.kafka.spout.trident.internal
- OutputFieldsExtractor() - Constructor for class org.apache.storm.kafka.spout.trident.internal.OutputFieldsExtractor
P
- partition() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- PatternTopicFilter - Class in org.apache.storm.kafka.spout.subscription
-
Filter that returns all partitions for topics matching the given
Pattern
. - PatternTopicFilter(Pattern) - Constructor for class org.apache.storm.kafka.spout.subscription.PatternTopicFilter
-
Creates filter based on a Pattern.
- period() - Method in class org.apache.storm.kafka.spout.internal.Timer
- PreparableCallback - Interface in org.apache.storm.kafka.bolt
-
Serializable callback for use with the KafkaProducer on KafkaBolt.
- prepare(Map<String, Object>, TopologyContext) - Method in interface org.apache.storm.kafka.bolt.PreparableCallback
- prepare(Map<String, Object>, TopologyContext, OutputCollector) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
- prepare(Properties) - Method in class org.apache.storm.kafka.trident.TridentKafkaState
-
Prepare this State.
- process(Tuple) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
R
- readyMessageCount() - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- readyMessageCount() - Method in interface org.apache.storm.kafka.spout.KafkaSpoutRetryService
-
Get the number of messages ready for retry.
- RecordTranslator<K,
V> - Interface in org.apache.storm.kafka.spout -
Translate a
ConsumerRecord
to a tuple. - reEmitPartitionBatch(TransactionAttempt, TridentCollector, KafkaTridentSpoutTopicPartition, Map<String, Object>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutEmitter
-
Emit a batch that has already been emitted.
- refreshPartitions(List<KafkaTridentSpoutTopicPartition>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentOpaqueSpoutEmitter
- refreshPartitions(List<KafkaTridentSpoutTopicPartition>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutEmitter
-
Prepare the emitter to handle the input partitions.
- refreshPartitions(List<KafkaTridentSpoutTopicPartition>) - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentTransactionalSpoutEmitter
- registerMetricsForNewTopicPartitions(Set<TopicPartition>) - Method in class org.apache.storm.kafka.spout.metrics2.KafkaOffsetMetricManager
- remove(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- remove(KafkaSpoutMessageId) - Method in interface org.apache.storm.kafka.spout.KafkaSpoutRetryService
-
Removes a message from the list of messages scheduled for retrial.
- retainAll(Collection<TopicPartition>) - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- retainAll(Collection<TopicPartition>) - Method in interface org.apache.storm.kafka.spout.KafkaSpoutRetryService
-
Retains all the messages whose
TopicPartition
belongs to the specifiedCollection<TopicPartition>
. - RoundRobinManualPartitioner - Class in org.apache.storm.kafka.spout.subscription
-
Assign partitions in a round robin fashion for all spouts, not just the ones that are alive.
- RoundRobinManualPartitioner() - Constructor for class org.apache.storm.kafka.spout.subscription.RoundRobinManualPartitioner
- routedTo(String) - Method in class org.apache.storm.kafka.spout.KafkaTuple
-
Sets the target stream of this Tuple.
S
- schedule(KafkaSpoutMessageId) - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- schedule(KafkaSpoutMessageId) - Method in interface org.apache.storm.kafka.spout.KafkaSpoutRetryService
-
Schedules this
KafkaSpoutMessageId
if not yet scheduled, or updates retry time if it has already been scheduled. - seconds(long) - Static method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff.TimeInterval
- setAsync(boolean) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
-
If set to true(the default) the bolt will not wait for the message to be fully sent to Kafka before getting another tuple to send.
- setConsumerGroupId(String) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- setEmitNullTuples(boolean) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Specifies if the spout should emit null tuples to the component downstream, or rather not emit and directly ack them.
- setFireAndForget(boolean) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
-
If set to true the bolt will assume that sending a message to kafka will succeed and will ack the tuple as soon as it has handed the message off to the producer API if false (the default) the message will be acked after it was successfully sent to kafka or failed if it was not successfully sent.
- setFirstPollOffsetStrategy(FirstPollOffsetStrategy) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Sets the offset used by the Kafka spout in the first poll to Kafka broker upon process start.
- setGroupId(String) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Specifies the group id.
- setMaxUncommittedOffsets(int) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Defines the max number of polled offsets (records) that can be pending commit, before another poll can take place.
- setMetricsTimeBucketSizeInSecs(int) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
The time period that metrics data in bucketed into.
- setNullTuple(boolean) - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- setOffsetCommitPeriodMs(long) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Specifies the period, in milliseconds, the offset commit task is periodically called.
- setPartitionRefreshPeriodMs(long) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Sets partition refresh period in milliseconds.
- setPollTimeoutMs(long) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Specifies the time, in milliseconds, spent waiting in poll if data is not available.
- setProcessingGuarantee(KafkaSpoutConfig.ProcessingGuarantee) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Specifies which processing guarantee the spout should offer.
- setProp(String, Object) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Set a
KafkaConsumer
property. - setProp(Map<String, Object>) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Set multiple
KafkaConsumer
properties. - setProp(Properties) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Set multiple
KafkaConsumer
properties. - setRecordTranslator(Func<ConsumerRecord<K, V>, List<Object>>, Fields) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Configure a translator with tuples to be emitted on the default stream.
- setRecordTranslator(Func<ConsumerRecord<K, V>, List<Object>>, Fields, String) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Configure a translator with tuples to be emitted to a given stream.
- setRecordTranslator(RecordTranslator<K, V>) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
- setRetry(KafkaSpoutRetryService) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Sets the retry service for the spout to use.
- setStartTimeStamp(long) - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig.Builder
-
Specifies the startTimeStamp if the first poll strategy is TIMESTAMP or UNCOMMITTED_TIMESTAMP.
- setTupleListener(KafkaTupleListener) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Sets the tuple listener for the spout to use.
- setTupleTrackingEnforced(boolean) - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig.Builder
-
Specifies whether the spout should require Storm to track emitted tuples when using a
KafkaSpoutConfig.ProcessingGuarantee
other thanKafkaSpoutConfig.ProcessingGuarantee.AT_LEAST_ONCE
. - SimpleRecordTranslator<K,
V> - Class in org.apache.storm.kafka.spout - SimpleRecordTranslator(Func<ConsumerRecord<K, V>, List<Object>>, Fields) - Constructor for class org.apache.storm.kafka.spout.SimpleRecordTranslator
- SimpleRecordTranslator(Func<ConsumerRecord<K, V>, List<Object>>, Fields, String) - Constructor for class org.apache.storm.kafka.spout.SimpleRecordTranslator
-
Creates a SimpleRecordTranslator.
- streams() - Method in class org.apache.storm.kafka.spout.ByTopicRecordTranslator
- streams() - Method in interface org.apache.storm.kafka.spout.RecordTranslator
-
Get the list of streams this translator will handle.
- streams() - Method in class org.apache.storm.kafka.spout.SimpleRecordTranslator
T
- TimeInterval(long, TimeUnit) - Constructor for class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff.TimeInterval
-
Creates a new TimeInterval.
- Timer - Class in org.apache.storm.kafka.spout.internal
- Timer(long, long, TimeUnit) - Constructor for class org.apache.storm.kafka.spout.internal.Timer
-
Creates a class that mimics a single threaded timer that expires periodically.
- TIMER_DELAY_MS - Static variable in class org.apache.storm.kafka.spout.KafkaSpout
- TIMER_DELAY_MS - Static variable in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutCoordinator
- TIMESTAMP - Enum constant in enum org.apache.storm.kafka.spout.FirstPollOffsetStrategy
-
The kafka spout polls records starting at the earliest offset whose timestamp is greater than or equal to the given startTimestamp.
- timeUnit() - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff.TimeInterval
- toMap() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
-
Writes this metadata object to a Map so Trident can read/write it to Zookeeper.
- toMap(TopicPartition) - Method in class org.apache.storm.kafka.spout.trident.TopicPartitionSerializer
-
Serializes the given TopicPartition to Map so Trident can serialize it to JSON.
- topic() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- TOPIC - Static variable in class org.apache.storm.kafka.bolt.KafkaBolt
- TOPIC_PARTITION_PARTITION_KEY - Static variable in class org.apache.storm.kafka.spout.trident.TopicPartitionSerializer
- TOPIC_PARTITION_TOPIC_KEY - Static variable in class org.apache.storm.kafka.spout.trident.TopicPartitionSerializer
- TopicAssigner - Class in org.apache.storm.kafka.spout.subscription
-
Handles assigning partitions to the consumer and updating the rebalance listener.
- TopicAssigner() - Constructor for class org.apache.storm.kafka.spout.subscription.TopicAssigner
- TopicFilter - Interface in org.apache.storm.kafka.spout.subscription
- TopicPartitionComparator - Class in org.apache.storm.kafka.spout
-
Singleton comparator of TopicPartitions.
- TopicPartitionSerializer - Class in org.apache.storm.kafka.spout.trident
- TopicPartitionSerializer() - Constructor for class org.apache.storm.kafka.spout.trident.TopicPartitionSerializer
- TOPOLOGY_ID_KEY - Static variable in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
- toString() - Method in class org.apache.storm.kafka.bolt.KafkaBolt
- toString() - Method in class org.apache.storm.kafka.spout.EmptyKafkaTupleListener
- toString() - Method in class org.apache.storm.kafka.spout.internal.CommitMetadata
- toString() - Method in class org.apache.storm.kafka.spout.internal.CommonKafkaSpoutConfig
- toString() - Method in class org.apache.storm.kafka.spout.internal.OffsetManager
- toString() - Method in class org.apache.storm.kafka.spout.KafkaSpout
- toString() - Method in class org.apache.storm.kafka.spout.KafkaSpoutConfig
- toString() - Method in class org.apache.storm.kafka.spout.KafkaSpoutMessageId
- toString() - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff.TimeInterval
- toString() - Method in class org.apache.storm.kafka.spout.KafkaSpoutRetryExponentialBackoff
- toString() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutBatchMetadata
- toString() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutCoordinator
- toString() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutEmitter
- toString() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutOpaque
- toString() - Method in class org.apache.storm.kafka.spout.trident.KafkaTridentSpoutTopicPartition
- TridentKafkaState<K,
V> - Class in org.apache.storm.kafka.trident - TridentKafkaState() - Constructor for class org.apache.storm.kafka.trident.TridentKafkaState
- TridentKafkaStateFactory<K,
V> - Class in org.apache.storm.kafka.trident - TridentKafkaStateFactory() - Constructor for class org.apache.storm.kafka.trident.TridentKafkaStateFactory
- TridentKafkaStateUpdater<K,
V> - Class in org.apache.storm.kafka.trident - TridentKafkaStateUpdater() - Constructor for class org.apache.storm.kafka.trident.TridentKafkaStateUpdater
- TridentTupleToKafkaMapper<K,
V> - Interface in org.apache.storm.kafka.trident.mapper - TupleToKafkaMapper<K,
V> - Interface in org.apache.storm.kafka.bolt.mapper -
Interface defining a mapping from storm tuple to kafka key and message.
U
- UNCOMMITTED_EARLIEST - Enum constant in enum org.apache.storm.kafka.spout.FirstPollOffsetStrategy
-
The kafka spout polls records from the last committed offset, if any.
- UNCOMMITTED_LATEST - Enum constant in enum org.apache.storm.kafka.spout.FirstPollOffsetStrategy
-
The kafka spout polls records from the last committed offset, if any.
- UNCOMMITTED_TIMESTAMP - Enum constant in enum org.apache.storm.kafka.spout.FirstPollOffsetStrategy
-
The kafka spout polls records from the last committed offset, if any.
- updateState(List<TridentTuple>, TridentCollector) - Method in class org.apache.storm.kafka.trident.TridentKafkaState
-
Write the given tuples to Kafka.
- updateState(TridentKafkaState<K, V>, List<TridentTuple>, TridentCollector) - Method in class org.apache.storm.kafka.trident.TridentKafkaStateUpdater
V
- valueOf(String) - Static method in enum org.apache.storm.kafka.spout.FirstPollOffsetStrategy
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.storm.kafka.spout.KafkaSpoutConfig.ProcessingGuarantee
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum org.apache.storm.kafka.spout.FirstPollOffsetStrategy
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.storm.kafka.spout.KafkaSpoutConfig.ProcessingGuarantee
-
Returns an array containing the constants of this enum type, in the order they are declared.
W
- withKafkaTopicSelector(KafkaTopicSelector) - Method in class org.apache.storm.kafka.trident.TridentKafkaState
- withKafkaTopicSelector(KafkaTopicSelector) - Method in class org.apache.storm.kafka.trident.TridentKafkaStateFactory
- withProducerCallback(PreparableCallback) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
-
Sets a user defined callback for use with the KafkaProducer.
- withProducerProperties(Properties) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
- withProducerProperties(Properties) - Method in class org.apache.storm.kafka.trident.TridentKafkaStateFactory
- withTopicSelector(String) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
-
Set the messages to be published to a single topic.
- withTopicSelector(KafkaTopicSelector) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
- withTridentTupleToKafkaMapper(TridentTupleToKafkaMapper<K, V>) - Method in class org.apache.storm.kafka.trident.TridentKafkaState
- withTridentTupleToKafkaMapper(TridentTupleToKafkaMapper<K, V>) - Method in class org.apache.storm.kafka.trident.TridentKafkaStateFactory
- withTupleToKafkaMapper(TupleToKafkaMapper<K, V>) - Method in class org.apache.storm.kafka.bolt.KafkaBolt
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form