A B C D E G H K O P R S T U W 
All Classes All Packages

A

AWSClientsProvider - Interface in org.apache.beam.sdk.io.kinesis
Provides instances of AWS clients.
AwsSerializableUtils - Class in org.apache.beam.sdk.io.kinesis.serde
Utilities for working with AWS Serializables.
AwsSerializableUtils() - Constructor for class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils
 

B

builder() - Static method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
 
buildExternal(KinesisTransformRegistrar.ReadDataBuilder.Configuration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder
 
buildExternal(KinesisTransformRegistrar.WriteBuilder.Configuration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder
 

C

Configuration() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
Configuration() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration
 
create() - Static method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
 
createKinesisProducer(KinesisProducerConfiguration) - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider
 
createWatermarkPolicy() - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
 

D

DefaultRateLimiter(BackOff, BackOff) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
 
DefaultRateLimiter(Duration, Duration, Duration) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
 
DelayIntervalRateLimiter() - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
 
DelayIntervalRateLimiter(Supplier<Duration>) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
 
deserialize(String) - Static method in class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils
 

E

equals(Object) - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
expand(PBegin) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
 
expand(PCollection<byte[]>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
 

G

getApproximateArrivalTimestamp() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getCloudWatchClient() - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider
 
getData() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getDataAsBytes() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getExplicitHashKey(byte[]) - Method in interface org.apache.beam.sdk.io.kinesis.KinesisPartitioner
 
getExtendedSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getKinesisClient() - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider
 
getPartitionKey() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getPartitionKey(byte[]) - Method in interface org.apache.beam.sdk.io.kinesis.KinesisPartitioner
 
getRateLimitPolicy() - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
 
getReadTime() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getShardId() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getStreamName() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getSubSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getUniqueId() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
getWatermark() - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicy
 
getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy
 
getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy
 
getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
 

H

hashCode() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
 

K

KinesisClientThrottledException - Exception in org.apache.beam.sdk.io.kinesis
Thrown when the Kinesis client was throttled due to rate limits.
KinesisClientThrottledException(String, AmazonClientException) - Constructor for exception org.apache.beam.sdk.io.kinesis.KinesisClientThrottledException
 
KinesisIO - Class in org.apache.beam.sdk.io.kinesis
Deprecated.
Module beam-sdks-java-io-kinesis is deprecated and will be eventually removed. Please migrate to org.apache.beam.sdk.io.aws2.kinesis.KinesisIO in module beam-sdks-java-io-amazon-web-services2.
KinesisIO() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO
Deprecated.
 
KinesisIO.Read<T> - Class in org.apache.beam.sdk.io.kinesis
Deprecated.
Implementation of KinesisIO.read().
KinesisIO.Write - Class in org.apache.beam.sdk.io.kinesis
Deprecated.
Implementation of KinesisIO.write().
KinesisPartitioner - Interface in org.apache.beam.sdk.io.kinesis
Kinesis interface for custom partitioner.
KinesisRecord - Class in org.apache.beam.sdk.io.kinesis
UserRecord enhanced with utility methods.
KinesisRecord(UserRecord, String, String) - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
KinesisRecord(ByteBuffer, String, long, String, Instant, Instant, String, String) - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisRecord
 
KinesisTransformRegistrar - Class in org.apache.beam.sdk.io.kinesis
Exposes KinesisIO.Write and KinesisIO.Read as an external transform for cross-language usage.
KinesisTransformRegistrar() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar
 
KinesisTransformRegistrar.ReadDataBuilder - Class in org.apache.beam.sdk.io.kinesis
 
KinesisTransformRegistrar.ReadDataBuilder.Configuration - Class in org.apache.beam.sdk.io.kinesis
 
KinesisTransformRegistrar.WriteBuilder - Class in org.apache.beam.sdk.io.kinesis
 
KinesisTransformRegistrar.WriteBuilder.Configuration - Class in org.apache.beam.sdk.io.kinesis
 
knownBuilderInstances() - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar
 

O

onSuccess(List<KinesisRecord>) - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicy
Called after Kinesis records are successfully retrieved.
onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
 
onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
 
onThrottle(KinesisClientThrottledException) - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicy
Called after the Kinesis client is throttled.
onThrottle(KinesisClientThrottledException) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
 
org.apache.beam.sdk.io.kinesis - package org.apache.beam.sdk.io.kinesis
Transforms for reading and writing from Amazon Kinesis.
org.apache.beam.sdk.io.kinesis.serde - package org.apache.beam.sdk.io.kinesis.serde
Defines serializers / deserializers for AWS.

P

ProcessingTimeWatermarkPolicy() - Constructor for class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
 

R

RateLimitPolicy - Interface in org.apache.beam.sdk.io.kinesis
 
RateLimitPolicyFactory - Interface in org.apache.beam.sdk.io.kinesis
Implement this interface to create a RateLimitPolicy.
RateLimitPolicyFactory.DefaultRateLimiter - Class in org.apache.beam.sdk.io.kinesis
Default rate limiter that throttles reading from a shard using an exponential backoff if the response is empty or if the consumer is throttled by AWS.
RateLimitPolicyFactory.DelayIntervalRateLimiter - Class in org.apache.beam.sdk.io.kinesis
 
read() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO
Deprecated.
Returns a new KinesisIO.Read transform for reading from Kinesis.
Read() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
 
READ_DATA_URN - Static variable in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar
 
readData() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO
Deprecated.
A PTransform to read from Kinesis stream as bytes without metadata and returns a PCollection of byte.
ReadDataBuilder() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder
 

S

serialize(AWSCredentialsProvider) - Static method in class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils
 
setInitialPositionInStream(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setInitialTimestampInStream(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setMaxCapacityPerShard(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setMaxNumRecords(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setMaxReadTime(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setPartitionKey(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration
 
setProducerProperties(Map<String, String>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration
 
setRateLimit(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setRequestRecordsLimit(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setUpToDateThreshold(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setWatermarkIdleDurationThreshold(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 
setWatermarkPolicy(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
 

T

toBuilder() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
 

U

update(KinesisRecord) - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicy
 
update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy
 
update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy
 
update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
 

W

WatermarkParameters - Class in org.apache.beam.sdk.io.kinesis
WatermarkParameters contains the parameters used for watermark computation.
WatermarkParameters() - Constructor for class org.apache.beam.sdk.io.kinesis.WatermarkParameters
 
WatermarkPolicy - Interface in org.apache.beam.sdk.io.kinesis
Implement this interface to define a custom watermark calculation heuristic.
WatermarkPolicyFactory - Interface in org.apache.beam.sdk.io.kinesis
Implement this interface to create a WatermarkPolicy.
WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis
ArrivalTimeWatermarkPolicy uses WatermarkPolicyFactory.CustomWatermarkPolicy for watermark computation.
WatermarkPolicyFactory.CustomWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis
CustomWatermarkPolicy uses parameters defined in WatermarkParameters to compute watermarks.
WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis
Watermark policy where the processing time is used as the event time.
withArrivalTimePolicy() - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
Returns an ArrivalTimeWatermarkPolicy.
withArrivalTimePolicy(Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
Returns an ArrivalTimeWatermarkPolicy.
withArrivalTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies the WatermarkPolicyFactory as ArrivalTimeWatermarkPolicyFactory.
withArrivalTimeWatermarkPolicy(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies the WatermarkPolicyFactory as ArrivalTimeWatermarkPolicyFactory.
withAWSClientsProvider(AWSCredentialsProvider, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify AWSCredentialsProvider and region to be used to read from Kinesis.
withAWSClientsProvider(AWSCredentialsProvider, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify AWSCredentialsProvider and region to be used to write to Kinesis.
withAWSClientsProvider(AWSCredentialsProvider, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify AWSCredentialsProvider and region to be used to read from Kinesis.
withAWSClientsProvider(AWSCredentialsProvider, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify AWSCredentialsProvider and region to be used to write to Kinesis.
withAWSClientsProvider(AWSCredentialsProvider, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify AWSCredentialsProvider and region to be used to read from Kinesis.
withAWSClientsProvider(AWSCredentialsProvider, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify credential details and region to be used to write to Kinesis.
withAWSClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify credential details and region to be used to read from Kinesis.
withAWSClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify credential details and region to be used to write to Kinesis.
withAWSClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify credential details and region to be used to read from Kinesis.
withAWSClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify credential details and region to be used to write to Kinesis.
withAWSClientsProvider(String, String, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify credential details and region to be used to read from Kinesis.
withAWSClientsProvider(String, String, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify credential details and region to be used to write to Kinesis.
withAWSClientsProvider(AWSClientsProvider) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Allows to specify custom AWSClientsProvider.
withAWSClientsProvider(AWSClientsProvider) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Allows to specify custom AWSClientsProvider.
withCustomRateLimitPolicy(RateLimitPolicyFactory) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies the RateLimitPolicyFactory for a custom rate limiter.
withCustomWatermarkPolicy(WatermarkParameters) - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
Returns an custom WatermarkPolicyFactory.
withCustomWatermarkPolicy(WatermarkPolicyFactory) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies the WatermarkPolicyFactory as a custom watermarkPolicyFactory.
withDefaultRateLimiter() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
 
withDefaultRateLimiter(Duration, Duration, Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
 
withDelay(Supplier<Duration>) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
 
withDynamicDelayRateLimitPolicy(Supplier<Duration>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies a dynamic delay rate limit policy with the given function being called at each polling interval to get the next delay value.
withFixedDelay() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
 
withFixedDelay(Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
 
withFixedDelayRateLimitPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies a fixed delay rate limit policy with the default delay of 1 second.
withFixedDelayRateLimitPolicy(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies a fixed delay rate limit policy with the given delay.
withInitialPositionInStream(InitialPositionInStream) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify reading from some initial position in stream.
withInitialTimestampInStream(Instant) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify reading beginning at given Instant.
withMaxCapacityPerShard(Integer) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies the maximum number of messages per one shard.
withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies to read at most a given number of records.
withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies to read records during maxReadTime.
withoutLimiter() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
 
withPartitioner(KinesisPartitioner) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Allows to specify custom implementation of KinesisPartitioner.
withPartitionKey(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify default partition key.
withProcessingTimePolicy() - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
Returns an ProcessingTimeWatermarkPolicy.
withProcessingTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies the WatermarkPolicyFactory as ProcessingTimeWatermarkPolicyFactory.
withProducerProperties(Properties) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify the configuration properties for Kinesis Producer Library (KPL).
withRequestRecordsLimit(int) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies the maximum number of records in GetRecordsResult returned by GetRecords call which is limited by 10K records.
withStreamName(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specify reading from streamName.
withStreamName(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
Specify Kinesis stream name which will be used for writing, this name is required.
withTimestampFn(SerializableFunction<KinesisRecord, Instant>) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
Specify the SerializableFunction to extract the event time from a KinesisRecord.
withUpToDateThreshold(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
Deprecated.
Specifies how late records consumed by this source can be to still be considered on time.
withWatermarkIdleDurationThreshold(Duration) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
Specify the watermark idle duration to consider before advancing the watermark.
write() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO
Deprecated.
A PTransform writing data to Kinesis.
Write() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
Deprecated.
 
WRITE_URN - Static variable in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar
 
WriteBuilder() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder
 
A B C D E G H K O P R S T U W 
All Classes All Packages