@Experimental(SOURCE_SINK)
Package org.apache.beam.sdk.io.kinesis
Transforms for reading and writing from Amazon Kinesis.
-
Interface Summary Interface Description AWSClientsProvider Provides instances of AWS clients.KinesisPartitioner Kinesis interface for custom partitioner.RateLimitPolicy RateLimitPolicyFactory Implement this interface to create aRateLimitPolicy
.WatermarkPolicy Implement this interface to define a custom watermark calculation heuristic.WatermarkPolicyFactory Implement this interface to create aWatermarkPolicy
. -
Class Summary Class Description KinesisIO Deprecated. Modulebeam-sdks-java-io-kinesis
is deprecated and will be eventually removed.KinesisIO.Read<T> Implementation ofKinesisIO.read()
.KinesisIO.Write Implementation ofKinesisIO.write()
.KinesisRecord UserRecord
enhanced with utility methods.KinesisTransformRegistrar ExposesKinesisIO.Write
andKinesisIO.Read
as an external transform for cross-language usage.KinesisTransformRegistrar.ReadDataBuilder KinesisTransformRegistrar.ReadDataBuilder.Configuration KinesisTransformRegistrar.WriteBuilder KinesisTransformRegistrar.WriteBuilder.Configuration RateLimitPolicyFactory.DefaultRateLimiter Default rate limiter that throttles reading from a shard using an exponential backoff if the response is empty or if the consumer is throttled by AWS.RateLimitPolicyFactory.DelayIntervalRateLimiter WatermarkParameters WatermarkParameters
contains the parameters used for watermark computation.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy ArrivalTimeWatermarkPolicy usesWatermarkPolicyFactory.CustomWatermarkPolicy
for watermark computation.WatermarkPolicyFactory.CustomWatermarkPolicy CustomWatermarkPolicy uses parameters defined inWatermarkParameters
to compute watermarks.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy Watermark policy where the processing time is used as the event time. -
Exception Summary Exception Description KinesisClientThrottledException Thrown when the Kinesis client was throttled due to rate limits.