A B C D E G H K O P R S T U W
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- AWSClientsProvider - Interface in org.apache.beam.sdk.io.kinesis
-
Provides instances of AWS clients.
- AwsSerializableUtils - Class in org.apache.beam.sdk.io.kinesis.serde
-
Utilities for working with AWS Serializables.
- AwsSerializableUtils() - Constructor for class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils
B
- builder() - Static method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
- buildExternal(KinesisTransformRegistrar.ReadDataBuilder.Configuration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder
- buildExternal(KinesisTransformRegistrar.WriteBuilder.Configuration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder
C
- Configuration() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- Configuration() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration
- create() - Static method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
- createKinesisProducer(KinesisProducerConfiguration) - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider
- createWatermarkPolicy() - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
D
- DefaultRateLimiter(BackOff, BackOff) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
- DefaultRateLimiter(Duration, Duration, Duration) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
- DelayIntervalRateLimiter() - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
- DelayIntervalRateLimiter(Supplier<Duration>) - Constructor for class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
- deserialize(String) - Static method in class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils
E
- equals(Object) - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- expand(PBegin) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.
- expand(PCollection<byte[]>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.
G
- getApproximateArrivalTimestamp() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getCloudWatchClient() - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider
- getData() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getDataAsBytes() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getExplicitHashKey(byte[]) - Method in interface org.apache.beam.sdk.io.kinesis.KinesisPartitioner
- getExtendedSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getKinesisClient() - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider
- getPartitionKey() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getPartitionKey(byte[]) - Method in interface org.apache.beam.sdk.io.kinesis.KinesisPartitioner
- getRateLimitPolicy() - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
- getReadTime() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getShardId() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getStreamName() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getSubSequenceNumber() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getUniqueId() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
- getWatermark() - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicy
- getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy
- getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy
- getWatermark() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
H
- hashCode() - Method in class org.apache.beam.sdk.io.kinesis.KinesisRecord
K
- KinesisClientThrottledException - Exception in org.apache.beam.sdk.io.kinesis
-
Thrown when the Kinesis client was throttled due to rate limits.
- KinesisClientThrottledException(String, AmazonClientException) - Constructor for exception org.apache.beam.sdk.io.kinesis.KinesisClientThrottledException
- KinesisIO - Class in org.apache.beam.sdk.io.kinesis
-
Deprecated.Module
beam-sdks-java-io-kinesis
is deprecated and will be eventually removed. Please migrate toorg.apache.beam.sdk.io.aws2.kinesis.KinesisIO
in modulebeam-sdks-java-io-amazon-web-services2
. - KinesisIO() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO
-
Deprecated.
- KinesisIO.Read<T> - Class in org.apache.beam.sdk.io.kinesis
-
Deprecated.Implementation of
KinesisIO.read()
. - KinesisIO.Write - Class in org.apache.beam.sdk.io.kinesis
-
Deprecated.Implementation of
KinesisIO.write()
. - KinesisPartitioner - Interface in org.apache.beam.sdk.io.kinesis
-
Kinesis interface for custom partitioner.
- KinesisRecord - Class in org.apache.beam.sdk.io.kinesis
-
UserRecord
enhanced with utility methods. - KinesisRecord(UserRecord, String, String) - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisRecord
- KinesisRecord(ByteBuffer, String, long, String, Instant, Instant, String, String) - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisRecord
- KinesisTransformRegistrar - Class in org.apache.beam.sdk.io.kinesis
-
Exposes
KinesisIO.Write
andKinesisIO.Read
as an external transform for cross-language usage. - KinesisTransformRegistrar() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar
- KinesisTransformRegistrar.ReadDataBuilder - Class in org.apache.beam.sdk.io.kinesis
- KinesisTransformRegistrar.ReadDataBuilder.Configuration - Class in org.apache.beam.sdk.io.kinesis
- KinesisTransformRegistrar.WriteBuilder - Class in org.apache.beam.sdk.io.kinesis
- KinesisTransformRegistrar.WriteBuilder.Configuration - Class in org.apache.beam.sdk.io.kinesis
- knownBuilderInstances() - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar
O
- onSuccess(List<KinesisRecord>) - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicy
-
Called after Kinesis records are successfully retrieved.
- onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
- onSuccess(List<KinesisRecord>) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DelayIntervalRateLimiter
- onThrottle(KinesisClientThrottledException) - Method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicy
-
Called after the Kinesis client is throttled.
- onThrottle(KinesisClientThrottledException) - Method in class org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory.DefaultRateLimiter
- org.apache.beam.sdk.io.kinesis - package org.apache.beam.sdk.io.kinesis
-
Transforms for reading and writing from Amazon Kinesis.
- org.apache.beam.sdk.io.kinesis.serde - package org.apache.beam.sdk.io.kinesis.serde
-
Defines serializers / deserializers for AWS.
P
- ProcessingTimeWatermarkPolicy() - Constructor for class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
R
- RateLimitPolicy - Interface in org.apache.beam.sdk.io.kinesis
- RateLimitPolicyFactory - Interface in org.apache.beam.sdk.io.kinesis
-
Implement this interface to create a
RateLimitPolicy
. - RateLimitPolicyFactory.DefaultRateLimiter - Class in org.apache.beam.sdk.io.kinesis
-
Default rate limiter that throttles reading from a shard using an exponential backoff if the response is empty or if the consumer is throttled by AWS.
- RateLimitPolicyFactory.DelayIntervalRateLimiter - Class in org.apache.beam.sdk.io.kinesis
- read() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO
-
Deprecated.Returns a new
KinesisIO.Read
transform for reading from Kinesis. - Read() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.
- READ_DATA_URN - Static variable in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar
- readData() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO
-
Deprecated.A
PTransform
to read from Kinesis stream as bytes without metadata and returns aPCollection
ofbyte
. - ReadDataBuilder() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder
S
- serialize(AWSCredentialsProvider) - Static method in class org.apache.beam.sdk.io.kinesis.serde.AwsSerializableUtils
- setInitialPositionInStream(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setInitialTimestampInStream(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setMaxCapacityPerShard(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setMaxNumRecords(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setMaxReadTime(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setPartitionKey(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration
- setProducerProperties(Map<String, String>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder.Configuration
- setRateLimit(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setRequestRecordsLimit(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setUpToDateThreshold(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setWatermarkIdleDurationThreshold(Long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
- setWatermarkPolicy(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.ReadDataBuilder.Configuration
T
- toBuilder() - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
U
- update(KinesisRecord) - Method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicy
- update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy
- update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.CustomWatermarkPolicy
- update(KinesisRecord) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy
W
- WatermarkParameters - Class in org.apache.beam.sdk.io.kinesis
-
WatermarkParameters
contains the parameters used for watermark computation. - WatermarkParameters() - Constructor for class org.apache.beam.sdk.io.kinesis.WatermarkParameters
- WatermarkPolicy - Interface in org.apache.beam.sdk.io.kinesis
-
Implement this interface to define a custom watermark calculation heuristic.
- WatermarkPolicyFactory - Interface in org.apache.beam.sdk.io.kinesis
-
Implement this interface to create a
WatermarkPolicy
. - WatermarkPolicyFactory.ArrivalTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis
-
ArrivalTimeWatermarkPolicy uses
WatermarkPolicyFactory.CustomWatermarkPolicy
for watermark computation. - WatermarkPolicyFactory.CustomWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis
-
CustomWatermarkPolicy uses parameters defined in
WatermarkParameters
to compute watermarks. - WatermarkPolicyFactory.ProcessingTimeWatermarkPolicy - Class in org.apache.beam.sdk.io.kinesis
-
Watermark policy where the processing time is used as the event time.
- withArrivalTimePolicy() - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
-
Returns an ArrivalTimeWatermarkPolicy.
- withArrivalTimePolicy(Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
-
Returns an ArrivalTimeWatermarkPolicy.
- withArrivalTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies the
WatermarkPolicyFactory
as ArrivalTimeWatermarkPolicyFactory. - withArrivalTimeWatermarkPolicy(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies the
WatermarkPolicyFactory
as ArrivalTimeWatermarkPolicyFactory. - withAWSClientsProvider(AWSCredentialsProvider, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify
AWSCredentialsProvider
and region to be used to read from Kinesis. - withAWSClientsProvider(AWSCredentialsProvider, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify
AWSCredentialsProvider
and region to be used to write to Kinesis. - withAWSClientsProvider(AWSCredentialsProvider, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify
AWSCredentialsProvider
and region to be used to read from Kinesis. - withAWSClientsProvider(AWSCredentialsProvider, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify
AWSCredentialsProvider
and region to be used to write to Kinesis. - withAWSClientsProvider(AWSCredentialsProvider, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify
AWSCredentialsProvider
and region to be used to read from Kinesis. - withAWSClientsProvider(AWSCredentialsProvider, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify credential details and region to be used to write to Kinesis.
- withAWSClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify credential details and region to be used to read from Kinesis.
- withAWSClientsProvider(String, String, Regions) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify credential details and region to be used to write to Kinesis.
- withAWSClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify credential details and region to be used to read from Kinesis.
- withAWSClientsProvider(String, String, Regions, String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify credential details and region to be used to write to Kinesis.
- withAWSClientsProvider(String, String, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify credential details and region to be used to read from Kinesis.
- withAWSClientsProvider(String, String, Regions, String, boolean) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify credential details and region to be used to write to Kinesis.
- withAWSClientsProvider(AWSClientsProvider) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Allows to specify custom
AWSClientsProvider
. - withAWSClientsProvider(AWSClientsProvider) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Allows to specify custom
AWSClientsProvider
. - withCustomRateLimitPolicy(RateLimitPolicyFactory) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies the
RateLimitPolicyFactory
for a custom rate limiter. - withCustomWatermarkPolicy(WatermarkParameters) - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
-
Returns an custom WatermarkPolicyFactory.
- withCustomWatermarkPolicy(WatermarkPolicyFactory) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies the
WatermarkPolicyFactory
as a custom watermarkPolicyFactory. - withDefaultRateLimiter() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
- withDefaultRateLimiter(Duration, Duration, Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
- withDelay(Supplier<Duration>) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
- withDynamicDelayRateLimitPolicy(Supplier<Duration>) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies a dynamic delay rate limit policy with the given function being called at each polling interval to get the next delay value.
- withFixedDelay() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
- withFixedDelay(Duration) - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
- withFixedDelayRateLimitPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies a fixed delay rate limit policy with the default delay of 1 second.
- withFixedDelayRateLimitPolicy(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies a fixed delay rate limit policy with the given delay.
- withInitialPositionInStream(InitialPositionInStream) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify reading from some initial position in stream.
- withInitialTimestampInStream(Instant) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify reading beginning at given
Instant
. - withMaxCapacityPerShard(Integer) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies the maximum number of messages per one shard.
- withMaxNumRecords(long) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies to read at most a given number of records.
- withMaxReadTime(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies to read records during
maxReadTime
. - withoutLimiter() - Static method in interface org.apache.beam.sdk.io.kinesis.RateLimitPolicyFactory
- withPartitioner(KinesisPartitioner) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Allows to specify custom implementation of
KinesisPartitioner
. - withPartitionKey(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify default partition key.
- withProcessingTimePolicy() - Static method in interface org.apache.beam.sdk.io.kinesis.WatermarkPolicyFactory
-
Returns an ProcessingTimeWatermarkPolicy.
- withProcessingTimeWatermarkPolicy() - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies the
WatermarkPolicyFactory
as ProcessingTimeWatermarkPolicyFactory. - withProducerProperties(Properties) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify the configuration properties for Kinesis Producer Library (KPL).
- withRequestRecordsLimit(int) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies the maximum number of records in GetRecordsResult returned by GetRecords call which is limited by 10K records.
- withStreamName(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specify reading from streamName.
- withStreamName(String) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.Specify Kinesis stream name which will be used for writing, this name is required.
- withTimestampFn(SerializableFunction<KinesisRecord, Instant>) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
-
Specify the
SerializableFunction
to extract the event time from aKinesisRecord
. - withUpToDateThreshold(Duration) - Method in class org.apache.beam.sdk.io.kinesis.KinesisIO.Read
-
Deprecated.Specifies how late records consumed by this source can be to still be considered on time.
- withWatermarkIdleDurationThreshold(Duration) - Method in class org.apache.beam.sdk.io.kinesis.WatermarkParameters
-
Specify the watermark idle duration to consider before advancing the watermark.
- write() - Static method in class org.apache.beam.sdk.io.kinesis.KinesisIO
-
Deprecated.A
PTransform
writing data to Kinesis. - Write() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisIO.Write
-
Deprecated.
- WRITE_URN - Static variable in class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar
- WriteBuilder() - Constructor for class org.apache.beam.sdk.io.kinesis.KinesisTransformRegistrar.WriteBuilder
All Classes All Packages