@Generated(value="com.amazonaws:aws-java-sdk-code-generator") public class KinesisStreamingSourceOptions extends Object implements Serializable, Cloneable, StructuredPojo
Additional options for the Amazon Kinesis streaming data source.
Constructor and Description |
---|
KinesisStreamingSourceOptions() |
Modifier and Type | Method and Description |
---|---|
KinesisStreamingSourceOptions |
clone() |
boolean |
equals(Object obj) |
Boolean |
getAddIdleTimeBetweenReads()
Adds a time delay between two consecutive getRecords operations.
|
String |
getAddRecordTimestamp()
When this option is set to 'true', the data output will contain an additional column named "__src_timestamp" that
indicates the time when the corresponding record received by the stream.
|
Boolean |
getAvoidEmptyBatches()
Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch
is started.
|
String |
getClassification()
An optional classification.
|
String |
getDelimiter()
Specifies the delimiter character.
|
Long |
getDescribeShardInterval()
The minimum time interval between two ListShards API calls for your script to consider resharding.
|
String |
getEmitConsumerLagMetrics()
When this option is set to 'true', for each batch, it will emit the metrics for the duration between the oldest
record received by the stream and the time it arrives in Glue to CloudWatch.
|
String |
getEndpointUrl()
The URL of the Kinesis endpoint.
|
Long |
getIdleTimeBetweenReadsInMs()
The minimum time delay between two consecutive getRecords operations, specified in ms.
|
Long |
getMaxFetchRecordsPerShard()
The maximum number of records to fetch per shard in the Kinesis data stream.
|
Long |
getMaxFetchTimeInMs()
The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in
milliseconds (ms).
|
Long |
getMaxRecordPerRead()
The maximum number of records to fetch from the Kinesis data stream in each getRecords operation.
|
Long |
getMaxRetryIntervalMs()
The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call.
|
Integer |
getNumRetries()
The maximum number of retries for Kinesis Data Streams API requests.
|
Long |
getRetryIntervalMs()
The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call.
|
String |
getRoleArn()
The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS).
|
String |
getRoleSessionName()
An identifier for the session assuming the role using AWS STS.
|
String |
getStartingPosition()
The starting position in the Kinesis data stream to read data from.
|
Date |
getStartingTimestamp()
The timestamp of the record in the Kinesis data stream to start reading data from.
|
String |
getStreamArn()
The Amazon Resource Name (ARN) of the Kinesis data stream.
|
String |
getStreamName()
The name of the Kinesis data stream.
|
int |
hashCode() |
Boolean |
isAddIdleTimeBetweenReads()
Adds a time delay between two consecutive getRecords operations.
|
Boolean |
isAvoidEmptyBatches()
Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch
is started.
|
void |
marshall(ProtocolMarshaller protocolMarshaller)
Marshalls this structured data using the given
ProtocolMarshaller . |
void |
setAddIdleTimeBetweenReads(Boolean addIdleTimeBetweenReads)
Adds a time delay between two consecutive getRecords operations.
|
void |
setAddRecordTimestamp(String addRecordTimestamp)
When this option is set to 'true', the data output will contain an additional column named "__src_timestamp" that
indicates the time when the corresponding record received by the stream.
|
void |
setAvoidEmptyBatches(Boolean avoidEmptyBatches)
Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch
is started.
|
void |
setClassification(String classification)
An optional classification.
|
void |
setDelimiter(String delimiter)
Specifies the delimiter character.
|
void |
setDescribeShardInterval(Long describeShardInterval)
The minimum time interval between two ListShards API calls for your script to consider resharding.
|
void |
setEmitConsumerLagMetrics(String emitConsumerLagMetrics)
When this option is set to 'true', for each batch, it will emit the metrics for the duration between the oldest
record received by the stream and the time it arrives in Glue to CloudWatch.
|
void |
setEndpointUrl(String endpointUrl)
The URL of the Kinesis endpoint.
|
void |
setIdleTimeBetweenReadsInMs(Long idleTimeBetweenReadsInMs)
The minimum time delay between two consecutive getRecords operations, specified in ms.
|
void |
setMaxFetchRecordsPerShard(Long maxFetchRecordsPerShard)
The maximum number of records to fetch per shard in the Kinesis data stream.
|
void |
setMaxFetchTimeInMs(Long maxFetchTimeInMs)
The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in
milliseconds (ms).
|
void |
setMaxRecordPerRead(Long maxRecordPerRead)
The maximum number of records to fetch from the Kinesis data stream in each getRecords operation.
|
void |
setMaxRetryIntervalMs(Long maxRetryIntervalMs)
The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call.
|
void |
setNumRetries(Integer numRetries)
The maximum number of retries for Kinesis Data Streams API requests.
|
void |
setRetryIntervalMs(Long retryIntervalMs)
The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call.
|
void |
setRoleArn(String roleArn)
The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS).
|
void |
setRoleSessionName(String roleSessionName)
An identifier for the session assuming the role using AWS STS.
|
void |
setStartingPosition(String startingPosition)
The starting position in the Kinesis data stream to read data from.
|
void |
setStartingTimestamp(Date startingTimestamp)
The timestamp of the record in the Kinesis data stream to start reading data from.
|
void |
setStreamArn(String streamArn)
The Amazon Resource Name (ARN) of the Kinesis data stream.
|
void |
setStreamName(String streamName)
The name of the Kinesis data stream.
|
String |
toString()
Returns a string representation of this object.
|
KinesisStreamingSourceOptions |
withAddIdleTimeBetweenReads(Boolean addIdleTimeBetweenReads)
Adds a time delay between two consecutive getRecords operations.
|
KinesisStreamingSourceOptions |
withAddRecordTimestamp(String addRecordTimestamp)
When this option is set to 'true', the data output will contain an additional column named "__src_timestamp" that
indicates the time when the corresponding record received by the stream.
|
KinesisStreamingSourceOptions |
withAvoidEmptyBatches(Boolean avoidEmptyBatches)
Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch
is started.
|
KinesisStreamingSourceOptions |
withClassification(String classification)
An optional classification.
|
KinesisStreamingSourceOptions |
withDelimiter(String delimiter)
Specifies the delimiter character.
|
KinesisStreamingSourceOptions |
withDescribeShardInterval(Long describeShardInterval)
The minimum time interval between two ListShards API calls for your script to consider resharding.
|
KinesisStreamingSourceOptions |
withEmitConsumerLagMetrics(String emitConsumerLagMetrics)
When this option is set to 'true', for each batch, it will emit the metrics for the duration between the oldest
record received by the stream and the time it arrives in Glue to CloudWatch.
|
KinesisStreamingSourceOptions |
withEndpointUrl(String endpointUrl)
The URL of the Kinesis endpoint.
|
KinesisStreamingSourceOptions |
withIdleTimeBetweenReadsInMs(Long idleTimeBetweenReadsInMs)
The minimum time delay between two consecutive getRecords operations, specified in ms.
|
KinesisStreamingSourceOptions |
withMaxFetchRecordsPerShard(Long maxFetchRecordsPerShard)
The maximum number of records to fetch per shard in the Kinesis data stream.
|
KinesisStreamingSourceOptions |
withMaxFetchTimeInMs(Long maxFetchTimeInMs)
The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in
milliseconds (ms).
|
KinesisStreamingSourceOptions |
withMaxRecordPerRead(Long maxRecordPerRead)
The maximum number of records to fetch from the Kinesis data stream in each getRecords operation.
|
KinesisStreamingSourceOptions |
withMaxRetryIntervalMs(Long maxRetryIntervalMs)
The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call.
|
KinesisStreamingSourceOptions |
withNumRetries(Integer numRetries)
The maximum number of retries for Kinesis Data Streams API requests.
|
KinesisStreamingSourceOptions |
withRetryIntervalMs(Long retryIntervalMs)
The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call.
|
KinesisStreamingSourceOptions |
withRoleArn(String roleArn)
The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS).
|
KinesisStreamingSourceOptions |
withRoleSessionName(String roleSessionName)
An identifier for the session assuming the role using AWS STS.
|
KinesisStreamingSourceOptions |
withStartingPosition(StartingPosition startingPosition)
The starting position in the Kinesis data stream to read data from.
|
KinesisStreamingSourceOptions |
withStartingPosition(String startingPosition)
The starting position in the Kinesis data stream to read data from.
|
KinesisStreamingSourceOptions |
withStartingTimestamp(Date startingTimestamp)
The timestamp of the record in the Kinesis data stream to start reading data from.
|
KinesisStreamingSourceOptions |
withStreamArn(String streamArn)
The Amazon Resource Name (ARN) of the Kinesis data stream.
|
KinesisStreamingSourceOptions |
withStreamName(String streamName)
The name of the Kinesis data stream.
|
public void setEndpointUrl(String endpointUrl)
The URL of the Kinesis endpoint.
endpointUrl
- The URL of the Kinesis endpoint.public String getEndpointUrl()
The URL of the Kinesis endpoint.
public KinesisStreamingSourceOptions withEndpointUrl(String endpointUrl)
The URL of the Kinesis endpoint.
endpointUrl
- The URL of the Kinesis endpoint.public void setStreamName(String streamName)
The name of the Kinesis data stream.
streamName
- The name of the Kinesis data stream.public String getStreamName()
The name of the Kinesis data stream.
public KinesisStreamingSourceOptions withStreamName(String streamName)
The name of the Kinesis data stream.
streamName
- The name of the Kinesis data stream.public void setClassification(String classification)
An optional classification.
classification
- An optional classification.public String getClassification()
An optional classification.
public KinesisStreamingSourceOptions withClassification(String classification)
An optional classification.
classification
- An optional classification.public void setDelimiter(String delimiter)
Specifies the delimiter character.
delimiter
- Specifies the delimiter character.public String getDelimiter()
Specifies the delimiter character.
public KinesisStreamingSourceOptions withDelimiter(String delimiter)
Specifies the delimiter character.
delimiter
- Specifies the delimiter character.public void setStartingPosition(String startingPosition)
The starting position in the Kinesis data stream to read data from. The possible values are "latest"
, "trim_horizon"
, "earliest"
, or a timestamp string in UTC format in the pattern
yyyy-mm-ddTHH:MM:SSZ
(where Z
represents a UTC timezone offset with a +/-. For example:
"2023-04-04T08:00:00-04:00"). The default value is "latest"
.
Note: Using a value that is a timestamp string in UTC format for "startingPosition" is supported only for Glue version 4.0 or later.
startingPosition
- The starting position in the Kinesis data stream to read data from. The possible values are
"latest"
, "trim_horizon"
, "earliest"
, or a timestamp string in UTC
format in the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z
represents a UTC timezone
offset with a +/-. For example: "2023-04-04T08:00:00-04:00"). The default value is "latest"
.
Note: Using a value that is a timestamp string in UTC format for "startingPosition" is supported only for Glue version 4.0 or later.
StartingPosition
public String getStartingPosition()
The starting position in the Kinesis data stream to read data from. The possible values are "latest"
, "trim_horizon"
, "earliest"
, or a timestamp string in UTC format in the pattern
yyyy-mm-ddTHH:MM:SSZ
(where Z
represents a UTC timezone offset with a +/-. For example:
"2023-04-04T08:00:00-04:00"). The default value is "latest"
.
Note: Using a value that is a timestamp string in UTC format for "startingPosition" is supported only for Glue version 4.0 or later.
"latest"
, "trim_horizon"
, "earliest"
, or a timestamp string in UTC
format in the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z
represents a UTC timezone
offset with a +/-. For example: "2023-04-04T08:00:00-04:00"). The default value is "latest"
.
Note: Using a value that is a timestamp string in UTC format for "startingPosition" is supported only for Glue version 4.0 or later.
StartingPosition
public KinesisStreamingSourceOptions withStartingPosition(String startingPosition)
The starting position in the Kinesis data stream to read data from. The possible values are "latest"
, "trim_horizon"
, "earliest"
, or a timestamp string in UTC format in the pattern
yyyy-mm-ddTHH:MM:SSZ
(where Z
represents a UTC timezone offset with a +/-. For example:
"2023-04-04T08:00:00-04:00"). The default value is "latest"
.
Note: Using a value that is a timestamp string in UTC format for "startingPosition" is supported only for Glue version 4.0 or later.
startingPosition
- The starting position in the Kinesis data stream to read data from. The possible values are
"latest"
, "trim_horizon"
, "earliest"
, or a timestamp string in UTC
format in the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z
represents a UTC timezone
offset with a +/-. For example: "2023-04-04T08:00:00-04:00"). The default value is "latest"
.
Note: Using a value that is a timestamp string in UTC format for "startingPosition" is supported only for Glue version 4.0 or later.
StartingPosition
public KinesisStreamingSourceOptions withStartingPosition(StartingPosition startingPosition)
The starting position in the Kinesis data stream to read data from. The possible values are "latest"
, "trim_horizon"
, "earliest"
, or a timestamp string in UTC format in the pattern
yyyy-mm-ddTHH:MM:SSZ
(where Z
represents a UTC timezone offset with a +/-. For example:
"2023-04-04T08:00:00-04:00"). The default value is "latest"
.
Note: Using a value that is a timestamp string in UTC format for "startingPosition" is supported only for Glue version 4.0 or later.
startingPosition
- The starting position in the Kinesis data stream to read data from. The possible values are
"latest"
, "trim_horizon"
, "earliest"
, or a timestamp string in UTC
format in the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z
represents a UTC timezone
offset with a +/-. For example: "2023-04-04T08:00:00-04:00"). The default value is "latest"
.
Note: Using a value that is a timestamp string in UTC format for "startingPosition" is supported only for Glue version 4.0 or later.
StartingPosition
public void setMaxFetchTimeInMs(Long maxFetchTimeInMs)
The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in
milliseconds (ms). The default value is 1000
.
maxFetchTimeInMs
- The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard,
specified in milliseconds (ms). The default value is 1000
.public Long getMaxFetchTimeInMs()
The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in
milliseconds (ms). The default value is 1000
.
1000
.public KinesisStreamingSourceOptions withMaxFetchTimeInMs(Long maxFetchTimeInMs)
The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in
milliseconds (ms). The default value is 1000
.
maxFetchTimeInMs
- The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard,
specified in milliseconds (ms). The default value is 1000
.public void setMaxFetchRecordsPerShard(Long maxFetchRecordsPerShard)
The maximum number of records to fetch per shard in the Kinesis data stream. The default value is
100000
.
maxFetchRecordsPerShard
- The maximum number of records to fetch per shard in the Kinesis data stream. The default value is
100000
.public Long getMaxFetchRecordsPerShard()
The maximum number of records to fetch per shard in the Kinesis data stream. The default value is
100000
.
100000
.public KinesisStreamingSourceOptions withMaxFetchRecordsPerShard(Long maxFetchRecordsPerShard)
The maximum number of records to fetch per shard in the Kinesis data stream. The default value is
100000
.
maxFetchRecordsPerShard
- The maximum number of records to fetch per shard in the Kinesis data stream. The default value is
100000
.public void setMaxRecordPerRead(Long maxRecordPerRead)
The maximum number of records to fetch from the Kinesis data stream in each getRecords operation. The default
value is 10000
.
maxRecordPerRead
- The maximum number of records to fetch from the Kinesis data stream in each getRecords operation. The
default value is 10000
.public Long getMaxRecordPerRead()
The maximum number of records to fetch from the Kinesis data stream in each getRecords operation. The default
value is 10000
.
10000
.public KinesisStreamingSourceOptions withMaxRecordPerRead(Long maxRecordPerRead)
The maximum number of records to fetch from the Kinesis data stream in each getRecords operation. The default
value is 10000
.
maxRecordPerRead
- The maximum number of records to fetch from the Kinesis data stream in each getRecords operation. The
default value is 10000
.public void setAddIdleTimeBetweenReads(Boolean addIdleTimeBetweenReads)
Adds a time delay between two consecutive getRecords operations. The default value is "False"
. This
option is only configurable for Glue version 2.0 and above.
addIdleTimeBetweenReads
- Adds a time delay between two consecutive getRecords operations. The default value is "False"
. This option is only configurable for Glue version 2.0 and above.public Boolean getAddIdleTimeBetweenReads()
Adds a time delay between two consecutive getRecords operations. The default value is "False"
. This
option is only configurable for Glue version 2.0 and above.
"False"
. This option is only configurable for Glue version 2.0 and above.public KinesisStreamingSourceOptions withAddIdleTimeBetweenReads(Boolean addIdleTimeBetweenReads)
Adds a time delay between two consecutive getRecords operations. The default value is "False"
. This
option is only configurable for Glue version 2.0 and above.
addIdleTimeBetweenReads
- Adds a time delay between two consecutive getRecords operations. The default value is "False"
. This option is only configurable for Glue version 2.0 and above.public Boolean isAddIdleTimeBetweenReads()
Adds a time delay between two consecutive getRecords operations. The default value is "False"
. This
option is only configurable for Glue version 2.0 and above.
"False"
. This option is only configurable for Glue version 2.0 and above.public void setIdleTimeBetweenReadsInMs(Long idleTimeBetweenReadsInMs)
The minimum time delay between two consecutive getRecords operations, specified in ms. The default value is
1000
. This option is only configurable for Glue version 2.0 and above.
idleTimeBetweenReadsInMs
- The minimum time delay between two consecutive getRecords operations, specified in ms. The default value
is 1000
. This option is only configurable for Glue version 2.0 and above.public Long getIdleTimeBetweenReadsInMs()
The minimum time delay between two consecutive getRecords operations, specified in ms. The default value is
1000
. This option is only configurable for Glue version 2.0 and above.
1000
. This option is only configurable for Glue version 2.0 and above.public KinesisStreamingSourceOptions withIdleTimeBetweenReadsInMs(Long idleTimeBetweenReadsInMs)
The minimum time delay between two consecutive getRecords operations, specified in ms. The default value is
1000
. This option is only configurable for Glue version 2.0 and above.
idleTimeBetweenReadsInMs
- The minimum time delay between two consecutive getRecords operations, specified in ms. The default value
is 1000
. This option is only configurable for Glue version 2.0 and above.public void setDescribeShardInterval(Long describeShardInterval)
The minimum time interval between two ListShards API calls for your script to consider resharding. The default
value is 1s
.
describeShardInterval
- The minimum time interval between two ListShards API calls for your script to consider resharding. The
default value is 1s
.public Long getDescribeShardInterval()
The minimum time interval between two ListShards API calls for your script to consider resharding. The default
value is 1s
.
1s
.public KinesisStreamingSourceOptions withDescribeShardInterval(Long describeShardInterval)
The minimum time interval between two ListShards API calls for your script to consider resharding. The default
value is 1s
.
describeShardInterval
- The minimum time interval between two ListShards API calls for your script to consider resharding. The
default value is 1s
.public void setNumRetries(Integer numRetries)
The maximum number of retries for Kinesis Data Streams API requests. The default value is 3
.
numRetries
- The maximum number of retries for Kinesis Data Streams API requests. The default value is 3
.public Integer getNumRetries()
The maximum number of retries for Kinesis Data Streams API requests. The default value is 3
.
3
.public KinesisStreamingSourceOptions withNumRetries(Integer numRetries)
The maximum number of retries for Kinesis Data Streams API requests. The default value is 3
.
numRetries
- The maximum number of retries for Kinesis Data Streams API requests. The default value is 3
.public void setRetryIntervalMs(Long retryIntervalMs)
The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call. The default value
is 1000
.
retryIntervalMs
- The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call. The default
value is 1000
.public Long getRetryIntervalMs()
The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call. The default value
is 1000
.
1000
.public KinesisStreamingSourceOptions withRetryIntervalMs(Long retryIntervalMs)
The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call. The default value
is 1000
.
retryIntervalMs
- The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call. The default
value is 1000
.public void setMaxRetryIntervalMs(Long maxRetryIntervalMs)
The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call. The
default value is 10000
.
maxRetryIntervalMs
- The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call.
The default value is 10000
.public Long getMaxRetryIntervalMs()
The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call. The
default value is 10000
.
10000
.public KinesisStreamingSourceOptions withMaxRetryIntervalMs(Long maxRetryIntervalMs)
The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call. The
default value is 10000
.
maxRetryIntervalMs
- The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call.
The default value is 10000
.public void setAvoidEmptyBatches(Boolean avoidEmptyBatches)
Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch
is started. The default value is "False"
.
avoidEmptyBatches
- Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the
batch is started. The default value is "False"
.public Boolean getAvoidEmptyBatches()
Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch
is started. The default value is "False"
.
"False"
.public KinesisStreamingSourceOptions withAvoidEmptyBatches(Boolean avoidEmptyBatches)
Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch
is started. The default value is "False"
.
avoidEmptyBatches
- Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the
batch is started. The default value is "False"
.public Boolean isAvoidEmptyBatches()
Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch
is started. The default value is "False"
.
"False"
.public void setStreamArn(String streamArn)
The Amazon Resource Name (ARN) of the Kinesis data stream.
streamArn
- The Amazon Resource Name (ARN) of the Kinesis data stream.public String getStreamArn()
The Amazon Resource Name (ARN) of the Kinesis data stream.
public KinesisStreamingSourceOptions withStreamArn(String streamArn)
The Amazon Resource Name (ARN) of the Kinesis data stream.
streamArn
- The Amazon Resource Name (ARN) of the Kinesis data stream.public void setRoleArn(String roleArn)
The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS). This role must
have permissions for describe or read record operations for the Kinesis data stream. You must use this parameter
when accessing a data stream in a different account. Used in conjunction with "awsSTSSessionName"
.
roleArn
- The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS). This role
must have permissions for describe or read record operations for the Kinesis data stream. You must use
this parameter when accessing a data stream in a different account. Used in conjunction with
"awsSTSSessionName"
.public String getRoleArn()
The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS). This role must
have permissions for describe or read record operations for the Kinesis data stream. You must use this parameter
when accessing a data stream in a different account. Used in conjunction with "awsSTSSessionName"
.
"awsSTSSessionName"
.public KinesisStreamingSourceOptions withRoleArn(String roleArn)
The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS). This role must
have permissions for describe or read record operations for the Kinesis data stream. You must use this parameter
when accessing a data stream in a different account. Used in conjunction with "awsSTSSessionName"
.
roleArn
- The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS). This role
must have permissions for describe or read record operations for the Kinesis data stream. You must use
this parameter when accessing a data stream in a different account. Used in conjunction with
"awsSTSSessionName"
.public void setRoleSessionName(String roleSessionName)
An identifier for the session assuming the role using AWS STS. You must use this parameter when accessing a data
stream in a different account. Used in conjunction with "awsSTSRoleARN"
.
roleSessionName
- An identifier for the session assuming the role using AWS STS. You must use this parameter when accessing
a data stream in a different account. Used in conjunction with "awsSTSRoleARN"
.public String getRoleSessionName()
An identifier for the session assuming the role using AWS STS. You must use this parameter when accessing a data
stream in a different account. Used in conjunction with "awsSTSRoleARN"
.
"awsSTSRoleARN"
.public KinesisStreamingSourceOptions withRoleSessionName(String roleSessionName)
An identifier for the session assuming the role using AWS STS. You must use this parameter when accessing a data
stream in a different account. Used in conjunction with "awsSTSRoleARN"
.
roleSessionName
- An identifier for the session assuming the role using AWS STS. You must use this parameter when accessing
a data stream in a different account. Used in conjunction with "awsSTSRoleARN"
.public void setAddRecordTimestamp(String addRecordTimestamp)
When this option is set to 'true', the data output will contain an additional column named "__src_timestamp" that indicates the time when the corresponding record received by the stream. The default value is 'false'. This option is supported in Glue version 4.0 or later.
addRecordTimestamp
- When this option is set to 'true', the data output will contain an additional column named
"__src_timestamp" that indicates the time when the corresponding record received by the stream. The
default value is 'false'. This option is supported in Glue version 4.0 or later.public String getAddRecordTimestamp()
When this option is set to 'true', the data output will contain an additional column named "__src_timestamp" that indicates the time when the corresponding record received by the stream. The default value is 'false'. This option is supported in Glue version 4.0 or later.
public KinesisStreamingSourceOptions withAddRecordTimestamp(String addRecordTimestamp)
When this option is set to 'true', the data output will contain an additional column named "__src_timestamp" that indicates the time when the corresponding record received by the stream. The default value is 'false'. This option is supported in Glue version 4.0 or later.
addRecordTimestamp
- When this option is set to 'true', the data output will contain an additional column named
"__src_timestamp" that indicates the time when the corresponding record received by the stream. The
default value is 'false'. This option is supported in Glue version 4.0 or later.public void setEmitConsumerLagMetrics(String emitConsumerLagMetrics)
When this option is set to 'true', for each batch, it will emit the metrics for the duration between the oldest record received by the stream and the time it arrives in Glue to CloudWatch. The metric's name is "glue.driver.streaming.maxConsumerLagInMs". The default value is 'false'. This option is supported in Glue version 4.0 or later.
emitConsumerLagMetrics
- When this option is set to 'true', for each batch, it will emit the metrics for the duration between the
oldest record received by the stream and the time it arrives in Glue to CloudWatch. The metric's name is
"glue.driver.streaming.maxConsumerLagInMs". The default value is 'false'. This option is supported in Glue
version 4.0 or later.public String getEmitConsumerLagMetrics()
When this option is set to 'true', for each batch, it will emit the metrics for the duration between the oldest record received by the stream and the time it arrives in Glue to CloudWatch. The metric's name is "glue.driver.streaming.maxConsumerLagInMs". The default value is 'false'. This option is supported in Glue version 4.0 or later.
public KinesisStreamingSourceOptions withEmitConsumerLagMetrics(String emitConsumerLagMetrics)
When this option is set to 'true', for each batch, it will emit the metrics for the duration between the oldest record received by the stream and the time it arrives in Glue to CloudWatch. The metric's name is "glue.driver.streaming.maxConsumerLagInMs". The default value is 'false'. This option is supported in Glue version 4.0 or later.
emitConsumerLagMetrics
- When this option is set to 'true', for each batch, it will emit the metrics for the duration between the
oldest record received by the stream and the time it arrives in Glue to CloudWatch. The metric's name is
"glue.driver.streaming.maxConsumerLagInMs". The default value is 'false'. This option is supported in Glue
version 4.0 or later.public void setStartingTimestamp(Date startingTimestamp)
The timestamp of the record in the Kinesis data stream to start reading data from. The possible values are a
timestamp string in UTC format of the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z represents a UTC
timezone offset with a +/-. For example: "2023-04-04T08:00:00+08:00").
startingTimestamp
- The timestamp of the record in the Kinesis data stream to start reading data from. The possible values are
a timestamp string in UTC format of the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z represents a
UTC timezone offset with a +/-. For example: "2023-04-04T08:00:00+08:00").public Date getStartingTimestamp()
The timestamp of the record in the Kinesis data stream to start reading data from. The possible values are a
timestamp string in UTC format of the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z represents a UTC
timezone offset with a +/-. For example: "2023-04-04T08:00:00+08:00").
yyyy-mm-ddTHH:MM:SSZ
(where Z represents
a UTC timezone offset with a +/-. For example: "2023-04-04T08:00:00+08:00").public KinesisStreamingSourceOptions withStartingTimestamp(Date startingTimestamp)
The timestamp of the record in the Kinesis data stream to start reading data from. The possible values are a
timestamp string in UTC format of the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z represents a UTC
timezone offset with a +/-. For example: "2023-04-04T08:00:00+08:00").
startingTimestamp
- The timestamp of the record in the Kinesis data stream to start reading data from. The possible values are
a timestamp string in UTC format of the pattern yyyy-mm-ddTHH:MM:SSZ
(where Z represents a
UTC timezone offset with a +/-. For example: "2023-04-04T08:00:00+08:00").public String toString()
toString
in class Object
Object.toString()
public KinesisStreamingSourceOptions clone()
public void marshall(ProtocolMarshaller protocolMarshaller)
StructuredPojo
ProtocolMarshaller
.marshall
in interface StructuredPojo
protocolMarshaller
- Implementation of ProtocolMarshaller
used to marshall this object's data.