Package | Description |
---|---|
com.amazonaws.services.glue.model |
Modifier and Type | Method and Description |
---|---|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.clone() |
KafkaStreamingSourceOptions |
DirectKafkaSource.getStreamingOptions()
Specifies the streaming options.
|
KafkaStreamingSourceOptions |
CatalogKafkaSource.getStreamingOptions()
Specifies the streaming options.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withAddRecordTimestamp(String addRecordTimestamp)
When this option is set to 'true', the data output will contain an additional column named "__src_timestamp" that
indicates the time when the corresponding record received by the topic.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withAssign(String assign)
The specific
TopicPartitions to consume. |
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withBootstrapServers(String bootstrapServers)
A list of bootstrap server URLs, for example, as
b-1.vpc-test-2.o4q88o.c6.kafka.us-east-1.amazonaws.com:9094 . |
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withClassification(String classification)
An optional classification.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withConnectionName(String connectionName)
The name of the connection.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withDelimiter(String delimiter)
Specifies the delimiter character.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withEmitConsumerLagMetrics(String emitConsumerLagMetrics)
When this option is set to 'true', for each batch, it will emit the metrics for the duration between the oldest
record received by the topic and the time it arrives in Glue to CloudWatch.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withEndingOffsets(String endingOffsets)
The end point when a batch query is ended.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withIncludeHeaders(Boolean includeHeaders)
Whether to include the Kafka headers.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withMaxOffsetsPerTrigger(Long maxOffsetsPerTrigger)
The rate limit on the maximum number of offsets that are processed per trigger interval.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withMinPartitions(Integer minPartitions)
The desired minimum number of partitions to read from Kafka.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withNumRetries(Integer numRetries)
The number of times to retry before failing to fetch Kafka offsets.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withPollTimeoutMs(Long pollTimeoutMs)
The timeout in milliseconds to poll data from Kafka in Spark job executors.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withRetryIntervalMs(Long retryIntervalMs)
The time in milliseconds to wait before retrying to fetch Kafka offsets.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withSecurityProtocol(String securityProtocol)
The protocol used to communicate with brokers.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withStartingOffsets(String startingOffsets)
The starting position in the Kafka topic to read data from.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withStartingTimestamp(Date startingTimestamp)
The timestamp of the record in the Kafka topic to start reading data from.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withSubscribePattern(String subscribePattern)
A Java regex string that identifies the topic list to subscribe to.
|
KafkaStreamingSourceOptions |
KafkaStreamingSourceOptions.withTopicName(String topicName)
The topic name as specified in Apache Kafka.
|
Modifier and Type | Method and Description |
---|---|
void |
DirectKafkaSource.setStreamingOptions(KafkaStreamingSourceOptions streamingOptions)
Specifies the streaming options.
|
void |
CatalogKafkaSource.setStreamingOptions(KafkaStreamingSourceOptions streamingOptions)
Specifies the streaming options.
|
DirectKafkaSource |
DirectKafkaSource.withStreamingOptions(KafkaStreamingSourceOptions streamingOptions)
Specifies the streaming options.
|
CatalogKafkaSource |
CatalogKafkaSource.withStreamingOptions(KafkaStreamingSourceOptions streamingOptions)
Specifies the streaming options.
|
Copyright © 2023. All rights reserved.