fs2.aws.kinesis

Members list

Concise view

Type members

Classlikes

case class CommittableRecord(shardId: String, recordProcessorStartingSequenceNumber: ExtendedSequenceNumber, millisBehindLatest: Long, record: KinesisClientRecord, recordProcessor: ChunkedRecordProcessor, checkpointer: RecordProcessorCheckpointer, lastRecordSemaphore: Semaphore, isLastInShard: Boolean)

A message type from Kinesis which has not yet been commited or checkpointed.

A message type from Kinesis which has not yet been commited or checkpointed.

Attributes

checkpointer

reference to the checkpointer used to commit this record

millisBehindLatest

ms behind the latest record, used to detect if the consumer is lagging the producer

record

the original record document from Kinesis

recordProcessor

reference to the record processor that is responsible for processing this message

shardId

the unique identifier for the shard from which this record originated

Constructor:

create a new commitable record with a name and age.

Companion:
object
Graph
Supertypes
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any

Attributes

Companion:
class
Graph
Supertypes
trait Product
trait Mirror
class Object
trait Matchable
class Any
Self type
case object FanOut extends RetrievalMode

Attributes

Graph
Supertypes
trait Singleton
trait Product
trait Mirror
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Self type
FanOut.type
trait Kinesis[F[_]]

Attributes

Companion:
object
Graph
Supertypes
class Object
trait Matchable
class Any
Known subtypes
object Kinesis

Attributes

Companion:
trait
Graph
Supertypes
class Object
trait Matchable
class Any
Self type
Kinesis.type

Settings for configuring the Kinesis checkpointer pipe

Settings for configuring the Kinesis checkpointer pipe

Attributes

maxBatchSize

the maximum number of records to aggregate before checkpointing the cluster of records. Passing 1 means checkpoint on every record

maxBatchWait

the maximum amount of time to wait before checkpointing the cluster of records

Companion:
object
Graph
Supertypes
class Object
trait Matchable
class Any

Attributes

Companion:
class
Graph
Supertypes
class Object
trait Matchable
class Any
Self type

Settings for configuring the Kinesis consumer

Settings for configuring the Kinesis consumer

Attributes

appName

name of the application which the KCL daemon should assume

bufferSize

size of the internal buffer used when reading messages from Kinesis

region

AWS region in which the Kinesis stream resides. Defaults to US-EAST-1

retrievalMode

FanOut (push) or Polling (pull). Defaults to FanOut (the new default in KCL 2.x).

streamName

name of the Kinesis stream to read from

Companion:
object
Graph
Supertypes
class Object
trait Matchable
class Any

Attributes

Companion:
class
Graph
Supertypes
class Object
trait Matchable
class Any
Self type
case object Polling extends RetrievalMode

Attributes

Graph
Supertypes
trait Singleton
trait Product
trait Mirror
trait Serializable
trait Product
trait Equals
class Object
trait Matchable
class Any
Self type
Polling.type
sealed trait RetrievalMode

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any
Known subtypes
object FanOut.type
object Polling.type
object publisher

fs2 Streams for publishing data to AWS Kinesis streams

fs2 Streams for publishing data to AWS Kinesis streams

Attributes

Graph
Supertypes
class Object
trait Matchable
class Any
Self type