GenericKinesis

fs2.aws.kinesis.Kinesis$.GenericKinesis
abstract class GenericKinesis[F[_]] extends Kinesis[F]

Attributes

Graph
Supertypes
trait Kinesis[F]
class Object
trait Matchable
class Any

Members list

Value members

Concrete methods

def checkpointRecords(checkpointSettings: KinesisCheckpointSettings): (F, CommittableRecord) => KinesisClientRecord

Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis

Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis

Value parameters

checkpointSettings

configure maxBatchSize and maxBatchWait time before triggering a checkpoint

Attributes

Returns

a stream of Record types representing checkpointed messages

Inherited methods

Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown

Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown

Value parameters

consumerConfig

configuration parameters for the KCL

Attributes

Returns

an infinite fs2 Stream that emits Kinesis Records Chunks

Inherited from:
Kinesis

Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown

Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown

Value parameters

consumerConfig

configuration parameters for the KCL

Attributes

Returns

an infinite fs2 Stream that emits Kinesis Records

Inherited from:
Kinesis
def readFromKinesisStream(appName: String, streamName: String): Stream[F, CommittableRecord]

Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown

Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown

Value parameters

appName

name of the Kinesis application. Used by KCL when resharding

streamName

name of the Kinesis stream to consume from

Attributes

Returns

an infinite fs2 Stream that emits Kinesis Records

Inherited from:
Kinesis