The maximum size in bytes of the last User Record that we can add to the Stream Record.
The maximum size in bytes of the last User Record that we can add to the Stream Record. This is very empiric becuase we don't have access to the size function of the aggregated record.
The maximum number of linear back-off retries before giving up and throwing an exception
The maximum size of the aggregated record in bytes before the last record is added.
The maximum size of the aggregated record in bytes before the last record is added. Look above for explanation.
Send an iterator of Protocol Buffer encoded messages to Kinesis.
Send an iterator of Protocol Buffer encoded messages to Kinesis. It also uses a RaygunClient. Raygun is a 3rd party error logging service provider.
Example:
val it = List( new PBMessage("now"), new PBMessage("yesterday"), new PBMessage("tomorrow") ).toIterator val client = new AmazonKinesisClient(new ProfileCredentialsProvider("my-custom-profile")) val raygunClient = new RaygunClient("your-raygunClient-key") PBScalaKinesisWriter.write("test-stream", it, client, raygunClient)
The name of the Kinesis Stream where the data should go to
The iterator containing Protocol Buffers messages
The Kinesis client responsible for sending the data to the Kinesis Streams
The Raygun client which sends exceptions
Send an iterator of Protocol Buffer encoded messages to Kinesis.
Send an iterator of Protocol Buffer encoded messages to Kinesis. It uses a default Kinesis client built using DefaultAWSCredentialsProviderChain and the default region. It also uses a RaygunClient. Raygun is a 3rd party error logging service provider.
Example:
val it = List( new PBMessage("now"), new PBMessage("yesterday"), new PBMessage("tomorrow") ).toIterator val raygunClient = new RaygunClient("your-raygunClient-key") PBScalaKinesisWriter.write("test-stream", it, raygunClient)
The name of the Kinesis Stream where the data should go to
The iterator containing Protocol Buffers messages
The Raygun client which sends exceptions
Send an iterator of Protocol Buffer encoded messages to Kinesis.
Send an iterator of Protocol Buffer encoded messages to Kinesis.
Example:
val it = List( new PBMessage("now"), new PBMessage("yesterday"), new PBMessage("tomorrow") ).toIterator val client = new AmazonKinesisClient(new ProfileCredentialsProvider("my-custom-profile")) PBScalaKinesisWriter.write("test-stream", it, client)
The name of the Kinesis Stream where the data should go to
The iterator containing Protocol Buffers messages
The Kinesis client responsible for sending the data to the Kinesis Streams
Send an iterator of Protocol Buffer encoded messages to Kinesis.
Send an iterator of Protocol Buffer encoded messages to Kinesis. It uses a default Kinesis client built using DefaultAWSCredentialsProviderChain and the default region.
Example:
val it = List( new PBMessage("now"), new PBMessage("yesterday"), new PBMessage("tomorrow") ).toIterator PBScalaKinesisWriter.write("test-stream", it)
The name of the Kinesis Stream where the data should go to
The iterator containing Protocol Buffers messages
This class can be used for writing aggregated Kinesis Stream Records to an Amazon Kinesis Stream. The Kinesis Stream Records are made of several User Records. This is a concept called aggregation in the context of Amazon Kinesis. This class only works with User Records that are Protocol Buffer based and their class is generated with the help of the ScalaPB sbt plugin (http://trueaccord.github.io/ScalaPB/).