DynamoDbManifest

Wrapper for a DynamoDB client that handles interactions with the events manifest table. Due to containing lots of mutable state, references and unserializable objects this wrapper should be constructed as late as possible - straight inside a ShredJob,

Initialized via EventsManifest.initStorage(),

client: AWS DynamoDB client object
table: AWS DynamoDB table name

Linear Supertypes

Serializable, Serializable, Product, Equals, EventsManifest, AnyRef, Any

Instance Constructors

new DynamoDbManifest(client: AmazonDynamoDB, table: String)

client
AWS DynamoDB client object
table
AWS DynamoDB table name

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
val client: AmazonDynamoDB

AWS DynamoDB client object
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def put(eventId: UUID, eventFingerprint: String, etlTstamp: Instant): Boolean

Try to store parts of an event into a previously specified table.
Try to store parts of an event into a previously specified table.
eventId
Snowplow event ID (UUID)
eventFingerprint
enriched event's fingerprint
etlTstamp
enrichment job's timestamp
returns
true if the event is successfully stored in the table, false if both eventId and fingerprint are already in the table

Definition Classes
DynamoDbManifest → EventsManifest
val putRequestDummy: PutItemRequest

A conditional write request that will pass if both eventId AND fingerprint are not present in the table, effectively meaning that only non-duplicates will be written.
A conditional write request that will pass if both eventId AND fingerprint are not present in the table, effectively meaning that only non-duplicates will be written.
Dupes can still pass if an event's etl_timestamp matches, effectively meaning that a previous shred was interrupted and an event is being overwritten.
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
val table: String

AWS DynamoDB table name
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Docs: object DynamoDbManifest | package eventsmanifest

case class DynamoDbManifest(client: AmazonDynamoDB, table: String) extends EventsManifest with Product with Serializable

Instance Constructors

new DynamoDbManifest(client: AmazonDynamoDB, table: String)

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

val client: AmazonDynamoDB

def clone(): AnyRef

final def eq(arg0: AnyRef): Boolean

def finalize(): Unit

final def getClass(): Class[_]

final def isInstanceOf[T0]: Boolean

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def put(eventId: UUID, eventFingerprint: String, etlTstamp: Instant): Boolean

val putRequestDummy: PutItemRequest

final def synchronized[T0](arg0: ⇒ T0): T0

val table: String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from EventsManifest

Inherited from AnyRef

Inherited from Any

Ungrouped