sink

Type Members

1. class BatchedSinkFromOffline[T] extends BatchedSink[T]

   

   Wrapped for the new scalding sink API in terms of the above

2. case class CompoundSink[Event](offline: Option[OfflineSink[Event]], online: Option[() ⇒ OnlineSink[Event]]) extends Product with Serializable

   

3. trait OfflineSink[Event] extends AnyRef

   

   Represents a location to which intermediate results of the "flatMap" operation can be written for consumption by other jobs.

   Represents a location to which intermediate results of the "flatMap" operation can be written for consumption by other jobs. On the offline side, this can be a time-based source on HDFS with one file per each batch ID. On the online side, this can be a kestrel fanout or kafka topic.

4. trait OnlineSink[-Event] extends (Event) ⇒ Future[Unit]

   

   Represents a location to which intermediate results of the "flatMap" operation can be written for consumption by other jobs.

   Represents a location to which intermediate results of the "flatMap" operation can be written for consumption by other jobs. This sink can be implemented using, for example, a kestrel fanout or kafka topic.