Class/Object

com.twitter.summingbird.batch

CalendarBatcher

Related Docs: object CalendarBatcher | package batch

Permalink

final case class CalendarBatcher(unitCount: Int, calField: CalField) extends Batcher with Product with Serializable

This batcher numbers batches based on a Calendar, not just milliseconds. Many offline HDFS sources at Twitter are batched in this way based on hour or day in the UTC calendar

Linear Supertypes
Serializable, Product, Equals, Batcher, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CalendarBatcher
  2. Serializable
  3. Product
  4. Equals
  5. Batcher
  6. Serializable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CalendarBatcher(unitCount: Int, calField: CalField)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. final def batchOf(t: Timestamp): BatchID

    Permalink

    Returns the batch into which the supplied Date is bucketed.

    Returns the batch into which the supplied Date is bucketed.

    Definition Classes
    CalendarBatcherBatcher
  6. def batchesCoveredBy(interval: Interval[Timestamp]): Interval[BatchID]

    Permalink
    Definition Classes
    Batcher
  7. val calField: CalField

    Permalink
  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. def cover(interval: Interval[Timestamp]): Interval[BatchID]

    Permalink

    What batches are needed to cover the given interval or: for all t in interval, batchOf(t) is in the result

    What batches are needed to cover the given interval or: for all t in interval, batchOf(t) is in the result

    Definition Classes
    Batcher
  10. def currentBatch: BatchID

    Permalink

    Returns the current BatchID.

    Returns the current BatchID.

    Definition Classes
    Batcher
  11. final def earliestTimeOf(batch: BatchID): Timestamp

    Permalink

    Returns the (inclusive) earliest time of the supplied batch.

    Returns the (inclusive) earliest time of the supplied batch.

    Definition Classes
    CalendarBatcherBatcher
  12. def enclosedBy(extremities: (BatchID, BatchID), other: Batcher): Iterable[BatchID]

    Permalink
    Definition Classes
    Batcher
  13. def enclosedBy(batchID: BatchID, other: Batcher): Iterable[BatchID]

    Permalink

    Returns the sequence of BatchIDs that the supplied other batcher would need to fetch to fully enclose the supplied batchID.

    Returns the sequence of BatchIDs that the supplied other batcher would need to fetch to fully enclose the supplied batchID.

    Definition Classes
    Batcher
  14. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  17. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  18. def isLowerBatchEdge(ts: Timestamp): Boolean

    Permalink

    Returns true if the supplied timestamp sits at the floor of the supplied batch.

    Returns true if the supplied timestamp sits at the floor of the supplied batch.

    Definition Classes
    Batcher
  19. def latestTimeOf(batch: BatchID): Timestamp

    Permalink

    Returns the latest time in the given batch

    Returns the latest time in the given batch

    Definition Classes
    Batcher
  20. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  21. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  22. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  23. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  24. def toInterval(b: BatchID): Interval[Timestamp]

    Permalink
    Definition Classes
    Batcher
  25. def toTimestamp(b: Interval[BatchID]): Interval[Timestamp]

    Permalink
    Definition Classes
    Batcher
  26. val unitCount: Int

    Permalink
  27. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from Batcher

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped