Class

ai.chronon.aggregator.windowing

SawtoothOnlineAggregator

Related Doc: package windowing

Permalink

class SawtoothOnlineAggregator extends SawtoothMutationAggregator

Linear Supertypes
SawtoothMutationAggregator, SawtoothAggregator, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SawtoothOnlineAggregator
  2. SawtoothMutationAggregator
  3. SawtoothAggregator
  4. Serializable
  5. Serializable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SawtoothOnlineAggregator(batchEndTs: Long, aggregations: Seq[Aggregation], inputSchema: Seq[(String, DataType)], resolution: Resolution = FiveMinuteResolution, tailBufferMillis: Long = new Window(2, TimeUnit.DAYS).millis)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. lazy val baseAggregator: RowAggregator

    Permalink
    Definition Classes
    SawtoothAggregator
  6. lazy val baseIrIndices: Array[Int]

    Permalink
    Attributes
    protected
    Definition Classes
    SawtoothAggregator
  7. val batchEndTs: Long

    Permalink
  8. def batchIrSchema: Array[(String, DataType)]

    Permalink
    Definition Classes
    SawtoothMutationAggregator
  9. val batchTailTs: Array[Option[Long]]

    Permalink
  10. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. def computeWindows(hops: OutputArrayType, endTimes: Array[Long]): Array[Array[Any]]

    Permalink
    Definition Classes
    SawtoothAggregator
  12. def cumulate(inputs: Iterator[Row], sortedEndTimes: Array[Long], baseIR: Array[Any]): Array[Array[Any]]

    Permalink
    Definition Classes
    SawtoothAggregator
  13. def denormalizeBatchIr(batchIr: FinalBatchIr): FinalBatchIr

    Permalink
  14. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  16. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  17. def finalizeSnapshot(batchIr: BatchIr): FinalBatchIr

    Permalink
    Definition Classes
    SawtoothMutationAggregator
  18. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  19. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  20. val hopSizes: Array[Long]

    Permalink
    Attributes
    protected
    Definition Classes
    SawtoothAggregator
  21. val hopsAggregator: HopsAggregatorBase

    Permalink
    Definition Classes
    SawtoothMutationAggregator
  22. def init: BatchIr

    Permalink
    Definition Classes
    SawtoothMutationAggregator
  23. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  24. def lambdaAggregateFinalized(finalBatchIr: FinalBatchIr, streamingRows: Iterator[Row], ts: Long, hasReversal: Boolean = false): Array[Any]

    Permalink
  25. def lambdaAggregateIr(finalBatchIr: FinalBatchIr, streamingRows: Iterator[Row], queryTs: Long, hasReversal: Boolean = false): Array[Any]

    Permalink
  26. def lambdaAggregateIrMany(batchEndTs: Long, finalBatchIr: FinalBatchIr, sortedInputs: Array[Row], sortedEndTimes: Array[Long]): Array[Array[Any]]

    Permalink

    Given aggregations FinalBatchIRs at the end of the Snapshot (batchEndTs) and mutation and query times, determine the values at the query times for the aggregations.

    Given aggregations FinalBatchIRs at the end of the Snapshot (batchEndTs) and mutation and query times, determine the values at the query times for the aggregations. This is pretty much a mix of online with extra work for multiple queries ts support.

    Definition Classes
    SawtoothMutationAggregator
  27. def merge(batchIr1: BatchIr, batchIr2: BatchIr): BatchIr

    Permalink
    Definition Classes
    SawtoothMutationAggregator
  28. def mergeTailHops(ir: Array[Any], queryTs: Long, batchEndTs: Long, batchIr: FinalBatchIr): Array[Any]

    Permalink

    Update the intermediate results with tail hops data from a FinalBatchIr.

    Update the intermediate results with tail hops data from a FinalBatchIr.

    Definition Classes
    SawtoothMutationAggregator
  29. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  30. def normalizeBatchIr(batchIr: BatchIr): FinalBatchIr

    Permalink
  31. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  32. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  33. lazy val perWindowAggs: Array[AggregationPart]

    Permalink
    Definition Classes
    SawtoothAggregator
  34. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  35. lazy val tailHopIndices: Array[Int]

    Permalink
    Attributes
    protected
    Definition Classes
    SawtoothAggregator
  36. def tailTs(batchEndTs: Long): Array[Option[Long]]

    Permalink
    Definition Classes
    SawtoothMutationAggregator
  37. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  38. lazy val unpackedAggs: UnpackedAggregations

    Permalink
    Definition Classes
    SawtoothAggregator
  39. def update(batchIr: BatchIr, row: Row): BatchIr

    Permalink
  40. def update(batchEndTs: Long, batchIr: BatchIr, row: Row, batchTails: Array[Option[Long]]): BatchIr

    Permalink
    Definition Classes
    SawtoothMutationAggregator
  41. def update(batchEndTs: Long, batchIr: BatchIr, row: Row): BatchIr

    Permalink
    Definition Classes
    SawtoothMutationAggregator
  42. def updateIr(ir: Array[Any], row: Row, queryTs: Long, hasReversal: Boolean = false): Unit

    Permalink

    Go through the aggregators and update or delete the intermediate with the information of the row if relevant.

    Go through the aggregators and update or delete the intermediate with the information of the row if relevant. Useful for both online and mutations

    Definition Classes
    SawtoothMutationAggregator
  43. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  44. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  45. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  46. lazy val windowMappings: Array[WindowMapping]

    Permalink
    Definition Classes
    SawtoothAggregator
  47. lazy val windowedAggregator: RowAggregator

    Permalink
    Definition Classes
    SawtoothAggregator

Inherited from SawtoothAggregator

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped