windowing

Type Members

1. case class BankersEntry[IR](value: IR, ts: Long) extends Product with Serializable

   

2. case class BatchIr(collapsed: Array[Any], tailHops: IrMapType) extends Product with Serializable

   

3. case class FinalBatchIr(collapsed: Array[Any], tailHops: OutputArrayType) extends Product with Serializable

   

4. class HopsAggregator extends HopsAggregatorBase

   

5. class HopsAggregatorBase extends Serializable

   

6. trait Resolution extends Serializable

   

7. class SawtoothAggregator extends Serializable

   

8. class SawtoothMutationAggregator extends SawtoothAggregator

   

   Mutations processing starts with an end of the day snapshot FinalBatchIR.

   Mutations processing starts with an end of the day snapshot FinalBatchIR. On top of this FinalBatchIR mutations are processed.

   update/merge/finalize are related to snapshot data. As such they follow the snapshot Schema and aggregators. However mutations come into play later in the group by and a finalized version of the snapshot data is created to be processed with the mutations rows. Since the dataframe inputs are aligned between mutations and snapshot (input) no additional schema is needed.

9. class SawtoothOnlineAggregator extends SawtoothMutationAggregator

   

10. class TwoStackLiteAggregationBuffer[Input, IR >: Null, Output >: Null] extends AnyRef

    

11. class TwoStackLiteAggregator extends AnyRef