beam

Type Members

1. trait Beam[A] extends AnyRef

   

   Beams can accept events and forward them along.

   Beams can accept events and forward them along. The propagate method may throw a DefunctBeamException, which means the beam should be discarded (after calling close()).

2. trait BeamMaker[A, BeamType <: Beam[A]] extends AnyRef

   

   Makes beams for particular intervals and partition numbers.

   Makes beams for particular intervals and partition numbers. Can also serialize and deserialize beam representations.

   A

   event type

   BeamType

   specific beam type we know how to create

3. class BeamPacketizer[A] extends Logging

   

   Wraps a Beam and exposes a single-message API rather than the future-batch-based API.

   Wraps a Beam and exposes a single-message API rather than the future-batch-based API. Not thread-safe.

4. trait BeamPacketizerListener[A] extends AnyRef

   

5. class ClusteredBeam[EventType, InnerBeamType <: Beam[EventType]] extends Beam[EventType] with Logging

   

   Beam composed of a stack of smaller beams.

   Beam composed of a stack of smaller beams. The smaller beams are split across two axes: timestamp (time shard of the data) and partition (shard of the data within one time interval). The stack of beams for a particular timestamp are created in a coordinated fashion, such that all ClusteredBeams for the same identifier will have semantically identical stacks. This interaction is mediated through zookeeper. Beam information persists across ClusteredBeam restarts.

   In the case of Druid, each merged beam corresponds to one segment partition number, and each inner beam corresponds to either one index task or a set of redundant index tasks.

                                ClusteredBeam
   
                       +-------------+---------------+
   2010-01-02T03:00:00 |                             |   2010-01-02T04:00:00
                       |                             |
                       v                             v
   
             +----+ Merged +----+                   ...
             |                  |
        partition 1         partition 2
             |                  |
             v                  v
   
         Decorated           Decorated
   
       InnerBeamType       InnerBeamType

6. case class ClusteredBeamMeta(latestCloseTime: DateTime, beamDictss: Map[Long, Seq[Dict]]) extends Product with Serializable

   

   Metadata stored in ZooKeeper for a ClusteredBeam.

   Metadata stored in ZooKeeper for a ClusteredBeam.

   latestCloseTime

   Most recently shut-down interval (to prevent necromancy).

   beamDictss

   Map of interval start -> beam metadata, partition by partition.

7. case class ClusteredBeamTuning(segmentGranularity: Granularity = Granularity.HOUR, warmingPeriod: Period = new Period(0), windowPeriod: Period = new Period("PT10M"), partitions: Int = 1, replicants: Int = 1, minSegmentsPerBeam: Int = 1, maxSegmentsPerBeam: Int = 1) extends Logging with Product with Serializable

   

8. class DefunctBeamException extends Exception

   

9. class HashPartitionBeam[A] extends MergingPartitioningBeam[A]

   

10. class HttpBeam[A] extends Beam[A] with Logging

    

    Emits events over http.

    Emits events over http.

    This class is a little bit half-baked and might not work.

11. class MemoryBeam[A] extends Beam[A]

    

12. class MergingPartitioningBeam[A] extends Beam[A] with Logging

    

    Partitions events based on the output of a Partitioner, and propagates the partitioned events via the appropriate underlying beams.

13. class NoopBeam[A] extends Beam[A]

    

14. class RoundRobinBeam[A] extends Beam[A] with Logging

    

    Farms out events to various beams, round-robin.