Object/Trait

com.twitter.algebird

Aggregator

Related Docs: trait Aggregator | package algebird

Permalink

object Aggregator extends Serializable

Aggregators compose well.

To create a parallel aggregator that operates on a single input in parallel, use: GeneratedTupleAggregator.from2((agg1, agg2))

Linear Supertypes
Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Aggregator
  2. Serializable
  3. AnyRef
  4. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. implicit def applicative[I]: Applicative[[O]Aggregator[I, _, O]]

    Permalink
  5. def approximatePercentile[T](percentile: Double, k: Int)(implicit num: Numeric[T]): QTreeAggregatorLowerBound[T]

    Permalink

    Returns the lower bound of a given percentile where the percentile is between (0,1] The items that are iterated over cannot be negative.

  6. def approximatePercentileBounds[T](percentile: Double, k: Int)(implicit num: Numeric[T]): QTreeAggregator[T]

    Permalink

    Returns the intersection of a bounded percentile where the percentile is between (0,1] The items that are iterated over cannot be negative.

  7. def approximateUniqueCount[T](implicit arg0: Hash128[T]): MonoidAggregator[T, Either[HLL, Set[T]], Long]

    Permalink

    Using a constant amount of memory, give an approximate unique count (~ 1% error).

    Using a constant amount of memory, give an approximate unique count (~ 1% error). This uses an exact set for up to 100 items, then HyperLogLog (HLL) with an 1.2% standard error which uses at most 8192 bytes for each HLL. For more control, see HyperLogLogAggregator.

  8. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  9. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. def const[T](t: T): MonoidAggregator[Any, Unit, T]

    Permalink

    This is a trivial aggregator that always returns a single value

  11. def count[T](pred: (T) ⇒ Boolean): MonoidAggregator[T, Long, Long]

    Permalink

    How many items satisfy a predicate

  12. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  13. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  14. def exists[T](pred: (T) ⇒ Boolean): MonoidAggregator[T, Boolean, Boolean]

    Permalink

    Do any items satisfy some predicate

  15. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  16. def forall[T](pred: (T) ⇒ Boolean): MonoidAggregator[T, Boolean, Boolean]

    Permalink

    Do all items satisfy a predicate

  17. def fromMonoid[F, T](implicit mon: Monoid[T], prep: (F) ⇒ T): MonoidAggregator[F, T, T]

    Permalink
  18. def fromMonoid[T](implicit mon: Monoid[T]): MonoidAggregator[T, T, T]

    Permalink
  19. def fromReduce[T](red: (T, T) ⇒ T): Aggregator[T, T, T]

    Permalink

    Using Aggregator.prepare,present you can add to this aggregator

  20. def fromRing[F, T](implicit rng: Ring[T], prep: (F) ⇒ T): RingAggregator[F, T, T]

    Permalink
  21. def fromRing[T](implicit rng: Ring[T]): RingAggregator[T, T, T]

    Permalink
  22. def fromSemigroup[T](implicit sg: Semigroup[T]): Aggregator[T, T, T]

    Permalink
  23. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  24. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  25. def head[T]: Aggregator[T, T, T]

    Permalink

    Take the first (left most in reduce order) item found

  26. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  27. def last[T]: Aggregator[T, T, T]

    Permalink

    Take the last (right most in reduce order) item found

  28. def max[T](implicit arg0: Ordering[T]): Aggregator[T, T, T]

    Permalink

    Get the maximum item

  29. def maxBy[U, T](fn: (U) ⇒ T)(implicit arg0: Ordering[T]): Aggregator[U, U, U]

    Permalink
  30. def min[T](implicit arg0: Ordering[T]): Aggregator[T, T, T]

    Permalink

    Get the minimum item

  31. def minBy[U, T](fn: (U) ⇒ T)(implicit arg0: Ordering[T]): Aggregator[U, U, U]

    Permalink
  32. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  33. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  34. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  35. def prepareMonoid[F, T](prep: (F) ⇒ T)(implicit m: Monoid[T]): MonoidAggregator[F, T, T]

    Permalink
  36. def size: MonoidAggregator[Any, Long, Long]

    Permalink

    This returns the number of items we find

  37. def sortedReverseTake[T](count: Int)(implicit arg0: Ordering[T]): MonoidAggregator[T, PriorityQueue[T], Seq[T]]

    Permalink

    Take the largest count items using a heap

  38. def sortedTake[T](count: Int)(implicit arg0: Ordering[T]): MonoidAggregator[T, PriorityQueue[T], Seq[T]]

    Permalink

    Take the smallest count items using a heap

  39. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  40. def toList[T]: MonoidAggregator[T, List[T], List[T]]

    Permalink

    Put everything in a List.

    Put everything in a List. Note, this could fill the memory if the List is very large.

  41. def toSet[T]: MonoidAggregator[T, Set[T], Set[T]]

    Permalink

    Put everything in a Set.

    Put everything in a Set. Note, this could fill the memory if the Set is very large.

  42. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  43. def uniqueCount[T]: MonoidAggregator[T, Set[T], Int]

    Permalink

    This builds an in-memory Set, and then finally gets the size of that set.

    This builds an in-memory Set, and then finally gets the size of that set. This may not be scalable if the Uniques are very large. You might check the approximateUniqueCount or HyperLogLog Aggregator to get an approximate version of this that is scalable.

  44. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  45. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  46. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped