com.twitter.scalding.typed

CoGroupable

trait CoGroupable[K, +R] extends HasReducers with HasDescription with Serializable

Represents something than can be CoGrouped with another CoGroupable

Linear Supertypes
Serializable, HasDescription, HasReducers, AnyRef, Any
Known Subclasses
CoGrouped, Grouped, HashJoinable, IdentityReduce, IteratorMappedReduce, UnsortedGrouped, UnsortedIdentityReduce
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CoGroupable
  2. Serializable
  3. HasDescription
  4. HasReducers
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def descriptions: Seq[String]

    Definition Classes
    HasDescription

  2. abstract def inputs: List[TypedPipe[(K, Any)]]

    This is the list of mapped pipes, just before the (reducing) joinFunction is applied

  3. abstract def joinFunction: (K, Iterator[Tuple], Seq[Iterable[Tuple]]) ⇒ Iterator[R]

    This function is not type-safe for others to call, but it should never have an error.

    This function is not type-safe for others to call, but it should never have an error. By construction, we never call it with incorrect types. It would be preferable to have stronger type safety here, but unclear how to achieve, and since it is an internal function, not clear it would actually help anyone for it to be type-safe

    Attributes
    protected

  4. abstract def keyOrdering: Ordering[K]

  5. abstract def reducers: Option[Int]

    Definition Classes
    HasReducers

Concrete Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def cogroup[R1, R2](smaller: CoGroupable[K, R1])(fn: (K, Iterator[R], Iterable[R1]) ⇒ Iterator[R2]): CoGrouped[K, R2]

    Smaller is about average values/key not total size (that does not matter, but is clearly related).

    Smaller is about average values/key not total size (that does not matter, but is clearly related).

    Note that from the type signature we see that the right side is iterated (or may be) over and over, but the left side is not. That means that you want the side with fewer values per key on the right. If both sides are similar, no need to worry. If one side is a one-to-one mapping, that should be the "smaller" side.

  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  10. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  13. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  14. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  15. def join[W](smaller: CoGroupable[K, W]): CoGrouped[K, (R, W)]

  16. def leftJoin[W](smaller: CoGroupable[K, W]): CoGrouped[K, (R, Option[W])]

  17. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  18. final def notify(): Unit

    Definition Classes
    AnyRef

  19. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  20. def outerJoin[W](smaller: CoGroupable[K, W]): CoGrouped[K, (Option[R], Option[W])]

  21. def rightJoin[W](smaller: CoGroupable[K, W]): CoGrouped[K, (Option[R], W)]

  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  23. def toString(): String

    Definition Classes
    AnyRef → Any

  24. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  25. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from HasDescription

Inherited from HasReducers

Inherited from AnyRef

Inherited from Any

Ungrouped