pipes

Type Members

1. abstract class Basis[-I] extends DataPipe[I, DenseVector[Double]]

   

   Defines an abstract type for a basis expansion/mapping.

2. trait BifurcationPipe[-Source, +Result1, +Result2] extends DataPipe[Source, (Result1, Result2)]

   

3. trait DataPipe[-Source, +Destination] extends DataPipeConvertible[Source, Destination] with Serializable

   

   Top level trait representing an abstract pipe that defines a transformation between two data types, i.e.

   Top level trait representing an abstract pipe that defines a transformation between two data types, i.e. Source and Destination

4. trait DataPipe2[-Source1, -Source2, +Result] extends DataPipeConvertible[(Source1, Source2), Result] with Serializable

   

5. trait DataPipe3[-Source1, -Source2, -Source3, +Result] extends DataPipeConvertible[(Source1, Source2, Source3), Result] with Serializable

   

6. trait DataPipe4[-Source1, -Source2, -Source3, -Source4, +Result] extends DataPipeConvertible[(Source1, Source2, Source3, Source4), Result] with Serializable

   

7. trait DataPipeConvertible[-Source, +Destination] extends AnyRef

   

8. trait Encoder[S, D] extends DataPipe[S, D]

   

   A deterministic and reversible encoding from a domain to a range.

   A deterministic and reversible encoding from a domain to a range. Mathematically equivalent to a bijective function.

   S

   The domain type

   D

   The output type

9. trait IterableDataPipe[I, J, K] extends DataPipe[Iterable[I], K]

   
   I

   The type of a single source record

   J

   The result type of a single record.

10. trait IterableFilterPipe[I] extends IterableDataPipe[I, Boolean, Iterable[I]]

    

11. trait IterableFlatMapPipe[I, J] extends IterableDataPipe[I, Iterable[J], Iterable[J]]

    

    A pipeline which takes a Iterable of data and performs the scala flatMap operation.

12. trait IterableMapPipe[I, J] extends IterableDataPipe[I, J, Iterable[J]]

    

    A pipeline which takes a Iterable of data and performs the scala mapoperation.

13. trait IterablePartitionPipe[I] extends IterableDataPipe[I, Boolean, (Iterable[I], Iterable[I])]

    

14. trait IterableSideEffectPipe[I] extends IterableDataPipe[I, Unit, Unit]

    

15. trait MetaPipe[Source, Intermediate, Destination] extends DataPipe[Source, DataPipe[Intermediate, Destination]]

    

    Data Pipe wrapper of a curried function of order 1

16. trait MetaPipe12[A, B, C, D] extends DataPipe[A, DataPipe2[B, C, D]]

    

    Wraps a curried function of order 1 which takes 1 arguments and returns a Function2.

17. trait MetaPipe21[A, B, C, D] extends DataPipe2[A, B, DataPipe[C, D]]

    

    Wraps a curried function of order 1 which takes 2 arguments and returns a Function1.

18. trait ParallelPipe[-Source1, +Result1, -Source2, +Result2] extends DataPipe[(Source1, Source2), (Result1, Result2)]

    

19. trait RDDFilterPipe[Element] extends RDDPipe[Element, RDD[Element]]

    

20. trait RDDMapPipe[Element, OtherElement] extends RDDPipe[Element, RDD[OtherElement]]

    

    A pipeline which takes an RDD of Element and maps it to an RDD of OtherElement.

21. trait RDDPipe[Element, Result] extends DataPipe[RDD[Element], Result]

    

22. sealed trait Reducer extends ReducerPipe[Double]

    

23. trait ReducerPipe[I] extends DataPipe[Array[I], I]

    

24. trait ReversibleScaler[S] extends Scaler[S] with Encoder[S, S]

    

25. trait Scaler[S] extends DataPipe[S, S]

    

26. trait SideEffectPipe[I] extends DataPipe[I, Unit]

    

27. trait StreamDataPipe[I, J, K] extends DataPipe[Stream[I], K]

    
    I

    The type of a single source record

    J

    The result type of a single record.

28. trait StreamFilterPipe[I] extends StreamDataPipe[I, Boolean, Stream[I]]

    

29. trait StreamFlatMapPipe[I, J] extends StreamDataPipe[I, Stream[J], Stream[J]]

    

    A pipeline which takes a Stream of data and performs the scala flatMap operation.

30. trait StreamMapPipe[I, J] extends StreamDataPipe[I, J, Stream[J]]

    

    A pipeline which takes a Stream of data and performs the scala mapoperation.

31. trait StreamPartitionPipe[I] extends StreamDataPipe[I, Boolean, (Stream[I], Stream[I])]

    

32. trait StreamSideEffectPipe[I] extends StreamDataPipe[I, Unit, Unit]

    

33. case class TupleIntegerEncoder(arities: List[Int]) extends Encoder[List[Int], Int] with Product with Serializable

    

34. case class WeightedSumReducer(weights: Array[Double]) extends Reducer with Product with Serializable