OptionMappedProducer
Related Doc:
package summingbird
Exactly the same as merge.
Exactly the same as merge. Here by analogy with the scala.collections API
Prefer to flatMap for transforming a subset of items like optionMap but convenient with case syntax in scala prod.collect { case x if fn(x) => g(x) }
Prefer to flatMap for transforming a subset of items like optionMap but convenient with case syntax in scala prod.collect { case x if fn(x) => g(x) }
Merge a different type of Producer into a single stream
Merge a different type of Producer into a single stream
Keep only the items that satisfy the fn
Keep only the items that satisfy the fn
Only use this function if you may return more than 1 item sometimes.
Only use this function if you may return more than 1 item sometimes. otherwise use collect or optionMap, which can be pushed up the graph
This is identical to a certain leftJoin: map((_, ())).leftJoin(srv).mapValues{case (_, v) => v} Useful when you are looking up values from say a stream of inputs, such as IDs.
This is identical to a certain leftJoin: map((_, ())).leftJoin(srv).mapValues{case (_, v) => v} Useful when you are looking up values from say a stream of inputs, such as IDs.
Map each item to a new value
Map each item to a new value
Combine the output into one Producer
Combine the output into one Producer
Naming a node is so that you may give Options for that node that may change the run-time performance of the job (parameter tuning, etc...)
Naming a node is so that you may give Options for that node that may change the run-time performance of the job (parameter tuning, etc...)
Prefer this or collect to flatMap if you are always emitting 0 or 1 items
Prefer this or collect to flatMap if you are always emitting 0 or 1 items
Cause some side effect on the sink, but pass through the values so they can be consumed downstream
Cause some side effect on the sink, but pass through the values so they can be consumed downstream
Represents filters and maps which may be optimized differently Note that "option-mapping" is closed under composition and hence useful to call out