org.hammerlab.magic

rdd

package rdd

Visibility

Public
All

Type Members

class CachedCountRegistry extends AnyRef

CachedCountRegistry adds a .size method to RDDs that mimicks RDD.count, but caches its result.
class IfRDD[T] extends Serializable

Hang an iff method off of RDDs, as a small bit of syntactic sugar.
case class KeyPartitioner(numPartitions: Int) extends Partitioner with Product with Serializable

Spark Partitioner that maps elements to a partition indicated by an Int that either is the key, or is the first element of a tuple.
class OrderedRepartitionRDD[T] extends Serializable

Some helpers for repartitioning an RDD while retaining the order of its elements.
class RunLengthRDD[T] extends AnyRef

Helper for run-length encoding an RDD.

Value Members

object CachedCountRegistry
object IfRDD extends Serializable
object KeyPartitioner extends Serializable
object OrderedRepartitionRDD extends Serializable
object RunLengthRDD
package cmp
package grid
package keyed
package partitions
package serde
package sliding
package sort
package zip

Ungrouped