Package

org.hammerlab

spark

Permalink

package spark

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. spark
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. case class Context(sc: SparkContext) extends Configuration with Product with Serializable

    Permalink

    SparkContext-wrapper that is also a Hadoop configuration object (and Serializable).

  2. type NumPartitions = Int

    Permalink
  3. type PartitionIndex = Int

    Permalink
  4. trait SelfRegistrar extends Registrator with Kryo

    Permalink

    Minimal trait for objects that can be used as their own org.apache.spark.serializer.KryoRegistrators, for ease of encapsulating Kryo-registration information in tandem with org.hammerlab.kryo.Registrar.register syntax.

  5. trait SparkConfBase extends AnyRef

    Permalink

    Interface for applications to register fall-back default Spark-configuration values, using the SparkConfBase.sparkConf method below.

    Interface for applications to register fall-back default Spark-configuration values, using the SparkConfBase.sparkConf method below.

    Configs are added to a org.apache.spark.SparkConf after it's been instantiated and other defaults have been applied to it, and are only written to keys that have no value.

  6. case class UnexpectedKey(key: Any) extends AssertionError with Product with Serializable

    Permalink

Value Members

  1. object Conf

    Permalink

    Convenience method for loading a SparkConf with initial values taken from a comma-delimited list of files in the SPARK_PROPERTIES_FILES environment variable (as well as system properties as usual).

  2. object Context extends Serializable

    Permalink
  3. object KeyPartitioner

    Permalink

    Generate a Spark org.apache.spark.Partitioner that maps elements to a partition indicated by an Int that either is the key, or is the first element of a tuple.

  4. object Partitioner

    Permalink

    Convenience-methods for creating Spark Partitioners from (partial-)functions

  5. package accumulator

    Permalink
  6. package confs

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped