Package

org.apache.spark

util

Permalink

package util

Spark utilities.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. util
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Type Members

  1. class EnumUtil extends AnyRef

    Permalink
  2. case class MutablePair[T1, T2](_1: T1, _2: T2) extends Product2[T1, T2] with Product with Serializable

    Permalink

    :: DeveloperApi :: A tuple of 2 elements.

    :: DeveloperApi :: A tuple of 2 elements. This can be used as an alternative to Scala's Tuple2 when we want to minimize object allocation.

    _1

    Element 1 of this MutablePair

    _2

    Element 2 of this MutablePair

    Annotations
    @DeveloperApi()
  3. class StatCounter extends Serializable

    Permalink

    A class for tracking the statistics of a set of numbers (count, mean and variance) in a numerically robust way.

    A class for tracking the statistics of a set of numbers (count, mean and variance) in a numerically robust way. Includes support for merging two StatCounters. Based on Welford and Chan's algorithms for running variance.

  4. trait TaskCompletionListener extends EventListener

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Listener providing a callback function to invoke when a task's execution completes.

    Annotations
    @DeveloperApi()
  5. class Vector extends Serializable

    Permalink
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) Use Vectors.dense from Spark's mllib.linalg package instead.

Value Members

  1. object RpcUtils

    Permalink
  2. object SizeEstimator extends Logging

    Permalink

    :: DeveloperApi :: Estimates the sizes of Java objects (number of bytes of memory they occupy), for use in memory-aware caches.

    :: DeveloperApi :: Estimates the sizes of Java objects (number of bytes of memory they occupy), for use in memory-aware caches.

    Based on the following JavaWorld article: http://www.javaworld.com/javaworld/javaqa/2003-12/02-qa-1226-sizeof.html

    Annotations
    @DeveloperApi()
  3. object StatCounter extends Serializable

    Permalink
  4. object Vector extends Serializable

    Permalink
  5. package collection

    Permalink
  6. package random

    Permalink

    Utilities for random number generation.

Inherited from AnyRef

Inherited from Any

Ungrouped