Object

com.holdenkarau.spark.testing

JavaRDDComparisons

Related Doc: package testing

Permalink

object JavaRDDComparisons extends RDDComparisonsLike with JavaTestSuite

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JavaRDDComparisons
  2. JavaTestSuite
  3. RDDComparisonsLike
  4. TestSuiteLike
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def assert[U](message: String, expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

    Permalink
    Definition Classes
    JavaTestSuiteTestSuiteLike
  6. def assert[U](expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

    Permalink
    Definition Classes
    JavaTestSuiteTestSuiteLike
  7. def assertEmpty[U](arr: Array[U])(implicit CT: ClassTag[U]): Unit

    Permalink
    Definition Classes
    JavaTestSuiteTestSuiteLike
  8. def assertRDDEquals[T](expected: JavaRDD[T], result: JavaRDD[T]): Unit

    Permalink

    Asserts two RDDs are equal (un ordered).

    Asserts two RDDs are equal (un ordered). If they are equal assertion succeeds, otherwise assertion fails.

  9. def assertRDDEquals[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

    Permalink

    Asserts two RDDs are equal (un ordered).

    Asserts two RDDs are equal (un ordered). If they are equal assertion succeeds, otherwise assertion fails.

    Definition Classes
    RDDComparisonsLike
  10. def assertRDDEqualsWithOrder[T](expected: JavaRDD[T], result: JavaRDD[T]): Unit

    Permalink

    Asserts two RDDs are equal (with the same order).

    Asserts two RDDs are equal (with the same order). If they are equal assertion succeeds, otherwise assertion fails.

  11. def assertRDDEqualsWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

    Permalink

    Asserts two RDDs are equal (with the same order).

    Asserts two RDDs are equal (with the same order). If they are equal assertion succeeds, otherwise assertion fails.

    Definition Classes
    RDDComparisonsLike
  12. def assertTrue(expected: Boolean): Unit

    Permalink
    Definition Classes
    JavaTestSuiteTestSuiteLike
  13. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  14. def compareRDD[T](expected: JavaRDD[T], result: JavaRDD[T]): Option[(T, Integer, Integer)]

    Permalink

    Compare two RDDs where we do not require the order to be equal.

    Compare two RDDs where we do not require the order to be equal. If they are equal returns None, otherwise returns Some with the first mismatch.

    returns

    None if the two RDDs are equal, or Some That contains first mismatch information. Mismatch information will be Tuple3 of: (key, number of times this key occur in expected RDD, number of times this key occur in result RDD)

  15. def compareRDD[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(T, Int, Int)]

    Permalink

    Compare two RDDs where we do not require the order to be equal.

    Compare two RDDs where we do not require the order to be equal. If they are equal returns None, otherwise returns Some with the first mismatch.

    returns

    None if the two RDDs are equal, or Some That contains first mismatch information. Mismatch information will be Tuple3 of: (key, number of times this key occur in expected RDD, number of times this key occur in result RDD)

    Definition Classes
    RDDComparisonsLike
  16. def compareRDDWithOrder[T](expected: JavaRDD[T], result: JavaRDD[T]): Option[(Option[T], Option[T])]

    Permalink

    Compare two RDDs.

    Compare two RDDs. If they are equal returns None, otherwise returns Some with the first mismatch. Assumes we have the same partitioner.

  17. def compareRDDWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    Permalink

    Compare two RDDs with order (e.g.

    Compare two RDDs with order (e.g. [1,2,3] != [3,2,1]) If the partitioners are not the same this requires multiple passes on the input. If they are equal returns None, otherwise returns Some with the first mismatch. If the lengths are not equal, one of the two components may be None.

    Definition Classes
    RDDComparisonsLike
  18. def compareRDDWithOrderSamePartitioner[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    Permalink

    Compare two RDDs.

    Compare two RDDs. If they are equal returns None, otherwise returns Some with the first mismatch. Assumes we have the same partitioner.

    Definition Classes
    RDDComparisonsLike
  19. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  20. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  21. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  22. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  23. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  24. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  25. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  26. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  27. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  28. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  29. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  30. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from JavaTestSuite

Inherited from RDDComparisonsLike

Inherited from TestSuiteLike

Inherited from AnyRef

Inherited from Any

Ungrouped