com.holdenkarau.spark.testing

JavaRDDComparisons

object JavaRDDComparisons extends RDDComparisonsLike with JavaTestSuite

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. JavaRDDComparisons
  2. JavaTestSuite
  3. RDDComparisonsLike
  4. TestSuiteLike
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def assert[U](message: String, expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

    Definition Classes
    JavaTestSuiteTestSuiteLike
  8. def assert[U](expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

    Definition Classes
    JavaTestSuiteTestSuiteLike
  9. def assertEmpty[U](arr: Array[U])(implicit CT: ClassTag[U]): Unit

    Definition Classes
    JavaTestSuiteTestSuiteLike
  10. def assertRDDEquals[T](expected: JavaRDD[T], result: JavaRDD[T]): Unit

    Asserts two RDDs are equal (un ordered).

    Asserts two RDDs are equal (un ordered). If they are equal assertion succeeds, otherwise assertion fails.

  11. def assertRDDEquals[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

    Asserts two RDDs are equal (un ordered).

    Asserts two RDDs are equal (un ordered). If they are equal assertion succeeds, otherwise assertion fails.

    Definition Classes
    RDDComparisonsLike
  12. def assertRDDEqualsWithOrder[T](expected: JavaRDD[T], result: JavaRDD[T]): Unit

    Asserts two RDDs are equal (with the same order).

    Asserts two RDDs are equal (with the same order). If they are equal assertion succeeds, otherwise assertion fails.

  13. def assertRDDEqualsWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

    Asserts two RDDs are equal (with the same order).

    Asserts two RDDs are equal (with the same order). If they are equal assertion succeeds, otherwise assertion fails.

    Definition Classes
    RDDComparisonsLike
  14. def assertTrue(expected: Boolean): Unit

    Definition Classes
    JavaTestSuiteTestSuiteLike
  15. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  16. def compareRDD[T](expected: JavaRDD[T], result: JavaRDD[T]): Option[(T, Integer, Integer)]

    Compare two RDDs where we do not require the order to be equal.

    Compare two RDDs where we do not require the order to be equal. If they are equal returns None, otherwise returns Some with the first mismatch.

    returns

    None if the two RDDs are equal, or Some that contains the first mismatch information. Mismatch information will be Tuple3 of: (key, number of times this key occur in expected RDD, number of times this key occur in result RDD)

  17. def compareRDD[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(T, Int, Int)]

    Compare two RDDs where we do not require the order to be equal.

    Compare two RDDs where we do not require the order to be equal. If they are equal returns None, otherwise returns Some with the first mismatch.

    returns

    None if the two RDDs are equal, or Some containing the first mismatch information. The mismatch information will be Tuple3 of: (key, number of times this key occur in expected RDD, number of times this key occur in result RDD)

    Definition Classes
    RDDComparisonsLike
  18. def compareRDDWithOrder[T](expected: JavaRDD[T], result: JavaRDD[T]): Option[(Option[T], Option[T])]

    Compare two RDDs.

    Compare two RDDs. If they are equal returns None, otherwise returns Some with the first mismatch. Assumes we have the same partitioner.

  19. def compareRDDWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    Compare two RDDs with order (e.

    Compare two RDDs with order (e.g. [1,2,3] != [3,2,1]) If the partitioners are not the same this requires multiple passes on the input. If they are equal returns None, otherwise returns Some with the first mismatch. If the lengths are not equal, one of the two components may be None.

    Definition Classes
    RDDComparisonsLike
  20. def compareRDDWithOrderSamePartitioner[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    Compare two RDDs.

    Compare two RDDs. If they are equal returns None, otherwise returns Some with the first mismatch. Assumes we have the same partitioner.

    Definition Classes
    RDDComparisonsLike
  21. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  22. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  23. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  24. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  25. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  26. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  27. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  28. final def notify(): Unit

    Definition Classes
    AnyRef
  29. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  30. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  31. def toString(): String

    Definition Classes
    AnyRef → Any
  32. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  33. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from JavaTestSuite

Inherited from RDDComparisonsLike

Inherited from TestSuiteLike

Inherited from AnyRef

Inherited from Any

Ungrouped