com.holdenkarau.spark.testing

RDDComparisons

trait RDDComparisons extends RDDComparisonsLike with TestSuite

Self Type
RDDComparisons with Suite
Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. RDDComparisons
  2. TestSuite
  3. RDDComparisonsLike
  4. TestSuiteLike
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def assert[U](message: String, expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

    Definition Classes
    TestSuiteTestSuiteLike
  8. def assert[U](expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

    Definition Classes
    TestSuiteTestSuiteLike
  9. def assertEmpty[U](arr: Array[U])(implicit CT: ClassTag[U]): Unit

    Definition Classes
    TestSuiteTestSuiteLike
  10. def assertRDDEquals[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

    Asserts two RDDs are equal (un ordered).

    Asserts two RDDs are equal (un ordered). If they are equal assertion succeeds, otherwise assertion fails.

    Definition Classes
    RDDComparisonsLike
  11. def assertRDDEqualsWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

    Asserts two RDDs are equal (with the same order).

    Asserts two RDDs are equal (with the same order). If they are equal assertion succeeds, otherwise assertion fails.

    Definition Classes
    RDDComparisonsLike
  12. def assertTrue(expected: Boolean): Unit

    Definition Classes
    TestSuiteTestSuiteLike
  13. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  14. def compareRDD[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(T, Int, Int)]

    Compare two RDDs where we do not require the order to be equal.

    Compare two RDDs where we do not require the order to be equal. If they are equal returns None, otherwise returns Some with the first mismatch.

    returns

    None if the two RDDs are equal, or Some containing the first mismatch information. The mismatch information will be Tuple3 of: (key, number of times this key occur in expected RDD, number of times this key occur in result RDD)

    Definition Classes
    RDDComparisonsLike
  15. def compareRDDWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    Compare two RDDs with order (e.

    Compare two RDDs with order (e.g. [1,2,3] != [3,2,1]) If the partitioners are not the same this requires multiple passes on the input. If they are equal returns None, otherwise returns Some with the first mismatch. If the lengths are not equal, one of the two components may be None.

    Definition Classes
    RDDComparisonsLike
  16. def compareRDDWithOrderSamePartitioner[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    Compare two RDDs.

    Compare two RDDs. If they are equal returns None, otherwise returns Some with the first mismatch. Assumes we have the same partitioner.

    Definition Classes
    RDDComparisonsLike
  17. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  18. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  19. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  20. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  21. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  22. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  23. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  24. final def notify(): Unit

    Definition Classes
    AnyRef
  25. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  26. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  27. def toString(): String

    Definition Classes
    AnyRef → Any
  28. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from TestSuite

Inherited from RDDComparisonsLike

Inherited from TestSuiteLike

Inherited from AnyRef

Inherited from Any

Ungrouped