Trait

com.holdenkarau.spark.testing

RDDComparisonsLike

Related Doc: package testing

Permalink

trait RDDComparisonsLike extends TestSuiteLike

Linear Supertypes
TestSuiteLike, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RDDComparisonsLike
  2. TestSuiteLike
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def assert[U](message: String, expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

    Permalink
    Definition Classes
    TestSuiteLike
  2. abstract def assert[U](expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

    Permalink
    Definition Classes
    TestSuiteLike
  3. abstract def assertEmpty[U](arr: Array[U])(implicit CT: ClassTag[U]): Unit

    Permalink
    Definition Classes
    TestSuiteLike
  4. abstract def assertTrue(expected: Boolean): Unit

    Permalink
    Definition Classes
    TestSuiteLike

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def assertRDDEquals[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

    Permalink

    Asserts two RDDs are equal (un ordered).

    Asserts two RDDs are equal (un ordered). If they are equal assertion succeeds, otherwise assertion fails.

  6. def assertRDDEqualsWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

    Permalink

    Asserts two RDDs are equal (with the same order).

    Asserts two RDDs are equal (with the same order). If they are equal assertion succeeds, otherwise assertion fails.

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def compareRDD[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(T, Int, Int)]

    Permalink

    Compare two RDDs where we do not require the order to be equal.

    Compare two RDDs where we do not require the order to be equal. If they are equal returns None, otherwise returns Some with the first mismatch.

    returns

    None if the two RDDs are equal, or Some That contains first mismatch information. Mismatch information will be Tuple3 of: (key, number of times this key occur in expected RDD, number of times this key occur in result RDD)

  9. def compareRDDWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    Permalink

    Compare two RDDs with order (e.g.

    Compare two RDDs with order (e.g. [1,2,3] != [3,2,1]) If the partitioners are not the same this requires multiple passes on the input. If they are equal returns None, otherwise returns Some with the first mismatch. If the lengths are not equal, one of the two components may be None.

  10. def compareRDDWithOrderSamePartitioner[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    Permalink

    Compare two RDDs.

    Compare two RDDs. If they are equal returns None, otherwise returns Some with the first mismatch. Assumes we have the same partitioner.

  11. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  13. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  14. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  15. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  16. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  17. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  18. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  19. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  20. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  21. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  22. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from TestSuiteLike

Inherited from AnyRef

Inherited from Any

Ungrouped