RDDComparisons

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def assert[U](message: String, expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

   

   Definition Classes

   TestSuite → TestSuiteLike

6. def assert[U](expected: U, actual: U)(implicit CT: ClassTag[U]): Unit

   

   Definition Classes

   TestSuite → TestSuiteLike

7. def assertEmpty[U](arr: Array[U])(implicit CT: ClassTag[U]): Unit

   

   Definition Classes

   TestSuite → TestSuiteLike

8. def assertRDDEquals[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

   

   Asserts two RDDs are equal (un ordered).

   Asserts two RDDs are equal (un ordered). If they are equal assertion succeeds, otherwise assertion fails.

   Definition Classes

   RDDComparisonsLike

9. def assertRDDEqualsWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Unit

   

   Asserts two RDDs are equal (with the same order).

   Asserts two RDDs are equal (with the same order). If they are equal assertion succeeds, otherwise assertion fails.

   Definition Classes

   RDDComparisonsLike

10. def assertTrue(expected: Boolean): Unit

    

    Definition Classes

    TestSuite → TestSuiteLike

11. def clone(): AnyRef

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

12. def compareRDD[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(T, Int, Int)]

    

    Compare two RDDs where we do not require the order to be equal.

    Compare two RDDs where we do not require the order to be equal. If they are equal returns None, otherwise returns Some with the first mismatch.

    returns

    None if the two RDDs are equal, or Some That contains first mismatch information. Mismatch information will be Tuple3 of: (key, number of times this key occur in expected RDD, number of times this key occur in result RDD)

    Definition Classes

    RDDComparisonsLike

13. def compareRDDWithOrder[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    

    Compare two RDDs with order (e.g.

    Compare two RDDs with order (e.g. [1,2,3] != [3,2,1]) If the partitioners are not the same this requires multiple passes on the input. If they are equal returns None, otherwise returns Some with the first mismatch. If the lengths are not equal, one of the two components may be None.

    Definition Classes

    RDDComparisonsLike

14. def compareRDDWithOrderSamePartitioner[T](expected: RDD[T], result: RDD[T])(implicit arg0: ClassTag[T]): Option[(Option[T], Option[T])]

    

    Compare two RDDs.

    Compare two RDDs. If they are equal returns None, otherwise returns Some with the first mismatch. Assumes we have the same partitioner.

    Definition Classes

    RDDComparisonsLike

15. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

16. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

17. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

18. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

19. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

20. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

21. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

22. final def notify(): Unit

    

    Definition Classes

    AnyRef

23. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

24. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

25. def toString(): String

    

    Definition Classes

    AnyRef → Any

26. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

27. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

28. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )