Class

com.twitter.scalding.platform

HadoopPlatformJobTest

Related Doc: package platform

Permalink

case class HadoopPlatformJobTest(cons: (Args) ⇒ Job, cluster: LocalCluster, argsMap: Map[String, List[String]] = Map.empty, dataToCreate: Seq[(String, Seq[String])] = Vector(), sourceWriters: Seq[(Args) ⇒ Job] = Vector.empty, sourceReaders: Seq[(Mode) ⇒ Unit] = Vector.empty, flowCheckers: Seq[(Flow[JobConf]) ⇒ Unit] = Vector.empty) extends HadoopPlatform[Args, Job, HadoopPlatformJobTest] with Product with Serializable

This class is used to construct unit tests in scalding which use Hadoop's MiniCluster to more fully simulate and test the logic which is deployed in a job.

Linear Supertypes
Serializable, Serializable, Product, Equals, HadoopPlatform[Args, Job, HadoopPlatformJobTest], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. HadoopPlatformJobTest
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. HadoopPlatform
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HadoopPlatformJobTest(cons: (Args) ⇒ Job, cluster: LocalCluster, argsMap: Map[String, List[String]] = Map.empty, dataToCreate: Seq[(String, Seq[String])] = Vector(), sourceWriters: Seq[(Args) ⇒ Job] = Vector.empty, sourceReaders: Seq[(Mode) ⇒ Unit] = Vector.empty, flowCheckers: Seq[(Flow[JobConf]) ⇒ Unit] = Vector.empty)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. def arg(key: String, value: String): HadoopPlatformJobTest

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  5. val argsMap: Map[String, List[String]]

    Permalink

  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  7. def checkSinks(): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    HadoopPlatform

  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  9. val cluster: LocalCluster

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  10. val cons: (Args) ⇒ Job

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  11. def createSources(): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    HadoopPlatform

  12. def data(data: (String, Seq[String])): HadoopPlatformJobTest

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  13. val dataToCreate: Seq[(String, Seq[String])]

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  14. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  15. final def execute(job: Job): Unit

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform
    Annotations
    @tailrec()

  16. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  17. val flowCheckers: Seq[(Flow[JobConf]) ⇒ Unit]

    Permalink

  18. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  19. def init(cons: (Args) ⇒ Job): Job

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  20. def inspectCompletedFlow(checker: (Flow[JobConf]) ⇒ Unit): HadoopPlatformJobTest

    Permalink

  21. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  22. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  23. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  24. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  25. def run(): Unit

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  26. def runExpectFailure[K](fn: (Throwable) ⇒ K): K

    Permalink
    Definition Classes
    HadoopPlatform

  27. def sink[T](in: Mappable[T])(toExpect: (Seq[T]) ⇒ Unit): HadoopPlatformJobTest

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  28. def sink[K](location: String)(toExpect: (Seq[K]) ⇒ Unit)(implicit arg0: TypeDescriptor[K]): HadoopPlatformJobTest

    Permalink
    Definition Classes
    HadoopPlatform

  29. def source[T](out: TypedSink[T], data: Seq[T]): HadoopPlatformJobTest

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  30. def source[K](location: String, data: Seq[K])(implicit arg0: TypeDescriptor[K]): HadoopPlatformJobTest

    Permalink
    Definition Classes
    HadoopPlatform

  31. val sourceReaders: Seq[(Mode) ⇒ Unit]

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  32. val sourceWriters: Seq[(Args) ⇒ Job]

    Permalink
    Definition Classes
    HadoopPlatformJobTest → HadoopPlatform

  33. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  34. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  35. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  36. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from HadoopPlatform[Args, Job, HadoopPlatformJobTest]

Inherited from AnyRef

Inherited from Any

Ungrouped