platform

Type Members

1. trait HadoopPlatform[P, R, T <: HadoopPlatform[P, R, T]] extends AnyRef

   

2. case class HadoopPlatformExecutionTest(cons: (Config) ⇒ Execution[_], cluster: LocalCluster, parameters: Map[String, String] = Map.empty, dataToCreate: Seq[(String, Seq[String])] = Vector(), sourceWriters: Seq[(Config) ⇒ Execution[_]] = Vector.empty, sourceReaders: Seq[(Mode) ⇒ Unit] = Vector.empty, flowCheckers: Seq[(Flow[JobConf]) ⇒ Unit] = Vector.empty) extends HadoopPlatform[Config, Execution[_], HadoopPlatformExecutionTest] with Product with Serializable

   

3. case class HadoopPlatformJobTest(cons: (Args) ⇒ Job, cluster: LocalCluster, argsMap: Map[String, List[String]] = Map.empty, dataToCreate: Seq[(String, Seq[String])] = Vector(), sourceWriters: Seq[(Args) ⇒ Job] = Vector.empty, sourceReaders: Seq[(Mode) ⇒ Unit] = Vector.empty, flowCheckers: Seq[(Flow[JobConf]) ⇒ Unit] = Vector.empty) extends HadoopPlatform[Args, Job, HadoopPlatformJobTest] with Product with Serializable

   

   This class is used to construct unit tests in scalding which use Hadoop's MiniCluster to more fully simulate and test the logic which is deployed in a job.

4. trait HadoopPlatformTest extends BeforeAndAfterEach

   

   This is a mixin fixture for scalatest which makes it easy to use a LocalCluster and will manage the lifecycle of one appropriately.

5. trait HadoopSharedPlatformTest extends BeforeAndAfterAll

   

6. class LocalCluster extends AnyRef