spark

jobserver

package jobserver

Visibility
  1. Public
  2. All

Type Members

  1. trait SparkHiveJob extends SparkJobBase

  2. trait SparkSqlJob extends SparkJobBase

  3. trait SparkStramingJob extends SparkJobBase

    Defines a Job that runs on a StreamingContext, note that these jobs are usually long running jobs and there's (yet) no way in Spark Job Server to query the status of these jobs.

Value Members

  1. object HiveLoaderJob extends SparkHiveJob

    A test job that accepts a HiveContext, as opposed to the regular SparkContext.

    A test job that accepts a HiveContext, as opposed to the regular SparkContext. Initializes some dummy data into a table, reads it back out, and returns a count (Will create Hive metastore at job-server/metastore_db if Hive isn't configured)

  2. object HiveTestJob extends SparkHiveJob

    This job simply runs the Hive SQL in the config.

  3. object SqlLoaderJob extends SparkSqlJob

    A test job that accepts a SQLContext, as opposed to the regular SparkContext.

    A test job that accepts a SQLContext, as opposed to the regular SparkContext. Just initializes some dummy data into a table.

  4. object SqlTestJob extends SparkSqlJob

    This job simply runs the SQL in the config.

  5. object StreamingTestJob extends SparkStramingJob

    Annotations
    @VisibleForTesting()

  6. package context

Ungrouped