Package

org.apache.spark

deploy

Permalink

package deploy

Visibility
  1. Public
  2. All

Type Members

  1. class SparkHadoopUtil extends Logging

    Permalink

    :: DeveloperApi :: Contains util methods to interact with Hadoop from Spark.

    :: DeveloperApi :: Contains util methods to interact with Hadoop from Spark.

    Annotations
    @DeveloperApi()

Value Members

  1. object Client

    Permalink

    Executable utility for starting and terminating drivers inside of a standalone cluster.

  2. object ExternalShuffleService extends Logging

    Permalink

    A main class for running the external shuffle service.

  3. object PythonRunner

    Permalink

    A main class used to launch Python applications.

    A main class used to launch Python applications. It executes python as a subprocess and then has it connect back to the JVM to access system properties, etc.

  4. object RRunner

    Permalink

    Main class used to launch SparkR applications using spark-submit.

    Main class used to launch SparkR applications using spark-submit. It executes R as a subprocess and then has it connect back to the JVM to access system properties etc.

  5. object SparkHadoopUtil

    Permalink
  6. object SparkSubmit

    Permalink

    Main gateway of launching a Spark application.

    Main gateway of launching a Spark application.

    This program handles setting up the classpath with relevant Spark dependencies and provides a layer over the different cluster managers and deploy modes that Spark supports.

  7. package history

    Permalink
  8. package master

    Permalink
  9. package worker

    Permalink

Ungrouped