Package | Description |
---|---|
co.cask.cdap.app.runtime.spark | |
co.cask.cdap.app.runtime.spark.distributed | |
co.cask.cdap.app.runtime.spark.preview | |
co.cask.cdap.app.runtime.spark.submit |
Modifier and Type | Method and Description |
---|---|
static SparkRuntimeContext |
SparkRuntimeContextProvider.get()
Returns the current
SparkRuntimeContext . |
SparkRuntimeContext |
SparkClassLoader.getRuntimeContext()
Returns the
SparkRuntimeContext . |
Modifier and Type | Method and Description |
---|---|
SparkRuntimeContextConfig |
SparkRuntimeContextConfig.set(SparkRuntimeContext context,
File pluginArchive)
Sets configurations based on the given context.
|
Constructor and Description |
---|
SparkClassLoader(SparkRuntimeContext runtimeContext)
Creates a new SparkClassLoader with the given
SparkRuntimeContext . |
Constructor and Description |
---|
SparkDriverService(URI baseURI,
SparkRuntimeContext runtimeContext) |
Constructor and Description |
---|
SparkDataTracer(SparkRuntimeContext sparkRuntimeContext,
String tracerName)
Constructor.
|
Modifier and Type | Method and Description |
---|---|
<V> com.google.common.util.concurrent.ListenableFuture<V> |
AbstractSparkSubmitter.submit(SparkRuntimeContext runtimeContext,
Map<String,String> configs,
List<LocalizeResource> resources,
URI jobFile,
V result) |
<V> com.google.common.util.concurrent.ListenableFuture<V> |
SparkSubmitter.submit(SparkRuntimeContext runtimeContext,
Map<String,String> configs,
List<LocalizeResource> resources,
URI jobFile,
V result)
Submits a Spark job to the Spark framework.
|
Constructor and Description |
---|
DistributedSparkSubmitter(Configuration hConf,
LocationFactory locationFactory,
String hostname,
SparkRuntimeContext runtimeContext,
String schedulerQueueName) |
Copyright © 2018 Cask Data, Inc. Licensed under the Apache License, Version 2.0.