com.tencentcloudapi.dlc.v20210125.models

Class CreateSparkAppRequest

java.lang.Object

com.tencentcloudapi.common.AbstractModel

com.tencentcloudapi.dlc.v20210125.models.CreateSparkAppRequest

public class CreateSparkAppRequest
extends AbstractModel

Constructor Summary

Constructors

Constructor and Description
CreateSparkAppRequest()
CreateSparkAppRequest(CreateSparkAppRequest source) NOTE: Any ambiguous key set via .set("AnyKey", "value") will be a shallow copy, and any explicit key, i.e Foo, set via .setFoo("value") will be a deep copy.

Method Summary

Modifier and Type	Method and Description
String	getAppArchives() Get Archives: Dependency resources
String	getAppConf() Get Spark configurations separated by line break
String	getAppDriverSize() Get Driver resource specification of the Spark job.
Long	getAppExecutorMaxNumbers() Get The specified executor count (max), which defaults to 1.
Long	getAppExecutorNums() Get Number of Spark job executors
String	getAppExecutorSize() Get Executor resource specification of the Spark job.
String	getAppFile() Get Execution entry of the Spark application
String	getAppFiles() Get Dependency resources of the Spark job separated by comma
String	getAppJars() Get Dependency JAR packages of the Spark JAR job separated by comma
String	getAppName() Get Spark application name
String	getAppPythonFiles() Get PySpark: Python dependency, which can be in .py, .zip, or .egg format.
Long	getAppType() Get 1: Spark JAR application; 2: Spark streaming application
String	getCmdArgs() Get Command line parameters of the Spark job
String	getDataEngine() Get The data engine executing the Spark job
String	getDataSource() Get Data source name
String	getEni() Get This field has been disused.
String	getIsLocal() Get Whether it is upload locally.
String	getIsLocalArchives() Get Archives: Dependency upload method.
String	getIsLocalFiles() Get Whether it is upload locally.
String	getIsLocalJars() Get Whether it is upload locally.
String	getIsLocalPythonFiles() Get PySpark: Dependency upload method.
String	getMainClass() Get Main class of the Spark JAR job during execution
Long	getMaxRetries() Get This parameter takes effect only for Spark flow tasks.
Long	getRoleArn() Get Execution role ID of the Spark job
String	getSessionId() Get The ID of the associated Data Lake Compute query script.
String	getSparkImage() Get The Spark image version.
String	getSparkImageVersion() Get The Spark image version name.
void	setAppArchives(String AppArchives) Set Archives: Dependency resources
void	setAppConf(String AppConf) Set Spark configurations separated by line break
void	setAppDriverSize(String AppDriverSize) Set Driver resource specification of the Spark job.
void	setAppExecutorMaxNumbers(Long AppExecutorMaxNumbers) Set The specified executor count (max), which defaults to 1.
void	setAppExecutorNums(Long AppExecutorNums) Set Number of Spark job executors
void	setAppExecutorSize(String AppExecutorSize) Set Executor resource specification of the Spark job.
void	setAppFile(String AppFile) Set Execution entry of the Spark application
void	setAppFiles(String AppFiles) Set Dependency resources of the Spark job separated by comma
void	setAppJars(String AppJars) Set Dependency JAR packages of the Spark JAR job separated by comma
void	setAppName(String AppName) Set Spark application name
void	setAppPythonFiles(String AppPythonFiles) Set PySpark: Python dependency, which can be in .py, .zip, or .egg format.
void	setAppType(Long AppType) Set 1: Spark JAR application; 2: Spark streaming application
void	setCmdArgs(String CmdArgs) Set Command line parameters of the Spark job
void	setDataEngine(String DataEngine) Set The data engine executing the Spark job
void	setDataSource(String DataSource) Set Data source name
void	setEni(String Eni) Set This field has been disused.
void	setIsLocal(String IsLocal) Set Whether it is upload locally.
void	setIsLocalArchives(String IsLocalArchives) Set Archives: Dependency upload method.
void	setIsLocalFiles(String IsLocalFiles) Set Whether it is upload locally.
void	setIsLocalJars(String IsLocalJars) Set Whether it is upload locally.
void	setIsLocalPythonFiles(String IsLocalPythonFiles) Set PySpark: Dependency upload method.
void	setMainClass(String MainClass) Set Main class of the Spark JAR job during execution
void	setMaxRetries(Long MaxRetries) Set This parameter takes effect only for Spark flow tasks.
void	setRoleArn(Long RoleArn) Set Execution role ID of the Spark job
void	setSessionId(String SessionId) Set The ID of the associated Data Lake Compute query script.
void	setSparkImage(String SparkImage) Set The Spark image version.
void	setSparkImageVersion(String SparkImageVersion) Set The Spark image version name.
void	toMap(HashMap<String,String> map, String prefix) Internal implementation, normal users should not use it.

Methods inherited from class com.tencentcloudapi.common.AbstractModel

any, fromJsonString, getBinaryParams, getMultipartRequestParams, set, setParamArrayObj, setParamArraySimple, setParamObj, setParamSimple, toJsonString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CreateSparkAppRequest

public CreateSparkAppRequest()

CreateSparkAppRequest

public CreateSparkAppRequest(CreateSparkAppRequest source)

NOTE: Any ambiguous key set via .set("AnyKey", "value") will be a shallow copy, and any explicit key, i.e Foo, set via .setFoo("value") will be a deep copy.

Method Detail

getAppName

public String getAppName()

Get Spark application name

Returns:

AppName Spark application name

setAppName

public void setAppName(String AppName)

Set Spark application name

Parameters:

AppName - Spark application name

getAppType

public Long getAppType()

Get 1: Spark JAR application; 2: Spark streaming application

Returns:

AppType 1: Spark JAR application; 2: Spark streaming application

setAppType

public void setAppType(Long AppType)

Set 1: Spark JAR application; 2: Spark streaming application

Parameters:

AppType - 1: Spark JAR application; 2: Spark streaming application

getDataEngine

public String getDataEngine()

Get The data engine executing the Spark job

Returns:

DataEngine The data engine executing the Spark job

setDataEngine

public void setDataEngine(String DataEngine)

Set The data engine executing the Spark job

Parameters:

DataEngine - The data engine executing the Spark job

getAppFile

public String getAppFile()

Get Execution entry of the Spark application

Returns:

AppFile Execution entry of the Spark application

setAppFile

public void setAppFile(String AppFile)

Set Execution entry of the Spark application

Parameters:

AppFile - Execution entry of the Spark application

getRoleArn

public Long getRoleArn()

Get Execution role ID of the Spark job

Returns:

RoleArn Execution role ID of the Spark job

setRoleArn

public void setRoleArn(Long RoleArn)

Set Execution role ID of the Spark job

Parameters:

RoleArn - Execution role ID of the Spark job

getAppDriverSize

public String getAppDriverSize()

Get Driver resource specification of the Spark job. Valid values: `small`, `medium`, `large`, `xlarge`.

Returns:

AppDriverSize Driver resource specification of the Spark job. Valid values: `small`, `medium`, `large`, `xlarge`.

setAppDriverSize

public void setAppDriverSize(String AppDriverSize)

Set Driver resource specification of the Spark job. Valid values: `small`, `medium`, `large`, `xlarge`.

Parameters:

AppDriverSize - Driver resource specification of the Spark job. Valid values: `small`, `medium`, `large`, `xlarge`.

getAppExecutorSize

public String getAppExecutorSize()

Get Executor resource specification of the Spark job. Valid values: `small`, `medium`, `large`, `xlarge`.

Returns:

AppExecutorSize Executor resource specification of the Spark job. Valid values: `small`, `medium`, `large`, `xlarge`.

setAppExecutorSize

public void setAppExecutorSize(String AppExecutorSize)

Set Executor resource specification of the Spark job. Valid values: `small`, `medium`, `large`, `xlarge`.

Parameters:

AppExecutorSize - Executor resource specification of the Spark job. Valid values: `small`, `medium`, `large`, `xlarge`.

getAppExecutorNums

public Long getAppExecutorNums()

Get Number of Spark job executors

Returns:

AppExecutorNums Number of Spark job executors

setAppExecutorNums

public void setAppExecutorNums(Long AppExecutorNums)

Set Number of Spark job executors

Parameters:

AppExecutorNums - Number of Spark job executors

getEni

public String getEni()

Get This field has been disused. Use the `Datasource` field instead.

Returns:

Eni This field has been disused. Use the `Datasource` field instead.

setEni

public void setEni(String Eni)

Set This field has been disused. Use the `Datasource` field instead.

Parameters:

Eni - This field has been disused. Use the `Datasource` field instead.

getIsLocal

public String getIsLocal()

Get Whether it is upload locally. Valid values: `cos`, `lakefs`.

Returns:

IsLocal Whether it is upload locally. Valid values: `cos`, `lakefs`.

setIsLocal

public void setIsLocal(String IsLocal)

Set Whether it is upload locally. Valid values: `cos`, `lakefs`.

Parameters:

IsLocal - Whether it is upload locally. Valid values: `cos`, `lakefs`.

getMainClass

public String getMainClass()

Get Main class of the Spark JAR job during execution

Returns:

MainClass Main class of the Spark JAR job during execution

setMainClass

public void setMainClass(String MainClass)

Set Main class of the Spark JAR job during execution

Parameters:

MainClass - Main class of the Spark JAR job during execution

getAppConf

public String getAppConf()

Get Spark configurations separated by line break

Returns:

AppConf Spark configurations separated by line break

setAppConf

public void setAppConf(String AppConf)

Set Spark configurations separated by line break

Parameters:

AppConf - Spark configurations separated by line break

getIsLocalJars

public String getIsLocalJars()

Get Whether it is upload locally. Valid values: `cos`, `lakefs`.

Returns:

IsLocalJars Whether it is upload locally. Valid values: `cos`, `lakefs`.

setIsLocalJars

public void setIsLocalJars(String IsLocalJars)

Set Whether it is upload locally. Valid values: `cos`, `lakefs`.

Parameters:

IsLocalJars - Whether it is upload locally. Valid values: `cos`, `lakefs`.

getAppJars

public String getAppJars()

Get Dependency JAR packages of the Spark JAR job separated by comma

Returns:

AppJars Dependency JAR packages of the Spark JAR job separated by comma

setAppJars

public void setAppJars(String AppJars)

Set Dependency JAR packages of the Spark JAR job separated by comma

Parameters:

AppJars - Dependency JAR packages of the Spark JAR job separated by comma

getIsLocalFiles

public String getIsLocalFiles()

Get Whether it is upload locally. Valid values: `cos`, `lakefs`.

Returns:

IsLocalFiles Whether it is upload locally. Valid values: `cos`, `lakefs`.

setIsLocalFiles

public void setIsLocalFiles(String IsLocalFiles)

Set Whether it is upload locally. Valid values: `cos`, `lakefs`.

Parameters:

IsLocalFiles - Whether it is upload locally. Valid values: `cos`, `lakefs`.

getAppFiles

public String getAppFiles()

Get Dependency resources of the Spark job separated by comma

Returns:

AppFiles Dependency resources of the Spark job separated by comma

setAppFiles

public void setAppFiles(String AppFiles)

Set Dependency resources of the Spark job separated by comma

Parameters:

AppFiles - Dependency resources of the Spark job separated by comma

getCmdArgs

public String getCmdArgs()

Get Command line parameters of the Spark job

Returns:

CmdArgs Command line parameters of the Spark job

setCmdArgs

public void setCmdArgs(String CmdArgs)

Set Command line parameters of the Spark job

Parameters:

CmdArgs - Command line parameters of the Spark job

getMaxRetries

public Long getMaxRetries()

Get This parameter takes effect only for Spark flow tasks.

Returns:

MaxRetries This parameter takes effect only for Spark flow tasks.

setMaxRetries

public void setMaxRetries(Long MaxRetries)

Set This parameter takes effect only for Spark flow tasks.

Parameters:

MaxRetries - This parameter takes effect only for Spark flow tasks.

getDataSource

public String getDataSource()

Get Data source name

Returns:

DataSource Data source name

setDataSource

public void setDataSource(String DataSource)

Set Data source name

Parameters:

DataSource - Data source name

getIsLocalPythonFiles

public String getIsLocalPythonFiles()

Get PySpark: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs).

Returns:

IsLocalPythonFiles PySpark: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs).

setIsLocalPythonFiles

public void setIsLocalPythonFiles(String IsLocalPythonFiles)

Set PySpark: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs).

Parameters:

IsLocalPythonFiles - PySpark: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs).

getAppPythonFiles

public String getAppPythonFiles()

Get PySpark: Python dependency, which can be in .py, .zip, or .egg format. Multiple files should be separated by comma.

Returns:

AppPythonFiles PySpark: Python dependency, which can be in .py, .zip, or .egg format. Multiple files should be separated by comma.

setAppPythonFiles

public void setAppPythonFiles(String AppPythonFiles)

Set PySpark: Python dependency, which can be in .py, .zip, or .egg format. Multiple files should be separated by comma.

Parameters:

AppPythonFiles - PySpark: Python dependency, which can be in .py, .zip, or .egg format. Multiple files should be separated by comma.

getIsLocalArchives

public String getIsLocalArchives()

Get Archives: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs).

Returns:

IsLocalArchives Archives: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs).

setIsLocalArchives

public void setIsLocalArchives(String IsLocalArchives)

Set Archives: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs).

Parameters:

IsLocalArchives - Archives: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs).

getAppArchives

public String getAppArchives()

Get Archives: Dependency resources

Returns:

AppArchives Archives: Dependency resources

setAppArchives

public void setAppArchives(String AppArchives)

Set Archives: Dependency resources

Parameters:

AppArchives - Archives: Dependency resources

getSparkImage

public String getSparkImage()

Get The Spark image version.

Returns:

SparkImage The Spark image version.

setSparkImage

public void setSparkImage(String SparkImage)

Set The Spark image version.

Parameters:

SparkImage - The Spark image version.

getSparkImageVersion

public String getSparkImageVersion()

Get The Spark image version name.

Returns:

SparkImageVersion The Spark image version name.

setSparkImageVersion

public void setSparkImageVersion(String SparkImageVersion)

Set The Spark image version name.

Parameters:

SparkImageVersion - The Spark image version name.

getAppExecutorMaxNumbers

public Long getAppExecutorMaxNumbers()

Get The specified executor count (max), which defaults to 1. This parameter applies if the "Dynamic" mode is selected. If the "Dynamic" mode is not selected, the executor count is equal to `AppExecutorNums`.

Returns:

AppExecutorMaxNumbers The specified executor count (max), which defaults to 1. This parameter applies if the "Dynamic" mode is selected. If the "Dynamic" mode is not selected, the executor count is equal to `AppExecutorNums`.

setAppExecutorMaxNumbers

public void setAppExecutorMaxNumbers(Long AppExecutorMaxNumbers)

Set The specified executor count (max), which defaults to 1. This parameter applies if the "Dynamic" mode is selected. If the "Dynamic" mode is not selected, the executor count is equal to `AppExecutorNums`.

Parameters:

AppExecutorMaxNumbers - The specified executor count (max), which defaults to 1. This parameter applies if the "Dynamic" mode is selected. If the "Dynamic" mode is not selected, the executor count is equal to `AppExecutorNums`.

getSessionId

public String getSessionId()

Get The ID of the associated Data Lake Compute query script.

Returns:

SessionId The ID of the associated Data Lake Compute query script.

setSessionId

public void setSessionId(String SessionId)

Set The ID of the associated Data Lake Compute query script.

Parameters:

SessionId - The ID of the associated Data Lake Compute query script.

toMap

public void toMap(HashMap<String,String> map,
                  String prefix)

Internal implementation, normal users should not use it.

Specified by:

toMap in class AbstractModel