com.tencentcloudapi.dlc.v20210125.models

Class SparkJobInfo

java.lang.Object

com.tencentcloudapi.common.AbstractModel

com.tencentcloudapi.dlc.v20210125.models.SparkJobInfo

public class SparkJobInfo
extends AbstractModel

Constructor Summary

Constructors

Constructor and Description
SparkJobInfo()
SparkJobInfo(SparkJobInfo source) NOTE: Any ambiguous key set via .set("AnyKey", "value") will be a shallow copy, and any explicit key, i.e Foo, set via .setFoo("value") will be a deep copy.

Method Summary

Modifier and Type	Method and Description
String	getAppPythonFiles() Get Note: This returned value has been disused.
String	getCmdArgs() Get Command line parameters of the Spark job separated by space
String	getCurrentTaskId() Get Last task ID of the Spark job
String	getDataEngine() Get Engine name
Long	getDataEngineStatus() Get Engine status.
String	getDataSource() Get Data source name Note: This field may return null, indicating that no valid values can be obtained.
String	getEni() Get This field has been disused.
String	getIsLocal() Get Whether the program package is uploaded locally.
String	getIsLocalArchives() Get Archives: Dependency upload method.
String	getIsLocalFiles() Get Whether the dependency file is uploaded locally.
String	getIsLocalJars() Get Whether the dependency JAR packages are uploaded locally.
String	getIsLocalPythonFiles() Get PySpark: Dependency upload method.
String	getJobArchives() Get Archives: Dependency resources Note: This field may return null, indicating that no valid values can be obtained.
String	getJobConf() Get Native Spark configurations separated by line break
Long	getJobCreateTime() Get Spark job creation time
String	getJobCreator() Get Spark job creator
String	getJobDriverSize() Get Driver resource size of the Spark job
Long	getJobExecutorNums() Get Number of Spark job executors
String	getJobExecutorSize() Get Executor resource size of the Spark job
String	getJobFile() Get Program package path
String	getJobFiles() Get Dependency files of the Spark job separated by comma
String	getJobId() Get Spark job ID
String	getJobJars() Get Dependency JAR packages of the Spark job separated by comma
Long	getJobMaxAttempts() Get Maximum number of retries of the Spark flow task
String	getJobName() Get Spark job name
String	getJobPythonFiles() Get PySpark: Python dependency, which can be in .py, .zip, or .egg format.
Long	getJobStatus() Get Last status of the Spark job
Long	getJobType() Get Spark job type.
Long	getJobUpdateTime() Get Spark job update time
String	getMainClass() Get Main class of Spark job execution
Long	getRoleArn() Get Role ID
StreamingStatistics	getStreamingStat() Get Spark streaming job statistics Note: This field may return null, indicating that no valid values can be obtained.
Long	getTaskNum() Get Number of tasks running or ready to run under the current job Note: This field may return null, indicating that no valid values can be obtained.
void	setAppPythonFiles(String AppPythonFiles) Set Note: This returned value has been disused.
void	setCmdArgs(String CmdArgs) Set Command line parameters of the Spark job separated by space
void	setCurrentTaskId(String CurrentTaskId) Set Last task ID of the Spark job
void	setDataEngine(String DataEngine) Set Engine name
void	setDataEngineStatus(Long DataEngineStatus) Set Engine status.
void	setDataSource(String DataSource) Set Data source name Note: This field may return null, indicating that no valid values can be obtained.
void	setEni(String Eni) Set This field has been disused.
void	setIsLocal(String IsLocal) Set Whether the program package is uploaded locally.
void	setIsLocalArchives(String IsLocalArchives) Set Archives: Dependency upload method.
void	setIsLocalFiles(String IsLocalFiles) Set Whether the dependency file is uploaded locally.
void	setIsLocalJars(String IsLocalJars) Set Whether the dependency JAR packages are uploaded locally.
void	setIsLocalPythonFiles(String IsLocalPythonFiles) Set PySpark: Dependency upload method.
void	setJobArchives(String JobArchives) Set Archives: Dependency resources Note: This field may return null, indicating that no valid values can be obtained.
void	setJobConf(String JobConf) Set Native Spark configurations separated by line break
void	setJobCreateTime(Long JobCreateTime) Set Spark job creation time
void	setJobCreator(String JobCreator) Set Spark job creator
void	setJobDriverSize(String JobDriverSize) Set Driver resource size of the Spark job
void	setJobExecutorNums(Long JobExecutorNums) Set Number of Spark job executors
void	setJobExecutorSize(String JobExecutorSize) Set Executor resource size of the Spark job
void	setJobFile(String JobFile) Set Program package path
void	setJobFiles(String JobFiles) Set Dependency files of the Spark job separated by comma
void	setJobId(String JobId) Set Spark job ID
void	setJobJars(String JobJars) Set Dependency JAR packages of the Spark job separated by comma
void	setJobMaxAttempts(Long JobMaxAttempts) Set Maximum number of retries of the Spark flow task
void	setJobName(String JobName) Set Spark job name
void	setJobPythonFiles(String JobPythonFiles) Set PySpark: Python dependency, which can be in .py, .zip, or .egg format.
void	setJobStatus(Long JobStatus) Set Last status of the Spark job
void	setJobType(Long JobType) Set Spark job type.
void	setJobUpdateTime(Long JobUpdateTime) Set Spark job update time
void	setMainClass(String MainClass) Set Main class of Spark job execution
void	setRoleArn(Long RoleArn) Set Role ID
void	setStreamingStat(StreamingStatistics StreamingStat) Set Spark streaming job statistics Note: This field may return null, indicating that no valid values can be obtained.
void	setTaskNum(Long TaskNum) Set Number of tasks running or ready to run under the current job Note: This field may return null, indicating that no valid values can be obtained.
void	toMap(HashMap<String,String> map, String prefix) Internal implementation, normal users should not use it.

Methods inherited from class com.tencentcloudapi.common.AbstractModel

any, fromJsonString, getBinaryParams, getMultipartRequestParams, set, setParamArrayObj, setParamArraySimple, setParamObj, setParamSimple, toJsonString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkJobInfo

public SparkJobInfo()

SparkJobInfo

public SparkJobInfo(SparkJobInfo source)

NOTE: Any ambiguous key set via .set("AnyKey", "value") will be a shallow copy, and any explicit key, i.e Foo, set via .setFoo("value") will be a deep copy.

Method Detail

getJobId

public String getJobId()

Get Spark job ID

Returns:

JobId Spark job ID

setJobId

public void setJobId(String JobId)

Set Spark job ID

Parameters:

JobId - Spark job ID

getJobName

public String getJobName()

Get Spark job name

Returns:

JobName Spark job name

setJobName

public void setJobName(String JobName)

Set Spark job name

Parameters:

JobName - Spark job name

getJobType

public Long getJobType()

Get Spark job type. Valid values: `1` (batch job), `2` (streaming job).

Returns:

JobType Spark job type. Valid values: `1` (batch job), `2` (streaming job).

setJobType

public void setJobType(Long JobType)

Set Spark job type. Valid values: `1` (batch job), `2` (streaming job).

Parameters:

JobType - Spark job type. Valid values: `1` (batch job), `2` (streaming job).

getDataEngine

public String getDataEngine()

Get Engine name

Returns:

DataEngine Engine name

setDataEngine

public void setDataEngine(String DataEngine)

Set Engine name

Parameters:

DataEngine - Engine name

getEni

public String getEni()

Get This field has been disused. Use the `Datasource` field instead.

Returns:

Eni This field has been disused. Use the `Datasource` field instead.

setEni

public void setEni(String Eni)

Set This field has been disused. Use the `Datasource` field instead.

Parameters:

Eni - This field has been disused. Use the `Datasource` field instead.

getIsLocal

public String getIsLocal()

Get Whether the program package is uploaded locally. Valid values: `cos`, `lakefs`.

Returns:

IsLocal Whether the program package is uploaded locally. Valid values: `cos`, `lakefs`.

setIsLocal

public void setIsLocal(String IsLocal)

Set Whether the program package is uploaded locally. Valid values: `cos`, `lakefs`.

Parameters:

IsLocal - Whether the program package is uploaded locally. Valid values: `cos`, `lakefs`.

getJobFile

public String getJobFile()

Get Program package path

Returns:

JobFile Program package path

setJobFile

public void setJobFile(String JobFile)

Set Program package path

Parameters:

JobFile - Program package path

getRoleArn

public Long getRoleArn()

Get Role ID

Returns:

RoleArn Role ID

setRoleArn

public void setRoleArn(Long RoleArn)

Set Role ID

Parameters:

RoleArn - Role ID

getMainClass

public String getMainClass()

Get Main class of Spark job execution

Returns:

MainClass Main class of Spark job execution

setMainClass

public void setMainClass(String MainClass)

Set Main class of Spark job execution

Parameters:

MainClass - Main class of Spark job execution

getCmdArgs

public String getCmdArgs()

Get Command line parameters of the Spark job separated by space

Returns:

CmdArgs Command line parameters of the Spark job separated by space

setCmdArgs

public void setCmdArgs(String CmdArgs)

Set Command line parameters of the Spark job separated by space

Parameters:

CmdArgs - Command line parameters of the Spark job separated by space

getJobConf

public String getJobConf()

Get Native Spark configurations separated by line break

Returns:

JobConf Native Spark configurations separated by line break

setJobConf

public void setJobConf(String JobConf)

Set Native Spark configurations separated by line break

Parameters:

JobConf - Native Spark configurations separated by line break

getIsLocalJars

public String getIsLocalJars()

Get Whether the dependency JAR packages are uploaded locally. Valid values: `cos`, `lakefs`.

Returns:

IsLocalJars Whether the dependency JAR packages are uploaded locally. Valid values: `cos`, `lakefs`.

setIsLocalJars

public void setIsLocalJars(String IsLocalJars)

Set Whether the dependency JAR packages are uploaded locally. Valid values: `cos`, `lakefs`.

Parameters:

IsLocalJars - Whether the dependency JAR packages are uploaded locally. Valid values: `cos`, `lakefs`.

getJobJars

public String getJobJars()

Get Dependency JAR packages of the Spark job separated by comma

Returns:

JobJars Dependency JAR packages of the Spark job separated by comma

setJobJars

public void setJobJars(String JobJars)

Set Dependency JAR packages of the Spark job separated by comma

Parameters:

JobJars - Dependency JAR packages of the Spark job separated by comma

getIsLocalFiles

public String getIsLocalFiles()

Get Whether the dependency file is uploaded locally. Valid values: `cos`, `lakefs`.

Returns:

IsLocalFiles Whether the dependency file is uploaded locally. Valid values: `cos`, `lakefs`.

setIsLocalFiles

public void setIsLocalFiles(String IsLocalFiles)

Set Whether the dependency file is uploaded locally. Valid values: `cos`, `lakefs`.

Parameters:

IsLocalFiles - Whether the dependency file is uploaded locally. Valid values: `cos`, `lakefs`.

getJobFiles

public String getJobFiles()

Get Dependency files of the Spark job separated by comma

Returns:

JobFiles Dependency files of the Spark job separated by comma

setJobFiles

public void setJobFiles(String JobFiles)

Set Dependency files of the Spark job separated by comma

Parameters:

JobFiles - Dependency files of the Spark job separated by comma

getJobDriverSize

public String getJobDriverSize()

Get Driver resource size of the Spark job

Returns:

JobDriverSize Driver resource size of the Spark job

setJobDriverSize

public void setJobDriverSize(String JobDriverSize)

Set Driver resource size of the Spark job

Parameters:

JobDriverSize - Driver resource size of the Spark job

getJobExecutorSize

public String getJobExecutorSize()

Get Executor resource size of the Spark job

Returns:

JobExecutorSize Executor resource size of the Spark job

setJobExecutorSize

public void setJobExecutorSize(String JobExecutorSize)

Set Executor resource size of the Spark job

Parameters:

JobExecutorSize - Executor resource size of the Spark job

getJobExecutorNums

public Long getJobExecutorNums()

Get Number of Spark job executors

Returns:

JobExecutorNums Number of Spark job executors

setJobExecutorNums

public void setJobExecutorNums(Long JobExecutorNums)

Set Number of Spark job executors

Parameters:

JobExecutorNums - Number of Spark job executors

getJobMaxAttempts

public Long getJobMaxAttempts()

Get Maximum number of retries of the Spark flow task

Returns:

JobMaxAttempts Maximum number of retries of the Spark flow task

setJobMaxAttempts

public void setJobMaxAttempts(Long JobMaxAttempts)

Set Maximum number of retries of the Spark flow task

Parameters:

JobMaxAttempts - Maximum number of retries of the Spark flow task

getJobCreator

public String getJobCreator()

Get Spark job creator

Returns:

JobCreator Spark job creator

setJobCreator

public void setJobCreator(String JobCreator)

Set Spark job creator

Parameters:

JobCreator - Spark job creator

getJobCreateTime

public Long getJobCreateTime()

Get Spark job creation time

Returns:

JobCreateTime Spark job creation time

setJobCreateTime

public void setJobCreateTime(Long JobCreateTime)

Set Spark job creation time

Parameters:

JobCreateTime - Spark job creation time

getJobUpdateTime

public Long getJobUpdateTime()

Get Spark job update time

Returns:

JobUpdateTime Spark job update time

setJobUpdateTime

public void setJobUpdateTime(Long JobUpdateTime)

Set Spark job update time

Parameters:

JobUpdateTime - Spark job update time

getCurrentTaskId

public String getCurrentTaskId()

Get Last task ID of the Spark job

Returns:

CurrentTaskId Last task ID of the Spark job

setCurrentTaskId

public void setCurrentTaskId(String CurrentTaskId)

Set Last task ID of the Spark job

Parameters:

CurrentTaskId - Last task ID of the Spark job

getJobStatus

public Long getJobStatus()

Get Last status of the Spark job

Returns:

JobStatus Last status of the Spark job

setJobStatus

public void setJobStatus(Long JobStatus)

Set Last status of the Spark job

Parameters:

JobStatus - Last status of the Spark job

getStreamingStat

public StreamingStatistics getStreamingStat()

Get Spark streaming job statistics Note: This field may return null, indicating that no valid values can be obtained.

Returns:

StreamingStat Spark streaming job statistics Note: This field may return null, indicating that no valid values can be obtained.

setStreamingStat

public void setStreamingStat(StreamingStatistics StreamingStat)

Set Spark streaming job statistics Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

StreamingStat - Spark streaming job statistics Note: This field may return null, indicating that no valid values can be obtained.

getDataSource

public String getDataSource()

Get Data source name Note: This field may return null, indicating that no valid values can be obtained.

Returns:

DataSource Data source name Note: This field may return null, indicating that no valid values can be obtained.

setDataSource

public void setDataSource(String DataSource)

Set Data source name Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

DataSource - Data source name Note: This field may return null, indicating that no valid values can be obtained.

getIsLocalPythonFiles

public String getIsLocalPythonFiles()

Get PySpark: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs). Note: This field may return null, indicating that no valid values can be obtained.

Returns:

IsLocalPythonFiles PySpark: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs). Note: This field may return null, indicating that no valid values can be obtained.

setIsLocalPythonFiles

public void setIsLocalPythonFiles(String IsLocalPythonFiles)

Set PySpark: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs). Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

IsLocalPythonFiles - PySpark: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs). Note: This field may return null, indicating that no valid values can be obtained.

getAppPythonFiles

public String getAppPythonFiles()

Get Note: This returned value has been disused. Note: This field may return null, indicating that no valid values can be obtained.

Returns:

AppPythonFiles Note: This returned value has been disused. Note: This field may return null, indicating that no valid values can be obtained.

setAppPythonFiles

public void setAppPythonFiles(String AppPythonFiles)

Set Note: This returned value has been disused. Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

AppPythonFiles - Note: This returned value has been disused. Note: This field may return null, indicating that no valid values can be obtained.

getIsLocalArchives

public String getIsLocalArchives()

Get Archives: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs). Note: This field may return null, indicating that no valid values can be obtained.

Returns:

IsLocalArchives Archives: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs). Note: This field may return null, indicating that no valid values can be obtained.

setIsLocalArchives

public void setIsLocalArchives(String IsLocalArchives)

Set Archives: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs). Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

IsLocalArchives - Archives: Dependency upload method. 1: cos; 2: lakefs (this method needs to be used in the console but cannot be called through APIs). Note: This field may return null, indicating that no valid values can be obtained.

getJobArchives

public String getJobArchives()

Get Archives: Dependency resources Note: This field may return null, indicating that no valid values can be obtained.

Returns:

JobArchives Archives: Dependency resources Note: This field may return null, indicating that no valid values can be obtained.

setJobArchives

public void setJobArchives(String JobArchives)

Set Archives: Dependency resources Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

JobArchives - Archives: Dependency resources Note: This field may return null, indicating that no valid values can be obtained.

getJobPythonFiles

public String getJobPythonFiles()

Get PySpark: Python dependency, which can be in .py, .zip, or .egg format. Multiple files should be separated by comma. Note: This field may return null, indicating that no valid values can be obtained.

Returns:

JobPythonFiles PySpark: Python dependency, which can be in .py, .zip, or .egg format. Multiple files should be separated by comma. Note: This field may return null, indicating that no valid values can be obtained.

setJobPythonFiles

public void setJobPythonFiles(String JobPythonFiles)

Set PySpark: Python dependency, which can be in .py, .zip, or .egg format. Multiple files should be separated by comma. Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

JobPythonFiles - PySpark: Python dependency, which can be in .py, .zip, or .egg format. Multiple files should be separated by comma. Note: This field may return null, indicating that no valid values can be obtained.

getTaskNum

public Long getTaskNum()

Get Number of tasks running or ready to run under the current job Note: This field may return null, indicating that no valid values can be obtained.

Returns:

TaskNum Number of tasks running or ready to run under the current job Note: This field may return null, indicating that no valid values can be obtained.

setTaskNum

public void setTaskNum(Long TaskNum)

Set Number of tasks running or ready to run under the current job Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

TaskNum - Number of tasks running or ready to run under the current job Note: This field may return null, indicating that no valid values can be obtained.

getDataEngineStatus

public Long getDataEngineStatus()

Get Engine status. -100 (default value): unknown; -2–11: normal. Note: This field may return null, indicating that no valid values can be obtained.

Returns:

DataEngineStatus Engine status. -100 (default value): unknown; -2–11: normal. Note: This field may return null, indicating that no valid values can be obtained.

setDataEngineStatus

public void setDataEngineStatus(Long DataEngineStatus)

Set Engine status. -100 (default value): unknown; -2–11: normal. Note: This field may return null, indicating that no valid values can be obtained.

Parameters:

DataEngineStatus - Engine status. -100 (default value): unknown; -2–11: normal. Note: This field may return null, indicating that no valid values can be obtained.

toMap

public void toMap(HashMap<String,String> map,
                  String prefix)

Internal implementation, normal users should not use it.

Specified by:

toMap in class AbstractModel