com.amazonaws.services.elasticmapreduce.model

Class AddJobFlowStepsRequest

java.lang.Object

com.amazonaws.AmazonWebServiceRequest

com.amazonaws.services.elasticmapreduce.model.AddJobFlowStepsRequest

All Implemented Interfaces:

ReadLimitInfo, Serializable, Cloneable

public class AddJobFlowStepsRequest
extends AmazonWebServiceRequest
implements Serializable, Cloneable

Container for the parameters to the AddJobFlowSteps operation.

AddJobFlowSteps adds new steps to a running job flow. A maximum of 256 steps are allowed in each job flow.

If your job flow is long-running (such as a Hive data warehouse) or complex, you may require more than 256 steps to process your data. You can bypass the 256-step limitation in various ways, including using the SSH shell to connect to the master node and submitting queries directly to the software running on the master node, such as Hive and Hadoop. For more information on how to do this, go to Add More than 256 Steps to a Job Flow in the Amazon Elastic MapReduce Developer's Guide .

A step specifies the location of a JAR file stored either on the master node of the job flow or in Amazon S3. Each step is performed by the main function of the main class of the JAR file. The main class can be specified either in the manifest of the JAR or by using the MainFunction parameter of the step.

Elastic MapReduce executes each step in the order listed. For a step to be considered complete, the main function must exit with a zero exit code and all Hadoop jobs started while the step was running must have completed and run successfully.

You can only add steps to a job flow that is in one of the following states: STARTING, BOOTSTRAPPING, RUNNING, or WAITING.

See Also:

AmazonElasticMapReduce.addJobFlowSteps(AddJobFlowStepsRequest), Serialized Form

Field Summary

Fields inherited from class com.amazonaws.AmazonWebServiceRequest

NOOP

Constructor Summary

Constructors

Constructor and Description
AddJobFlowStepsRequest() Default constructor for a new AddJobFlowStepsRequest object.
AddJobFlowStepsRequest(String jobFlowId) Constructs a new AddJobFlowStepsRequest object.
AddJobFlowStepsRequest(String jobFlowId, List<StepConfig> steps) Constructs a new AddJobFlowStepsRequest object.

Method Summary

Methods

Modifier and Type	Method and Description
AddJobFlowStepsRequest	clone()
boolean	equals(Object obj)
String	getJobFlowId() A string that uniquely identifies the job flow.
List<StepConfig>	getSteps() A list of StepConfig to be executed by the job flow.
int	hashCode()
void	setJobFlowId(String jobFlowId) A string that uniquely identifies the job flow.
void	setSteps(Collection<StepConfig> steps) A list of StepConfig to be executed by the job flow.
String	toString() Returns a string representation of this object; useful for testing and debugging.
AddJobFlowStepsRequest	withJobFlowId(String jobFlowId) A string that uniquely identifies the job flow.
AddJobFlowStepsRequest	withSteps(Collection<StepConfig> steps) A list of StepConfig to be executed by the job flow.
AddJobFlowStepsRequest	withSteps(StepConfig... steps) A list of StepConfig to be executed by the job flow.

Methods inherited from class com.amazonaws.AmazonWebServiceRequest

copyBaseTo, getCustomRequestHeaders, getGeneralProgressListener, getReadLimit, getRequestClientOptions, getRequestCredentials, getRequestMetricCollector, putCustomRequestHeader, setGeneralProgressListener, setRequestCredentials, setRequestMetricCollector, withGeneralProgressListener, withRequestMetricCollector

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

AddJobFlowStepsRequest

public AddJobFlowStepsRequest()

Default constructor for a new AddJobFlowStepsRequest object. Callers should use the setter or fluent setter (with...) methods to initialize this object after creating it.

AddJobFlowStepsRequest

public AddJobFlowStepsRequest(String jobFlowId)

Constructs a new AddJobFlowStepsRequest object. Callers should use the setter or fluent setter (with...) methods to initialize any additional object members.

Parameters:

jobFlowId - A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from ListClusters.

AddJobFlowStepsRequest

public AddJobFlowStepsRequest(String jobFlowId,
                      List<StepConfig> steps)

Constructs a new AddJobFlowStepsRequest object. Callers should use the setter or fluent setter (with...) methods to initialize any additional object members.

Parameters:

jobFlowId - A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from ListClusters.

steps - A list of StepConfig to be executed by the job flow.

Method Detail

getJobFlowId

public String getJobFlowId()

A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from ListClusters.

Constraints:
Length: 0 - 256
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*

Returns:

A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from ListClusters.

setJobFlowId

public void setJobFlowId(String jobFlowId)

A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from ListClusters.

Constraints:
Length: 0 - 256
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*

Parameters:

jobFlowId - A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from ListClusters.

withJobFlowId

public AddJobFlowStepsRequest withJobFlowId(String jobFlowId)

A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from ListClusters.

Returns a reference to this object so that method calls can be chained together.

Constraints:
Length: 0 - 256
Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*

Parameters:

jobFlowId - A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from ListClusters.

Returns:

A reference to this updated object so that method calls can be chained together.

getSteps

public List<StepConfig> getSteps()

A list of StepConfig to be executed by the job flow.

Returns:

A list of StepConfig to be executed by the job flow.

setSteps

public void setSteps(Collection<StepConfig> steps)

A list of StepConfig to be executed by the job flow.

Parameters:

steps - A list of StepConfig to be executed by the job flow.

withSteps

public AddJobFlowStepsRequest withSteps(StepConfig... steps)

A list of StepConfig to be executed by the job flow.

NOTE: This method appends the values to the existing list (if any). Use setSteps(java.util.Collection) or withSteps(java.util.Collection) if you want to override the existing values.

Returns a reference to this object so that method calls can be chained together.

Parameters:

steps - A list of StepConfig to be executed by the job flow.

Returns:

A reference to this updated object so that method calls can be chained together.

withSteps

public AddJobFlowStepsRequest withSteps(Collection<StepConfig> steps)

A list of StepConfig to be executed by the job flow.

Returns a reference to this object so that method calls can be chained together.

Parameters:

steps - A list of StepConfig to be executed by the job flow.

Returns:

A reference to this updated object so that method calls can be chained together.

toString

public String toString()

Returns a string representation of this object; useful for testing and debugging.

Overrides:

toString in class Object

Returns:

A string representation of this object.

See Also:

Object.toString()

hashCode

public int hashCode()

Overrides:

hashCode in class Object

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

clone

public AddJobFlowStepsRequest clone()

Overrides:

clone in class AmazonWebServiceRequest