Did this page help you?

   Yes   No   Tell us about it...

com.amazonaws.services.elasticmapreduce.model
Class AddJobFlowStepsRequest

java.lang.Object
  extended by com.amazonaws.AmazonWebServiceRequest
      extended by com.amazonaws.services.elasticmapreduce.model.AddJobFlowStepsRequest
All Implemented Interfaces:
Serializable

public class AddJobFlowStepsRequest
extends AmazonWebServiceRequest
implements Serializable

Container for the parameters to the AddJobFlowSteps operation.

AddJobFlowSteps adds new steps to a running job flow. A maximum of 256 steps are allowed in each job flow.

If your job flow is long-running (such as a Hive data warehouse) or complex, you may require more than 256 steps to process your data. You can bypass the 256-step limitation in various ways, including using the SSH shell to connect to the master node and submitting queries directly to the software running on the master node, such as Hive and Hadoop. For more information on how to do this, go to Add More than 256 Steps to a Job Flow in the Amazon Elastic MapReduce Developer's Guide .

A step specifies the location of a JAR file stored either on the master node of the job flow or in Amazon S3. Each step is performed by the main function of the main class of the JAR file. The main class can be specified either in the manifest of the JAR or by using the MainFunction parameter of the step.

Elastic MapReduce executes each step in the order listed. For a step to be considered complete, the main function must exit with a zero exit code and all Hadoop jobs started while the step was running must have completed and run successfully.

You can only add steps to a job flow that is in one of the following states: STARTING, BOOTSTRAPPING, RUNNING, or WAITING.

See Also:
AmazonElasticMapReduce.addJobFlowSteps(AddJobFlowStepsRequest), Serialized Form

Constructor Summary
AddJobFlowStepsRequest()
          Default constructor for a new AddJobFlowStepsRequest object.
AddJobFlowStepsRequest(String jobFlowId)
          Constructs a new AddJobFlowStepsRequest object.
AddJobFlowStepsRequest(String jobFlowId, List<StepConfig> steps)
          Constructs a new AddJobFlowStepsRequest object.
 
Method Summary
 boolean equals(Object obj)
           
 String getJobFlowId()
          A string that uniquely identifies the job flow.
 List<StepConfig> getSteps()
          A list of StepConfig to be executed by the job flow.
 int hashCode()
           
 void setJobFlowId(String jobFlowId)
          A string that uniquely identifies the job flow.
 void setSteps(Collection<StepConfig> steps)
          A list of StepConfig to be executed by the job flow.
 String toString()
          Returns a string representation of this object; useful for testing and debugging.
 AddJobFlowStepsRequest withJobFlowId(String jobFlowId)
          A string that uniquely identifies the job flow.
 AddJobFlowStepsRequest withSteps(Collection<StepConfig> steps)
          A list of StepConfig to be executed by the job flow.
 AddJobFlowStepsRequest withSteps(StepConfig... steps)
          A list of StepConfig to be executed by the job flow.
 
Methods inherited from class com.amazonaws.AmazonWebServiceRequest
copyPrivateRequestParameters, getRequestClientOptions, getRequestCredentials, setRequestCredentials
 
Methods inherited from class java.lang.Object
getClass, notify, notifyAll, wait, wait, wait
 

Constructor Detail

AddJobFlowStepsRequest

public AddJobFlowStepsRequest()
Default constructor for a new AddJobFlowStepsRequest object. Callers should use the setter or fluent setter (with...) methods to initialize this object after creating it.


AddJobFlowStepsRequest

public AddJobFlowStepsRequest(String jobFlowId)
Constructs a new AddJobFlowStepsRequest object. Callers should use the setter or fluent setter (with...) methods to initialize any additional object members.

Parameters:
jobFlowId - A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from DescribeJobFlows.

AddJobFlowStepsRequest

public AddJobFlowStepsRequest(String jobFlowId,
                              List<StepConfig> steps)
Constructs a new AddJobFlowStepsRequest object. Callers should use the setter or fluent setter (with...) methods to initialize any additional object members.

Parameters:
jobFlowId - A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from DescribeJobFlows.
steps - A list of StepConfig to be executed by the job flow.
Method Detail

getJobFlowId

public String getJobFlowId()
A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from DescribeJobFlows.

Constraints:
Length: 0 - 256
Pattern: [ -??-??-?\r\n\t]*

Returns:
A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from DescribeJobFlows.

setJobFlowId

public void setJobFlowId(String jobFlowId)
A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from DescribeJobFlows.

Constraints:
Length: 0 - 256
Pattern: [ -??-??-?\r\n\t]*

Parameters:
jobFlowId - A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from DescribeJobFlows.

withJobFlowId

public AddJobFlowStepsRequest withJobFlowId(String jobFlowId)
A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from DescribeJobFlows.

Returns a reference to this object so that method calls can be chained together.

Constraints:
Length: 0 - 256
Pattern: [ -??-??-?\r\n\t]*

Parameters:
jobFlowId - A string that uniquely identifies the job flow. This identifier is returned by RunJobFlow and can also be obtained from DescribeJobFlows.
Returns:
A reference to this updated object so that method calls can be chained together.

getSteps

public List<StepConfig> getSteps()
A list of StepConfig to be executed by the job flow.

Returns:
A list of StepConfig to be executed by the job flow.

setSteps

public void setSteps(Collection<StepConfig> steps)
A list of StepConfig to be executed by the job flow.

Parameters:
steps - A list of StepConfig to be executed by the job flow.

withSteps

public AddJobFlowStepsRequest withSteps(StepConfig... steps)
A list of StepConfig to be executed by the job flow.

Returns a reference to this object so that method calls can be chained together.

Parameters:
steps - A list of StepConfig to be executed by the job flow.
Returns:
A reference to this updated object so that method calls can be chained together.

withSteps

public AddJobFlowStepsRequest withSteps(Collection<StepConfig> steps)
A list of StepConfig to be executed by the job flow.

Returns a reference to this object so that method calls can be chained together.

Parameters:
steps - A list of StepConfig to be executed by the job flow.
Returns:
A reference to this updated object so that method calls can be chained together.

toString

public String toString()
Returns a string representation of this object; useful for testing and debugging.

Overrides:
toString in class Object
Returns:
A string representation of this object.
See Also:
Object.toString()

hashCode

public int hashCode()
Overrides:
hashCode in class Object

equals

public boolean equals(Object obj)
Overrides:
equals in class Object


Copyright © 2010 Amazon Web Services, Inc. All Rights Reserved.