Runs a Spark job on a cluster. The cluster can be an EMR cluster managed by AWS Data Pipeline
or another resource if you use TaskRunner. Use SparkJobActivity when you want to run work in parallel.
This allows you to use the scheduling resources of the YARN framework or the MapReduce resource
negotiator in Hadoop 1. If you would like to run work sequentially using the Amazon EMR Step action,
you can still use SparkActivity.
Runs a Spark job on a cluster. The cluster can be an EMR cluster managed by AWS Data Pipeline or another resource if you use TaskRunner. Use SparkJobActivity when you want to run work in parallel. This allows you to use the scheduling resources of the YARN framework or the MapReduce resource negotiator in Hadoop 1. If you would like to run work sequentially using the Amazon EMR Step action, you can still use SparkActivity.