Commits a task output.
Commits a task output. Before committing the task output, we need to know whether some other task attempt might be racing to commit the same output partition. Therefore, coordinate with the driver in order to determine whether this attempt can commit (please see SPARK-4879 for details).
Output commit coordinator is only contacted when the following two configurations are both set
to true
:
spark.speculation
spark.hadoop.outputCommitCoordination.enabled