Returns true if eel should move written data from the staging directory into the table itself once all the writes have completed.
Returns true if eel should move written data from the staging directory into the table itself once all the writes have completed.
If you wish to manually move data from staging, then return false, and eel will leave the files inside the staging directory.
Return true if you want eel to create output files in a temporary staging area before committing the files into the table location.
Return true if you want eel to create output files in a temporary staging area before committing the files into the table location. The commit phase will happen once all writes have been completed into the staging area.
Return false if you want to write directly into the table location.
Return a Path where eel should create the output files.
Return a Path where eel should create the output files.
The path should be absolute, and can be created as a child of the table or partition path which is provided as the parameter. Or it can be created anywhere else you choose by just returning a different absolute path.
If staging is disabled then return None.