package local
Allow to fork process locally in a managed way.
It provides the exec
interpolator that you can use to fork shell scripts:
exec"""hdfs dfs -cp /from /to"""()
The script your provide will be forked into another process.
Note that if you provide several commands separated by ;' only the first one will be forked
and the other ones will be ignored.
If you really need to run several commands, you can use one of the followed ways:
1. Chain multiple execs in a for-comprehension. Because of platform mechanism it will require several platform allocations to run completely.
2. Wrap it in one sh -c' _In this case we cannot guarantee that
all process spawned inside this fork will be successfully killed when we kill the parent process._
Type Members
-
implicit final
class
InlineCommands extends AnyVal
The exec string interpolation.
-
case class
LocalPlatform(maxForkedProcesses: Int) extends ExecutionPlatform with Product with Serializable
The LocalPlatform handles the execution of locally forked processes.
The LocalPlatform handles the execution of locally forked processes. The number of concurrently forked processes is limited and can be configured for the platform.
While waiting for the process to be actually forked, the Job Execution is seen as WAITING in the UI.
- maxForkedProcesses
The maximum number of concurrently running processes.
-
class
LocalProcess extends AnyRef
Represent a process to be locally foked.