LocalContextSupervisorActor
Related Doc:
package jobserver
postStop() is called when actor is stopped or restarted due to Exceptions *
postStop() is called when actor is stopped or restarted due to Exceptions *
preRestart() is called when actor is killed due to exception, and will be restarted.
preRestart() is called when actor is killed due to exception, and will be restarted. It is run on the current actor instance that is about to be killed. We just log errors. The super (original) method should call postStop() and shut down children as well.
Stackable traits should override and call super.receive(x) for stacking functionality
Stackable traits should override and call super.receive(x) for stacking functionality
Actor classes should implement this partialFunction for standard actor message handling
Actor classes should implement this partialFunction for standard actor message handling
This class starts and stops JobManagers / Contexts in-process. It is responsible for watching out for the death of contexts/JobManagers.
Auto context start configuration
Contexts can be configured to be created automatically at job server initialization. Configuration example:
spark { contexts { olap-demo { num-cpu-cores = 4 # Number of cores to allocate. Required. memory-per-node = 1024m # Executor memory per node, -Xmx style eg 512m, 1G, etc. } } }Other configuration
spark { jobserver { context-creation-timeout = 15 s yarn-context-creation-timeout = 40 s } # Default settings for all context creation context-settings { spark.mesos.coarse = true } }