attach a classloader which classes must be put on the job classpath
attach a classloader which classes must be put on the job classpath
add a new jar url (as a String) to the current configuration
add a new jar url (as a String) to the current configuration
add a new jar of a given class, by finding the url in the current classloader, to the current configuration
add a new jar of a given class, by finding the url in the current classloader, to the current configuration
add several user jars to the classpath of this configuration
add several user jars to the classpath of this configuration
add a user directory to the classpath of this configuration
add a user directory to the classpath of this configuration
add several user directories to the classpath of this configuration
add several user directories to the classpath of this configuration
true if the mscr jobs can be executed concurrently
Scoobi's configuration, initialised with a job id
Scoobi's configuration, initialised with a job id
the file system for this configuration, either a local or a remote one
Get the number of input bytes per reducer.
Get the number of input bytes per reducer. Default is 1GiB.
Get the max number of reducers to use in M/R jobs
Get the max number of reducers to use in M/R jobs
Get the min number of reducers to use in M/R jobs
Get the min number of reducers to use in M/R jobs
add a list of jars to include as -libjars in this configuration
add a list of jars to include as -libjars in this configuration
true if this configuration is used for an in memory execution with a collection backend
true if this configuration is used for a local memory execution
true if this configuration is used for a remote job execution
The id for the current Scoobi job being (or about to be) executed.
The id for the current Scoobi job being (or about to be) executed.
the job name if one is defined
set a new job name to help recognize the job better
set a new job name to help recognize the job better
The job name for a step in the current Scoobi, i.
The job name for a step in the current Scoobi, i.e. a single MapReduce job
get the default values from the configuration files
get the default values from the configuration files
the current mode
set a flag in order to know that this configuration is for a in-memory, local or remote execution,
set a flag in order to know that this configuration is for a in-memory, local or remote execution,
a new environment object
use the GenericOptionsParser to parse the value of a command line argument and update the current configuration The command line argument doesn't have to start with a dash.
use the GenericOptionsParser to parse the value of a command line argument and update the current configuration The command line argument doesn't have to start with a dash.
the class loader to use with Scoobi classes, including generated ones
set a value on the configuration
set a value on the configuration
force a configuration to be an in-memory one, currently doing everything as in the local mode
force a configuration to be an in-memory one, currently doing everything as in the local mode
force a configuration to be a local one
force a configuration to be a local one
Set the number of input bytes per reducer.
Set the number of input bytes per reducer. This is used to control the number of reducers based off the size of the input data to the M/R job.
set to true if the mscr jobs must be executed concurrently
this setup needs to be done only after the internal conf object has been set to a local configuration or a cluster one because all the paths will depend on that
this setup needs to be done only after the internal conf object has been set to a local configuration or a cluster one because all the paths will depend on that
Set an upper bound for the number of reducers to be used in M/R jobs
Set an upper bound for the number of reducers to be used in M/R jobs
Set a lower bound for the number of reducers to be used in M/R jobs
Set a lower bound for the number of reducers to be used in M/R jobs
set a flag in order to know if jars have been uploaded before jobs are defined
set a flag in order to know if jars have been uploaded before jobs are defined
update the current counters from the result of a job that has just been run
update the current counters from the result of a job that has just been run
true if the dependent jars have been uploaded
user classes to add in the job jar, by class name (and corresponding bytecode)
Parse the generic Hadoop command line arguments, and call the user code with the remaining arguments
Parse the generic Hadoop command line arguments, and call the user code with the remaining arguments
(Since version 0.7.0) use 'configuration' instead
(Since version 0.7.0) use 'fileSystem' instead