context

Type Members

1. class DefaultSparkContextFactory extends SparkContextFactory

   

   The default factory creates a standard SparkContext.

   The default factory creates a standard SparkContext. In the future if we want to add additional methods, etc. then we can have additional factories. For example a specialized SparkContext to manage RDDs in a user-defined way.

   If you create your own SparkContextFactory, please make sure it has zero constructor args.

2. class HiveContextFactory extends SparkContextFactory

   

3. class SQLContextFactory extends SparkContextFactory

   

4. trait SparkContextFactory extends AnyRef

   

   Factory trait for creating a SparkContext or any derived Contexts, such as SQLContext, StreamingContext, HiveContext, etc.

   Factory trait for creating a SparkContext or any derived Contexts, such as SQLContext, StreamingContext, HiveContext, etc. My implementing classes can be dynamically loaded using classloaders to ensure that the entire SparkContext has access to certain dynamically loaded classes, for example, job jars.

5. class StreamingContextFactory extends SparkContextFactory