Packages

p

org.apache.spark.sql

internal

package internal

All classes in this package are considered an internal API to Spark and are subject to change between minor releases.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. internal
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. abstract class BaseSessionStateBuilder extends AnyRef

    Builder class that coordinates construction of a new SessionState.

    Builder class that coordinates construction of a new SessionState.

    The builder explicitly defines all components needed by the session state, and creates a session state when build is called. Components should only be initialized once. This is not a problem for most components as they are only used in the build function. However some components (conf, catalog, functionRegistry, experimentalMethods & sqlParser) are as dependencies for other components and are shared as a result. These components are defined as lazy vals to make sure the component is created only once.

    A developer can modify the builder by providing custom versions of components, or by using the hooks provided for the analyzer, optimizer & planner. There are some dependencies between the components (they are documented per dependency), a developer should respect these when making modifications in order to prevent initialization problems.

    A parent SessionState can be used to initialize the new SessionState. The new session state will clone the parent sessions state's conf, functionRegistry, experimentalMethods and catalog fields. Note that the state is cloned when build is called, and not before.

    Annotations
    @Unstable()
  2. class CatalogImpl extends Catalog

    Internal implementation of the user-facing Catalog.

  3. case class HiveSerDe(inputFormat: Option[String] = None, outputFormat: Option[String] = None, serde: Option[String] = None) extends Product with Serializable
  4. class NonClosableMutableURLClassLoader extends MutableURLClassLoader

    This class loader cannot be closed (its close method is a no-op).

  5. class SessionResourceLoader extends FunctionResourceLoader

    Session shared FunctionResourceLoader.

    Session shared FunctionResourceLoader.

    Annotations
    @Unstable()
  6. class SessionStateBuilder extends BaseSessionStateBuilder

    Concrete implementation of a BaseSessionStateBuilder.

    Concrete implementation of a BaseSessionStateBuilder.

    Annotations
    @Unstable()
  7. class SparkUDFExpressionBuilder extends FunctionExpressionBuilder
  8. class VariableSubstitution extends SQLConfHelper

    A helper class that enables substitution using syntax like ${var}, ${system:var} and ${env:var}.

    A helper class that enables substitution using syntax like ${var}, ${system:var} and ${env:var}.

    Variable substitution is controlled by SQLConf.variableSubstituteEnabled.

Value Members

  1. object HiveSerDe extends Serializable
  2. object SharedState extends Logging

Inherited from AnyRef

Inherited from Any

Ungrouped