org.apache.spark.sql

catalyst

package catalyst

Catalyst is a library for manipulating relational query plans. All classes in catalyst are considered an internal API to Spark SQL and are subject to change between minor releases.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. catalyst
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. trait CatalystConf extends AnyRef

    Interface for configuration options used in the catalyst module.

  2. trait DefinedByConstructorParams extends AnyRef

    A helper trait to create org.apache.spark.sql.catalyst.encoders.ExpressionEncoders for classes whose fields are entirely defined by constructor params but should not be case classes.

  3. case class FunctionIdentifier(funcName: String, database: Option[String]) extends IdentifierWithDatabase with Product with Serializable

    Identifies a function in a database.

  4. sealed trait IdentifierWithDatabase extends AnyRef

    An identifier that optionally specifies a database.

  5. abstract class InternalRow extends SpecializedGetters with Serializable

    An abstract class for row used internally in Spark SQL, which only contains the columns as internal types.

  6. trait ScalaReflection extends AnyRef

    Support for generating catalyst schemas for scala objects.

  7. case class SimpleCatalystConf(caseSensitiveAnalysis: Boolean, orderByOrdinal: Boolean = true, groupByOrdinal: Boolean = true, optimizerMaxIterations: Int = 100, optimizerInSetConversionThreshold: Int = 10, maxCaseBranchesForCodegen: Int = 20, runSQLonFile: Boolean = true, crossJoinEnabled: Boolean = false, warehousePath: String = "/user/hive/warehouse") extends CatalystConf with Product with Serializable

    A CatalystConf that can be used for local testing.

  8. case class TableIdentifier(table: String, database: Option[String]) extends IdentifierWithDatabase with Product with Serializable

    Identifies a table in a database.

Value Members

  1. object CatalystTypeConverters

    Functions to convert Scala types to Catalyst types and vice versa.

  2. object FunctionIdentifier extends Serializable

  3. object InternalRow extends Serializable

  4. object JavaTypeInference

    Type-inference utilities for POJOs and Java collections.

  5. object ScalaReflection extends ScalaReflection

    A default version of ScalaReflection that uses the runtime universe.

  6. object ScalaReflectionLock

    A JVM-global lock that should be used to prevent thread safety issues when using things in scala.

  7. object TableIdentifier extends Serializable

  8. package analysis

    Provides a logical query plan Analyzer and supporting classes for performing analysis.

  9. package catalog

  10. package dsl

    A collection of implicit conversions that create a DSL for constructing catalyst data structures.

  11. package encoders

  12. package errors

    Functions for attaching and retrieving trees that are associated with errors.

  13. package expressions

    A set of classes that can be used to represent trees of relational expressions.

  14. package json

  15. package optimizer

  16. package parser

  17. package planning

    Contains classes for enumerating possible physical plans for a given logical query plan.

  18. package plans

    A collection of common abstractions for query plans as well as a base logical plan representation.

  19. package rules

    A framework for applying batches rewrite rules to trees, possibly to fixed point.

  20. package trees

    A library for easily manipulating trees of operators.

  21. package util

Inherited from AnyRef

Inherited from Any

Ungrouped