org.apache.spark.sql.execution

QueryExecution

class QueryExecution extends AnyRef

The primary workflow for executing relational queries using Spark. Designed to allow easy access to the intermediate phases of query execution for developers.

While this is not a public class, we should avoid changing the function names for the sake of changing them, because a lot of developers use the feature for debugging.

Linear Supertypes
AnyRef, Any
Known Subclasses
IncrementalExecution
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. QueryExecution
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new QueryExecution(sparkSession: SparkSession, logical: LogicalPlan)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. lazy val analyzed: LogicalPlan

  7. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  8. def assertAnalyzed(): Unit

  9. def assertSupported(): Unit

  10. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  11. object debug

    A special namespace for commands that can be used to debug query execution.

  12. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  13. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  14. lazy val executedPlan: SparkPlan

  15. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  16. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  17. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  18. def hiveResultString(): Seq[String]

    Returns the result as a hive compatible sequence of strings.

    Returns the result as a hive compatible sequence of strings. This is for testing only.

  19. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  20. val logical: LogicalPlan

  21. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  22. final def notify(): Unit

    Definition Classes
    AnyRef

  23. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  24. lazy val optimizedPlan: LogicalPlan

  25. def planner: SparkPlanner

    Attributes
    protected

  26. def preparations: Seq[Rule[SparkPlan]]

    A sequence of rules that will be applied in order to the physical plan before execution.

    A sequence of rules that will be applied in order to the physical plan before execution.

    Attributes
    protected

  27. def prepareForExecution(plan: SparkPlan): SparkPlan

    Prepares a planned SparkPlan for execution by inserting shuffle operations and internal row format conversions as needed.

    Prepares a planned SparkPlan for execution by inserting shuffle operations and internal row format conversions as needed.

    Attributes
    protected

  28. def simpleString: String

  29. lazy val sparkPlan: SparkPlan

  30. val sparkSession: SparkSession

  31. def stringOrError[A](f: ⇒ A): String

    Attributes
    protected

  32. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  33. lazy val toRdd: RDD[InternalRow]

    Internal version of the RDD.

    Internal version of the RDD. Avoids copies and has no schema

  34. def toString(): String

    Definition Classes
    QueryExecution → AnyRef → Any

  35. def toStringWithStats: String

  36. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  37. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  38. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  39. lazy val withCachedData: LogicalPlan

Inherited from AnyRef

Inherited from Any

Ungrouped