shark.execution

TableScanOperator

class TableScanOperator extends TopOperator[TableScanDesc]

The TableScanOperator is used for scanning any type of Shark or Hive table.

Linear Supertypes
TopOperator[TableScanDesc], UnaryOperator[TableScanDesc], Operator[TableScanDesc], Serializable, Serializable, LogHelper, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. TableScanOperator
  2. TopOperator
  3. UnaryOperator
  4. Operator
  5. Serializable
  6. Serializable
  7. LogHelper
  8. Logging
  9. AnyRef
  10. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new TableScanOperator()

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. def addChild(child: Operator[_ <: HiveDesc]): Unit

    Definition Classes
    Operator
  7. def addParent(parent: Operator[_ <: HiveDesc]): Unit

    Definition Classes
    Operator
  8. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  9. var cacheMode: CacheType

  10. def childOperators: ArrayBuffer[Operator[_ <: HiveDesc]]

    Definition Classes
    Operator
  11. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  12. def desc: TableScanDesc

    Definition Classes
    Operator
  13. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  15. def errStream(): PrintStream

    Definition Classes
    LogHelper
  16. def execute(): RDD[_]

    Execute the operator.

    Execute the operator. This should recursively execute parent operators.

    Definition Classes
    TableScanOperatorUnaryOperatorOperator
  17. def executeParents(): Seq[(Int, RDD[_])]

    Attributes
    protected
    Definition Classes
    Operator
  18. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  19. var firstConfPartDesc: PartitionDesc

  20. def getBaseRDD(): RDD[_]

  21. def getCacheMode(): CacheType

  22. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  23. def getFirstConfPartDesc(): PartitionDesc

  24. def getIsInMemoryTableScan(): Boolean

  25. def getTableDesc(): TableDesc

  26. def getTag: Int

    Return the join tag.

    Return the join tag. This is usually just 0. ReduceSink might set it to something else.

    Definition Classes
    Operator
  27. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  28. def hconf: HiveConf

    Definition Classes
    Operator
  29. var hiveOp: org.apache.hadoop.hive.ql.exec.TableScanOperator

  30. def initEvaluators(evals: Array[ExprNodeEvaluator], start: Int, length: Int, rowInspector: ObjectInspector): Array[ObjectInspector]

    Initialize an array of ExprNodeEvaluator from start, for specified length and return the result ObjectInspectors.

    Initialize an array of ExprNodeEvaluator from start, for specified length and return the result ObjectInspectors.

    Attributes
    protected
    Definition Classes
    Operator
  31. def initEvaluators(evals: Array[ExprNodeEvaluator], rowInspector: ObjectInspector): Array[ObjectInspector]

    Initialize an array of ExprNodeEvaluator and return the result ObjectInspectors.

    Initialize an array of ExprNodeEvaluator and return the result ObjectInspectors.

    Attributes
    protected
    Definition Classes
    Operator
  32. def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], outputColName: List[String], rowInspector: ObjectInspector): StructObjectInspector

    Initialize an array of ExprNodeEvaluator and put the return values into a StructObjectInspector with integer field names.

    Initialize an array of ExprNodeEvaluator and put the return values into a StructObjectInspector with integer field names.

    Attributes
    protected
    Definition Classes
    Operator
  33. def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], fieldObjectInspectors: Array[ObjectInspector], distinctColIndices: List[List[Integer]], outputColNames: List[String], length: Int, rowInspector: ObjectInspector): StructObjectInspector

    Copy from the org.

    Copy from the org.apache.hadoop.hive.ql.exec.ReduceSinkOperator Initializes array of ExprNodeEvaluator. Adds Union field for distinct column indices for group by. Puts the return values into a StructObjectInspector with output column names.

    If distinctColIndices is empty, the object inspector is same as Operator#initEvaluatorsAndReturnStruct(ExprNodeEvaluator[], List, ObjectInspector)

    Attributes
    protected
    Definition Classes
    Operator
  34. def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], distinctColIndices: List[List[Integer]], outputColNames: List[String], length: Int, rowInspector: ObjectInspector): StructObjectInspector

    Copy from the org.

    Copy from the org.apache.hadoop.hive.ql.exec.ReduceSinkOperator Initializes array of ExprNodeEvaluator. Adds Union field for distinct column indices for group by. Puts the return values into a StructObjectInspector with output column names.

    If distinctColIndices is empty, the object inspector is same as Operator#initEvaluatorsAndReturnStruct(ExprNodeEvaluator[], List, ObjectInspector)

    Attributes
    protected
    Definition Classes
    Operator
  35. def initializeMasterOnAll(): Unit

    Recursively calls initializeOnMaster() for the entire query plan.

    Recursively calls initializeOnMaster() for the entire query plan. Parent operators are called before children.

    Definition Classes
    Operator
  36. def initializeOnMaster(): Unit

    Initialize the operator on master node.

    Initialize the operator on master node. This can have dependency on other nodes. When an operator's initializeOnMaster() is invoked, all its parents' initializeOnMaster() have been invoked.

    Definition Classes
    TableScanOperatorOperator
  37. def initializeOnSlave(): Unit

    Initialize the operator on slave nodes.

    Initialize the operator on slave nodes. This method should have no dependency on parents or children. Everything that is not used in this method should be marked @transient.

    Definition Classes
    Operator
  38. def inputObjectInspectors(): Seq[ObjectInspector]

    Attributes
    protected
    Definition Classes
    Operator
  39. var isInMemoryTableScan: Boolean

  40. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  41. def isTraceEnabled(): Boolean

    Attributes
    protected
    Definition Classes
    Logging
  42. var localHConf: HiveConf

  43. def log: Logger

    Attributes
    protected
    Definition Classes
    Logging
  44. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  45. def logDebug(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  46. def logError(msg: String, exception: Throwable): Unit

    Definition Classes
    LogHelper
  47. def logError(msg: String, detail: String): Unit

    Definition Classes
    LogHelper
  48. def logError(msg: ⇒ String): Unit

    Definition Classes
    LogHelper → Logging
  49. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  50. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  51. def logInfo(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  52. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  53. def logTrace(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  54. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging
  55. def logWarning(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging
  56. def makeRDDFromHadoop(): RDD[_]

    Create an RDD for a table stored in Hadoop.

  57. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  58. final def notify(): Unit

    Definition Classes
    AnyRef
  59. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  60. def objectInspector: ObjectInspector

    Definition Classes
    UnaryOperator
  61. var objectInspectors: Seq[ObjectInspector]

    Definition Classes
    Operator
  62. def outStream(): PrintStream

    Definition Classes
    LogHelper
  63. def outputObjectInspector(): ObjectInspector

    Definition Classes
    TableScanOperatorOperator
  64. def parentOperator: Operator[HiveDesc]

    Definition Classes
    UnaryOperator
  65. def parentOperators: ArrayBuffer[Operator[_ <: HiveDesc]]

    Definition Classes
    Operator
  66. def parentOperatorsAsJavaList: List[Operator[_ <: HiveDesc]]

    Return the parent operators as a Java List.

    Return the parent operators as a Java List. This is for interoperability with Java. We use this in explain's Java code.

    Definition Classes
    Operator
  67. var parts: Array[Partition]

  68. def postprocessRdd(rdd: RDD[_]): RDD[_]

    Called on master.

    Called on master.

    Definition Classes
    UnaryOperator
  69. def preprocessRdd(rdd: RDD[_]): RDD[_]

    Called on master.

    Called on master.

    Definition Classes
    UnaryOperator
  70. def processPartition(split: Int, iter: Iterator[_]): Iterator[_]

    Process a partition.

    Process a partition. Called on slaves.

    Definition Classes
    TableScanOperatorUnaryOperatorOperator
  71. def returnTerminalOperators(): Seq[Operator[_ <: HiveDesc]]

    Definition Classes
    Operator
  72. def returnTopOperators(): Seq[Operator[_]]

    Definition Classes
    Operator
  73. def setCacheMode(arg0: CacheType): Unit

  74. def setDesc[B >: TableScanDesc](d: B): Unit

    Definition Classes
    Operator
  75. def setFirstConfPartDesc(arg0: PartitionDesc): Unit

  76. def setIsInMemoryTableScan(arg0: Boolean): Unit

  77. def setTableDesc(arg0: TableDesc): Unit

  78. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  79. var table: Table

  80. var tableDesc: TableDesc

  81. def toString(): String

    Definition Classes
    AnyRef → Any
  82. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  83. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  84. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from TopOperator[TableScanDesc]

Inherited from UnaryOperator[TableScanDesc]

Inherited from Operator[TableScanDesc]

Inherited from Serializable

Inherited from Serializable

Inherited from LogHelper

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped