JoinOperator

Instance Constructors

new JoinOperator()

Value Members

final def !=(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def !=(arg0: Any): Boolean

Definition Classes
Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def ==(arg0: Any): Boolean

Definition Classes
Any
def addChild(child: Operator[_ <: HiveDesc]): Unit

Definition Classes
Operator
def addParent(parent: Operator[_ <: HiveDesc]): Unit

Definition Classes
Operator
final def asInstanceOf[T0]: T0

Definition Classes
Any
def childOperators: ArrayBuffer[Operator[_ <: HiveDesc]]

Definition Classes
Operator
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
def combineMultipleRdds(rdds: Seq[(Int, RDD[_])]): RDD[_]

Called on master.
Called on master.

Definition Classes
JoinOperator → NaryOperator
def computeJoinValues(tblIdx: Int, bytes: BytesWritable, objs: Array[AnyRef]): Array[AnyRef]
var conf: JoinDesc

Definition Classes
CommonJoinOperator
def desc: JoinDesc

Definition Classes
Operator
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def errStream(): PrintStream

Definition Classes
LogHelper
def execute(): RDD[_]

Execute the operator.
Execute the operator. This should recursively execute parent operators.

Definition Classes
JoinOperator → NaryOperator → Operator
def executeParents(): Seq[(Int, RDD[_])]

Attributes
protected
Definition Classes
Operator
def filterEval(data: AnyRef): Boolean

Definition Classes
CommonJoinOperator
Annotations
@inline()
var filterMap: Array[Array[Int]]

Definition Classes
CommonJoinOperator
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
def generate[B <: AnyRef](elements: Array[B]): Array[AnyRef]

Create the new output tuple based on the input elements and return it.
Create the new output tuple based on the input elements and return it.
The join sequence generally looks like:
join (filter value eval) ... / \ join (filter value eval) \ / \ \ table1(col1,col2..) table2(colx, coly..) table3(cola, colb..) ...
elements
[input] represents values of all input tables columns

Definition Classes
JoinFilter
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def getConf(): JoinDesc

Definition Classes
CommonJoinOperator
def getInputOffsets(): Array[Int]

Definition Classes
JoinFilter
def getJoinConditions(): Array[JoinCondDesc]

Definition Classes
CommonJoinOperator
def getKeyTableDesc(): TableDesc
def getNullCheck(): Boolean

Definition Classes
CommonJoinOperator
def getNumTables(): Int

Definition Classes
CommonJoinOperator
def getOrder(): Array[Byte]

Definition Classes
CommonJoinOperator
def getResultRowSize(): Int

Definition Classes
JoinFilter
def getResultTupleSizes(): Array[Int]

Definition Classes
JoinFilter
def getTag: Int

Return the join tag.
Return the join tag. This is usually just 0. ReduceSink might set it to something else.

Definition Classes
Operator
def getValueTableDescMap(): HashMap[Int, TableDesc]
def hashCode(): Int

Definition Classes
AnyRef → Any
def hconf: HiveConf

Definition Classes
Operator
def initEvaluators(evals: Array[ExprNodeEvaluator], start: Int, length: Int, rowInspector: ObjectInspector): Array[ObjectInspector]

Initialize an array of ExprNodeEvaluator from start, for specified length and return the result ObjectInspectors.
Initialize an array of ExprNodeEvaluator from start, for specified length and return the result ObjectInspectors.

Attributes
protected
Definition Classes
Operator
def initEvaluators(evals: Array[ExprNodeEvaluator], rowInspector: ObjectInspector): Array[ObjectInspector]

Initialize an array of ExprNodeEvaluator and return the result ObjectInspectors.
Initialize an array of ExprNodeEvaluator and return the result ObjectInspectors.

Attributes
protected
Definition Classes
Operator
def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], outputColName: List[String], rowInspector: ObjectInspector): StructObjectInspector

Initialize an array of ExprNodeEvaluator and put the return values into a StructObjectInspector with integer field names.
Initialize an array of ExprNodeEvaluator and put the return values into a StructObjectInspector with integer field names.

Attributes
protected
Definition Classes
Operator
def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], fieldObjectInspectors: Array[ObjectInspector], distinctColIndices: List[List[Integer]], outputColNames: List[String], length: Int, rowInspector: ObjectInspector): StructObjectInspector

Copy from the org.
Copy from the org.apache.hadoop.hive.ql.exec.ReduceSinkOperator Initializes array of ExprNodeEvaluator. Adds Union field for distinct column indices for group by. Puts the return values into a StructObjectInspector with output column names.
If distinctColIndices is empty, the object inspector is same as Operator#initEvaluatorsAndReturnStruct(ExprNodeEvaluator[], List, ObjectInspector)

Attributes
protected
Definition Classes
Operator
def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], distinctColIndices: List[List[Integer]], outputColNames: List[String], length: Int, rowInspector: ObjectInspector): StructObjectInspector

Copy from the org.
Copy from the org.apache.hadoop.hive.ql.exec.ReduceSinkOperator Initializes array of ExprNodeEvaluator. Adds Union field for distinct column indices for group by. Puts the return values into a StructObjectInspector with output column names.
If distinctColIndices is empty, the object inspector is same as Operator#initEvaluatorsAndReturnStruct(ExprNodeEvaluator[], List, ObjectInspector)

Attributes
protected
Definition Classes
Operator
def initializeJoinFilterOnMaster(): Unit

Attributes
protected
Definition Classes
JoinFilter
def initializeMasterOnAll(): Unit

Recursively calls initializeOnMaster() for the entire query plan.
Recursively calls initializeOnMaster() for the entire query plan. Parent operators are called before children.

Definition Classes
Operator
def initializeOnMaster(): Unit

Initialize the operator on master node.
Initialize the operator on master node. This can have dependency on other nodes. When an operator's initializeOnMaster() is invoked, all its parents' initializeOnMaster() have been invoked.

Definition Classes
JoinOperator → CommonJoinOperator → Operator
def initializeOnSlave(): Unit

Initialize the operator on slave nodes.
Initialize the operator on slave nodes. This method should have no dependency on parents or children. Everything that is not used in this method should be marked @transient.

Definition Classes
JoinOperator → CommonJoinOperator → Operator
def inputObjectInspectors(): Seq[ObjectInspector]

Attributes
protected
Definition Classes
Operator
var inputOffsets: Array[Int]

Definition Classes
JoinFilter
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def isTraceEnabled(): Boolean

Attributes
protected
Definition Classes
Logging
var joinConditions: Array[JoinCondDesc]

Definition Classes
CommonJoinOperator
var joinFilterObjectInspectors: Array[List[ObjectInspector]]

Definition Classes
CommonJoinOperator
var joinFilters: Array[List[ExprNodeEvaluator]]

Definition Classes
CommonJoinOperator
var joinVals: Array[List[ExprNodeEvaluator]]

Definition Classes
CommonJoinOperator
var joinValuesObjectInspectors: Array[List[ObjectInspector]]

Definition Classes
CommonJoinOperator
var joinValuesStandardObjectInspectors: Array[List[ObjectInspector]]

Definition Classes
CommonJoinOperator
var keyDeserializer: Deserializer
var keyObjectInspector: StandardStructObjectInspector
var keyTableDesc: TableDesc
def keyValueDescs(): Seq[(Int, (TableDesc, TableDesc))]

Definition Classes
ReduceSinkTableDesc
def log: Logger

Attributes
protected
Definition Classes
Logging
def logDebug(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logDebug(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
def logError(msg: String, exception: Throwable): Unit

Definition Classes
LogHelper
def logError(msg: String, detail: String): Unit

Definition Classes
LogHelper
def logError(msg: ⇒ String): Unit

Definition Classes
LogHelper → Logging
def logError(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logInfo(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logInfo(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
def logTrace(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logTrace(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
def logWarning(msg: ⇒ String, throwable: Throwable): Unit

Attributes
protected
Definition Classes
Logging
def logWarning(msg: ⇒ String): Unit

Attributes
protected
Definition Classes
Logging
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
var noOuterJoin: Boolean

Definition Classes
CommonJoinOperator
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
var nullCheck: Boolean

Definition Classes
CommonJoinOperator
var numTables: Int

Definition Classes
CommonJoinOperator
var objectInspectors: Seq[ObjectInspector]

Definition Classes
Operator
var order: Array[Byte]

Definition Classes
CommonJoinOperator
def outStream(): PrintStream

Definition Classes
LogHelper
def outputObjectInspector(): StandardStructObjectInspector

Definition Classes
CommonJoinOperator → Operator
def parentOperators: ArrayBuffer[Operator[_ <: HiveDesc]]

Definition Classes
Operator
def parentOperatorsAsJavaList: List[Operator[_ <: HiveDesc]]

Return the parent operators as a Java List.
Return the parent operators as a Java List. This is for interoperability with Java. We use this in explain's Java code.

Definition Classes
Operator
def postprocessRdd(rdd: RDD[_]): RDD[_]

Called on master.
Called on master.

Definition Classes
NaryOperator
def processPartition(split: Int, iter: Iterator[_]): Iterator[_]

Process a partition.
Process a partition. Called on slaves.

Definition Classes
JoinOperator → NaryOperator → Operator
var resultRowSize: Int

Definition Classes
JoinFilter
var resultTupleSizes: Array[Int]

Definition Classes
JoinFilter
def returnTerminalOperators(): Seq[Operator[_ <: HiveDesc]]

Definition Classes
Operator
def returnTopOperators(): Seq[Operator[_]]

Definition Classes
Operator
var rowBuffer: Array[AnyRef]

Definition Classes
CommonJoinOperator
def setColumnValues(data: AnyRef, outputRow: Array[AnyRef], tblIdx: Int, offsets: IndexedSeq[Int]): Unit

Copy the table(input) columns value to the output tuple
Copy the table(input) columns value to the output tuple

Attributes
protected
Definition Classes
JoinFilter
def setConf(arg0: JoinDesc): Unit

Definition Classes
CommonJoinOperator
def setDesc[B >: JoinDesc](d: B): Unit

Definition Classes
Operator
def setInputOffsets(arg0: Array[Int]): Unit

Definition Classes
JoinFilter
def setJoinConditions(arg0: Array[JoinCondDesc]): Unit

Definition Classes
CommonJoinOperator
def setKeyTableDesc(arg0: TableDesc): Unit
def setNullCheck(arg0: Boolean): Unit

Definition Classes
CommonJoinOperator
def setNumTables(arg0: Int): Unit

Definition Classes
CommonJoinOperator
def setOrder(arg0: Array[Byte]): Unit

Definition Classes
CommonJoinOperator
def setResultRowSize(arg0: Int): Unit

Definition Classes
JoinFilter
def setResultTupleSizes(arg0: Array[Int]): Unit

Definition Classes
JoinFilter
def setValueTableDescMap(arg0: HashMap[Int, TableDesc]): Unit
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
var tagLen: Int

Definition Classes
CommonJoinOperator
var tagToValueSer: HashMap[Int, Deserializer]
def toString(): String

Definition Classes
AnyRef → Any
var valueTableDescMap: HashMap[Int, TableDesc]
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

class JoinOperator extends CommonJoinOperator[JoinDesc] with ReduceSinkTableDesc

Instance Constructors

new JoinOperator()

Value Members

final def !=(arg0: AnyRef): Boolean

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: AnyRef): Boolean

final def ==(arg0: Any): Boolean

def addChild(child: Operator[_ <: HiveDesc]): Unit

def addParent(parent: Operator[_ <: HiveDesc]): Unit

final def asInstanceOf[T0]: T0

def childOperators: ArrayBuffer[Operator[_ <: HiveDesc]]

def clone(): AnyRef

def combineMultipleRdds(rdds: Seq[(Int, RDD[_])]): RDD[_]

def computeJoinValues(tblIdx: Int, bytes: BytesWritable, objs: Array[AnyRef]): Array[AnyRef]

var conf: JoinDesc

def desc: JoinDesc

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def errStream(): PrintStream

def execute(): RDD[_]

def executeParents(): Seq[(Int, RDD[_])]

def filterEval(data: AnyRef): Boolean

var filterMap: Array[Array[Int]]

def finalize(): Unit

def generate[B <: AnyRef](elements: Array[B]): Array[AnyRef]

final def getClass(): Class[_]

def getConf(): JoinDesc

def getInputOffsets(): Array[Int]

def getJoinConditions(): Array[JoinCondDesc]

def getKeyTableDesc(): TableDesc

def getNullCheck(): Boolean

def getNumTables(): Int

def getOrder(): Array[Byte]

def getResultRowSize(): Int

def getResultTupleSizes(): Array[Int]

def getTag: Int

def getValueTableDescMap(): HashMap[Int, TableDesc]

def hashCode(): Int

def hconf: HiveConf

def initEvaluators(evals: Array[ExprNodeEvaluator], start: Int, length: Int, rowInspector: ObjectInspector): Array[ObjectInspector]

def initEvaluators(evals: Array[ExprNodeEvaluator], rowInspector: ObjectInspector): Array[ObjectInspector]

def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], outputColName: List[String], rowInspector: ObjectInspector): StructObjectInspector

def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], fieldObjectInspectors: Array[ObjectInspector], distinctColIndices: List[List[Integer]], outputColNames: List[String], length: Int, rowInspector: ObjectInspector): StructObjectInspector

def initEvaluatorsAndReturnStruct(evals: Array[ExprNodeEvaluator], distinctColIndices: List[List[Integer]], outputColNames: List[String], length: Int, rowInspector: ObjectInspector): StructObjectInspector

def initializeJoinFilterOnMaster(): Unit

def initializeMasterOnAll(): Unit

def initializeOnMaster(): Unit

def initializeOnSlave(): Unit

def inputObjectInspectors(): Seq[ObjectInspector]

var inputOffsets: Array[Int]

final def isInstanceOf[T0]: Boolean

def isTraceEnabled(): Boolean

var joinConditions: Array[JoinCondDesc]

var joinFilterObjectInspectors: Array[List[ObjectInspector]]

var joinFilters: Array[List[ExprNodeEvaluator]]

var joinVals: Array[List[ExprNodeEvaluator]]

var joinValuesObjectInspectors: Array[List[ObjectInspector]]

var joinValuesStandardObjectInspectors: Array[List[ObjectInspector]]

var keyDeserializer: Deserializer

var keyObjectInspector: StandardStructObjectInspector

var keyTableDesc: TableDesc

def keyValueDescs(): Seq[(Int, (TableDesc, TableDesc))]

def log: Logger

def logDebug(msg: ⇒ String, throwable: Throwable): Unit

def logDebug(msg: ⇒ String): Unit

def logError(msg: String, exception: Throwable): Unit

def logError(msg: String, detail: String): Unit

def logError(msg: ⇒ String): Unit

def logError(msg: ⇒ String, throwable: Throwable): Unit

def logInfo(msg: ⇒ String, throwable: Throwable): Unit

def logInfo(msg: ⇒ String): Unit

def logTrace(msg: ⇒ String, throwable: Throwable): Unit

def logTrace(msg: ⇒ String): Unit

def logWarning(msg: ⇒ String, throwable: Throwable): Unit

def logWarning(msg: ⇒ String): Unit

final def ne(arg0: AnyRef): Boolean

var noOuterJoin: Boolean