CodegenContext

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

5. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

6. final var INPUT_ROW: String

   The variable name of the input row in generated code.

7. final val JAVA_BOOLEAN: String("boolean")

8. final val JAVA_BYTE: String("byte")

9. final val JAVA_DOUBLE: String("double")

10. final val JAVA_FLOAT: String("float")

11. final val JAVA_INT: String("int")

12. final val JAVA_LONG: String("long")

13. final val JAVA_SHORT: String("short")

14. def addBufferedState(dataType: DataType, variableName: String, initCode: String): ExprCode

    Add buffer variable which stores data coming from an InternalRow.

    Add buffer variable which stores data coming from an InternalRow. This methods guarantees that the variable is safely stored, which is important for (potentially) byte array backed data types like: UTF8String, ArrayData, MapData & InternalRow.

15. def addMutableState(javaType: String, variableName: String, initCode: String): Unit

16. def addNewFunction(funcName: String, funcCode: String): Unit

17. def addPartitionInitializationStatement(statement: String): Unit

18. def addReferenceObj(name: String, obj: Any, className: String = null): String

    Add an object to references, create a class member to access it.

    Add an object to references, create a class member to access it.

    Returns the name of class member.

19. def addReferenceObj(obj: Any): String

    Add an object to references.

    Add an object to references.

    Returns the code to access it.

    This is for minor objects not to store the object into field but refer it from the references field at the time of use because number of fields in class is limited so we should reduce it.

20. val addedFunctions: Map[String, String]

    Holding all the functions those will be added into generated class.

21. final def asInstanceOf[T0]: T0

    Definition Classes

    Any

22. def boxedType(dt: DataType): String

23. def boxedType(jt: String): String

    Returns the boxed type in Java.

24. def clone(): AnyRef

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

25. var copyResult: Boolean

    Whether should we copy the result rows or not.

    Whether should we copy the result rows or not.

    If any operator inside WholeStageCodegen generate multiple rows from a single row (for example, Join), this should be true.

    If an operator starts a new pipeline, this should be reset to false before calling consume().

26. var currentVars: Seq[ExprCode]

    Holding a list of generated columns as input of current operator, will be used by BoundReference to generate code.

27. def declareAddedFunctions(): String

28. def declareMutableStates(): String

29. def defaultValue(dt: DataType): String

30. def defaultValue(jt: String): String

    Returns the representation of default value for a given Java Type.

31. final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

32. def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

33. val equivalentExpressions: EquivalentExpressions

    Holds expressions that are equivalent.

    Holds expressions that are equivalent. Used to perform subexpression elimination during codegen.

    For expressions that appear more than once, generate additional code to prevent recomputing the value.

    For example, consider two expression generated from this SQL statement: SELECT (col1 + col2), (col1 + col2) / col3.

    equivalentExpressions will match the tree containing col1 + col2 and it will only be evaluated once.

34. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

35. def freshName(name: String): String

    Returns a term name that is unique within this instance of a CodegenContext.

36. var freshNamePrefix: String

    A prefix used to generate fresh name.

37. def genComp(dataType: DataType, c1: String, c2: String): String

    Generates code for comparing two expressions.

    Generates code for comparing two expressions.

    dataType

    data type of the expressions

    c1

    name of the variable of expression 1's output

    c2

    name of the variable of expression 2's output

38. def genEqual(dataType: DataType, c1: String, c2: String): String

    Generates code for equal expression in Java.

39. def genGreater(dataType: DataType, c1: String, c2: String): String

    Generates code for greater of two expressions.

    Generates code for greater of two expressions.

    dataType

    data type of the expressions

    c1

    name of the variable of expression 1's output

    c2

    name of the variable of expression 2's output

40. def generateExpressions(expressions: Seq[Expression], doSubexpressionElimination: Boolean = false): Seq[ExprCode]

    Generates code for expressions.

    Generates code for expressions. If doSubexpressionElimination is true, subexpression elimination will be performed. Subexpression elimination assumes that the code will for each expression will be combined in the expressions order.

41. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

42. def getPlaceHolderToComments(): Map[String, String]

    get a map of the pair of a place holder and a corresponding comment

43. def getValue(batch: String, row: String, dataType: DataType, ordinal: Int): String

    Returns the specialized code to access a value from a column vector for a given DataType.

44. def getValue(input: String, dataType: DataType, ordinal: String): String

    Returns the specialized code to access a value from inputRow at ordinal.

45. def hashCode(): Int

    Definition Classes

    AnyRef → Any

46. def initMutableStates(): String

47. def initPartition(): String

48. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

49. def isPrimitiveType(dt: DataType): Boolean

50. def isPrimitiveType(jt: String): Boolean

    Returns true if the Java type has a special accessor and setter in InternalRow.

51. def javaType(dt: DataType): String

    Returns the Java type for a DataType.

52. val mutableStates: ArrayBuffer[(String, String, String)]

    Holding expressions' mutable states like MonotonicallyIncreasingID.count as a 3-tuple: java type, variable name, code to init it.

    Holding expressions' mutable states like MonotonicallyIncreasingID.count as a 3-tuple: java type, variable name, code to init it. As an example, ("int", "count", "count = 0;") will produce code:

    private int count;

    as a member variable, and add

    count = 0;

    to the constructor.

    They will be kept as member variables in generated classes like SpecificProjection.

53. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

54. final def notify(): Unit

    Definition Classes

    AnyRef

55. final def notifyAll(): Unit

    Definition Classes

    AnyRef

56. def nullSafeExec(nullable: Boolean, isNull: String)(execute: String): String

    Generates code to do null safe execution, i.

    Generates code to do null safe execution, i.e. only execute the code when the input is not null by adding null check if necessary.

    nullable

    used to decide whether we should add null check or not.

    isNull

    the code to check if the input is null.

    execute

    the code that should only be executed when the input is not null.

57. val partitionInitializationStatements: ArrayBuffer[String]

    Code statements to initialize states that depend on the partition index.

    Code statements to initialize states that depend on the partition index. An integer partitionIndex will be made available within the scope.

58. def primitiveTypeName(dt: DataType): String

59. def primitiveTypeName(jt: String): String

    Returns the name used in accessor and setter for a Java primitive type.

60. val primitiveTypes: Seq[String]

    List of java data types that have special accessors and setters in InternalRow.

61. val references: ArrayBuffer[Any]

    Holding a list of objects that could be used passed into generated class.

62. def registerComment(text: ⇒ String): String

    Register a comment and return the corresponding place holder

63. def setColumn(row: String, dataType: DataType, ordinal: Int, value: String): String

    Returns the code to update a column in Row for a given DataType.

64. def setValue(batch: String, row: String, dataType: DataType, ordinal: Int, value: String): String

    Returns the specialized code to set a given value in a column vector for a given DataType.

65. def splitExpressions(row: String, expressions: Seq[String]): String

    Splits the generated code of expressions into multiple functions, because function has 64kb code size limit in JVM

    Splits the generated code of expressions into multiple functions, because function has 64kb code size limit in JVM

    row

    the variable name of row that is used by expressions

    expressions

    the codes to evaluate expressions.

66. val subExprEliminationExprs: HashMap[Expression, SubExprEliminationState]

67. val subexprFunctions: ArrayBuffer[String]

68. def subexpressionEliminationForWholeStageCodegen(expressions: Seq[Expression]): SubExprCodes

    Checks and sets up the state and codegen for subexpression elimination.

    Checks and sets up the state and codegen for subexpression elimination. This finds the common subexpressions, generates the code snippets that evaluate those expressions and populates the mapping of common subexpressions to the generated code snippets. The generated code snippets will be returned and should be inserted into generated codes before these common subexpressions actually are used first time.

69. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

70. def toString(): String

    Definition Classes

    AnyRef → Any

71. def updateColumn(batch: String, row: String, dataType: DataType, ordinal: Int, ev: ExprCode, nullable: Boolean): String

    Returns the specialized code to set a given value in a column vector for a given DataType that could potentially be nullable.

72. def updateColumn(row: String, dataType: DataType, ordinal: Int, ev: ExprCode, nullable: Boolean, isVectorized: Boolean = false): String

    Update a column in MutableRow from ExprCode.

    Update a column in MutableRow from ExprCode.

    isVectorized

    True if the underlying row is of type ColumnarBatch.Row, false otherwise

73. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

74. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

75. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

76. def withSubExprEliminationExprs(newSubExprEliminationExprs: Map[Expression, SubExprEliminationState])(f: ⇒ Seq[ExprCode]): Seq[ExprCode]

    Perform a function which generates a sequence of ExprCodes with a given mapping between expressions and common expressions, instead of using the mapping in current context.