aggregate

Type Members

1. abstract class AggregationIterator extends Iterator[UnsafeRow] with Logging

   The base class of SortBasedAggregationIterator and TungstenAggregationIterator.

2. sealed trait BufferSetterGetterUtils extends AnyRef

   A helper trait used to create specialized setter and getter for types supported by org.apache.spark.sql.execution.UnsafeFixedWidthAggregationMap's buffer.

3. case class HashAggregateExec(requiredChildDistributionExpressions: Option[Seq[Expression]], groupingExpressions: Seq[NamedExpression], aggregateExpressions: Seq[AggregateExpression], aggregateAttributes: Seq[Attribute], initialInputBufferOffset: Int, resultExpressions: Seq[NamedExpression], child: SparkPlan) extends SparkPlan with UnaryExecNode with CodegenSupport with Product with Serializable

   Hash-based aggregate operator that can also fallback to sorting when data exceeds memory size.

4. abstract class HashMapGenerator extends AnyRef

   This is a helper class to generate an append-only row-based hash map that can act as a 'cache' for extremely fast key-value lookups while evaluating aggregates (and fall back to the BytesToBytesMap if a given key isn't found).

5. class RowBasedHashMapGenerator extends HashMapGenerator

   This is a helper class to generate an append-only row-based hash map that can act as a 'cache' for extremely fast key-value lookups while evaluating aggregates (and fall back to the BytesToBytesMap if a given key isn't found).

6. case class ScalaUDAF(children: Seq[Expression], udaf: UserDefinedAggregateFunction, mutableAggBufferOffset: Int = 0, inputAggBufferOffset: Int = 0) extends ImperativeAggregate with NonSQLExpression with Logging with Product with Serializable

   The internal wrapper used to hook a UserDefinedAggregateFunction udaf in the internal aggregation code path.

7. case class SortAggregateExec(requiredChildDistributionExpressions: Option[Seq[Expression]], groupingExpressions: Seq[NamedExpression], aggregateExpressions: Seq[AggregateExpression], aggregateAttributes: Seq[Attribute], initialInputBufferOffset: Int, resultExpressions: Seq[NamedExpression], child: SparkPlan) extends SparkPlan with UnaryExecNode with Product with Serializable

   Sort-based aggregate operator.

8. class SortBasedAggregationIterator extends AggregationIterator

   An iterator used to evaluate AggregateFunction.

9. class TungstenAggregationIterator extends AggregationIterator with Logging

   An iterator used to evaluate aggregate functions.

10. case class TypedAggregateExpression(aggregator: expressions.Aggregator[Any, Any, Any], inputDeserializer: Option[Expression], inputClass: Option[Class[_]], inputSchema: Option[StructType], bufferSerializer: Seq[NamedExpression], bufferDeserializer: Expression, outputSerializer: Seq[Expression], outputExternalType: DataType, dataType: DataType, nullable: Boolean) extends DeclarativeAggregate with NonSQLExpression with Product with Serializable

    A helper class to hook Aggregator into the aggregation system.

11. class TypedAverage[IN] extends expressions.Aggregator[IN, (Double, Long), Double]

12. class TypedCount[IN] extends expressions.Aggregator[IN, Long, Long]

13. class TypedSumDouble[IN] extends expressions.Aggregator[IN, Double, Double]

14. class TypedSumLong[IN] extends expressions.Aggregator[IN, Long, Long]

15. class VectorizedHashMapGenerator extends HashMapGenerator

    This is a helper class to generate an append-only vectorized hash map that can act as a 'cache' for extremely fast key-value lookups while evaluating aggregates (and fall back to the BytesToBytesMap if a given key isn't found).