org.apache.drill.exec.physical.impl.agg

Class TestStreamingAggEmitOutcome

java.lang.Object

DrillTest

org.apache.drill.exec.ExecTest

org.apache.drill.test.PhysicalOpUnitTestBase

org.apache.drill.exec.physical.impl.BaseTestOpBatchEmitOutcome

org.apache.drill.exec.physical.impl.agg.TestStreamingAggEmitOutcome

public class TestStreamingAggEmitOutcome
extends BaseTestOpBatchEmitOutcome

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.test.PhysicalOpUnitTestBase

PhysicalOpUnitTestBase.BatchIterator, PhysicalOpUnitTestBase.MockExecutorFragmentContext, PhysicalOpUnitTestBase.MockPhysicalOperator

Field Summary

Fields

Modifier and Type	Field and Description
protected static TupleMetadata	resultSchema
protected static TupleMetadata	resultSchemaNoGroupBy

Fields inherited from class org.apache.drill.exec.physical.impl.BaseTestOpBatchEmitOutcome

emptyInputRowSet, inputContainer, inputContainerSv2, inputOutcomes, inputSchema, nonEmptyInputRowSet, outputRecordCount

Fields inherited from class org.apache.drill.test.PhysicalOpUnitTestBase

classpathScan, dirTestWatcher, drillbitContext, drillConf, fragContext, opContext, opCreatorReg, operatorFixture, scanDecodeExecutor, scanExecutor

Fields inherited from class org.apache.drill.exec.ExecTest

c, optionManager

Constructor Summary

Constructors

Constructor and Description
TestStreamingAggEmitOutcome()

Method Summary

Modifier and Type	Method and Description
static void	setUpBeforeClass2()
void	t1_testStreamingAggrEmptyBatchEmitOutcome() Verifies that if StreamingAggBatch receives empty batches with OK_NEW_SCHEMA and EMIT outcome then it correctly produces empty batches as output.
void	t10_1_testStreamingAggr_InputSplitToMultipleOutputBatch()
void	t10_testStreamingAggrWithEmptyDataSet()
void	t11_testStreamingAggrEmptyBatchEmitOutcome() Repeats t1_testStreamingAggrEmptyBatchEmitOutcome with no group by
void	t12_testStreamingAggrNonEmptyBatchEmitOutcome() Repeats t2_testStreamingAggrNonEmptyBatchEmitOutcome with no group by
void	t13_testStreamingAggrEmptyBatchFollowedByNonEmptyBatchEmitOutcome() Repeats t3_testStreamingAggrEmptyBatchFollowedByNonEmptyBatchEmitOutcome with no group by
void	t14_testStreamingAggrMultipleEmptyBatchFollowedByNonEmptyBatchEmitOutcome() Repeats t4_testStreamingAggrMultipleEmptyBatchFollowedByNonEmptyBatchEmitOutcome with no group by
void	t15_testStreamingAgrResetsAfterFirstEmitOutcome() Repeats t5_testStreamingAgrResetsAfterFirstEmitOutcome with no group by
void	t16_testStreamingAggrOkFollowedByNone() Repeats t6_testStreamingAggrOkFollowedByNone with no group by
void	t17_testStreamingAggrMultipleEMITOutcome() Repeats t7_testStreamingAggrMultipleEMITOutcome with no group by
void	t18_testStreamingAggrMultipleInputToSingleOutputBatch() Repeats t8_testStreamingAggrMultipleInputToSingleOutputBatch with no group by
void	t19_testStreamingAgr_WithEmptyNonEmptyBatchesAndOKOutcome() Repeats t9_testStreamingAgr_WithEmptyNonEmptyBatchesAndOKOutcome with no group by
void	t2_testStreamingAggrNonEmptyBatchEmitOutcome() Verifies that if StreamingAgg receives a RecordBatch with EMIT outcome post build schema phase then it produces output for those input batch correctly.
void	t20_testStreamingAggrWithEmptyDataSet() Repeats t10_testStreamingAggrWithEmptyDataSet with no group by
void	t21_testStreamingAggrRunsofEmpty_NonEmpty_Sv2() Repeats t21_testStreamingAggrRunsofEmpty_NonEmpty_Sv2 with no group by
void	t22_testStreamingAggrRunsOfEmpty_NonEmpty() Repeats t22_testStreamingAggrRunsOfEmpty_NonEmpty with no group by
void	t3_testStreamingAggrEmptyBatchFollowedByNonEmptyBatchEmitOutcome()
void	t4_testStreamingAggrMultipleEmptyBatchFollowedByNonEmptyBatchEmitOutcome()
void	t5_testStreamingAgrResetsAfterFirstEmitOutcome() Verifies that if StreamingAggr receives multiple non-empty record batch with EMIT outcome in between then it produces output for those input batch correctly.
void	t6_testStreamingAggrOkFollowedByNone() Verifies that if StreamingAggr receives multiple non-empty record batch with EMIT outcome in between then it produces output for those input batch correctly.
void	t7_testStreamingAggrMultipleEMITOutcome() Normal case
void	t8_1_testStreamingAggr_InputSplitToMultipleOutputBatch() Verifies scenario where multiple incoming batches received with OK_NEW_SCHEMA, OK, OK, EMIT whose output is split into multiple output batches is handled correctly such that first output is produced with OK_NEW_SCHEMA and then followed by EMIT outcome
void	t8_2_testStreamingAggr_Inputs_OK_EMIT_SplitToMultipleOutputBatch() Verifies scenario where multiple incoming batches received with OK_NEW_SCHEMA, OK, OK, EMIT whose output is split into multiple output batches and incoming batches received with OK,OK,EMIT whose output is also split across multiple output batches is handled correctly.
void	t8_testStreamingAggrMultipleInputToSingleOutputBatch()
void	t9_testStreamingAgr_WithEmptyNonEmptyBatchesAndOKOutcome() Tests for validating regular StreamingAggr behavior with no EMIT outcome

Methods inherited from class org.apache.drill.exec.physical.impl.BaseTestOpBatchEmitOutcome

afterTest, beforeTest, setUpBeforeClass

Methods inherited from class org.apache.drill.test.PhysicalOpUnitTestBase

getJsonReadersFromBatchString, getJsonReadersFromInputFiles, getOpCreatorReg, getReaderListForJsonBatches, joinCond, legacyOpTestBuilder, mockFragmentContext, mockOpContext, opTestBuilder, ordering, parseExprs, setup, teardown

Methods inherited from class org.apache.drill.exec.ExecTest

clear, getLocalFileSystem, mockDrillbitContext, mockUsDateFormatSymbols, mockUtcDateTimeZone, parseExpr, setupOptionManager

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

resultSchema

protected static TupleMetadata resultSchema

resultSchemaNoGroupBy

protected static TupleMetadata resultSchemaNoGroupBy

Constructor Detail

TestStreamingAggEmitOutcome

public TestStreamingAggEmitOutcome()

Method Detail

setUpBeforeClass2

public static void setUpBeforeClass2()
                              throws Exception

Throws:

Exception

t1_testStreamingAggrEmptyBatchEmitOutcome

public void t1_testStreamingAggrEmptyBatchEmitOutcome()

Verifies that if StreamingAggBatch receives empty batches with OK_NEW_SCHEMA and EMIT outcome then it correctly produces empty batches as output. First empty batch will be with OK_NEW_SCHEMA and second will be with EMIT outcome.

t2_testStreamingAggrNonEmptyBatchEmitOutcome

public void t2_testStreamingAggrNonEmptyBatchEmitOutcome()

Verifies that if StreamingAgg receives a RecordBatch with EMIT outcome post build schema phase then it produces output for those input batch correctly. The first output batch will always be returned with OK_NEW_SCHEMA outcome followed by EMIT with empty batch. The test verifies the output order with the expected baseline.

t3_testStreamingAggrEmptyBatchFollowedByNonEmptyBatchEmitOutcome

public void t3_testStreamingAggrEmptyBatchFollowedByNonEmptyBatchEmitOutcome()

t4_testStreamingAggrMultipleEmptyBatchFollowedByNonEmptyBatchEmitOutcome

public void t4_testStreamingAggrMultipleEmptyBatchFollowedByNonEmptyBatchEmitOutcome()

t5_testStreamingAgrResetsAfterFirstEmitOutcome

public void t5_testStreamingAgrResetsAfterFirstEmitOutcome()

Verifies that if StreamingAggr receives multiple non-empty record batch with EMIT outcome in between then it produces output for those input batch correctly. In this case it receives first non-empty batch with OK_NEW_SCHEMA in buildSchema phase followed by an empty batch with EMIT outcome. For this combination it produces output for the record received so far along with EMIT outcome. Then it receives second non-empty batch with OK outcome and produces output for it differently. The test validates that for each output received the order of the records are correct.

Throws:

Exception

t6_testStreamingAggrOkFollowedByNone

public void t6_testStreamingAggrOkFollowedByNone()

Verifies that if StreamingAggr receives multiple non-empty record batch with EMIT outcome in between then it produces output for those input batch correctly. In this case it receives first non-empty batch with OK_NEW_SCHEMA in buildSchema phase followed by an empty batch with EMIT outcome. For this combination it produces output for the record received so far along with EMIT outcome. Then it receives second non-empty batch with OK outcome and produces output for it differently. The test validates that for each output received the order of the records are correct.

Throws:

Exception

t7_testStreamingAggrMultipleEMITOutcome

public void t7_testStreamingAggrMultipleEMITOutcome()

Normal case

t8_testStreamingAggrMultipleInputToSingleOutputBatch

public void t8_testStreamingAggrMultipleInputToSingleOutputBatch()

t8_1_testStreamingAggr_InputSplitToMultipleOutputBatch

public void t8_1_testStreamingAggr_InputSplitToMultipleOutputBatch()

Verifies scenario where multiple incoming batches received with OK_NEW_SCHEMA, OK, OK, EMIT whose output is split into multiple output batches is handled correctly such that first output is produced with OK_NEW_SCHEMA and then followed by EMIT outcome

t8_2_testStreamingAggr_Inputs_OK_EMIT_SplitToMultipleOutputBatch

public void t8_2_testStreamingAggr_Inputs_OK_EMIT_SplitToMultipleOutputBatch()

Verifies scenario where multiple incoming batches received with OK_NEW_SCHEMA, OK, OK, EMIT whose output is split into multiple output batches and incoming batches received with OK,OK,EMIT whose output is also split across multiple output batches is handled correctly.

t9_testStreamingAgr_WithEmptyNonEmptyBatchesAndOKOutcome

public void t9_testStreamingAgr_WithEmptyNonEmptyBatchesAndOKOutcome()

Tests for validating regular StreamingAggr behavior with no EMIT outcome

t10_testStreamingAggrWithEmptyDataSet

public void t10_testStreamingAggrWithEmptyDataSet()

t10_1_testStreamingAggr_InputSplitToMultipleOutputBatch

public void t10_1_testStreamingAggr_InputSplitToMultipleOutputBatch()

t11_testStreamingAggrEmptyBatchEmitOutcome

public void t11_testStreamingAggrEmptyBatchEmitOutcome()

Repeats t1_testStreamingAggrEmptyBatchEmitOutcome with no group by

t12_testStreamingAggrNonEmptyBatchEmitOutcome

public void t12_testStreamingAggrNonEmptyBatchEmitOutcome()

Repeats t2_testStreamingAggrNonEmptyBatchEmitOutcome with no group by

t13_testStreamingAggrEmptyBatchFollowedByNonEmptyBatchEmitOutcome

public void t13_testStreamingAggrEmptyBatchFollowedByNonEmptyBatchEmitOutcome()

Repeats t3_testStreamingAggrEmptyBatchFollowedByNonEmptyBatchEmitOutcome with no group by

t14_testStreamingAggrMultipleEmptyBatchFollowedByNonEmptyBatchEmitOutcome

public void t14_testStreamingAggrMultipleEmptyBatchFollowedByNonEmptyBatchEmitOutcome()

Repeats t4_testStreamingAggrMultipleEmptyBatchFollowedByNonEmptyBatchEmitOutcome with no group by

t15_testStreamingAgrResetsAfterFirstEmitOutcome

public void t15_testStreamingAgrResetsAfterFirstEmitOutcome()

Repeats t5_testStreamingAgrResetsAfterFirstEmitOutcome with no group by

t16_testStreamingAggrOkFollowedByNone

public void t16_testStreamingAggrOkFollowedByNone()

Repeats t6_testStreamingAggrOkFollowedByNone with no group by

t17_testStreamingAggrMultipleEMITOutcome

public void t17_testStreamingAggrMultipleEMITOutcome()

Repeats t7_testStreamingAggrMultipleEMITOutcome with no group by

t18_testStreamingAggrMultipleInputToSingleOutputBatch

public void t18_testStreamingAggrMultipleInputToSingleOutputBatch()

Repeats t8_testStreamingAggrMultipleInputToSingleOutputBatch with no group by

t19_testStreamingAgr_WithEmptyNonEmptyBatchesAndOKOutcome

public void t19_testStreamingAgr_WithEmptyNonEmptyBatchesAndOKOutcome()

Repeats t9_testStreamingAgr_WithEmptyNonEmptyBatchesAndOKOutcome with no group by

t20_testStreamingAggrWithEmptyDataSet

public void t20_testStreamingAggrWithEmptyDataSet()

Repeats t10_testStreamingAggrWithEmptyDataSet with no group by

t21_testStreamingAggrRunsofEmpty_NonEmpty_Sv2

public void t21_testStreamingAggrRunsofEmpty_NonEmpty_Sv2()

Repeats t21_testStreamingAggrRunsofEmpty_NonEmpty_Sv2 with no group by

t22_testStreamingAggrRunsOfEmpty_NonEmpty

public void t22_testStreamingAggrRunsOfEmpty_NonEmpty()

Repeats t22_testStreamingAggrRunsOfEmpty_NonEmpty with no group by