org.apache.drill.exec.physical.impl.scan

Class TestScanOperExecLateSchema

java.lang.Object

DrillTest

org.apache.drill.test.SubOperatorTest

org.apache.drill.exec.physical.impl.scan.BaseScanOperatorExecTest

org.apache.drill.exec.physical.impl.scan.TestScanOperExecLateSchema

public class TestScanOperExecLateSchema
extends BaseScanOperatorExecTest

Test "late schema" readers: those like JSON that discover their schema as they read data.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.drill.exec.physical.impl.scan.BaseScanOperatorExecTest

BaseScanOperatorExecTest.BaseMockBatchReader, BaseScanOperatorExecTest.BaseScanFixtureBuilder, BaseScanOperatorExecTest.MockEarlySchemaReader

Field Summary

Fields inherited from class org.apache.drill.test.SubOperatorTest

dirTestWatcher, fixture

Constructor Summary

Constructors

Constructor and Description
TestScanOperExecLateSchema()

Method Summary

Modifier and Type	Method and Description
void	testLateSchemaDataOnFirst()
void	testLateSchemaEarlyClose() Test the case that a late scan operator is closed before the first reader is opened.
void	testLateSchemaEarlyCloseWithData() Test the case that a late schema reader is closed before consuming the look-ahead batch used to infer schema.
void	testLateSchemaEarlyReaderClose() Test the case that a late schema reader is closed after discovering schema, before any calls to next().
void	testLateSchemaLifecycle() Most basic test of a reader that discovers its schema as it goes along.
void	testLateSchemaLifecycleNoFile() Test a late-schema source that has no file information.
void	testLateSchemaLifecycleNoSchemaBatch()
void	testLateSchemaNoData()
void	testNonEmptyFirstBatch() Test the case where the reader does not play the "first batch contains only schema" game, and instead returns data.

Methods inherited from class org.apache.drill.exec.physical.impl.scan.BaseScanOperatorExecTest

expectedSchema, makeExpected, makeExpected, simpleBuilder, simpleFixture, verifyBatch

Methods inherited from class org.apache.drill.test.SubOperatorTest

classSetup, classTeardown

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TestScanOperExecLateSchema

public TestScanOperExecLateSchema()

Method Detail

testLateSchemaLifecycle

public void testLateSchemaLifecycle()

Most basic test of a reader that discovers its schema as it goes along. The purpose is to validate the most basic life-cycle steps before trying more complex variations.

testLateSchemaLifecycleNoSchemaBatch

public void testLateSchemaLifecycleNoSchemaBatch()

testLateSchemaEarlyClose

public void testLateSchemaEarlyClose()

Test the case that a late scan operator is closed before the first reader is opened.

testLateSchemaEarlyReaderClose

public void testLateSchemaEarlyReaderClose()

Test the case that a late schema reader is closed after discovering schema, before any calls to next().

testLateSchemaEarlyCloseWithData

public void testLateSchemaEarlyCloseWithData()

Test the case that a late schema reader is closed before consuming the look-ahead batch used to infer schema.

testLateSchemaLifecycleNoFile

public void testLateSchemaLifecycleNoFile()

Test a late-schema source that has no file information. (Like a Hive or JDBC data source.)

testLateSchemaNoData

public void testLateSchemaNoData()

testLateSchemaDataOnFirst

public void testLateSchemaDataOnFirst()

testNonEmptyFirstBatch

public void testNonEmptyFirstBatch()

Test the case where the reader does not play the "first batch contains only schema" game, and instead returns data. The Scan operator will split the first batch into two: one with schema only, another with data.