org.apache.drill.test

Class PhysicalOpUnitTestBase

java.lang.Object

DrillTest

org.apache.drill.exec.ExecTest

org.apache.drill.test.PhysicalOpUnitTestBase

Direct Known Subclasses:

BaseTestOpBatchEmitOutcome, BasicPhysicalOpUnitTest, MiniPlanUnitTestBase, OperatorTestBuilderTest, TestAggWithAnyValue.TestAggWithAnyValueMultipleBatches, TestBatchSizingMemoryUtil, TestHashAggBatch, TestHashJoinJPPD, TestHashJoinOutcome, TestHashJoinSpill, TestLimitOperator, TestOutputBatchSize

public class PhysicalOpUnitTestBase
extends ExecTest

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	PhysicalOpUnitTestBase.BatchIterator
protected static class	PhysicalOpUnitTestBase.MockExecutorFragmentContext Note
static class	PhysicalOpUnitTestBase.MockPhysicalOperator Note

Field Summary

Fields

Modifier and Type	Field and Description
protected ScanResult	classpathScan
BaseDirTestWatcher	dirTestWatcher
protected DrillbitContext	drillbitContext
protected DrillConfig	drillConf
protected PhysicalOpUnitTestBase.MockExecutorFragmentContext	fragContext
protected OperatorFixture.MockOperatorContext	opContext
protected OperatorCreatorRegistry	opCreatorReg
protected OperatorFixture	operatorFixture
protected ExecutorService	scanDecodeExecutor
protected ExecutorService	scanExecutor

Fields inherited from class org.apache.drill.exec.ExecTest

c, optionManager

Constructor Summary

Constructors

Constructor and Description
PhysicalOpUnitTestBase()

Method Summary

Modifier and Type	Method and Description
static Iterator<RecordReader>	getJsonReadersFromBatchString(List<String> jsonBatches, FragmentContext fragContext, List<SchemaPath> columnsToRead) Create JSONRecordReader from input strings.
static Iterator<RecordReader>	getJsonReadersFromInputFiles(DrillFileSystem fs, List<org.apache.hadoop.fs.Path> inputPaths, FragmentContext fragContext, List<SchemaPath> columnsToRead) Create JSONRecordReader from files on a file system.
protected OperatorCreatorRegistry	getOpCreatorReg()
List<RecordReader>	getReaderListForJsonBatches(List<String> jsonBatches, FragmentContext fragContext)
protected JoinCondition	joinCond(String leftExpr, String relationship, String rightExpr)
protected LegacyOperatorTestBuilder	legacyOpTestBuilder() Deprecated. Use opTestBuilder() instead.
protected void	mockFragmentContext()
protected void	mockOpContext(PhysicalOperator popConfig, long initReservation, long maxAllocation)
protected OperatorTestBuilder	opTestBuilder() Gets an OperatorTestBuilder.
protected Order.Ordering	ordering(String expression, org.apache.calcite.rel.RelFieldCollation.Direction direction, org.apache.calcite.rel.RelFieldCollation.NullDirection nullDirection)
protected List<NamedExpression>	parseExprs(String... expressionsAndOutputNames)
void	setup()
void	teardown()

Methods inherited from class org.apache.drill.exec.ExecTest

clear, getLocalFileSystem, mockDrillbitContext, mockUsDateFormatSymbols, mockUtcDateTimeZone, parseExpr, setupOptionManager

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

fragContext

protected PhysicalOpUnitTestBase.MockExecutorFragmentContext fragContext

drillbitContext

protected DrillbitContext drillbitContext

opContext

protected OperatorFixture.MockOperatorContext opContext

operatorFixture

protected OperatorFixture operatorFixture

scanExecutor

protected ExecutorService scanExecutor

scanDecodeExecutor

protected ExecutorService scanDecodeExecutor

dirTestWatcher

public final BaseDirTestWatcher dirTestWatcher

drillConf

protected final DrillConfig drillConf

classpathScan

protected final ScanResult classpathScan

opCreatorReg

protected final OperatorCreatorRegistry opCreatorReg

Constructor Detail

PhysicalOpUnitTestBase

public PhysicalOpUnitTestBase()

Method Detail

setup

public void setup()
           throws Exception

Throws:

Exception

teardown

public void teardown()

ordering

protected Order.Ordering ordering(String expression,
                                  org.apache.calcite.rel.RelFieldCollation.Direction direction,
                                  org.apache.calcite.rel.RelFieldCollation.NullDirection nullDirection)

joinCond

protected JoinCondition joinCond(String leftExpr,
                                 String relationship,
                                 String rightExpr)

parseExprs

protected List<NamedExpression> parseExprs(String... expressionsAndOutputNames)

legacyOpTestBuilder

@Deprecated
protected LegacyOperatorTestBuilder legacyOpTestBuilder()

Deprecated. Use opTestBuilder() instead.

Gets a LegacyOperatorTestBuilder.

Returns:

A LegacyOperatorTestBuilder.

opTestBuilder

protected OperatorTestBuilder opTestBuilder()

Gets an OperatorTestBuilder.

Returns:

An OperatorTestBuilder.

mockFragmentContext

protected void mockFragmentContext()
                            throws Exception

Throws:

Exception

mockOpContext

protected void mockOpContext(PhysicalOperator popConfig,
                             long initReservation,
                             long maxAllocation)
                      throws Exception

Throws:

Exception

getOpCreatorReg

protected OperatorCreatorRegistry getOpCreatorReg()

getReaderListForJsonBatches

public List<RecordReader> getReaderListForJsonBatches(List<String> jsonBatches,
                                                      FragmentContext fragContext)

getJsonReadersFromBatchString

public static Iterator<RecordReader> getJsonReadersFromBatchString(List<String> jsonBatches,
                                                                   FragmentContext fragContext,
                                                                   List<SchemaPath> columnsToRead)

Create JSONRecordReader from input strings.

Parameters:

jsonBatches - : list of input strings, each element represent a batch. Each string could either be in the form of "[{...}, {...}, ..., {...}]", or in the form of "{...}".

fragContext - : fragment context

columnsToRead - : list of schema paths to read from JSON reader.

Returns:

The JSONRecordReader corresponding to each given jsonBatch.

getJsonReadersFromInputFiles

public static Iterator<RecordReader> getJsonReadersFromInputFiles(DrillFileSystem fs,
                                                                  List<org.apache.hadoop.fs.Path> inputPaths,
                                                                  FragmentContext fragContext,
                                                                  List<SchemaPath> columnsToRead)

Create JSONRecordReader from files on a file system.

Parameters:

fs - : file system.

inputPaths - : list of .json file paths.

fragContext -

columnsToRead -

Returns:

The JSONRecordReader corresponding to each given input path.