org.apache.drill.exec.physical.resultSet.impl

Class TestResultSetLoaderOverflow

java.lang.Object

DrillTest

org.apache.drill.test.SubOperatorTest

org.apache.drill.exec.physical.resultSet.impl.TestResultSetLoaderOverflow

public class TestResultSetLoaderOverflow
extends SubOperatorTest

Exercise the vector overflow functionality for the result set loader.

Field Summary

Fields inherited from class org.apache.drill.test.SubOperatorTest

dirTestWatcher, fixture

Constructor Summary

Constructors

Constructor and Description
TestResultSetLoaderOverflow()

Method Summary

Modifier and Type	Method and Description
void	testArrayOverflowWithOtherArrays() Test the complete set of array overflow cases: Array a is written before the column that has overflow, and must be copied, in its entirety, to the overflow row. Column b causes the overflow. Column c is written after the overflow, and should go to the look-ahead row. Column d is written for a while, then has empties before the overflow row, but is written in the overflow row. Column e is like d, but is not written in the overflow row.
void	testBatchSizeLimit() Test that the writer detects a vector overflow.
void	testCloseWithOverflow() Load a batch to overflow.
void	testLargeArray() Create an array that contains more than 64K values.
void	testMissingArrayValues() Test the case that an array has "missing values" before the overflow.
void	testOverflowWithNullables()
void	testOversizeArray() Case where a single array fills up the vector to the maximum size limit.
void	testSizeLimitOnArray() Test a row with a single array column which overflows.
void	testVectorSizeLimit() Test that the writer detects a vector overflow.
void	testVectorSizeLimitWithAppend()

Methods inherited from class org.apache.drill.test.SubOperatorTest

classSetup, classTeardown

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TestResultSetLoaderOverflow

public TestResultSetLoaderOverflow()

Method Detail

testVectorSizeLimit

public void testVectorSizeLimit()

Test that the writer detects a vector overflow. The offending column value should be moved to the next batch.

testBatchSizeLimit

public void testBatchSizeLimit()

Test that the writer detects a vector overflow. The offending column value should be moved to the next batch.

testCloseWithOverflow

public void testCloseWithOverflow()

Load a batch to overflow. Then, close the loader with the overflow batch unharvested. The Loader should release the memory allocated to the unused overflow vectors.

testOversizeArray

public void testOversizeArray()

Case where a single array fills up the vector to the maximum size limit. Overflow won't work here; the attempt will fail with a user exception.

testSizeLimitOnArray

public void testSizeLimitOnArray()

Test a row with a single array column which overflows. Verifies that all the fiddly bits about offset vectors and so on works correctly. Run this test (the simplest case) if you change anything about the array handling code.

testArrayOverflowWithOtherArrays

public void testArrayOverflowWithOtherArrays()

Test the complete set of array overflow cases:

• Array a is written before the column that has overflow, and must be copied, in its entirety, to the overflow row.
• Column b causes the overflow.
• Column c is written after the overflow, and should go to the look-ahead row.
• Column d is written for a while, then has empties before the overflow row, but is written in the overflow row.
• Column e is like d, but is not written in the overflow row.

testLargeArray

public void testLargeArray()

Create an array that contains more than 64K values. Drill has no numeric limit on array lengths. (Well, it does, but the limit is about 2 billion which, even for bytes, is too large to fit into a vector...)

testMissingArrayValues

public void testMissingArrayValues()

Test the case that an array has "missing values" before the overflow.

testOverflowWithNullables

public void testOverflowWithNullables()

testVectorSizeLimitWithAppend

public void testVectorSizeLimitWithAppend()