A B C D E F G H I L M N O P R S T U V W
All Classes All Packages

A

AbstractFileSource<T,SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src

The base class for File Sources.

AbstractFileSource(Path[], FileEnumerator.Provider, FileSplitAssigner.Provider, BulkFormat<T, SplitT>, ContinuousEnumerationSettings) - Constructor for class org.apache.flink.connector.file.src.AbstractFileSource

AbstractFileSource.AbstractFileSourceBuilder<T,SplitT extends FileSourceSplit,SELF extends AbstractFileSource.AbstractFileSourceBuilder<T,SplitT,SELF>> - Class in org.apache.flink.connector.file.src

The generic base builder.

AbstractFileSourceBuilder(Path[], BulkFormat<T, SplitT>, FileEnumerator.Provider, FileSplitAssigner.Provider) - Constructor for class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

AbstractStreamingWriter<IN,OUT> - Class in org.apache.flink.connector.file.table.stream

Operator for file system sink.

AbstractStreamingWriter(long, StreamingFileSink.BucketsBuilder<IN, String, ? extends StreamingFileSink.BucketsBuilder<IN, String, ?>>) - Constructor for class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

add(long, int) - Method in class org.apache.flink.connector.file.table.stream.TaskTracker

add(T) - Method in class org.apache.flink.connector.file.src.util.Pool

Adds an entry to the pool with an optional payload.

addPartition(String) - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitTrigger

Add a pending partition.

addPartition(String) - Method in class org.apache.flink.connector.file.table.stream.PartitionTimeCommitTrigger

addPartition(String) - Method in class org.apache.flink.connector.file.table.stream.ProcTimeCommitTrigger

addPreCommitTopology(DataStream<CommittableMessage<FileSinkCommittable>>) - Method in class org.apache.flink.connector.file.sink.FileSink

addReader(int) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

addReader(int) - Method in class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

addReader(int) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator

addSplits(Collection<FileSourceSplit>) - Method in interface org.apache.flink.connector.file.src.assigners.FileSplitAssigner

Adds a set of splits to this assigner.

addSplits(Collection<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner

addSplits(Collection<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner

addSplitsBack(List<FileSourceSplit>, int) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

addSplitsBack(List<FileSourceSplit>, int) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator

addSplitsBack(List<SplitT>, int) - Method in class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

addSplitsForPath(FileStatus, FileSystem, ArrayList<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveAllDirEnumerator

addSplitsForPath(FileStatus, FileSystem, ArrayList<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveAllDirEnumerator

addSplitsForPath(FileStatus, FileSystem, ArrayList<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator

addToCompact(FileSinkCommittable) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequest

addToPassthrough(FileSinkCommittable) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequest

ALL - org.apache.flink.connector.file.table.FileSystemConnectorOptions.FileStatisticsType

applyFilters(List<ResolvedExpression>) - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

applyFilters(List<ResolvedExpression>) - Method in interface org.apache.flink.connector.file.table.format.BulkDecodingFormat

Provides a list of filters in conjunctive form for filtering on a best-effort basis.

applyLimit(long) - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

applyOverwrite(boolean) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink

applyPartitions(List<Map<String, String>>) - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

applyProjection(int[][], DataType) - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

applyReadableMetadata(List<String>, DataType) - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

applyStaticPartition(Map<String, String>) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink

ArrayResultIterator<E> - Class in org.apache.flink.connector.file.src.util

A simple BulkFormat.RecordIterator that returns the elements of an array, one after the other.

ArrayResultIterator() - Constructor for class org.apache.flink.connector.file.src.util.ArrayResultIterator

Creates a new, initially empty, ArrayResultIterator.

ArrayResultIterator(Runnable) - Constructor for class org.apache.flink.connector.file.src.util.ArrayResultIterator

Creates a new, initially empty, ArrayResultIterator.

asSummaryString() - Method in class org.apache.flink.connector.file.table.FileSystemTableSink

asSummaryString() - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

ATTEMPT_PREFIX - Static variable in class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

AUTO_COMPACTION - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

B

BatchCompactCoordinator - Class in org.apache.flink.connector.file.table.batch.compact

Coordinator for compaction in batch mode.

BatchCompactCoordinator(SupplierWithException<FileSystem, IOException>, long, long) - Constructor for class org.apache.flink.connector.file.table.batch.compact.BatchCompactCoordinator

BatchCompactOperator<T> - Class in org.apache.flink.connector.file.table.batch.compact

CompactOperator for compaction in batch mode.

BatchCompactOperator(SupplierWithException<FileSystem, IOException>, CompactReader.Factory<T>, CompactWriter.Factory<T>) - Constructor for class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

BatchFileWriter<T> - Class in org.apache.flink.connector.file.table.batch.compact

An operator for writing files in batch mode.

BatchFileWriter(FileSystemFactory, Path, String[], boolean, LinkedHashMap<String, String>, OutputFormatFactory<T>, PartitionComputer<T>, OutputFileConfig) - Constructor for class org.apache.flink.connector.file.table.batch.compact.BatchFileWriter

BatchPartitionCommitterSink - Class in org.apache.flink.connector.file.table.batch.compact

Committer operator for partition in batch mode.

BatchPartitionCommitterSink(FileSystemFactory, TableMetaStoreFactory, boolean, boolean, Path, String[], LinkedHashMap<String, String>, ObjectIdentifier, PartitionCommitPolicyFactory) - Constructor for class org.apache.flink.connector.file.table.batch.compact.BatchPartitionCommitterSink

BatchSink - Class in org.apache.flink.connector.file.table.batch

Helper for creating batch file sink.

BinPacking - Class in org.apache.flink.connector.file.table

A bin packing implementation.

BlockSplittingRecursiveAllDirEnumerator - Class in org.apache.flink.connector.file.src.enumerate

This FileEnumerator enumerates all files under the given paths recursively except the hidden directories, and creates a separate split for each file block.

BlockSplittingRecursiveAllDirEnumerator(String) - Constructor for class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveAllDirEnumerator

Creates a new enumerator that enumerates all files whose file path matches the regex except hidden files.

BlockSplittingRecursiveAllDirEnumerator(Predicate<Path>, String[]) - Constructor for class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveAllDirEnumerator

Creates a new enumerator that uses the given predicate as a filter for file paths, and avoids splitting files with the given extension (typically to avoid splitting compressed files).

BlockSplittingRecursiveEnumerator - Class in org.apache.flink.connector.file.src.enumerate

This FileEnumerator enumerates all files under the given paths recursively, and creates a separate split for each file block.

BlockSplittingRecursiveEnumerator() - Constructor for class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveEnumerator

Creates a new enumerator that enumerates all files except hidden files.

BlockSplittingRecursiveEnumerator(Predicate<Path>, String[]) - Constructor for class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveEnumerator

Creates a new enumerator that uses the given predicate as a filter for file paths, and avoids splitting files with the given extension (typically to avoid splitting compressed files).

buckets - Variable in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

build() - Method in class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy.Builder

build() - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

Creates the actual sink.

build() - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

Creates the actual sink.

build() - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

Creates the file source with the settings applied to this builder.

build() - Method in class org.apache.flink.connector.file.src.FileSource.FileSourceBuilder

build() - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

Builder() - Constructor for class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy.Builder

Builder() - Constructor for class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

BulkDecodingFormat<T> - Interface in org.apache.flink.connector.file.table.format

A Format for a DynamicTableSource for reading rows by BulkFormat.

BulkFormat<T,SplitT extends FileSourceSplit> - Interface in org.apache.flink.connector.file.src.reader

The BulkFormat reads and decodes batches of records at a time.

BulkFormat.Reader<T> - Interface in org.apache.flink.connector.file.src.reader

The actual reader that reads the batches of records.

BulkFormat.RecordIterator<T> - Interface in org.apache.flink.connector.file.src.reader

An iterator over records with their position in the file.

BulkFormatBuilder(Path, long, BulkWriter.Factory<IN>, BucketAssigner<IN, String>, CheckpointRollingPolicy<IN, String>, FileWriterBucketFactory<IN>, OutputFileConfig) - Constructor for class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

BulkFormatBuilder(Path, BulkWriter.Factory<IN>, BucketAssigner<IN, String>) - Constructor for class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

BulkReaderFormatFactory - Interface in org.apache.flink.connector.file.table.factories

Base interface for configuring a BulkFormat for file system connector.

BulkWriterFormatFactory - Interface in org.apache.flink.connector.file.table.factories

Base interface for configuring a BulkWriter.Factory for file system connector.

C

canEqual(Object) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

catalogName() - Method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy.Context

Catalog name of this table.

CheckpointedPosition - Class in org.apache.flink.connector.file.src.util

The position of a reader, to be stored in a checkpoint.

CheckpointedPosition(long, long) - Constructor for class org.apache.flink.connector.file.src.util.CheckpointedPosition

Creates a new CheckpointedPosition for given offset and records-to-skip.

close() - Method in class org.apache.flink.connector.file.sink.committer.FileCommitter

close() - Method in class org.apache.flink.connector.file.sink.compactor.DecoderBasedReader

close() - Method in interface org.apache.flink.connector.file.sink.compactor.DecoderBasedReader.Decoder

Closes the open resources.

close() - Method in class org.apache.flink.connector.file.sink.compactor.InputFormatBasedReader

close() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

close() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandler

close() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactService

close() - Method in class org.apache.flink.connector.file.sink.compactor.SimpleStringDecoder

close() - Method in class org.apache.flink.connector.file.sink.writer.FileWriter

close() - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

close() - Method in class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

close() - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator

close() - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter.Reader

close() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat.Reader

Closes the reader and should release all resources.

close() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat.Reader

Closes the reader to release all resources.

close() - Method in class org.apache.flink.connector.file.src.reader.TextLineInputFormat.Reader

close() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactCoordinator

close() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

close() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchFileWriter

close() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchPartitionCommitterSink

close() - Method in class org.apache.flink.connector.file.table.DynamicPartitionWriter

close() - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat

close() - Method in class org.apache.flink.connector.file.table.GroupedPartitionWriter

close() - Method in interface org.apache.flink.connector.file.table.PartitionFetcher.Context

close the resources of the Context, this method should call when the context do not need any more.

close() - Method in class org.apache.flink.connector.file.table.PartitionLoader

close() - Method in interface org.apache.flink.connector.file.table.PartitionReader

Close the reader, this method should release all resources.

close() - Method in interface org.apache.flink.connector.file.table.PartitionWriter

End a transaction.

close() - Method in class org.apache.flink.connector.file.table.SingleDirectoryWriter

close() - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

close() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactBulkReader

close() - Method in class org.apache.flink.connector.file.table.stream.compact.FileInputFormatCompactReader

collectPartSpecToPaths(FileSystem, List<Path>, int) - Static method in class org.apache.flink.connector.file.table.PartitionTempFileManager

Collect all partitioned paths, aggregate according to partition spec.

ColumnarRowIterator - Class in org.apache.flink.connector.file.table

A BulkFormat.RecordIterator that returns RowDatas.

ColumnarRowIterator(ColumnarRowData, Runnable) - Constructor for class org.apache.flink.connector.file.table.ColumnarRowIterator

commit() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactBucketWriter

commit() - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactWriter

Commits the pending file, making it visible.

commit(Collection<Committer.CommitRequest<FileSinkCommittable>>) - Method in class org.apache.flink.connector.file.sink.committer.FileCommitter

commit(PartitionCommitPolicy.Context) - Method in class org.apache.flink.connector.file.table.MetastoreCommitPolicy

commit(PartitionCommitPolicy.Context) - Method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy

Commit a partition.

commit(PartitionCommitPolicy.Context) - Method in class org.apache.flink.connector.file.table.SuccessFileCommitPolicy

commitPartitions() - Method in class org.apache.flink.connector.file.table.FileSystemCommitter

For committing job's output after successful batch job completion.

commitPartitions(BiPredicate<Integer, Integer>) - Method in class org.apache.flink.connector.file.table.FileSystemCommitter

Commits the partitions with a filter to filter out invalid task attempt files.

commitPartitionsWithFiles(Map<String, List<Path>>) - Method in class org.apache.flink.connector.file.table.FileSystemCommitter

For committing job's output after successful batch job completion, it will commit with the given partitions and corresponding files written which means it'll move the temporary files to partition's location.

committablePartitions(long) - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitTrigger

Get committable partitions, and cleanup useless watermarks and partitions.

committablePartitions(long) - Method in class org.apache.flink.connector.file.table.stream.PartitionTimeCommitTrigger

committablePartitions(long) - Method in class org.apache.flink.connector.file.table.stream.ProcTimeCommitTrigger

commitUpToCheckpoint(long) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

Commit up to this checkpoint id.

commitUpToCheckpoint(long) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactFileWriter

commitUpToCheckpoint(long) - Method in class org.apache.flink.connector.file.table.stream.StreamingFileWriter

compact(List<Path>, OutputStream) - Method in class org.apache.flink.connector.file.sink.compactor.IdenticalFileCompactor

compact(List<Path>, OutputStream) - Method in class org.apache.flink.connector.file.sink.compactor.OutputStreamBasedFileCompactor

compact(List<Path>, RecordWiseFileCompactor.Writer<IN>) - Method in class org.apache.flink.connector.file.sink.compactor.RecordWiseFileCompactor

COMPACT_OP_NAME - Static variable in class org.apache.flink.connector.file.table.batch.BatchSink

CompactBucketWriter<T> - Class in org.apache.flink.connector.file.table.stream.compact

The CompactWriter to delegate BucketWriter.

CompactBulkReader<T> - Class in org.apache.flink.connector.file.table.stream.compact

The CompactReader to delegate CompactBulkReader.

CompactBulkReader(BulkFormat.Reader<T>) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactBulkReader

CompactContext - Interface in org.apache.flink.connector.file.table.stream.compact

Context for CompactReader and CompactWriter.

CompactContext.CompactContextImpl - Class in org.apache.flink.connector.file.table.stream.compact

Implementation of CompactContext.

CompactCoordinator - Class in org.apache.flink.connector.file.sink.compactor.operator

Coordinator that coordinates file compaction for the FileSink.

CompactCoordinator - Class in org.apache.flink.connector.file.table.stream.compact

This is the single (non-parallel) monitoring task which coordinate input files to compaction units. - Receives in-flight input files inside checkpoint. - Receives all upstream end input messages after the checkpoint completes successfully, starts coordination.

CompactCoordinator(StreamOperatorParameters<CompactorRequest>, FileCompactStrategy, SimpleVersionedSerializer<FileSinkCommittable>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinator

CompactCoordinator(SupplierWithException<FileSystem, IOException>, long) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactCoordinator

CompactCoordinatorFactory - Class in org.apache.flink.connector.file.sink.compactor.operator

Factory for CompactCoordinator.

CompactCoordinatorFactory(FileCompactStrategy, SerializableSupplierWithException<SimpleVersionedSerializer<FileSinkCommittable>, IOException>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorFactory

CompactCoordinatorStateHandler - Class in org.apache.flink.connector.file.sink.compactor.operator

Handler that processes the state of CompactCoordinator when compaction is disabled.

CompactCoordinatorStateHandler(StreamOperatorParameters<Either<CommittableMessage<FileSinkCommittable>, CompactorRequest>>, SimpleVersionedSerializer<FileSinkCommittable>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorStateHandler

CompactCoordinatorStateHandlerFactory - Class in org.apache.flink.connector.file.sink.compactor.operator

Factory for CompactCoordinatorStateHandler.

CompactCoordinatorStateHandlerFactory(SerializableSupplierWithException<SimpleVersionedSerializer<FileSinkCommittable>, IOException>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorStateHandlerFactory

COMPACTED_PREFIX - Static variable in class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

COMPACTED_PREFIX - Static variable in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

CompactFileUtils - Class in org.apache.flink.connector.file.table.utils

Utils for compacting files.

CompactFileUtils() - Constructor for class org.apache.flink.connector.file.table.utils.CompactFileUtils

CompactFileWriter<T> - Class in org.apache.flink.connector.file.table.stream.compact

Writer for emitting CompactMessages.InputFile and CompactMessages.EndCheckpoint to downstream.

CompactFileWriter(long, StreamingFileSink.BucketsBuilder<T, String, ? extends StreamingFileSink.BucketsBuilder<T, String, ?>>) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactFileWriter

COMPACTION_FILE_SIZE - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

COMPACTION_PARALLELISM - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

CompactionUnit(int, String, List<Path>) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactMessages.CompactionUnit

compactionWriter(ProviderContext, DataStream<T>, long, StreamingFileSink.BucketsBuilder<T, String, ? extends StreamingFileSink.BucketsBuilder<T, String, ?>>, FileSystemFactory, Path, CompactReader.Factory<T>, long, int, boolean) - Static method in class org.apache.flink.connector.file.table.stream.StreamingSink

Create a file writer with compaction operators by input stream.

CompactMessages - Class in org.apache.flink.connector.file.table.stream.compact

Util class for all compaction messages.

CompactMessages.CompactionUnit - Class in org.apache.flink.connector.file.table.stream.compact

The unit of a single compaction.

CompactMessages.CompactOutput - Class in org.apache.flink.connector.file.table.stream.compact

The output of BatchCompactOperator.

CompactMessages.CoordinatorInput - Interface in org.apache.flink.connector.file.table.stream.compact

The input of compact coordinator.

CompactMessages.CoordinatorOutput - Interface in org.apache.flink.connector.file.table.stream.compact

The output of compact coordinator.

CompactMessages.EndCheckpoint - Class in org.apache.flink.connector.file.table.stream.compact

A flag to end checkpoint, coordinator can start coordinating one checkpoint.

CompactMessages.EndCompaction - Class in org.apache.flink.connector.file.table.stream.compact

A flag to end compaction.

CompactMessages.InputFile - Class in org.apache.flink.connector.file.table.stream.compact

A partitioned input file.

CompactOperator<T> - Class in org.apache.flink.connector.file.table.stream.compact

Receives compaction units to do compaction.

CompactOperator(SupplierWithException<FileSystem, IOException>, CompactReader.Factory<T>, CompactWriter.Factory<T>) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactOperator

CompactorOperator - Class in org.apache.flink.connector.file.sink.compactor.operator

An operator that perform compaction for the FileSink.

CompactorOperator(StreamOperatorParameters<CommittableMessage<FileSinkCommittable>>, FileCompactStrategy, SimpleVersionedSerializer<FileSinkCommittable>, FileCompactor, BucketWriter<?, String>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

CompactorOperatorFactory - Class in org.apache.flink.connector.file.sink.compactor.operator

Factory for CompactorOperator.

CompactorOperatorFactory(FileCompactStrategy, FileCompactor, SerializableSupplierWithException<SimpleVersionedSerializer<FileSinkCommittable>, IOException>, SerializableSupplierWithException<BucketWriter<?, String>, IOException>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorFactory

CompactorOperatorStateHandler - Class in org.apache.flink.connector.file.sink.compactor.operator

Handler that processes the state of CompactorOperator when compaction is disabled.

CompactorOperatorStateHandler(StreamOperatorParameters<CommittableMessage<FileSinkCommittable>>, SimpleVersionedSerializer<FileSinkCommittable>, BucketWriter<?, String>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandler

CompactorOperatorStateHandlerFactory - Class in org.apache.flink.connector.file.sink.compactor.operator

Factory for CompactorOperatorStateHandler.

CompactorOperatorStateHandlerFactory(SerializableSupplierWithException<SimpleVersionedSerializer<FileSinkCommittable>, IOException>, SerializableSupplierWithException<BucketWriter<?, String>, IOException>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandlerFactory

CompactorRequest - Class in org.apache.flink.connector.file.sink.compactor.operator

Request of file compacting for FileSink.

CompactorRequest(String) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequest

CompactorRequest(String, List<FileSinkCommittable>, List<FileSinkCommittable>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequest

CompactorRequestSerializer - Class in org.apache.flink.connector.file.sink.compactor.operator

Versioned serializer for CompactorRequest.

CompactorRequestSerializer(SimpleVersionedSerializer<FileSinkCommittable>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestSerializer

CompactorRequestTypeInfo - Class in org.apache.flink.connector.file.sink.compactor.operator

Type information of CompactorRequest.

CompactorRequestTypeInfo(SerializableSupplierWithException<SimpleVersionedSerializer<FileSinkCommittable>, IOException>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

CompactOutput(Map<String, List<Path>>) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactMessages.CompactOutput

CompactReader<T> - Interface in org.apache.flink.connector.file.table.stream.compact

Reader for compaction.

CompactReader.Factory<T> - Interface in org.apache.flink.connector.file.table.stream.compact

Factory to create CompactReader.

CompactService - Class in org.apache.flink.connector.file.sink.compactor.operator

The asynchronous file compaction service.

CompactService(int, FileCompactor, BucketWriter<?, String>) - Constructor for class org.apache.flink.connector.file.sink.compactor.operator.CompactService

CompactWriter<T> - Interface in org.apache.flink.connector.file.table.stream.compact

Writer for compaction.

CompactWriter.Factory<T> - Interface in org.apache.flink.connector.file.table.stream.compact

Factory to create CompactWriter.

computeIndexMapping(List<String>, List<String>, List<String>) - Static method in class org.apache.flink.connector.file.table.EnrichedRowData

This method computes the index mapping for EnrichedRowData.

ConcatFileCompactor - Class in org.apache.flink.connector.file.sink.compactor

A OutputStreamBasedFileCompactor implementation that simply concat the compacting files.

ConcatFileCompactor() - Constructor for class org.apache.flink.connector.file.sink.compactor.ConcatFileCompactor

ConcatFileCompactor(byte[]) - Constructor for class org.apache.flink.connector.file.sink.compactor.ConcatFileCompactor

configure(Configuration) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat

Context(Configuration, OutputFormatFactory<T>) - Constructor for class org.apache.flink.connector.file.table.PartitionWriter.Context

ContinuousEnumerationSettings - Class in org.apache.flink.connector.file.src

Settings describing how to do continuous file discovery and enumeration for the file source's continuous discovery and streaming mode.

ContinuousEnumerationSettings(Duration) - Constructor for class org.apache.flink.connector.file.src.ContinuousEnumerationSettings

ContinuousFileSplitEnumerator - Class in org.apache.flink.connector.file.src.impl

A continuously monitoring enumerator.

ContinuousFileSplitEnumerator(SplitEnumeratorContext<FileSourceSplit>, FileEnumerator, FileSplitAssigner, Path[], Collection<Path>, long) - Constructor for class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

ContinuousPartitionFetcher<P,T extends Comparable<T>> - Interface in org.apache.flink.connector.file.table

Partition fetcher for helping continuously fetch partitioned table.

ContinuousPartitionFetcher.Context<P,T extends Comparable<T>> - Interface in org.apache.flink.connector.file.table

Context for fetch partitions, partition information is stored in hive meta store.

continuousSourceSettings - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

convertFromUncompacted(Path) - Static method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

convertFromUncompacted(Path) - Static method in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

convertToSourceSplits(FileStatus, FileSystem, List<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveEnumerator

convertToSourceSplits(FileStatus, FileSystem, List<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator

convertToUncompacted(String) - Static method in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

COORDINATOR_OP_NAME - Static variable in class org.apache.flink.connector.file.table.batch.BatchSink

copy() - Method in class org.apache.flink.connector.file.table.FileSystemTableSink

copy() - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

create() - Method in interface org.apache.flink.connector.file.sink.compactor.DecoderBasedReader.Decoder.Factory

create() - Method in interface org.apache.flink.connector.file.src.enumerate.DynamicFileEnumerator.Provider

create() - Method in interface org.apache.flink.connector.file.src.enumerate.FileEnumerator.Provider

create(boolean, OperatorStateStore, Configuration, ClassLoader, List<String>, ProcessingTimeService) - Static method in interface org.apache.flink.connector.file.table.stream.PartitionCommitTrigger

create(ClassLoader, String, String, String, String) - Static method in interface org.apache.flink.connector.file.table.PartitionTimeExtractor

create(URI) - Method in interface org.apache.flink.connector.file.table.FileSystemFactory

Creates a new file system for the given file system URI.

create(Collection<FileSourceSplit>) - Method in interface org.apache.flink.connector.file.src.assigners.FileSplitAssigner.Provider

Creates a new FileSplitAssigner that starts with the given set of initial splits.

create(Configuration, ClassLoader, List<String>) - Static method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate

create(Configuration, FileSystem, String, Path) - Static method in interface org.apache.flink.connector.file.table.stream.compact.CompactContext

create(BulkFormat<T, SplitT>, Long) - Static method in class org.apache.flink.connector.file.table.LimitableBulkFormat

create(PartitionWriter.Context<T>, PartitionTempFileManager, PartitionComputer<T>, PartitionWriter.PartitionWriterListener) - Method in interface org.apache.flink.connector.file.table.PartitionWriterFactory

create(CompactContext) - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactReader.Factory

create(CompactContext) - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactWriter.Factory

create(FSDataOutputStream) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink.ProjectionBulkFactory

createBatchCompactSink(DataStream<CompactMessages.CoordinatorInput>, StreamingFileSink.BucketsBuilder<T, String, ? extends StreamingFileSink.BucketsBuilder<T, String, ?>>, CompactReader.Factory<T>, FileSystemFactory, TableMetaStoreFactory, PartitionCommitPolicyFactory, String[], LinkedHashMap<String, String>, Path, ObjectIdentifier, long, long, boolean, boolean, int, boolean) - Static method in class org.apache.flink.connector.file.table.batch.BatchSink

createBatchNoCompactSink(DataStream<RowData>, DynamicTableSink.DataStructureConverter, FileSystemOutputFormat<Row>, int, boolean) - Static method in class org.apache.flink.connector.file.table.batch.BatchSink

createCommitter(CommitterInitContext) - Method in class org.apache.flink.connector.file.sink.FileSink

createDecodingFormat(DynamicTableFactory.Context, ReadableConfig) - Method in interface org.apache.flink.connector.file.table.factories.BulkReaderFormatFactory

Creates a BulkDecodingFormat from the given context and format options.

createDynamicTableSink(DynamicTableFactory.Context) - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

createDynamicTableSource(DynamicTableFactory.Context) - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

createEnumerator(SplitEnumeratorContext<SplitT>) - Method in class org.apache.flink.connector.file.src.AbstractFileSource

createFor(Path) - Method in class org.apache.flink.connector.file.sink.compactor.DecoderBasedReader.Factory

createFor(Path) - Method in class org.apache.flink.connector.file.sink.compactor.InputFormatBasedReader.Factory

createFor(Path) - Method in interface org.apache.flink.connector.file.sink.compactor.RecordWiseFileCompactor.Reader.Factory

createOrAlterPartition(LinkedHashMap<String, String>, Path) - Method in interface org.apache.flink.connector.file.table.TableMetaStoreFactory.TableMetaStore

After data has been inserted into the partition path, the partition may need to be created (if doesn't exists) or updated.

createOutputFormat(Path) - Method in interface org.apache.flink.connector.file.table.OutputFormatFactory

Create a OutputFormat with specific path.

createPartitionDir(String...) - Method in class org.apache.flink.connector.file.table.PartitionTempFileManager

Generate a new partition directory with partitions.

createPartitionTimeCommitPredicate(Configuration, ClassLoader, List<String>) - Static method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate

createPolicyChain(ClassLoader, Supplier<FileSystem>) - Method in class org.apache.flink.connector.file.table.PartitionCommitPolicyFactory

Create a policy chain.

createPredicateContext(String, long, long, long) - Static method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate

createProcTime() - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate.PredicateContext

Return the creation time of the partition.

createProcTimeCommitPredicate(Configuration) - Static method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate

createReader(SourceReaderContext) - Method in class org.apache.flink.connector.file.src.AbstractFileSource

createReader(Configuration, FileSourceSplit) - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter

createReader(Configuration, FileSourceSplit) - Method in class org.apache.flink.connector.file.table.DeserializationSchemaAdapter

createReader(Configuration, FSDataInputStream) - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat

Creates a new reader.

createReader(Configuration, FSDataInputStream) - Method in class org.apache.flink.connector.file.src.reader.TextLineInputFormat

createReader(Configuration, FSDataInputStream, long, long) - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat

createReader(Configuration, FSDataInputStream, long, long) - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat

Creates a new reader to read in this format.

createReader(Configuration, SplitT) - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat

Creates a new reader that reads from the split's path starting at the split's offset and reads length bytes after the offset.

createReader(Configuration, SplitT) - Method in class org.apache.flink.connector.file.table.LimitableBulkFormat

createSerializer(SerializerConfig) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

createStreamOperator(StreamOperatorParameters<CompactorRequest>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorFactory

createStreamOperator(StreamOperatorParameters<CommittableMessage<FileSinkCommittable>>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorFactory

createStreamOperator(StreamOperatorParameters<CommittableMessage<FileSinkCommittable>>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandlerFactory

createStreamOperator(StreamOperatorParameters<Either<CommittableMessage<FileSinkCommittable>, CompactorRequest>>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorStateHandlerFactory

createTableMetaStore() - Method in class org.apache.flink.connector.file.table.EmptyMetaStoreFactory

createTableMetaStore() - Method in interface org.apache.flink.connector.file.table.TableMetaStoreFactory

Create a TableMetaStoreFactory.TableMetaStore.

createWriter(WriterInitContext) - Method in class org.apache.flink.connector.file.sink.FileSink

currentProcTime() - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate.PredicateContext

Return the current process time.

currentWatermark - Variable in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

currentWatermark() - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate.PredicateContext

Returns the current event-time watermark.

CUSTOM - Static variable in interface org.apache.flink.connector.file.table.PartitionCommitPolicy

CUSTOM - Static variable in interface org.apache.flink.connector.file.table.PartitionTimeExtractor

D

databaseName() - Method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy.Context

Database name of this table.

decodeNext() - Method in interface org.apache.flink.connector.file.sink.compactor.DecoderBasedReader.Decoder

decodeNext() - Method in class org.apache.flink.connector.file.sink.compactor.SimpleStringDecoder

DecoderBasedReader<T> - Class in org.apache.flink.connector.file.sink.compactor

A RecordWiseFileCompactor.Reader implementation that reads the file as an FSDataInputStream and decodes the record with the DecoderBasedReader.Decoder.

DecoderBasedReader(Path, DecoderBasedReader.Decoder<T>) - Constructor for class org.apache.flink.connector.file.sink.compactor.DecoderBasedReader

DecoderBasedReader.Decoder<T> - Interface in org.apache.flink.connector.file.sink.compactor

A DecoderBasedReader.Decoder to decode the file content into the actual records.

DecoderBasedReader.Decoder.Factory<T> - Interface in org.apache.flink.connector.file.sink.compactor

Factory to create DecoderBasedReader.Decoder.

DecoderBasedReader.Factory<T> - Class in org.apache.flink.connector.file.sink.compactor

Factory for DecoderBasedReader.

DEFAULT - Static variable in interface org.apache.flink.connector.file.table.PartitionTimeExtractor

DEFAULT_CHARSET_NAME - Static variable in class org.apache.flink.connector.file.src.reader.TextLineInputFormat

DEFAULT_NON_SPLITTABLE_FILE_ENUMERATOR - Static variable in class org.apache.flink.connector.file.src.FileSource

The default file enumerator used for non-splittable formats.

DEFAULT_SPLIT_ASSIGNER - Static variable in class org.apache.flink.connector.file.src.FileSource

The default split assigner, a lazy locality-aware assigner.

DEFAULT_SPLITTABLE_FILE_ENUMERATOR - Static variable in class org.apache.flink.connector.file.src.FileSource

The default file enumerator used for splittable formats.

DefaultFileFilter - Class in org.apache.flink.connector.file.src.enumerate

A file filter that filters out hidden files based on common naming patterns, i.e., files where the filename starts with '.' or with '_'.

DefaultFileFilter() - Constructor for class org.apache.flink.connector.file.src.enumerate.DefaultFileFilter

DefaultFileWriterBucketFactory<IN> - Class in org.apache.flink.connector.file.sink.writer

A factory returning writer.

DefaultFileWriterBucketFactory() - Constructor for class org.apache.flink.connector.file.sink.writer.DefaultFileWriterBucketFactory

DefaultPartitionWriterListener() - Constructor for class org.apache.flink.connector.file.table.PartitionWriter.DefaultPartitionWriterListener

DefaultPartTimeExtractor - Class in org.apache.flink.connector.file.table

Default PartitionTimeExtractor.

DefaultPartTimeExtractor(String, String) - Constructor for class org.apache.flink.connector.file.table.DefaultPartTimeExtractor

defaultPartValue - Variable in class org.apache.flink.connector.file.table.RowDataPartitionComputer

defaultPartValue - Variable in class org.apache.flink.connector.file.table.RowPartitionComputer

DeserializationSchemaAdapter - Class in org.apache.flink.connector.file.table

Adapter to turn a DeserializationSchema into a BulkFormat.

DeserializationSchemaAdapter(DeserializationSchema<RowData>) - Constructor for class org.apache.flink.connector.file.table.DeserializationSchemaAdapter

deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestSerializer

deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.sink.FileSinkCommittableSerializer

deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketStateSerializer

deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.src.FileSourceSplitSerializer

deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpointSerializer

disableCompact() - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

disableCompact() - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

disableLocalWriting() - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

discoverDecodingFormat(DynamicTableFactory.Context, Class<F>) - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

doCompact(List<Path>, OutputStream) - Method in class org.apache.flink.connector.file.sink.compactor.ConcatFileCompactor

doCompact(List<Path>, OutputStream) - Method in class org.apache.flink.connector.file.sink.compactor.OutputStreamBasedFileCompactor

doCompact(FileSystem, String, List<Path>, Path, Configuration, CompactReader.Factory<T>, CompactWriter.Factory<T>) - Static method in class org.apache.flink.connector.file.table.utils.CompactFileUtils

Do Compaction: - Target file exists, do nothing. - Can do compaction: - Single file, do atomic renaming, there are optimizations for FileSystem. - Multiple file, do reading and writing.

doWithCleanupOnException(Closeable, SupplierWithException<E, IOException>) - Static method in class org.apache.flink.connector.file.src.util.Utils

Runs the given SupplierWithException (a piece of code producing a result).

doWithCleanupOnException(Closeable, ThrowingRunnable<IOException>) - Static method in class org.apache.flink.connector.file.src.util.Utils

Runs the given Runnable.

DynamicFileEnumerator - Interface in org.apache.flink.connector.file.src.enumerate

FileEnumerator that supports dynamic filtering.

DynamicFileEnumerator.Provider - Interface in org.apache.flink.connector.file.src.enumerate

Factory for the DynamicFileEnumerator.

DynamicFileSplitEnumerator<SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src.impl

A SplitEnumerator implementation that supports dynamic filtering.

DynamicFileSplitEnumerator(SplitEnumeratorContext<SplitT>, DynamicFileEnumerator.Provider, FileSplitAssigner.Provider) - Constructor for class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

DynamicPartitionWriter<T> - Class in org.apache.flink.connector.file.table

Dynamic partition writer to writing multiple partitions at the same time, it maybe consumes more memory.

DynamicPartitionWriter(PartitionWriter.Context<T>, PartitionTempFileManager, PartitionComputer<T>) - Constructor for class org.apache.flink.connector.file.table.DynamicPartitionWriter

DynamicPartitionWriter(PartitionWriter.Context<T>, PartitionTempFileManager, PartitionComputer<T>, PartitionWriter.PartitionWriterListener) - Constructor for class org.apache.flink.connector.file.table.DynamicPartitionWriter

E

EmptyMetaStoreFactory - Class in org.apache.flink.connector.file.table

Empty implementation TableMetaStoreFactory.

EmptyMetaStoreFactory(Path) - Constructor for class org.apache.flink.connector.file.table.EmptyMetaStoreFactory

enableCompact(FileCompactStrategy, FileCompactor) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

enableCompact(FileCompactStrategy, FileCompactor) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

enableCompactionOnCheckpoint(int) - Method in class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy.Builder

Optional, compaction will be triggered when N checkpoints passed since the last triggering, -1 by default indicating no compaction on checkpoint.

encode(RowData, OutputStream) - Method in class org.apache.flink.connector.file.table.SerializationSchemaAdapter

EndCheckpoint(long, int, int) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactMessages.EndCheckpoint

EndCompaction(long) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactMessages.EndCompaction

endInput() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinator

endInput() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorStateHandler

endInput() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

endInput() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandler

endInput() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactCoordinator

endInput() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

endInput() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchFileWriter

endInput() - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

endInput() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

endInput() - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitTrigger

End input, return committable partitions and clear.

endInput() - Method in class org.apache.flink.connector.file.table.stream.PartitionTimeCommitTrigger

endInput() - Method in class org.apache.flink.connector.file.table.stream.ProcTimeCommitTrigger

EnrichedRowData - Class in org.apache.flink.connector.file.table

An implementation of RowData which is backed by two RowData with a well-defined index mapping, One of the rows is fixed, while the other can be swapped for performant changes in hot code paths.

EnrichedRowData(RowData, int[]) - Constructor for class org.apache.flink.connector.file.table.EnrichedRowData

enumerateSplits(Path[], int) - Method in interface org.apache.flink.connector.file.src.enumerate.FileEnumerator

Generates all file splits for the relevant files under the given paths.

enumerateSplits(Path[], int) - Method in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator

equals(Object) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

equals(Object) - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

equals(Object) - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition

equals(Object) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

extract(List<String>, List<String>) - Method in class org.apache.flink.connector.file.table.DefaultPartTimeExtractor

extract(List<String>, List<String>) - Method in interface org.apache.flink.connector.file.table.PartitionTimeExtractor

Extract time from partition keys and values.

extract(T, String, LogicalType) - Method in interface org.apache.flink.connector.file.table.PartitionFieldExtractor

F

factory(FileInputFormat<T>) - Static method in class org.apache.flink.connector.file.table.stream.compact.FileInputFormatCompactReader

factory(BulkFormat<T, FileSourceSplit>) - Static method in class org.apache.flink.connector.file.table.stream.compact.CompactBulkReader

factory(SupplierWithException<BucketWriter<T, String>, IOException>) - Static method in class org.apache.flink.connector.file.table.stream.compact.CompactBucketWriter

Factory(DecoderBasedReader.Decoder.Factory<T>) - Constructor for class org.apache.flink.connector.file.sink.compactor.DecoderBasedReader.Factory

Factory(SerializableSupplierWithException<FileInputFormat<T>, IOException>) - Constructor for class org.apache.flink.connector.file.sink.compactor.InputFormatBasedReader.Factory

factoryIdentifier() - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

fetch(PartitionFetcher.Context<P>) - Method in interface org.apache.flink.connector.file.table.PartitionFetcher

Fetch the suitable partitions, call this method should guarantee the fetcher has opened.

FETCH_IO_SIZE - Static variable in interface org.apache.flink.connector.file.src.reader.StreamFormat

The config option to define how many bytes to be read by the I/O thread in one fetch operation.

fetchPartitions(ContinuousPartitionFetcher.Context<P, T>, T) - Method in interface org.apache.flink.connector.file.table.ContinuousPartitionFetcher

Fetch partitions by previous partition offset (Including).

FileCommitter - Class in org.apache.flink.connector.file.sink.committer

Committer implementation for FileSink.

FileCommitter(BucketWriter<?, ?>) - Constructor for class org.apache.flink.connector.file.sink.committer.FileCommitter

FileCompactor - Interface in org.apache.flink.connector.file.sink.compactor

The FileCompactor is responsible for compacting files into one file.

FileCompactStrategy - Class in org.apache.flink.connector.file.sink.compactor

Strategy for compacting the files written in FileSink before committing.

FileCompactStrategy.Builder - Class in org.apache.flink.connector.file.sink.compactor

Builder for FileCompactStrategy.

fileEnumerator - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

FileEnumerator - Interface in org.apache.flink.connector.file.src.enumerate

The FileEnumerator's task is to discover all files to be read and to split them into a set of FileSourceSplit.

FileEnumerator.Provider - Interface in org.apache.flink.connector.file.src.enumerate

Factory for the FileEnumerator, to allow the FileEnumerator to be eagerly initialized and to not be serializable.

fileFilter - Variable in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator

The filter predicate to filter out unwanted files.

FileInputFormatCompactReader<T> - Class in org.apache.flink.connector.file.table.stream.compact

The CompactReader to delegate FileInputFormat.

fileModificationTime() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

Returns the modification time of the file, from FileStatus.getModificationTime().

FileRecords<T> - Class in org.apache.flink.connector.file.src.impl

A collection of records for one file split.

FileSink<IN> - Class in org.apache.flink.connector.file.sink

A unified sink that emits its input elements to FileSystem files within buckets.

FileSink.BulkFormatBuilder<IN,T extends FileSink.BulkFormatBuilder<IN,T>> - Class in org.apache.flink.connector.file.sink

A builder for configuring the sink for bulk-encoding formats, e.g.

FileSink.DefaultBulkFormatBuilder<IN> - Class in org.apache.flink.connector.file.sink

Builder for the vanilla FileSink using a bulk format.

FileSink.DefaultRowFormatBuilder<IN> - Class in org.apache.flink.connector.file.sink

Builder for the vanilla FileSink using a row format.

FileSink.RowFormatBuilder<IN,T extends FileSink.RowFormatBuilder<IN,T>> - Class in org.apache.flink.connector.file.sink

A builder for configuring the sink for row-wise encoding formats.

FileSinkCommittable - Class in org.apache.flink.connector.file.sink

Wrapper class for both type of committables in FileSink.

FileSinkCommittable(String, Path) - Constructor for class org.apache.flink.connector.file.sink.FileSinkCommittable

FileSinkCommittable(String, InProgressFileWriter.InProgressFileRecoverable) - Constructor for class org.apache.flink.connector.file.sink.FileSinkCommittable

FileSinkCommittable(String, InProgressFileWriter.PendingFileRecoverable) - Constructor for class org.apache.flink.connector.file.sink.FileSinkCommittable

FileSinkCommittableSerializer - Class in org.apache.flink.connector.file.sink

Versioned serializer for FileSinkCommittable.

FileSinkCommittableSerializer(SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable>, SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable>) - Constructor for class org.apache.flink.connector.file.sink.FileSinkCommittableSerializer

fileSize() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

Returns the full file size in bytes, from FileStatus.getLen().

FileSource<T> - Class in org.apache.flink.connector.file.src

A unified data source that reads files - both in batch and in streaming mode.

FileSource.FileSourceBuilder<T> - Class in org.apache.flink.connector.file.src

The builder for the FileSource, to configure the various behaviors.

FileSourceReader<T,SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src.impl

A SourceReader that read records from FileSourceSplit.

FileSourceReader(SourceReaderContext, BulkFormat<T, SplitT>, Configuration) - Constructor for class org.apache.flink.connector.file.src.impl.FileSourceReader

FileSourceSplit - Class in org.apache.flink.connector.file.src

A SourceSplit that represents a file, or a region of a file.

FileSourceSplit(String, Path, long, long, long, long) - Constructor for class org.apache.flink.connector.file.src.FileSourceSplit

Constructs a split with host information.

FileSourceSplit(String, Path, long, long, long, long, String...) - Constructor for class org.apache.flink.connector.file.src.FileSourceSplit

Constructs a split with host information.

FileSourceSplit(String, Path, long, long, long, long, String[], CheckpointedPosition) - Constructor for class org.apache.flink.connector.file.src.FileSourceSplit

Constructs a split with host information.

FileSourceSplitSerializer - Class in org.apache.flink.connector.file.src

A serializer for the FileSourceSplit.

FileSourceSplitSerializer() - Constructor for class org.apache.flink.connector.file.src.FileSourceSplitSerializer

FileSourceSplitState<SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src

State of the reader, essentially a mutable version of the FileSourceSplit.

FileSourceSplitState(SplitT) - Constructor for class org.apache.flink.connector.file.src.FileSourceSplitState

FileSplitAssigner - Interface in org.apache.flink.connector.file.src.assigners

The FileSplitAssigner is responsible for deciding what split should be processed next by which node.

FileSplitAssigner.Provider - Interface in org.apache.flink.connector.file.src.assigners

Factory for the FileSplitAssigner, to allow the FileSplitAssigner to be eagerly initialized and to not be serializable.

FileSystemCommitter - Class in org.apache.flink.connector.file.table

File system file committer implementation.

FileSystemCommitter(FileSystemFactory, TableMetaStoreFactory, boolean, Path, int, boolean, ObjectIdentifier, LinkedHashMap<String, String>, List<PartitionCommitPolicy>) - Constructor for class org.apache.flink.connector.file.table.FileSystemCommitter

FileSystemConnectorOptions - Class in org.apache.flink.connector.file.table

Options for the filesystem connector.

FileSystemConnectorOptions.FileStatisticsType - Enum in org.apache.flink.connector.file.table

Statistics types for file system, see FileSystemConnectorOptions.SOURCE_REPORT_STATISTICS.

FileSystemConnectorOptions.PartitionCommitTriggerType - Enum in org.apache.flink.connector.file.table

Trigger types for partition commit, see FileSystemConnectorOptions.SINK_PARTITION_COMMIT_TRIGGER.

FileSystemFactory - Interface in org.apache.flink.connector.file.table

A factory to create file systems.

FileSystemOutputFormat<T> - Class in org.apache.flink.connector.file.table

File system OutputFormat for batch job.

FileSystemOutputFormat.Builder<T> - Class in org.apache.flink.connector.file.table

Builder to build FileSystemOutputFormat.

FileSystemTableFactory - Class in org.apache.flink.connector.file.table

File system TableFactory.

FileSystemTableFactory() - Constructor for class org.apache.flink.connector.file.table.FileSystemTableFactory

FileSystemTableSink - Class in org.apache.flink.connector.file.table

File system DynamicTableSink.

FileSystemTableSink.ProjectionBulkFactory - Class in org.apache.flink.connector.file.table

Project row to non-partition fields.

FileSystemTableSink.TableBucketAssigner - Class in org.apache.flink.connector.file.table

Table bucket assigner, wrap PartitionComputer.

FileSystemTableSink.TableRollingPolicy - Class in org.apache.flink.connector.file.table

Table RollingPolicy, it extends CheckpointRollingPolicy for bulk writers.

FileSystemTableSource - Class in org.apache.flink.connector.file.table

File system table source.

FileSystemTableSource(ObjectIdentifier, DataType, List<String>, ReadableConfig, DecodingFormat<BulkFormat<RowData, FileSourceSplit>>, DecodingFormat<DeserializationSchema<RowData>>) - Constructor for class org.apache.flink.connector.file.table.FileSystemTableSource

FileWriter<IN> - Class in org.apache.flink.connector.file.sink.writer

A SinkWriter implementation for FileSink.

FileWriter(Path, SinkWriterMetricGroup, BucketAssigner<IN, String>, FileWriterBucketFactory<IN>, BucketWriter<IN, String>, RollingPolicy<IN, String>, OutputFileConfig, ProcessingTimeService, long) - Constructor for class org.apache.flink.connector.file.sink.writer.FileWriter

A constructor creating a new empty bucket manager.

FileWriterBucketFactory<IN> - Interface in org.apache.flink.connector.file.sink.writer

A factory able to create FileWriterBucket for the FileSink.

FileWriterBucketState - Class in org.apache.flink.connector.file.sink.writer

States for FileWriterBucket.

FileWriterBucketState(String, Path, long, InProgressFileWriter.InProgressFileRecoverable) - Constructor for class org.apache.flink.connector.file.sink.writer.FileWriterBucketState

FileWriterBucketState(String, Path, long, InProgressFileWriter.InProgressFileRecoverable, Map<Long, List<InProgressFileWriter.PendingFileRecoverable>>) - Constructor for class org.apache.flink.connector.file.sink.writer.FileWriterBucketState

FileWriterBucketStateSerializer - Class in org.apache.flink.connector.file.sink.writer

A SimpleVersionedSerializer used to serialize the BucketState.

FileWriterBucketStateSerializer(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable>, SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable>) - Constructor for class org.apache.flink.connector.file.sink.writer.FileWriterBucketStateSerializer

finalizeGlobal(FinalizeOnMaster.FinalizationContext) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat

finish() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchPartitionCommitterSink

finishedSplit(String) - Static method in class org.apache.flink.connector.file.src.impl.FileRecords

finishedSplits() - Method in class org.apache.flink.connector.file.src.impl.FileRecords

finishWritingTable(Path) - Method in interface org.apache.flink.connector.file.table.TableMetaStoreFactory.TableMetaStore

After data has been inserted into table, some follow-up works related to metastore may need be done like report statistic to metastore.

flush(boolean) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter

forBulkFileFormat(BulkFormat<T, FileSourceSplit>, Path...) - Static method in class org.apache.flink.connector.file.src.FileSource

Builds a new FileSource using a BulkFormat to read batches of records from files.

forBulkFormat(Path, BulkWriter.Factory<IN>) - Static method in class org.apache.flink.connector.file.sink.FileSink

forEachRemaining(BulkFormat.Reader<T>, Consumer<? super T>) - Static method in class org.apache.flink.connector.file.src.util.Utils

Performs the given action for each remaining element in BulkFormat.Reader until all elements have been processed or the action throws an exception.

forFileSystem(String) - Static method in interface org.apache.flink.connector.file.table.PartitionFieldExtractor

forRecords(String, BulkFormat.RecordIterator<T>) - Static method in class org.apache.flink.connector.file.src.impl.FileRecords

forRecordStreamFormat(StreamFormat<T>, Path...) - Static method in class org.apache.flink.connector.file.src.FileSource

Builds a new FileSource using a StreamFormat to read record-by-record from a file stream.

forRowFormat(Path, Encoder<IN>) - Static method in class org.apache.flink.connector.file.sink.FileSink

forwardOptions() - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

from(RowData, List<String>, List<String>, List<String>) - Static method in class org.apache.flink.connector.file.table.EnrichedRowData

Creates a new EnrichedRowData with the provided fixedRow as the immutable static row, and uses the producedRowFields, fixedRowFields and mutableRowFields arguments to compute the indexes mapping.

fromCollectionSnapshot(Collection<T>) - Static method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint

fromCollectionSnapshot(Collection<T>, Collection<Path>) - Static method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint

G

generatePartValues(RowData) - Method in class org.apache.flink.connector.file.table.RowDataPartitionComputer

generatePartValues(Row) - Method in class org.apache.flink.connector.file.table.RowPartitionComputer

generatePartValues(T) - Method in interface org.apache.flink.connector.file.table.PartitionComputer

Compute partition values from record.

get(boolean, boolean, LinkedHashMap<String, String>) - Static method in interface org.apache.flink.connector.file.table.PartitionWriterFactory

Util for get a PartitionWriterFactory.

getAllTasksFuture() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

getAlreadyProcessedPaths() - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint

getArity() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

getArity() - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getArray(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getAssignerFactory() - Method in class org.apache.flink.connector.file.src.AbstractFileSource

getBinary(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getBoolean(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getBoundedness() - Method in class org.apache.flink.connector.file.src.AbstractFileSource

getBucketId() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequest

getBucketId() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

getBucketId() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState

getBucketId(RowData, BucketAssigner.Context) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink.TableBucketAssigner

getBucketPath() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState

getByte(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getChangelogMode() - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

getChangelogMode(ChangelogMode) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink

getCheckpointedPosition() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat.Reader

Optionally returns the current position of the reader.

getCheckpointId() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.EndCheckpoint

getCheckpointId() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.EndCompaction

getCheckpointId() - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

getCommittableSerializer() - Method in class org.apache.flink.connector.file.sink.FileSink

getCommittableToCompact() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequest

getCommittableToPassthrough() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequest

getCommonSuffixes() - Static method in class org.apache.flink.connector.file.src.compression.StandardDeCompressors

Gets all common file extensions of supported file compression formats.

getCompactedFiles() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.CompactOutput

getCompactedFileToCleanup() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

getComparablePartitionValueList() - Method in interface org.apache.flink.connector.file.table.PartitionFetcher.Context

Get list that contains partition with comparable object.

getComparator() - Method in interface org.apache.flink.connector.file.table.PartitionFetcher.Context.ComparablePartitionValue

Get the comparator.

getCompatibleWriterStateNames() - Method in class org.apache.flink.connector.file.sink.FileSink

getConfig() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactContext.CompactContextImpl

getConfig() - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactContext

getConsumeStartOffset() - Method in interface org.apache.flink.connector.file.table.ContinuousPartitionFetcher.Context

Get the partition consume start offset.

getContinuousEnumerationSettings() - Method in class org.apache.flink.connector.file.src.AbstractFileSource

getDecimal(int, int, int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getDecompressorForExtension(String) - Static method in class org.apache.flink.connector.file.src.compression.StandardDeCompressors

Gets the decompressor for a file extension.

getDecompressorForFileName(String) - Static method in class org.apache.flink.connector.file.src.compression.StandardDeCompressors

Gets the decompressor for a file name.

getDescription() - Method in enum org.apache.flink.connector.file.table.FileSystemConnectorOptions.FileStatisticsType

getDescription() - Method in enum org.apache.flink.connector.file.table.FileSystemConnectorOptions.PartitionCommitTriggerType

getDiscoveryInterval() - Method in class org.apache.flink.connector.file.src.ContinuousEnumerationSettings

getDouble(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getEnumeratorCheckpointSerializer() - Method in class org.apache.flink.connector.file.src.AbstractFileSource

getEnumeratorFactory() - Method in class org.apache.flink.connector.file.src.AbstractFileSource

getFile() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.InputFile

getFileSystem() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactContext.CompactContextImpl

getFileSystem() - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactContext

getFloat(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getInProgressFileCreationTime() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState

getInProgressFileToCleanup() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

getInt(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getLimit() - Method in class org.apache.flink.connector.file.table.LimitableBulkFormat

getLocationPath() - Method in interface org.apache.flink.connector.file.table.TableMetaStoreFactory.TableMetaStore

Deprecated.

getLong(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getMap(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getNewBucket(String, Path, BucketWriter<IN, String>, RollingPolicy<IN, String>, OutputFileConfig) - Method in class org.apache.flink.connector.file.sink.writer.DefaultFileWriterBucketFactory

getNewBucket(String, Path, BucketWriter<IN, String>, RollingPolicy<IN, String>, OutputFileConfig) - Method in interface org.apache.flink.connector.file.sink.writer.FileWriterBucketFactory

getNext(String) - Method in interface org.apache.flink.connector.file.src.assigners.FileSplitAssigner

Gets the next split.

getNext(String) - Method in class org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner

getNext(String) - Method in class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner

getNextId() - Method in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator

getNumberOfTasks() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.EndCheckpoint

getNumberOfTasks() - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

getNumCheckpointsBeforeCompaction() - Method in class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy

getNumCompactThreads() - Method in class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy

getOffset() - Method in class org.apache.flink.connector.file.src.FileSourceSplitState

getOffset() - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition

Gets the offset that the reader will seek to when restored from this checkpoint.

getOffset() - Method in class org.apache.flink.connector.file.src.util.RecordAndPosition

getPartition() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactContext.CompactContextImpl

getPartition() - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactContext

getPartition() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.CompactionUnit

getPartition() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.InputFile

getPartition(LinkedHashMap<String, String>) - Method in interface org.apache.flink.connector.file.table.TableMetaStoreFactory.TableMetaStore

Get partition location path for this partition spec.

getPartition(List<String>) - Method in interface org.apache.flink.connector.file.table.PartitionFetcher.Context

Get partition by file partition values.

getPartitions() - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

getPartitionValue() - Method in interface org.apache.flink.connector.file.table.PartitionFetcher.Context.ComparablePartitionValue

Get the partition value.

getPath() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactContext.CompactContextImpl

getPath() - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactContext

getPaths() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.CompactionUnit

getPendingFile() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

getPendingFileRecoverablesPerCheckpoint() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState

getProducedType() - Method in class org.apache.flink.connector.file.src.AbstractFileSource

getProducedType() - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter

getProducedType() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat

Gets the type produced by this format.

getProducedType() - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat

Gets the type produced by this format.

getProducedType() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat

Gets the type produced by this format.

getProducedType() - Method in class org.apache.flink.connector.file.src.reader.TextLineInputFormat

getProducedType() - Method in class org.apache.flink.connector.file.table.DeserializationSchemaAdapter

getProducedType() - Method in class org.apache.flink.connector.file.table.LimitableBulkFormat

getRawValue(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getReaderPosition() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

Gets the (checkpointed) position of the reader, if set.

getRecord() - Method in class org.apache.flink.connector.file.src.util.RecordAndPosition

getRecordsAfterOffset() - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition

Gets the records to skip after the offset.

getRecordSkipCount() - Method in class org.apache.flink.connector.file.src.util.RecordAndPosition

getRecordsToSkipAfterOffset() - Method in class org.apache.flink.connector.file.src.FileSourceSplitState

getRow(int, int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getRowKind() - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getScanRuntimeProvider(ScanTableSource.ScanContext) - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

getSerializer() - Method in class org.apache.flink.connector.file.table.FileSystemTableSink.TableBucketAssigner

getShort(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getSinkRuntimeProvider(DynamicTableSink.Context) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink

getSizeThreshold() - Method in class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy

getSplits() - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint

getSplitSerializer() - Method in class org.apache.flink.connector.file.src.AbstractFileSource

getSplitSerializer() - Method in class org.apache.flink.connector.file.src.FileSource

getStreamOperatorClass(ClassLoader) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorFactory

getStreamOperatorClass(ClassLoader) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorStateHandlerFactory

getStreamOperatorClass(ClassLoader) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorFactory

getStreamOperatorClass(ClassLoader) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandlerFactory

getString(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getTablePath() - Method in interface org.apache.flink.connector.file.table.ContinuousPartitionFetcher.Context

The table full path.

getTaskId() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.EndCheckpoint

getTaskId() - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

getTimestamp(int, int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getTotalFields() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

getTypeClass() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

getTypeSerializer() - Method in interface org.apache.flink.connector.file.table.ContinuousPartitionFetcher.Context

Get the Serializer of partition order.

getUnitId() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.CompactionUnit

getVariant(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

getVersion() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestSerializer

getVersion() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittableSerializer

getVersion() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketStateSerializer

getVersion() - Method in class org.apache.flink.connector.file.src.FileSourceSplitSerializer

getVersion() - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpointSerializer

getWriteResultSerializer() - Method in class org.apache.flink.connector.file.sink.FileSink

getWriterStateSerializer() - Method in class org.apache.flink.connector.file.sink.FileSink

GroupedPartitionWriter<T> - Class in org.apache.flink.connector.file.table

PartitionWriter for grouped dynamic partition inserting.

GroupedPartitionWriter(PartitionWriter.Context<T>, PartitionTempFileManager, PartitionComputer<T>) - Constructor for class org.apache.flink.connector.file.table.GroupedPartitionWriter

GroupedPartitionWriter(PartitionWriter.Context<T>, PartitionTempFileManager, PartitionComputer<T>, PartitionWriter.PartitionWriterListener) - Constructor for class org.apache.flink.connector.file.table.GroupedPartitionWriter

H

handleSourceEvent(int, int, SourceEvent) - Method in class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

handleSourceEvent(int, SourceEvent) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

handleSourceEvent(int, SourceEvent) - Method in class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

handleSourceEvent(int, SourceEvent) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator

handleSplitRequest(int, String) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

handleSplitRequest(int, String) - Method in class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

handleSplitRequest(int, String) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator

hasCompactedFileToCleanup() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

hashCode() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

hashCode() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

hashCode() - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition

hashCode() - Method in class org.apache.flink.connector.file.table.EnrichedRowData

hasInProgressFileToCleanup() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

hasPendingFile() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

hostnames() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

Gets the hostnames of the nodes storing the file range described by this split.

I

IdenticalFileCompactor - Class in org.apache.flink.connector.file.sink.compactor

A simple OutputStreamBasedFileCompactor implementation that directly copy the content of the only input file to the output.

IdenticalFileCompactor() - Constructor for class org.apache.flink.connector.file.sink.compactor.IdenticalFileCompactor

IDENTIFIER - Static variable in class org.apache.flink.connector.file.table.FileSystemTableFactory

inferParallelism(DynamicParallelismInference.Context) - Method in class org.apache.flink.connector.file.src.FileSource

initializedState(SplitT) - Method in class org.apache.flink.connector.file.src.impl.FileSourceReader

initializeState(Collection<FileWriterBucketState>) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter

Initializes the state after recovery from a failure.

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinator

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorStateHandler

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandler

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactCoordinator

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitter

initializeState(StateInitializationContext) - Method in class org.apache.flink.connector.file.table.stream.StreamingFileWriter

InputFile(String, Path) - Constructor for class org.apache.flink.connector.file.table.stream.compact.CompactMessages.InputFile

InputFormatBasedReader<T> - Class in org.apache.flink.connector.file.sink.compactor

A RecordWiseFileCompactor.Reader implementation that reads the file using the FileInputFormat.

InputFormatBasedReader(Path, FileInputFormat<T>) - Constructor for class org.apache.flink.connector.file.sink.compactor.InputFormatBasedReader

InputFormatBasedReader.Factory<T> - Class in org.apache.flink.connector.file.sink.compactor

Factory for InputFormatBasedReader.

inputPaths - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

INSTANCE - Static variable in class org.apache.flink.connector.file.src.FileSourceSplitSerializer

invoke(CompactMessages.CompactOutput, SinkFunction.Context) - Method in class org.apache.flink.connector.file.table.batch.compact.BatchPartitionCommitterSink

isBasicType() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

isFileSplittable(Path) - Method in class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveEnumerator

isKeyType() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

isNullAt(int) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

isPartitionCommittable(PartitionCommitPredicate.PredicateContext) - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate

isPartitionCommittable(PartitionCommitPredicate.PredicateContext) - Method in class org.apache.flink.connector.file.table.stream.PartitionTimeCommitPredicate

isPartitionCommittable(PartitionCommitPredicate.PredicateContext) - Method in class org.apache.flink.connector.file.table.stream.ProcTimeCommitPredicate

isSplittable() - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter

isSplittable() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat

Checks whether this format is splittable.

isSplittable() - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat

This format is always not splittable.

isSplittable() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat

Checks whether this format is splittable.

isSplittable() - Method in class org.apache.flink.connector.file.table.DeserializationSchemaAdapter

isSplittable() - Method in class org.apache.flink.connector.file.table.LimitableBulkFormat

isTaskMessage(int, int) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactMessages.CompactionUnit

isTupleType() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

IteratorResultIterator<E> - Class in org.apache.flink.connector.file.src.util

A simple BulkFormat.RecordIterator that returns the elements of an iterator, augmented with position information.

IteratorResultIterator(Iterator<E>, long, long) - Constructor for class org.apache.flink.connector.file.src.util.IteratorResultIterator

Creates a new RecordIterator returning the records from the given iterator, augmented with their position information.

IteratorResultIterator(Iterator<E>, long, long, Runnable) - Constructor for class org.apache.flink.connector.file.src.util.IteratorResultIterator

Creates a new RecordIterator returning the records from the given iterator, augmented with their position information.

L

length() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

Returns the number of bytes in the file region described by this source split.

LimitableBulkFormat<T,SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.table

A BulkFormat that can limit output record number.

listPartitions() - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

listReadableMetadata() - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

listTaskTemporaryPaths(FileSystem, Path, BiPredicate<Integer, Integer>) - Static method in class org.apache.flink.connector.file.table.PartitionTempFileManager

Returns task temporary paths in this checkpoint.

loadEmptyPartition(LinkedHashMap<String, String>) - Method in class org.apache.flink.connector.file.table.PartitionLoader

The flink job does not write data to the partition, but the corresponding partition needs to be created or updated.

loadNonPartition(List<Path>, boolean) - Method in class org.apache.flink.connector.file.table.PartitionLoader

Load a non-partition files to output path.

loadPartition(LinkedHashMap<String, String>, List<Path>, boolean) - Method in class org.apache.flink.connector.file.table.PartitionLoader

Load a single partition.

LocalityAwareSplitAssigner - Class in org.apache.flink.connector.file.src.assigners

A FileSplitAssigner that assigns to each host preferably splits that are local, before assigning splits that are not local.

LocalityAwareSplitAssigner(Collection<FileSourceSplit>) - Constructor for class org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner

M

map(I) - Method in interface org.apache.flink.connector.file.src.util.RecordMapperWrapperRecordIterator.RecordMapper

Map the record.

METASTORE - Static variable in interface org.apache.flink.connector.file.table.PartitionCommitPolicy

MetastoreCommitPolicy - Class in org.apache.flink.connector.file.table

Partition commit policy to update metastore.

MetastoreCommitPolicy() - Constructor for class org.apache.flink.connector.file.table.MetastoreCommitPolicy

monitorContinuously(Duration) - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

Sets this source to streaming ("continuous monitoring") mode.

MutableRecordAndPosition<E> - Class in org.apache.flink.connector.file.src.util

A mutable version of the RecordAndPosition.

MutableRecordAndPosition() - Constructor for class org.apache.flink.connector.file.src.util.MutableRecordAndPosition

N

newBuilder() - Static method in class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy.Builder

next() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator

Gets the next record from the file, together with its position.

next() - Method in class org.apache.flink.connector.file.src.util.ArrayResultIterator

next() - Method in class org.apache.flink.connector.file.src.util.IteratorResultIterator

next() - Method in class org.apache.flink.connector.file.src.util.RecordMapperWrapperRecordIterator

next() - Method in class org.apache.flink.connector.file.src.util.SingletonResultIterator

next() - Method in class org.apache.flink.connector.file.table.ColumnarRowIterator

nextRecordFromSplit() - Method in class org.apache.flink.connector.file.src.impl.FileRecords

nextSplit() - Method in class org.apache.flink.connector.file.src.impl.FileRecords

NO_OFFSET - Static variable in class org.apache.flink.connector.file.src.util.CheckpointedPosition

Constant for the offset, reflecting that the position does not contain any offset information.

NO_OFFSET - Static variable in class org.apache.flink.connector.file.src.util.RecordAndPosition

Constant for the offset, reflecting that the position does not contain any offset information.

NONE - org.apache.flink.connector.file.table.FileSystemConnectorOptions.FileStatisticsType

nonPartitionFieldGetters - Variable in class org.apache.flink.connector.file.table.RowDataPartitionComputer

NonSplittingRecursiveAllDirEnumerator - Class in org.apache.flink.connector.file.src.enumerate

This FileEnumerator enumerates all files under the given paths recursively except the hidden directories.

NonSplittingRecursiveAllDirEnumerator(String) - Constructor for class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveAllDirEnumerator

Creates a NonSplittingRegexEnumerator that enumerates all files whose file path matches the regex except hidden files.

NonSplittingRecursiveAllDirEnumerator(Predicate<Path>) - Constructor for class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveAllDirEnumerator

Creates a NonSplittingRegexEnumerator that enumerates all files whose file path matches the regex.

NonSplittingRecursiveEnumerator - Class in org.apache.flink.connector.file.src.enumerate

This FileEnumerator enumerates all files under the given paths recursively.

NonSplittingRecursiveEnumerator() - Constructor for class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator

Creates a NonSplittingRecursiveEnumerator that enumerates all files except hidden files.

NonSplittingRecursiveEnumerator(Predicate<Path>) - Constructor for class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator

Creates a NonSplittingRecursiveEnumerator that uses the given predicate as a filter for file paths.

notifyCheckpointComplete(long) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

notifyCheckpointComplete(long) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

notifyCheckpointComplete(long) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

O

offset() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

Returns the start of the file region referenced by this source split.

onFileOpened(String, Path) - Method in class org.apache.flink.connector.file.table.PartitionWriter.DefaultPartitionWriterListener

onFileOpened(String, Path) - Method in interface org.apache.flink.connector.file.table.PartitionWriter.PartitionWriterListener

Notifies a new file has been opened.

onPartFileOpened(String, Path) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

Notifies a new file has been opened.

onPartFileOpened(String, Path) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactFileWriter

onPartFileOpened(String, Path) - Method in class org.apache.flink.connector.file.table.stream.StreamingFileWriter

onProcessingTime(long) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter

onSplitFinished(Map<String, FileSourceSplitState<SplitT>>) - Method in class org.apache.flink.connector.file.src.impl.FileSourceReader

open() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

open() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandler

open() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactService

open() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactCoordinator

open() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

open() - Method in class org.apache.flink.connector.file.table.batch.compact.BatchFileWriter

open() - Method in interface org.apache.flink.connector.file.table.PartitionFetcher.Context

open the resources of the Context, this method should first call before call other methods.

open(InputStream) - Method in interface org.apache.flink.connector.file.sink.compactor.DecoderBasedReader.Decoder

Prepares to start decoding the input stream.

open(InputStream) - Method in class org.apache.flink.connector.file.sink.compactor.SimpleStringDecoder

open(List<P>) - Method in interface org.apache.flink.connector.file.table.PartitionReader

Opens the reader with given partitions.

open(OpenContext) - Method in class org.apache.flink.connector.file.table.batch.compact.BatchPartitionCommitterSink

open(OutputFormat.InitializationContext) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat

optionalOptions() - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

org.apache.flink.connector.file.sink - package org.apache.flink.connector.file.sink

org.apache.flink.connector.file.sink.committer - package org.apache.flink.connector.file.sink.committer

org.apache.flink.connector.file.sink.compactor - package org.apache.flink.connector.file.sink.compactor

org.apache.flink.connector.file.sink.compactor.operator - package org.apache.flink.connector.file.sink.compactor.operator

org.apache.flink.connector.file.sink.writer - package org.apache.flink.connector.file.sink.writer

org.apache.flink.connector.file.src - package org.apache.flink.connector.file.src

org.apache.flink.connector.file.src.assigners - package org.apache.flink.connector.file.src.assigners

org.apache.flink.connector.file.src.compression - package org.apache.flink.connector.file.src.compression

org.apache.flink.connector.file.src.enumerate - package org.apache.flink.connector.file.src.enumerate

org.apache.flink.connector.file.src.impl - package org.apache.flink.connector.file.src.impl

org.apache.flink.connector.file.src.reader - package org.apache.flink.connector.file.src.reader

org.apache.flink.connector.file.src.util - package org.apache.flink.connector.file.src.util

org.apache.flink.connector.file.table - package org.apache.flink.connector.file.table

org.apache.flink.connector.file.table.batch - package org.apache.flink.connector.file.table.batch

org.apache.flink.connector.file.table.batch.compact - package org.apache.flink.connector.file.table.batch.compact

org.apache.flink.connector.file.table.factories - package org.apache.flink.connector.file.table.factories

org.apache.flink.connector.file.table.format - package org.apache.flink.connector.file.table.format

org.apache.flink.connector.file.table.stream - package org.apache.flink.connector.file.table.stream

org.apache.flink.connector.file.table.stream.compact - package org.apache.flink.connector.file.table.stream.compact

org.apache.flink.connector.file.table.utils - package org.apache.flink.connector.file.table.utils

OutputFormatFactory<T> - Interface in org.apache.flink.connector.file.table

A factory to create an OutputFormat.

OutputStreamBasedFileCompactor - Class in org.apache.flink.connector.file.sink.compactor

Base class for FileCompactor implementations that write the compacting file by a output stream.

OutputStreamBasedFileCompactor() - Constructor for class org.apache.flink.connector.file.sink.compactor.OutputStreamBasedFileCompactor

P

pack(Iterable<T>, Function<T, Long>, long) - Static method in class org.apache.flink.connector.file.table.BinPacking

partition() - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitPredicate.PredicateContext

Return the partition.

PARTITION_DEFAULT_NAME - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

PARTITION_TIME - org.apache.flink.connector.file.table.FileSystemConnectorOptions.PartitionCommitTriggerType

PARTITION_TIME_EXTRACTOR_CLASS - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

PARTITION_TIME_EXTRACTOR_KIND - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

PARTITION_TIME_EXTRACTOR_TIMESTAMP_FORMATTER - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

PARTITION_TIME_EXTRACTOR_TIMESTAMP_PATTERN - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

partitionColumns - Variable in class org.apache.flink.connector.file.table.RowDataPartitionComputer

partitionColumns - Variable in class org.apache.flink.connector.file.table.RowPartitionComputer

PartitionCommitInfo - Class in org.apache.flink.connector.file.table.stream

The message sent by upstream.

PartitionCommitInfo() - Constructor for class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

PartitionCommitInfo(long, int, int, String[]) - Constructor for class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

PartitionCommitPolicy - Interface in org.apache.flink.connector.file.table

Policy for commit a partition.

PartitionCommitPolicy.Context - Interface in org.apache.flink.connector.file.table

Context of policy, including table information and partition information.

PartitionCommitPolicyFactory - Class in org.apache.flink.connector.file.table

A factory to create PartitionCommitPolicy chain.

PartitionCommitPolicyFactory(String, String, String, List<String>) - Constructor for class org.apache.flink.connector.file.table.PartitionCommitPolicyFactory

PartitionCommitPredicate - Interface in org.apache.flink.connector.file.table.stream

Partition commit predicate.

PartitionCommitPredicate.PredicateContext - Interface in org.apache.flink.connector.file.table.stream

Context that PartitionCommitPredicate can use for getting context about a partition.

PartitionCommitter - Class in org.apache.flink.connector.file.table.stream

Committer operator for partitions.

PartitionCommitter(Path, ObjectIdentifier, List<String>, TableMetaStoreFactory, FileSystemFactory, Configuration) - Constructor for class org.apache.flink.connector.file.table.stream.PartitionCommitter

PartitionCommitTrigger - Interface in org.apache.flink.connector.file.table.stream

Partition commit trigger.

PartitionComputer<T> - Interface in org.apache.flink.connector.file.table

Compute partition path from record and project non-partition columns for output writer.

partitionCreated(String) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

Notifies a partition created.

partitionCreated(String) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactFileWriter

partitionCreated(String) - Method in class org.apache.flink.connector.file.table.stream.StreamingFileWriter

PartitionFetcher<P> - Interface in org.apache.flink.connector.file.table

Fetcher to fetch the suitable partitions of a filesystem table.

PartitionFetcher.Context<P> - Interface in org.apache.flink.connector.file.table

Context for fetch partitions, partition information is stored in hive meta store.

PartitionFetcher.Context.ComparablePartitionValue<P,T extends Comparable<T>> - Interface in org.apache.flink.connector.file.table

A comparable partition value that can compare order by using its comparator.

PartitionFieldExtractor<T extends FileSourceSplit> - Interface in org.apache.flink.connector.file.table

Interface to extract partition field from split.

partitionFieldGetters - Variable in class org.apache.flink.connector.file.table.RowDataPartitionComputer

partitionInactive(String) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

Notifies a partition become inactive.

partitionInactive(String) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactFileWriter

partitionInactive(String) - Method in class org.apache.flink.connector.file.table.stream.StreamingFileWriter

partitionIndexes - Variable in class org.apache.flink.connector.file.table.RowDataPartitionComputer

partitionIndexes - Variable in class org.apache.flink.connector.file.table.RowPartitionComputer

partitionKeys() - Method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy.Context

Table partition keys.

PartitionLoader - Class in org.apache.flink.connector.file.table

Loader to temporary files to final output path and meta store.

PartitionLoader(boolean, FileSystem, TableMetaStoreFactory, boolean, ObjectIdentifier, List<PartitionCommitPolicy>) - Constructor for class org.apache.flink.connector.file.table.PartitionLoader

partitionPath() - Method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy.Context

Path of this partition.

PartitionReader<P,OUT> - Interface in org.apache.flink.connector.file.table

Reader that reads record from given partitions.

partitionSpec() - Method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy.Context

Partition spec in the form of a map from partition keys to values.

PartitionTempFileManager - Class in org.apache.flink.connector.file.table

Manage temporary files for writing files.

PartitionTempFileManager(FileSystemFactory, Path, int, int) - Constructor for class org.apache.flink.connector.file.table.PartitionTempFileManager

PartitionTempFileManager(FileSystemFactory, Path, int, int, OutputFileConfig) - Constructor for class org.apache.flink.connector.file.table.PartitionTempFileManager

PartitionTimeCommitPredicate - Class in org.apache.flink.connector.file.table.stream

Partition commit predicate by partition time and watermark, if 'watermark' > 'partition-time' + 'delay', the partition is committable.

PartitionTimeCommitPredicate(Configuration, ClassLoader, List<String>) - Constructor for class org.apache.flink.connector.file.table.stream.PartitionTimeCommitPredicate

PartitionTimeCommitTrigger - Class in org.apache.flink.connector.file.table.stream

Partition commit trigger by partition time and watermark.

PartitionTimeCommitTrigger(boolean, OperatorStateStore, PartitionCommitPredicate) - Constructor for class org.apache.flink.connector.file.table.stream.PartitionTimeCommitTrigger

PartitionTimeExtractor - Interface in org.apache.flink.connector.file.table

Time extractor to extract time from partition values.

partitionTypes - Variable in class org.apache.flink.connector.file.table.RowDataPartitionComputer

partitionValues() - Method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy.Context

Values of this partition.

PartitionWriter<T> - Interface in org.apache.flink.connector.file.table

Partition writer to write records with partition.

PartitionWriter.Context<T> - Class in org.apache.flink.connector.file.table

Context for partition writer, provide some information and generation utils.

PartitionWriter.DefaultPartitionWriterListener - Class in org.apache.flink.connector.file.table

Default implementation for PartitionWriterListener.

PartitionWriter.PartitionWriterListener - Interface in org.apache.flink.connector.file.table

Listener for partition writer.

PartitionWriterFactory<T> - Interface in org.apache.flink.connector.file.table

Factory of PartitionWriter to avoid virtual function calls.

path() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

Gets the file's path.

PATH - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

PendingSplitsCheckpoint<SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src

A checkpoint of the current state of the containing the currently pending splits that are not yet assigned.

PendingSplitsCheckpoint(Collection<SplitT>, Collection<Path>) - Constructor for class org.apache.flink.connector.file.src.PendingSplitsCheckpoint

PendingSplitsCheckpointSerializer<T extends FileSourceSplit> - Class in org.apache.flink.connector.file.src

A serializer for the PendingSplitsCheckpoint.

PendingSplitsCheckpointSerializer(SimpleVersionedSerializer<T>) - Constructor for class org.apache.flink.connector.file.src.PendingSplitsCheckpointSerializer

pollEntry() - Method in class org.apache.flink.connector.file.src.util.Pool

Gets the next cached entry.

Pool<T> - Class in org.apache.flink.connector.file.src.util

A pool to cache and recycle heavyweight objects, to reduce object allocation.

Pool(int) - Constructor for class org.apache.flink.connector.file.src.util.Pool

Creates a pool with the given capacity.

Pool.Recycler<T> - Interface in org.apache.flink.connector.file.src.util

A Recycler puts objects into the pool that the recycler is associated with.

prepareCommit() - Method in class org.apache.flink.connector.file.sink.writer.FileWriter

prepareSnapshotPreBarrier(long) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinator

prepareSnapshotPreBarrier(long) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

PROCESS_TIME - org.apache.flink.connector.file.table.FileSystemConnectorOptions.PartitionCommitTriggerType

processElement(StreamRecord<IN>) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

processElement(StreamRecord<CompactorRequest>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

processElement(StreamRecord<CompactMessages.CoordinatorInput>) - Method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactCoordinator

processElement(StreamRecord<CompactMessages.CoordinatorInput>) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactCoordinator

processElement(StreamRecord<CompactMessages.CoordinatorOutput>) - Method in class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

processElement(StreamRecord<CompactMessages.CoordinatorOutput>) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

processElement(StreamRecord<PartitionCommitInfo>) - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitter

processElement(StreamRecord<CommittableMessage<FileSinkCommittable>>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinator

processElement(StreamRecord<CommittableMessage<FileSinkCommittable>>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinatorStateHandler

processElement(StreamRecord<Either<CommittableMessage<FileSinkCommittable>, CompactorRequest>>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandler

processElement(StreamRecord<T>) - Method in class org.apache.flink.connector.file.table.batch.compact.BatchFileWriter

processStaticFileSet() - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

Sets this source to bounded (batch) mode.

processWatermark(Watermark) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

processWatermark(Watermark) - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitter

ProcTimeCommitPredicate - Class in org.apache.flink.connector.file.table.stream

Partition commit trigger by creation time and processing time service, if 'current processing time' > 'partition creation time' + 'delay', the partition is committable.

ProcTimeCommitPredicate(Configuration) - Constructor for class org.apache.flink.connector.file.table.stream.ProcTimeCommitPredicate

ProcTimeCommitTrigger - Class in org.apache.flink.connector.file.table.stream

Partition commit trigger by creation time and processing time service.

ProcTimeCommitTrigger(boolean, OperatorStateStore, ProcessingTimeService, PartitionCommitPredicate) - Constructor for class org.apache.flink.connector.file.table.stream.ProcTimeCommitTrigger

projectColumnsToWrite(RowData) - Method in class org.apache.flink.connector.file.table.RowDataPartitionComputer

projectColumnsToWrite(Row) - Method in class org.apache.flink.connector.file.table.RowPartitionComputer

projectColumnsToWrite(T) - Method in interface org.apache.flink.connector.file.table.PartitionComputer

Project non-partition columns for output writer.

ProjectionBulkFactory(BulkWriter.Factory<RowData>, RowDataPartitionComputer) - Constructor for class org.apache.flink.connector.file.table.FileSystemTableSink.ProjectionBulkFactory

R

read() - Method in class org.apache.flink.connector.file.sink.compactor.DecoderBasedReader

read() - Method in class org.apache.flink.connector.file.sink.compactor.InputFormatBasedReader

read() - Method in interface org.apache.flink.connector.file.sink.compactor.RecordWiseFileCompactor.Reader

read() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat.Reader

Reads the next record.

read() - Method in class org.apache.flink.connector.file.src.reader.TextLineInputFormat.Reader

read() - Method in class org.apache.flink.connector.file.table.stream.compact.CompactBulkReader

read() - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactReader

Read a record, return null if no more record.

read() - Method in class org.apache.flink.connector.file.table.stream.compact.FileInputFormatCompactReader

read(OUT) - Method in interface org.apache.flink.connector.file.table.PartitionReader

Reads the next record from the partitions.

readBatch() - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter.Reader

readBatch() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat.Reader

Reads one batch.

readerFormat - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

RecordAndPosition<E> - Class in org.apache.flink.connector.file.src.util

A record, together with the reader position to be stored in the checkpoint.

RecordAndPosition(E, long, long) - Constructor for class org.apache.flink.connector.file.src.util.RecordAndPosition

Creates a new RecordAndPosition with the given record and position info.

RecordMapperWrapperRecordIterator<I,O> - Class in org.apache.flink.connector.file.src.util

Implementation of BulkFormat.RecordIterator that wraps another iterator and performs the mapping of the records.

RecordMapperWrapperRecordIterator(BulkFormat.RecordIterator<I>, RecordMapperWrapperRecordIterator.RecordMapper<I, O>) - Constructor for class org.apache.flink.connector.file.src.util.RecordMapperWrapperRecordIterator

RecordMapperWrapperRecordIterator.RecordMapper<I,O> - Interface in org.apache.flink.connector.file.src.util

Record mapper definition.

RecordWiseFileCompactor<IN> - Class in org.apache.flink.connector.file.sink.compactor

A FileCompactor implementation that reads input files with a RecordWiseFileCompactor.Reader and writes with a RecordWiseFileCompactor.Writer.

RecordWiseFileCompactor(RecordWiseFileCompactor.Reader.Factory<IN>) - Constructor for class org.apache.flink.connector.file.sink.compactor.RecordWiseFileCompactor

RecordWiseFileCompactor.Reader<T> - Interface in org.apache.flink.connector.file.sink.compactor

The reader that reads record from the compacting files.

RecordWiseFileCompactor.Reader.Factory<T> - Interface in org.apache.flink.connector.file.sink.compactor

Factory for RecordWiseFileCompactor.Reader.

RecordWiseFileCompactor.Writer<T> - Interface in org.apache.flink.connector.file.sink.compactor

The writer that writers record into the compacting files.

RecyclableIterator<E> - Class in org.apache.flink.connector.file.src.util

Utility base class for iterators that accept a recycler.

RecyclableIterator(Runnable) - Constructor for class org.apache.flink.connector.file.src.util.RecyclableIterator

Creates a RecyclableIterator with the given optional recycler.

recycle() - Method in class org.apache.flink.connector.file.src.impl.FileRecords

recycle(T) - Method in interface org.apache.flink.connector.file.src.util.Pool.Recycler

Recycles the given object to the pool that this recycler works with.

recycler() - Method in class org.apache.flink.connector.file.src.util.Pool

Gets the recycler for this pool.

RegexFileFilter - Class in org.apache.flink.connector.file.src.enumerate

A file filter that filters out hidden files, see DefaultFileFilter and the files whose path doesn't match the given regex pattern.

RegexFileFilter(String) - Constructor for class org.apache.flink.connector.file.src.enumerate.RegexFileFilter

releaseBatch() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator

Releases the batch that this iterator iterated over.

releaseBatch() - Method in class org.apache.flink.connector.file.src.util.RecordMapperWrapperRecordIterator

releaseBatch() - Method in class org.apache.flink.connector.file.src.util.RecyclableIterator

remainingSplits() - Method in interface org.apache.flink.connector.file.src.assigners.FileSplitAssigner

Gets the remaining splits that this assigner has pending.

remainingSplits() - Method in class org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner

remainingSplits() - Method in class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner

replaceMutableRow(RowData) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

Replaces the mutable RowData backing this EnrichedRowData.

reportStatistics() - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

requiredOptions() - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

requiresPartitionGrouping(boolean) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink

restoreBucket(BucketWriter<IN, String>, RollingPolicy<IN, String>, FileWriterBucketState, OutputFileConfig) - Method in class org.apache.flink.connector.file.sink.writer.DefaultFileWriterBucketFactory

restoreBucket(BucketWriter<IN, String>, RollingPolicy<IN, String>, FileWriterBucketState, OutputFileConfig) - Method in interface org.apache.flink.connector.file.sink.writer.FileWriterBucketFactory

restoreEnumerator(SplitEnumeratorContext<SplitT>, PendingSplitsCheckpoint<SplitT>) - Method in class org.apache.flink.connector.file.src.AbstractFileSource

restorePartValueFromType(String, DataType) - Static method in class org.apache.flink.connector.file.table.RowPartitionComputer

restorePartValueFromType(String, LogicalType) - Static method in class org.apache.flink.connector.file.table.RowPartitionComputer

Restore partition value from string and type.

restoreReader(Configuration, FileSourceSplit) - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter

restoreReader(Configuration, FileSourceSplit) - Method in class org.apache.flink.connector.file.table.DeserializationSchemaAdapter

restoreReader(Configuration, FSDataInputStream, long, long, long) - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat

restoreReader(Configuration, FSDataInputStream, long, long, long) - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat

Restores a reader from a checkpointed position.

restoreReader(Configuration, SplitT) - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat

Creates a new reader that reads from split.path() starting at offset and reads until length bytes after the offset.

restoreReader(Configuration, SplitT) - Method in class org.apache.flink.connector.file.table.LimitableBulkFormat

restoreWriter(WriterInitContext, Collection<FileWriterBucketState>) - Method in class org.apache.flink.connector.file.sink.FileSink

RowDataPartitionComputer - Class in org.apache.flink.connector.file.table

PartitionComputer for RowData.

RowDataPartitionComputer(String, String[], DataType[], String[]) - Constructor for class org.apache.flink.connector.file.table.RowDataPartitionComputer

RowFormatBuilder(Path, long, Encoder<IN>, BucketAssigner<IN, String>, RollingPolicy<IN, String>, FileWriterBucketFactory<IN>, OutputFileConfig) - Constructor for class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

RowFormatBuilder(Path, Encoder<IN>, BucketAssigner<IN, String>) - Constructor for class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

RowPartitionComputer - Class in org.apache.flink.connector.file.table

PartitionComputer for Row.

RowPartitionComputer(String, String[], String[]) - Constructor for class org.apache.flink.connector.file.table.RowPartitionComputer

S

SerializationSchemaAdapter - Class in org.apache.flink.connector.file.table

Adapter to turn a SerializationSchema into a Encoder.

SerializationSchemaAdapter(SerializationSchema<RowData>) - Constructor for class org.apache.flink.connector.file.table.SerializationSchemaAdapter

serialize(CompactorRequest) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestSerializer

serialize(FileSinkCommittable) - Method in class org.apache.flink.connector.file.sink.FileSinkCommittableSerializer

serialize(FileWriterBucketState) - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketStateSerializer

serialize(FileSourceSplit) - Method in class org.apache.flink.connector.file.src.FileSourceSplitSerializer

serialize(PendingSplitsCheckpoint<T>) - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpointSerializer

set(int, long) - Method in class org.apache.flink.connector.file.table.ColumnarRowIterator

set(int, long, long) - Method in class org.apache.flink.connector.file.table.ColumnarRowIterator

Set number rows in this batch and updates the position.

set(E[], int, long, long) - Method in class org.apache.flink.connector.file.src.util.ArrayResultIterator

Sets the records to be returned by this iterator.

set(E, long, long) - Method in class org.apache.flink.connector.file.src.util.MutableRecordAndPosition

Updates the record and position in this object.

set(E, long, long) - Method in class org.apache.flink.connector.file.src.util.SingletonResultIterator

Sets the single record to be returned by this iterator.

setCheckpointId(long) - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

setDynamicFilteringData(DynamicFilteringData) - Method in interface org.apache.flink.connector.file.src.enumerate.DynamicFileEnumerator

Provides a DynamicFilteringData for filtering while the enumerator is enumerating splits.

setDynamicGrouped(boolean) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setFileEnumerator(FileEnumerator.Provider) - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

Configures the FileEnumerator for the source.

setFileSystemFactory(FileSystemFactory) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setFormatFactory(OutputFormatFactory<T>) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setIdentifier(ObjectIdentifier) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setIsToLocal(boolean) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setMetastore(TableMetaStoreFactory.TableMetaStore) - Method in class org.apache.flink.connector.file.table.MetastoreCommitPolicy

setMetaStoreFactory(TableMetaStoreFactory) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setNext(E) - Method in class org.apache.flink.connector.file.src.util.MutableRecordAndPosition

Sets the next record of a sequence.

setNumberOfTasks(int) - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

setNumCompactThreads(int) - Method in class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy.Builder

Optional, the count of compacting threads in a compactor operator, 1 by default.

setOffset(long) - Method in class org.apache.flink.connector.file.src.FileSourceSplitState

setOutputFileConfig(OutputFileConfig) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setOverwrite(boolean) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setPartitionColumns(String[]) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setPartitionCommitPolicyFactory(PartitionCommitPolicyFactory) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setPartitionComputer(PartitionComputer<T>) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setPartitions(String[]) - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

setPath(Path) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setPosition(long, long) - Method in class org.apache.flink.connector.file.src.FileSourceSplitState

setPosition(long, long) - Method in class org.apache.flink.connector.file.src.util.MutableRecordAndPosition

Sets the position without setting a record.

setPosition(CheckpointedPosition) - Method in class org.apache.flink.connector.file.src.FileSourceSplitState

setRecordsToSkipAfterOffset(long) - Method in class org.apache.flink.connector.file.src.FileSourceSplitState

setRowKind(RowKind) - Method in class org.apache.flink.connector.file.table.EnrichedRowData

setSizeThreshold(long) - Method in class org.apache.flink.connector.file.sink.compactor.FileCompactStrategy.Builder

Optional, compaction will be triggered when the total size of compacting files reaches the threshold. -1 by default, indicating the size is unlimited.

setSplitAssigner(FileSplitAssigner.Provider) - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

Configures the FileSplitAssigner for the source.

setStaticPartitions(LinkedHashMap<String, String>) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat.Builder

setTaskId(int) - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitInfo

shouldRollOnCheckpoint(PartFileInfo<String>) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink.TableRollingPolicy

shouldRollOnEvent(PartFileInfo<String>, RowData) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink.TableRollingPolicy

shouldRollOnProcessingTime(PartFileInfo<String>, long) - Method in class org.apache.flink.connector.file.table.FileSystemTableSink.TableRollingPolicy

SimpleSplitAssigner - Class in org.apache.flink.connector.file.src.assigners

The SimpleSplitAssigner hands out splits in a random order, without any consideration for order or locality.

SimpleSplitAssigner(Collection<FileSourceSplit>) - Constructor for class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner

SimpleStreamFormat<T> - Class in org.apache.flink.connector.file.src.reader

A simple version of the StreamFormat, for formats that are not splittable.

SimpleStreamFormat() - Constructor for class org.apache.flink.connector.file.src.reader.SimpleStreamFormat

SimpleStringDecoder - Class in org.apache.flink.connector.file.sink.compactor

A sink DecoderBasedReader.Decoder that reads data encoded by the SimpleStringEncoder only for compaction.

SimpleStringDecoder() - Constructor for class org.apache.flink.connector.file.sink.compactor.SimpleStringDecoder

SingleDirectoryWriter<T> - Class in org.apache.flink.connector.file.table

PartitionWriter for single directory writer.

SingleDirectoryWriter(PartitionWriter.Context<T>, PartitionTempFileManager, PartitionComputer<T>, LinkedHashMap<String, String>) - Constructor for class org.apache.flink.connector.file.table.SingleDirectoryWriter

SingleDirectoryWriter(PartitionWriter.Context<T>, PartitionTempFileManager, PartitionComputer<T>, LinkedHashMap<String, String>, PartitionWriter.PartitionWriterListener) - Constructor for class org.apache.flink.connector.file.table.SingleDirectoryWriter

SingletonResultIterator<E> - Class in org.apache.flink.connector.file.src.util

A simple BulkFormat.RecordIterator that returns a single value.

SingletonResultIterator() - Constructor for class org.apache.flink.connector.file.src.util.SingletonResultIterator

SingletonResultIterator(Runnable) - Constructor for class org.apache.flink.connector.file.src.util.SingletonResultIterator

sink(ProviderContext, DataStream<PartitionCommitInfo>, Path, ObjectIdentifier, List<String>, TableMetaStoreFactory, FileSystemFactory, Configuration) - Static method in class org.apache.flink.connector.file.table.stream.StreamingSink

Create a sink from file writer.

SINK_PARALLELISM - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_PARTITION_COMMIT_DELAY - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_PARTITION_COMMIT_POLICY_CLASS - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_PARTITION_COMMIT_POLICY_CLASS_PARAMETERS - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_PARTITION_COMMIT_POLICY_KIND - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_PARTITION_COMMIT_SUCCESS_FILE_NAME - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_PARTITION_COMMIT_TRIGGER - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_PARTITION_COMMIT_WATERMARK_TIME_ZONE - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_ROLLING_POLICY_CHECK_INTERVAL - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_ROLLING_POLICY_FILE_SIZE - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_ROLLING_POLICY_INACTIVITY_INTERVAL - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_ROLLING_POLICY_ROLLOVER_INTERVAL - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SINK_SHUFFLE_BY_PARTITION - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

snapshotState(long) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter

snapshotState(long) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

snapshotState(long) - Method in class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

snapshotState(long) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator

snapshotState(long, long) - Method in interface org.apache.flink.connector.file.table.stream.PartitionCommitTrigger

Snapshot state.

snapshotState(long, long) - Method in class org.apache.flink.connector.file.table.stream.PartitionTimeCommitTrigger

snapshotState(long, long) - Method in class org.apache.flink.connector.file.table.stream.ProcTimeCommitTrigger

snapshotState(StateSnapshotContext) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactCoordinator

snapshotState(StateSnapshotContext) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperator

snapshotState(StateSnapshotContext) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorOperatorStateHandler

snapshotState(StateSnapshotContext) - Method in class org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

snapshotState(StateSnapshotContext) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactCoordinator

snapshotState(StateSnapshotContext) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

snapshotState(StateSnapshotContext) - Method in class org.apache.flink.connector.file.table.stream.PartitionCommitter

snapshotState(StateSnapshotContext) - Method in class org.apache.flink.connector.file.table.stream.StreamingFileWriter

SOURCE_MONITOR_INTERVAL - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SOURCE_PATH_REGEX_PATTERN - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

SOURCE_REPORT_STATISTICS - Static variable in class org.apache.flink.connector.file.table.FileSystemConnectorOptions

splitAssigner - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder

splitId() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

StandardDeCompressors - Class in org.apache.flink.connector.file.src.compression

A collection of common compression formats and de-compressors.

start() - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

start() - Method in class org.apache.flink.connector.file.src.impl.DynamicFileSplitEnumerator

start() - Method in class org.apache.flink.connector.file.src.impl.FileSourceReader

start() - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator

StaticFileSplitEnumerator - Class in org.apache.flink.connector.file.src.impl

A SplitEnumerator implementation for bounded / batch FileSource input.

StaticFileSplitEnumerator(SplitEnumeratorContext<FileSourceSplit>, FileSplitAssigner) - Constructor for class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator

StreamFormat<T> - Interface in org.apache.flink.connector.file.src.reader

A reader format that reads individual records from a stream.

StreamFormat.Reader<T> - Interface in org.apache.flink.connector.file.src.reader

The actual reader that reads the records.

StreamFormatAdapter<T> - Class in org.apache.flink.connector.file.src.impl

Adapter to turn a StreamFormat into a BulkFormat.

StreamFormatAdapter(StreamFormat<T>) - Constructor for class org.apache.flink.connector.file.src.impl.StreamFormatAdapter

StreamFormatAdapter.Reader<T> - Class in org.apache.flink.connector.file.src.impl

The reader adapter, from StreamFormat.Reader to BulkFormat.Reader.

StreamingFileWriter<IN> - Class in org.apache.flink.connector.file.table.stream

Writer for emitting PartitionCommitInfo to downstream.

StreamingFileWriter(long, StreamingFileSink.BucketsBuilder<IN, String, ? extends StreamingFileSink.BucketsBuilder<IN, String, ?>>, List<String>, Configuration) - Constructor for class org.apache.flink.connector.file.table.stream.StreamingFileWriter

StreamingSink - Class in org.apache.flink.connector.file.table.stream

Helper for creating streaming file sink.

submit(CompactorRequest, CompletableFuture<Iterable<FileSinkCommittable>>) - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactService

SUCCESS_FILE - Static variable in interface org.apache.flink.connector.file.table.PartitionCommitPolicy

SuccessFileCommitPolicy - Class in org.apache.flink.connector.file.table

Partition commit policy to add success file to directory.

SuccessFileCommitPolicy(String, FileSystem) - Constructor for class org.apache.flink.connector.file.table.SuccessFileCommitPolicy

supportsNestedProjection() - Method in class org.apache.flink.connector.file.table.FileSystemTableSource

T

TableBucketAssigner(PartitionComputer<RowData>) - Constructor for class org.apache.flink.connector.file.table.FileSystemTableSink.TableBucketAssigner

TableMetaStoreFactory - Interface in org.apache.flink.connector.file.table

Meta store factory to create TableMetaStoreFactory.TableMetaStore.

TableMetaStoreFactory.TableMetaStore - Interface in org.apache.flink.connector.file.table

Meta store to manage the location paths of this table and its partitions.

tableName() - Method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy.Context

Table name.

TableRollingPolicy(boolean, long, long, long) - Constructor for class org.apache.flink.connector.file.table.FileSystemTableSink.TableRollingPolicy

TaskTracker - Class in org.apache.flink.connector.file.table.stream

Track the upstream tasks to determine whether all the upstream data of a checkpoint has been received.

TaskTracker(int) - Constructor for class org.apache.flink.connector.file.table.stream.TaskTracker

test(Path) - Method in class org.apache.flink.connector.file.src.enumerate.DefaultFileFilter

test(Path) - Method in class org.apache.flink.connector.file.src.enumerate.RegexFileFilter

TextLineInputFormat - Class in org.apache.flink.connector.file.src.reader

A reader format that text lines from a file.

TextLineInputFormat() - Constructor for class org.apache.flink.connector.file.src.reader.TextLineInputFormat

TextLineInputFormat(String) - Constructor for class org.apache.flink.connector.file.src.reader.TextLineInputFormat

TextLineInputFormat.Reader - Class in org.apache.flink.connector.file.src.reader

The actual reader for the TextLineInputFormat.

toFileSourceSplit() - Method in class org.apache.flink.connector.file.src.FileSourceSplitState

Use the current row count as the starting row count to create a new FileSourceSplit.

toLocalDateTime(String, String) - Static method in class org.apache.flink.connector.file.table.DefaultPartTimeExtractor

toLocalDateTimeDefault(String) - Static method in class org.apache.flink.connector.file.table.DefaultPartTimeExtractor

toMills(LocalDateTime) - Static method in class org.apache.flink.connector.file.table.DefaultPartTimeExtractor

toSplitType(String, FileSourceSplitState<SplitT>) - Method in class org.apache.flink.connector.file.src.impl.FileSourceReader

toString() - Method in class org.apache.flink.connector.file.sink.compactor.operator.CompactorRequestTypeInfo

toString() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable

toString() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState

toString() - Method in class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner

toString() - Method in class org.apache.flink.connector.file.src.ContinuousEnumerationSettings

toString() - Method in class org.apache.flink.connector.file.src.FileSourceSplit

toString() - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint

toString() - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition

toString() - Method in class org.apache.flink.connector.file.src.util.RecordAndPosition

toString() - Method in class org.apache.flink.connector.file.table.EnrichedRowData

toString() - Method in enum org.apache.flink.connector.file.table.FileSystemConnectorOptions.FileStatisticsType

toString() - Method in enum org.apache.flink.connector.file.table.FileSystemConnectorOptions.PartitionCommitTriggerType

tryPollEntry() - Method in class org.apache.flink.connector.file.src.util.Pool

Tries to get the next cached entry.

U

UNCOMPACTED_PREFIX - Static variable in class org.apache.flink.connector.file.table.batch.compact.BatchCompactOperator

UNCOMPACTED_PREFIX - Static variable in class org.apache.flink.connector.file.table.stream.compact.CompactOperator

updateWithCheckpointedPosition(CheckpointedPosition) - Method in class org.apache.flink.connector.file.src.FileSourceSplit

Creates a copy of this split where the checkpointed position is replaced by the given new position.

Utils - Class in org.apache.flink.connector.file.src.util

Miscellaneous utilities for the file source.

V

validate(FactoryUtil.TableFactoryHelper) - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

validatePolicyChain(boolean, String) - Static method in interface org.apache.flink.connector.file.table.PartitionCommitPolicy

Validate commit policy.

validateTimeZone(String) - Method in class org.apache.flink.connector.file.table.FileSystemTableFactory

Similar logic as for TableConfig.

valueOf(String) - Static method in enum org.apache.flink.connector.file.table.FileSystemConnectorOptions.FileStatisticsType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.flink.connector.file.table.FileSystemConnectorOptions.PartitionCommitTriggerType

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.flink.connector.file.table.FileSystemConnectorOptions.FileStatisticsType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.flink.connector.file.table.FileSystemConnectorOptions.PartitionCommitTriggerType

Returns an array containing the constants of this enum type, in the order they are declared.

W

withBucketAssigner(BucketAssigner<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

withBucketAssigner(BucketAssigner<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

withBucketCheckInterval(long) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

withBucketCheckInterval(long) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

withNewBucketAssigner(BucketAssigner<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

withOutputFileConfig(OutputFileConfig) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

withOutputFileConfig(OutputFileConfig) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

withRollingPolicy(CheckpointRollingPolicy<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

withRollingPolicy(RollingPolicy<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

wrapReader(BulkFormat.Reader<I>, RecordMapperWrapperRecordIterator.RecordMapper<I, O>) - Static method in class org.apache.flink.connector.file.src.util.RecordMapperWrapperRecordIterator

Wrap a BulkFormat.Reader applying a RecordMapperWrapperRecordIterator.RecordMapper on the returned iterator.

write(IN, SinkWriter.Context) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter

write(T) - Method in interface org.apache.flink.connector.file.sink.compactor.RecordWiseFileCompactor.Writer

write(T) - Method in class org.apache.flink.connector.file.table.DynamicPartitionWriter

write(T) - Method in class org.apache.flink.connector.file.table.GroupedPartitionWriter

write(T) - Method in interface org.apache.flink.connector.file.table.PartitionWriter

Write a record.

write(T) - Method in class org.apache.flink.connector.file.table.SingleDirectoryWriter

write(T) - Method in class org.apache.flink.connector.file.table.stream.compact.CompactBucketWriter

write(T) - Method in interface org.apache.flink.connector.file.table.stream.compact.CompactWriter

writer(ProviderContext, DataStream<T>, long, StreamingFileSink.BucketsBuilder<T, String, ? extends StreamingFileSink.BucketsBuilder<T, String, ?>>, int, List<String>, Configuration, boolean) - Static method in class org.apache.flink.connector.file.table.stream.StreamingSink

Create a file writer by input stream.

writeRecord(T) - Method in class org.apache.flink.connector.file.table.FileSystemOutputFormat

A B C D E F G H I L M N O P R S T U V W
All Classes All Packages