a list of paths to scan
as set of options to control discovery
an optional partition schema that will be use to provide types for the discovered partitions
Returns all the valid files.
Returns all the valid files.
Returns all valid files grouped into partitions when the data is partitioned.
Returns all valid files grouped into partitions when the data is partitioned. If the data is unpartitioned, this will return a single partition with no partition values.
The filters used to prune which partitions are returned. These filters must
only refer to partition columns and this method will only return files
where these predicates are guaranteed to evaluate to true
. Thus, these
filters will not need to be evaluated again on the returned data.
Returns the specification of the partitions inferred from the data.
Returns the specification of the partitions inferred from the data.
a list of paths to scan
a list of paths to scan
Refresh the file listing
Refresh the file listing
A FileCatalog that generates the list of files to process by recursively listing all the files present in
paths
.