Stats

com.github.mjakubowski84.parquet4s.Stats
See theStats companion object
trait Stats

Utilises statistics of Parquet files to provide number of records and minimum and maximum value of columns. Values are provided for both unfiltered and filtered reads. Reading statistics from unfiltered files is usually faster as then only file metadata are used. For filtered files certain blocks must be scanned in order to provide correct results.

Attributes

Companion
object
Graph
Supertypes
class Object
trait Matchable
class Any

Members list

Value members

Abstract methods

Attributes

Returns

Number for records in given path. Filter is considered during calculation.

Concrete methods

def max[V](columnPath: ColumnPath)(implicit decoder: ValueDecoder[V], ordering: Ordering[V]): Option[V]

Type parameters

V

type of value stored in the column

Value parameters

columnPath

ColumnPath

decoder

ValueDecoder required to decode the value

ordering

required to sort filtered values

Attributes

Returns

Maximum value across Parquet data. Filter is considered during calculation.

def min[V](columnPath: ColumnPath)(implicit decoder: ValueDecoder[V], ordering: Ordering[V]): Option[V]

Type parameters

V

type of value stored in the column

Value parameters

columnPath

ColumnPath

decoder

ValueDecoder required to decode the value

ordering

required to sort filtered values

Attributes

Returns

Minimum value across Parquet data. Filter is considered during calculation.