org.apache.flink.api.java.summarize

类 NumericColumnSummary<T>

java.lang.Object

org.apache.flink.api.java.summarize.ColumnSummary

org.apache.flink.api.java.summarize.NumericColumnSummary<T>

类型参数:

T - the numeric type e.g. Integer, Double

所有已实现的接口:

Serializable

已过时。

All Flink DataSet APIs are deprecated since Flink 1.18 and will be removed in a future Flink major version. You can still build your application in DataSet, but you should move to either the DataStream and/or Table API.

@Deprecated
 @PublicEvolving
public class NumericColumnSummary<T>
extends ColumnSummary
implements Serializable

Generic Column Summary for Numeric Types.

Some values are considered "missing" where "missing" is defined as null, NaN, or Infinity. These values are ignored in some calculations like mean, variance, and standardDeviation.

Uses the Kahan summation algorithm to avoid numeric instability when computing variance. The algorithm is described in: "Scalable and Numerically Stable Descriptive Statistics in SystemML", Tian et al, International Conference on Data Engineering 2012.

另请参阅:

FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API, 序列化表格

构造器概要

构造器

构造器和说明
NumericColumnSummary(long nonMissingCount, long nullCount, long nanCount, long infinityCount, T min, T max, T sum, Double mean, Double variance, Double standardDeviation) 已过时。

方法概要

限定符和类型	方法和说明
long	getInfinityCount() 已过时。 Number of values that are positive or negative infinity.
T	getMax() 已过时。
Double	getMean() 已过时。 Null, NaN, and Infinite values are ignored in this calculation.
T	getMin() 已过时。
long	getMissingCount() 已过时。 The number of "missing" values where "missing" is defined as null, NaN, or Infinity.
long	getNanCount() 已过时。 Number of values that are NaN.
long	getNonMissingCount() 已过时。 The number of values that are not null, NaN, or Infinity.
long	getNonNullCount() 已过时。 The number of non-null values in this column.
long	getNullCount() 已过时。 The number of null values in this column.
Double	getStandardDeviation() 已过时。 Standard Deviation is a measure of variation in a set of numbers.
T	getSum() 已过时。
Double	getVariance() 已过时。 Variance is a measure of how far a set of numbers are spread out.
String	toString() 已过时。

从类继承的方法 org.apache.flink.api.java.summarize.ColumnSummary

containsNonNull, containsNull, getTotalCount

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

构造器详细资料

NumericColumnSummary

public NumericColumnSummary(long nonMissingCount,
                            long nullCount,
                            long nanCount,
                            long infinityCount,
                            T min,
                            T max,
                            T sum,
                            Double mean,
                            Double variance,
                            Double standardDeviation)

已过时。

方法详细资料

getMissingCount

public long getMissingCount()

已过时。

The number of "missing" values where "missing" is defined as null, NaN, or Infinity.

These values are ignored in some calculations like mean, variance, and standardDeviation.

getNonMissingCount

public long getNonMissingCount()

已过时。

The number of values that are not null, NaN, or Infinity.

getNonNullCount

public long getNonNullCount()

已过时。

The number of non-null values in this column.

指定者:

getNonNullCount 在类中 ColumnSummary

getNullCount

public long getNullCount()

已过时。

从类复制的说明: ColumnSummary

The number of null values in this column.

指定者:

getNullCount 在类中 ColumnSummary

getNanCount

public long getNanCount()

已过时。

Number of values that are NaN.

(always zero for types like Short, Integer, Long)

getInfinityCount

public long getInfinityCount()

已过时。

Number of values that are positive or negative infinity.

(always zero for types like Short, Integer, Long)

getMin

public T getMin()

已过时。

getMax

public T getMax()

已过时。

getSum

public T getSum()

已过时。

getMean

public Double getMean()

已过时。

Null, NaN, and Infinite values are ignored in this calculation.

另请参阅:

Arithmetic Mean

getVariance

public Double getVariance()

已过时。

Variance is a measure of how far a set of numbers are spread out.

Null, NaN, and Infinite values are ignored in this calculation.

另请参阅:

Variance

getStandardDeviation

public Double getStandardDeviation()

已过时。

Standard Deviation is a measure of variation in a set of numbers. It is the square root of the variance.

Null, NaN, and Infinite values are ignored in this calculation.

另请参阅:

Standard Deviation

toString

public String toString()

已过时。

覆盖:

toString 在类中 Object