org.apache.flink.api.java.operators

类 DeltaIteration<ST,WT>

java.lang.Object

org.apache.flink.api.java.operators.DeltaIteration<ST,WT>

类型参数:

ST - The data type of the solution set.

WT - The data type of the workset (the feedback data set).

已过时。

All Flink DataSet APIs are deprecated since Flink 1.18 and will be removed in a future Flink major version. You can still build your application in DataSet, but you should move to either the DataStream and/or Table API.

@Deprecated
 @Public
public class DeltaIteration<ST,WT>
extends Object

The DeltaIteration represents the start of a delta iteration. It is created from the DataSet that represents the initial solution set via the DataSet.iterateDelta(DataSet, int, int...) method.

另请参阅:

DataSet.iterateDelta(DataSet, int, int...), DataSet.iterateDelta(DataSet, int, int[]), FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	DeltaIteration.SolutionSetPlaceHolder<ST> 已过时。 A DataSet that acts as a placeholder for the solution set during the iteration.
static class	DeltaIteration.WorksetPlaceHolder<WT> 已过时。 A DataSet that acts as a placeholder for the workset during the iteration.

构造器概要

构造器

构造器和说明
DeltaIteration(ExecutionEnvironment context, org.apache.flink.api.common.typeinfo.TypeInformation<ST> type, DataSet<ST> solutionSet, DataSet<WT> workset, org.apache.flink.api.common.operators.Keys<ST> keys, int maxIterations) 已过时。

方法概要

限定符和类型	方法和说明
DataSet<ST>	closeWith(DataSet<ST> solutionSetDelta, DataSet<WT> newWorkset) 已过时。 Closes the delta iteration.
org.apache.flink.api.common.aggregators.AggregatorRegistry	getAggregators() 已过时。 Gets the registry for aggregators for the iteration.
DataSet<ST>	getInitialSolutionSet() 已过时。 Gets the initial solution set.
DataSet<WT>	getInitialWorkset() 已过时。 Gets the initial workset.
org.apache.flink.api.common.operators.ResourceSpec	getMinResources() 已过时。 Gets the minimum resources from this iteration.
String	getName() 已过时。 Gets the name from this iteration.
int	getParallelism() 已过时。 Gets the iteration's parallelism.
org.apache.flink.api.common.operators.ResourceSpec	getPreferredResources() 已过时。 Gets the preferred resources from this iteration.
DeltaIteration.SolutionSetPlaceHolder<ST>	getSolutionSet() 已过时。 Gets the solution set of the delta iteration.
DeltaIteration.WorksetPlaceHolder<WT>	getWorkset() 已过时。 Gets the working set of the delta iteration.
boolean	isSolutionSetUnManaged() 已过时。 gets whether the solution set is in managed or unmanaged memory.
DeltaIteration<ST,WT>	name(String name) 已过时。 Sets the name for the iteration.
DeltaIteration<ST,WT>	parallelism(int parallelism) 已过时。 Sets the parallelism for the iteration.
<X extends org.apache.flink.types.Value> DeltaIteration<ST,WT>	registerAggregationConvergenceCriterion(String name, org.apache.flink.api.common.aggregators.Aggregator<X> aggregator, org.apache.flink.api.common.aggregators.ConvergenceCriterion<X> convergenceCheck) 已过时。 Registers an Aggregator for the iteration together with a ConvergenceCriterion.
DeltaIteration<ST,WT>	registerAggregator(String name, org.apache.flink.api.common.aggregators.Aggregator<?> aggregator) 已过时。 Registers an Aggregator for the iteration.
void	setSolutionSetUnManaged(boolean solutionSetUnManaged) 已过时。 Sets whether to keep the solution set in managed memory (safe against heap exhaustion) or unmanaged memory (objects on heap).

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DeltaIteration

public DeltaIteration(ExecutionEnvironment context,
                      org.apache.flink.api.common.typeinfo.TypeInformation<ST> type,
                      DataSet<ST> solutionSet,
                      DataSet<WT> workset,
                      org.apache.flink.api.common.operators.Keys<ST> keys,
                      int maxIterations)

已过时。

方法详细资料

closeWith

public DataSet<ST> closeWith(DataSet<ST> solutionSetDelta,
                             DataSet<WT> newWorkset)

已过时。

Closes the delta iteration. This method defines the end of the delta iteration's function.

参数:

solutionSetDelta - The delta for the solution set. The delta will be merged into the solution set at the end of each iteration.

newWorkset - The new workset (feedback data set) that will be fed back to the next iteration.

返回:

The DataSet that represents the result of the iteration, after the computation has terminated.

另请参阅:

DataSet.iterateDelta(DataSet, int, int...)

getInitialSolutionSet

public DataSet<ST> getInitialSolutionSet()

已过时。

Gets the initial solution set. This is the data set on which the delta iteration was started.

Consider the following example:

 DataSet<MyType> solutionSetData = ...;
 DataSet<AnotherType> worksetData = ...;

 DeltaIteration<MyType, AnotherType> iteration = solutionSetData.iteratorDelta(worksetData, 10, ...);
 

The solutionSetData would be the data set returned by iteration.getInitialSolutionSet();.

返回:

The data set that forms the initial solution set.

getInitialWorkset

public DataSet<WT> getInitialWorkset()

已过时。

Gets the initial workset. This is the data set passed to the method that starts the delta iteration.

Consider the following example:

 DataSet<MyType> solutionSetData = ...;
 DataSet<AnotherType> worksetData = ...;

 DeltaIteration<MyType, AnotherType> iteration = solutionSetData.iteratorDelta(worksetData, 10, ...);
 

The worksetData would be the data set returned by iteration.getInitialWorkset();.

返回:

The data set that forms the initial workset.

getSolutionSet

public DeltaIteration.SolutionSetPlaceHolder<ST> getSolutionSet()

已过时。

Gets the solution set of the delta iteration. The solution set represents the state that is kept across iterations.

返回:

The solution set of the delta iteration.

getWorkset

public DeltaIteration.WorksetPlaceHolder<WT> getWorkset()

已过时。

Gets the working set of the delta iteration. The working set is constructed by the previous iteration.

返回:

The working set of the delta iteration.

name

public DeltaIteration<ST,WT> name(String name)

已过时。

Sets the name for the iteration. The name is displayed in logs and messages.

参数:

name - The name for the iteration.

返回:

The iteration object, for function call chaining.

getName

public String getName()

已过时。

Gets the name from this iteration.

返回:

The name of the iteration.

parallelism

public DeltaIteration<ST,WT> parallelism(int parallelism)

已过时。

Sets the parallelism for the iteration.

参数:

parallelism - The parallelism.

返回:

The iteration object, for function call chaining.

getParallelism

public int getParallelism()

已过时。

Gets the iteration's parallelism.

返回:

The iteration's parallelism, or ExecutionConfig.PARALLELISM_DEFAULT if not set.

getMinResources

@PublicEvolving
public org.apache.flink.api.common.operators.ResourceSpec getMinResources()

已过时。

Gets the minimum resources from this iteration. If no minimum resources have been set, it returns the default empty resource.

返回:

The minimum resources of the iteration.

getPreferredResources

@PublicEvolving
public org.apache.flink.api.common.operators.ResourceSpec getPreferredResources()

已过时。

Gets the preferred resources from this iteration. If no preferred resources have been set, it returns the default empty resource.

返回:

The preferred resources of the iteration.

registerAggregator

@PublicEvolving
public DeltaIteration<ST,WT> registerAggregator(String name,
                                                                org.apache.flink.api.common.aggregators.Aggregator<?> aggregator)

已过时。

Registers an Aggregator for the iteration. Aggregators can be used to maintain simple statistics during the iteration, such as number of elements processed. The aggregators compute global aggregates: After each iteration step, the values are globally aggregated to produce one aggregate that represents statistics across all parallel instances. The value of an aggregator can be accessed in the next iteration.

Aggregators can be accessed inside a function via the AbstractRichFunction.getIterationRuntimeContext() method.

参数:

name - The name under which the aggregator is registered.

aggregator - The aggregator class.

返回:

The DeltaIteration itself, to allow chaining function calls.

registerAggregationConvergenceCriterion

@PublicEvolving
public <X extends org.apache.flink.types.Value> DeltaIteration<ST,WT> registerAggregationConvergenceCriterion(String name,
                                                                                                                              org.apache.flink.api.common.aggregators.Aggregator<X> aggregator,
                                                                                                                              org.apache.flink.api.common.aggregators.ConvergenceCriterion<X> convergenceCheck)

已过时。

Registers an Aggregator for the iteration together with a ConvergenceCriterion. For a general description of aggregators, see registerAggregator(String, Aggregator) and Aggregator. At the end of each iteration, the convergence criterion takes the aggregator's global aggregate value and decides whether the iteration should terminate. A typical use case is to have an aggregator that sums up the total error of change in an iteration step and have to have a convergence criterion that signals termination as soon as the aggregate value is below a certain threshold.

参数:

name - The name under which the aggregator is registered.

aggregator - The aggregator class.

convergenceCheck - The convergence criterion.

返回:

The DeltaIteration itself, to allow chaining function calls.

getAggregators

@PublicEvolving
public org.apache.flink.api.common.aggregators.AggregatorRegistry getAggregators()

已过时。

Gets the registry for aggregators for the iteration.

返回:

The registry with all aggregators.

setSolutionSetUnManaged

public void setSolutionSetUnManaged(boolean solutionSetUnManaged)

已过时。

Sets whether to keep the solution set in managed memory (safe against heap exhaustion) or unmanaged memory (objects on heap).

参数:

solutionSetUnManaged - True to keep the solution set in unmanaged memory, false to keep it in managed memory.

另请参阅:

isSolutionSetUnManaged()

isSolutionSetUnManaged

public boolean isSolutionSetUnManaged()

已过时。

gets whether the solution set is in managed or unmanaged memory.

返回:

True, if the solution set is in unmanaged memory (object heap), false if in managed memory.

另请参阅:

setSolutionSetUnManaged(boolean)