IN
- Type of the elements emitted by this sinkpublic abstract class GenericWriteAheadSink<IN> extends AbstractStreamOperator<IN> implements OneInputStreamOperator<IN,IN>
Incoming records are stored within a AbstractStateBackend
, and only committed if a
checkpoint is completed.
AbstractStreamOperator.CountingOutput<OUT>
限定符和类型 | 字段和说明 |
---|---|
protected static org.slf4j.Logger |
LOG |
protected org.apache.flink.api.common.typeutils.TypeSerializer<IN> |
serializer |
chainingStrategy, config, latencyStats, metrics, output, timeServiceManager
构造器和说明 |
---|
GenericWriteAheadSink(CheckpointCommitter committer,
org.apache.flink.api.common.typeutils.TypeSerializer<IN> serializer,
String jobID) |
限定符和类型 | 方法和说明 |
---|---|
void |
close()
This method is called after all records have been added to the operators via the methods
OneInputStreamOperator.processElement(StreamRecord) , or
TwoInputStreamOperator.processElement1(StreamRecord) and
TwoInputStreamOperator.processElement2(StreamRecord) . |
void |
initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
Stream operators with state which can be restored need to override this hook method.
|
void |
notifyCheckpointComplete(long checkpointId) |
void |
open()
This method is called immediately before any elements are processed, it should contain the
operator's initialization logic, e.g. state initialization.
|
void |
processElement(StreamRecord<IN> element)
Processes one element that arrived at this operator.
|
protected abstract boolean |
sendValues(Iterable<IN> values,
long checkpointId,
long timestamp)
Write the given element into the backend.
|
void |
snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)
Stream operators with state, which want to participate in a snapshot need to override this hook method.
|
dispose, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getUserCodeClassloader, initializeState, numEventTimeTimers, numProcessingTimeTimers, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark, processWatermark1, processWatermark2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setup, snapshotState
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
processLatencyMarker, processWatermark
dispose, getChainingStrategy, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setChainingStrategy, setKeyContextElement1, setKeyContextElement2, setup, snapshotState
getCurrentKey, setCurrentKey
protected static final org.slf4j.Logger LOG
protected final org.apache.flink.api.common.typeutils.TypeSerializer<IN> serializer
public GenericWriteAheadSink(CheckpointCommitter committer, org.apache.flink.api.common.typeutils.TypeSerializer<IN> serializer, String jobID) throws Exception
Exception
public void initializeState(org.apache.flink.runtime.state.StateInitializationContext context) throws Exception
AbstractStreamOperator
initializeState
在类中 AbstractStreamOperator<IN>
context
- context that allows to register different states.Exception
public void open() throws Exception
AbstractStreamOperator
The default implementation does nothing.
open
在接口中 StreamOperator<IN>
open
在类中 AbstractStreamOperator<IN>
Exception
- An exception in this method causes the operator to fail.public void close() throws Exception
AbstractStreamOperator
OneInputStreamOperator.processElement(StreamRecord)
, or
TwoInputStreamOperator.processElement1(StreamRecord)
and
TwoInputStreamOperator.processElement2(StreamRecord)
.
The method is expected to flush all remaining buffered data. Exceptions during this flushing of buffered should be propagated, in order to cause the operation to be recognized asa failed, because the last data items are not processed properly.
close
在接口中 StreamOperator<IN>
close
在类中 AbstractStreamOperator<IN>
Exception
- An exception in this method causes the operator to fail.public void snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context) throws Exception
AbstractStreamOperator
snapshotState
在类中 AbstractStreamOperator<IN>
context
- context that provides information and means required for taking a snapshotException
public void notifyCheckpointComplete(long checkpointId) throws Exception
notifyCheckpointComplete
在接口中 org.apache.flink.runtime.state.CheckpointListener
notifyCheckpointComplete
在类中 AbstractStreamOperator<IN>
Exception
protected abstract boolean sendValues(Iterable<IN> values, long checkpointId, long timestamp) throws Exception
values
- The values to be writtencheckpointId
- The checkpoint ID of the checkpoint to be writtentimestamp
- The wall-clock timestamp of the checkpointException
public void processElement(StreamRecord<IN> element) throws Exception
OneInputStreamOperator
processElement
在接口中 OneInputStreamOperator<IN,IN>
Exception
Copyright © 2014–2019 The Apache Software Foundation. All rights reserved.