Class ReconcilingBinlogReader
- java.lang.Object
-
- io.debezium.connector.mysql.legacy.ReconcilingBinlogReader
-
- All Implemented Interfaces:
Reader
public class ReconcilingBinlogReader extends Object implements Reader
A reader that unifies the binlog positions of two binlog readers. To do this, at start time we evaluate the (now completed) states of the two binlog readers we want to unify, and create a newBinlogReader
duplicating the lagging reader, but with a halting predicate that will halt it once it has passed the final position of the leading reader.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description (package private) static class
ReconcilingBinlogReader.OffsetLimitPredicate
A Predicate that returns false for any record beyond a given offset.-
Nested classes/interfaces inherited from interface io.debezium.connector.mysql.legacy.Reader
Reader.State
-
-
Field Summary
Fields Modifier and Type Field Description private Boolean
aReaderLeading
private BinlogReader
binlogReaderA
private BinlogReader
binlogReaderB
private AtomicBoolean
completed
private static org.slf4j.Logger
LOGGER
private BinlogReader
reconcilingReader
private AtomicBoolean
running
private long
serverId
private BinlogReader
unifiedReader
private AtomicReference<Runnable>
uponCompletion
-
Constructor Summary
Constructors Constructor Description ReconcilingBinlogReader(BinlogReader binlogReaderA, BinlogReader binlogReaderB, BinlogReader unifiedReader, long serverId)
Create a reconciling Binlog Reader.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description private void
checkLaggingLeadingInfo()
private void
completeSuccessfully()
private void
determineLeadingReader()
(package private) BinlogReader
getLaggingReader()
(package private) BinlogReader
getLeadingReader()
String
name()
Get the name of this reader.List<org.apache.kafka.connect.source.SourceRecord>
poll()
Poll for the next batch of source records.private void
setupUnifiedReader()
void
start()
Start the reader and return immediately.Reader.State
state()
Get the current state of this reader.void
stop()
Stop the reader from running and transition to theReader.State.STOPPING
state until all remaining records areconsumed
, at which point its state transitions toReader.State.STOPPED
.void
uponCompletion(Runnable handler)
Set the function that should be called when this reader transitions from theReader.State.STOPPING
toReader.State.STOPPED
state, which is after all generated records have been consumed via thepoll
method.-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface io.debezium.connector.mysql.legacy.Reader
destroy, initialize
-
-
-
-
Field Detail
-
LOGGER
private static final org.slf4j.Logger LOGGER
-
binlogReaderA
private final BinlogReader binlogReaderA
-
binlogReaderB
private final BinlogReader binlogReaderB
-
unifiedReader
private final BinlogReader unifiedReader
-
reconcilingReader
private BinlogReader reconcilingReader
-
aReaderLeading
private Boolean aReaderLeading
-
running
private final AtomicBoolean running
-
completed
private final AtomicBoolean completed
-
uponCompletion
private final AtomicReference<Runnable> uponCompletion
-
serverId
private final long serverId
-
-
Constructor Detail
-
ReconcilingBinlogReader
public ReconcilingBinlogReader(BinlogReader binlogReaderA, BinlogReader binlogReaderB, BinlogReader unifiedReader, long serverId)
Create a reconciling Binlog Reader.- Parameters:
binlogReaderA
- the first binlog reader to unify.binlogReaderB
- the second binlog reader to unify.unifiedReader
- the final, unified binlog reader that will run once the reconciliation is complete.
-
-
Method Detail
-
state
public Reader.State state()
Description copied from interface:Reader
Get the current state of this reader.
-
uponCompletion
public void uponCompletion(Runnable handler)
Description copied from interface:Reader
Set the function that should be called when this reader transitions from theReader.State.STOPPING
toReader.State.STOPPED
state, which is after all generated records have been consumed via thepoll
method.This method should only be called while the reader is in the
Reader.State.STOPPED
state.- Specified by:
uponCompletion
in interfaceReader
- Parameters:
handler
- the function; may not be null
-
start
public void start()
Description copied from interface:Reader
Start the reader and return immediately. Once started, theSourceRecord
s generated by the reader can be obtained by periodically callingReader.poll()
until that method returnsnull
.This method does nothing if it is already running.
-
stop
public void stop()
Description copied from interface:Reader
Stop the reader from running and transition to theReader.State.STOPPING
state until all remaining records areconsumed
, at which point its state transitions toReader.State.STOPPED
.
-
poll
public List<org.apache.kafka.connect.source.SourceRecord> poll() throws InterruptedException
Description copied from interface:Reader
Poll for the next batch of source records. This method returnsnull
only when all records generated by this reader have been processed, following the natural or explicitstopping
of this reader. Note that this method may block if no additional records are available but the reader may produce more, thus callers should call this method continually until this method returnsnull
.- Specified by:
poll
in interfaceReader
- Returns:
- the list of source records that may or may not be empty; or
null
when there will be no more records because the reader has completelyReader.State.STOPPED
. - Throws:
InterruptedException
- if this thread is interrupted while waiting for more records
-
completeSuccessfully
private void completeSuccessfully()
-
setupUnifiedReader
private void setupUnifiedReader()
-
determineLeadingReader
private void determineLeadingReader()
-
getLeadingReader
BinlogReader getLeadingReader()
-
getLaggingReader
BinlogReader getLaggingReader()
-
checkLaggingLeadingInfo
private void checkLaggingLeadingInfo()
-
-