com.ververica.cdc.debezium.internal

Class FlinkOffsetBackingStore

java.lang.Object

com.ververica.cdc.debezium.internal.FlinkOffsetBackingStore

All Implemented Interfaces:

org.apache.kafka.connect.storage.OffsetBackingStore

public class FlinkOffsetBackingStore
extends Object
implements org.apache.kafka.connect.storage.OffsetBackingStore

A implementation of OffsetBackingStore backed on Flink's state mechanism.

The OFFSET_STATE_VALUE in the WorkerConfig is the raw position and offset data in JSON format. It is set into the config when recovery from failover by DebeziumSourceFunction before startup the DebeziumEngine. If it is not a restoration, the OFFSET_STATE_VALUE is empty. DebeziumEngine relies on the OffsetBackingStore for failover recovery.

See Also:

DebeziumSourceFunction

Field Summary

Fields

Modifier and Type	Field and Description
protected Map<ByteBuffer,ByteBuffer>	data
protected ExecutorService	executor
static int	FLUSH_TIMEOUT_SECONDS
static String	OFFSET_STATE_VALUE

Constructor Summary

Constructors

Constructor and Description
FlinkOffsetBackingStore()

Method Summary

Modifier and Type	Method and Description
void	configure(org.apache.kafka.connect.runtime.WorkerConfig config)
Future<Map<ByteBuffer,ByteBuffer>>	get(Collection<ByteBuffer> keys)
Future<Void>	set(Map<ByteBuffer,ByteBuffer> values, org.apache.kafka.connect.util.Callback<Void> callback)
void	start()
void	stop()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OFFSET_STATE_VALUE

public static final String OFFSET_STATE_VALUE

See Also:

Constant Field Values

FLUSH_TIMEOUT_SECONDS

public static final int FLUSH_TIMEOUT_SECONDS

See Also:

Constant Field Values

data

protected Map<ByteBuffer,ByteBuffer> data

executor

protected ExecutorService executor

Constructor Detail

FlinkOffsetBackingStore

public FlinkOffsetBackingStore()

Method Detail

configure

public void configure(org.apache.kafka.connect.runtime.WorkerConfig config)

Specified by:

configure in interface org.apache.kafka.connect.storage.OffsetBackingStore

start

public void start()

Specified by:

start in interface org.apache.kafka.connect.storage.OffsetBackingStore

stop

public void stop()

Specified by:

stop in interface org.apache.kafka.connect.storage.OffsetBackingStore

get

public Future<Map<ByteBuffer,ByteBuffer>> get(Collection<ByteBuffer> keys)

Specified by:

get in interface org.apache.kafka.connect.storage.OffsetBackingStore

set

public Future<Void> set(Map<ByteBuffer,ByteBuffer> values,
                        org.apache.kafka.connect.util.Callback<Void> callback)

Specified by:

set in interface org.apache.kafka.connect.storage.OffsetBackingStore