Package io.debezium.transforms.partitions

Class PartitionRouting<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

java.lang.Object

io.debezium.transforms.partitions.PartitionRouting<R>

Type Parameters:

R - the subtype of ConnectRecord on which this transformation will operate

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.kafka.common.Configurable, org.apache.kafka.connect.transforms.Transformation<R>

public class PartitionRouting<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>
extends Object
implements org.apache.kafka.connect.transforms.Transformation<R>

This SMT allow to use payload fields to calculate the destination partition.

Author:

Mario Fiore Vitale

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	PartitionRouting.HashFunction

Field Summary

Fields

Modifier and Type	Field	Description
static final String	CHANGE_SPECIAL_FIELD
static final String	FIELD_HASH_FUNCTION
static final String	FIELD_PAYLOAD_FIELD_CONF
static final String	FIELD_TOPIC_PARTITION_NUM_CONF
(package private) static final Field	HASH_FUNCTION_FIELD
private PartitionRouting.HashFunction	hashFc
private static final org.slf4j.Logger	LOGGER
private static final MurmurHash3	MURMUR_HASH_3
static final String	NESTING_SEPARATOR
(package private) static final Field	PARTITION_PAYLOAD_FIELDS_FIELD
private int	partitionNumber
private List<String>	payloadFields
private SmtManager<R>	smtManager
(package private) static final Field	TOPIC_PARTITION_NUM_FIELD

Constructor Summary

Constructors

Constructor	Description
PartitionRouting()

Method Summary

Modifier and Type	Method	Description
R	apply(R originalRecord)
private R	buildNewRecord(R originalRecord, org.apache.kafka.connect.data.Struct envelope, int partition)
void	close()
protected int	computePartition(Integer partitionNumber, List<Object> values)
org.apache.kafka.common.config.ConfigDef	config()
void	configure(Map<String,?> props)
private static String	getFieldName(org.apache.kafka.connect.data.Struct envelope, String[] subFields, int i)
private static org.apache.kafka.connect.data.Struct	getLastStruct(org.apache.kafka.connect.data.Struct envelope, String[] subFields)
private Optional<Object>	toValue(String fieldName, org.apache.kafka.connect.data.Struct envelope)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOGGER

private static final org.slf4j.Logger LOGGER

MURMUR_HASH_3

private static final MurmurHash3 MURMUR_HASH_3

NESTING_SEPARATOR

public static final String NESTING_SEPARATOR

See Also:

• Constant Field Values

CHANGE_SPECIAL_FIELD

public static final String CHANGE_SPECIAL_FIELD

See Also:

• Constant Field Values

FIELD_PAYLOAD_FIELD_CONF

public static final String FIELD_PAYLOAD_FIELD_CONF

See Also:

• Constant Field Values

FIELD_TOPIC_PARTITION_NUM_CONF

public static final String FIELD_TOPIC_PARTITION_NUM_CONF

See Also:

• Constant Field Values

FIELD_HASH_FUNCTION

public static final String FIELD_HASH_FUNCTION

See Also:

• Constant Field Values

PARTITION_PAYLOAD_FIELDS_FIELD

static final Field PARTITION_PAYLOAD_FIELDS_FIELD

TOPIC_PARTITION_NUM_FIELD

static final Field TOPIC_PARTITION_NUM_FIELD

HASH_FUNCTION_FIELD

static final Field HASH_FUNCTION_FIELD

smtManager

private SmtManager<R extends org.apache.kafka.connect.connector.ConnectRecord<R>> smtManager

payloadFields

private List<String> payloadFields

partitionNumber

private int partitionNumber

hashFc

private PartitionRouting.HashFunction hashFc

Constructor Details

PartitionRouting

public PartitionRouting()

Method Details

config

public org.apache.kafka.common.config.ConfigDef config()

Specified by:

config in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

configure

public void configure(Map<String,?> props)

Specified by:

configure in interface org.apache.kafka.common.Configurable

apply

public R apply(R originalRecord)

Specified by:

apply in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>

toValue

private Optional<Object> toValue(String fieldName,
 org.apache.kafka.connect.data.Struct envelope)

getLastStruct

private static org.apache.kafka.connect.data.Struct getLastStruct(org.apache.kafka.connect.data.Struct envelope,
 String[] subFields)

getFieldName

private static String getFieldName(org.apache.kafka.connect.data.Struct envelope,
 String[] subFields,
 int i)

buildNewRecord

private R buildNewRecord(R originalRecord,
 org.apache.kafka.connect.data.Struct envelope,
 int partition)

computePartition

protected int computePartition(Integer partitionNumber,
 List<Object> values)

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Specified by:

close in interface org.apache.kafka.connect.transforms.Transformation<R extends org.apache.kafka.connect.connector.ConnectRecord<R>>