Package io.debezium.relational

Class TableSchemaBuilder

java.lang.Object
io.debezium.relational.TableSchemaBuilder
@ThreadSafe @Immutable public class TableSchemaBuilder extends Object
Builder that constructs TableSchema instances for Table definitions.

This builder is responsible for mapping table columns to fields in Kafka Connect Schemas, and this is necessarily dependent upon the database's supported types. Although mappings are defined for standard types, this class may need to be subclassed for each DBMS to add support for DBMS-specific types by overriding any of the "add*Field" methods.

See the Java SE Mapping SQL and Java Types for details about how JDBC types map to Java value types.

Author:
Randall Hauch

  • Field Details

    • LOGGER

      private static final org.slf4j.Logger LOGGER

    • schemaNameAdjuster

      private final SchemaNameAdjuster schemaNameAdjuster

    • valueConverterProvider

      private final ValueConverterProvider valueConverterProvider

    • defaultValueConverter

      private final DefaultValueConverter defaultValueConverter

    • sourceInfoSchema

      private final org.apache.kafka.connect.data.Schema sourceInfoSchema

    • fieldNamer

      private final FieldNameSelector.FieldNamer<Column> fieldNamer

    • customConverterRegistry

      private final CustomConverterRegistry customConverterRegistry

    • multiPartitionMode

      private final boolean multiPartitionMode

  • Constructor Details

    • TableSchemaBuilder

      public TableSchemaBuilder(ValueConverterProvider valueConverterProvider, SchemaNameAdjuster schemaNameAdjuster, CustomConverterRegistry customConverterRegistry, org.apache.kafka.connect.data.Schema sourceInfoSchema, boolean sanitizeFieldNames, boolean multiPartitionMode)
      Create a new instance of the builder.
      Parameters:
      valueConverterProvider - the provider for obtaining ValueConverters and SchemaBuilders; may not be null
      schemaNameAdjuster - the adjuster for schema names; may not be null

    • TableSchemaBuilder

      public TableSchemaBuilder(ValueConverterProvider valueConverterProvider, DefaultValueConverter defaultValueConverter, SchemaNameAdjuster schemaNameAdjuster, CustomConverterRegistry customConverterRegistry, org.apache.kafka.connect.data.Schema sourceInfoSchema, boolean sanitizeFieldNames, boolean multiPartitionMode)
      Create a new instance of the builder.
      Parameters:
      valueConverterProvider - the provider for obtaining ValueConverters and SchemaBuilders; may not be null
      defaultValueConverter - is used to convert the default value literal to a Java type recognized by value converters for a subset of types. may be null.
      schemaNameAdjuster - the adjuster for schema names; may not be null

  • Method Details

    • create

      public TableSchema create(TopicNamingStrategy topicNamingStrategy, Table table, Tables.ColumnNameFilter filter, ColumnMappers mappers, Key.KeyMapper keysMapper)
      Create a TableSchema from the given table definition. The resulting TableSchema will have a key schema that contains all of the columns that make up the table's primary key, and a value schema that contains only those columns that are not in the table's primary key.

      This is equivalent to calling create(table,false).

      Parameters:
      topicNamingStrategy - the topic naming strategy
      table - the table definition; may not be null
      filter - the filter that specifies whether columns in the table should be included; may be null if all columns are to be included
      mappers - the mapping functions for columns; may be null if none of the columns are to be mapped to different values
      Returns:
      the table schema that can be used for sending rows of data for this table to Kafka Connect; never null

    • isMultiPartitionMode

      public boolean isMultiPartitionMode()

    • createKeyGenerator

      protected StructGenerator createKeyGenerator(org.apache.kafka.connect.data.Schema schema, TableId columnSetName, List<Column> columns, TopicNamingStrategy topicNamingStrategy)
      Creates the function that produces a Kafka Connect key object for a row of data.
      Parameters:
      schema - the Kafka Connect schema for the key; may be null if there is no known schema, in which case the generator will be null
      columnSetName - the name for the set of columns, used in error messages; may not be null
      columns - the column definitions for the table that defines the row; may not be null
      topicNamingStrategy - the topic naming strategy
      Returns:
      the key-generating function, or null if there is no key schema

    • validateIncomingRowToInternalMetadata

      private void validateIncomingRowToInternalMetadata(int[] recordIndexes, org.apache.kafka.connect.data.Field[] fields, ValueConverter[] converters, Object[] row, int position)

    • createValueGenerator

      protected StructGenerator createValueGenerator(org.apache.kafka.connect.data.Schema schema, TableId tableId, List<Column> columns, Tables.ColumnNameFilter filter, ColumnMappers mappers)
      Creates the function that produces a Kafka Connect value object for a row of data.
      Parameters:
      schema - the Kafka Connect schema for the value; may be null if there is no known schema, in which case the generator will be null
      tableId - the table identifier; may not be null
      columns - the column definitions for the table that defines the row; may not be null
      filter - the filter that specifies whether columns in the table should be included; may be null if all columns are to be included
      mappers - the mapping functions for columns; may be null if none of the columns are to be mapped to different values
      Returns:
      the value-generating function, or null if there is no value schema

    • indexesForColumns

      protected int[] indexesForColumns(List<Column> columns)

    • fieldsForColumns

      protected org.apache.kafka.connect.data.Field[] fieldsForColumns(org.apache.kafka.connect.data.Schema schema, List<Column> columns)

    • convertersForColumns

      protected ValueConverter[] convertersForColumns(org.apache.kafka.connect.data.Schema schema, TableId tableId, List<Column> columns, ColumnMappers mappers)
      Obtain the array of converters for each column in a row. A converter might be null if the column is not be included in the records.
      Parameters:
      schema - the schema; may not be null
      tableId - the identifier of the table that contains the columns
      columns - the columns in the row; may not be null
      mappers - the mapping functions for columns; may be null if none of the columns are to be mapped to different values
      Returns:
      the converters for each column in the rows; never null

    • wrapInMappingConverterIfNeeded

      private ValueConverter wrapInMappingConverterIfNeeded(ColumnMappers mappers, TableId tableId, Column column, ValueConverter converter)

    • addField

      protected void addField(org.apache.kafka.connect.data.SchemaBuilder builder, Table table, Column column, ColumnMapper mapper)
      Add to the supplied SchemaBuilder a field for the column with the given information.
      Parameters:
      builder - the schema builder; never null
      table - the table definition; never null
      column - the column definition
      mapper - the mapping function for the column; may be null if the columns is not to be mapped to different values

    • createValueConverterFor

      protected ValueConverter createValueConverterFor(TableId tableId, Column column, org.apache.kafka.connect.data.Field fieldDefn)
      Create a ValueConverter that can be used to convert row values for the given column into the Kafka Connect value object described by the field definition. This uses the supplied ValueConverterProvider object.
      Parameters:
      tableId - the id of the table containing the column; never null
      column - the column describing the input values; never null
      fieldDefn - the definition for the field in a Kafka Connect Schema describing the output of the function; never null
      Returns:
      the value conversion function; may not be null