confluent

Type Members

1. case class CatalystDataToConfluentAvro(child: Expression, subject: String, confluentHelper: ConfluentClient, updateAllowed: Boolean, mutualReadCheck: Boolean = false) extends UnaryExpression with Logging with Product with Serializable

   

2. case class ConfluentAvroDataToCatalyst(child: Expression, subject: String, confluentHelper: ConfluentClient) extends UnaryExpression with ExpectsInputTypes with Product with Serializable

   

3. class ConfluentClient extends Logging with Serializable

   

   Wrapper for schema registry client.

   Wrapper for schema registry client. It supports advanced logic for schema compatibility check and update. It provides Spark SQL functions from/to_confluent_avro for decoding/encoding confluent avro messages.

4. class IncompatibleSchemaException extends Exception

   

5. class MyAvroSerializer extends Logging

   

   A serializer to serialize data in catalyst format to data in avro format.

   A serializer to serialize data in catalyst format to data in avro format.

   copied from org.apache.spark.sql.avro.* Changes: - backport support for nullable vs non-nullable types in resolveNullableType - enhance resolveNullableType to support converting NullType to Null-Union - enhance resolveNullableType to support converting not nullable type to Null-Union - improve exception messages by adding field name

6. class SchemaIncompatibleException extends Exception

   

7. case class SetNullable(child: Expression, forcedNullable: Boolean) extends UnaryExpression with Product with Serializable

   

8. class SubjectNotExistingException extends Exception