AvroSerDe
Related Doc:
package avro
This class provides the method that converts binary Avro records from a Dataframe into Spark Rows on the fly.
This class provides the method that converts binary Avro records from a Dataframe into Spark Rows on the fly.
It loads binary data from a stream and feed them into an Avro/Spark decoder, returning the resulting rows.
It requires the path to the Avro schema which defines the records to be read.
This class provides methods to perform the translation from Dataframe Rows into Avro records on the fly.
This class provides methods to perform the translation from Dataframe Rows into Avro records on the fly.
Users can either, inform the path to the destination Avro schema or inform record name and namespace and the schema will be inferred from the Dataframe.
The methods are "storage-agnostic", which means they provide Dataframes of Avro records which can be stored into any sink (e.g. Kafka, Parquet, etc).
This class provides the method that converts binary Avro records from a stream into Spark Rows on the fly.
This class provides the method that converts binary Avro records from a stream into Spark Rows on the fly.
It loads binary data from a stream and feed them into an Avro/Spark decoder, returning the resulting rows.
It requires the path to the Avro schema which defines the records to be read.
This object provides the main point of integration between applications and this library.
It is STRONGLY recommended that users of this library understand the concept behind za.co.absa.abris.avro.schemas.policy.SchemaRetentionPolicies.