org.apache.spark.sql.catalyst.encoders
The schema after converting T to a Spark SQL row.
A set of expressions, one for each top-level field that can be used to extract the values from a raw object into an InternalRow.
An expression that will construct an object given an InternalRow.
A classtag for T.
The process of resolution to a given schema throws away information about where a given field is being bound by ordinal instead of by name.
The process of resolution to a given schema throws away information about where a given field is being bound by ordinal instead of by name. This method checks to make sure this process has not been done already in places where we plan to do later composition of encoders.
A classtag for T.
A classtag for T.
An expression that will construct an object given an InternalRow.
Returns an object of type T, extracting the required values from the provided row.
Returns an object of type T, extracting the required values from the provided row. Note that
you must resolveAndBind an encoder to a specific schema before you can call this
function.
Returns a new set (with unique ids) of NamedExpression that represent the serialized form of this object.
Returns a new copy of this encoder, where the deserializer is resolved and bound to the
given schema.
Returns a new copy of this encoder, where the deserializer is resolved and bound to the
given schema.
Note that, ideally encoder is used as a container of serde expressions, the resolution and binding stuff should happen inside query framework. However, in some cases we need to use encoder as a function to do serialization directly(e.g. Dataset.collect), then we can use this method to do resolution and binding outside of query framework.
The schema after converting T to a Spark SQL row.
The schema after converting T to a Spark SQL row.
A set of expressions, one for each top-level field that can be used to extract the values from a raw object into an InternalRow.
Returns an encoded version of t as a Spark SQL row.
Returns an encoded version of t as a Spark SQL row. Note that multiple calls to
toRow are allowed to return the same actual InternalRow object. Thus, the caller should
copy the result before making another call if required.
A generic encoder for JVM objects.
The schema after converting
Tto a Spark SQL row.A set of expressions, one for each top-level field that can be used to extract the values from a raw object into an InternalRow.
An expression that will construct an object given an InternalRow.
A classtag for
T.