Spark requires nested objects to be expanded in tupled form in order to be properly encoded.
Spark requires nested objects to be expanded in tupled form in order to be properly encoded.
In order to do this, we have to find the needed Entity by looking up the field identity
and then expand it's fields. When a Spark Dataset is encoded via "liftDataset",
we attempt to do the same thing by pulling out the case class (and it's fields)
from the ScalarValueLift.
Spark requires nested objects to be expanded in tupled form in order to be properly encoded. In order to do this, we have to find the needed Entity by looking up the field identity and then expand it's fields. When a Spark Dataset is encoded via "liftDataset", we attempt to do the same thing by pulling out the case class (and it's fields) from the ScalarValueLift.