This Source writes out the TupleEntry as a simple JSON object, using the field names as keys and the string representation of the values.
This Source writes out the TupleEntry as a simple JSON object, using the field names as keys and the string representation of the values.
TODO: it would be nice to have a way to add read/write transformations to pipes that doesn't require extending the sources and overriding methods.
When set to false, it just skips empty lines instead of failing the jobs. Defaults to true for backwards compatibility.
TODO: at the next binary incompatible version remove the AbstractFunction2/scala.Serializable jank which was added to get mima to not report binary errors
This type uses the structural type of a case class, but not it's name, to describe the Json using json4s.
This type uses the structural type of a case class, but not it's name, to describe the Json using json4s. This is intended to be used for intermediate output from a REPL session. The intended use is to save adhoc data between sessions. The fully qualified class name of classes defined in a REPL is not stable between REPL sessions.
We believe using a fixed schema, such as thrift or Avro is a much safer way to do long term productionized data pipelines to minimize risks of incompatible changes to schema that render old data unreadable.