types

Type Members

1. case class ArrayType(elementType: DataType, containsNull: Boolean) extends DataType with Product with Serializable

   The data type for collections of multiple values.

2. abstract class AtomicType extends DataType

   An internal type used to represent everything that is not null, UDTs, arrays, structs, and maps.

3. class BinaryType extends AtomicType

   The data type representing Array[Byte] values.

4. class BooleanType extends AtomicType

   The data type representing Boolean values.

5. class ByteType extends IntegralType

   The data type representing Byte values.

6. class CalendarIntervalType extends DataType

   The data type representing calendar time intervals.

7. abstract class DataType extends AbstractDataType

   The base type of all Spark SQL data types.

8. class DataTypes extends AnyRef

9. class DateType extends AtomicType

   A date type, supporting "0001-01-01" through "9999-12-31".

10. final class Decimal extends Ordered[Decimal] with Serializable

    A mutable implementation of BigDecimal that can hold a Long if values are small enough.

11. case class DecimalType(precision: Int, scale: Int) extends FractionalType with Product with Serializable

    The data type representing java.math.BigDecimal values.

12. class DoubleType extends FractionalType

    The data type representing Double values.

13. class FloatType extends FractionalType

    The data type representing Float values.

14. class IntegerType extends IntegralType

    The data type representing Int values.

15. class LongType extends IntegralType

    The data type representing Long values.

16. case class MapType(keyType: DataType, valueType: DataType, valueContainsNull: Boolean) extends DataType with Product with Serializable

    The data type for Maps.

17. sealed class Metadata extends Serializable

    Metadata is a wrapper over Map[String, Any] that limits the value type to simple ones: Boolean, Long, Double, String, Metadata, Array[Boolean], Array[Long], Array[Double], Array[String], and Array[Metadata].

18. class MetadataBuilder extends AnyRef

    Builder for Metadata.

19. class NullType extends DataType

    The data type representing NULL values.

20. abstract class NumericType extends AtomicType

    Numeric data types.

21. case class ObjectType(cls: Class[_]) extends DataType with Product with Serializable

    Represents a JVM object that is passing through Spark SQL expression evaluation.

22. class SQLUserDefinedType extends Annotation with Annotation with ClassfileAnnotation

23. class ShortType extends IntegralType

    The data type representing Short values.

24. class StringType extends AtomicType

    The data type representing String values.

25. case class StructField(name: String, dataType: DataType, nullable: Boolean = true, metadata: Metadata = Metadata.empty) extends Product with Serializable

    A field inside a StructType.

26. case class StructType(fields: Array[StructField]) extends DataType with Seq[StructField] with Product with Serializable

    A StructType object can be constructed by

27. class TimestampType extends AtomicType

    The data type representing java.sql.Timestamp values.