Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  def +(other: String): String

   Implicit

   This member is added by an implicit conversion from CommonColumns to any2stringadd[CommonColumns] performed by method any2stringadd in scala.Predef.

   Definition Classes

   any2stringadd

4.  def ->[B](y: B): (CommonColumns, B)

   Implicit

   This member is added by an implicit conversion from CommonColumns to ArrowAssoc[CommonColumns] performed by method ArrowAssoc in scala.Predef.

   Definition Classes

   ArrowAssoc

   Annotations

   @inline()

5.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

6.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

7.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

8.  def coalesce[T](cols: DoricColumn[T]*): DoricColumn[T]

   Returns the first column that is not null, or null if all inputs are null.

   Returns the first column that is not null, or null if all inputs are null.

   For example, coalesce(a, b, c) will return a if a is not null, or b if a is null and b is not null, or c if both a and b are null but c is not null.

   cols

   the DoricColumns to coalesce

   returns

   the first column that is not null, or null if all inputs are null.

   See also

   org.apache.spark.sql.functions.coalesce

9.  def col[T](colName: String)(implicit arg0: SparkType[T], location: Location): NamedDoricColumn[T]

   Retrieves a column with the provided name and the provided type.

   Retrieves a column with the provided name and the provided type.

   T

   the expected type of the column

   colName

   the name of the column to find.

   location

   error location.

   returns

   the column reference

   Definition Classes

   ColGetters

10.  def colArray[T](colName: String)(implicit arg0: ClassTag[T], location: Location, st: SparkType[Array[T]]): NamedDoricColumn[Array[T]]

    Retrieves a column with the provided name expecting it to be of array of T type.

    Retrieves a column with the provided name expecting it to be of array of T type.

    T

    the type of the elements of the array.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the array of T column reference.

    Definition Classes

    ColGetters

11.  def colArrayInt(colName: String)(implicit location: Location): NamedDoricColumn[Array[Int]]

    Retrieves a column with the provided name expecting it to be of array of integers type.

    Retrieves a column with the provided name expecting it to be of array of integers type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the array of integers column reference.

    Definition Classes

    ColGetters

12.  def colArrayString(colName: String)(implicit location: Location): NamedDoricColumn[Array[String]]

    Retrieves a column with the provided name expecting it to be of array of string type.

    Retrieves a column with the provided name expecting it to be of array of string type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the array of string column reference.

    Definition Classes

    ColGetters

13.  def colBinary(colName: String)(implicit location: Location): NamedDoricColumn[Array[Byte]]

    Retrieves a column with the provided name expecting it to be of array of bytes type.

    Retrieves a column with the provided name expecting it to be of array of bytes type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the binary column reference.

    Definition Classes

    ColGetters

14.  def colBoolean(colName: String)(implicit location: Location): NamedDoricColumn[Boolean]

    Retrieves a column with the provided name expecting it to be of double type.

    Retrieves a column with the provided name expecting it to be of double type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the long column reference

    Definition Classes

    ColGetters

15.  def colDate(colName: String)(implicit location: Location): NamedDoricColumn[Date]

    Retrieves a column with the provided name expecting it to be of Date type.

    Retrieves a column with the provided name expecting it to be of Date type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the Date column reference

    Definition Classes

    ColGetters

16.  def colDouble(colName: String)(implicit location: Location): NamedDoricColumn[Double]

    Retrieves a column with the provided name expecting it to be of double type.

    Retrieves a column with the provided name expecting it to be of double type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the double column reference

    Definition Classes

    ColGetters

17.  def colFloat(colName: String)(implicit location: Location): NamedDoricColumn[Float]

    Retrieves a column with the provided name expecting it to be of float type.

    Retrieves a column with the provided name expecting it to be of float type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the float column reference

    Definition Classes

    ColGetters

18.  def colFromDF[T](colName: String, originDF: Dataset[_])(implicit arg0: SparkType[T], location: Location): NamedDoricColumn[T]

    Retrieves a column of the provided dataframe.

    Retrieves a column of the provided dataframe. Useful to prevent column ambiguity errors.

    T

    the type of the doric column.

    colName

    the name of the column to find.

    originDF

    the dataframe to force the column.

    location

    error location.

    returns

    the column of type T column reference.

    Definition Classes

    ColGetters

19.  def colInstant(colName: String)(implicit location: Location): NamedDoricColumn[Instant]

    Retrieves a column with the provided name expecting it to be of instant type.

    Retrieves a column with the provided name expecting it to be of instant type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the instant column reference

    Definition Classes

    ColGetters

20.  def colInt(colName: String)(implicit location: Location): NamedDoricColumn[Int]

    Retrieves a column with the provided name expecting it to be of integer type.

    Retrieves a column with the provided name expecting it to be of integer type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the integer column reference

    Definition Classes

    ColGetters

21.  def colLocalDate(colName: String)(implicit location: Location): NamedDoricColumn[LocalDate]

    Retrieves a column with the provided name expecting it to be of LocalDate type.

    Retrieves a column with the provided name expecting it to be of LocalDate type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the LocalDate column reference

    Definition Classes

    ColGetters

22.  def colLong(colName: String)(implicit location: Location): NamedDoricColumn[Long]

    Retrieves a column with the provided name expecting it to be of long type.

    Retrieves a column with the provided name expecting it to be of long type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the long column reference

    Definition Classes

    ColGetters

23.  def colMap[K, V](colName: String)(implicit arg0: SparkType[K], arg1: SparkType[V], location: Location): NamedDoricColumn[Map[K, V]]

    Retrieves a column with the provided name expecting it to be of map type.

    Retrieves a column with the provided name expecting it to be of map type.

    K

    the type of the keys of the map.

    V

    the type of the values of the map.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the map column reference.

    Definition Classes

    ColGetters

24.  def colMapString[V](colName: String)(implicit arg0: SparkType[V], location: Location): NamedDoricColumn[Map[String, V]]

    Retrieves a column with the provided name expecting it to be of map type.

    Retrieves a column with the provided name expecting it to be of map type.

    V

    the type of the values of the map.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the map column reference.

    Definition Classes

    ColGetters

25.  def colNull(colName: String)(implicit location: Location): NamedDoricColumn[Null]

    Retrieves a column with the provided name expecting it to be of null type.

    Retrieves a column with the provided name expecting it to be of null type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the null column reference

    Definition Classes

    ColGetters

26.  def colString(colName: String)(implicit location: Location): NamedDoricColumn[String]

    Retrieves a column with the provided name expecting it to be of string type.

    Retrieves a column with the provided name expecting it to be of string type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the string column reference

    Definition Classes

    ColGetters

27.  def colStruct(colName: String)(implicit location: Location): NamedDoricColumn[Row]

    Retrieves a column with the provided name expecting it to be of struct type.

    Retrieves a column with the provided name expecting it to be of struct type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the struct column reference.

    Definition Classes

    ColGetters

28.  def colTimestamp(colName: String)(implicit location: Location): NamedDoricColumn[Timestamp]

    Retrieves a column with the provided name expecting it to be of Timestamp type.

    Retrieves a column with the provided name expecting it to be of Timestamp type.

    colName

    the name of the column to find.

    location

    error location.

    returns

    the Timestamp column reference

    Definition Classes

    ColGetters

29.  def constructSide[T](column: Doric[Column], colName: String): NamedDoricColumn[T]

    Attributes

    protected

    Definition Classes

    CommonColumns → ColGetters

30.  def ensuring(cond: (CommonColumns) ⇒ Boolean, msg: ⇒ Any): CommonColumns

    Implicit

    This member is added by an implicit conversion from CommonColumns to Ensuring[CommonColumns] performed by method Ensuring in scala.Predef.

    Definition Classes

    Ensuring

31.  def ensuring(cond: (CommonColumns) ⇒ Boolean): CommonColumns

    Implicit

    This member is added by an implicit conversion from CommonColumns to Ensuring[CommonColumns] performed by method Ensuring in scala.Predef.

    Definition Classes

    Ensuring

32.  def ensuring(cond: Boolean, msg: ⇒ Any): CommonColumns

    Implicit

    This member is added by an implicit conversion from CommonColumns to Ensuring[CommonColumns] performed by method Ensuring in scala.Predef.

    Definition Classes

    Ensuring

33.  def ensuring(cond: Boolean): CommonColumns

    Implicit

    This member is added by an implicit conversion from CommonColumns to Ensuring[CommonColumns] performed by method Ensuring in scala.Predef.

    Definition Classes

    Ensuring

34.  final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

35.  def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

36.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

37.  def formatted(fmtstr: String): String

    Implicit

    This member is added by an implicit conversion from CommonColumns to StringFormat[CommonColumns] performed by method StringFormat in scala.Predef.

    Definition Classes

    StringFormat

    Annotations

    @inline()

38.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

39.  def greatest[T](col: DoricColumn[T], cols: DoricColumn[T]*): DoricColumn[T]

    Returns the greatest value of the list of values, skipping null values.

    Returns the greatest value of the list of values, skipping null values. This function takes at least 2 parameters. It will return null iff all parameters are null.

    Note

    skips null values

    See also

    org.apache.spark.sql.functions.greatest

40.  def hash(cols: DoricColumn[_]*): IntegerColumn

    Calculates the hash code of given columns, and returns the result as an integer column.

    Calculates the hash code of given columns, and returns the result as an integer column.

    See also

    org.apache.spark.sql.functions.hash

41.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

42.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

43.  def least[T](col: DoricColumn[T], cols: DoricColumn[T]*): DoricColumn[T]

    Returns the least value of the list of values, skipping null values.

    Returns the least value of the list of values, skipping null values. This function takes at least 2 parameters. It will return null iff all parameters are null.

    Note

    skips null values

    See also

    org.apache.spark.sql.functions.least

44.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

45.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

46.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

47.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

48.  def toString(): String

    Definition Classes

    AnyRef → Any

49.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

50.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

51.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()

52.  def →[B](y: B): (CommonColumns, B)

    Implicit

    This member is added by an implicit conversion from CommonColumns to ArrowAssoc[CommonColumns] performed by method ArrowAssoc in scala.Predef.

    Definition Classes

    ArrowAssoc

53.  object row extends Dynamic

    The object row stands for the top-level row of the DataFrame.

    The object row stands for the top-level row of the DataFrame.

    Definition Classes

    ColGetters