Class

doric.syntax.TimestampColumns

TimestampColumnLikeSyntax

Related Doc: package TimestampColumns

Permalink

implicit class TimestampColumnLikeSyntax[T] extends AnyRef

Linear Supertypes
AnyRef, Any
Ordering
  1. Grouped
  2. Alphabetic
  3. By Inheritance
Inherited
  1. TimestampColumnLikeSyntax
  2. AnyRef
  3. Any
Implicitly
  1. by LiteralOps
  2. by any2stringadd
  3. by StringFormat
  4. by Ensuring
  5. by ArrowAssoc
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new TimestampColumnLikeSyntax(column: DoricColumn[T])(implicit arg0: TimestampType[T])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. def +(other: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to any2stringadd[TimestampColumnLikeSyntax[T]] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd

  4. def ->[B](y: B): (TimestampColumnLikeSyntax[T], B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to ArrowAssoc[TimestampColumnLikeSyntax[T]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()

  5. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def ensuring(cond: (TimestampColumnLikeSyntax[T]) ⇒ Boolean, msg: ⇒ Any): TimestampColumnLikeSyntax[T]

    Permalink
    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  9. def ensuring(cond: (TimestampColumnLikeSyntax[T]) ⇒ Boolean): TimestampColumnLikeSyntax[T]

    Permalink
    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  10. def ensuring(cond: Boolean, msg: ⇒ Any): TimestampColumnLikeSyntax[T]

    Permalink
    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  11. def ensuring(cond: Boolean): TimestampColumnLikeSyntax[T]

    Permalink
    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring

  12. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  13. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  14. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  15. def formatted(fmtstr: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to StringFormat[TimestampColumnLikeSyntax[T]] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()

  16. def fromUtc(timeZone: StringColumn): TimestampColumn

    Permalink

    Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in UTC, and renders that time as a timestamp in the given time zone.

    Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in UTC, and renders that time as a timestamp in the given time zone. For example, 'GMT+1' would yield '2017-07-14 03:40:00.0'.

    Exceptions thrown

    java.time.DateTimeException if invalid timeZone

    To do

    scaladoc link (issue #135)

    See also

    org.apache.spark.sql.functions.from_utc_timestamp

  17. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  18. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  19. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  20. def lit(implicit l: Location): LiteralDoricColumn[TimestampColumnLikeSyntax[T]]

    Permalink

    Transforms the original value to a literal.

    Transforms the original value to a literal.

    returns

    a literal with the same type.

    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to doric.LiteralOps[TimestampColumnLikeSyntax[T]] performed by method LiteralOps in doric.syntax.LiteralConversions. This conversion will take place only if an implicit value of type SparkType[TimestampColumnLikeSyntax[T]] is in scope and at the same time an implicit value of type LiteralSparkType[TimestampColumnLikeSyntax[T]] is in scope.
    Definition Classes
    LiteralOps
    Annotations
    @inline()

  21. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  22. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  23. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  24. def second: IntegerColumn

    Permalink

    Extracts the seconds as an integer from a given timestamp.

    Extracts the seconds as an integer from a given timestamp.

    See also

    org.apache.spark.sql.functions.second

  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  26. def toDate: DateColumn

    Permalink

    Safe casting to Date column

    Safe casting to Date column

    returns

    a Date Column without the hour

    See also

    org.apache.spark.sql.functions.to_date

  27. def toLocalDate: LocalDateColumn

    Permalink

    Safe casting to LocalDate column

    Safe casting to LocalDate column

    returns

    a LocalDate Column without the hour

    See also

    org.apache.spark.sql.functions.to_date

  28. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  29. def toUtc(timeZone: StringColumn): TimestampColumn

    Permalink

    Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in the given time zone, and renders that time as a timestamp in UTC.

    Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in the given time zone, and renders that time as a timestamp in UTC. For example, 'GMT+1' would yield '2017-07-14 01:40:00.0'.

    Exceptions thrown

    java.time.DateTimeException if invalid timeZone

    To do

    scaladoc link (issue #135)

    See also

    org.apache.spark.sql.functions.to_utc_timestamp

  30. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  31. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  32. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  33. def window(windowDuration: String, slideDuration: String, startTime: String = "0 second"): RowColumn

    Permalink

    Generates tumbling time windows given a timestamp specifying column.

    Generates tumbling time windows given a timestamp specifying column. Window starts are inclusive but the window ends are exclusive.

    windowDuration

    A string specifying the width of the window, e.g. 10 minutes, 1 second. Check org.apache.spark.unsafe.types.CalendarInterval for valid duration identifiers. Note that the duration is a fixed length of time, and does not vary over time according to a calendar. For example, 1 day always means 86,400,000 milliseconds, not a calendar day.

    slideDuration

    A string specifying the sliding interval of the window, e.g. 1 minute. A new window will be generated every slideDuration. Must be less than or equal to the windowDuration. Check org.apache.spark.unsafe.types.CalendarInterval for valid duration identifiers. This duration is likewise absolute, and does not vary according to a calendar.

    startTime

    The offset with respect to 1970-01-01 00:00:00 UTC with which to start window intervals. For example, in order to have hourly tumbling windows that start 15 minutes past the hour, e.g. 12:15-13:15, 13:15-14:15... provide startTime as 15 minutes.

    See also

    org.apache.spark.sql.functions.window

  34. def window(windowDuration: String): RowColumn

    Permalink

    Generates tumbling time windows given a timestamp specifying column.

    Generates tumbling time windows given a timestamp specifying column. Window starts are inclusive but the window ends are exclusive.

    windowDuration

    A string specifying the width of the window, e.g. 10 minutes, 1 second. Check org.apache.spark.unsafe.types.CalendarInterval for valid duration identifiers.

    See also

    org.apache.spark.sql.functions.window

  35. def →[B](y: B): (TimestampColumnLikeSyntax[T], B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to ArrowAssoc[TimestampColumnLikeSyntax[T]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion LiteralOps from TimestampColumnLikeSyntax[T] to doric.LiteralOps[TimestampColumnLikeSyntax[T]]

Inherited by implicit conversion any2stringadd from TimestampColumnLikeSyntax[T] to any2stringadd[TimestampColumnLikeSyntax[T]]

Inherited by implicit conversion StringFormat from TimestampColumnLikeSyntax[T] to StringFormat[TimestampColumnLikeSyntax[T]]

Inherited by implicit conversion Ensuring from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]]

Inherited by implicit conversion ArrowAssoc from TimestampColumnLikeSyntax[T] to ArrowAssoc[TimestampColumnLikeSyntax[T]]

Timestamp Type

Ungrouped