implicit class TimestampColumnLikeSyntax[T] extends AnyRef
- Grouped
- Alphabetic
- By Inheritance
- TimestampColumnLikeSyntax
- AnyRef
- Any
- by LiteralOps
- by any2stringadd
- by StringFormat
- by Ensuring
- by ArrowAssoc
- Hide All
- Show All
- Public
- All
Instance Constructors
- new TimestampColumnLikeSyntax(column: DoricColumn[T])(implicit arg0: TimestampType[T])
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
def
+(other: String): String
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to any2stringadd[TimestampColumnLikeSyntax[T]] performed by method any2stringadd in scala.Predef.
- Definition Classes
- any2stringadd
-
def
->[B](y: B): (TimestampColumnLikeSyntax[T], B)
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to ArrowAssoc[TimestampColumnLikeSyntax[T]] performed by method ArrowAssoc in scala.Predef.
- Definition Classes
- ArrowAssoc
- Annotations
- @inline()
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
ensuring(cond: (TimestampColumnLikeSyntax[T]) ⇒ Boolean, msg: ⇒ Any): TimestampColumnLikeSyntax[T]
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: (TimestampColumnLikeSyntax[T]) ⇒ Boolean): TimestampColumnLikeSyntax[T]
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: Boolean, msg: ⇒ Any): TimestampColumnLikeSyntax[T]
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: Boolean): TimestampColumnLikeSyntax[T]
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to Ensuring[TimestampColumnLikeSyntax[T]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
def
formatted(fmtstr: String): String
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to StringFormat[TimestampColumnLikeSyntax[T]] performed by method StringFormat in scala.Predef.
- Definition Classes
- StringFormat
- Annotations
- @inline()
-
def
fromUtc(timeZone: StringColumn): TimestampColumn
Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in UTC, and renders that time as a timestamp in the given time zone.
Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in UTC, and renders that time as a timestamp in the given time zone. For example, 'GMT+1' would yield '2017-07-14 03:40:00.0'.
- Exceptions thrown
java.time.DateTimeException
if invalid timeZone- To do
scaladoc link (issue #135)
- See also
org.apache.spark.sql.functions.from_utc_timestamp
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
def
lit(implicit l: Location): LiteralDoricColumn[TimestampColumnLikeSyntax[T]]
Transforms the original value to a literal.
Transforms the original value to a literal.
- returns
a literal with the same type.
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to doric.LiteralOps[TimestampColumnLikeSyntax[T]] performed by method LiteralOps in doric.syntax.LiteralConversions. This conversion will take place only if an implicit value of type SparkType[TimestampColumnLikeSyntax[T]] is in scope and at the same time an implicit value of type LiteralSparkType[TimestampColumnLikeSyntax[T]] is in scope.
- Definition Classes
- LiteralOps
- Annotations
- @inline()
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
second: IntegerColumn
Extracts the seconds as an integer from a given timestamp.
Extracts the seconds as an integer from a given timestamp.
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toDate: DateColumn
Safe casting to Date column
Safe casting to Date column
- returns
a Date Column without the hour
-
def
toLocalDate: LocalDateColumn
Safe casting to LocalDate column
Safe casting to LocalDate column
- returns
a LocalDate Column without the hour
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
def
toUtc(timeZone: StringColumn): TimestampColumn
Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in the given time zone, and renders that time as a timestamp in UTC.
Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in the given time zone, and renders that time as a timestamp in UTC. For example, 'GMT+1' would yield '2017-07-14 01:40:00.0'.
- Exceptions thrown
java.time.DateTimeException
if invalid timeZone- To do
scaladoc link (issue #135)
- See also
org.apache.spark.sql.functions.to_utc_timestamp
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
def
window(windowDuration: String, slideDuration: String, startTime: String = "0 second"): RowColumn
Generates tumbling time windows given a timestamp specifying column.
Generates tumbling time windows given a timestamp specifying column. Window starts are inclusive but the window ends are exclusive.
- windowDuration
A string specifying the width of the window, e.g.
10 minutes
,1 second
. Checkorg.apache.spark.unsafe.types.CalendarInterval
for valid duration identifiers. Note that the duration is a fixed length of time, and does not vary over time according to a calendar. For example,1 day
always means 86,400,000 milliseconds, not a calendar day.- slideDuration
A string specifying the sliding interval of the window, e.g.
1 minute
. A new window will be generated everyslideDuration
. Must be less than or equal to thewindowDuration
. Checkorg.apache.spark.unsafe.types.CalendarInterval
for valid duration identifiers. This duration is likewise absolute, and does not vary according to a calendar.- startTime
The offset with respect to 1970-01-01 00:00:00 UTC with which to start window intervals. For example, in order to have hourly tumbling windows that start 15 minutes past the hour, e.g. 12:15-13:15, 13:15-14:15... provide
startTime
as15 minutes
.
-
def
window(windowDuration: String): RowColumn
Generates tumbling time windows given a timestamp specifying column.
Generates tumbling time windows given a timestamp specifying column. Window starts are inclusive but the window ends are exclusive.
- windowDuration
A string specifying the width of the window, e.g.
10 minutes
,1 second
. Checkorg.apache.spark.unsafe.types.CalendarInterval
for valid duration identifiers.
-
def
→[B](y: B): (TimestampColumnLikeSyntax[T], B)
- Implicit
- This member is added by an implicit conversion from TimestampColumnLikeSyntax[T] to ArrowAssoc[TimestampColumnLikeSyntax[T]] performed by method ArrowAssoc in scala.Predef.
- Definition Classes
- ArrowAssoc