DStructOps

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. def +(other: String): String

   

   Implicit information

   This member is added by an implicit conversion from DStructOps[T] to any2stringadd[DStructOps[T]] performed by method any2stringadd in scala.Predef.

   Definition Classes

   any2stringadd

4. def ->[B](y: B): (DStructOps[T], B)

   

   Implicit information

   This member is added by an implicit conversion from DStructOps[T] to ArrowAssoc[DStructOps[T]] performed by method ArrowAssoc in scala.Predef.

   Definition Classes

   ArrowAssoc

   Annotations

   @inline()

5. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

6. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

7. def child: DynamicFieldAccessor[T]

   

8. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

9. def ensuring(cond: (DStructOps[T]) ⇒ Boolean, msg: ⇒ Any): DStructOps[T]

   

   Implicit information

   This member is added by an implicit conversion from DStructOps[T] to Ensuring[DStructOps[T]] performed by method Ensuring in scala.Predef.

   Definition Classes

   Ensuring

10. def ensuring(cond: (DStructOps[T]) ⇒ Boolean): DStructOps[T]

    

    Implicit information

    This member is added by an implicit conversion from DStructOps[T] to Ensuring[DStructOps[T]] performed by method Ensuring in scala.Predef.

    Definition Classes

    Ensuring

11. def ensuring(cond: Boolean, msg: ⇒ Any): DStructOps[T]

    

    Implicit information

    This member is added by an implicit conversion from DStructOps[T] to Ensuring[DStructOps[T]] performed by method Ensuring in scala.Predef.

    Definition Classes

    Ensuring

12. def ensuring(cond: Boolean): DStructOps[T]

    

    Implicit information

    This member is added by an implicit conversion from DStructOps[T] to Ensuring[DStructOps[T]] performed by method Ensuring in scala.Predef.

    Definition Classes

    Ensuring

13. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

14. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

15. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

16. def formatted(fmtstr: String): String

    

    Implicit information

    This member is added by an implicit conversion from DStructOps[T] to StringFormat[DStructOps[T]] performed by method StringFormat in scala.Predef.

    Definition Classes

    StringFormat

    Annotations

    @inline()

17. def getChild[T2](subColumnName: String)(implicit arg0: SparkType[T2], location: Location): DoricColumn[T2]

    

    Retrieves the child row of the Struct column

    Retrieves the child row of the Struct column

    T2

    the expected type of the child column.

    subColumnName

    the column name expected to find in the struct.

    location

    the location if an error is generated

    returns

    a reference to the child column of the provided type.

18. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

19. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

20. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

21. def lit(implicit l: Location): LiteralDoricColumn[DStructOps[T]]

    

    Transforms the original value to a literal.

    Transforms the original value to a literal.

    returns

    a literal with the same type.

    Implicit information

    This member is added by an implicit conversion from DStructOps[T] to doric.LiteralOps[DStructOps[T]] performed by method LiteralOps in doric.syntax.LiteralConversions. This conversion will take place only if an implicit value of type SparkType[DStructOps[T]] is in scope and at the same time an implicit value of type LiteralSparkType[DStructOps[T]] is in scope.

    Definition Classes

    LiteralOps

    Annotations

    @inline()

22. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

23. final def notify(): Unit

    

    Definition Classes

    AnyRef

24. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

25. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

26. def toJson(options: Map[String, String] = Map.empty): StringColumn

    

    Converts a column containing a StructType into a JSON string with the specified schema.

    Converts a column containing a StructType into a JSON string with the specified schema.

    Exceptions thrown

    java.lang.IllegalArgumentException in the case of an unsupported type.

    To do

    scaladoc link (issue #135)

    See also

    org.apache.spark.sql.functions.to_json(e:org\.apache\.spark\.sql\.Column,options:scala\.collection\.immutable\.Map\[java\.lang\.String,java\.lang\.String\]):* org.apache.spark.sql.functions.to_csv

27. def toString(): String

    

    Definition Classes

    AnyRef → Any

28. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

29. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

30. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

31. def →[B](y: B): (DStructOps[T], B)

    

    Implicit information

    This member is added by an implicit conversion from DStructOps[T] to ArrowAssoc[DStructOps[T]] performed by method ArrowAssoc in scala.Predef.

    Definition Classes

    ArrowAssoc