DataFrameEnhancements

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. def alignSchema(structType: StructType): DataFrame

   

   Using utils selector from getDataFrameSelector aligns the utils of a DataFrame to the selector for operations where utils order might be important (e.g.

   Using utils selector from getDataFrameSelector aligns the utils of a DataFrame to the selector for operations where utils order might be important (e.g. hashing the whole rows and using except)

   structType

   model structType for the alignment of df

   returns

   Returns aligned and filtered utils

5. def alignSchema(selector: List[Column]): DataFrame

   

   Using utils selector returned from StructTypeEnhancements.getDataFrameSelector aligns the utils of a DataFrame to the selector for operations where utils order might be important (e.g.

   Using utils selector returned from StructTypeEnhancements.getDataFrameSelector aligns the utils of a DataFrame to the selector for operations where utils order might be important (e.g. hashing the whole rows and using except)

   selector

   model structType for the alignment of df

   returns

   Returns aligned and filtered utils

6. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

7. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

8. def dataAsString(numRows: Int, truncate: Int, vertical: Boolean): String

   

9. def dataAsString(numRows: Int, truncate: Int): String

   

10. def dataAsString(numRows: Int, truncate: Boolean): String

    

11. def dataAsString(truncate: Boolean): String

    

12. def dataAsString(): String

    

13. val df: DataFrame

    

14. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

15. def equals(arg0: Any): Boolean

    

    Definition Classes

    AnyRef → Any

16. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

17. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

18. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

19. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

20. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

21. final def notify(): Unit

    

    Definition Classes

    AnyRef

22. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

23. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

24. def toString(): String

    

    Definition Classes

    AnyRef → Any

25. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

26. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

27. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

28. def withColumnIfDoesNotExist(ifExists: (DataFrame, String) ⇒ DataFrame)(colName: String, colExpr: Column): DataFrame

    

    Adds a column to a dataframe if it does not exist

    Adds a column to a dataframe if it does not exist

    ifExists

    A function to apply when the column already exists

    colName

    A column to add if it does not exist already

    colExpr

    An expression for the column to add

    returns

    a new dataframe with the new column