Unique column operations
Concatenate string columns to form a single one
Concatenate string columns to form a single one
the String DoricColumns to concatenate
a reference of a single DoricColumn with all strings concatenated. If at least one is null will return null.
Concatenates multiple input string columns together into a single string column, using the given separator.
Concatenates multiple input string columns together into a single string column, using the given separator.
df.withColumn("res", concatWs("-".lit, col("col1"), col("col2"))) .show(false) +----+----+----+ |col1|col2| res| +----+----+----+ | 1| 1| 1-1| |null| 2| 2| | 3|null| 3| |null|null| | +----+----+----+
even if cols
contain null columns, it prints remaining string columns (or empty string).
Formats the arguments in printf-style and returns the result as a string column.
Formats the arguments in printf-style and returns the result as a string column.
Printf format
the String DoricColumns to format
Formats the arguments in printf-style and returns the result as a string column.
Creates a string column for the file name of the current Spark task.
Creates a string column for the file name of the current Spark task.
Creates a string column for the file name of the current Spark task.
Creates a string column for the file name of the current Spark task.