Literal to be used with the Spark DataFrame's .format method
Short literal name of SNOWFLAKE_SOURCE_NAME
Given a URI, verify that the Hadoop FileSystem for that URI is not the S3 block FileSystem.
Given a URI, verify that the Hadoop FileSystem for that URI is not the S3 block FileSystem.
spark-snowflakedb
cannot use this FileSystem because the files written to it will not be
readable by Snowflake (and vice versa).
Checks whether the S3 bucket for the given UI has an object lifecycle configuration to ensure cleanup of temporary files.
Checks whether the S3 bucket for the given UI has an object lifecycle configuration to ensure cleanup of temporary files. If no applicable configuration is found, this method logs a helpful warning for the user.
Check whether the giving DataFrame contains variant type or not
ensure a name wrapped with double quotes
Snowflake COPY and UNLOAD commands don't support s3n or s3a, but users may wish to use them for data loads.
Snowflake COPY and UNLOAD commands don't support s3n or s3a, but users may wish to use them for data loads. This function converts the URL back to the s3:// format.
Converts url for the copy command.
Converts url for the copy command. For S3, convert s3a|s3n to s3. For Azure, convert the wasb: url to azure: url.
the url to be used in hadoop/spark
the url to be used in Snowflake
check whether a name is quoted
Joins prefix URL a to path suffix b, and appends a trailing /, in order to create a temp directory path for S3.
Creates a randomly named temp directory path for intermediate data
create a map from string for column mapping
wrap a name with double quotes
wrap a name with double quotes without capitalize letters
Same as readMapFromFile, but accepts the file content as an argument
Returns a copy of the given URI with the user credentials removed.
Removes (hopefully :)) sensitive content from a query string
Various arbitrary helper functions