The StreamingSqlProcessor is a base class that can support multiple implementation, mainly designed to support registering custom SQL functions (UDFs) to make them available while running the queries.
Context class for the FormatConverter
Context class for the FormatConverter
data source
data sink
The SqlProcessor is a base class that can support multiple implementation, mainly designed to support registering custom SQL functions (UDFs) to make them available while running the queries.
Context class for the StreamingFormatConverter
Context class for the StreamingFormatConverter
data source
data sink
Load a file into a DataFrame and save it as a file in the specified path.
Load a file into a DataFrame and save it as a file in the specified path.
This is the most basic implementation of the SQL processor and it registers no custom functions
This is the most basic implementation of the SQL processor and it registers no custom functions
Load a file into a org.apache.spark.sql.DataFrame and save it as a file in the specified path.
Load a file into a org.apache.spark.sql.DataFrame and save it as a file in the specified path.
Replace variables marked by {{}}
inside the given text
from the map holding variable names as keys and
the values to be replaced as values.