public static interface SparkSQL.Builder extends SdkPojo, CopyableBuilder<SparkSQL.Builder,SparkSQL>
Modifier and Type | Method and Description |
---|---|
SparkSQL.Builder |
inputs(Collection<String> inputs)
The data inputs identified by their node names.
|
SparkSQL.Builder |
inputs(String... inputs)
The data inputs identified by their node names.
|
SparkSQL.Builder |
name(String name)
The name of the transform node.
|
SparkSQL.Builder |
outputSchemas(Collection<GlueSchema> outputSchemas)
Specifies the data schema for the SparkSQL transform.
|
SparkSQL.Builder |
outputSchemas(Consumer<GlueSchema.Builder>... outputSchemas)
Specifies the data schema for the SparkSQL transform.
|
SparkSQL.Builder |
outputSchemas(GlueSchema... outputSchemas)
Specifies the data schema for the SparkSQL transform.
|
SparkSQL.Builder |
sqlAliases(Collection<SqlAlias> sqlAliases)
A list of aliases.
|
SparkSQL.Builder |
sqlAliases(Consumer<SqlAlias.Builder>... sqlAliases)
A list of aliases.
|
SparkSQL.Builder |
sqlAliases(SqlAlias... sqlAliases)
A list of aliases.
|
SparkSQL.Builder |
sqlQuery(String sqlQuery)
A SQL query that must use Spark SQL syntax and return a single data set.
|
equalsBySdkFields, sdkFields
copy
applyMutation, build
SparkSQL.Builder name(String name)
The name of the transform node.
name
- The name of the transform node.SparkSQL.Builder inputs(Collection<String> inputs)
The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.
inputs
- The data inputs identified by their node names. You can associate a table name with each input node to
use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.SparkSQL.Builder inputs(String... inputs)
The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.
inputs
- The data inputs identified by their node names. You can associate a table name with each input node to
use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.SparkSQL.Builder sqlQuery(String sqlQuery)
A SQL query that must use Spark SQL syntax and return a single data set.
sqlQuery
- A SQL query that must use Spark SQL syntax and return a single data set.SparkSQL.Builder sqlAliases(Collection<SqlAlias> sqlAliases)
A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example,
you have a datasource named "MyDataSource". If you specify From
as MyDataSource, and
Alias
as SqlName, then in your SQL you can do:
select * from SqlName
and that gets data from MyDataSource.
sqlAliases
- A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For
example, you have a datasource named "MyDataSource". If you specify From
as MyDataSource,
and Alias
as SqlName, then in your SQL you can do:
select * from SqlName
and that gets data from MyDataSource.
SparkSQL.Builder sqlAliases(SqlAlias... sqlAliases)
A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example,
you have a datasource named "MyDataSource". If you specify From
as MyDataSource, and
Alias
as SqlName, then in your SQL you can do:
select * from SqlName
and that gets data from MyDataSource.
sqlAliases
- A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For
example, you have a datasource named "MyDataSource". If you specify From
as MyDataSource,
and Alias
as SqlName, then in your SQL you can do:
select * from SqlName
and that gets data from MyDataSource.
SparkSQL.Builder sqlAliases(Consumer<SqlAlias.Builder>... sqlAliases)
A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example,
you have a datasource named "MyDataSource". If you specify From
as MyDataSource, and
Alias
as SqlName, then in your SQL you can do:
select * from SqlName
and that gets data from MyDataSource.
This is a convenience method that creates an instance of theSqlAlias.Builder
avoiding the need to create one manually
via SqlAlias.builder()
.
When the Consumer
completes,
SdkBuilder.build()
is called immediately and its
result is passed to #sqlAliases(List
.
sqlAliases
- a consumer that will call methods on
SqlAlias.Builder
#sqlAliases(java.util.Collection)
SparkSQL.Builder outputSchemas(Collection<GlueSchema> outputSchemas)
Specifies the data schema for the SparkSQL transform.
outputSchemas
- Specifies the data schema for the SparkSQL transform.SparkSQL.Builder outputSchemas(GlueSchema... outputSchemas)
Specifies the data schema for the SparkSQL transform.
outputSchemas
- Specifies the data schema for the SparkSQL transform.SparkSQL.Builder outputSchemas(Consumer<GlueSchema.Builder>... outputSchemas)
Specifies the data schema for the SparkSQL transform.
This is a convenience method that creates an instance of theGlueSchema.Builder
avoiding the need to create one
manually via GlueSchema.builder()
.
When the Consumer
completes,
SdkBuilder.build()
is called immediately and its
result is passed to #outputSchemas(List
.
outputSchemas
- a consumer that will call methods on
GlueSchema.Builder
#outputSchemas(java.util.Collection)
Copyright © 2022. All rights reserved.