Package com.exasol.spark.s3
Class S3Source
- java.lang.Object
-
- com.exasol.spark.s3.S3Source
-
- All Implemented Interfaces:
org.apache.spark.sql.connector.catalog.TableProvider
,org.apache.spark.sql.sources.DataSourceRegister
public class S3Source extends Object implements org.apache.spark.sql.connector.catalog.TableProvider, org.apache.spark.sql.sources.DataSourceRegister
An S3 Spark Connector Source.
-
-
Constructor Summary
Constructors Constructor Description S3Source()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description org.apache.spark.sql.connector.catalog.Table
getTable(org.apache.spark.sql.types.StructType schema, org.apache.spark.sql.connector.expressions.Transform[] partitioning, Map<String,String> properties)
org.apache.spark.sql.types.StructType
inferSchema(org.apache.spark.sql.util.CaseInsensitiveStringMap map)
String
shortName()
boolean
supportsExternalMetadata()
-
-
-
Method Detail
-
shortName
public String shortName()
- Specified by:
shortName
in interfaceorg.apache.spark.sql.sources.DataSourceRegister
-
supportsExternalMetadata
public boolean supportsExternalMetadata()
- Specified by:
supportsExternalMetadata
in interfaceorg.apache.spark.sql.connector.catalog.TableProvider
-
inferSchema
public org.apache.spark.sql.types.StructType inferSchema(org.apache.spark.sql.util.CaseInsensitiveStringMap map)
- Specified by:
inferSchema
in interfaceorg.apache.spark.sql.connector.catalog.TableProvider
-
getTable
public org.apache.spark.sql.connector.catalog.Table getTable(org.apache.spark.sql.types.StructType schema, org.apache.spark.sql.connector.expressions.Transform[] partitioning, Map<String,String> properties)
- Specified by:
getTable
in interfaceorg.apache.spark.sql.connector.catalog.TableProvider
-
-