Package org.hpccsystems.spark.datasource

Class HpccRelationProvider

java.lang.Object

org.hpccsystems.spark.datasource.HpccRelationProvider

All Implemented Interfaces:

org.apache.spark.sql.sources.CreatableRelationProvider, org.apache.spark.sql.sources.DataSourceRegister, org.apache.spark.sql.sources.RelationProvider

public class HpccRelationProvider
extends Object
implements org.apache.spark.sql.sources.RelationProvider, org.apache.spark.sql.sources.CreatableRelationProvider, org.apache.spark.sql.sources.DataSourceRegister

Registers HPCC Systems as a DataSource. Allows reading of a dataset in HPCC Systems and writing a new dataset to HPCC Systems.

Constructor Summary

Constructors

Constructor	Description
HpccRelationProvider()

Method Summary

Modifier and Type	Method	Description
org.apache.spark.sql.sources.BaseRelation	createRelation(org.apache.spark.sql.SQLContext sqlContext, org.apache.spark.sql.SaveMode mode, scala.collection.immutable.Map<String,String> parameters, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> data)
org.apache.spark.sql.sources.BaseRelation	createRelation(org.apache.spark.sql.SQLContext sqlContext, scala.collection.immutable.Map<String,String> parameters)
String	shortName()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HpccRelationProvider

public HpccRelationProvider()

Method Detail

shortName

public String shortName()

Specified by:

shortName in interface org.apache.spark.sql.sources.DataSourceRegister

createRelation

public org.apache.spark.sql.sources.BaseRelation createRelation(org.apache.spark.sql.SQLContext sqlContext,
                                                                scala.collection.immutable.Map<String,String> parameters)

Specified by:

createRelation in interface org.apache.spark.sql.sources.RelationProvider

createRelation

public org.apache.spark.sql.sources.BaseRelation createRelation(org.apache.spark.sql.SQLContext sqlContext,
                                                                org.apache.spark.sql.SaveMode mode,
                                                                scala.collection.immutable.Map<String,String> parameters,
                                                                org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> data)

Specified by:

createRelation in interface org.apache.spark.sql.sources.CreatableRelationProvider