HpccRelation (spark-hpcc 8.10.58-1 API)

java.lang.Object
- org.apache.spark.sql.sources.BaseRelation
- - org.hpccsystems.spark.datasource.HpccRelation

All Implemented Interfaces:: org.apache.spark.sql.sources.PrunedFilteredScan

public class HpccRelation
extends org.apache.spark.sql.sources.BaseRelation
implements org.apache.spark.sql.sources.PrunedFilteredScan

Represents a dataset in HPCC Systems with a known schema.

Constructor Summary

Constructors
Constructor Description

HpccRelation(org.apache.spark.sql.SQLContext context, HpccOptions opts)

Method Summary

All Methods Instance Methods Concrete Methods
Modifier and Type	Method	Description
`org.apache.spark.rdd.RDD<org.apache.spark.sql.Row>`	`buildScan(String[] requiredColumns, org.apache.spark.sql.sources.Filter[] filters)`
`boolean`	`equals(Object rhs)`
`boolean`	`needConversion()`
`org.apache.spark.sql.types.StructType`	`schema()`
`long`	`sizeInBytes()`
`org.apache.spark.sql.SQLContext`	`sqlContext()`
`org.apache.spark.sql.sources.Filter[]`	`unhandledFilters(org.apache.spark.sql.sources.Filter[] filters)`

Methods inherited from class java.lang.Object
clone, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HpccRelation

public HpccRelation(org.apache.spark.sql.SQLContext context,
                    HpccOptions opts)

Method Detail
- needConversion
```
public boolean needConversion()
```
  Overrides:
  
  needConversion in class org.apache.spark.sql.sources.BaseRelation
- schema
```
public org.apache.spark.sql.types.StructType schema()
```
  Specified by:
  
  schema in class org.apache.spark.sql.sources.BaseRelation
- sizeInBytes
```
public long sizeInBytes()
```
  Overrides:
  
  sizeInBytes in class org.apache.spark.sql.sources.BaseRelation
- sqlContext
```
public org.apache.spark.sql.SQLContext sqlContext()
```
  Specified by:
  
  sqlContext in class org.apache.spark.sql.sources.BaseRelation
- unhandledFilters
```
public org.apache.spark.sql.sources.Filter[] unhandledFilters(org.apache.spark.sql.sources.Filter[] filters)
```
  Overrides:
  
  unhandledFilters in class org.apache.spark.sql.sources.BaseRelation
- buildScan
```
public org.apache.spark.rdd.RDD<org.apache.spark.sql.Row> buildScan(String[] requiredColumns,
                                                                    org.apache.spark.sql.sources.Filter[] filters)
```
  Specified by:
  
  buildScan in interface org.apache.spark.sql.sources.PrunedFilteredScan
- equals
```
public boolean equals(Object rhs)
```
  Overrides:
  
  equals in class Object