This project enables HPCC Systems / Spark interoperability.
The DataAccess project contains the classes which expose distributed streaming of HPCC based data via Spark constructs. In addition, the HPCC data is exposed as a Dataframe for the convenience of the Spark developer.
| Package | Description |
|---|---|
| org.hpccsystems.generated |
Contains dynamically generated class populated with static build-time variables.
|
| org.hpccsystems.spark |
Provides access to data residing in HPCC Systems or Spark environments.
|
| org.hpccsystems.spark.datasource |
Provides mechanism to stream HPCC Systems data via Spark Relation.
|
| org.hpccsystems.ws.client.antlr |
Used internally to parse various formats of ECL record definitions.
|