netezza

Type Members

1. class DefaultSource extends RelationProvider with DataSourceRegister

   

   Implements base relation for Netezza data source.

   Implements base relation for Netezza data source. This relation is used when user specifies "com.ibm.spark.netezza' or 'netezza' as data format for the data frame reader or in the DDL operation with USING clause.

   Netezza data source implementations is based on in-built Spark SQL JDBC datasource.

2. class NetezzaDataReader extends Iterator[NetezzaRow]

   

   Creates reader for the given partitions.

   Creates reader for the given partitions. Reader fetches the data for the Netezza source table by creating external table to tranfer from Netezza host system to a remote spark client using named pipes.

   Executes the external table statement in separate thread to allow reading of data in parallel from the named pipe by the RDD iterator.

3. class NetezzaRecordParser extends AnyRef

   

   Class provides methods to parse the data written by the Netezza into the remote client pipe.

   Class provides methods to parse the data written by the Netezza into the remote client pipe. Format of the data is controlled by the external table definition options.