Package

com.google.cloud.spark.bigquery

direct

Permalink

package direct

Visibility
  1. Public
  2. All

Type Members

  1. case class ArrowConverter(columnsInOrder: Seq[String], rawArrowSchema: ByteString, rowResponseIterator: Iterator[ReadRowsResponse], userProvidedSchema: Optional[StructType]) extends Product with Serializable

    Permalink

    A converter for transforming an iterator on ReadRowsResponse to an iterator that converts each of these rows to Arrow Schema

    A converter for transforming an iterator on ReadRowsResponse to an iterator that converts each of these rows to Arrow Schema

    columnsInOrder

    Ordered columns in the Big Query schema

    rawArrowSchema

    Schema representation in arrow format

    rowResponseIterator

    Iterator over rows read from big query

  2. case class AvroConverter(bqSchema: Schema, columnsInOrder: Seq[String], rawAvroSchema: String, rowResponseIterator: Iterator[ReadRowsResponse], userProvidedSchema: Optional[StructType]) extends Product with Serializable

    Permalink

    A converter for transforming an iterator on ReadRowsResponse to an iterator that converts each of these rows to Avro Schema

    A converter for transforming an iterator on ReadRowsResponse to an iterator that converts each of these rows to Avro Schema

    bqSchema

    Schema of underlying big query source

    columnsInOrder

    Ordered columns in the Big Query schema

    rawAvroSchema

    Schema representation in Avro format

    rowResponseIterator

    Iterator over rows read from big query

  3. case class BigQueryPartition(stream: String, index: Int) extends Partition with Product with Serializable

    Permalink
  4. class BigQueryRDD extends RDD[InternalRow]

    Permalink
  5. trait ReadRowsClient extends AutoCloseable

    Permalink
  6. case class ReadRowsClientWrapper(client: BigQueryReadClient) extends ReadRowsClient with Product with Serializable

    Permalink
  7. case class ReadRowsHelper(client: ReadRowsClient, request: Builder, maxReadRowsRetries: Int) extends Product with Serializable

    Permalink
  8. class ReadRowsIterator extends Logging with Iterator[ReadRowsResponse]

    Permalink

Value Members

  1. object BigQueryRDD extends Serializable

    Permalink

Ungrouped