com.sequoiadb.spark

SequoiadbRelation

case class SequoiadbRelation(config: SequoiadbConfig, schemaProvided: Option[StructType] = scala.None)(sqlContext: SQLContext) extends BaseRelation with PrunedFilteredScan with InsertableRelation with Product with Serializable

A SequoiaDB baseRelation that can eliminate unneeded columns and filter using selected predicates before producing an RDD containing all matching tuples as Row objects.

config

A SequoiadB configuration

sqlContext

An existing Spark SQL context.

Linear Supertypes
Serializable, Serializable, Product, Equals, InsertableRelation, PrunedFilteredScan, BaseRelation, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. SequoiadbRelation
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. InsertableRelation
  7. PrunedFilteredScan
  8. BaseRelation
  9. AnyRef
  10. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SequoiadbRelation(config: SequoiadbConfig, schemaProvided: Option[StructType] = scala.None)(sqlContext: SQLContext)

    config

    A SequoiadB configuration

    sqlContext

    An existing Spark SQL context.

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any

  3. final def ##(): Int

    Definition Classes
    AnyRef → Any

  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any

  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  7. def buildScan(requiredColumns: Array[String], filters: Array[Filter]): RDD[Row]

    Override build scan function that takes requiredColumns and filters as input

    Override build scan function that takes requiredColumns and filters as input

    requiredColumns

    Array list of columns that required

    filters

    Predicates that need to be applied to data source

    Definition Classes
    SequoiadbRelation → PrunedFilteredScan

  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  9. val config: SequoiadbConfig

    A SequoiadB configuration

  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  12. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  13. def insert(data: DataFrame, overwrite: Boolean): Unit

    Override insert method to insert data into this dataframe

    Override insert method to insert data into this dataframe

    data

    DataFrame of input

    overwrite

    Whether the table is overwriten

    Definition Classes
    SequoiadbRelation → InsertableRelation

  14. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  15. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  16. final def notify(): Unit

    Definition Classes
    AnyRef

  17. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  18. val schema: StructType

    Either use schema that provided by user, or automatically generate schema by sampling the collection

    Either use schema that provided by user, or automatically generate schema by sampling the collection

    Definition Classes
    SequoiadbRelation → BaseRelation

  19. val schemaProvided: Option[StructType]

  20. def sizeInBytes: Long

    Definition Classes
    BaseRelation

  21. val sqlContext: SQLContext

    An existing Spark SQL context.

    An existing Spark SQL context.

    Definition Classes
    SequoiadbRelation → BaseRelation

  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  23. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  24. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  25. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from InsertableRelation

Inherited from PrunedFilteredScan

Inherited from BaseRelation

Inherited from AnyRef

Inherited from Any

Ungrouped