Object

com.sequoiadb.spark.schema

SequoiadbRowConverter

Related Doc: package schema

Permalink

object SequoiadbRowConverter extends JsonSupport with Serializable

SequoiadbRowConverter support RDD transformations from BSONObject to Row and vice versa

Linear Supertypes
Serializable, Serializable, JsonSupport, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SequoiadbRowConverter
  2. Serializable
  3. Serializable
  4. JsonSupport
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def CSVRecordAsRow(CSV_obj: BSONObject, schema: StructType): Row

    Permalink

    Given a schema, it converts a CSV String into a Row

    Given a schema, it converts a CSV String into a Row

    schema

    Schema

    returns

    The converted row

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def asRow(schema: StructType, haveSpecialDataType: Boolean, rdd: RDD[BSONObject]): RDD[Row]

    Permalink

    schema

    RDD native schema

    haveSpecialDataType

    check selector field is it have speciel data type

    rdd

    Current native RDD

    returns

    A brand new RDD of Spark SQL Row type.

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def dbObjectToMap(dBObject: BSONObject): Map[String, AnyRef]

    Permalink

    It creates a map with dbObject attribute values.

    It creates a map with dbObject attribute values.

    dBObject

    Object to be splitted into attribute tuples.

    returns

    A map with dbObject attributes.

  9. def enforceCorrectType(value: Any, desiredType: DataType): Any

    Permalink

    Tries to convert some scala value to another compatible given type

    Tries to convert some scala value to another compatible given type

    value

    Value to be converted

    desiredType

    Destiny type

    returns

    Converted value

    Attributes
    protected
    Definition Classes
    JsonSupport
  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  14. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  15. def haveSpecialDataType(schema: StructType): Boolean

    Permalink

    check selector does it have special data type ,eg.

    check selector does it have special data type ,eg. date, timestamp, bson, array, decimal

    schema

    RDD native schema

    returns

    true or false

  16. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  17. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  18. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  19. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  20. def recordAsRow(json: Map[String, AnyRef], schema: StructType): Row

    Permalink

    Given a schema, it converts a JSON object (as map) into a Row

    Given a schema, it converts a JSON object (as map) into a Row

    json

    DBObject map

    schema

    Schema

    returns

    The converted row

  21. def rowAsDBObject(row: Row, schema: StructType): BSONObject

    Permalink

    Given a schema, it converts a Row into a DBObject

    Given a schema, it converts a Row into a DBObject

    row

    Row to be converted

    schema

    Schema

    returns

    The converted DBObject

  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  23. def toDBObject(value: Any, dataType: DataType): Any

    Permalink

    It converts some Row attribute value into a DBObject field

    It converts some Row attribute value into a DBObject field

    value

    Row attribute

    dataType

    Attribute type

    returns

    The converted value into a DBObject field.

  24. def toSQL(value: Any, dataType: DataType): Any

    Permalink

    It converts some DBObject attribute value into a Row field

    It converts some DBObject attribute value into a Row field

    value

    DBObject attribute

    dataType

    Attribute type

    returns

    The converted value into a Row field.

  25. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  26. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from JsonSupport

Inherited from AnyRef

Inherited from Any

Ungrouped