Class/Object

org.apache.spark.sql.redis

RedisSourceRelation

Related Docs: object RedisSourceRelation | package redis

Permalink

class RedisSourceRelation extends BaseRelation with InsertableRelation with PrunedFilteredScan with Keys with Serializable with Logging

Linear Supertypes
Logging, Serializable, Serializable, Keys, PrunedFilteredScan, InsertableRelation, BaseRelation, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RedisSourceRelation
  2. Logging
  3. Serializable
  4. Serializable
  5. Keys
  6. PrunedFilteredScan
  7. InsertableRelation
  8. BaseRelation
  9. AnyRef
  10. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new RedisSourceRelation(sqlContext: SQLContext, parameters: Map[String, String], userSpecifiedSchema: Option[StructType])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def buildScan(requiredColumns: Array[String], filters: Array[Filter]): RDD[Row]

    Permalink
    Definition Classes
    RedisSourceRelation → PrunedFilteredScan

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  9. def filterKeysByType(conn: Jedis, keys: Array[String], t: String)(implicit readWriteConfig: ReadWriteConfig): Array[String]

    Permalink

    keys

    keys are guaranteed that they belongs with the server jedis connected to.

    returns

    keys of "t" type

    Definition Classes
    Keys

  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  12. def getKeys(nodes: Array[RedisNode], sPos: Int, ePos: Int, keyPattern: String)(implicit readWriteConfig: ReadWriteConfig): Iterator[String]

    Permalink

    nodes

    list of RedisNode

    sPos

    start position of slots

    ePos

    end position of slots

    returns

    keys whose slot is in [sPos, ePos]

    Definition Classes
    Keys

  13. def getMasterNode(nodes: Array[RedisNode], key: String): RedisNode

    Permalink

    Master node for a key

    Master node for a key

    nodes

    list of all nodes

    key

    key

    returns

    master node

    Definition Classes
    Keys

  14. def groupKeysByNode(nodes: Array[RedisNode], keys: Iterator[String]): Iterator[(RedisNode, Array[String])]

    Permalink

    nodes

    list of RedisNode

    keys

    list of keys

    returns

    (node: (key1, key2, ...), node2: (key3, key4,...), ...)

    Definition Classes
    Keys

  15. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  16. def insert(data: DataFrame, overwrite: Boolean): Unit

    Permalink
    Definition Classes
    RedisSourceRelation → InsertableRelation

  17. def isEmpty: Boolean

    Permalink

    returns

    true if data exists in redis

  18. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  19. def logDebug(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging

  20. def logInfo(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging

  21. def logTrace(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging

  22. def logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  23. def loggerName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging

  24. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  25. def needConversion: Boolean

    Permalink
    Definition Classes
    BaseRelation

  26. def nonEmpty: Boolean

    Permalink

    returns

    true if no data exists in redis

  27. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  28. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  29. def schema: StructType

    Permalink
    Definition Classes
    RedisSourceRelation → BaseRelation

  30. def sizeInBytes: Long

    Permalink
    Definition Classes
    BaseRelation

  31. val sqlContext: SQLContext

    Permalink
    Definition Classes
    RedisSourceRelation → BaseRelation

  32. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  33. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  34. def unhandledFilters(filters: Array[Filter]): Array[Filter]

    Permalink
    Definition Classes
    RedisSourceRelation → BaseRelation

  35. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  36. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  37. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from Keys

Inherited from PrunedFilteredScan

Inherited from InsertableRelation

Inherited from BaseRelation

Inherited from AnyRef

Inherited from Any

Ungrouped