Class

org.apache.spark.sql.riak

RiakSQLContext

Related Doc: package riak

Permalink

class RiakSQLContext extends SQLContext

Allows to execute SQL queries against Riak TS. Predicate pushdown is supported.

Since

1.2.0

Linear Supertypes
SQLContext, Serializable, Serializable, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. RiakSQLContext
  2. SQLContext
  3. Serializable
  4. Serializable
  5. Logging
  6. AnyRef
  7. Any
Implicitly
  1. by any2stringadd
  2. by StringFormat
  3. by Ensuring
  4. by ArrowAssoc
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Instance Constructors

  1. new RiakSQLContext(sc: SparkContext)

    Permalink

Type Members

  1. class QueryExecution extends execution.QueryExecution

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.6.0) use org.apache.spark.sql.QueryExecution

  2. class SparkPlanner extends execution.SparkPlanner

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.6.0) use org.apache.spark.sql.SparkPlanner

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. def +(other: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from RiakSQLContext to any2stringadd[RiakSQLContext] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd
  4. def ->[B](y: B): (RiakSQLContext, B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from RiakSQLContext to ArrowAssoc[RiakSQLContext] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()
  5. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  6. def addJar(path: String): Unit

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  7. lazy val analyzer: Analyzer

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  8. def applySchemaToPythonRDD(rdd: RDD[Array[Any]], schema: StructType): DataFrame

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  9. def applySchemaToPythonRDD(rdd: RDD[Array[Any]], schemaString: String): DataFrame

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  10. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  11. def baseRelationToDataFrame(baseRelation: BaseRelation): DataFrame

    Permalink
    Definition Classes
    SQLContext
  12. val cacheManager: execution.CacheManager

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  13. def cacheTable(tableName: String): Unit

    Permalink
    Definition Classes
    SQLContext
  14. lazy val catalog: RiakCatalog

    Permalink

    A catalyst metadata catalog that points to Riak.

    A catalyst metadata catalog that points to Riak.

    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    RiakSQLContext → SQLContext
  15. def clearCache(): Unit

    Permalink
    Definition Classes
    SQLContext
  16. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  17. lazy val conf: SQLConf

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  18. def createDataFrame(data: List[_], beanClass: Class[_]): DataFrame

    Permalink
    Definition Classes
    SQLContext
  19. def createDataFrame(rdd: JavaRDD[_], beanClass: Class[_]): DataFrame

    Permalink
    Definition Classes
    SQLContext
  20. def createDataFrame(rdd: RDD[_], beanClass: Class[_]): DataFrame

    Permalink
    Definition Classes
    SQLContext
  21. def createDataFrame(rows: List[Row], schema: StructType): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @DeveloperApi()
  22. def createDataFrame(rowRDD: JavaRDD[Row], schema: StructType): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @DeveloperApi()
  23. def createDataFrame(rowRDD: RDD[Row], schema: StructType): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @DeveloperApi()
  24. def createDataFrame[A <: Product](data: Seq[A])(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  25. def createDataFrame[A <: Product](rdd: RDD[A])(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  26. def createDataset[T](data: List[T])(implicit arg0: Encoder[T]): Dataset[T]

    Permalink
    Definition Classes
    SQLContext
  27. def createDataset[T](data: RDD[T])(implicit arg0: Encoder[T]): Dataset[T]

    Permalink
    Definition Classes
    SQLContext
  28. def createDataset[T](data: Seq[T])(implicit arg0: Encoder[T]): Dataset[T]

    Permalink
    Definition Classes
    SQLContext
  29. def createExternalTable(tableName: String, source: String, schema: StructType, options: Map[String, String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  30. def createExternalTable(tableName: String, source: String, schema: StructType, options: Map[String, String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  31. def createExternalTable(tableName: String, source: String, options: Map[String, String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  32. def createExternalTable(tableName: String, source: String, options: Map[String, String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  33. def createExternalTable(tableName: String, path: String, source: String): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  34. def createExternalTable(tableName: String, path: String): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  35. val ddlParser: DDLParser

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  36. def dialectClassName: String

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  37. def dropTempTable(tableName: String): Unit

    Permalink
    Definition Classes
    SQLContext
  38. lazy val emptyDataFrame: DataFrame

    Permalink
    Definition Classes
    SQLContext
  39. lazy val emptyResult: RDD[InternalRow]

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  40. def ensuring(cond: (RiakSQLContext) ⇒ Boolean, msg: ⇒ Any): RiakSQLContext

    Permalink
    Implicit information
    This member is added by an implicit conversion from RiakSQLContext to Ensuring[RiakSQLContext] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  41. def ensuring(cond: (RiakSQLContext) ⇒ Boolean): RiakSQLContext

    Permalink
    Implicit information
    This member is added by an implicit conversion from RiakSQLContext to Ensuring[RiakSQLContext] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  42. def ensuring(cond: Boolean, msg: ⇒ Any): RiakSQLContext

    Permalink
    Implicit information
    This member is added by an implicit conversion from RiakSQLContext to Ensuring[RiakSQLContext] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  43. def ensuring(cond: Boolean): RiakSQLContext

    Permalink
    Implicit information
    This member is added by an implicit conversion from RiakSQLContext to Ensuring[RiakSQLContext] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  44. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  45. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  46. def executePlan(plan: LogicalPlan): execution.QueryExecution

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  47. def executeSql(sql: String): execution.QueryExecution

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  48. val experimental: ExperimentalMethods

    Permalink
    Definition Classes
    SQLContext
  49. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  50. def formatted(fmtstr: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from RiakSQLContext to StringFormat[RiakSQLContext] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()
  51. lazy val functionRegistry: FunctionRegistry

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  52. def getAllConfs: Map[String, String]

    Permalink
    Definition Classes
    SQLContext
  53. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  54. def getConf(key: String, defaultValue: String): String

    Permalink
    Definition Classes
    SQLContext
  55. def getConf(key: String): String

    Permalink
    Definition Classes
    SQLContext
  56. def getSQLDialect(): ParserDialect

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  57. def getSchema(beanClass: Class[_]): Seq[AttributeReference]

    Permalink
    Attributes
    protected
    Definition Classes
    SQLContext
  58. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  59. def isCached(tableName: String): Boolean

    Permalink
    Definition Classes
    SQLContext
  60. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  61. val isRootContext: Boolean

    Permalink
    Definition Classes
    SQLContext
  62. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  63. lazy val listenerManager: ExecutionListenerManager

    Permalink
    Definition Classes
    SQLContext
  64. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  65. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  66. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  67. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  68. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  69. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  70. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  71. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  72. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  73. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  74. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  75. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  76. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  77. def newSession(): SQLContext

    Permalink
    Definition Classes
    SQLContext
  78. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  79. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  80. lazy val optimizer: Optimizer

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  81. def parseDataType(dataTypeString: String): DataType

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  82. def parseSql(sql: String): LogicalPlan

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  83. val planner: execution.SparkPlanner

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  84. val prepareForExecution: RuleExecutor[SparkPlan]

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  85. def range(start: Long, end: Long, step: Long, numPartitions: Int): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  86. def range(start: Long, end: Long): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  87. def range(end: Long): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  88. def read: DataFrameReader

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @Experimental()
  89. def riakTsSql(tsQuery: String): DataFrame

    Permalink

    Executes SQL query against Riak TS and returns DataFrame representing the result.

  90. def setConf(key: String, value: String): Unit

    Permalink
    Definition Classes
    SQLContext
  91. def setConf(props: Properties): Unit

    Permalink
    Definition Classes
    SQLContext
  92. val sparkContext: SparkContext

    Permalink
    Definition Classes
    SQLContext
  93. def sql(tsQuery: String): DataFrame

    Permalink

    Delegates to riakTsSql

    Delegates to riakTsSql

    Definition Classes
    RiakSQLContext → SQLContext
  94. val sqlParser: SparkSQLParser

    Permalink
    Attributes
    protected[org.apache.spark.sql]
    Definition Classes
    SQLContext
  95. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  96. def table(tableName: String): DataFrame

    Permalink
    Definition Classes
    SQLContext
  97. def tableNames(databaseName: String): Array[String]

    Permalink
    Definition Classes
    SQLContext
  98. def tableNames(): Array[String]

    Permalink
    Definition Classes
    SQLContext
  99. def tables(databaseName: String): DataFrame

    Permalink
    Definition Classes
    SQLContext
  100. def tables(): DataFrame

    Permalink
    Definition Classes
    SQLContext
  101. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  102. val udf: UDFRegistration

    Permalink
    Definition Classes
    SQLContext
  103. def uncacheTable(tableName: String): Unit

    Permalink
    Definition Classes
    SQLContext
  104. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  105. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  106. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  107. def [B](y: B): (RiakSQLContext, B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from RiakSQLContext to ArrowAssoc[RiakSQLContext] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Deprecated Value Members

  1. def applySchema(rdd: JavaRDD[_], beanClass: Class[_]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.3.0) Use createDataFrame. This will be removed in Spark 2.0.

  2. def applySchema(rdd: RDD[_], beanClass: Class[_]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.3.0) Use createDataFrame. This will be removed in Spark 2.0.

  3. def applySchema(rowRDD: JavaRDD[Row], schema: StructType): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.3.0) Use createDataFrame. This will be removed in Spark 2.0.

  4. def applySchema(rowRDD: RDD[Row], schema: StructType): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.3.0) Use createDataFrame. This will be removed in Spark 2.0.

  5. def jdbc(url: String, table: String, theParts: Array[String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.jdbc(). This will be removed in Spark 2.0.

  6. def jdbc(url: String, table: String, columnName: String, lowerBound: Long, upperBound: Long, numPartitions: Int): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.jdbc(). This will be removed in Spark 2.0.

  7. def jdbc(url: String, table: String): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.jdbc(). This will be removed in Spark 2.0.

  8. def jsonFile(path: String, samplingRatio: Double): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  9. def jsonFile(path: String, schema: StructType): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  10. def jsonFile(path: String): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  11. def jsonRDD(json: JavaRDD[String], samplingRatio: Double): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  12. def jsonRDD(json: RDD[String], samplingRatio: Double): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  13. def jsonRDD(json: JavaRDD[String], schema: StructType): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  14. def jsonRDD(json: RDD[String], schema: StructType): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  15. def jsonRDD(json: JavaRDD[String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  16. def jsonRDD(json: RDD[String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.json(). This will be removed in Spark 2.0.

  17. def load(source: String, schema: StructType, options: Map[String, String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.format(source).schema(schema).options(options).load(). This will be removed in Spark 2.0.

  18. def load(source: String, schema: StructType, options: Map[String, String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.format(source).schema(schema).options(options).load(). This will be removed in Spark 2.0.

  19. def load(source: String, options: Map[String, String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.format(source).options(options).load(). This will be removed in Spark 2.0.

  20. def load(source: String, options: Map[String, String]): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.format(source).options(options).load(). This will be removed in Spark 2.0.

  21. def load(path: String, source: String): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.format(source).load(path). This will be removed in Spark 2.0.

  22. def load(path: String): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated
    Deprecated

    (Since version 1.4.0) Use read.load(path). This will be removed in Spark 2.0.

  23. def parquetFile(paths: String*): DataFrame

    Permalink
    Definition Classes
    SQLContext
    Annotations
    @deprecated @varargs()
    Deprecated

    (Since version 1.4.0) Use read.parquet(). This will be removed in Spark 2.0.

Inherited from SQLContext

Inherited from Serializable

Inherited from Serializable

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from RiakSQLContext to any2stringadd[RiakSQLContext]

Inherited by implicit conversion StringFormat from RiakSQLContext to StringFormat[RiakSQLContext]

Inherited by implicit conversion Ensuring from RiakSQLContext to Ensuring[RiakSQLContext]

Inherited by implicit conversion ArrowAssoc from RiakSQLContext to ArrowAssoc[RiakSQLContext]

Ungrouped