Class

org.apache.spark.sql.execution.columnar

JDBCAppendableRelation

Related Doc: package columnar

Permalink

abstract case class JDBCAppendableRelation(table: String, provider: String, mode: SaveMode, userSchema: StructType, origOptions: CaseInsensitiveMutableHashMap[String], externalStore: ExternalStore, sqlContext: SQLContext) extends BaseRelation with PrunedUnsafeFilteredScan with InsertableRelation with PlanInsertableRelation with DestroyRelation with IndexableRelation with Logging with NativeTableRowLevelSecurityRelation with Serializable with Product

A LogicalPlan implementation for an external column table whose contents are retrieved using a JDBC URL or DataSource.

Self Type
JDBCAppendableRelation
Linear Supertypes
Product, Equals, Serializable, Serializable, NativeTableRowLevelSecurityRelation, RowLevelSecurityRelation, Logging, IndexableRelation, PlanInsertableRelation, NativeTableRelation, DestroyRelation, InsertableRelation, PrunedUnsafeFilteredScan, BaseRelation, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JDBCAppendableRelation
  2. Product
  3. Equals
  4. Serializable
  5. Serializable
  6. NativeTableRowLevelSecurityRelation
  7. RowLevelSecurityRelation
  8. Logging
  9. IndexableRelation
  10. PlanInsertableRelation
  11. NativeTableRelation
  12. DestroyRelation
  13. InsertableRelation
  14. PrunedUnsafeFilteredScan
  15. BaseRelation
  16. AnyRef
  17. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new JDBCAppendableRelation(table: String, provider: String, mode: SaveMode, userSchema: StructType, origOptions: CaseInsensitiveMutableHashMap[String], externalStore: ExternalStore, sqlContext: SQLContext)

    Permalink

Abstract Value Members

  1. abstract def buildUnsafeScan(requiredColumns: Array[String], filters: Array[Expression]): (RDD[Any], Seq[RDD[InternalRow]])

    Permalink
    Definition Classes
    PrunedUnsafeFilteredScan
  2. abstract def createActualTables(connection: Connection): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    NativeTableRowLevelSecurityRelation
  3. abstract def destroy(ifExists: Boolean): Unit

    Permalink

    Destroy and cleanup this relation.

    Destroy and cleanup this relation. It may include, but not limited to, dropping the external table that this relation represents.

    Definition Classes
    DestroyRelation
  4. abstract def getBasicInsertPlan(relation: LogicalRelation, child: SparkPlan): SparkPlan

    Permalink
    Definition Classes
    PlanInsertableRelation
  5. abstract def schemaName: String

    Permalink
    Definition Classes
    RowLevelSecurityRelation
  6. abstract def tableName: String

    Permalink
    Definition Classes
    RowLevelSecurityRelation
  7. abstract def truncate(): Unit

    Permalink

    Truncate the table represented by this relation.

    Truncate the table represented by this relation.

    Definition Classes
    DestroyRelation
  8. abstract def unhandledFilters(filters: Seq[Expression]): Seq[Expression]

    Permalink

    Returns the list of Expressions that this datasource may not be able to handle.

    Returns the list of Expressions that this datasource may not be able to handle. By default, this function will return all filters, as it is always safe to double evaluate an Expression.

    Definition Classes
    PrunedUnsafeFilteredScan
  9. abstract def withoutUserSchema: Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    NativeTableRowLevelSecurityRelation

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. var _relationInfoAndRegion: (RelationInfo, Option[LocalRegion])

    Permalink
    Attributes
    protected[this]
    Definition Classes
    NativeTableRowLevelSecurityRelation
  5. var _schema: StructType

    Permalink
    Attributes
    protected[this]
    Definition Classes
    NativeTableRowLevelSecurityRelation
  6. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  7. def canEqual(that: Any): Boolean

    Permalink
    Definition Classes
    JDBCAppendableRelation → Equals
  8. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. final val connFactory: () ⇒ Connection

    Permalink
  10. final def connProperties: ConnectionProperties

    Permalink
  11. def createIndex(indexIdent: TableIdentifier, tableIdent: TableIdentifier, indexColumns: Seq[(String, Option[SortDirection])], options: Map[String, String]): Unit

    Permalink

    Create an index on a table.

    Create an index on a table.

    indexIdent

    Index Identifier which goes in the catalog

    tableIdent

    Table identifier on which the index is created.

    indexColumns

    Columns on which the index has to be created with the direction of sorting. Direction can be specified as None.

    options

    Options for indexes. For e.g. column table index - ("COLOCATE_WITH"->"CUSTOMER"). row table index - ("INDEX_TYPE"->"GLOBAL HASH") or ("INDEX_TYPE"->"UNIQUE")

    Definition Classes
    JDBCAppendableRelationIndexableRelation
  12. def createTable(conn: Connection, tableStr: String, tableName: String): Unit

    Permalink
    Attributes
    protected
  13. def createTable(mode: SaveMode): Unit

    Permalink
  14. var delayRollover: Boolean

    Permalink
    Attributes
    protected
  15. final def dialect: JdbcDialect

    Permalink
    Attributes
    protected
    Definition Classes
    JDBCAppendableRelationNativeTableRelation
  16. def dropIndex(indexIdent: TableIdentifier, tableIdent: TableIdentifier, ifExists: Boolean): Unit

    Permalink

    Drops an index on this table

    Drops an index on this table

    indexIdent

    Index identifier

    tableIdent

    Table identifier

    ifExists

    Drop if exists

    Definition Classes
    JDBCAppendableRelationIndexableRelation
  17. def enableOrDisableRowLevelSecurity(tableIdent: TableIdentifier, enableRowLevelSecurity: Boolean): Unit

    Permalink
  18. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  19. def equals(that: Any): Boolean

    Permalink
    Definition Classes
    JDBCAppendableRelation → Equals → AnyRef → Any
  20. def executeUpdate(sql: String, defaultSchema: String): Int

    Permalink

    Execute a DML SQL and return the number of rows affected.

    Execute a DML SQL and return the number of rows affected.

    Definition Classes
    NativeTableRelation
  21. val externalStore: ExternalStore

    Permalink
  22. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  23. def flushRowBuffer(): Unit

    Permalink
  24. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  25. def getColumnBatchParams: (Int, Int, String)

    Permalink
  26. def getCompressionCodec: String

    Permalink
  27. def getInsertPlan(relation: LogicalRelation, child: SparkPlan): SparkPlan

    Permalink

    Get a spark plan for insert.

    Get a spark plan for insert. The result of SparkPlan execution should be a count of number of inserted rows.

    Definition Classes
    PlanInsertableRelation
  28. def hashCode(): Int

    Permalink
    Definition Classes
    JDBCAppendableRelation → AnyRef → Any
  29. def initializeLogIfNecessary(): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  30. def insert(data: DataFrame, overwrite: Boolean): Unit

    Permalink
    Definition Classes
    JDBCAppendableRelation → InsertableRelation
  31. final def isDebugEnabled: Boolean

    Permalink
    Definition Classes
    Logging
  32. final def isInfoEnabled: Boolean

    Permalink
    Definition Classes
    Logging
  33. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  34. def isRowLevelSecurityEnabled: Boolean

    Permalink
  35. final def isRowTable: Boolean

    Permalink
  36. final def isTraceEnabled: Boolean

    Permalink
    Definition Classes
    Logging
  37. final var levelFlags: Int

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  38. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  39. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Definition Classes
    Logging
  40. def logDebug(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging
  41. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Definition Classes
    Logging
  42. def logError(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging
  43. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Definition Classes
    Logging
  44. def logInfo(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging
  45. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  46. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Definition Classes
    Logging
  47. def logTrace(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging
  48. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Definition Classes
    Logging
  49. def logWarning(msg: ⇒ String): Unit

    Permalink
    Definition Classes
    Logging
  50. final var log_: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  51. val mode: SaveMode

    Permalink
  52. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  53. val needConversion: Boolean

    Permalink
    Definition Classes
    JDBCAppendableRelation → BaseRelation
  54. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  55. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  56. val origOptions: CaseInsensitiveMutableHashMap[String]

    Permalink
  57. val provider: String

    Permalink
  58. def refreshTableSchema(invalidateCached: Boolean, fetchFromStore: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    NativeTableRowLevelSecurityRelation
  59. lazy val region: LocalRegion

    Permalink
  60. def relationInfo: RelationInfo

    Permalink
  61. def relationInfoAndRegion: (RelationInfo, Option[LocalRegion])

    Permalink
    Attributes
    protected
    Definition Classes
    NativeTableRowLevelSecurityRelation
  62. def resetLogger(): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  63. final def resolvedName: String

    Permalink
  64. def scanTable(tableName: String, requiredColumns: Array[String], filters: Array[Expression], prunePartitions: () ⇒ Int): (RDD[Any], Array[Int])

    Permalink
  65. def schema: StructType

    Permalink
    Definition Classes
    NativeTableRowLevelSecurityRelation → BaseRelation
  66. def sizeInBytes: Long

    Permalink
    Definition Classes
    JDBCAppendableRelation → BaseRelation
  67. val sqlContext: SQLContext

    Permalink
    Definition Classes
    JDBCAppendableRelation → BaseRelation
  68. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  69. val table: String

    Permalink

    Name of this table as stored in catalog.

    Name of this table as stored in catalog.

    Definition Classes
    JDBCAppendableRelationNativeTableRelation
  70. def unhandledFilters(filters: Array[Filter]): Array[Filter]

    Permalink
    Definition Classes
    BaseRelation
  71. val userSchema: StructType

    Permalink
  72. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  73. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  74. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Product

Inherited from Equals

Inherited from Serializable

Inherited from Serializable

Inherited from RowLevelSecurityRelation

Inherited from Logging

Inherited from IndexableRelation

Inherited from PlanInsertableRelation

Inherited from NativeTableRelation

Inherited from DestroyRelation

Inherited from InsertableRelation

Inherited from PrunedUnsafeFilteredScan

Inherited from BaseRelation

Inherited from AnyRef

Inherited from Any

Ungrouped