Class/Object

org.apache.spark.sql.hive

SnappyHiveExternalCatalog

Related Docs: object SnappyHiveExternalCatalog | package hive

Permalink

class SnappyHiveExternalCatalog extends SnappyHiveCatalogBase with SnappyExternalCatalog

Linear Supertypes
SnappyExternalCatalog, SnappyHiveCatalogBase, HiveExternalCatalog, internal.Logging, ExternalCatalog, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SnappyHiveExternalCatalog
  2. SnappyExternalCatalog
  3. SnappyHiveCatalogBase
  4. HiveExternalCatalog
  5. Logging
  6. ExternalCatalog
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def alterDatabase(schemaDefinition: CatalogDatabase): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  5. def alterPartitions(schema: String, table: String, parts: Seq[CatalogTablePartition]): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  6. def alterTable(tableDefinition: CatalogTable): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  7. def alterTableSchema(schemaName: String, table: String, schema: StructType): Unit

    Permalink
    Definition Classes
    SnappyExternalCatalog → ExternalCatalog
  8. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  9. val cachedCatalogTables: LoadingCache[(String, String), CatalogTable]

    Permalink

    A cache of Spark SQL data source tables that have been accessed.

    A cache of Spark SQL data source tables that have been accessed.

    Attributes
    protected
  10. def client(): HiveClient

    Permalink
    Definition Classes
    SnappyHiveCatalogBase → HiveExternalCatalog
  11. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  12. def close(): Unit

    Permalink
  13. val conf: SparkConf

    Permalink
  14. def createDatabase(schemaDefinition: CatalogDatabase, ignoreIfExists: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  15. def createFunction(schema: String, funcDefinition: CatalogFunction): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  16. def createPartitions(schema: String, table: String, parts: Seq[CatalogTablePartition], ignoreIfExists: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  17. def createPolicy(schemaName: String, policyName: String, targetTable: String, policyFor: String, policyApplyTo: Seq[String], expandedPolicyApplyTo: Seq[String], owner: String, filterString: String): Unit

    Permalink
  18. def createTable(tableDefinition: CatalogTable, ignoreIfExists: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  19. val createTime: Long

    Permalink
  20. def databaseExists(schema: String): Boolean

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  21. def dropDatabase(schema: String, ignoreIfNotExists: Boolean, cascade: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  22. def dropFunction(schema: String, name: String): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  23. def dropPartitions(schema: String, table: String, parts: Seq[TablePartitionSpec], ignoreIfNotExists: Boolean, purge: Boolean, retainData: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  24. def dropTable(schema: String, table: String, ignoreIfNotExists: Boolean, purge: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  25. def dropTableUnsafe(schema: String, table: String, forceDrop: Boolean): Unit

    Permalink
  26. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  27. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  28. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  29. def finalizeCatalogTable(table: CatalogTable): CatalogTable

    Permalink

    Transform given CatalogTable to final form filling in viewText and other fields using the properties if required.

    Transform given CatalogTable to final form filling in viewText and other fields using the properties if required.

    Attributes
    protected
  30. def functionExists(schema: String, funcName: String): Boolean

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  31. def getAllTables(skipSchemas: Seq[String] = SYS_SCHEMA :: Nil): Seq[CatalogTable]

    Permalink

    Get all the tables in the catalog skipping given schema names.

    Get all the tables in the catalog skipping given schema names. By default the inbuilt SYS schema is skipped.

    Definition Classes
    SnappyExternalCatalog
  32. def getBaseTable(tableDefinition: CatalogTable): Option[String]

    Permalink

    Check for baseTable in both properties and storage.properties (older releases used a mix).

    Check for baseTable in both properties and storage.properties (older releases used a mix).

    Definition Classes
    SnappyExternalCatalog
  33. def getCachedCatalogTable(schema: String, table: String): CatalogTable

    Permalink
    Attributes
    protected
    Definition Classes
    SnappyHiveExternalCatalogSnappyExternalCatalog
  34. def getCatalogSchemaVersion: Long

    Permalink
  35. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  36. def getDatabase(schema: String): CatalogDatabase

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  37. def getDependents(schema: String, table: String, catalogTable: CatalogTable, includeTypes: Seq[Type], excludeTypes: Seq[Type]): Seq[CatalogTable]

    Permalink

    Get all the dependent objects for a given catalog object.

    Get all the dependent objects for a given catalog object.

    Definition Classes
    SnappyExternalCatalog
  38. def getDependentsFromProperties(schema: String, properties: Map[String, String], includeTypes: Seq[Type], excludeTypes: Seq[Type]): Seq[CatalogTable]

    Permalink
    Attributes
    protected
    Definition Classes
    SnappyExternalCatalog
  39. def getDependentsFromProperties(schema: String, table: String, includeTypes: Seq[Type] = Nil, excludeTypes: Seq[Type] = Nil): Seq[CatalogTable]

    Permalink

    Get all the dependent objects for a given catalog object.

    Get all the dependent objects for a given catalog object. Note that this does not check for older releases that may lack appropriate catalog entries for dependent relations. Use getDependents for cases where that might be possible.

    Definition Classes
    SnappyExternalCatalog
  40. def getFunction(schema: String, funcName: String): CatalogFunction

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  41. def getPartition(schema: String, table: String, spec: TablePartitionSpec): CatalogTablePartition

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  42. def getPartitionOption(schema: String, table: String, spec: TablePartitionSpec): Option[CatalogTablePartition]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  43. def getPolicies(schema: String, table: String, properties: Map[String, String]): Seq[CatalogTable]

    Permalink

    Get the list of policies defined for a given table

    Get the list of policies defined for a given table

    schema

    schema name of the table

    table

    name of the table

    properties

    CatalogTable.properties for the table

    returns

    list of policy CatalogTables

    Definition Classes
    SnappyExternalCatalog
  44. def getRelationInfo(schema: String, table: String, rowTable: Boolean): (RelationInfo, Option[LocalRegion])

    Permalink

    Get RelationInfo for given table with underlying region in embedded mode.

    Get RelationInfo for given table with underlying region in embedded mode.

    Definition Classes
    SnappyHiveExternalCatalogSnappyExternalCatalog
  45. def getTable(schema: String, table: String): CatalogTable

    Permalink
    Definition Classes
    SnappyExternalCatalog → ExternalCatalog
  46. def getTableOption(schema: String, table: String): Option[CatalogTable]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  47. def getTableWithBaseTable(table: CatalogTable): Seq[(String, String)]

    Permalink
    Attributes
    protected
    Definition Classes
    SnappyExternalCatalog
  48. val hadoopConf: Configuration

    Permalink
  49. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  50. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  51. def invalidate(name: (String, String)): Unit

    Permalink
  52. def invalidateAll(): Unit

    Permalink
  53. def invalidateCaches(relations: Seq[(String, String)]): Unit

    Permalink
  54. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  55. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  56. def listDatabases(pattern: String): Seq[String]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  57. def listDatabases(): Seq[String]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  58. def listFunctions(schema: String, pattern: String): Seq[String]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  59. def listPartitionNames(schema: String, table: String, partialSpec: Option[TablePartitionSpec]): Seq[String]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  60. def listPartitions(schema: String, table: String, partialSpec: Option[TablePartitionSpec] = None): Seq[CatalogTablePartition]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  61. def listPartitionsByFilter(schema: String, table: String, predicates: Seq[Expression]): Seq[CatalogTablePartition]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  62. def listTables(schema: String, pattern: String): Seq[String]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  63. def listTables(schema: String): Seq[String]

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  64. def loadDynamicPartitions(schema: String, table: String, loadPath: String, partition: TablePartitionSpec, replace: Boolean, numDP: Int, holdDDLTime: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  65. def loadPartition(schema: String, table: String, loadPath: String, partition: TablePartitionSpec, isOverwrite: Boolean, holdDDLTime: Boolean, inheritTableSpecs: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  66. def loadTable(schema: String, table: String, loadPath: String, isOverwrite: Boolean, holdDDLTime: Boolean): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  67. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  68. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  69. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  70. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  71. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  72. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  73. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  74. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  75. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  76. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  77. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  78. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  79. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  80. val nonExistentTables: Cache[(String, String), Boolean]

    Permalink

    A cache of SQL data source tables that are missing in catalog.

    A cache of SQL data source tables that are missing in catalog.

    Attributes
    protected
  81. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  82. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  83. def refreshPolicies(ldapGroup: String): Unit

    Permalink
  84. def registerCatalogSchemaChange(relations: Seq[(String, String)]): Unit

    Permalink
  85. def renameFunction(schema: String, oldName: String, newName: String): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  86. def renamePartitions(schema: String, table: String, specs: Seq[TablePartitionSpec], newSpecs: Seq[TablePartitionSpec]): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  87. def renameTable(schemaName: String, oldName: String, newName: String): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  88. def requireDbExists(schema: String): Unit

    Permalink
    Definition Classes
    SnappyExternalCatalog → ExternalCatalog
  89. def requireFunctionExists(schema: String, funcName: String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    SnappyExternalCatalog → ExternalCatalog
  90. def requireFunctionNotExists(schema: String, funcName: String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    SnappyExternalCatalog → ExternalCatalog
  91. def requireTableExists(schema: String, table: String): Unit

    Permalink
    Definition Classes
    SnappyExternalCatalog → ExternalCatalog
  92. def setCurrentDatabase(schema: String): Unit

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  93. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  94. def systemSchemaDefinition: CatalogDatabase

    Permalink
    Definition Classes
    SnappyExternalCatalog
  95. def tableExists(schema: String, table: String): Boolean

    Permalink
    Definition Classes
    SnappyHiveExternalCatalog → HiveExternalCatalog → ExternalCatalog
  96. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  97. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  98. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  99. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from SnappyExternalCatalog

Inherited from SnappyHiveCatalogBase

Inherited from HiveExternalCatalog

Inherited from internal.Logging

Inherited from ExternalCatalog

Inherited from AnyRef

Inherited from Any

Ungrouped