Class/Object

io.eels.component.hive

HiveSource

Related Docs: object HiveSource | package hive

Permalink

case class HiveSource(dbName: String, tableName: String, partitionExprs: List[PartitionConstraint] = Nil, columnNames: Seq[String] = Nil, predicate: Option[Predicate] = None)(implicit fs: FileSystem, client: IMetaStoreClient) extends Source with Logging with Using with Product with Serializable

Linear Supertypes
Serializable, Serializable, Product, Equals, Using, Source, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. HiveSource
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. Using
  7. Source
  8. Logging
  9. AnyRef
  10. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HiveSource(dbName: String, tableName: String, partitionExprs: List[PartitionConstraint] = Nil, columnNames: Seq[String] = Nil, predicate: Option[Predicate] = None)(implicit fs: FileSystem, client: IMetaStoreClient)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. def create(schema: org.apache.avro.Schema): Unit

    Permalink
  7. val dbName: String

    Permalink
  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  11. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  12. val logger: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  13. lazy val metastoreSchema: Schema

    Permalink
  14. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  16. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. lazy val partitionKeys: List[String]

    Permalink
  18. def partitionMap(keys: Seq[String]): Map[String, Seq[String]]

    Permalink
  19. def partitionMap: Map[String, Seq[String]]

    Permalink
  20. def partitionValues(keys: Seq[String]): Seq[Seq[String]]

    Permalink

    Returns all partition values for the given partition keys.

    Returns all partition values for the given partition keys. This operation is optimized, in that it does not need to scan files, but can retrieve the information directly from the hive metastore.

  21. def partitionValues(key: String): Seq[String]

    Permalink

    Returns all partition values for a given partition key.

    Returns all partition values for a given partition key. This operation is optimized, in that it does not need to scan files, but can retrieve the information directly from the hive metastore.

  22. def partitions: List[Partition]

    Permalink
  23. def parts: Seq[Part]

    Permalink
    Definition Classes
    HiveSourceSource
  24. lazy val schema: Schema

    Permalink

    The returned schema should take into account:

    The returned schema should take into account:

    1) Any projection. If a projection is set, then it should return the schema in the same order as the projection. If no projection is set then the schema should be driven from the hive metastore.

    2) Any partitions set. These should be included in the schema columns.

    Definition Classes
    HiveSourceSource
  25. def spec: HiveSpec

    Permalink
  26. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  27. val tableName: String

    Permalink
  28. def toFrame(ioThreads: Int): Frame

    Permalink
    Definition Classes
    Source
  29. def using[T, U <: AnyRef { def close(): Unit }](closeable: U)(f: (U) ⇒ T): T

    Permalink
    Definition Classes
    Using
  30. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  32. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  33. def withColumns(first: String, rest: String*): HiveSource

    Permalink
  34. def withColumns(columns: Seq[String]): HiveSource

    Permalink
  35. def withPartitionConstraint(expr: PartitionConstraint): HiveSource

    Permalink
  36. def withPartitionConstraint(name: String, value: String): HiveSource

    Permalink
  37. def withPredicate(predicate: Predicate): HiveSource

    Permalink

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from Using

Inherited from Source

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped