Class

com.twitter.summingbird.batch.store

HDFSMetadata

Related Doc: package store

Permalink

class HDFSMetadata extends AnyRef

Class to access metadata for a single versioned output directory

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. HDFSMetadata
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HDFSMetadata(conf: Configuration, rootPath: String)

    Permalink

    rootPath

    the base root path to where versions of a single output are stored

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. def apply(version: Long): HDFSVersionMetadata

    Permalink

    Refer to a specific version, even if it does not exist on disk

  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  10. def find[T](fn: (T) ⇒ Boolean)(implicit arg0: JsonNodeInjection[T]): Option[(T, HDFSVersionMetadata)]

    Permalink

    Find the newest version that satisfies a predicate

  11. def get(version: Long): Option[HDFSVersionMetadata]

    Permalink

    Get a version's metadata IF it exists on disk

  12. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  13. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  14. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  15. def mostRecentVersion: Option[HDFSVersionMetadata]

    Permalink

    The greatest version number that has been completed on disk

  16. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  17. def newVersion: Long

    Permalink

    Create a new version number that is greater than all previous

  18. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  19. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  20. def select[T](fn: (T) ⇒ Boolean)(implicit arg0: JsonNodeInjection[T]): Iterable[(T, HDFSVersionMetadata)]

    Permalink

    select all versions that satisfy a predicate

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  22. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  23. val versionedStore: VersionedStore

    Permalink
    Attributes
    protected

  24. def versions: Iterable[Long]

    Permalink

    This touches the filesystem once on each call, newest (largest) to oldest (smallest) This relies on dfs-datastore doing the sorting, which it does last we checked

  25. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  26. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  27. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped