Object

org.apache.spark.sql.delta.util

FileNames

Related Doc: package util

Permalink

object FileNames

Helper for creating file names for specific commits / checkpoints.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. FileNames
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. val checkpointFilePattern: Pattern

    Permalink
  6. def checkpointFileSingular(path: Path, version: Long): Path

    Permalink

    Returns the path for a singular checkpoint up to the given version.

    Returns the path for a singular checkpoint up to the given version.

    In a future protocol version this path will stop being written.

  7. def checkpointFileWithParts(path: Path, version: Long, numParts: Int): Seq[Path]

    Permalink

    Returns the paths for all parts of the checkpoint up to the given version.

    Returns the paths for all parts of the checkpoint up to the given version.

    In a future protocol version we will write this path instead of checkpointFileSingular.

    Example of the format: 00000000000000004915.checkpoint.0000000020.0000000060.parquet is checkpoint part 20 out of 60 for the snapshot at version 4915. Zero padding is for lexicographic sorting.

  8. def checkpointPrefix(path: Path, version: Long): Path

    Permalink

    Returns the prefix of all checkpoint files for the given version.

    Returns the prefix of all checkpoint files for the given version.

    Intended for use with listFrom to get all files from this version onwards. The returned Path will not exist as a file.

  9. def checkpointVersion(path: Path): Long

    Permalink
  10. def checksumFile(path: Path, version: Long): Path

    Permalink

    Returns the path to the checksum file for the given version.

  11. val checksumFilePattern: Pattern

    Permalink
  12. def checksumVersion(path: Path): Long

    Permalink

    Returns the version for the given checksum file.

  13. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  14. def deltaFile(path: Path, version: Long): Path

    Permalink

    Returns the path for a given delta file.

  15. val deltaFilePattern: Pattern

    Permalink
  16. def deltaVersion(path: Path): Long

    Permalink

    Returns the version for the given delta path.

  17. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  18. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  19. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  20. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  21. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  22. def isCheckpointFile(path: Path): Boolean

    Permalink
  23. def isChecksumFile(path: Path): Boolean

    Permalink
  24. def isDeltaFile(path: Path): Boolean

    Permalink
  25. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  26. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  27. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  28. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  29. def numCheckpointParts(path: Path): Option[Int]

    Permalink
  30. def sampleFile(path: Path, version: Long): Path

    Permalink

    Returns the path for a given sample file

  31. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  32. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  33. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  35. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped