org.apache.spark.sql.execution.streaming.HDFSMetadataLog

FileSystemManager

class FileSystemManager extends FileManager

Implementation of FileManager using older FileSystem API. Note that this implementation cannot provide atomic renaming of paths, hence can lead to consistency issues. This should be used only as a backup option, when FileContextManager cannot be used.

Linear Supertypes
FileManager, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. FileSystemManager
  2. FileManager
  3. AnyRef
  4. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new FileSystemManager(path: Path, hadoopConf: Configuration)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def create(path: Path): FSDataOutputStream

    Create path, or throw exception if it already exists

    Create path, or throw exception if it already exists

    Definition Classes
    FileSystemManagerFileManager
  9. def delete(path: Path): Unit

    Recursively delete a path if it exists.

    Recursively delete a path if it exists. Should not throw exception if file doesn't exist.

    Definition Classes
    FileSystemManagerFileManager
  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  12. def exists(path: Path): Boolean

    Whether path exists

    Whether path exists

    Definition Classes
    FileSystemManagerFileManager
  13. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  14. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  15. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  16. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  17. def list(path: Path, filter: PathFilter): Array[FileStatus]

    List the files in a path that matches a filter.

    List the files in a path that matches a filter.

    Definition Classes
    FileSystemManagerFileManager
  18. def mkdirs(path: Path): Unit

    Make directory at the give path and all its parent directories as needed.

    Make directory at the give path and all its parent directories as needed.

    Definition Classes
    FileSystemManagerFileManager
  19. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  20. final def notify(): Unit

    Definition Classes
    AnyRef
  21. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  22. def open(path: Path): FSDataInputStream

    Open a file for reading, or throw exception if it does not exist.

    Open a file for reading, or throw exception if it does not exist.

    Definition Classes
    FileSystemManagerFileManager
  23. def rename(srcPath: Path, destPath: Path): Unit

    Rename a path.

    Rename a path. Note that this implementation is not atomic.

    Definition Classes
    FileSystemManagerFileManager
    Exceptions thrown
    FileAlreadyExistsException

    if destination path already exists.

    FileNotFoundException

    if source path does not exist.

    IOException

    if renaming fails for some unknown reason.

  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  25. def toString(): String

    Definition Classes
    AnyRef → Any
  26. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from FileManager

Inherited from AnyRef

Inherited from Any

Ungrouped