org.allenai.pipeline

S3FlatArtifact

Related Doc: package pipeline

class S3FlatArtifact extends FlatArtifact with S3Artifact[FileArtifact]

Artifact implementations using S3 storage.

Linear Supertypes
S3Artifact[FileArtifact], Logging, FlatArtifact, Artifact, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. S3FlatArtifact
  2. S3Artifact
  3. Logging
  4. FlatArtifact
  5. Artifact
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new S3FlatArtifact(path: String, config: S3Config, contentTypeOverride: Option[String] = None)

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  5. def asProducer: Producer[FlatArtifact]

    Definition Classes
    FlatArtifact
  6. val bucket: String

    Attributes
    protected
    Definition Classes
    S3Artifact
  7. var cachedFile: Option[FileArtifact]

    Attributes
    protected
    Definition Classes
    S3Artifact
  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. val config: S3Config

    Definition Classes
    S3FlatArtifactS3Artifact
  10. def contentType: String

    Definition Classes
    S3Artifact
  11. val contentTypeOverride: Option[String]

    Definition Classes
    S3FlatArtifactS3Artifact
  12. def copyTo(other: FlatArtifact): Unit

    Definition Classes
    FlatArtifact
  13. def defaultContentType: String

    Definition Classes
    S3Artifact
  14. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  15. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  16. def exists: Boolean

    Definition Classes
    S3Artifact
  17. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  18. def getCachedArtifact: FileArtifact

    Attributes
    protected
    Definition Classes
    S3Artifact
  19. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  20. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  21. val internalLogger: Logger

    Definition Classes
    Logging
  22. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  23. object logger

    Definition Classes
    Logging
  24. def makeLocalArtifact(f: File): FileArtifact

    Attributes
    protected
    Definition Classes
    S3FlatArtifactS3Artifact
  25. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  26. final def notify(): Unit

    Definition Classes
    AnyRef
  27. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  28. val path: String

    Definition Classes
    S3FlatArtifactS3Artifact
  29. def read: InputStream

    Reading from a flat file gives an InputStream.

    Reading from a flat file gives an InputStream. The client code is responsible for closing this. This is necessary to support streaming.

    Definition Classes
    S3FlatArtifactFlatArtifact
  30. val service: AmazonS3Client

    Attributes
    protected
    Definition Classes
    S3Artifact
  31. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  32. def toString(): String

    Definition Classes
    S3FlatArtifact → AnyRef → Any
  33. def upload(file: File): Unit

    Attributes
    protected
    Definition Classes
    S3Artifact
  34. def url: URI

    Definition Classes
    S3Artifact
  35. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  36. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  37. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  38. def write[T](writer: (ArtifactStreamWriter) ⇒ T): T

    The write interface enforces atomic writes to a FlatArtifact The client code is unable to close any OutputStream, nor to keep it open after the writer function terminates.

    The write interface enforces atomic writes to a FlatArtifact The client code is unable to close any OutputStream, nor to keep it open after the writer function terminates. Furthermore, if a write operation fails (throws an Exception), the resulting Artifact must not be created.

    Definition Classes
    S3FlatArtifactFlatArtifact

Inherited from S3Artifact[FileArtifact]

Inherited from Logging

Inherited from FlatArtifact

Inherited from Artifact

Inherited from AnyRef

Inherited from Any

Ungrouped