org.allenai.pipeline

Producer

Related Doc: package pipeline

trait Producer[T] extends Logging with CachingEnabled with PipelineRunnerSupport

An individual step in a data processing pipeline. A lazily evaluated calculation, with support for in-memory caching and persistence.

Self Type
Producer[T]
Linear Supertypes
Known Subclasses
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Producer
  2. PipelineRunnerSupport
  3. HasCodeInfo
  4. CachingEnabled
  5. Logging
  6. AnyRef
  7. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def codeInfo: CodeInfo

    Definition Classes
    HasCodeInfo
  2. abstract def create: T

    Return the computed value.

  3. abstract def signature: Signature

    Represents a digest of the logic that will uniquely determine the output of this Producer Includes the inputs (other Producer instances feeding into this one) and parameters (other static configuration) and code version (a release id that should only change when the internal class logic changes)

    Represents a digest of the logic that will uniquely determine the output of this Producer Includes the inputs (other Producer instances feeding into this one) and parameters (other static configuration) and code version (a release id that should only change when the internal class logic changes)

    Definition Classes
    PipelineRunnerSupport

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  5. def cachingEnabled: Boolean

    Definition Classes
    CachingEnabled
  6. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def copy[T2](create: () ⇒ T2 = self.create, signature: () ⇒ Signature = self.signature, codeInfo: () ⇒ CodeInfo = self.codeInfo, cachingEnabled: () ⇒ Boolean = self.cachingEnabled): Producer[T2]

  8. def disableCaching: Producer[T]

    Default caching policy is set by the implementing class but can be overridden dynamically.

  9. def enableCaching: Producer[T]

    Default caching policy is set by the implementing class but can be overridden dynamically.

  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. def get: T

  14. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  15. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  16. val internalLogger: Logger

    Definition Classes
    Logging
  17. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  18. object logger

    Definition Classes
    Logging
  19. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  20. final def notify(): Unit

    Definition Classes
    AnyRef
  21. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  22. def outputLocation: Option[URI]

    If this Producer has been Persisted, this field will contain the URL of the Artifact where the data was written.

    If this Producer has been Persisted, this field will contain the URL of the Artifact where the data was written. This field should not be specified in the Producer implementation class. Specifying a value will not cause the Producer to be persisted. Rather, when a PersistedProducer is created, it will populate this field appropriately.

    Definition Classes
    ProducerPipelineRunnerSupport
  23. def persisted[A <: Artifact](io: ArtifactIo[T, A], artifactSource: ⇒ A): PersistedProducer[T, A]

    Persist the result of this step.

    Persist the result of this step. Once computed, write the result to the given artifact. If the artifact we are using for persistence exists, return the deserialized object rather than recomputing it.

  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  25. def toString(): String

    Definition Classes
    AnyRef → Any
  26. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from PipelineRunnerSupport

Inherited from HasCodeInfo

Inherited from CachingEnabled

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped