Class

org.locationtech.geomesa.tools.ingest.DistributedCombineConverterIngest

ConverterCombineIngestJob

Related Doc: package DistributedCombineConverterIngest

Permalink

class ConverterCombineIngestJob extends ConverterIngestJob

Distributed job that uses converters to process input files in batches. This allows multiple files to be processed by one mapper. Batch size is controlled by the 'maxSplitSize' and should be scaled with mapper memory.

Linear Supertypes
ConverterIngestJob, AbstractIngestJob, JobWithLibJars, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ConverterCombineIngestJob
  2. ConverterIngestJob
  3. AbstractIngestJob
  4. JobWithLibJars
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ConverterCombineIngestJob(dsParams: Map[String, String], sft: SimpleFeatureType, converterConfig: Config, paths: Seq[String], maxSplitSize: Option[Integer], libjarsFiles: Seq[String], libjarsPaths: Iterator[() ⇒ Seq[File]])

    Permalink

    sft

    simple feature type

    converterConfig

    converter definition

    maxSplitSize

    size in bytes for each map split

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. def configureJob(job: Job): Unit

    Permalink
  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  9. def failed(job: Job): Long

    Permalink
    Definition Classes
    ConverterIngestJobAbstractIngestJob
  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  13. val inputFormatClass: Class[_ <: FileInputFormat[_, SimpleFeature]]

    Permalink
  14. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  15. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  16. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  18. def reduced(job: Job): Long

    Permalink
    Definition Classes
    AbstractIngestJob
  19. def run(statusCallback: StatusCallback, waitForCompletion: Boolean = true): Option[(Long, Long)]

    Permalink
    Definition Classes
    AbstractIngestJob
  20. def setLibJars(job: Job, fileNames: Seq[String], searchPath: Iterator[() ⇒ Seq[File]]): Unit

    Permalink
    Definition Classes
    JobWithLibJars
  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  22. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  23. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. def written(job: Job): Long

    Permalink
    Definition Classes
    ConverterIngestJobAbstractIngestJob

Inherited from ConverterIngestJob

Inherited from AbstractIngestJob

Inherited from JobWithLibJars

Inherited from AnyRef

Inherited from Any

Ungrouped