org.allenai.common.indexing

BulkProcessorUtility

Related Doc: package indexing

class BulkProcessorUtility extends Logging

Factory for elasticsearch BulkProcessor.

Linear Supertypes
Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. BulkProcessorUtility
  2. Logging
  3. AnyRef
  4. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new BulkProcessorUtility()

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  5. def buildDumpOnErrorBulkProcessor(esClient: TransportClient, dumpFilePath: String): BulkProcessor

    Builds a bulk processor, with listener configured with nice behavior on fail: dump to fail and save failed requests to a sequence to be retried later.

    Builds a bulk processor, with listener configured with nice behavior on fail: dump to fail and save failed requests to a sequence to be retried later.

    esClient

    TransportClient with which to send requests to the elasticsearch server

    dumpFilePath

    path to dump files to

    returns

    The contructed bulk processor

  6. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. def dumpRequestToFile(request: BulkRequest, dumpFilePath: String): Unit

    Serialize a request and save to file.

    Serialize a request and save to file.

    request

    failed bulk request

    dumpFilePath

    path to dump folder

  8. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  12. def getFailedRequests(): List[BulkRequest]

    Get list of bulk requests that failed.

  13. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  14. val internalLogger: Logger

    Definition Classes
    Logging
  15. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  16. object logger

    Definition Classes
    Logging
  17. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  18. final def notify(): Unit

    Definition Classes
    AnyRef
  19. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  20. def randomRequestFileName(): String

    Utility method for generating random file name.

    Utility method for generating random file name.

    returns

    random file name

  21. def retryDumpedRequest(dumpFilePath: String, esConfig: com.typesafe.config.Config, indexName: String): Unit

    Method for retrying failed request.

    Method for retrying failed request.

    dumpFilePath

    path to dumped request

    esConfig

    configuration of elasticsearch index for which request should be executed

  22. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  23. def toString(): String

    Definition Classes
    AnyRef → Any
  24. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped