Packages

  • package root
    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package criteo
    Definition Classes
    com
  • package cuttle

    Core cuttle concepts are defined here.

    Core cuttle concepts are defined here.

    Definition Classes
    criteo
  • package platforms

    Defines useful ExecutionPlatforms:

    Defines useful ExecutionPlatforms:

    • local to fork process locally in a managed way.
    • http to make HTTP calls with rate limiting.
    Definition Classes
    cuttle
  • package local

    Allow to fork process locally in a managed way.

    Allow to fork process locally in a managed way.

    It provides the exec interpolator that you can use to fork shell scripts:

    exec"""hdfs dfs -cp /from /to"""()

    The script your provide will be forked into another process. Note that if you provide several commands separated by ;' only the first one will be forked and the other ones will be ignored.

    If you really need to run several commands, you can use one of the followed ways:

    1. Chain multiple execs in a for-comprehension. Because of platform mechanism it will require several platform allocations to run completely.

    2. Wrap it in one sh -c' _In this case we cannot guarantee that all process spawned inside this fork will be successfully killed when we kill the parent process._

    Definition Classes
    platforms
  • InlineCommands
  • LocalPlatform
  • LocalProcess

case class LocalPlatform(maxForkedProcesses: Int) extends ExecutionPlatform with Product with Serializable

The LocalPlatform handles the execution of locally forked processes. The number of concurrently forked processes is limited and can be configured for the platform.

While waiting for the process to be actually forked, the Job Execution is seen as WAITING in the UI.

maxForkedProcesses

The maximum number of concurrently running processes.

Linear Supertypes
Serializable, Serializable, Product, Equals, ExecutionPlatform, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. LocalPlatform
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. ExecutionPlatform
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new LocalPlatform(maxForkedProcesses: Int)

    maxForkedProcesses

    The maximum number of concurrently running processes.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  8. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
  9. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  10. val maxForkedProcesses: Int
  11. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  12. final def notify(): Unit
    Definition Classes
    AnyRef
  13. final def notifyAll(): Unit
    Definition Classes
    AnyRef
  14. def privateRoutes: AuthenticatedService

    Expose a private lolhttp service for the platform operations (for the UI and API).

    Expose a private lolhttp service for the platform operations (for the UI and API).

    Definition Classes
    ExecutionPlatform
  15. lazy val publicRoutes: PartialService

    Expose a public lolhttp service for the platform internal statistics (for the UI and API).

    Expose a public lolhttp service for the platform internal statistics (for the UI and API).

    Definition Classes
    LocalPlatform → ExecutionPlatform
  16. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  17. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  18. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. def waiting: Set[Execution[_]]

    returns

    the list of Execution waiting for resources on this platform. These executions will be seen as WAITING in the UI and the API.

    Definition Classes
    LocalPlatform → ExecutionPlatform

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from ExecutionPlatform

Inherited from AnyRef

Inherited from Any

Ungrouped