StepBasedCheckpoints

Checkpoint configuration for step-based checkpoints (i.e., checkpoints every n steps).

steps: Save checkpoints every this many steps.
maxCheckpointsToKeep: Maximum number of recent checkpoint files to keep. As new files are created, older files are deleted. If 0, then all checkpoint files are kept. Defaults to 5 (that is, the 5 most recent checkpoint files are kept).
keepCheckpointEveryNHours: Save checkpoints every this many hours. The default value of 10,000 hours effectively disables the feature.

Linear Supertypes

Serializable, Serializable, Product, Equals, CheckpointConfig, AnyRef, Any

Instance Constructors

new StepBasedCheckpoints(steps: Int = 1000, maxCheckpointsToKeep: Int = 5, keepCheckpointEveryNHours: Int = 10000)

steps
Save checkpoints every this many steps.
maxCheckpointsToKeep
Maximum number of recent checkpoint files to keep. As new files are created, older files are deleted. If 0, then all checkpoint files are kept. Defaults to 5 (that is, the 5 most recent checkpoint files are kept).
keepCheckpointEveryNHours
Save checkpoints every this many hours. The default value of 10,000 hours effectively disables the feature.

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes
Any
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
val keepCheckpointEveryNHours: Int

Save checkpoints every this many hours.
Save checkpoints every this many hours. The default value of 10,000 hours effectively disables the feature.

Definition Classes
StepBasedCheckpoints → CheckpointConfig
val maxCheckpointsToKeep: Int

Maximum number of recent checkpoint files to keep.
Maximum number of recent checkpoint files to keep. As new files are created, older files are deleted. If 0, then all checkpoint files are kept. Defaults to 5 (that is, the 5 most recent checkpoint files are kept).

Definition Classes
StepBasedCheckpoints → CheckpointConfig
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
val steps: Int

Save checkpoints every this many steps.
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Doc: package config

case class StepBasedCheckpoints(steps: Int = 1000, maxCheckpointsToKeep: Int = 5, keepCheckpointEveryNHours: Int = 10000) extends CheckpointConfig with Product with Serializable

Instance Constructors

new StepBasedCheckpoints(steps: Int = 1000, maxCheckpointsToKeep: Int = 5, keepCheckpointEveryNHours: Int = 10000)

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def clone(): AnyRef

final def eq(arg0: AnyRef): Boolean

def finalize(): Unit

final def getClass(): Class[_]

final def isInstanceOf[T0]: Boolean

val keepCheckpointEveryNHours: Int

val maxCheckpointsToKeep: Int

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

val steps: Int

final def synchronized[T0](arg0: ⇒ T0): T0

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from CheckpointConfig

Inherited from AnyRef

Inherited from Any

Ungrouped