spark_validator

Type Members

1. case class AbsoluteSparkCounterValidationRule(counterName: String, min: Option[Long], max: Option[Long]) extends NoHistoryValidationRule with Product with Serializable

   Helper class to make it easy to write rule with an absolute min/max.

2. case class AvgRule(counterName: String, maxDiff: Double, histLength: Option[Int], newCounter: Boolean = false) extends ValidationRule with Product with Serializable

   Helper class to make it easy to write a rule based on previous average maxDiff is an absolute

3. case class HistoricData(jobid: Long, counters: Map[String, Long]) extends Product with Serializable

4. abstract class NoHistoryValidationRule extends ValidationRule

5. class Validation extends AnyRef

6. case class ValidationConf(jobBasePath: String, jobDir: String, firstTime: Boolean, rules: List[ValidationRule]) extends Product with Serializable

7. class ValidationListener extends SparkListener

8. abstract class ValidationRule extends AnyRef