Approximate comparison between two Datasets, can be customized using the Spark-Test configuration If the Datasets match the instances of Double, Float, or Timestamp, 'approx' will be used to compare an approximate equality of the two DSs.
Approximate comparison between two Datasets, can be customized using the Spark-Test configuration If the Datasets match the instances of Double, Float, or Timestamp, 'approx' will be used to compare an approximate equality of the two DSs.
Dataset to compare to
double for the approximate comparison. If the absolute value of the difference between two values is less than approx, then the two values are considered equal.
Check if all values are present into the dataset.
Check if all values are present into the dataset. If not, return a AssertionError.
values that should be in the dataset
Verify if the Dataset and Sequence are equals, can be customized using the Spark-Test configuration
Verify if the Dataset and Sequence are equals, can be customized using the Spark-Test configuration
Sequence to compare to
an exception if the Dataset and the Sequence are not equals
Comparison between two Datasets, can be customized using the Spark-Test configuration
Comparison between two Datasets, can be customized using the Spark-Test configuration
Dataset to compare to
an exception if both Datasets are not equals
Check if at least one row from the Dataset match the sql expression.
Check if at least one row from the Dataset match the sql expression. If not, return a SparkTestError.
expression to match
Check if at least one row from the Dataset match the predicate.
Check if at least one row from the Dataset match the predicate. If not, return a SparkTestError.
predicate to match
Check if all the rows from the Dataset match the sql expression.
Check if all the rows from the Dataset match the sql expression. If not, return a SparkTestError.
expression to match
Check if all the rows from the Dataset match the predicate.
Check if all the rows from the Dataset match the predicate. If not, return a SparkTestError.
predicate to match