eels

Type Members

1. case class AndPredicate(predicates: Seq[Predicate]) extends Predicate with Product with Serializable

   

2. case class CloseableIterator[T](closeable: Closeable, iterator: Iterator[T]) extends Closeable with Iterator[T] with Product with Serializable

   

3. case class DataTypeRule(pattern: String, dataType: DataType, nullable: Boolean = true) extends Product with Serializable

   

4. case class EqualsPredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

   

5. case class FilePattern(pattern: String, filter: (Path) ⇒ Boolean = _ => true) extends Logging with Product with Serializable

   

6. case class GtPredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

   

7. case class GtePredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

   

8. trait Listener extends AnyRef

   

9. case class LtPredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

   

10. case class LtePredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

    

11. abstract class NamedPredicate extends Predicate

    

12. case class NotEqualsPredicate(name: String, value: Any) extends NamedPredicate with Product with Serializable

    

13. case class NotPredicate(inner: Predicate) extends Predicate with Product with Serializable

    

14. case class OrPredicate(predicates: Seq[Predicate]) extends Predicate with Product with Serializable

    

15. trait Part extends AnyRef

    

    A Part represents part of the source data.

    A Part represents part of the source data. Eg a single file in a multi-file source, or a single table in a multi-table source. Splitting sources into parts allows them to be read concurrently, therefore, implementations must ensure that different parts can be safely read in parallel. A single part is always read by a single thread.

16. sealed trait Predicate extends AnyRef

    

17. trait PredicateBuilder[T] extends AnyRef

    

18. case class Row(schema: StructType, values: Seq[Any]) extends Product with Serializable

    

19. trait RowOutputStream extends AnyRef

    

    A RowOutputStream writes Row data to some storage.

    A RowOutputStream writes Row data to some storage.

    It does not need to be thread safe, callers will guarantee that only a single thread will invoke a particular output stream at a time.

    RowOutputStream's can be implemented as lazy if required, so that file handles, etc, are not opened until the first record is written.

20. trait SchemaInferrer extends AnyRef

    

21. trait Sink extends Using

    

22. trait Source extends Logging

    

    A Source is a provider of data.

    A Source is a provider of data.

    A source implementation must provide two methods:

    1: schema() which returns an eel schema for the data source.

    2: parts() which returns zero or more Part instances representing the data.

    A part instance is a subset of the data in a Source, and allows for concurrent reading of that data. For example a part could be a single file in a multi-file source, or a partition in a partitioned source.