Package

za.co.absa.cobrix.spark.cobol.source

streaming

Permalink

package streaming

Visibility
  1. Public
  2. All

Type Members

  1. class BufferedFSDataInputStream extends AnyRef

    Permalink
  2. class FileStreamer extends SimpleStream

    Permalink

    This class provides methods for streaming bytes from an HDFS file.

    This class provides methods for streaming bytes from an HDFS file.

    It is stateful, which means that it stores the offset until which the file has been consumed.

    Instances of this class are not reusable, i.e. once the file is fully read it can neither be reopened nor can other file be consumed.

    Exceptions thrown

    IllegalArgumentException in case the file is not found in the underlying file system.

Value Members

  1. object CobolStreamer

    Permalink

    Provides an integration point for adding streaming support to the Spark-Cobol library.

    Provides an integration point for adding streaming support to the Spark-Cobol library.

    This version is experimental and does not yet provide support to schemas or structured streaming.

Ungrouped