AvroSink

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

5. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

6. final def asInstanceOf[T0]: T0

   Definition Classes

   Any

7. val checkpoint: Option[Checkpoint]

   returns

   the checkpoint parameters if this sink is a Checkpoint

   Definition Classes

   AvroSink → SinkSource

8. def checkpointExists(implicit sc: ScoobiConfiguration): Boolean

   returns

   true if this Sink is a checkpoint and has been filled with data

   Definition Classes

   SinkSource

9. def checkpointName: Option[String]

   returns

   the name of the checkpoint

   Definition Classes

   SinkSource

10. def clone(): AnyRef

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws()

11. def compress: Sink

    returns

    a new sink with Gzip compression enabled

    Definition Classes

    Sink

12. def compressWith(codec: CompressionCodec, compressionType: CompressionType = CompressionType.BLOCK): AvroSink[K, B]

    returns

    a new sink with compression enabled

    Definition Classes

    AvroSink → Sink

13. val compression: Option[Compression]

    returns

    a compression object if this sink is compressed

    Definition Classes

    AvroSink → DataSink

14. def configureCompression(configuration: Configuration): DataSink[AvroKey[K], NullWritable, B]

    configure the compression for a given job

    configure the compression for a given job

    Definition Classes

    DataSink → Sink

15. final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

16. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws()

17. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

18. lazy val id: Int

    Definition Classes

    DataSink → Sink

19. def isCheckpoint: Boolean

    returns

    true if this sink is a checkpoint

    Definition Classes

    SinkSource

20. def isCompressed: Boolean

    returns

    true if this Sink is compressed

    Definition Classes

    DataSink → Sink

21. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

22. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

23. final def notify(): Unit

    Definition Classes

    AnyRef

24. final def notifyAll(): Unit

    Definition Classes

    AnyRef

25. lazy val output: Path

26. def outputCheck(implicit sc: ScoobiConfiguration): Unit

    Check the validity of the DataSink specification.

    Check the validity of the DataSink specification.

    Definition Classes

    AvroSink → DataSink → Sink

27. def outputConfigure(job: Job)(implicit sc: ScoobiConfiguration): Unit

    Configure the DataSink.

    Configure the DataSink.

    Definition Classes

    AvroSink → DataSink → Sink

28. val outputConverter: OutputConverter[AvroKey[K], NullWritable, B]

    Maps the type consumed by this DataSink to the key-values of its OutputFormat.

    Maps the type consumed by this DataSink to the key-values of its OutputFormat.

    Definition Classes

    AvroSink → DataSink → Sink

29. def outputFormat(implicit sc: ScoobiConfiguration): Class[_ >: GenericAvroKeyOutputFormat[K] <: AvroKeyOutputFormat[K]]

    The OutputFormat specifying the type of output for this DataSink.

    The OutputFormat specifying the type of output for this DataSink.

    Definition Classes

    AvroSink → DataSink → Sink

30. def outputKeyClass(implicit sc: ScoobiConfiguration): Class[AvroKey[K]]

    The Class of the OutputFormat's key.

    The Class of the OutputFormat's key.

    Definition Classes

    AvroSink → DataSink → Sink

31. def outputPath(implicit sc: ScoobiConfiguration): Some[Path]

    returns

    the path for this Sink.

    Definition Classes

    AvroSink → Sink

32. def outputSetup(implicit configuration: Configuration): Unit

    This method is called just before writing data to the sink

    This method is called just before writing data to the sink

    Definition Classes

    AvroSink → DataSink → Sink

33. def outputValueClass(implicit sc: ScoobiConfiguration): Class[NullWritable]

    The Class of the OutputFormat's value.

    The Class of the OutputFormat's value.

    Definition Classes

    AvroSink → DataSink → Sink

34. val overwrite: Boolean

35. val path: String

36. val schema: AvroSchema[B]

37. lazy val stringId: String

    Definition Classes

    DataSink → Sink

38. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

39. def toSource: Source

    Definition Classes

    AvroSink → SinkSource

40. def toString(): String

    Definition Classes

    AvroSink → AnyRef → Any

41. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws()

42. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws()

43. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws()