Class/Object

org.apache.spark.sql.aliyun.datahub

DatahubSourceProvider

Related Docs: object DatahubSourceProvider | package datahub

Permalink

class DatahubSourceProvider extends DataSourceRegister with StreamSourceProvider with MicroBatchReadSupport with ContinuousReadSupport with WriteSupport with StreamWriteSupport

Linear Supertypes
StreamWriteSupport, BaseStreamingSink, WriteSupport, ContinuousReadSupport, MicroBatchReadSupport, DataSourceV2, StreamSourceProvider, DataSourceRegister, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. DatahubSourceProvider
  2. StreamWriteSupport
  3. BaseStreamingSink
  4. WriteSupport
  5. ContinuousReadSupport
  6. MicroBatchReadSupport
  7. DataSourceV2
  8. StreamSourceProvider
  9. DataSourceRegister
  10. AnyRef
  11. Any
  1. Hide All
  2. Show all
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DatahubSourceProvider()

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. def createContinuousReader(schema: Optional[StructType], checkpointLocation: String, options: DataSourceOptions): ContinuousReader

    Permalink
    Definition Classes
    DatahubSourceProvider → ContinuousReadSupport

  7. def createMicroBatchReader(schema: Optional[StructType], checkpointLocation: String, options: DataSourceOptions): MicroBatchReader

    Permalink
    Definition Classes
    DatahubSourceProvider → MicroBatchReadSupport

  8. def createStreamWriter(queryId: String, schema: StructType, mode: OutputMode, options: DataSourceOptions): StreamWriter

    Permalink
    Definition Classes
    DatahubSourceProvider → StreamWriteSupport

  9. def createWriter(writeUUID: String, schema: StructType, mode: SaveMode, options: DataSourceOptions): Optional[DataSourceWriter]

    Permalink
    Definition Classes
    DatahubSourceProvider → WriteSupport

  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  12. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  13. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  14. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  16. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  17. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  18. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  19. def shortName(): String

    Permalink
    Definition Classes
    DatahubSourceProvider → DataSourceRegister

  20. def sourceSchema(sqlContext: SQLContext, schema: Option[StructType], providerName: String, parameters: Map[String, String]): (String, StructType)

    Permalink
    Definition Classes
    DatahubSourceProvider → StreamSourceProvider

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  22. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  23. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  24. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  25. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def createSource(sqlContext: SQLContext, metadataPath: String, schema: Option[StructType], providerName: String, parameters: Map[String, String]): Source

    Permalink
    Definition Classes
    DatahubSourceProvider → StreamSourceProvider
    Annotations
    @deprecated
    Deprecated

    (Since version 1.8.0) use DataSourceV2 impl

Inherited from StreamWriteSupport

Inherited from BaseStreamingSink

Inherited from WriteSupport

Inherited from ContinuousReadSupport

Inherited from MicroBatchReadSupport

Inherited from DataSourceV2

Inherited from StreamSourceProvider

Inherited from DataSourceRegister

Inherited from AnyRef

Inherited from Any

Ungrouped