ExperimentalSCollection

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

5. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

6. final def asInstanceOf[T0]: T0

   Definition Classes

   Any

7. def clone(): AnyRef

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

8. final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

9. def equals(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

10. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

11. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

12. def hashCode(): Int

    Definition Classes

    AnyRef → Any

13. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

14. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

15. final def notify(): Unit

    Definition Classes

    AnyRef

16. final def notifyAll(): Unit

    Definition Classes

    AnyRef

17. def saveAsTypedBigQuery(tableSpec: String, writeDisposition: WriteDisposition = null, createDisposition: CreateDisposition = null)(implicit ct: ClassTag[T], tt: scala.reflect.api.JavaUniverse.TypeTag[T], ev: <:<[T, HasAnnotation]): Future[Tap[T]]

    Save this SCollection as a BigQuery table.

    Save this SCollection as a BigQuery table. Note that element type T must be annotated with BigQueryType.

    This could be a complete case class with BigQueryType.toTable. For example:

    @BigQueryType.toTable
    case class Result(name: String, score: Double)
    
    val p: SCollection[Result] = // process data and convert elements to Result
    p.saveAsTypedBigQuery("myproject:mydataset.mytable")

    It could also be an empty class with schema from BigQueryType.fromSchema, BigQueryType.fromTable, or BigQueryType.fromQuery. For example:

    @BigQueryType.fromTable("publicdata:samples.gsod")
    class Row
    
    sc.typedBigQuery[Row]()
      .sample(withReplacement = false, fraction = 0.1)
      .saveAsTypedBigQuery("myproject:samples.gsod")

18. def saveAsTypedBigQuery(table: TableReference, writeDisposition: WriteDisposition, createDisposition: CreateDisposition)(implicit ct: ClassTag[T], tt: scala.reflect.api.JavaUniverse.TypeTag[T], ev: <:<[T, HasAnnotation]): Future[Tap[T]]

    Save this SCollection as a BigQuery table.

    Save this SCollection as a BigQuery table. Note that element type T must be a case class annotated with BigQueryType.toTable.

19. val self: SCollection[T]

20. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

21. def toString(): String

    Definition Classes

    AnyRef → Any

22. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

23. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

24. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )