Object

org.apache.spark.examples.snappydata

CreateColumnTable

Related Doc: package snappydata

Permalink

object CreateColumnTable extends SnappySQLJob

An example that shows how to create column tables in SnappyData using SQL or APIs.

This example can be run either in local mode (in which case the example runs collocated with Spark+SnappyData Store in the same JVM) or can be submitted as a job to an already running SnappyData cluster.

To run the example in local mode go to you SnappyData product distribution directory and type following command on the command prompt 

bin/run-example snappydata.CreateColumnTable quickstart/src/main/resources

To submit this example as a job to an already running cluster 

  cd $SNAPPY_HOME
  bin/snappy-job.sh submit
  --app-name CreateColumnTable
  --class org.apache.spark.examples.snappydata.CreateColumnTable
  --app-jar examples/jars/quickstart.jar
  --lead [leadHost:port]
  --conf data_resource_folder=../../quickstart/src/main/resources

Check the status of your job id
bin/snappy-job.sh status --lead [leadHost:port] --job-id [job-id]

The output of the job will be redirected to a file named CreateColumnTable.out
Linear Supertypes
SnappySQLJob, SparkJobBase, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CreateColumnTable
  2. SnappySQLJob
  3. SparkJobBase
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. type C = Any

    Permalink
    Definition Classes
    SnappySQLJob → SparkJobBase

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. def createAndGetDataDir: String

    Permalink

  7. def createColumnTableInferredSchema(snSession: SnappySession, pw: PrintWriter): Unit

    Permalink

    Creates a column table where schema is inferred from Parquet/CSV data file

  8. def createColumnTableUsingAPI(snSession: SnappySession, pw: PrintWriter): Unit

    Permalink

    Creates a column table using APIs

  9. def createColumnTableUsingSQL(snSession: SnappySession, pw: PrintWriter): Unit

    Permalink

    Creates a column table by executing a SQL statement thru SnappyContext

    Creates a column table by executing a SQL statement thru SnappyContext

    Other way to execute a SQL statement is thru JDBC or ODBC driver. Refer to JDBCExample.scala for more details

  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  12. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  13. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  14. def getCurrentDirectory: String

    Permalink

  15. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  16. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  17. def isValidJob(snappySession: SnappySession, config: Config): SnappyJobValidation

    Permalink
    Definition Classes
    CreateColumnTable → SnappySQLJob

  18. def main(args: Array[String]): Unit

    Permalink

  19. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  20. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  21. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  22. final def runJob(sc: C, jobConfig: Config): Any

    Permalink
    Definition Classes
    SnappySQLJob → SparkJobBase

  23. def runSnappyJob(snappySession: SnappySession, jobConfig: Config): Any

    Permalink
    Definition Classes
    CreateColumnTable → SnappySQLJob

  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  25. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  26. final def validate(sc: C, config: Config): SparkJobValidation

    Permalink
    Definition Classes
    SnappySQLJob → SparkJobBase

  27. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  29. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from SnappySQLJob

Inherited from SparkJobBase

Inherited from AnyRef

Inherited from Any

Ungrouped