ml.sparkling.graph.loaders.csv

CSVLoader

object CSVLoader

Main class of csv loader Created by Roman Bartusiak ([email protected] http://riomus.github.io).

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CSVLoader
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  12. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  13. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  14. def loadGraphFromCSV(file: String, csvLoaderConfig: CsvLoaderConfig = CsvLoaderConfig(), defaultVertex: Option[String] = Option(""), column1: Int = 0, column2: Int = 1, edgeAttributeProvider: (Row) ⇒ Double = defaultEdgeAttribute, partitions: Int = 0)(implicit sc: SparkContext): Graph[String, Double]

    Simple load graph from CSV.

    Simple load graph from CSV. Columns from witch vertices will be created must be numeric identifiers of vertices

    file

    - CSV input file

    csvLoaderConfig

    - Loader config, with default value

    defaultVertex

    - default vertex, has default value

    column1

    - first column to be selected as vertex, default:0

    column2

    - second column to be selected as vertex, default:1

    sc

    - spark contex

    returns

    Graph[String,Double] - loaded graph

  15. def loadGraphFromCSV[VD, ED](file: String, graphBuilder: (DataFrame) ⇒ Graph[VD, ED], csvLoaderConfig: CsvLoaderConfig, partitions: Int)(implicit sc: SparkContext): Graph[VD, ED]

    Main method for graph loading from csv, should be used for extension and further development, please use case specific loading methods present in that object

    Main method for graph loading from csv, should be used for extension and further development, please use case specific loading methods present in that object

    VD

    - vertex attribute type

    ED

    - edge attribute type

    file

    - CSV file

    graphBuilder

    - graph builder to handle graph creation from csv file

    csvLoaderConfig

    - csv loader configuration

    sc

    - spark context

    returns

    Graph[VD,ED] - loaded graph

  16. def loadGraphFromCSVWitVertexIndexing[VD, ED](file: String, csvLoaderConfig: CsvLoaderConfig = CsvLoaderConfig(), defaultVertex: Option[VD] = Option("").asInstanceOf[Option[VD]], column1: Int = 0, column2: Int = 1, edgeAttributeProvider: (Row) ⇒ ED = defaultEdgeAttribute, partitions: Int = 0)(implicit arg0: ClassTag[VD], arg1: ClassTag[ED], sc: SparkContext): Graph[VD, ED]

    Load graph from given CSV file, indexing vertices toprovide each unique ID.

    Load graph from given CSV file, indexing vertices toprovide each unique ID.

    VD

    - vertex type

    ED

    - edge type

    file

    - input CSV file

    csvLoaderConfig

    - CSV loader config , has default value

    defaultVertex

    - default Vertex value

    column1

    - first column to be selected as vertex, default:0

    column2

    - second column to be selected as vertex, default:1

    edgeAttributeProvider

    - provider for edge attribute, default 1L

    sc

    - spark context

    returns

    Graph[VD,ED] - loaded graph

  17. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  18. final def notify(): Unit

    Definition Classes
    AnyRef
  19. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  20. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  21. def toString(): String

    Definition Classes
    AnyRef → Any
  22. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped