Class/Object

org.opencypher.spark.api.io.neo4j

Neo4jBulkCSVDataSink

Related Docs: object Neo4jBulkCSVDataSink | package neo4j

Permalink

class Neo4jBulkCSVDataSink extends FSGraphSource

This data sink writes a PropertyGraph into the Neo4j Bulk Import Format (see https://neo4j.com/docs/operations-manual/current/tools/import/).

In addition, it generates an import shell script that is parameterized with the path to the Neo4j installation and runs the import.

Linear Supertypes
FSGraphSource, JsonSerialization, AbstractPropertyGraphDataSource, CAPSPropertyGraphDataSource, PropertyGraphDataSource, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Neo4jBulkCSVDataSink
  2. FSGraphSource
  3. JsonSerialization
  4. AbstractPropertyGraphDataSource
  5. CAPSPropertyGraphDataSource
  6. PropertyGraphDataSource
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Neo4jBulkCSVDataSink(rootPath: String, arrayDelimiter: String = "|")(implicit session: CAPSSession)

    Permalink

    rootPath

    Directory where the graph is being stored in

    arrayDelimiter

    elimiter for array properties

    session

    CAPS session

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. implicit val caps: CAPSSession

    Permalink
    Definition Classes
    FSGraphSource → AbstractPropertyGraphDataSource

  6. def checkStorable(name: GraphName): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    CAPSPropertyGraphDataSource

  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  8. def dataFileForNodes(graphName: GraphName, labels: Set[String]): String

    Permalink

  9. def dataFileForRelationships(graphName: GraphName, relType: String): String

    Permalink

  10. def delete(graphName: GraphName): Unit

    Permalink
    Definition Classes
    Neo4jBulkCSVDataSink → AbstractPropertyGraphDataSource → PropertyGraphDataSource

  11. def deleteDirectory(path: String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource

  12. def deleteGraph(graphName: GraphName): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource → AbstractPropertyGraphDataSource

  13. val directoryStructure: DefaultGraphDirectoryStructure

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource

  14. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  15. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  16. lazy val fileSystem: FileSystem

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource

  17. val filesPerTable: Option[Int]

    Permalink

    optional parameter that specifies how many files a table is coalesced into, by default 1

    optional parameter that specifies how many files a table is coalesced into, by default 1

    Definition Classes
    FSGraphSource

  18. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  19. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  20. def graph(name: GraphName): PropertyGraph

    Permalink
    Definition Classes
    Neo4jBulkCSVDataSink → AbstractPropertyGraphDataSource → PropertyGraphDataSource

  21. var graphNameCache: Set[GraphName]

    Permalink
    Attributes
    protected
    Definition Classes
    AbstractPropertyGraphDataSource

  22. def graphNames: Set[GraphName]

    Permalink
    Definition Classes
    Neo4jBulkCSVDataSink → AbstractPropertyGraphDataSource → PropertyGraphDataSource

  23. def hasGraph(graphName: GraphName): Boolean

    Permalink
    Definition Classes
    Neo4jBulkCSVDataSink → AbstractPropertyGraphDataSource → PropertyGraphDataSource

  24. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  25. val hiveDatabaseName: Option[String]

    Permalink
    Definition Classes
    FSGraphSource

  26. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  27. def listDirectories(path: String): List[String]

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource

  28. def listGraphNames: List[String]

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource → AbstractPropertyGraphDataSource

  29. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  30. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  31. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  32. def readCAPSGraphMetaData(graphName: GraphName): CAPSGraphMetaData

    Permalink
    Attributes
    protected
    Definition Classes
    JsonSerialization

  33. def readFile(path: String): String

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource

  34. def readJsonCAPSGraphMetaData(graphName: GraphName): String

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource → JsonSerialization

  35. def readJsonSchema(graphName: GraphName): String

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource → JsonSerialization

  36. def readNodeTable(graphName: GraphName, labels: Set[String], sparkSchema: StructType): DataFrame

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource → AbstractPropertyGraphDataSource

  37. def readRelationshipTable(graphName: GraphName, relKey: String, sparkSchema: StructType): DataFrame

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource → AbstractPropertyGraphDataSource

  38. def readSchema(graphName: GraphName): CAPSSchema

    Permalink
    Attributes
    protected
    Definition Classes
    JsonSerialization

  39. def readTable(path: String, schema: StructType): DataFrame

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource

  40. val rootPath: String

    Permalink

    Directory where the graph is being stored in

    Directory where the graph is being stored in

    Definition Classes
    Neo4jBulkCSVDataSink → FSGraphSource

  41. def schema(graphName: GraphName): Option[CAPSSchema]

    Permalink
    Definition Classes
    Neo4jBulkCSVDataSink → AbstractPropertyGraphDataSource → PropertyGraphDataSource

  42. var schemaCache: Map[GraphName, CAPSSchema]

    Permalink
    Attributes
    protected
    Definition Classes
    AbstractPropertyGraphDataSource

  43. def schemaFileForNodes(graphName: GraphName, labels: Set[String]): String

    Permalink

  44. def schemaFileForRelationships(graphName: GraphName, relType: String): String

    Permalink

  45. def store(graphName: GraphName, graph: PropertyGraph): Unit

    Permalink
    Definition Classes
    AbstractPropertyGraphDataSource → PropertyGraphDataSource

  46. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  47. val tableStorageFormat: StorageFormat

    Permalink

    Spark configuration parameter for the table format

    Spark configuration parameter for the table format

    Definition Classes
    FSGraphSource → AbstractPropertyGraphDataSource

  48. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  49. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  50. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  51. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  52. def waitForWriteCompletion(writeFutures: Set[Future[Unit]])(implicit ec: ExecutionContext): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    AbstractPropertyGraphDataSource

  53. def writeCAPSGraphMetaData(graphName: GraphName, capsGraphMetaData: CAPSGraphMetaData): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    JsonSerialization

  54. def writeFile(path: String, content: String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource

  55. def writeJsonCAPSGraphMetaData(graphName: GraphName, capsGraphMetaData: String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource → JsonSerialization

  56. def writeJsonSchema(graphName: GraphName, schema: String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource → JsonSerialization

  57. def writeNodeTable(graphName: GraphName, labels: Set[String], table: DataFrame): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Neo4jBulkCSVDataSink → FSGraphSource → AbstractPropertyGraphDataSource

  58. def writeRelationshipTable(graphName: GraphName, relKey: String, table: DataFrame): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Neo4jBulkCSVDataSink → FSGraphSource → AbstractPropertyGraphDataSource

  59. def writeSchema(graphName: GraphName, schema: CAPSSchema): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Neo4jBulkCSVDataSink → JsonSerialization → AbstractPropertyGraphDataSource

  60. def writeTable(path: String, table: DataFrame): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FSGraphSource

Inherited from FSGraphSource

Inherited from JsonSerialization

Inherited from AbstractPropertyGraphDataSource

Inherited from CAPSPropertyGraphDataSource

Inherited from PropertyGraphDataSource

Inherited from AnyRef

Inherited from Any

Ungrouped