Class

com.mongodb.spark.rdd.api.java

JavaMongoRDD

Related Doc: package java

Permalink

case class JavaMongoRDD[D](rdd: MongoRDD[D])(implicit classTag: ClassTag[D]) extends JavaRDD[D] with Product with Serializable

Java specific version of com.mongodb.spark.rdd.MongoRDD.

Since

1.0

Linear Supertypes
Product, Equals, JavaRDD[D], AbstractJavaRDDLike[D, JavaRDD[D]], JavaRDDLike[D, JavaRDD[D]], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. JavaMongoRDD
  2. Product
  3. Equals
  4. JavaRDD
  5. AbstractJavaRDDLike
  6. JavaRDDLike
  7. Serializable
  8. Serializable
  9. AnyRef
  10. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new JavaMongoRDD(rdd: MongoRDD[D])(implicit classTag: ClassTag[D])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def aggregate[U](zeroValue: U)(seqOp: Function2[U, D, U], combOp: Function2[U, U, U]): U

    Permalink
    Definition Classes
    JavaRDDLike
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def cache(): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  7. def cartesian[U](other: JavaRDDLike[U, _]): JavaPairRDD[D, U]

    Permalink
    Definition Classes
    JavaRDDLike
  8. def checkpoint(): Unit

    Permalink
    Definition Classes
    JavaRDDLike
  9. implicit val classTag: ClassTag[D]

    Permalink
    Definition Classes
    JavaMongoRDD → JavaRDD → JavaRDDLike
  10. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. def coalesce(numPartitions: Int, shuffle: Boolean): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  12. def coalesce(numPartitions: Int): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  13. def collect(): List[D]

    Permalink
    Definition Classes
    JavaRDDLike
  14. def collectAsync(): JavaFutureAction[List[D]]

    Permalink
    Definition Classes
    JavaRDDLike
  15. def collectPartitions(partitionIds: Array[Int]): Array[List[D]]

    Permalink
    Definition Classes
    JavaRDDLike
  16. def context: SparkContext

    Permalink
    Definition Classes
    JavaRDDLike
  17. def count(): Long

    Permalink
    Definition Classes
    JavaRDDLike
  18. def countApprox(timeout: Long): PartialResult[BoundedDouble]

    Permalink
    Definition Classes
    JavaRDDLike
  19. def countApprox(timeout: Long, confidence: Double): PartialResult[BoundedDouble]

    Permalink
    Definition Classes
    JavaRDDLike
  20. def countApproxDistinct(relativeSD: Double): Long

    Permalink
    Definition Classes
    JavaRDDLike
  21. def countAsync(): JavaFutureAction[Long]

    Permalink
    Definition Classes
    JavaRDDLike
  22. def countByValue(): Map[D, Long]

    Permalink
    Definition Classes
    JavaRDDLike
  23. def countByValueApprox(timeout: Long): PartialResult[Map[D, BoundedDouble]]

    Permalink
    Definition Classes
    JavaRDDLike
  24. def countByValueApprox(timeout: Long, confidence: Double): PartialResult[Map[D, BoundedDouble]]

    Permalink
    Definition Classes
    JavaRDDLike
  25. def distinct(numPartitions: Int): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  26. def distinct(): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  27. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  28. def filter(f: org.apache.spark.api.java.function.Function[D, Boolean]): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  29. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  30. def first(): D

    Permalink
    Definition Classes
    JavaRDDLike
  31. def flatMap[U](f: FlatMapFunction[D, U]): JavaRDD[U]

    Permalink
    Definition Classes
    JavaRDDLike
  32. def flatMapToDouble(f: DoubleFlatMapFunction[D]): JavaDoubleRDD

    Permalink
    Definition Classes
    JavaRDDLike
  33. def flatMapToPair[K2, V2](f: PairFlatMapFunction[D, K2, V2]): JavaPairRDD[K2, V2]

    Permalink
    Definition Classes
    JavaRDDLike
  34. def fold(zeroValue: D)(f: Function2[D, D, D]): D

    Permalink
    Definition Classes
    JavaRDDLike
  35. def foreach(f: VoidFunction[D]): Unit

    Permalink
    Definition Classes
    JavaRDDLike
  36. def foreachAsync(f: VoidFunction[D]): JavaFutureAction[Void]

    Permalink
    Definition Classes
    JavaRDDLike
  37. def foreachPartition(f: VoidFunction[Iterator[D]]): Unit

    Permalink
    Definition Classes
    JavaRDDLike
  38. def foreachPartitionAsync(f: VoidFunction[Iterator[D]]): JavaFutureAction[Void]

    Permalink
    Definition Classes
    JavaRDDLike
  39. def getCheckpointFile(): Optional[String]

    Permalink
    Definition Classes
    JavaRDDLike
  40. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  41. def getNumPartitions: Int

    Permalink
    Definition Classes
    JavaRDDLike
    Annotations
    @Since( "1.6.0" )
  42. def getStorageLevel: StorageLevel

    Permalink
    Definition Classes
    JavaRDDLike
  43. def glom(): JavaRDD[List[D]]

    Permalink
    Definition Classes
    JavaRDDLike
  44. def groupBy[U](f: org.apache.spark.api.java.function.Function[D, U], numPartitions: Int): JavaPairRDD[U, Iterable[D]]

    Permalink
    Definition Classes
    JavaRDDLike
  45. def groupBy[U](f: org.apache.spark.api.java.function.Function[D, U]): JavaPairRDD[U, Iterable[D]]

    Permalink
    Definition Classes
    JavaRDDLike
  46. def id: Int

    Permalink
    Definition Classes
    JavaRDDLike
  47. def intersection(other: JavaRDD[D]): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  48. def isCheckpointed: Boolean

    Permalink
    Definition Classes
    JavaRDDLike
  49. def isEmpty(): Boolean

    Permalink
    Definition Classes
    JavaRDDLike
  50. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  51. def iterator(split: Partition, taskContext: TaskContext): Iterator[D]

    Permalink
    Definition Classes
    JavaRDDLike
  52. def keyBy[U](f: org.apache.spark.api.java.function.Function[D, U]): JavaPairRDD[U, D]

    Permalink
    Definition Classes
    JavaRDDLike
  53. def map[R](f: org.apache.spark.api.java.function.Function[D, R]): JavaRDD[R]

    Permalink
    Definition Classes
    JavaRDDLike
  54. def mapPartitions[U](f: FlatMapFunction[Iterator[D], U], preservesPartitioning: Boolean): JavaRDD[U]

    Permalink
    Definition Classes
    JavaRDDLike
  55. def mapPartitions[U](f: FlatMapFunction[Iterator[D], U]): JavaRDD[U]

    Permalink
    Definition Classes
    JavaRDDLike
  56. def mapPartitionsToDouble(f: DoubleFlatMapFunction[Iterator[D]], preservesPartitioning: Boolean): JavaDoubleRDD

    Permalink
    Definition Classes
    JavaRDDLike
  57. def mapPartitionsToDouble(f: DoubleFlatMapFunction[Iterator[D]]): JavaDoubleRDD

    Permalink
    Definition Classes
    JavaRDDLike
  58. def mapPartitionsToPair[K2, V2](f: PairFlatMapFunction[Iterator[D], K2, V2], preservesPartitioning: Boolean): JavaPairRDD[K2, V2]

    Permalink
    Definition Classes
    JavaRDDLike
  59. def mapPartitionsToPair[K2, V2](f: PairFlatMapFunction[Iterator[D], K2, V2]): JavaPairRDD[K2, V2]

    Permalink
    Definition Classes
    JavaRDDLike
  60. def mapPartitionsWithIndex[R](f: Function2[Integer, Iterator[D], Iterator[R]], preservesPartitioning: Boolean): JavaRDD[R]

    Permalink
    Definition Classes
    JavaRDDLike
  61. def mapToDouble[R](f: DoubleFunction[D]): JavaDoubleRDD

    Permalink
    Definition Classes
    JavaRDDLike
  62. def mapToPair[K2, V2](f: PairFunction[D, K2, V2]): JavaPairRDD[K2, V2]

    Permalink
    Definition Classes
    JavaRDDLike
  63. def max(comp: Comparator[D]): D

    Permalink
    Definition Classes
    JavaRDDLike
  64. def min(comp: Comparator[D]): D

    Permalink
    Definition Classes
    JavaRDDLike
  65. def name(): String

    Permalink
    Definition Classes
    JavaRDDLike
  66. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  67. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  68. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  69. def partitioner: Optional[Partitioner]

    Permalink
    Definition Classes
    JavaRDDLike
  70. def partitions: List[Partition]

    Permalink
    Definition Classes
    JavaRDDLike
  71. def persist(newLevel: StorageLevel): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  72. def pipe(command: List[String], env: Map[String, String], separateWorkingDir: Boolean, bufferSize: Int, encoding: String): JavaRDD[String]

    Permalink
    Definition Classes
    JavaRDDLike
  73. def pipe(command: List[String], env: Map[String, String], separateWorkingDir: Boolean, bufferSize: Int): JavaRDD[String]

    Permalink
    Definition Classes
    JavaRDDLike
  74. def pipe(command: List[String], env: Map[String, String]): JavaRDD[String]

    Permalink
    Definition Classes
    JavaRDDLike
  75. def pipe(command: List[String]): JavaRDD[String]

    Permalink
    Definition Classes
    JavaRDDLike
  76. def pipe(command: String): JavaRDD[String]

    Permalink
    Definition Classes
    JavaRDDLike
  77. def randomSplit(weights: Array[Double], seed: Long): Array[JavaRDD[D]]

    Permalink
    Definition Classes
    JavaRDD
  78. def randomSplit(weights: Array[Double]): Array[JavaRDD[D]]

    Permalink
    Definition Classes
    JavaRDD
  79. val rdd: MongoRDD[D]

    Permalink
    Definition Classes
    JavaMongoRDD → JavaRDD → JavaRDDLike
  80. def reduce(f: Function2[D, D, D]): D

    Permalink
    Definition Classes
    JavaRDDLike
  81. def repartition(numPartitions: Int): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  82. def sample(withReplacement: Boolean, fraction: Double, seed: Long): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  83. def sample(withReplacement: Boolean, fraction: Double): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  84. def saveAsObjectFile(path: String): Unit

    Permalink
    Definition Classes
    JavaRDDLike
  85. def saveAsTextFile(path: String, codec: Class[_ <: CompressionCodec]): Unit

    Permalink
    Definition Classes
    JavaRDDLike
  86. def saveAsTextFile(path: String): Unit

    Permalink
    Definition Classes
    JavaRDDLike
  87. def setName(name: String): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  88. def sortBy[S](f: org.apache.spark.api.java.function.Function[D, S], ascending: Boolean, numPartitions: Int): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  89. def subtract(other: JavaRDD[D], p: Partitioner): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  90. def subtract(other: JavaRDD[D], numPartitions: Int): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  91. def subtract(other: JavaRDD[D]): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  92. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  93. def take(num: Int): List[D]

    Permalink
    Definition Classes
    JavaRDDLike
  94. def takeAsync(num: Int): JavaFutureAction[List[D]]

    Permalink
    Definition Classes
    JavaRDDLike
  95. def takeOrdered(num: Int): List[D]

    Permalink
    Definition Classes
    JavaRDDLike
  96. def takeOrdered(num: Int, comp: Comparator[D]): List[D]

    Permalink
    Definition Classes
    JavaRDDLike
  97. def takeSample(withReplacement: Boolean, num: Int, seed: Long): List[D]

    Permalink
    Definition Classes
    JavaRDDLike
  98. def takeSample(withReplacement: Boolean, num: Int): List[D]

    Permalink
    Definition Classes
    JavaRDDLike
  99. def toDF[T](beanClass: Class[T]): DataFrame

    Permalink

    Creates a DataFrame based on the schema derived from the bean class

    Creates a DataFrame based on the schema derived from the bean class

    T

    The bean class type to shape the data from MongoDB into

    beanClass

    encapsulating the data from MongoDB

    returns

    a DataFrame

  100. def toDF(): DataFrame

    Permalink

    Creates a DataFrame inferring the schema by sampling data from MongoDB.

    Creates a DataFrame inferring the schema by sampling data from MongoDB.

    Note: Prefer toDS[T](beanClass:Class[T])* as any computations will be more efficient. The rdd must contain an _id for MongoDB versions < 3.2.

    returns

    a DataFrame

  101. def toDS[T](beanClass: Class[T]): Dataset[T]

    Permalink

    Creates a Dataset from the RDD strongly typed to the provided java bean.

    Creates a Dataset from the RDD strongly typed to the provided java bean.

    T

    The type of the data from MongoDB

    beanClass

    encapsulating the data from MongoDB

    returns

    a Dataset

  102. def toDebugString(): String

    Permalink
    Definition Classes
    JavaRDDLike
  103. def toLocalIterator(): Iterator[D]

    Permalink
    Definition Classes
    JavaRDDLike
  104. def toString(): String

    Permalink
    Definition Classes
    JavaRDD → AnyRef → Any
  105. def top(num: Int): List[D]

    Permalink
    Definition Classes
    JavaRDDLike
  106. def top(num: Int, comp: Comparator[D]): List[D]

    Permalink
    Definition Classes
    JavaRDDLike
  107. def treeAggregate[U](zeroValue: U, seqOp: Function2[U, D, U], combOp: Function2[U, U, U]): U

    Permalink
    Definition Classes
    JavaRDDLike
  108. def treeAggregate[U](zeroValue: U, seqOp: Function2[U, D, U], combOp: Function2[U, U, U], depth: Int): U

    Permalink
    Definition Classes
    JavaRDDLike
  109. def treeReduce(f: Function2[D, D, D]): D

    Permalink
    Definition Classes
    JavaRDDLike
  110. def treeReduce(f: Function2[D, D, D], depth: Int): D

    Permalink
    Definition Classes
    JavaRDDLike
  111. def union(other: JavaRDD[D]): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  112. def unpersist(blocking: Boolean): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  113. def unpersist(): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD
  114. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  115. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  116. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  117. def withPipeline[B <: Bson](pipeline: List[B]): JavaMongoRDD[D]

    Permalink

    Returns a copy with the specified aggregation pipeline

    Returns a copy with the specified aggregation pipeline

    pipeline

    the aggregation pipeline to use

    returns

    the updated MongoJavaRDD

  118. def wrapRDD(rdd: RDD[D]): JavaRDD[D]

    Permalink
    Definition Classes
    JavaRDD → JavaRDDLike
  119. def zip[U](other: JavaRDDLike[U, _]): JavaPairRDD[D, U]

    Permalink
    Definition Classes
    JavaRDDLike
  120. def zipPartitions[U, V](other: JavaRDDLike[U, _], f: FlatMapFunction2[Iterator[D], Iterator[U], V]): JavaRDD[V]

    Permalink
    Definition Classes
    JavaRDDLike
  121. def zipWithIndex(): JavaPairRDD[D, Long]

    Permalink
    Definition Classes
    JavaRDDLike
  122. def zipWithUniqueId(): JavaPairRDD[D, Long]

    Permalink
    Definition Classes
    JavaRDDLike

Inherited from Product

Inherited from Equals

Inherited from JavaRDD[D]

Inherited from AbstractJavaRDDLike[D, JavaRDD[D]]

Inherited from JavaRDDLike[D, JavaRDD[D]]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped