rdd

Type Members

1. abstract class NextIterator[T, R] extends Iterator[R] with Logging

   

   An iterator that allows to iterate through the stream of JSON objects.

   An iterator that allows to iterate through the stream of JSON objects. Used MessagePackFactory parser by default.

   hasNext reads next element from the stream to accumulator and returns true if element exists

2. case class RDDPartition(idx: Int, ryftPartition: URL, rddQuery: RDDQuery) extends Partition with Product with Serializable

   

   Describes RyftRDD partition

   Describes RyftRDD partition

   idx

   Identifier of the partition, used internally by Spark

   ryftPartition

   Ryft rest URL

   rddQuery

   RDD query

3. class RDDPartitioner extends AnyRef

   

   Simple RyftRDD partitioner

4. case class RDDQuery(ryftQuery: RyftQuery, queryOptions: RyftQueryOptions, ryftPartitions: Set[URL], params: Map[String, String] = Map.empty, action: Action = Search) extends Product with Serializable

   

   Represents entity to specify query to Ryft Rest service and set of spark nodes preferred to use for this query.

5. abstract class RyftAbstractRDD[T, R] extends RDD[T]

   

   RDD representing of a RyftQuery.

   RDD representing of a RyftQuery.

   This class is the main entry point for analyzing data using Ryft with Spark.

6. class RyftPairRDD[T] extends RyftAbstractRDD[(String, T), T]

   

7. class RyftRDD[T] extends RyftAbstractRDD[T, T]