Package net.sansa_stack.spark.io.rdf.input.impl

Class RddRdfLoaderImpl<T>

java.lang.Object

net.sansa_stack.spark.io.rdf.input.api.RddLoaderBase<org.apache.hadoop.io.LongWritable,T>

net.sansa_stack.spark.io.rdf.input.impl.RddRdfLoaderImpl<T>

All Implemented Interfaces:

RddLoader<org.apache.hadoop.io.LongWritable,T>, RddRdfLoader<T>

public class RddRdfLoaderImpl<T>
extends RddLoaderBase<org.apache.hadoop.io.LongWritable,T>
implements RddRdfLoader<T>

Field Summary

Fields inherited from class net.sansa_stack.spark.io.rdf.input.api.RddLoaderBase

clazz, fileInputFormatClass

Constructor Summary

Constructors

Constructor	Description
RddRdfLoaderImpl(Class<T> clazz, Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,T>> fileInputFormatClass)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.rdd.RDD<T>	load(org.apache.spark.SparkContext sparkContext, String path)
org.apache.jena.riot.system.PrefixMap	peekPrefixes(org.apache.spark.SparkContext sparkContext, String path)	Peek prefixes w.r.t.

Methods inherited from class net.sansa_stack.spark.io.rdf.input.api.RddLoaderBase

getFileInputFormatClass, getValueClass

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface net.sansa_stack.spark.io.rdf.input.api.RddLoader

getFileInputFormatClass, getValueClass

Constructor Details

RddRdfLoaderImpl

public RddRdfLoaderImpl(Class<T> clazz,
 Class<? extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,T>> fileInputFormatClass)

Method Details

load

public org.apache.spark.rdd.RDD<T> load(org.apache.spark.SparkContext sparkContext,
 String path)

Specified by:

load in interface RddLoader<org.apache.hadoop.io.LongWritable,T>

peekPrefixes

public org.apache.jena.riot.system.PrefixMap peekPrefixes(org.apache.spark.SparkContext sparkContext,
 String path)

Description copied from interface: RddRdfLoader

Peek prefixes w.r.t. the hadoop configuration and the loader's FileInputFormat

Specified by:

peekPrefixes in interface RddRdfLoader<T>