Package ai.djl.basicdataset.nlp
Class StanfordMovieReview
- java.lang.Object
-
- ai.djl.training.dataset.RandomAccessDataset
-
- ai.djl.basicdataset.nlp.TextDataset
-
- ai.djl.basicdataset.nlp.StanfordMovieReview
-
- All Implemented Interfaces:
ai.djl.training.dataset.Dataset
public class StanfordMovieReview extends TextDataset
TheStanfordMovieReview
dataset contains aApplication.NLP.SENTIMENT_ANALYSIS
set of movie reviews and their sentiment ratings.The data is sourced from reviews located on IMDB (see here for details).
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
StanfordMovieReview.Builder
A builder for aStanfordMovieReview
.-
Nested classes/interfaces inherited from class ai.djl.basicdataset.nlp.TextDataset
TextDataset.Sample
-
-
Field Summary
-
Fields inherited from class ai.djl.basicdataset.nlp.TextDataset
manager, mrl, prepared, samples, sourceTextData, targetTextData, usage
-
-
Constructor Summary
Constructors Modifier Constructor Description protected
StanfordMovieReview(StanfordMovieReview.Builder builder)
Creates a new instance ofStanfordMovieReview
with the given necessary configurations.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description protected long
availableSize()
static StanfordMovieReview.Builder
builder()
Creates a new builder to build aStanfordMovieReview
.ai.djl.training.dataset.Record
get(ai.djl.ndarray.NDManager manager, long index)
void
prepare(ai.djl.util.Progress progress)
-
Methods inherited from class ai.djl.basicdataset.nlp.TextDataset
getProcessedText, getRawText, getSamples, getTextEmbedding, getVocabulary, preprocess
-
Methods inherited from class ai.djl.training.dataset.RandomAccessDataset
getData, getData, getData, getData, newSubDataset, newSubDataset, randomSplit, size, subDataset, subDataset, subDataset, subDataset, toArray
-
-
-
-
Constructor Detail
-
StanfordMovieReview
protected StanfordMovieReview(StanfordMovieReview.Builder builder)
Creates a new instance ofStanfordMovieReview
with the given necessary configurations.- Parameters:
builder
- a builder with the necessary configurations
-
-
Method Detail
-
builder
public static StanfordMovieReview.Builder builder()
Creates a new builder to build aStanfordMovieReview
.- Returns:
- a new builder
-
prepare
public void prepare(ai.djl.util.Progress progress) throws java.io.IOException, ai.djl.modality.nlp.embedding.EmbeddingException
- Throws:
java.io.IOException
ai.djl.modality.nlp.embedding.EmbeddingException
-
get
public ai.djl.training.dataset.Record get(ai.djl.ndarray.NDManager manager, long index)
- Specified by:
get
in classai.djl.training.dataset.RandomAccessDataset
-
availableSize
protected long availableSize()
- Specified by:
availableSize
in classai.djl.training.dataset.RandomAccessDataset
-
-