public class UpdateStream extends TupleStream implements Expressible
TupleStream
as updates to a SolrCloud collection.TupleStream.IgnoreException
MapWriter.EntryWriter
Modifier and Type | Field and Description |
---|---|
static String |
BATCH_INDEXED_FIELD_NAME |
Constructor and Description |
---|
UpdateStream(StreamExpression expression,
StreamFactory factory) |
UpdateStream(String collectionName,
TupleStream tupleSource,
String zkHost,
int updateBatchSize) |
Modifier and Type | Method and Description |
---|---|
List<TupleStream> |
children() |
void |
close() |
protected boolean |
defaultPruneVersionField()
Used during initialization to specify the default value for the
"pruneVersionField" option. |
protected CloudSolrClient |
getCloudSolrClient()
Only viable after calling
open() |
protected String |
getCollectionName()
The name of the collection being updated
|
StreamComparator |
getStreamSort() |
void |
open() |
Tuple |
read() |
void |
setStreamContext(StreamContext context) |
Explanation |
toExplanation(StreamFactory factory)
Returns an explanation about the stream object
|
StreamExpression |
toExpression(StreamFactory factory) |
protected void |
uploadBatchToCollection(List<SolrInputDocument> documentBatch)
This method will be called on every batch of tuples comsumed, after converting each tuple
in that batch to a Solr Input Document.
|
getCost, getShards, getShards, getStreamNodeId, writeMap
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
_forEachEntry, _forEachEntry, _forEachEntry, _get, _get, _getStr, _getStr, _size
public static String BATCH_INDEXED_FIELD_NAME
public UpdateStream(StreamExpression expression, StreamFactory factory) throws IOException
IOException
public UpdateStream(String collectionName, TupleStream tupleSource, String zkHost, int updateBatchSize) throws IOException
IOException
protected String getCollectionName()
public void open() throws IOException
open
in class TupleStream
IOException
public Tuple read() throws IOException
read
in class TupleStream
IOException
public void close() throws IOException
close
in interface Closeable
close
in interface AutoCloseable
close
in class TupleStream
IOException
public StreamComparator getStreamSort()
getStreamSort
in class TupleStream
public List<TupleStream> children()
children
in class TupleStream
public StreamExpression toExpression(StreamFactory factory) throws IOException
toExpression
in interface Expressible
IOException
public Explanation toExplanation(StreamFactory factory) throws IOException
Expressible
toExplanation
in interface Expressible
toExplanation
in class TupleStream
factory
- Stream factory for this, contains information about the function nameIOException
- throw on any errorpublic void setStreamContext(StreamContext context)
setStreamContext
in class TupleStream
protected boolean defaultPruneVersionField()
"pruneVersionField"
option.
UpdateStream
returns true
for backcompat and to simplify slurping of data from one
collection to another.protected CloudSolrClient getCloudSolrClient()
open()
protected void uploadBatchToCollection(List<SolrInputDocument> documentBatch) throws IOException
IOException
Copyright © 2000-2024 Apache Software Foundation. All Rights Reserved.