public class PostingsHighlighter extends Object
FieldInfo.IndexOptions.DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS
.
PostingsHighlighter treats the single original document as the whole corpus, and then scores individual
passages as if they were documents in this corpus. It uses a BreakIterator
to find
passages in the text; by default it breaks using getSentenceInstance(Locale.ROOT)
. It then iterates in parallel (merge sorting by offset) through
the positions of all terms from the query, coalescing those hits that occur in a single passage
into a Passage
, and then scores each Passage using a separate PassageScorer
.
Passages are finally formatted into highlighted snippets with a PassageFormatter
.
You can customize the behavior by subclassing this highlighter, some important hooks:
getBreakIterator(String)
: Customize how the text is divided into passages.
getScorer(String)
: Customize how passages are ranked.
getFormatter(String)
: Customize how snippets are formatted.
getIndexAnalyzer(String)
: Enable highlighting of MultiTermQuerys such as WildcardQuery
.
WARNING: The code is very new and probably still has some exciting bugs!
Example usage:
// configure field with offsets at index time FieldType offsetsType = new FieldType(TextField.TYPE_STORED); offsetsType.setIndexOptions(IndexOptions.DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS); Field body = new Field("body", "foobar", offsetsType); // retrieve highlights at query time PostingsHighlighter highlighter = new PostingsHighlighter(); Query query = new TermQuery(new Term("body", "highlighting")); TopDocs topDocs = searcher.search(query, n); String highlights[] = highlighter.highlight("body", query, searcher, topDocs);
This is thread-safe, and can be used across different readers.
Modifier and Type | Field and Description |
---|---|
static int |
DEFAULT_MAX_LENGTH
Default maximum content size to process.
|
Constructor and Description |
---|
PostingsHighlighter()
Creates a new highlighter with
DEFAULT_MAX_LENGTH . |
PostingsHighlighter(int maxLength)
Creates a new highlighter, specifying maximum content length.
|
Modifier and Type | Method and Description |
---|---|
String[] |
highlight(String field,
Query query,
IndexSearcher searcher,
TopDocs topDocs)
Highlights the top passages from a single field.
|
String[] |
highlight(String field,
Query query,
IndexSearcher searcher,
TopDocs topDocs,
int maxPassages)
Highlights the top-N passages from a single field.
|
Map<String,String[]> |
highlightFields(String[] fieldsIn,
Query query,
IndexSearcher searcher,
int[] docidsIn,
int[] maxPassagesIn)
Highlights the top-N passages from multiple fields,
for the provided int[] docids.
|
Map<String,String[]> |
highlightFields(String[] fields,
Query query,
IndexSearcher searcher,
TopDocs topDocs)
Highlights the top passages from multiple fields.
|
Map<String,String[]> |
highlightFields(String[] fields,
Query query,
IndexSearcher searcher,
TopDocs topDocs,
int[] maxPassages)
Highlights the top-N passages from multiple fields.
|
public static final int DEFAULT_MAX_LENGTH
public PostingsHighlighter()
DEFAULT_MAX_LENGTH
.public PostingsHighlighter(int maxLength)
maxLength
- maximum content size to process.IllegalArgumentException
- if maxLength
is negative or Integer.MAX_VALUE
public String[] highlight(String field, Query query, IndexSearcher searcher, TopDocs topDocs) throws IOException
field
- field name to highlight.
Must have a stored string value and also be indexed with offsets.query
- query to highlight.searcher
- searcher that was previously used to execute the query.topDocs
- TopDocs containing the summary result documents to highlight.topDocs
.
If no highlights were found for a document, the
first sentence for the field will be returned.IOException
- if an I/O error occurred during processingIllegalArgumentException
- if field
was indexed without
FieldInfo.IndexOptions.DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS
public String[] highlight(String field, Query query, IndexSearcher searcher, TopDocs topDocs, int maxPassages) throws IOException
field
- field name to highlight.
Must have a stored string value and also be indexed with offsets.query
- query to highlight.searcher
- searcher that was previously used to execute the query.topDocs
- TopDocs containing the summary result documents to highlight.maxPassages
- The maximum number of top-N ranked passages used to
form the highlighted snippets.topDocs
.
If no highlights were found for a document, the
first maxPassages
sentences from the
field will be returned.IOException
- if an I/O error occurred during processingIllegalArgumentException
- if field
was indexed without
FieldInfo.IndexOptions.DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS
public Map<String,String[]> highlightFields(String[] fields, Query query, IndexSearcher searcher, TopDocs topDocs) throws IOException
Conceptually, this behaves as a more efficient form of:
Map m = new HashMap(); for (String field : fields) { m.put(field, highlight(field, query, searcher, topDocs)); } return m;
fields
- field names to highlight.
Must have a stored string value and also be indexed with offsets.query
- query to highlight.searcher
- searcher that was previously used to execute the query.topDocs
- TopDocs containing the summary result documents to highlight.topDocs
.
If no highlights were found for a document, the
first sentence from the field will be returned.IOException
- if an I/O error occurred during processingIllegalArgumentException
- if field
was indexed without
FieldInfo.IndexOptions.DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS
public Map<String,String[]> highlightFields(String[] fields, Query query, IndexSearcher searcher, TopDocs topDocs, int[] maxPassages) throws IOException
Conceptually, this behaves as a more efficient form of:
Map m = new HashMap(); for (String field : fields) { m.put(field, highlight(field, query, searcher, topDocs, maxPassages)); } return m;
fields
- field names to highlight.
Must have a stored string value and also be indexed with offsets.query
- query to highlight.searcher
- searcher that was previously used to execute the query.topDocs
- TopDocs containing the summary result documents to highlight.maxPassages
- The maximum number of top-N ranked passages per-field used to
form the highlighted snippets.topDocs
.
If no highlights were found for a document, the
first maxPassages
sentences from the
field will be returned.IOException
- if an I/O error occurred during processingIllegalArgumentException
- if field
was indexed without
FieldInfo.IndexOptions.DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS
public Map<String,String[]> highlightFields(String[] fieldsIn, Query query, IndexSearcher searcher, int[] docidsIn, int[] maxPassagesIn) throws IOException
fieldsIn
- field names to highlight.
Must have a stored string value and also be indexed with offsets.query
- query to highlight.searcher
- searcher that was previously used to execute the query.docidsIn
- containing the document IDs to highlight.maxPassagesIn
- The maximum number of top-N ranked passages per-field used to
form the highlighted snippets.docidsIn
.
If no highlights were found for a document, the
first maxPassages
from the field will
be returned.IOException
- if an I/O error occurred during processingIllegalArgumentException
- if field
was indexed without
FieldInfo.IndexOptions.DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS
Copyright © 2010 - 2020 Adobe. All Rights Reserved