Package com.digitalpebble.stormcrawler.indexing

Class StdOutIndexer

java.lang.Object

org.apache.storm.topology.base.BaseComponent

org.apache.storm.topology.base.BaseRichBolt

com.digitalpebble.stormcrawler.indexing.AbstractIndexerBolt

com.digitalpebble.stormcrawler.indexing.StdOutIndexer

All Implemented Interfaces:

Serializable, org.apache.storm.task.IBolt, org.apache.storm.topology.IComponent, org.apache.storm.topology.IRichBolt

public class StdOutIndexer
extends AbstractIndexerBolt

Indexer which generates fields for indexing and sends them to the standard output. Useful for debugging and as an illustration of what AbstractIndexerBolt provides.

See Also:

Serialized Form

Field Summary

Fields inherited from class com.digitalpebble.stormcrawler.indexing.AbstractIndexerBolt

canonicalMetadataParamName, ignoreEmptyFieldValueParamName, metadata2fieldParamName, metadataFilterParamName, textFieldParamName, textLengthParamName, urlFieldParamName

Constructor Summary

Constructors

Constructor	Description
StdOutIndexer()

Method Summary

Modifier and Type	Method	Description
void	execute(org.apache.storm.tuple.Tuple tuple)
void	prepare(Map<String,Object> conf, org.apache.storm.task.TopologyContext context, org.apache.storm.task.OutputCollector collector)

Methods inherited from class com.digitalpebble.stormcrawler.indexing.AbstractIndexerBolt

declareOutputFields, fieldNameForText, fieldNameForURL, filterDocument, filterMetadata, getDocumentID, ignoreEmptyFields, trimText, valueForURL

Methods inherited from class org.apache.storm.topology.base.BaseRichBolt

cleanup

Methods inherited from class org.apache.storm.topology.base.BaseComponent

getComponentConfiguration

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.storm.topology.IComponent

getComponentConfiguration

Constructor Detail

StdOutIndexer

public StdOutIndexer()

Method Detail

prepare

public void prepare(Map<String,Object> conf,
                    org.apache.storm.task.TopologyContext context,
                    org.apache.storm.task.OutputCollector collector)

Specified by:

prepare in interface org.apache.storm.task.IBolt

Overrides:

prepare in class AbstractIndexerBolt

execute

public void execute(org.apache.storm.tuple.Tuple tuple)