Package com.digitalpebble.stormcrawler.persistence

Class MemoryStatusUpdater

java.lang.Object

org.apache.storm.topology.base.BaseComponent

org.apache.storm.topology.base.BaseRichBolt

com.digitalpebble.stormcrawler.persistence.AbstractStatusUpdaterBolt

com.digitalpebble.stormcrawler.persistence.MemoryStatusUpdater

All Implemented Interfaces:

Serializable, org.apache.storm.task.IBolt, org.apache.storm.topology.IComponent, org.apache.storm.topology.IRichBolt

public class MemoryStatusUpdater
extends AbstractStatusUpdaterBolt

Use in combination with the MemorySpout for testing in local mode. There is no guarantee that this will work in distributed mode as it expects the MemorySpout to be in the same execution thread.

See Also:

Serialized Form

Field Summary

Fields inherited from class com.digitalpebble.stormcrawler.persistence.AbstractStatusUpdaterBolt

_collector, AS_IS_NEXTFETCHDATE_METADATA, cacheConfigParamName, maxFetchErrorsParamName, roundDateParamName, useCacheParamName

Constructor Summary

Constructors

Constructor	Description
MemoryStatusUpdater()

Method Summary

Modifier and Type	Method	Description
void	store(String url, Status status, Metadata metadata, Optional<Date> nextFetch, org.apache.storm.tuple.Tuple t)

Methods inherited from class com.digitalpebble.stormcrawler.persistence.AbstractStatusUpdaterBolt

ack, declareOutputFields, execute, getDocumentID, prepare

Methods inherited from class org.apache.storm.topology.base.BaseRichBolt

cleanup

Methods inherited from class org.apache.storm.topology.base.BaseComponent

getComponentConfiguration

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.storm.topology.IComponent

getComponentConfiguration

Constructor Detail

MemoryStatusUpdater

public MemoryStatusUpdater()

Method Detail

store

public void store(String url,
                  Status status,
                  Metadata metadata,
                  Optional<Date> nextFetch,
                  org.apache.storm.tuple.Tuple t)
           throws Exception

Specified by:

store in class AbstractStatusUpdaterBolt

Throws:

Exception