Package com.digitalpebble.stormcrawler.elasticsearch.persistence
-
Class Summary Class Description AbstractSpout AggregationSpout Spout which pulls URL from an ES index.CollapsingSpout Spout which pulls URL from an ES index.HybridSpout Uses collapsing spouts to get an initial set of URLs and keys to query for and gets emptyQueue notifications from the URLBuffer to query ES for a specific key.ScrollSpout Reads all the documents from a shard and emits them on the status stream.StatusUpdaterBolt Simple bolt which stores the status of URLs into ElasticSearch.