Package com.digitalpebble.stormcrawler.persistence
-
Interface Summary Interface Description EmptyQueueListener Used by URLBuffer to inform the spouts when a queue has no more URLs in it -
Class Summary Class Description AbstractQueryingSpout Common features of spouts which query a backend to generate tuples.AbstractStatusUpdaterBolt Abstract bolt used to store the status of URLs.AdaptiveScheduler Adaptive fetch scheduler, checks by signature comparison whether a re-fetched page has changed: if yes, shrink the fetch interval up to a minimum fetch interval if not, increase the fetch interval up to a maximumDefaultScheduler Schedules a nextFetchDate based on the configurationMemoryStatusUpdater Use in combination with the MemorySpout for testing in local mode.Scheduler StdOutStatusUpdater Dummy status updater which dumps the content of the incoming tuples to the standard output. -
Enum Summary Enum Description Status