Package com.digitalpebble.stormcrawler.persistence.urlbuffer

Interface Summary

Interface	Description
URLBuffer	Buffers URLs to be processed into separate queues; used by spouts.

Class Summary

Class	Description
AbstractURLBuffer	Abstract class for URLBuffer interface, meant to simplify the code of the implementations and provide some default methods
PriorityURLBuffer	Determines the priority of the buffers based on the number of URLs acked in a configurable period of time.
SchedulingURLBuffer	Checks how long the last N URLs took to work out whether a queue should release a URL.
SimpleURLBuffer	Simple implementation of a URLBuffer which rotates on the queues without applying any priority.