Package com.digitalpebble.stormcrawler.persistence.urlbuffer

Class SimpleURLBuffer

java.lang.Object

com.digitalpebble.stormcrawler.persistence.urlbuffer.AbstractURLBuffer

com.digitalpebble.stormcrawler.persistence.urlbuffer.SimpleURLBuffer

All Implemented Interfaces:

URLBuffer

Direct Known Subclasses:

PriorityURLBuffer

public class SimpleURLBuffer
extends AbstractURLBuffer

Simple implementation of a URLBuffer which rotates on the queues without applying any priority.

Since:

1.15

Nested Class Summary

Nested classes/interfaces inherited from class com.digitalpebble.stormcrawler.persistence.urlbuffer.AbstractURLBuffer

AbstractURLBuffer.URLMetadata

Field Summary

Fields inherited from class com.digitalpebble.stormcrawler.persistence.urlbuffer.AbstractURLBuffer

in_buffer, listener, partitioner, queues

Fields inherited from interface com.digitalpebble.stormcrawler.persistence.urlbuffer.URLBuffer

bufferClassParamName

Constructor Summary

Constructors

Constructor	Description
SimpleURLBuffer()

Method Summary

Modifier and Type	Method	Description
org.apache.storm.tuple.Values	next()	Retrieves the next available URL, guarantees that the URLs are always perfectly shuffled

Methods inherited from class com.digitalpebble.stormcrawler.persistence.urlbuffer.AbstractURLBuffer

add, add, configure, hasNext, numQueues, setEmptyQueueListener, size

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.digitalpebble.stormcrawler.persistence.urlbuffer.URLBuffer

acked

Constructor Detail

SimpleURLBuffer

public SimpleURLBuffer()

Method Detail

next

public org.apache.storm.tuple.Values next()

Retrieves the next available URL, guarantees that the URLs are always perfectly shuffled

Returns:

null if no entries are available