Package com.digitalpebble.stormcrawler.bolt

Class URLPartitionerBolt

java.lang.Object

org.apache.storm.topology.base.BaseComponent

org.apache.storm.topology.base.BaseRichBolt

com.digitalpebble.stormcrawler.bolt.URLPartitionerBolt

All Implemented Interfaces:

Serializable, org.apache.storm.task.IBolt, org.apache.storm.topology.IComponent, org.apache.storm.topology.IRichBolt

public class URLPartitionerBolt
extends org.apache.storm.topology.base.BaseRichBolt

Generates a partition key for a given URL based on the hostname, domain or IP address.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor	Description
URLPartitionerBolt()

Method Summary

Modifier and Type	Method	Description
void	declareOutputFields(org.apache.storm.topology.OutputFieldsDeclarer declarer)
void	execute(org.apache.storm.tuple.Tuple tuple)
void	prepare(Map<String,Object> stormConf, org.apache.storm.task.TopologyContext context, org.apache.storm.task.OutputCollector collector)

Methods inherited from class org.apache.storm.topology.base.BaseRichBolt

cleanup

Methods inherited from class org.apache.storm.topology.base.BaseComponent

getComponentConfiguration

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.storm.topology.IComponent

getComponentConfiguration

Constructor Detail

URLPartitionerBolt

public URLPartitionerBolt()

Method Detail

execute

public void execute(org.apache.storm.tuple.Tuple tuple)

declareOutputFields

public void declareOutputFields(org.apache.storm.topology.OutputFieldsDeclarer declarer)

prepare

public void prepare(Map<String,Object> stormConf,
                    org.apache.storm.task.TopologyContext context,
                    org.apache.storm.task.OutputCollector collector)