AbstractConfigurable |
|
CharsetIdentification |
|
CollectionMetric |
|
ConfUtils |
|
CookieConverter |
Helper to extract cookies from cookies string.
|
InitialisationUtil |
|
MetadataTransfer |
Implements the logic of how the metadata should be passed to the outlinks, what should be stored
back in the persistence layer etc...
|
PerSecondReducer |
Used to return an average value per second *
|
RefreshTag |
|
RobotsTags |
Normalises the robots instructions provided by the HTML meta tags or the HTTP X-Robots-Tag
headers.
|
StringTabScheme |
Converts a byte array into URL + metadata
|
URLPartitioner |
Generates a partition key for a given URL based on the hostname, domain or IP address.
|
URLStreamGrouping |
Directs tuples to a specific bolt instance based on the URLPartitioner, e.g.
|
URLUtil |
Utility class for URL analysis
|