Uses of Package
com.digitalpebble.stormcrawler.protocol
-
Classes in com.digitalpebble.stormcrawler.protocol used by com.digitalpebble.stormcrawler.protocol Class Description AbstractHttpProtocol.KeyValue Protocol ProtocolFactory ProtocolResponse ProtocolResponse.TrimmedContentReason Enum of reasons which may cause that protocol content is trimmed.RobotRules Wrapper for BaseRobotRules which tracks the number of requests and length of the responses needed to get the rules.RobotRulesParser This class uses crawler-commons for handling the parsing ofrobots.txt
files. -
Classes in com.digitalpebble.stormcrawler.protocol used by com.digitalpebble.stormcrawler.protocol.file Class Description Protocol ProtocolResponse -
Classes in com.digitalpebble.stormcrawler.protocol used by com.digitalpebble.stormcrawler.protocol.httpclient Class Description AbstractHttpProtocol Protocol ProtocolResponse -
Classes in com.digitalpebble.stormcrawler.protocol used by com.digitalpebble.stormcrawler.protocol.okhttp Class Description AbstractHttpProtocol Protocol ProtocolResponse -
Classes in com.digitalpebble.stormcrawler.protocol used by com.digitalpebble.stormcrawler.protocol.selenium Class Description AbstractHttpProtocol Protocol ProtocolResponse