jp.co.bizreach.robot
The object of parsing the robots.txt.
Parse the specified robots.txt.
input stream of robots.txt
encoding (optional: defaults to UTF-8)
the contents of the parsed robots.txt
The object of parsing the robots.txt.