| HttpBase | code | html |
| BlockedException | Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. | code | html |
| HttpException | Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. | code | html |
| RobotRulesParser | This class handles the parsing of robots.txt files. |
code | html |
| RobotRulesParser.RobotRuleSet | This class holds the rules which were parsed from a robots.txt file, and can test paths against those rules. | code | html |
| RobotRulesParser.RobotRuleSet.RobotsEntry | code | html |
Common API used by HTTP plugins (http , httpclient )