Searched refs:can_fetch (Results 1 – 5 of 5) sorted by relevance
| /external/python/cpython2/Lib/test/ |
| D | test_robotparser.py | 30 self.assertTrue(self.parser.can_fetch(agent, url))
32 self.assertFalse(self.parser.can_fetch(agent, url))
276 self.assertEqual(parser.can_fetch("*", robots_url), False)
287 parser.can_fetch("*", "https://www.python.org/robots.txt"))
|
| /external/python/cpython2/Doc/library/ |
| D | robotparser.rst | 50 .. method:: can_fetch(useragent, url)
75 >>> rp.can_fetch("*", "http://www.musi-cal.com/cgi-bin/search?city=San+Francisco")
77 >>> rp.can_fetch("*", "http://www.musi-cal.com/")
|
| /external/python/cpython2/Lib/ |
| D | robotparser.py | 130 def can_fetch(self, useragent, url): member in RobotFileParser
|
| /external/python/cpython2/Tools/webchecker/ |
| D | webchecker.py | 483 return self.robots[root].can_fetch(AGENTNAME, url)
|
| /external/python/cpython2/Misc/ |
| D | NEWS | 2111 prior to returning True in can_fetch().
|