Adam Birds 4d9f161e0f tools: Suppress errors for github.com links. ... I have suppressed errors for github.com by adding an function to exclude domains as well as urls; this is necessary because GitHub has marked this tool's User-Agent as a blocker crawler. I have also suppressed reoccurring url errors that do definitely exist. Fixes #17928.		2021-04-09 12:25:23 -07:00
..
documentation_crawler	tools: Suppress errors for github.com links.	2021-04-09 12:25:23 -07:00
__init__.py	docs-test: Add scrapy crawler to check documentation not having broken links.	2016-10-25 11:35:16 -07:00
scrapy.cfg	cleanup: Delete leading newlines.	2019-08-06 23:29:11 -07:00