CRAWLER POLICY / 04
ANZMachineShopsBot
Our crawler identifies as ANZMachineShopsBot/1.0 (+https://anzmachineshops.com/about/crawler). It reads robots.txt, follows Retry-After, uses conditional requests, and does not bypass access controls, login walls, CAPTCHAs or personal/social profiles.
Limits
At most four HTML pages and 2 MB per domain, no more than once every 90 days. Temporary 429 and 5xx outcomes are retried; blocked, login, CAPTCHA, 404 and 410 outcomes are acknowledged without repeated attempts.
Contact
For crawler questions or removal requests, use the private corrections form.
Corrections and removal requests ↗