CRAWLER POLICY / 04

ANZMachineShopsBot

Our crawler identifies as ANZMachineShopsBot/1.0 (+https://anzmachineshops.com/about/crawler). It reads robots.txt, follows Retry-After, uses conditional requests, and does not bypass access controls, login walls, CAPTCHAs or personal/social profiles.

Limits

At most four HTML pages and 2 MB per domain, no more than once every 90 days. Temporary 429 and 5xx outcomes are retried; blocked, login, CAPTCHA, 404 and 410 outcomes are acknowledged without repeated attempts.

Contact

For crawler questions or removal requests, use the private corrections form.

Corrections and removal requests ↗