About our crawler
Last updated October 2026
Starter text. This page is a plain-language draft written for launch and has not been reviewed by a lawyer. Have it reviewed and completed with your registered business details before relying on it.
What it is
AfterClickBot is the program behind the free SEO audit on this website. When someone enters a web address, it reads that site's public pages to check technical SEO, AI readiness and conversion basics. It identifies itself in every request with a User-Agent that looks like AfterClickBot/1.0 followed by a link to this page.
How it behaves
- It only sends read-only GET requests. It never submits forms or logs in.
- It reads robots.txt first and does not fetch anything it disallows.
- It stays on one site, fetches at most a few pages per second, and slows itself down if the site answers with "too many requests" or "unavailable".
- It does not run JavaScript and does not download images, scripts or files.
- It stops after a set number of pages and a time limit, and refuses private or internal addresses.
How to block it
Add this to your robots.txt and it will not audit your site:
User-agent: AfterClickBot Disallow: /
Questions or problems
If the crawler caused a problem or you want it to stop, tell us the site address. Use the contact form.