SitewalkBot
SitewalkBot is the crawler behind Sitewalk. Someone asked it to look at your site. This page says what it does and how to stop it.
What it is
A person typed your site address into Sitewalk and asked for a technical SEO audit. The bot fetches pages to build that report.
- User agent
SitewalkBot/1.0 (+https://audit.adityaarsharma.com/bot)- Source IPs
- 95.216.156.89
How it behaves
- It reads your robots.txt first and obeys it.
- It uses ports 80 and 443 only.
- It identifies itself with the user agent above. It does not pretend to be a browser.
- It crawls slowly. It stops if your server answers with errors that mean slow down or go away.
- There is a daily limit on how many audits can target one site, across all users.
- It will not follow links to private or internal network addresses.
Opt out
Add this to your robots.txt. The bot will not crawl your site after it next reads the file.
User-agent: SitewalkBot Disallow: /
To block only part of the site, replace / with the path.
Report a problem
If the bot is misbehaving, or you want it stopped and cannot edit robots.txt, write to the abuse contact. Include your domain and the time of the requests.
- Abuse contact
- work@adityaarsharma.com
- Response time
- within 2 business days