Blocked bots
We block a number of crawlers/bots that we identify by their User-Agent Header
on *.val.run domains. These bots generated an inordinate amount of traffic
(they are particularly fond of
playing chess).
This list may change at any time, we'll do our best to keep it up to date.
| User-Agent |
|---|
Amazonbot |
Anchor Browser |
Applebot |
Bytespider |
ClaudeBot |
Claude-SearchBot |
GPTBot |
meta-externalagent |
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) |
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html) |
Mozilla/5.0 (compatible; DataForSeoBot/1.0; +https://dataforseo.com/dataforseo-bot) |
Last updated