MentionedBot
The crawler that reads a website when its owner asks Mentioned for a scan.
Last updated November 4, 2026
What it is
Every request it makes carries this user agent:
MentionedBot/0.1 (+https://meetmentioned.com/crawler; scans on request of the site owner)
It isn’t an AI company’s crawler, and it doesn’t train any AI model.
When it visits
It runs when someone asks Mentioned to scan a website. It reads up to 25 public pages, starting with the homepage, the sitemap and the pages they link to, to learn what the business does.
What it does and doesn’t do
- It follows robots.txt.
- It fetches only public pages, never private or internal network addresses.
- It limits how many pages it reads, how large they can be and how long it spends.
- It doesn’t log in, submit forms or run scripts.
How to block it
Add these lines to your robots.txt:
User-agent: MentionedBot
Disallow: /
Contact
Questions about MentionedBot go to [email protected].