About CompetitorWatchBot
CompetitorWatchBot fetches publicly available web pages so our users can see a summary of a business website and, for subscribers, be told when it changes. It identifies itself with the user agent CompetitorWatchBot/1.0 (+https://competitorwatch.xyz/bot).
How it behaves:
- Reads only public pages with plain GET requests. It never logs in, never submits forms, and never bypasses any access control.
- Respects robots.txt for recurring monitoring.
- Fetches politely: a small number of pages, no more than one request per second, typically once a week per site.
- Stores short structural summaries and brief excerpts, not copies of your pages.
If you run a website and would like it excluded from monitoring, email [email protected] with the domain and we will block it.