Free tools AI crawler access checker
AI crawler access checker
Enter your shop and see which AI crawlers your robots.txt and pages let in: the ones that answer shoppers in ChatGPT, Perplexity, Google and Claude.
How it works
- Central reads your robots.txt and the page's robots meta tags and headers, as each crawler would.
- Each crawler is listed with what it is used for, because blocking a training crawler is not the same as blocking a search crawler.
- Nothing is stored; a few checks a day are free.
Questions
Should I block AI crawlers?
Blocking training crawlers keeps your content out of model training. Blocking search and shopping crawlers keeps your products out of assistant answers. Many shops allow the search crawlers and decide on training separately.
You choose what goes in and where it goes out.
Central AI does everything in between. Your first 3 products are free.
- Your inputYour shop, your files or your product pages.
- Central AIResearches, verifies and writes everything in between. Every value is backed by sources you can check; what the sources do not support is held back.
- Your channelsProduct data and listings for the channels you choose.