Can AI crawlers read your site?
Before an AI engine can recommend a business, it has to be able to read its website. Enter your address and we will check your robots.txt rules, your llms.txt file, whether your content is readable, and whether your business data is described in code. No signup, no card.
FAQ
- What does this check do?
- We look at your site the way an AI crawler would: whether robots.txt blocks crawlers such as GPTBot, ClaudeBot and PerplexityBot, whether you have an llms.txt file, whether your home page contains readable text, and whether Schema.org markup and a page description are present. Five checks, one screen.
- Is blocking AI crawlers harmful?
- If you want to be recommended by AI, yes. When a crawler cannot read your site, the engine can only learn about you from other sources — directories, review sites, news — which means you do not get to write your own story. Blocking can be a deliberate choice; it is a loss only when nobody meant to do it.
- If I pass, will AI recommend me?
- No. This check measures the technical ground that makes your site READABLE. Being recommended is a separate question, and the only way to answer it is to ask the engines — which is exactly what our free visibility test does: it puts a real question to ChatGPT and shows you whether your name appears in the answer.
- Can it harm my site?
- No. We only read a few publicly available files (your home page, robots.txt, llms.txt), the same way a search engine does. Nothing is changed and nothing is stored.