Free checkclaude.ai
Can Google and AI find claude.ai?
23 / 100Score out of 100: the fewer and smaller the problems below, the higher. Checked 2026-09-28 10:22 UTC from the outside, the way a crawler sees it.
Fix these first
The problems that cost you the most visibility, worst first. Each one says why it matters and how to fix it.
1. Your site turns away crawlers it does not know
It answered 403 to our checker. That is usually a firewall or bot shield. Google usually gets through, but AI answer engines and smaller search engines often do not, and then they cannot read or cite you.
Fix: In your firewall or host settings (for example Cloudflare Bot Fight Mode), allow verified search and AI crawlers.
2. 3 AI answer engines are blocked
robots.txt keeps out ChatGPT search, ChatGPT reading a link, Gemini (Google AI). They cannot read or cite your pages when people ask them.
Fix: If you want to be recommended in AI answers, allow OAI-SearchBot, ChatGPT-User, Google-Extended in robots.txt. Blocking training bots such as GPTBot is fine; these are the search ones.
3. No sitemap found
A sitemap is how you hand Google and Bing the list of pages you want found.
Fix: Most site builders make one for you; turn it on and add a Sitemap: line to robots.txt.
1 more
- No llms.txt file: Add /llms.txt with one paragraph about you and links to your key pages.
Who is allowed to read your site
Read from your robots.txt. Blocked means that search engine or AI cannot read your pages, so it cannot show or cite them.
- Google Search Googlebotallowed
- Bing (also feeds ChatGPT search and Copilot) Bingbotallowed
- ChatGPT search OAI-SearchBotblocked
- ChatGPT reading a link ChatGPT-Userblocked
- Perplexity PerplexityBotallowed
- Claude search Claude-SearchBotallowed
- Gemini (Google AI) Google-Extendedblocked
- OpenAI model training GPTBot training onlyblocked (your choice)
- Anthropic model training ClaudeBot training onlyallowed
From your robots.txt.
Already good
Nothing to do here.
- Google and Bing are allowed to read your site
- Served over https
Get an email if claude.ai breaks for Google or AI
We re-check it every week and write only when something new goes wrong: a crawler gets blocked, a page is marked noindex, the sitemap breaks. Free. No account. One click to stop.
This is what a crawler sees. Now see what people do.
Connect Google Search Console and SearchLink tells you which pages lost clicks and why, checks every week, and emails you the 3 things to fix. Free for up to 3 sites.