Is OAI-SearchBot blocked on your site?
OAI-SearchBot is the ChatGPT Search crawler that fetches pages when someone runs a search in the assistant. If your robots.txt blocks it, that engine cannot read your pages, and a page it cannot read is a page it can never cite.
Free, no sign-up. We fetch one public file and read it. Nothing is stored.
Questions
- What does OAI-SearchBot do?
- OAI-SearchBot is used by ChatGPT Search. It fetches pages when someone runs a search in the assistant.
- Should I block OAI-SearchBot?
- Usually not. This crawler is how ChatGPT Search reaches your pages when answering a question, so blocking it removes you from answers you could have been cited in.
- Is this check free?
- Yes, and there is no signup. We fetch one public file, robots.txt, and read the rules for this user-agent. You see the full result, including every failure we find.
Check something else
- Is GPTBot blocked on your site?Tests the GPTBot user-agent specifically, which builds the index the model answers from.
- Is ChatGPT-User blocked on your site?Tests the ChatGPT-User user-agent specifically, which fetches a page live when a user asks about it.
- Is PerplexityBot blocked on your site?Tests the PerplexityBot user-agent specifically, which builds the index the model answers from.
- Is your llms.txt valid?Reads and parses the llms.txt file itself, rather than testing a crawler rule.