Is GPTBot blocked on your site?
GPTBot is the ChatGPT (indexing) crawler that builds the index the model answers from. If your robots.txt blocks it, that engine cannot read your pages, and a page it cannot read is a page it can never cite.
Free, no sign-up. We fetch one public file and read it. Nothing is stored.
Questions
- What does GPTBot do?
- GPTBot is used by ChatGPT (indexing). It builds the index the model answers from.
- Should I block GPTBot?
- Usually not. This crawler is how ChatGPT (indexing) reaches your pages when answering a question, so blocking it removes you from answers you could have been cited in.
- Is this check free?
- Yes, and there is no signup. We fetch one public file, robots.txt, and read the rules for this user-agent. You see the full result, including every failure we find.
Check something else
- Is OAI-SearchBot blocked on your site?Tests the OAI-SearchBot user-agent specifically, which fetches pages when someone runs a search in the assistant.
- Is ChatGPT-User blocked on your site?Tests the ChatGPT-User user-agent specifically, which fetches a page live when a user asks about it.
- Is ClaudeBot blocked on your site?Tests the ClaudeBot user-agent specifically, which builds the index the model answers from.
- Is your llms.txt valid?Reads and parses the llms.txt file itself, rather than testing a crawler rule.