Is GPTBot blocked on your site?
GPTBot is the ChatGPT (indexing) crawler that builds the index the model answers from. If your robots.txt blocks it, that engine cannot read your pages, and a page it cannot read is a page it can never cite.
Free, no sign-up. We fetch one public file and read it. Nothing is stored.
Questions
- What does GPTBot do?
- GPTBot is used by ChatGPT (indexing). It builds the index the model answers from.
- Should I block GPTBot?
- Usually not. This crawler is how ChatGPT (indexing) reaches your pages when answering a question, so blocking it removes you from answers you could have been cited in.
- Is this check free?
- Yes, and there is no signup. We fetch one public file, robots.txt, and read the rules for this user-agent. You see the full result, including every failure we find.
Check something else
- Is ClaudeBot blocked on your site?Tests the ClaudeBot user-agent specifically, which builds the index the model answers from.
- Is Google-Extended blocked on your site?Tests the Google-Extended user-agent specifically, which collects pages used to train the model.
- Is your llms.txt valid?Reads and parses the llms.txt file itself, rather than testing a crawler rule.