Is cohere-ai blocked on your site?
cohere-ai is a RETIRED user-agent. Superseded by cohere-training-data-crawler. Blocking it does not stop Cohere today, and this tester tells you that instead of counting it as a meaningful block.
Free, no sign-up. We fetch one public file and read it. Nothing is stored.
Questions
- What does cohere-ai do?
- cohere-ai is used by Cohere. It collects pages used to train the model.
- Should I block cohere-ai?
- There is little point: this token is retired, so blocking it protects nothing. Superseded by cohere-training-data-crawler.
- Is this check free?
- Yes, and there is no signup. We fetch one public file, robots.txt, and read the rules for this user-agent. You see the full result, including every failure we find.
Check something else
- Is CCBot blocked on your site?Tests the CCBot user-agent specifically, which collects pages used to train the model.
- Is Google-Extended blocked on your site?Tests the Google-Extended user-agent specifically, which collects pages used to train the model.
- Is GPTBot blocked on your site?Tests the GPTBot user-agent specifically, which builds the index the model answers from.
- Is your llms.txt valid?Reads and parses the llms.txt file itself, rather than testing a crawler rule.