Why does my robots.txt change after I edit it in a plugin?

Two sources are fighting: a physical file in the site root always beats the virtual file plugins generate. Pick one mechanism, delete the other, and re-check what the URL actually serves.

Do I need a plugin to allow AI crawlers on WordPress?

No. A plain robots.txt file uploaded to your site root is the whole job. Plugins are a convenience editor for the same file, not a requirement.

Where does llms.txt go on WordPress?

The site root, next to where robots.txt lives, so it serves at yoursite.com/llms.txt. It is a static file; no plugin is needed.

WordPress robots.txt generator for AI crawlers

WordPress serves a VIRTUAL robots.txt when no real file exists: generated on the fly, minimal, and easy to mistake for a file you can edit. A physical robots.txt uploaded to your site root overrides it completely, and most SEO plugins can write that file for you. Knowing which of the two your site is serving is the first real question.

Your domain

Runs in your browser. Your domain is never sent to us, and nothing is stored.

Type your domain and the file appears here.

Applying this on WordPress

Check whether your robots.txt is virtual or physical: look for the file in your site root over SFTP or your host's file manager. If there is no file and yoursite.com/robots.txt still answers, you are on the virtual one.
Generate the AI-crawler rules with the tool above.
Apply them either by saving a physical robots.txt to the site root, or through your SEO plugin's robots editor if you use one. One method, not both: a physical file silently wins over anything a plugin generates dynamically.
Re-read yoursite.com/robots.txt and confirm the named AI crawlers appear.

llms.txt on WordPress

WordPress is your own server, so llms.txt is the easy case: upload the generated file to your site root exactly like any other static file, and it serves at yoursite.com/llms.txt. Verify with our llms.txt validator that it returns markdown rather than a 404 page your theme styles as a 200. llms.txt Validator · llms.txt Generator

Can AI crawlers read your WordPress content at all?

Classic WordPress renders on the server, so your content is in the HTML an AI crawler fetches. The risk arrives with page builders and headless setups that assemble content in the browser: if you use one, run the server-side rendering checker on a content page before assuming crawlers see what visitors see. Server-Side Rendering Checker

Questions

Why does my robots.txt change after I edit it in a plugin?: Two sources are fighting: a physical file in the site root always beats the virtual file plugins generate. Pick one mechanism, delete the other, and re-check what the URL actually serves.
Do I need a plugin to allow AI crawlers on WordPress?: No. A plain robots.txt file uploaded to your site root is the whole job. Plugins are a convenience editor for the same file, not a requirement.
Where does llms.txt go on WordPress?: The site root, next to where robots.txt lives, so it serves at yoursite.com/llms.txt. It is a static file; no plugin is needed.

By platform

The file is half the story. Whether AI engines then read and cite your WordPress site is the half you cannot see from your own dashboard. Run the free AI visibility audit