Bot Manager Troubleshooting

Bot Manager Troubleshooting

Use this guide when LLMs.txt or Robots.txt is not behaving as expected.

In this guide

• LLMs.txt has not been generated
• Expected content is missing
• Unwanted content appears in LLMs.txt
• AI bot access is incorrect
• Robots.txt changes are not saved
• Robots.txt validation reports an issue
• Custom robots.txt was accidentally reset or deleted

---

LLMs.txt Has Not Been Generated

Go to:

SEO Repair Kit → Bot Manager → LLMs.txt

Check that:

1. Required Post Types are selected.
2. Required Taxonomies are selected.
3. Posts/Terms Limit is configured.
4. AI Bot Access settings have been reviewed.
5. You clicked Generate LLMs.txt.

After generation, review LLMs.txt Content and save the file.

---

Expected Content Is Missing from LLMs.txt

Check Select Post Types and Select Taxonomies.

Make sure the content type or taxonomy containing the missing information is selected.

Also review the Posts/Terms Limit, as this controls how many links can be included for each post type according to the interface.

Generate the file again after changing the configuration.

---

Unwanted Content Appears in LLMs.txt

Review:

• Selected Post Types
• Selected Taxonomies
• Additional Content

Remove selections or custom content that should not be included, then regenerate and review the file.

---

An AI Bot Has the Wrong Access Configuration

Open:

Bot Manager → LLMs.txt → AI Bot Access Control

Check whether the bot is selected.

Remember that the interface states unchecked listed bots are blocked, while bots not present in the list are allowed by default.

Save the updated configuration after making changes.

---

Robots.txt Changes Are Not Saved

Open:

Bot Manager → Robots.txt

Make the required edit and click:

Save Robots.txt

Then review the public robots.txt URL displayed at the top of the screen.

---

Robots.txt Validation Reports an Issue

Review the rules in the editor, particularly:

• User-agent declarations
• Allow rules
• Disallow rules
• Sitemap entry

Correct the configuration and run Validate again.

Avoid adding crawler directives you do not understand simply to remove a validation message.

---

I Accidentally Reset Robots.txt

If Reset to Default was used, review the current editor content.

Any custom configuration that is still required may need to be recreated and saved.

---

I Accidentally Deleted Custom Robots.txt

If Delete Custom Robots.txt was used, return to the Robots.txt Editor and review the current state before recreating a custom configuration.

---

Still Need Help?

If the issue continues, collect:

• Bot Manager tab involved
• Screenshot of the current settings
• Expected behavior
• Actual behavior
• WordPress version
• SEO Repair Kit version

For LLMs.txt issues, also include the relevant content-selection configuration.

For Robots.txt issues, include the relevant rules, but remove any information you do not want to share publicly.

Then contact SEO Repair Kit Support.