Bot Manager Overview

Bot Manager Overview

SEO Repair Kit’s Bot Manager gives you tools for controlling how search-engine crawlers and AI bots interact with your WordPress website.

It brings together two important areas:

• LLMs.txt for AI content discovery and bot access controls
• Robots.txt for managing crawler instructions

In this guide

• How to access Bot Manager
• Understanding the Bot Manager tabs
• LLMs.txt
• AI Bot Access Control
• Content selection
• Robots.txt
• Where to start

---

How to Access Bot Manager

From your WordPress dashboard, go to:

SEO Repair Kit → Bot Manager

The Bot Manager screen opens with two main tabs:

• LLMs.txt
• Robots.txt

---

LLMs.txt

The LLMs.txt tab provides tools for generating and managing an LLMs.txt file for your website.

The current interface lets you:

• Control access for listed AI bots
• Select Post Types
• Select Taxonomies
• Set a Posts/Terms Limit
• Add Additional Content
• Generate LLMs.txt
• Review generated LLMs.txt content
• Preview the file
• Save the file
• Delete LLMs.txt

Create and Manage an LLMs.txt File →

---

AI Bot Access Control

The AI Bot Access Control section lets you choose which listed AI bots can access your LLMs.txt file.

The current interface includes bots/services such as ChatGPT, Claude, Google Bard/Gemini, Perplexity AI, Bing Chat/Copilot, You.com, Character.AI, CCBot, Anthropic AI, DeepSeek, Grok, Qwen AI, Meta Llama, Cohere, Mistral AI, and Hugging Face.

Unchecked bots are handled according to the blocking behavior described in the Bot Manager interface.

Control AI Bot Access →

---

Content Selection

Bot Manager lets you choose which website content should be included when generating LLMs.txt.

You can select:

• Post Types
• Taxonomies
• Maximum Posts/Terms per type
• Additional custom content

The exact Post Types and Taxonomies available depend on what is registered on the WordPress website.

Choose Content for LLMs.txt →

---

Robots.txt

The Robots.txt tab provides an editor for managing your website’s robots.txt content.

From this area, you can:

• Edit robots.txt
• Save changes
• Validate the file
• Reset it to default
• Apply an enhanced configuration
• Delete the custom robots.txt

Manage Your Robots.txt File →

---

Where Should I Start?

If you are using Bot Manager for the first time, first review the LLMs.txt configuration.

Choose which AI bots you want to allow, select the content you want included, and then generate and review the file before saving it.

After that, review your Robots.txt configuration separately.

Create and Manage an LLMs.txt File →