Did You Know?

How to use

Estimated reading: 1 minute 192 views
  1. Open Bot Manager.
  2. Review robots.txt.
  3. Add or adjust rules carefully.
  4. Generate llms.txt if needed.
  5. Save.
  6. Test /robots.txt and /llms.txt in a browser.

Best practice

Be careful with Disallow rules. Blocking important pages can harm search visibility.

No comments yet — be the first to share your thoughts.

Leave a Comment

Share this Doc

How to use

Or copy link

CONTENTS