Fix guides ยท Crawler access

Declare your sitemap in robots.txt

Add a Sitemap: line with the full URL to your robots.txt.

Vendor documentation

What we check

We look for a Sitemap: line in your robots.txt.

76%

of 198 sites we could read pass this.

Why it matters

Google says to insert the line "anywhere in your robots.txt file," and there's no limit on how many you can include.

How to fix it

  1. Add a Sitemap: line using the full URL.
  2. Add another line for each additional sitemap.
Sitemap: https://yoursite.com/sitemap.xml

Fix it yourself with AI

Small fixes shouldn't sit in a queue. Give your AI agent one prompt, and it fixes and deploys for you.

PromptShip is made by the team behind this checker.

Sources

Fixed it?

Run your site through the checker, and re-check after you ship to see what improved.

Check my site

Related guides