crawl · crawl.robots.noSitemap
robots.txt doesn't reference a sitemap
The Sitemap directive is how every search engine — not just Google — discovers your URL inventory automatically.
Why it matters
The Sitemap directive helps every search engine (not just Google) find your URL inventory automatically.
Example fix
Sitemap: https://your-domain.com/sitemap.xml
Authoritative reference
Run a full audit of your site
Free, no signup, no crawl cap. Check this and 90+ other factors across every public page.
Audit my site →