Robots.txt SEO checks

The robots.txt file tells crawlers which parts of the site they may visit. A wrong rule can hide a whole site from search engines.

SmooxSEO runs 5 robots.txt checks on every page of your site:

Critical Critical priority

The site, or its key pages, can drop out of Google or can't be reached. Fix it first.

Medium Medium priority

The page still ranks, but less well, or a real opportunity is lost. Fix it when you can.

Low Low priority

Good practice with a small effect, or something that is often intentional. Nice to have.

  • robots.txt missing

    Without robots.txt everything may be crawled; that is fine, but you have no control and no place to list your sitemap.