robots.txt guide

If Google can't crawl and index your site, nothing else matters. This guide covers the difference between crawlability and indexability, how to use robots.txt, noindex, canonical tags, and XML sitemaps to control what Google discovers, and how to use Search Console to monitor your index health.