# https://bcminsurance.com/robots.txt User-agent: * Disallow: # The content handbook at /handbook sits behind the site's login, and a # crawler gets the sign-in panel, which carries a noindex meta tag. Nothing # needs disallowing here: a crawler has to fetch a page to see a noindex, so # blocking the path would leave the URL indexable by URL alone. Sitemap: https://bcminsurance.com/sitemap.xml