# This file is what leid.no actually serves. A public/ file shadows an app/robots.ts route, # so the former app/robots.ts never took effect and its Disallow rules were dead; they now # live here. Staging is handled by buildspec.yaml, which moves robots-staging.txt over this # file, so keep that file self-contained rather than adding an environment check here. User-agent: * Allow: / # Account, checkout and auth flows: nothing indexable, and crawling them wastes crawl budget # that should go to products, categories, locations and the region landing pages. Disallow: /account/ Disallow: /api/ Disallow: /cart Disallow: /payment/ Disallow: /login/ Disallow: /register/ Disallow: /confirmUser Disallow: /change-password/ Disallow: /external/ Disallow: /organizations/ Disallow: /requests Sitemap: https://leid.no/sitemap.xml