# www.mogean.com — the whole site is public marketing copy, so everything is # crawlable. Pages that must NOT be indexed carry their own robots meta tag # (the contact thanks/error landings and 404 — see src/layouts/Base.astro's # `noindex` prop) and are filtered out of the sitemap in astro.config.mjs. # Non-canonical hosts (the *.cloudfront.net preview domain) are handled at the # edge instead: a CloudFront viewer-response function adds # `x-robots-tag: noindex, nofollow` on any Host that is not www.mogean.com # (infra/stacks/robots_function.py), which a static file here cannot do. User-agent: * Allow: / Sitemap: https://www.mogean.com/sitemap-index.xml