# CoGrader -- robots policy # Allow all major search engines and AI crawlers to index the public site. User-agent: * Allow: / # Block API endpoints, internal dev pages, and embeddable widgets from indexing. Disallow: /api/ Disallow: /dev/ Disallow: /embed/ # Sitemap index (generated by @astrojs/sitemap during build) Sitemap: https://cograder.com/sitemap-index.xml