User-agent: * Allow: / Allow: /api/sitemap LLMS: /llms.txt Disallow: /auth/ Disallow: /admin/ Disallow: /profile/ Disallow: /settings/ Disallow: /dashboard/ Disallow: /pages/index-* Disallow: /pages/draft/* Disallow: /_next/