# vibed — https://vibed.city # Search crawlers are welcome. AI training crawlers are not: the corpus is # other people's work, published to be played, not to be trained on. User-agent: * Disallow: /api/ Disallow: /admin Disallow: /cli Disallow: /preview/ Disallow: /auth/ Disallow: /i/ Disallow: /metrics Disallow: /healthz Disallow: /*?*utm_ Disallow: /*?*ref= Allow: / # TRAINING crawlers, denied by name. `Google-Extended` and `Applebot-Extended` # are the training-only tokens — blocking them does NOT affect Googlebot or # Applebot, so search indexing is untouched. User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: meta-externalagent Disallow: / User-agent: Amazonbot Disallow: / # AI SEARCH crawlers are deliberately NOT blocked — see the note in seo.ts. # Allowed: OAI-SearchBot, ChatGPT-User, Claude-User, PerplexityBot Sitemap: https://vibed.city/sitemap.xml