mirror of
https://github.com/docker/docs.git
synced 2026-06-19 07:35:16 +00:00
David Karlsson
bca4905aef
Add Content-Signal directive opting in to AI training, search indexing, and AI input (RAG/grounding). Docker's official docs benefit from wide distribution through AI assistants, so permitting training and grounding is aligned with the site's purpose. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
20 lines
459 B
Plaintext
20 lines
459 B
Plaintext
{{- /*
|
|
For Netlify deployments, we disallow all routes to prevent search
|
|
engines from indexing our preview sites.
|
|
*/
|
|
-}}
|
|
|
|
{{- if hugo.IsProduction -}}
|
|
User-agent: *
|
|
Disallow: /unassociated-machines/
|
|
Content-Signal: ai-train=yes, search=yes, ai-input=yes
|
|
|
|
|
|
Sitemap: {{ "sitemap.xml" | absURL }}
|
|
{{- else -}}
|
|
# Disable all indexing on staging websites and Netlify previews to prevent
|
|
# them showing up in search results.
|
|
User-agent: *
|
|
Disallow: /
|
|
{{- end }}
|