# XRBitcoinCash robots.txt # Canonical domain: https://xrbitcoincash.com/ # Policy revision: 2026-09-01 # File cleanup: 2026-09-10; existing crawl permissions are unchanged. # # Allow legitimate public discovery by search, AI search, user-directed # retrieval, research/archive crawlers, and future standards-compliant crawlers. # The wildcard also preserves existing permission for model-training crawlers; # this is separate from search inclusion and is not a ranking guarantee. # # robots.txt is a crawler preference, not an authentication, authorization, # privacy, or security boundary. Protect sensitive resources server-side. # Default policy, including crawlers without a named group below. User-agent: * Allow: / # Search, image, preview, and archive crawlers. User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Bingbot Allow: / User-agent: MicrosoftPreview Allow: / User-agent: Applebot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: CCBot Allow: / # User-directed retrieval. User-agent: ChatGPT-User Allow: / User-agent: Claude-User Allow: / User-agent: Perplexity-User Allow: / # Canonical XML sitemap. Sitemap: https://xrbitcoincash.com/sitemap.xml # Human-readable references, not crawler directives. # https://xrbitcoincash.com/xrbc-metadata.json # https://xrbitcoincash.com/universal-ai.json # https://xrbitcoincash.com/.well-known/ai.json # https://xrbitcoincash.com/ai/provenance.json # https://xrbitcoincash.com/.well-known/security.txt