# Bidda Sovereign Intelligence Forest - Agent Discovery Standard (2026)
Sitemap: https://bidda.com/sitemap-index.xml
Agent-Knowledge: https://bidda.com/llms.txt
Agent-Manifest: https://bidda.com/llms-full.txt
Agent-Context: https://bidda.com/llms-ctx.txt
Feed: https://bidda.com/feed.xml
Insights-Feed: https://bidda.com/insights/feed.xml
Changelog-Feed: https://bidda.com/changelog/feed.xml
Compliance-Registry: https://bidda.com/.well-known/compliance-registry.json
Registry-Health: https://bidda.com/api/v1/registry-health.json
Latest-Intelligence: https://bidda.com/api/v1/nodes/latest.json
Tools-Manifest: https://bidda.com/api/v1/tools/index.json
Compliance-Scanner: https://bidda.com/scan
MCP-Server: https://bidda.com/mcp
Security-Contact: https://bidda.com/.well-known/security.txt
MITRE-Hub: https://bidda.com/mitre
MITRE-ATTACK-Matrix: https://bidda.com/mitre-attack
MITRE-D3FEND-Matrix: https://bidda.com/d3fend
MITRE-ATLAS-Matrix: https://bidda.com/atlas

# Plain-text mirrors of each MITRE matrix (JS-free, fully crawlable)
MITRE-Hub-Text: https://bidda.com/mitre.txt
MITRE-ATTACK-Text: https://bidda.com/mitre-attack.txt
MITRE-ATLAS-Text: https://bidda.com/atlas.txt
MITRE-D3FEND-Text: https://bidda.com/d3fend.txt
MITRE-CAPEC-Text: https://bidda.com/capec.txt

# Plain-text mirrors of key pages (JS-free, full rendered content + code examples)
Developer-Docs-Text: https://bidda.com/developers.txt
Methodology-Text: https://bidda.com/methodology.txt
Use-Cases-Text: https://bidda.com/use-cases.txt
Pricing-Text: https://bidda.com/pricing.txt
About-Text: https://bidda.com/about.txt
Audit-Text: https://bidda.com/audit.txt
Verify-Text: https://bidda.com/verify.txt
CISA-Hub-Text: https://bidda.com/cisa.txt
CISA-CPG-Crosswalk-Text: https://bidda.com/cisa-cpg-crosswalk.txt
CISA-Secure-By-Design-Text: https://bidda.com/cisa-secure-by-design.txt
CISA-Free-For-Defenders-Text: https://bidda.com/cisa-free.txt

# Core product pages
Interactive-Demo: https://bidda.com/playground
Use-Cases: https://bidda.com/use-cases
Pricing: https://bidda.com/pricing
Developer-Portal: https://bidda.com/developers
Methodology: https://bidda.com/methodology

# Trust + operations
Status: https://bidda.com/status
Acceptable-Use: https://bidda.com/aup
Security-Policy: https://bidda.com/security
Changelog: https://bidda.com/changelog

# Bidda x CISA: built-to public-trust surfaces (CPG crosswalk, Secure by Design attestation, no-cost defender capabilities)
CISA-Hub: https://bidda.com/cisa
CISA-CPG-Crosswalk: https://bidda.com/cisa/cpg-crosswalk
CISA-Secure-By-Design: https://bidda.com/cisa/secure-by-design
CISA-Free-For-Defenders: https://bidda.com/cisa/free

# Point-in-time history (per-node version index + change feed)
Node-History-Index: https://bidda.com/api/v1/history/index.json
Regulatory-Change-Feed: https://bidda.com/api/v1/changes.json

# Allow high-fidelity AI discovery
# All AI crawlers below are allowed to discovery-tier surfaces (search, BLUF
# summaries, methodology, MCP tools, plain-text mirrors). The vault tier and
# the auto-updater pipeline are gated separately - no crawler reaches paid
# content. This list is maintained manually; add new bots as they emerge.

User-agent: GPTBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Perplexity-User
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: GoogleOther
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Claude-Web
Allow: /

User-agent: anthropic-ai
Allow: /

User-agent: CommonCrawl
Allow: /

User-agent: CCBot
Allow: /

User-agent: Applebot-Extended
Allow: /

User-agent: Amazonbot
Allow: /

User-agent: Meta-ExternalAgent
Allow: /

User-agent: FacebookBot
Allow: /

User-agent: DuckAssistBot
Allow: /

User-agent: cohere-ai
Allow: /

User-agent: cohere-training-data-crawler
Allow: /

User-agent: MistralAI-User
Allow: /

User-agent: YouBot
Allow: /

User-agent: Diffbot
Allow: /

# Blocked crawlers - high request volume, zero referral value to Bidda's
# audience. PetalBot (Huawei) and Bytespider (ByteDance) are disallowed
# site-wide. Enforced at the edge (Cloudflare WAF) as well - robots.txt is
# the polite signal; the WAF rule is the hard stop.
User-agent: PetalBot
Disallow: /

User-agent: Bytespider
Disallow: /

# Generic rules for all other crawlers (regular search bots inherit from this)
User-agent: *
Disallow: /api/v1/vault/
Disallow: /preview/
Allow: /api/v1/nodes/
Allow: /insights/
Allow: /
Allow: /llms.txt
Allow: /llms-full.txt
Allow: /sitemap.xml