# aevumsecurity.com.sg — robots.txt
#
# Everything public is crawlable, by every crawler, including the AI search
# crawlers (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, PerplexityBot,
# Googlebot, Bingbot). They are covered by the "User-agent: *" group below;
# there is deliberately no per-crawler group, because a named group REPLACES
# the "*" group for that crawler and the two would drift apart over time.
#
# The only exclusions are two endpoints that are not documents: /api/ is
# POST-only (a crawler GET returns 405) and /health is a monitoring probe.
#
# The Sitemap: lines at the bottom are the one machine-consumed discovery
# directive in this file. The agent-surface sitemap is listed alongside the
# apex one so a crawler that reads this file learns both corpora exist.

User-agent: *
Allow: /
Disallow: /api/
Disallow: /health

# Machine-readable agent surface (for clients that already look for it):
#   llms.txt:   https://aevumsecurity.com.sg/llms.txt
#   Manifest:   https://agents.aevumsecurity.com.sg/.well-known/b2a.json
#   MCP server: https://agents.aevumsecurity.com.sg/mcp
#   Human-readable explanation of all of the above:
#               https://aevumsecurity.com.sg/agents/

Sitemap: https://aevumsecurity.com.sg/sitemap.xml
Sitemap: https://agents.aevumsecurity.com.sg/sitemap.xml

# Agent surface (machine-readable)
# See: https://agents.aevumsecurity.com.sg/llms.txt
# Manifest: https://agents.aevumsecurity.com.sg/.well-known/b2a.json