# Last updated: 2026-08-25
#
# One group only, on purpose. robots.txt has no inheritance: a crawler obeys
# the single most specific group that names it and ignores every other group,
# including this catch-all. The previous version gave Googlebot, Bingbot, the
# AI crawlers and the social crawlers a group each containing nothing but
# "Allow: /", which exempted all of them from the Disallow rules below -- so
# /panel/, /api/ and /how-to were open to precisely the crawlers the rules
# were written for. Everything not named is allowed by default anyway, so
# naming them bought nothing.
#
# Explicitly welcome, and covered by the rules below like everyone else:
# Googlebot, Googlebot-Extended, Bingbot, Slurp, DuckDuckBot, Baiduspider,
# YandexBot, Applebot, GPTBot, ChatGPT-User, ClaudeBot, anthropic-ai,
# PerplexityBot, cohere-ai, FacebookBot, facebookexternalhit, Twitterbot,
# LinkedInBot.
#
# /_next/ is NOT disallowed: it serves the JS and CSS Google needs to render
# the pages, and blocking it is the single fastest way to lose rankings.
#
# /components is not listed either: it now 404s outside dev, so there is
# nothing to disallow and no reason to publish the path.

User-agent: *
Allow: /
Disallow: /api/
Disallow: /panel/
Disallow: /how-to

Sitemap: https://tetrixx.ai/sitemap.xml