# FlyBrief — robots.txt # Public airspace briefing pages and the about/guide pages are open to # legitimate search-engine indexing. Live-tracking, retrieve, account, # and pilot-data endpoints are NOT for crawlers — they expose # real-time location data that uniquely identifies pilots in flight. # # Automated access beyond what's permitted here, and any scraping or # bulk extraction, is prohibited under our Terms of Service: # https://flybrief.app/terms.html # UK Database Right (Copyright and Rights in Databases Regulations 1997) # is asserted over the airspace, NOTAM, retrieve, and tracking datasets. User-agent: * Disallow: /rides/ Disallow: /notams/cache/ Disallow: /vendor/ Disallow: /db/ Disallow: /scripts/ Disallow: /ingesters/ Disallow: /health.php Disallow: /counter.php Disallow: /*.json.php$ Disallow: /*.bak # Public, indexable pages Allow: / Allow: /privacy.html Allow: /terms.html Allow: /notams/ Allow: /notams/about.html Allow: /notams/guide.html Allow: /notams/disclaimer.html Allow: /notams/about-glider.html Allow: /notams/guide-glider.html # Block known AI-scraper crawlers wholesale (training-data harvesters). # These do not respect Disallow when their operator overrides; the legal # claim against them lives in /terms.html clause 4. User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Omgilibot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Diffbot Disallow: / User-agent: Bytespider Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Applebot-Extended Disallow: / # Sitemap (optional — none currently published; legitimate search engines # will discover the public pages via Allow rules above) # Crawl-delay for non-AI bots to keep load reasonable User-agent: * Crawl-delay: 10