# Dizko robots.txt # Public event, editorial, DJ profile, venue, and product pages are open to # search and answer engines. Account pages and bulk DJ catalog surfaces are # excluded. User-agent: * Allow: / Disallow: /me Disallow: /onboarding Disallow: /preferences Disallow: /train Disallow: /saved Disallow: /djs Allow: /djs/ Disallow: /djs/graph # Named AI crawlers need their own rules because a specific user-agent group # does not inherit rules from the wildcard group. User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-Web User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: GoogleOther User-agent: CCBot User-agent: Applebot-Extended User-agent: Bytespider User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: cohere-ai Allow: / Disallow: /me Disallow: /onboarding Disallow: /preferences Disallow: /train Disallow: /saved Disallow: /djs Allow: /djs/ Disallow: /djs/graph Sitemap: https://www.dizko.app/sitemap.xml