# LLMS Access Policy for outsourced.ph # Purpose: Clearly allow AI/LLM crawlers to access publicly available content. # Global allow User-agent: * Allow: / # Explicit allow for well-known AI/LLM and research crawlers User-agent: GPTBot # OpenAI training crawler Allow: / User-agent: OAI-SearchBot # OpenAI browsing/search Allow: / User-agent: OAI-User-Agent # OpenAI chat browsing agent Allow: / User-agent: ClaudeBot # Anthropic Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: CCBot # Common Crawl Allow: / User-agent: Bytespider # ByteDance/TikTok Allow: / User-agent: Amazonbot Allow: / User-agent: cohere-ai Allow: / # Google / Gemini crawlers User-agent: Google-Extended # Google content use for AI Allow: / User-agent: GoogleOther # Google non-product crawlers Allow: / User-agent: GoogleOther-Image Allow: / User-agent: GeminiBot # Explicit Gemini reference (maps to Google AI) Allow: / # Apple AI crawlers User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Sitemaps to help discovery Sitemap: https://outsourced.ph/sitemap_index.xml # Optional contact # Contact: mailto:contact@outsourced.ph