# robots.txt for greenlineloanscash.com # Full crawl permissions for all search and AI bots. # Site: Independent editorial review of Greenline Loans tribal lender. User-agent: * Allow: / # ---- Search engine crawlers (explicit allow) ---- User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-News Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: YandexBot Allow: / User-agent: Baiduspider Allow: / # ---- Social crawlers (for OG image fetching) ---- User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: facebookcatalog Allow: / User-agent: LinkedInBot Allow: / User-agent: Pinterestbot Allow: / User-agent: WhatsApp Allow: / User-agent: TelegramBot Allow: / # ---- AI search & citation bots (allowed for discoverability) ---- # OpenAI (ChatGPT training, browsing, and search) User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic (Claude training and browsing) User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / # Google AI (Bard, Gemini, SGE) User-agent: Google-Extended Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Common Crawl (used by many AI training datasets) User-agent: CCBot Allow: / # Amazon (Alexa, Bedrock models) User-agent: Amazonbot Allow: / # Apple (Siri, Apple Intelligence) User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Meta AI User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / # Mistral AI User-agent: MistralAI-User Allow: / # DuckDuckGo AI assistant User-agent: DuckAssistBot Allow: / # You.com AI User-agent: YouBot Allow: / # Diffbot (knowledge graph builder) User-agent: Diffbot Allow: / # ---- Sitemaps (XML discovery) ---- Sitemap: https://greenlineloanscash.com/sitemap.xml Sitemap: https://greenlineloanscash.com/sitemap-index.xml Sitemap: https://greenlineloanscash.com/sitemap-images.xml # ---- Additional AI/machine-readable resources ---- # /llms.txt — AI-first content index (llmstxt.org standard) # /llms-full.txt — expanded facts, sourcing, and entity info for citation # /ai.txt — AI usage policy declaration # /sitemap/ — human-readable HTML sitemap