# Date de mise à jour: 01/04/2025 # Règles générales pour tous les robots User-agent: * Allow: / Crawl-delay: 1 Disallow: /category/ Disallow: /tag/ Disallow: /author/ Disallow: /page/ Disallow: /wp-json/ Disallow: /xmlrpc.php Disallow: /wp-content/plugins/ Disallow: /wp-content/themes/ Disallow: /wp-content/cache/ Disallow: /wp-content/upgrade/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /*.php$ Disallow: /*.cgi$ Disallow: /*?attachment_id= Disallow: /*?replytocom= Disallow: /*?s= Disallow: /*&s= Disallow: /search/ Disallow: /trackback/ Disallow: /feed/ Disallow: /comments/feed/ Disallow: /*?*utm*= Disallow: /*?*fb*= # Moteurs de recherche principaux User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: YandexBot Allow: / User-agent: Baiduspider Allow: / User-agent: Exabot Allow: / User-agent: Sogou web spider Allow: / User-agent: Sogou inst spider Allow: / User-agent: Slurp Allow: / User-agent: Applebot Allow: / User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: PinterestBot Allow: / # Robots d'indexation d'images User-agent: Googlebot-Image Allow: / User-agent: Bingbot-Image Allow: / # Robots d'indexation de vidéos User-agent: Googlebot-Video Allow: / # Robots d'indexation mobile User-agent: Googlebot-Mobile Allow: / # Robots LLM (Large Language Models) User-agent: GPTBot Allow: / User-agent: CCBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: DeepSeekBot Allow: / User-agent: MistralBot Allow: / User-agent: GeminiBot Allow: / User-agent: LlamaBot Allow: / User-agent: ClaudeBot Allow: / User-agent: CohereBot Allow: / User-agent: AnthropicBot Allow: / User-agent: OpenAssistantBot Allow: / User-agent: PerplexityBot Allow: / User-agent: AlephAlphaBot Allow: / User-agent: AI21LabsBot Allow: / User-agent: BardBot Allow: / User-agent: PaLMBot Allow: / User-agent: QwantBot Allow: / User-agent: FacebookBot Allow: / User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: AdsBot-Bing Allow: / # Sitemaps Sitemap: https://gsi-immobilier.com/sitemap_index.xml