# Content Signals (https://contentsignals.org/): usage preferences for # automated systems. search = building a search index and showing results, # ai-input = feeding content into AI models at answer time (RAG, grounding), # ai-train = training or fine-tuning AI models. This site wants to be # visible to and correctly represented by AI systems, so all are allowed. # A crawler obeys only its most specific User-agent group, so the signal # is repeated in every named group below - keep them identical. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # The 13 named groups below are grouped by vendor. Every one allows # everything, exactly like the * group - naming them is documentation, not # policy. Two reasons to keep them: a crawler only ever reads its most # specific group, so the Content-Signal has to be restated in each one to # reach it; and the training opt-out tokens need a group of their own. # WITHOUT an explicit rule, Applebot-Extended follows Applebot, then # Googlebot, then * - so Apple's training access would silently track # whatever Googlebot got. The explicit groups below sever that chain: a # future Disallow on Googlebot now leaves Apple and Google training # untouched, which is the point of naming them. # Allowing AI training is deliberate here; see ai.txt and llms.txt. # OpenAI User-agent: GPTBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / User-agent: OAI-SearchBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / User-agent: ChatGPT-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Anthropic User-agent: ClaudeBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / User-agent: Claude-SearchBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / User-agent: Claude-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Perplexity User-agent: PerplexityBot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / User-agent: Perplexity-User Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Google User-agent: Googlebot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / User-agent: Google-Extended Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Microsoft User-agent: Bingbot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Apple User-agent: Applebot Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / User-agent: Applebot-Extended Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / Sitemap: https://firstpoint.com.tr/sitemap.xml