Skip to content
Technical GEO Intermediate
Step 2 of 8

Per-bot deep dive: GPTBot, ClaudeBot, PerplexityBot

Every major AI vendor runs at least one named crawler, but the operational details — User-Agent strings, IP ranges, rate limits, the difference between training and live-fetch bots — vary enough that a one-size policy will misfire. Start with whichever bot dominates your logs and work outward from there.

What to read for this step

  1. GPTBot
    Wiki · coming soon
  2. ClaudeBot
    Wiki · coming soon
  3. PerplexityBot
    Wiki · coming soon

After this step, you should be able to answer

  • What's each bot's UA pattern, crawl frequency, and opt-out signal?
  • Which bot family doubles as both training and retrieval (and why that matters for opt-out)?
  • Which of these is actually showing up in your traffic logs today?