What is PerplexityBot?
Direct Answer: PerplexityBot is Perplexity AI's search crawler, used to surface and link websites in Perplexity search results. It is explicitly not used to crawl content for AI foundation models.
PerplexityBot is the web crawler operated by Perplexity AI that builds the index powering Perplexity's AI-driven search experience. It identifies itself via the user-agent token 'PerplexityBot' and respects robots.txt directives — site owners are encouraged to allow it so their content can be surfaced and linked in Perplexity's answers. PerplexityBot is kept separate from Perplexity-User, which is a user-triggered fetcher used during live queries. Perplexity publishes the list of IP addresses PerplexityBot uses as a JSON file so site operators can verify requests.
User-Agent Identification
The following user-agent strings identify PerplexityBot in your live traffic data:
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
robots.txt Rules for PerplexityBot
Respects robots.txt: Yes
Use the following robots.txt rules to control PerplexityBot access:
# Block PerplexityBot
User-agent: PerplexityBot
Disallow: /
# Allow PerplexityBot
User-agent: PerplexityBot
Allow: /Robots.txt is a directive, not a barrier
Perplexity AI states that PerplexityBot respects robots.txt. However, configuration mistakes, caching delays, and edge cases mean your directives may not always be followed as expected. Live traffic verification confirms whether PerplexityBot actually obeys your rules in practice.
Need continuous verification across 500+ bots? Can AI See It automates this.
Crawl Behavior
Request Pattern:Not documented
Official Documentation Quotes
"PerplexityBot is designed to surface and link websites in search results on Perplexity. It is not used to crawl content for AI foundation models."
Why track PerplexityBot traffic?
Measure what Perplexity AI gives back. PerplexityBot fetches your content to power AI search — but does Perplexity AI send traffic in return? Track referral visits from Perplexity AI's AI search products relative to how much content PerplexityBot consumes.
See which pages fuel AI-generated answers. PerplexityBot fetches your content in real time to build search results for Perplexity AI's AI search product. Tracking these requests shows you which URLs are being used as sources.
Measure referral traffic from AI search. When PerplexityBot cites your page in an AI-generated answer and a user clicks through, that session is trackable. Correlate PerplexityBot crawls with downstream visits to understand your AI search performance.
Find citation gaps. If PerplexityBot frequently fetches certain pages but users never click through, your content may be answering the query completely in the AI response — leaving no reason to visit your site. That's a content strategy signal.
Spot 4XX and 5XX errors early. If PerplexityBot encounters broken or unavailable pages, your content won't appear in AI-generated answers. Catching these errors in your logs lets you fix them before you lose visibility in AI search results.
From crawl to conversion: how PerplexityBot affects your revenue
The bot fetches your content to use in AI-generated search results.
Perplexity AI's AI search shows your page as a source in its answer.
A user reading the AI answer clicks your link and visits your site.
The visitor signs up, buys, subscribes, or engages.
Most tools stop at step 2 — they test prompts to see if your brand appears in AI answers. But appearing in AI answers doesn't mean you're getting traffic. The AI might summarize your content so completely that nobody clicks through.
The only way to measure the full pipeline is by connecting PerplexityBot's crawl activity in your live traffic data with referral sessions in your analytics. That's exactly what Can AI See It does — including a Crawl-to-Referral Ratio (CRR) that shows how much traffic Perplexity AI actually sends back for every 1,000 pages PerplexityBot crawls.
What Can AI See It measures for PerplexityBot
Pages fetched by PerplexityBot per day, week, and month
Visits arriving from Perplexity AI's AI search to your site
Your AI traffic efficiency score — referrals per 1,000 crawls
Revenue and goals attributed to AI-referred sessions
Without this data, you're making block/allow decisions blind. A bot with high crawl volume but zero referrals is just consuming your content. A bot with modest crawls but high CRR is driving real business value.
How is this different from prompt testing tools? Prompt testing checks if AI mentions your brand in simulated queries. Can AI See It measures what actually happens: real crawls, real referrals, real conversions — from your live traffic data.
Read: Why live traffic monitoring beats prompt testing →Log Verification
To verify PerplexityBot traffic in your live traffic data:
- Search access logs for the user-agent strings listed above
- Check if the IP addresses match documented ranges (if provided by Perplexity AI)
- Verify the crawl pattern matches documented behavior
- Use reverse DNS lookup for additional verification if available
IP Verification: Perplexity AI provides official IP verification via Published IP list. View verification instructions →
Perplexity publishes the PerplexityBot IP ranges as a JSON file.
Note: Observed behavior in production environments may differ from official documentation. Live traffic monitoring provides the only reliable verification of actual bot behavior.
Undocumented Information
The following information is not officially documented for PerplexityBot:
- crawl frequency
- request pattern
- JavaScript rendering
Live traffic monitoring vs prompt testing
| Prompt testing tools | Can AI See It | |
|---|---|---|
| What it measures | Does AI mention your brand in test prompts? | Does AI bot activity lead to real visits and conversions? |
| Data source | Simulated AI queries | Your live traffic data + analytics |
| Covers which bots | ChatGPT, Perplexity, Gemini (chat interfaces only) | 500+ bots including crawlers, assistants, and training bots |
| Business metric | Brand mention frequency | Crawl-to-Referral Ratio, revenue attribution |
| Tells you | "AI mentions you 34% of the time for keyword X" | "PerplexityBot crawled 8,200 pages and Perplexity AI sent 290 visitors who generated $4,100 in revenue" |
Measure your Crawl-to-Referral Ratio for PerplexityBot
See how much traffic Perplexity AI actually sends back to your site relative to how much content PerplexityBot takes.
- Connect PerplexityBot crawls in your logs with referral sessions in analytics
- Calculate your CRR — the metric prompt testing tools can't provide
- Make data-driven block/allow decisions for every AI bot
Measure business impact from PerplexityBot
The real question is: does PerplexityBot activity translate into referrals, sessions, and conversions on your site?
- Crawls: pages fetched by PerplexityBot
- Referral tracking: PerplexityBot takes — measure what Perplexity AI gives back. Track actual visits arriving from Perplexity AI's products to your site.
- CRR: your Crawl-to-Referral Ratio — referrals per 1,000 crawls
Based on your live traffic data and analytics — not synthetic prompt tests.
Official Documentation
View Official PerplexityBot Documentation →
Information sourced from official documentation.