Skip to main content
Can AI see it

Know what AI sees. Measure what it's worth.

What is DuckAssistbot?

Direct Answer: DuckAssistBot is a web crawler operated by DuckDuckGo for AI-assisted search answers.

Operator: DuckDuckGo Type: AI Assistant Purpose: Real-time web crawling for AI-assisted search answers

DuckAssistBot is a web crawler for DuckDuckGo Search that crawls pages in real-time for AI-assisted answers, which cite their sources. The data is not used to train AI models. Publishers can opt out by modifying their robots.txt file.

User-Agent Identification

The following user-agent strings identify DuckAssistbot in your live traffic data:

  • DuckAssistBot/1.1; (+http://duckduckgo.com/duckduckbot.html)

robots.txt Rules for DuckAssistbot

Respects robots.txt: Yes

Use the following robots.txt rules to control DuckAssistbot access:

# Block DuckAssistbot
User-agent: DuckAssistBot
Disallow: /

# Allow DuckAssistbot
User-agent: DuckAssistBot
Allow: /

Robots.txt is a directive, not a barrier

DuckDuckGo states that DuckAssistbot respects robots.txt. However, configuration mistakes, caching delays, and edge cases mean your directives may not always be followed as expected. Live traffic verification confirms whether DuckAssistbot actually obeys your rules in practice.

Need continuous verification across 500+ bots? Can AI See It automates this.

Crawl Behavior

Frequency:Continuous

Request Pattern:Crawls Pages In Real-Time For AI-Assisted Answers

Official Documentation Quotes

"DuckAssistBot is a web crawler for DuckDuckGo Search that crawls pages in real-time for our AI-assisted answers, which prominently cite their sources."

Crawl Activity Index

Relative crawl activity for DuckAssistbot over the past 28 days. Higher values indicate increased crawling intensity compared to the period baseline.

View recent activity data (last 7 days)
Date Activity Index
Mar 28, 2026 20.8
Mar 29, 2026 22.8
Mar 30, 2026 21.7
Mar 31, 2026 24.2
Apr 1, 2026 18.4
Apr 2, 2026 20.3
Apr 3, 2026 18.3

Source: Cloudflare Radar

Why track DuckAssistbot traffic?

Measure what DuckDuckGo gives back. DuckAssistbot fetches your pages for AI-assisted answers — but do users actually click through to your site? Track referral visits from DuckDuckGo's AI assistant relative to how many pages it fetches.

Track real-time content usage by AI assistants. DuckAssistbot fetches your pages when a user explicitly asks DuckDuckGo's AI assistant to look something up. Each request represents a real user seeking your content through an AI intermediary.

Attribute AI-driven sessions. When someone clicks a link provided by DuckDuckGo's assistant, that visit can be tracked in your analytics. Connect DuckAssistbot crawls to referral sessions to measure the full path: AI fetch → user click → conversion.

Understand content authority signals. The pages DuckAssistbot fetches most often reveal what DuckDuckGo's AI considers authoritative on your site.

Detect 4XX and 5XX errors before users do. When DuckAssistbot hits a broken or unavailable page, it can't serve your content to users asking about it. Catching these errors early in your logs prevents lost visibility in AI-assisted answers.

Every DuckAssistbot request = a real person looking for your content

Unlike autonomous crawlers, DuckAssistbot only fetches your page when a real user asks for it. Every request in your logs represents someone who specifically wanted information from your site through DuckDuckGo's AI assistant.

1User asks DuckDuckGo's assistant

"Find me information from [your domain]"

2DuckAssistbot fetches your page

Logged in your server access logs with timestamp and URL

3Assistant shows your content + link

User sees your information with a citation link

4User clicks through to your site

Trackable as a referral session in your analytics

This makes DuckAssistbot the most directly measurable AI traffic source. Can AI See It connects these dots with the Crawl-to-Referral Ratio (CRR) — showing what percentage of AI-fetched requests translate into actual site visits and conversions.

What Can AI See It measures for DuckAssistbot

User-initiated fetches

How many real users asked AI to fetch your content

Crawl-to-Referral Ratio

What % of AI-fetched visitors actually land on your site

Top requested pages

Which content AI users ask about most

Revenue attribution

Conversions from AI assistant referrals

Blocking DuckAssistbot means cutting off a channel where real users are actively seeking your content. Before deciding, measure how many of these requests convert.

How is this different from prompt testing tools? Prompt testing checks if AI mentions your brand in simulated queries. Can AI See It measures what actually happens: real crawls, real referrals, real conversions — from your live traffic data.

Read: Why live traffic monitoring beats prompt testing →

Log Verification

To verify DuckAssistbot traffic in your live traffic data:

  1. Search access logs for the user-agent strings listed above
  2. Check if the IP addresses match documented ranges (if provided by DuckDuckGo)
  3. Verify the crawl pattern matches documented behavior
  4. Use reverse DNS lookup for additional verification if available

IP Verification: DuckDuckGo provides official IP verification via Published IP ranges. View verification instructions →

List of IP addresses provided

Note: Observed behavior in production environments may differ from official documentation. Live traffic monitoring provides the only reliable verification of actual bot behavior.

Live traffic monitoring vs prompt testing

Prompt testing toolsCan AI See It
What it measures Does AI mention your brand in test prompts? Does AI bot activity lead to real visits and conversions?
Data source Simulated AI queries Your live traffic data + analytics
Covers which bots ChatGPT, Perplexity, Gemini (chat interfaces only) 500+ bots including crawlers, assistants, and training bots
Business metric Brand mention frequency Crawl-to-Referral Ratio, revenue attribution
Tells you "AI mentions you 34% of the time for keyword X" "DuckAssistbot crawled 8,200 pages and DuckDuckGo sent 290 visitors who generated $4,100 in revenue"

Prompt testing shows visibility. Live traffic monitoring shows value. They're complementary — but only one connects to revenue. Read the full comparison →

Measure your Crawl-to-Referral Ratio for DuckAssistbot

See how much traffic DuckDuckGo actually sends back to your site relative to how much content DuckAssistbot takes.

  • Connect DuckAssistbot crawls in your logs with referral sessions in analytics
  • Calculate your CRR — the metric prompt testing tools can't provide
  • Make data-driven block/allow decisions for every AI bot
Start measuring for free → See how it works →

Measure business impact from DuckAssistbot

The real question is: does DuckAssistbot activity translate into referrals, sessions, and conversions on your site?

  • Crawls: pages fetched by DuckAssistbot
  • Referral tracking: DuckAssistbot takes — measure what DuckDuckGo gives back. Track actual visits arriving from DuckDuckGo's products to your site.
  • CRR: your Crawl-to-Referral Ratio — referrals per 1,000 crawls
Measure crawl-to-conversion for DuckAssistbot →

Based on your live traffic data and analytics — not synthetic prompt tests.

Official Documentation

View Official DuckAssistbot Documentation →

Information sourced from official documentation. Content generated with AI assistance.