What is Devin?
Direct Answer: Devin is an autonomous AI software engineer operated by Devin AI, designed to assist engineering teams with coding tasks.
Devin is an AI-powered software engineer that can write, run, and test code. It can handle tasks such as code refactoring, bug fixing, and unit testing. Devin is designed to work alongside human engineers, helping them with small tasks and improving their workflow.
User-Agent Identification
The following user-agent strings identify Devin in your live traffic data:
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/137.0.0.0 Safari/537.36; Devin/1.0; +https://devin.ai
robots.txt Rules for Devin
Respects robots.txt: No
This bot does not commit to following robots.txt
Devin does not officially follow robots.txt directives. The only reliable way to control access is through server-side blocking (IP filtering, user-agent rules in your web server config) combined with log monitoring to verify effectiveness.
Need continuous verification across 500+ bots? Can AI See It automates this.
Crawl Behavior
Frequency:Not Documented
Request Pattern:Not Documented
Official Documentation Quotes
"Devin is an autonomous AI software engineer that can write, run and test code."
Crawl Activity Index
Relative crawl activity for Devin over the past 28 days. Higher values indicate increased crawling intensity compared to the period baseline.
View recent activity data (last 7 days)
| Date | Activity Index |
|---|---|
| Mar 28, 2026 | 2.8 |
| Mar 29, 2026 | 3.1 |
| Mar 30, 2026 | 5.7 |
| Mar 31, 2026 | 5.5 |
| Apr 1, 2026 | 7.0 |
| Apr 2, 2026 | 8.0 |
| Apr 3, 2026 | 10.1 |
Source: Cloudflare Radar
Why track Devin traffic?
Measure what Devin AI gives back. Devin fetches your pages for AI-assisted answers — but do users actually click through to your site? Track referral visits from Devin AI's AI assistant relative to how many pages it fetches.
Track real-time content usage by AI assistants. Devin fetches your pages when a user explicitly asks Devin AI's AI assistant to look something up. Each request represents a real user seeking your content through an AI intermediary.
Attribute AI-driven sessions. When someone clicks a link provided by Devin AI's assistant, that visit can be tracked in your analytics. Connect Devin crawls to referral sessions to measure the full path: AI fetch → user click → conversion.
Understand content authority signals. The pages Devin fetches most often reveal what Devin AI's AI considers authoritative on your site.
Detect 4XX and 5XX errors before users do. When Devin hits a broken or unavailable page, it can't serve your content to users asking about it. Catching these errors early in your logs prevents lost visibility in AI-assisted answers.
Every Devin request = a real person looking for your content
Unlike autonomous crawlers, Devin only fetches your page when a real user asks for it. Every request in your logs represents someone who specifically wanted information from your site through Devin AI's AI assistant.
"Find me information from [your domain]"
Logged in your server access logs with timestamp and URL
User sees your information with a citation link
Trackable as a referral session in your analytics
This makes Devin the most directly measurable AI traffic source. Can AI See It connects these dots with the Crawl-to-Referral Ratio (CRR) — showing what percentage of AI-fetched requests translate into actual site visits and conversions.
What Can AI See It measures for Devin
How many real users asked AI to fetch your content
What % of AI-fetched visitors actually land on your site
Which content AI users ask about most
Conversions from AI assistant referrals
Blocking Devin means cutting off a channel where real users are actively seeking your content. Before deciding, measure how many of these requests convert.
How is this different from prompt testing tools? Prompt testing checks if AI mentions your brand in simulated queries. Can AI See It measures what actually happens: real crawls, real referrals, real conversions — from your live traffic data.
Read: Why live traffic monitoring beats prompt testing →Log Verification
To verify Devin traffic in your live traffic data:
- Search access logs for the user-agent strings listed above
- Check if the IP addresses match documented ranges (if provided by Devin AI)
- Verify the crawl pattern matches documented behavior
- Use reverse DNS lookup for additional verification if available
Note: Observed behavior in production environments may differ from official documentation. Live traffic monitoring provides the only reliable verification of actual bot behavior.
Undocumented Information
The following information is not officially documented for Devin:
- crawl frequency
- request pattern
- IP verification method
- JavaScript rendering behavior
Live traffic monitoring vs prompt testing
| Prompt testing tools | Can AI See It | |
|---|---|---|
| What it measures | Does AI mention your brand in test prompts? | Does AI bot activity lead to real visits and conversions? |
| Data source | Simulated AI queries | Your live traffic data + analytics |
| Covers which bots | ChatGPT, Perplexity, Gemini (chat interfaces only) | 500+ bots including crawlers, assistants, and training bots |
| Business metric | Brand mention frequency | Crawl-to-Referral Ratio, revenue attribution |
| Tells you | "AI mentions you 34% of the time for keyword X" | "Devin crawled 8,200 pages and Devin AI sent 290 visitors who generated $4,100 in revenue" |
Measure your Crawl-to-Referral Ratio for Devin
See how much traffic Devin AI actually sends back to your site relative to how much content Devin takes.
- Connect Devin crawls in your logs with referral sessions in analytics
- Calculate your CRR — the metric prompt testing tools can't provide
- Make data-driven block/allow decisions for every AI bot
Measure business impact from Devin
The real question is: does Devin activity translate into referrals, sessions, and conversions on your site?
- Crawls: pages fetched by Devin
- Referral tracking: Devin takes — measure what Devin AI gives back. Track actual visits arriving from Devin AI's products to your site.
- CRR: your Crawl-to-Referral Ratio — referrals per 1,000 crawls
Based on your live traffic data and analytics — not synthetic prompt tests.
Official Documentation
View Official Devin Documentation →
Information sourced from official documentation. Content generated with AI assistance.