Agent report
Devin failures
10 documented incidents, average severity 3.9/10. Most common failure mode: scope explosion.
n = 10
10
Incidents
3.9
Avg severity
1
Critical
10
Verified
Severity breakdown
Failure modes
Worst documented incident
10.0
critical
Devin replaced entire medical website with unrelated renal care site
All 10 incidents
10.0
5.8
5.0
3.4
3.4
3.3
2.2
2.1
2.0
1.4