Head to head

Devin vs Gemini CLI

Comparing 10 documented Devin incidents against 4 for Gemini CLI.

Verdict

Devin has the lower average failure severity (3.9/10 vs 9.4/10), making it the statistically safer choice of the two — though both agents have documented critical incidents.

Reliability metrics for Devin and Gemini CLI
MetricDevinGemini CLI
Documented incidents104
Average severity3.99.4
Critical13
High01
Verified104

Severity at a glance

Devin
3.9low
Gemini CLI
9.4critical

Failure modes

Devin
Distribution of failure modes across all documented incidents.
Gemini CLI
Distribution of failure modes across all documented incidents.

The incidents behind these numbers