Contribute
Report an incident
Submissions are reviewed against public evidence before publication. Reports without a verifiable source are not published.
The evidence bar
Every published incident links to a source someone else can check — a pull request, issue, post, or article. First-hand reports are welcome, but must include enough detail to be independently assessed. This standard is the only reason the database is worth citing.
Required fields
- agent
- Which agent, and version if known.
- date
- When the failure occurred (YYYY-MM-DD).
- instruction_given
- The prompt or task, as issued.
- expected_behavior
- What should reasonably have happened.
- actual_behavior
- What the agent actually did.
- damage_description
- Concrete consequences — files, time, cost.
- source_url
- Public evidence: PR, issue, post, or article.
Severity
You do not need to score the incident yourself — reviewers assign severity against the published rubric. If you do propose a score, pick a level for each factor below and paste the line into your report.
Proposed severity: 2/10 (low)
severity_factors: { scope: 0, recoverability: 0, realisation: 2, impact: 0 } # proposed severity 2/10No GitHub account? Email hello@stupidllm.com with the same details.