Skip to content

Commit

Permalink
copy
Browse files Browse the repository at this point in the history
  • Loading branch information
paul-gauthier committed May 30, 2024
1 parent 6966936 commit ec26d5f
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions _posts/2024-05-22-swe-bench-lite.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ highlight_image: /assets/swe_bench_lite.jpg
on the
[SWE Bench Lite benchmark](https://www.swebench.com),
achieving a state-of-the-art result.
The current top leaderboard entry is 20.3%
The previous top leaderboard entry was 20.3%
from Amazon Q Developer Agent.

[![SWE Bench Lite results](/assets/swe_bench_lite.svg)](https://aider.chat/assets/swe_bench_lite.svg)
Expand Down Expand Up @@ -406,7 +406,7 @@ Below are the references for the SWE-Bench Lite results
displayed in the graph at the beginning of this article.

- [20.3% Amazon Q Developer Agent (v20240430-dev)](https://www.swebench.com)
- [19.0% AutoCodeRover](https://github.com/swe-bench/experiments/pull/11)
- [19.0% AutoCodeRover](https://www.swebench.com/)
- [18.0% SWE-Agent + GPT-4](https://www.swebench.com)
- [16.7% OpenDevin](https://github.com/OpenDevin/OpenDevin/issues/2149)
- [11.7% SWE-Agent + Opus](https://www.swebench.com)
Expand Down

0 comments on commit ec26d5f

Please sign in to comment.