Skip to content

People Papers Models Technologies Organizations Events Datasets Benchmarks

Atlas/Benchmarks

SWE-bench Verified

August 2024

500 SWE-bench tasks checked by people so the tests are fair. The number labs quote for coding agents.

Connections

Built on 1

SWE-bench2023

Preceded by 1

SWE-bench2023

Facts

Date: August 2024
Era: Generative AI and agents

Sources: AI4U editorial.

AI4U Atlas. Built from Wikidata, arXiv, OpenAlex, the Epoch AI notable models dataset (CC BY), the Hugging Face Hub and OpenRouter, plus our own writing.

Timeline · Chat · aheadintofun