research report

METR publishes experienced-developer productivity experiment

A randomized study of sixteen experienced developers reports slower completion with early-2025 AI tools on their own repositories.

Original sources

Open artifact View JSON