Launches
C

cto bench

The ground truth code agent benchmark

125 votes·10 comments·Dec 20, 2025

About

Most AI benchmarks are built backwards. Someone sits down, dreams up hard problems, and then measures how well agents solve them. The results are interesting, sure. But they don't always tell you what matters: how agents perform on the actual work that's sitting in your queue. That's why we built cto.bench. Instead of hypothetical tasks, we're building our benchmark from real work. Every data point on cto bench comes directly from how cto.new users are actually using our platform.