Coverage of "Ai benchmarks" on cryptobo.eu: the stories and the context behind them.
Cognition’s CEO Scott Wu says AI benchmarks lose relevance as models like Devin achieve near-perfect scores, prompting a shift toward real-world performance evaluation. Devin now writes nearly 90% of its team’s code, illustrating how traditional tests no longer capture AI progress.
