day 1 benchmarks had that for opus and i think also astra but updated numbers have smoothed that out. i can't say for sure what all changed between early runs and now but it seems like max is now the most powerful mode for both models.
that said, with a clock on this benchmark it's very possible that lower reasoning = more iteration = better code.
day 1 benchmarks had that for opus and i think also astra but updated numbers have smoothed that out. i can't say for sure what all changed between early runs and now but it seems like max is now the most powerful mode for both models.
that said, with a clock on this benchmark it's very possible that lower reasoning = more iteration = better code.