> ... runs each model in its lab's 1st party CLI harness at the highest reasoning setting it offers.

  Anthropic (Claude models): Claude Code
  OpenAI (GPT models): Codex
  Google (Gemini models): Antigravity CLI
  Meta (Muse models): Muse Code

> The CLIs' web search and web fetch tools are turned off, and the agent has no other internet access. The CLI is installed before the clock starts, and the hour counts from when the agent starts. There is no submit tool: the harness collects the bot when the time runs out.

One thing we're learning is that harness is HUGE. The difference in performance for the same underlying model can change dramatically across:

1. harnesses

2. allowed tools (no web search/fetch - how does the model refer to documentation?)

3. thinking levels