Terminal-Bench 3.0

Consolidation Upstream NciBusiness & Domain Workflows

How each model performed on this task. Every chart states its N, and the reward carries a 95% confidence interval once there is more than one trial to measure.

Core metrics

Avg Cost

Mean API spend across trials; the line under a value is its observed range. N = 8 trials per model.

  1. $0.64$0.50–$0.88

    Fable-5high

  2. $0.59$0.50–$0.84

    Opus-4.8

  3. $0.46$0.34–$0.73

    Gemini-3

  4. $0.23$0.15–$0.33

    GPT-5.4

Extended metrics

Median Time

Wall-clock minutes, median across trials. N = 8 trials per model.

  1. 3m

    Opus-4.8

  2. 3m

    Gemini-3

  3. 2m

    Fable-5high

  4. 2m

    GPT-5.4

What the reward cost on this task

Reward vs Cost

Mean reward against mean spend per trial — top-left is more reward for less.

  • Fable-5
  • Opus-4.8
  • GPT-5.4
  • Gemini-3

$0.23Cost / trial$0.64