Terminal-Bench 3.0

Scheduler Offer ReservationDistributed Systems & Databases

How each model performed on this task. Every chart states its N, and the reward carries a 95% confidence interval once there is more than one trial to measure.

Core metrics

Avg Cost

Mean API spend across trials; the line under a value is its observed range. N = 8 trials per model.

  1. $0.37$0.27–$0.51

    Opus-4.8

  2. $0.32$0.23–$0.49

    Gemini-3

  3. $0.22$0.17–$0.29

    GPT-5.4

Extended metrics

Median Time

Wall-clock minutes, median across trials. N = 8 trials per model.

  1. 2m

    Gemini-3

  2. 2m

    Opus-4.8

  3. 1m

    GPT-5.4

What the reward cost on this task

Reward vs Cost

Mean reward against mean spend per trial — top-left is more reward for less.

  • Opus-4.8
  • GPT-5.4
  • Gemini-3

$0.22Cost / trial$0.37