I am looking to attend an NBA gameEcommerce & Shopping
How each model performed on this task. Every chart states its N, and the reward carries a 95% confidence interval once there is more than one run to measure.
Core metrics
Check Pass %
Mean share of the task's checks passing, averaged over runs. N = 1 run per model.
100%
Claude Opus 5.5
100%
GPT-6 sol
100%
GPT-5.6 sol
40%
Claude Opus 5
Extended metrics
Median Time
Wall-clock minutes, median across runs. N = 1 run per model.
28m
Claude Opus 5
17m
GPT-5.6 sol
Tool Calls
Tool invocations, median across runs — counted from the trajectories. N = 1 run per model.
118
Claude Opus 5
48
GPT-6 sol
39
Claude Opus 5.5
35
GPT-5.6 sol
Verifier × model pass rate
How often each verifier passed, per model. Green is passing, red is failing — a red band across a row is a verifier nothing clears.
| Verifier | Claude Opus 5.5n=1 | GPT-6 soln=1 | GPT-5.6 soln=1 | Claude Opus 5n=1 |
|---|---|---|---|---|
| checks (5) | ||||
| 100% | 100% | 100% | 100% | |
How to passCheck the official NBA schedule for the 2026–27 NBA season and identify all scheduled Minnesota Timberwolves games played on the East Coast, prioritizing games in Orlando and Miami. If games in those cities are available, use them first; otherwise include other suitable East Coast destinations. For every qualifying game, record the opponent, venue/city, game date, and scheduled start time. Use the official NBA schedule as the authoritative source for the game information and do not substitute games from third-party schedules. | ||||
| 100% | 100% | 100% | 0% | |
How to passCreate a list of all qualifying Timberwolves East Coast games identified in Step 1 and arrange them in chronological order, with the earliest game appearing first. Keep the matchup, city/venue, date, and scheduled start time for each game so the user can compare the available travel options. If multiple games occur in the same city, retain each qualifying game separately rather than combining them. | ||||
| 100% | 100% | 100% | 0% | |
How to passFor each qualifying Timberwolves game, check the official NBA ticket marketplace or the official ticketing page linked through NBATickets.com to determine whether tickets are currently available for purchase. Record whether the game is currently on sale, unavailable, or only offering another ticket option such as resale. Where an official purchase page is available, record the corresponding booking link. Do not claim that tickets are available unless the live official ticket page confirms it. NBATickets.com is the NBA's official ticket marketplace hub and can link users to the individual team's official primary ticketing provider. | ||||
| 100% | 100% | 100% | 100% | |
How to passOpen the official NBA Store and find a Minnesota Timberwolves fan jersey that is currently available for purchase. Record the product name and official NBA Store product page, and leave that product page open for review. Do not purchase the jersey or proceed through checkout. | ||||
| 100% | 100% | 100% | 0% | |
How to passCreate a document containing the qualifying Minnesota Timberwolves East Coast games in chronological order, with the matchup, venue/city, date, scheduled start time, ticket-availability status, and official ticket link where available. Highlight Orlando and Miami games where they exist because they are the user's preferred destinations. Include the official NBA schedule as the primary source and clearly distinguish confirmed ticket availability from unavailable or resale-only listings. | ||||
Failure modes on this task
3 tagged verifier failures, by the stage they were assigned to. Higher is worse.
| Failure stage | Claude Opus 5.5 | GPT-6 sol | GPT-5.6 sol | Claude Opus 5 |
|---|---|---|---|---|
| Standing up the evidence1 mode | — | — | — | 1 |
| Delivering the result1 mode | — | — | — | 1 |
| No signal in the judge’s words1 mode · the grader | — | — | — | 1 |