Compile a review-ready comparison of Baseball Australia c…Sports
How each model performed on this task. Every chart states its N, and the reward carries a 95% confidence interval once there is more than one run to measure.
Core metrics
Check Pass %
Mean share of the task's checks passing, averaged over runs. N = 1 run per model.
67%
Claude Opus 5
50%
Claude Opus 5.5
50%
GPT-6 sol
33%
GPT-5.6 sol
Extended metrics
Median Time
Wall-clock minutes, median across runs. N = 1 run per model.
38m
GPT-5.6 sol
31m
Claude Opus 5
Tool Calls
Tool invocations, median across runs — counted from the trajectories. N = 1 run per model.
117
Claude Opus 5
100
Claude Opus 5.5
57
GPT-6 sol
42
GPT-5.6 sol
Verifier × model pass rate
How often each verifier passed, per model. Green is passing, red is failing — a red band across a row is a verifier nothing clears.
| Verifier | Claude Opus 5.5n=1 | GPT-6 soln=1 | GPT-5.6 soln=1 | Claude Opus 5n=1 |
|---|---|---|---|---|
| checks (6) | ||||
| 100% | 100% | 100% | 100% | |
How to passNavigate to https://baseball.com.au/play-baseball/coach/ and https://coaching.baseballaustralia.com.au/page/5741/welcome-information. Locate the national coach accreditation scheme levels A, B and C. Record eligibility, duration of validity, required courses, any costs if shown, educational content covered, source URLs and confirmation status. | ||||
| 0% | 100% | 100% | 100% | |
How to passNavigate to https://www.baseballnsw.com.au/education/coaching/ and https://www.baseballnsw.com.au/. Search or browse for current coaching accreditation requirements and any listed camps or clinics scheduled to begin at least 30 days from task start. Record program names, dates relative to task start if available, educational focus, eligibility, source URLs and availability status. | ||||
| 0% | 0% | 0% | 100% | |
How to passNavigate to https://rbiaustralia.com.au/ and https://rbiaustralia.com.au/academy/. Work from the site's current camps, clinics and academy program listings rather than dated seasonal announcement posts, which may still advertise events that have already passed. Identify development camps or clinics that include coaching or educational elements and that can start at least 30 days from task start. Record duration, location, skill or educational focus, any listed costs, eligibility, source URLs and confirmation status. | ||||
| 100% | 0% | 0% | 100% | |
How to passNavigate to https://thegrindaustralia.com.au/ and any linked Baseball Australia state association pages for Queensland or New South Wales. Search for pitching or general development camps that incorporate educational content such as biomechanics or coaching principles. Record available options meeting the relative timing window, key educational components, source URLs and availability status. | ||||
| 100% | 100% | 0% | 0% | |
How to passFrom the recorded data shortlist at least one formal accreditation pathway and two practical camps or clinics, each lasting up to seven consecutive days and each able to start at least 30 days from task start. Keep them as separate comparable options for the reader's final decision rather than committing them to a single combined itinerary. Return to each source URL to reconfirm current details, requirements and status. Record the final set with cross-references to the original source URLs. | ||||
| 0% | 0% | 0% | 0% | |
How to passFor every selected option produce a structured entry containing the relative timing window label, program or course name, educational content summary, duration, eligibility requirements, any listed costs, location, full source URL, and confirmation that the data was verified on the live public page at research time. Include a summary comparison of the accreditation pathway against the practical camps. Assemble all entries into one coherent review-ready document format. | ||||
Failure modes on this task
12 tagged verifier failures, by the stage they were assigned to. Higher is worse.
| Failure stage | Claude Opus 5.5 | GPT-6 sol | GPT-5.6 sol | Claude Opus 5 |
|---|---|---|---|---|
| Delivering the result1 mode | 2 | 1 | 2 | 1 |
| Standing up the evidence1 mode | — | 2 | — | 1 |
| Reaching the page1 mode | 1 | — | — | — |
| No signal in the judge’s words1 mode · the grader | — | — | 2 | — |