I want to start a simple daily meditationHealth
How each model performed on this task. Every chart states its N, and the reward carries a 95% confidence interval once there is more than one run to measure.
Core metrics
Check Pass %
Mean share of the task's checks passing, averaged over runs. N = 1 run per model.
100%
Claude Opus 5.5
100%
Claude Opus 5
67%
GPT-5.6 sol
50%
GPT-6 sol
Extended metrics
Median Time
Wall-clock minutes, median across runs. N = 1 run per model.
27m
Claude Opus 5
12m
GPT-5.6 sol
Tool Calls
Tool invocations, median across runs — counted from the trajectories. N = 1 run per model.
88
Claude Opus 5
32
Claude Opus 5.5
27
GPT-5.6 sol
22
GPT-6 sol
Verifier × model pass rate
How often each verifier passed, per model. Green is passing, red is failing — a red band across a row is a verifier nothing clears.
| Verifier | Claude Opus 5.5n=1 | GPT-6 soln=1 | GPT-5.6 soln=1 | Claude Opus 5n=1 |
|---|---|---|---|---|
| checks (6) | ||||
| 100% | 100% | 100% | 100% | |
How to passNavigate to https://www.nccih.nih.gov/health/meditation-in-depth and record the definition of meditation it gives, three techniques or forms it names, and the health topics it says research has studied. | ||||
| 100% | 0% | 0% | 100% | |
How to passNavigate to https://health.clevelandclinic.org/box-breathing-benefits and record the box breathing technique it describes, the time or posture guidance it shows such as four counts or daily practice, and two benefits or expectation notes it lists. | ||||
| 100% | 100% | 100% | 100% | |
How to passNavigate to https://en.wikipedia.org/wiki/Meditation and record the page's definition of meditation, the types it names, and two practices or posture tips it lists. | ||||
| 100% | 100% | 100% | 100% | |
How to passNavigate to https://www.amazon.com/ and find one meditation cushion, zafu, or simple meditation timer under $40. Open its product-detail page and record the product title and current price visibly shown there. | ||||
| 100% | 0% | 100% | 100% | |
How to passCompare the NCCIH techniques, the Cleveland Clinic time and posture guidance, and the Wikipedia types for a beginner who gets frustrated and quits early. Choose one habit that is reasonably supported by the cited guidance to help reduce early frustration, such as short daily consistency or focusing on the breath, and record a one-sentence reason citing one of the sources. | ||||
| 100% | 0% | 0% | 100% | |
How to passProduce a written first-month meditation starter plan with the NCCIH techniques and health topics, the Cleveland Clinic breathing and time guidance, the Wikipedia types, the selected cushion or timer with price, a four-week practice sequence, the total against $40, and the key habit verdict. | ||||
Failure modes on this task
5 tagged verifier failures, by the stage they were assigned to. Higher is worse.
| Failure stage | Claude Opus 5.5 | GPT-6 sol | GPT-5.6 sol | Claude Opus 5 |
|---|---|---|---|---|
| Standing up the evidence1 mode | — | 1 | 1 | — |
| Delivering the result1 mode | — | 1 | 1 | — |
| No signal in the judge’s words1 mode · the grader | — | 1 | — | — |