I've taken on a garden in the upperHome and Garden
How each model performed on this task. Every chart states its N, and the reward carries a 95% confidence interval once there is more than one run to measure.
Core metrics
Check Pass %
Mean share of the task's checks passing, averaged over runs. N = 1 run per model.
92%
Claude Opus 5.5
92%
Claude Opus 5
75%
GPT-5.6 sol
67%
GPT-6 sol
Extended metrics
Median Time
Wall-clock minutes, median across runs. N = 1 run per model.
19m
Claude Opus 5
7m
GPT-5.6 sol
Tool Calls
Tool invocations, median across runs — counted from the trajectories. N = 1 run per model.
66
Claude Opus 5
63
Claude Opus 5.5
24
GPT-6 sol
24
GPT-5.6 sol
Verifier × model pass rate
How often each verifier passed, per model. Green is passing, red is failing — a red band across a row is a verifier nothing clears.
| Verifier | Claude Opus 5.5n=1 | GPT-6 soln=1 | GPT-5.6 soln=1 | Claude Opus 5n=1 |
|---|---|---|---|---|
| checks (12) | ||||
| 100% | 100% | 100% | 100% | |
How to passOpen https://extension.umn.edu/planting-and-growing-guides/upper-midwest-home-garden-care-calendar and record what the page says the schedule covers, what it explicitly says it does not cover, and the year it states it was last reviewed. That last detail matters, so record it word for word rather than paraphrasing. | ||||
| 100% | 100% | 100% | 100% | |
How to passFrom the same page, record every task listed under the earliest section with its stated timing, including the trigger that is described as a ground condition rather than a calendar date. Keep the crop examples given in brackets attached to their task. | ||||
| 100% | 100% | 100% | 100% | |
How to passRecord each task in that section with its timing, paying attention to the ones that name specific crops. Note which crops are described as moderately cold tolerant and which are described as heat loving, and record the different windows given for each group. | ||||
| 100% | 100% | 100% | 100% | |
How to passSeveral entries give one range described as the best time plus a second acceptable range. Find every task on the page worded this way, and record both ranges with the qualifier attached. Do not reduce these to a single window; the distinction between them is exactly what I want. | ||||
| 100% | 100% | 100% | 100% | |
How to passRecord all remaining tasks with their timings, including the two separate fall sowing dates given for different crop groups, the tasks concerning bulbs, and the end of season cleanup entries. Note where a task appears in more than one season with different timing. | ||||
| 0% | 0% | 0% | 0% | |
How to passSort every task you have collected into planting or sowing actions versus maintenance actions such as watering, weeding, mulching, deadheading and fertilising. State the total count in each group. This is the split that decides what I actually have to buy versus what I just have to do. | ||||
| 100% | 100% | 0% | 100% | |
How to passOpen https://planthardiness.ars.usda.gov/ and record what the map is based on, the temperature interval its zones and half zones represent, and how the site says to look up a location. Record what the page says about the map's previous edition and where state or regional maps can be obtained. | ||||
| 100% | 100% | 100% | 100% | |
How to passThe zone lookup is inside an interactive mapping frame rather than published as text on the page. Attempt the lookup as the page describes, then state plainly what you were and were not able to retrieve. If you cannot extract a zone value, say so and explain what the map is for, rather than supplying a zone number from memory or from another site. | ||||
| 100% | 100% | 100% | 100% | |
How to passOpen https://extension.umn.edu/planting-and-growing-guides/planting-vegetable-garden. Its crop guidance sits inside collapsible sections, so open those before reading. Record what it says about when to transplant heat loving crops, and compare that against the window the calendar gave. State whether the two agree, then record the different basis this page uses for timing, including the soil temperature range it names and the frost reference, and record the review year each of the two pages states. | ||||
| 100% | 0% | 0% | 100% | |
How to passProduce one row per month from January to December, with columns for planting tasks, maintenance tasks, and anything that must be started indoors or purchased in advance of a later window. Where a task spans months, repeat it in each month it covers and mark which month is the preferred one. | ||||
| 100% | 0% | 100% | 100% | |
How to passWorking backwards from your table, list what must be acquired or started before each planting window opens, with the latest sensible date for each, derived from the windows themselves. Name the single earliest action in the year and what happens to the rest of the schedule if it is missed. | ||||
| 100% | 0% | 100% | 100% | |
How to passUsing what the hardiness material told you about how zones are defined, explain which categories of task in your table are tied to frost and temperature and would therefore shift in a colder zone, and which are not. Be explicit that you are reasoning from the zone definition rather than from a second regional calendar, since these sources cover the upper Midwest only. | ||||
Failure modes on this task
9 tagged verifier failures, by the stage they were assigned to. Higher is worse.
| Failure stage | Claude Opus 5.5 | GPT-6 sol | GPT-5.6 sol | Claude Opus 5 |
|---|---|---|---|---|
| Delivering the result1 mode | — | 2 | 2 | 1 |
| Standing up the evidence1 mode | 1 | 1 | — | — |
| No signal in the judge’s words1 mode · the grader | — | 1 | 1 | — |