Compile a review-ready comparison of reputable philanthro…Community and Society
How each model performed on this task. Every chart states its N, and the reward carries a 95% confidence interval once there is more than one run to measure.
Core metrics
Check Pass %
Mean share of the task's checks passing, averaged over runs. N = 1 run per model.
100%
Claude Opus 5.5
100%
GPT-6 sol
100%
GPT-5.6 sol
20%
Claude Opus 5
Extended metrics
Median Time
Wall-clock minutes, median across runs. N = 1 run per model.
62m
Claude Opus 5
23m
GPT-5.6 sol
Tool Calls
Tool invocations, median across runs — counted from the trajectories. N = 1 run per model.
119
Claude Opus 5
50
GPT-6 sol
49
Claude Opus 5.5
46
GPT-5.6 sol
Verifier × model pass rate
How often each verifier passed, per model. Green is passing, red is failing — a red band across a row is a verifier nothing clears.
| Verifier | Claude Opus 5.5n=1 | GPT-6 soln=1 | GPT-5.6 soln=1 | Claude Opus 5n=1 |
|---|---|---|---|---|
| checks (5) | ||||
| 100% | 100% | 100% | 100% | |
How to passNavigate to https://mpce.gouv.ht/registre-des-ong_/. Locate the public list of registered non-governmental organizations. Record how the registry presents organization names domains of intervention and status information source URL and confirmation status. If the page can't be opened directly, use search-result snippets instead. | ||||
| 100% | 100% | 100% | 0% | |
How to passNavigate to https://hopeforhaiti.com/ and similar established organization sites focused on Haiti. Record program focus areas such as health education or community support any listed impact summaries source URLs and confirmation status. | ||||
| 100% | 100% | 100% | 0% | |
How to passNavigate to public pages of organizations such as those linked from GlobalGiving Haiti listings or known foundations active in the country including Partners In Health related or Fonkoze if available. Record primary philanthropic activities geographic emphasis source URLs and confirmation status. | ||||
| 100% | 100% | 100% | 0% | |
How to passReturn to the official registry and organization sites to reconfirm current focus areas and any public accountability notes. Select at least four organizations or channels that demonstrate clear community or development work in Haiti. Record the final set with cross-references to the original source URLs. | ||||
| 100% | 100% | 100% | 0% | |
How to passFor every selected organization produce a structured entry containing the relative engagement window label organization name primary focus areas any listed coverage or impact notes full source URL and confirmation that the data was verified on the live public page at research time. Include a summary grouping options by thematic area such as health education or broader community development. Assemble all entries into one coherent review-ready document format. | ||||
Failure modes on this task
4 tagged verifier failures, by the stage they were assigned to. Higher is worse.
| Failure stage | Claude Opus 5.5 | GPT-6 sol | GPT-5.6 sol | Claude Opus 5 |
|---|---|---|---|---|
| Delivering the result1 mode | — | — | — | 2 |
| Reaching the page1 mode | — | — | — | 1 |
| No signal in the judge’s words1 mode · the grader | — | — | — | 1 |