I’m planning to pursue postgraduate studyScience and Education
How each model performed on this task. Every chart states its N, and the reward carries a 95% confidence interval once there is more than one run to measure.
Core metrics
Check Pass %
Mean share of the task's checks passing, averaged over runs. N = 1 run per model.
68%
Claude Opus 5
63%
Claude Opus 5.5
42%
GPT-5.6 sol
32%
GPT-6 sol
Extended metrics
Median Time
Wall-clock minutes, median across runs. N = 1 run per model.
20m
Claude Opus 5
19m
GPT-5.6 sol
Tool Calls
Tool invocations, median across runs — counted from the trajectories. N = 1 run per model.
101
Claude Opus 5
72
Claude Opus 5.5
44
GPT-6 sol
40
GPT-5.6 sol
Verifier × model pass rate
How often each verifier passed, per model. Green is passing, red is failing — a red band across a row is a verifier nothing clears.
| Verifier | Claude Opus 5.5n=1 | GPT-6 soln=1 | GPT-5.6 soln=1 | Claude Opus 5n=1 |
|---|---|---|---|---|
| checks (19) | ||||
| 100% | 100% | 100% | 100% | |
How to passBegin by mapping the major categories of funding available for international postgraduate students. Use authoritative sources including: https://www.gov.uk/postgraduate-scholarships-international-students https://www.gov.uk/funding-for-postgraduate-study https://www.ukcisa.org.uk/student-advice/finances/funding-your-studies/ https://www.britishcouncil.in/study-uk/scholarships https://study-uk.britishcouncil.org/scholarships-funding/great-scholarships Identify funding under at least these categories: UK government scholarships University scholarships University fee waivers Research studentships Research-council funding Subject-specific awards Country-specific scholarships Charitable/trust funding Industry-sponsored scholarships Bursaries and hardship funding Teaching/research assistant opportunities where funding is attached Student loans or other financial support where an international applicant may actually qualify Do not assume that something called a "grant," "scholarship," "studentship," or "bursary" provides the same type of funding. | ||||
| 100% | 0% | 0% | 100% | |
How to passBefore collecting individual scholarships, determine which broad UK funding mechanisms can realistically apply to an international applicant. Use: https://www.ukcisa.org.uk/student-advice/finances/funding-your-studies https://www.gov.uk/browse/education/student-finance https://www.gov.uk/funding-for-postgraduate-study Research: Home vs international fee status Nationality requirements Residency requirements Whether the funding is restricted to UK residents Whether international students can access UK government loans Whether funding applies to taught master's programs Whether funding applies to PhD/research degrees Whether funding is university-specific Whether funding requires an offer before applying Create an Eligibility Map: Funding Type International Student Eligible? India Eligible? Master's PhD Main Restriction Do not mark an opportunity as available to international students merely because the university offers funding generally. | ||||
| 100% | 100% | 100% | 100% | |
How to passInvestigate the major national programs individually. At minimum research: Chevening Use: https://www.gov.uk/government/organisations/chevening-foundation/about https://www.gov.uk/postgraduate-scholarships-international-students Verify: Eligible nationalities Degree type Work-experience requirement Leadership requirements English-language requirements if applicable Eligible universities/courses Funding coverage Application process Application cycle Current status Important restrictions Do not assume a recent graduate automatically qualifies. GOV.UK currently states that Chevening applicants must have at least two years of eligible work experience. Commonwealth Scholarships Research: https://cscuk.fcdo.gov.uk https://www.gov.uk/guidance/foreign-commonwealth-development-office-international-scholarship-programmes Verify: Eligible Commonwealth countries India eligibility Master's vs PhD pathways Subject/development priorities Academic requirements Funding coverage Nomination requirements Application route Deadlines/cycle Whether university admission is required GREAT Scholarships Research: https://study-uk.britishcouncil.org/scholarships-funding/great-scholarships https://study-uk.britishcouncil.org/scholarships-funding/great-scholarships/india https://www.britishcouncil.in/study-uk/scholarships/great-scholarships Study UK publishes the GREAT award amount and the list of participating UK universities for the academic cycle that is current when this task is run (as a reference point, the 2026–27 cycle offered £10,000 toward tuition for eligible one-year taught postgraduate courses). Record the cycle year and award amount as shown on the official page at the time of research rather than treating any figure as fixed. For India specifically, verify each participating university, eligible course, award amount, and application route rather than assuming all GREAT scholarships have identical conditions. | ||||
| 100% | 100% | 100% | 100% | |
How to passBecause the target applicant is from India, investigate funding specifically available to Indian students. Start with: https://www.britishcouncil.in/study-uk/scholarships https://www.britishcouncil.in/study-uk/scholarships/great-scholarships https://study-uk.britishcouncil.org/scholarships-funding/great-scholarships/india Investigate: GREAT Scholarships Commonwealth opportunities British Council scholarships Women in STEM opportunities where applicable Charles Wallace India Trust where relevant to eligible disciplines University scholarships specifically restricted to Indian applicants India-specific external foundations/trusts Scholarships jointly funded by UK universities and organizations Separate: India-specific from Global scholarships that accept Indian applicants. | ||||
| 100% | 0% | 0% | 0% | |
How to passBuild a university funding pool rather than researching only famous universities. Cover a diverse range of institutions across: England Scotland Wales Northern Ireland Search university websites for: International scholarships Postgraduate scholarships Master's funding Science scholarships STEM scholarships Engineering scholarships Computer science scholarships Education scholarships International student awards Indian student scholarships Tuition fee discounts Fully funded master's opportunities PhD studentships Use the universities' official funding pages as the authoritative source. For each university, record: University Scholarship Eligible Nationality Subject Degree Award Deadline Official URL Aim to investigate a meaningful cross-section of UK universities rather than collecting multiple awards from only 3–4 institutions. | ||||
| 0% | 0% | 0% | 100% | |
How to passCreate a separate research track for science/STEM. Investigate funding for fields such as: Computer Science Artificial Intelligence Data Science Information Technology Mathematics Physics Chemistry Biology Biotechnology Environmental Science Engineering Materials Science Life Sciences Search university departments as well as central scholarship offices. For each relevant opportunity, determine: Exact eligible subjects Whether the scholarship applies to taught master's or research degrees Whether the course must belong to a particular department Whether laboratory/research work is relevant Whether international students are eligible Whether the funding covers tuition only or also living costs Do not classify a general university scholarship as STEM-specific unless the official eligibility criteria support that classification. | ||||
| 100% | 0% | 0% | 0% | |
How to passCreate a second subject-specific research track for: Education Educational Technology Education Leadership Teaching Special Education Educational Psychology TESOL/Applied Linguistics where relevant Curriculum and Learning Education Policy Search university education faculties and official scholarship databases. Determine whether each scholarship: Requires teaching experience Requires an education-related undergraduate degree Is restricted to practicing teachers Is open to international students Applies to taught master's or research programs Covers full or partial costs Keep education funding separate from STEM funding in the final analysis. | ||||
| 100% | 100% | 100% | 100% | |
How to passResearch doctoral funding separately because studentships can operate differently from taught master's scholarships. Use: https://www.ukri.org/ University doctoral funding pages Individual university departments Research-group pages Official doctoral training partnership pages UKCISA notes that UK public postgraduate research funding can be administered through research councils, while GOV.UK identifies studentships as postgraduate positions with funding attached to fees, living expenses, or both. For each studentship, record: University Department Research area Project title Supervisor, if listed Degree International eligibility Tuition coverage Stipend Additional funding Duration Application deadline Academic requirements Research proposal requirements Official application page Do not mix PhD studentships into the master's scholarship ranking. | ||||
| 100% | 100% | 0% | 100% | |
How to passSearch specifically for awards that reduce tuition rather than providing cash. Look for: International tuition discounts Automatic fee reductions Merit scholarships Country-specific tuition awards Early-payment discounts Alumni discounts Partner-institution discounts Departmental fee waivers For each one, determine: Amount or percentage Whether it is automatic Whether a separate application is required Whether it can be combined with other scholarships Whether it applies to international fees Whether it applies to the entire course or only the first year Clearly distinguish a £5,000 fee reduction from £5,000 cash living support. | ||||
| 100% | 100% | 100% | 100% | |
How to passResearch funding outside universities. Use reputable sources and official organizations. Investigate: Charitable foundations Educational trusts Scientific societies Engineering organizations Technology organizations Professional bodies Research foundations Industry-funded education programs GOV.UK notes that charities and trusts can provide student grants and that learned societies can offer postgraduate/postdoctoral research funding. For every external organization: Open its official website. Find the current funding page. Verify eligible nationality. Verify eligible study level. Verify subject. Check whether the award is actually available for study in the UK. Check application requirements. Record the official application route. Avoid scholarship-aggregator sites as the final authority. | ||||
| 0% | 0% | 0% | 0% | |
How to passFor every promising scholarship, determine whether it can be combined with: University scholarships GREAT Scholarships Departmental awards Fee waivers External grants Studentships Other university funding Search the official terms for phrases such as: "cannot be combined" "not eligible if receiving another award" "in conjunction with" "other funding" "double funding" "full funding" "partial funding" Create a Funding Compatibility Matrix: Scholarship A Scholarship B Can Combine? Evidence Conditions Do not assume two scholarships can be stacked simply because both are independently available. | ||||
| 100% | 0% | 0% | 0% | |
How to passFor every serious scholarship candidate, investigate the corresponding academic program. Verify: University Degree Course title Entry requirements Required undergraduate background English-language requirements International fee level Course duration Application deadline Scholarship deadline Whether admission and scholarship applications are separate This is important because UKCISA notes that many scholarships require an offer from a UK institution before the scholarship application can proceed. Record whether the scholarship requires: Application first → admission → scholarship or: Admission application + scholarship application simultaneously or another sequence. | ||||
| 0% | 0% | 100% | 100% | |
How to passDo not simply rank scholarships by headline award amount. For each serious option, determine: Tuition Full tuition Partial tuition Fixed contribution Percentage reduction Living support Annual stipend Monthly stipend Accommodation support No living support Additional support Travel Visa-related costs Insurance Research expenses Books/equipment Relocation support Then estimate: Total stated funding versus Estimated remaining cost Do not fabricate living-cost figures. Where an estimate is necessary, obtain current figures from official university accommodation/cost-of-living pages or other authoritative sources and clearly label the result as an estimate. | ||||
| 0% | 0% | 0% | 0% | |
How to passFor each top scholarship, document the application package. Look for: Academic transcripts Degree certificate CV Personal statement Scholarship essay Study plan Research proposal References Admission offer English-language evidence Passport/nationality evidence Leadership evidence Work-experience evidence Financial documents where required Create an Application Requirements Tracker. Scholarship CV Transcript References Essay Offer Required Research Proposal Other Do not infer requirements from another scholarship's application process. | ||||
| 100% | 0% | 100% | 100% | |
How to passFor every shortlisted opportunity, check the current official deadline. Because scholarship deadlines change annually: Do not copy deadlines from old articles. Prefer official university/government pages. Record whether the opportunity is: Open Upcoming Closed for the current cycle Not yet announced If the next cycle has not been announced, record the most recent cycle only as a reference and clearly label it. Create a deadline tracker: Scholarship Current Cycle Status Deadline Next Action Do not claim that an upcoming deadline exists unless an official source confirms it. | ||||
| 100% | 0% | 0% | 100% | |
How to passRank the opportunities based on practical usefulness. Consider: Eligibility certainty Funding amount Tuition coverage Living-cost coverage Relevance to science/education International-student eligibility Indian-national eligibility Academic compatibility Application complexity Deadline feasibility Competition/selectivity where reliable information exists Whether an admission offer is required Whether the funding can be combined with other awards Create three groups: Priority A — Highest-Value Targets Strong eligibility and substantial funding. Priority B — Good Funding Opportunities Useful awards with reasonable eligibility but lower funding or greater restrictions. Priority C — Additional/Backup Funding Partial awards, fee reductions, or opportunities with significant eligibility limitations. Do not rank an award highly merely because its headline value is large if the applicant is unlikely to qualify. | ||||
| 0% | 0% | 0% | 0% | |
How to passAfter calculating the strongest funding opportunities, identify what remains unfunded. For each shortlisted university/program combination, estimate: Tuition after scholarship Remaining tuition Expected living-cost requirement Remaining living expenses Other known costs Then identify whether the remaining gap could potentially be addressed through: Another scholarship University bursary Studentship External grant Personal funding Other legitimate support Do not recommend borrowing or financial products as though they are guaranteed solutions. | ||||
| 0% | 0% | 100% | 100% | |
How to passReturn to every Priority A opportunity. Verify directly from the official source: Scholarship name University/organization Eligible nationality Eligible degree Eligible subject Award amount Tuition coverage Living-cost coverage Deadline Application method Admission requirement Important restrictions Official application URL If information from a scholarship aggregator conflicts with the official page, use the official page and note the discrepancy. | ||||
| 0% | 0% | 0% | 100% | |
How to passProduce a comprehensive funding report containing: 1. Funding Landscape Explain the major types of funding available to international students seeking UK study. 2. Best National Scholarships Include detailed profiles of relevant: Chevening Commonwealth GREAT Other verified national programs Clearly distinguish which are realistically available to Indian applicants. 3. Science/STEM Scholarship Shortlist Provide the strongest verified opportunities for: Computer Science AI/Data Science Engineering Mathematics Natural Sciences Other relevant STEM areas 4. Education Scholarship Shortlist Provide the strongest verified opportunities for education-related postgraduate study. 5. University Scholarship Table Include a substantial list of verified university-funded opportunities. Use: University Scholarship Degree Subject Indian Eligibility Award Tuition Coverage Living Support Deadline Offer Required Official URL 6. Fully Funded Opportunities Separate scholarships/studentships that potentially cover: Tuition + living costs from those covering only one component. 7. Partial Funding Identify: Fee waivers Tuition discounts Partial scholarships Bursaries Smaller external grants 8. Funding Compatibility Show which awards can potentially be combined and which cannot. 9. Application Calendar Create a chronological tracker of: Scholarships to apply for first Admission applications required beforehand Scholarship deadlines Documents to prepare Follow-up actions 10. Top 10 Funding Targets Select the strongest ten opportunities based on actual eligibility, funding value, subject relevance, and application feasibility. For each: Scholarship → Why it fits → Funding → Eligibility → Main obstacle → Next action → Official application page 11. Funding-Gap Analysis For representative programs, explain how much of the total study cost the identified funding could potentially cover and what expenses may remain. 12. Source Verification Use official government, university, British Council, research-council, and scholarship-organization sources wherever possible. Third-party scholarship websites may be used for discovery, but important eligibility, funding, and deadline claims must be verified against the official source. Do not fabricate scholarships, deadlines, award amounts, eligibility rules, participating universities, or application links. If a current cycle has not yet been announced, explicitly say so. Treat funding amounts and deadlines as time-sensitive information. | ||||
Failure modes on this task
37 tagged verifier failures, by the stage they were assigned to. Higher is worse.
| Failure stage | Claude Opus 5.5 | GPT-6 sol | GPT-5.6 sol | Claude Opus 5 |
|---|---|---|---|---|
| Delivering the result1 mode | 1 | 10 | 6 | 2 |
| Standing up the evidence1 mode | 6 | — | — | 3 |
| No signal in the judge’s words1 mode · the grader | — | 3 | 5 | 1 |