The state of the work

Chapter 6 promised future work. This is that work, being built.

If you have not read Start from zero yet, read that first — it explains the problem this is all about. This page is the status of the software: what exists, what it fixed, and what comes next.

DocumentFinal · submitted
Phases done8 of 9
Tests433 passing
API keys used3 · phase 4

Where to go

The result, as a reminder

Explained in full on the entry page; repeated here as a picture, because every number below refers back to it.

BASELINE — 20 TASKS Resolved · 12 Logic · 4 Format · 4 RECOVERED AFTER THE RETROFIT Reasoning failures 0 / 4 Mechanical failures 3 / 3 Changing how the edit was written moved outcomes. Changing what the model was told did not.
The fourth format-class task, astropy__astropy-14182, was excluded: the model refused to generate for it at all, so there was never a patch to evaluate. That leaves three evaluable, and all three recovered.

So why build anything?

Because the original study had three problems that no amount of writing could fix.

ProblemWhat the build does
A failed attempt left no record at all — it printed “Not applied” and wrote nothing, so 8 of 24 cells simply vanishedEvery cell is enumerated before anything runs, and must end in a recorded outcome — one of eight, never silence
Conditions lived in 30 separate scripts with no entry point, so nobody could state what had been runOne config file, one command, a checksum over the config that changes if any setting does
The headline numbers were typed by hand into tables and figures, so nothing checked themThey regenerate from the raw logs, and the regenerated table is compared byte-for-byte with yours

The whole thing runs with no API key, no network and no Docker.

That was a deliberate constraint, not a limitation we worked around. It means anyone can verify the results on any laptop — which is the difference between a claim and a result.

The nine phases

Each phase depends on the one before it, so the order is real rather than administrative. A page is written when a phase finishes, so nothing here describes work that does not exist yet.

PhaseWhat it builtState
0 · ProvenanceRescue the original data, freeze the 300-task benchmarkdone
1 · FoundationsThe shared vocabulary, the config schema, the pre-flight checkdone
2 · Edit layerThe part your finding actually lives in — 138 testsdone
3 · ReplayChapter 5 regenerated from raw logs, offlinedone
4 · ProvidersThe first live model call, with a token budget that refuses to overspenddone
5 · StrategiesYour three recovery conditions, prompts byte-verified against the originalsdone
6 · Sweep1,308 cells, cost-checked before spending, with no missing cellsdone
7 · DashboardSix views over the results; states the finding in a sentence derived from the datadone
7 · DashboardThe visual layernext
8 · ExtensionsThe L3 and L4 rungs your section 8 proposesplanned

Nothing here changes your document

Self.docx is final and is not edited again. Where the build found something the document states differently, it is recorded as a numbered decision in the repository — never applied silently to the text. There are sixteen of those decisions so far; the four that matter to you are on the findings page.

Built on top of your own logs and predictions, preserved at Lagadnakul/Dissertation@c8872d0. Every figure on these pages is computed from that data, not copied from the document.