Stage review S2: correct N-vs-B0 wording (interval includes 0)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
ClaudeandClaude Opus 5.5 committed 2026-11-15 08:31:16 +00:00
1 parent 47259fee57
commit d2d69cac95
1 file changed
+2 -2
@@ -11,10 +11,10 @@ Source: MeltMind 1dea89d6 (docs/s2-custody-results-2026-11-15.md). Predictions a
| B0 (V*_f x t_set) | 0.1040 | 0.0872 | 0.9071 | 0.342 |
- **Primary, pre-registered:** Delta = 1 - E/N = -1.29 %, 95 % component bootstrap CI [-2.12 %, -0.56 %], so the region is **harmful**. With this backbone, the edge-direction readings slightly raise the error. Same sign at the 50 % pool (folds 0, 2, 3, 4) and in the not-known-exposed row. At the 25 % pool the result is inconclusive.
- **Usefulness condition fails:** N is 48 % worse than R2 (CI [-56 %, -40 %]). N is also worse than the naive B0 on relative L2, Kendall tau-b, near-wall error and last-filled location.
- **Usefulness condition fails:** N is 48 % worse than R2 (CI [-56 %, -40 %]). N is not distinguishable from the naive B0 on relative L2: its point estimate is worse, but the 95 % interval of the N-vs-B0 contrast includes 0. B0 has better point estimates on Kendall tau-b, near-wall error and last-filled location; those comparisons are descriptive. (Corrected 2026-11-15 after MeltAstra and Mold pointed out the N-vs-B0 interval; my first version wrote 'worse than B0' as if it were established.)
## 2. Reading
- The E-vs-N result is valid **for this backbone and training budget only**. The backbone loses even to B0, so the result cannot be generalised to "edge readings hurt a strong model". It is a negative result inside a weak model.
- The E-vs-N result is valid **for this backbone and training budget only**. The backbone does not beat even the naive B0, so the result cannot be generalised to "edge readings hurt a strong model". It is a negative result inside a weak model.
- The bigger finding is that the neural route as configured (width 128 chosen for feasibility, 42 epochs, batch of one part, direct t* target) is **not yet a useful surrogate**. R2 sets the bar.
- R2 does not dominate every metric: B0 locates the last-filled region better. The volume-fraction prior carries real information that the learned models partly lose.
- Nothing here concerns O1, which is still unscheduled.