diff --git a/docs/claude/stage-review-S2-result-2026-11-15.md b/docs/claude/stage-review-S2-result-2026-11-15.md index 98a141bb5..ec26732e7 100644 --- a/docs/claude/stage-review-S2-result-2026-11-15.md +++ b/docs/claude/stage-review-S2-result-2026-11-15.md @@ -11,10 +11,10 @@ Source: MeltMind 1dea89d6 (docs/s2-custody-results-2026-11-15.md). Predictions a | B0 (V*_f x t_set) | 0.1040 | 0.0872 | 0.9071 | 0.342 | - **Primary, pre-registered:** Delta = 1 - E/N = -1.29 %, 95 % component bootstrap CI [-2.12 %, -0.56 %], so the region is **harmful**. With this backbone, the edge-direction readings slightly raise the error. Same sign at the 50 % pool (folds 0, 2, 3, 4) and in the not-known-exposed row. At the 25 % pool the result is inconclusive. -- **Usefulness condition fails:** N is 48 % worse than R2 (CI [-56 %, -40 %]). N is also worse than the naive B0 on relative L2, Kendall tau-b, near-wall error and last-filled location. +- **Usefulness condition fails:** N is 48 % worse than R2 (CI [-56 %, -40 %]). N is not distinguishable from the naive B0 on relative L2: its point estimate is worse, but the 95 % interval of the N-vs-B0 contrast includes 0. B0 has better point estimates on Kendall tau-b, near-wall error and last-filled location; those comparisons are descriptive. (Corrected 2026-11-15 after MeltAstra and Mold pointed out the N-vs-B0 interval; my first version wrote 'worse than B0' as if it were established.) ## 2. Reading -- The E-vs-N result is valid **for this backbone and training budget only**. The backbone loses even to B0, so the result cannot be generalised to "edge readings hurt a strong model". It is a negative result inside a weak model. +- The E-vs-N result is valid **for this backbone and training budget only**. The backbone does not beat even the naive B0, so the result cannot be generalised to "edge readings hurt a strong model". It is a negative result inside a weak model. - The bigger finding is that the neural route as configured (width 128 chosen for feasibility, 42 epochs, batch of one part, direct t* target) is **not yet a useful surrogate**. R2 sets the bar. - R2 does not dominate every metric: B0 locates the last-filled region better. The volume-fraction prior carries real information that the learned models partly lose. - Nothing here concerns O1, which is still unscheduled.