research-tree: gate calibration v2 failed; holdout blocked
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
f601f8fe46
commit
64d6c1b30d
1 file changed
+1
@@ -34,6 +34,7 @@ Rules:
|
||||
| P3 | O1 with size-matched K = 8 partitions | — | — | PRUNED (eligibility 23 %; lesson: control cut area as a covariate, do not match it) |
|
||||
|
||||
Log (newest first):
|
||||
- 2026-11-17: **Gate calibration v2 FAIL_OUTCOME_EQUIVALENCE** (pre-registered, review PASS before scoring). Label-derived minus LOG gates, 545 paired parts / 202 components: field A +.00083, CI [+.00039, +.00134]; E1b +.00077, CI [+.00035, +.00125] (both exceed ±.001); last/Rg CIs exceed ±.010. Cost 94,261 / 104,639. **Consequence:** the v2 fresh holdout is BLOCKED_INPUT for gate-dependent methods; the shift is of the same size as the effects we test (E1b gain .0011). The A and E1b shifts are similar, so a paired method difference *might* cancel, but that is an observation from this result, not a pre-registered test, and will not be used. Route forward: real gate metadata for v2 (question to Yanqi), or a different fresh source. Phase-3 item c's fresh-family stage is blocked accordingly.
|
||||
- 2026-11-17: **H2-S1 (fold 0 test, 121 parts / 37 components, one seed).** Pre-score review PASS (MeltAssist 07514084). Field H2 .06747 vs A .07292: Δ -.00546, CI [-.01035, -.00098], about 7.5 % relative on fold 0 only (not comparable with E1b's five-fold 1.6 %: different statistical domain; no ranking or attribution to representation/data). Last fill +.110, CI [-.134, +.393] (no support); τ CI crosses 0. 7,786 full-node / 145 query predictions negative (kept, not clipped). S2 gate passed. **Pre-registered before S2 results:** H2 is CONFIRMED if the pooled five-fold (552 / 204 test) field upper bound vs A < 0; vs B13-E1b reported, not gating. Single fold / seed: no causal or cross-split claim yet. Data-sufficiency test (Mold e24fff7c) follows S2 under its own cap.
|
||||
- 2026-11-17: **B17 PRUNED (stage 1).** 552 / 204, pre-score review PASS (MeltAssist 235cfc9f, after one score-assembly fix). Last fill Δ (new - E1b) -.0033, CI [-.0389, +.0298]; it needed mean ≤ -.010 and upper < 0. Stage 2 not run. Cost 4,745 / 10,800. **Learned:** the B14 / B16 last-fill near-misses do not survive a dedicated, tail-weighted recipe. Last fill stays unsolved by the tabular feature route; it is not closed for learned representations (H2) or for other targets. Gate calibration v2 (outcome-level, 72k CPU-s) running; the fresh holdout remains useful for an independent deployment check of E1b.
|
||||
- 2026-11-17: **B17 opened** (MoldAstra spec b5bd8a4e, accepted as written). Stage 1 = screening only on the already-used 552 parts; stage 2 = one unsealing of the fresh holdout. B14 / B16 near-misses are one hint, not two. Fresh holdout: 94 candidates sealed (a2dac8d1 / manifest a5a133a2; 72 source groups, 42 / 40 new tokens); gate extractor must first reproduce the LOG gates on the 552. The 10 GB evidence is copied to /home and hash-verified (not a remote backup).
|
||||
|
||||
Reference in new issue
Block a user