research-tree: 1b screen fail, closed
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
f785e30244
commit
fd530184bb
1 file changed
+1
@@ -34,6 +34,7 @@ Rules:
|
||||
| P3 | O1 with size-matched K = 8 partitions | — | — | PRUNED (eligibility 23 %; lesson: control cut area as a covariate, do not match it) |
|
||||
|
||||
Log (newest first):
|
||||
- 2026-11-19: **1b (100-epoch full schedule) SCREEN_FAIL; CLOSED.** Fold 0 validation, 111 parts / 35 components, component-weighted relative L2: 200-epoch seed 0 6.085 %; 100-epoch seed 0 5.936 % (−.149 pp, first gate passed); 200-epoch seed 1 5.877 % (−.208 pp vs seed 0). The schedule effect is smaller than the seed difference, so the second gate fails. One labelled recovery (GPU0 foreign occupant); final run guard STOP at exit, cause undetermined; outputs audited complete (MeltAssist e5cfba65; adoption criterion amended before values were seen, timing item dropped as attribution-only). 5,840.58 GPU-s + 741.16 stopped. **Reading:** no evidence that the shorter schedule helps beyond seed variation; item 1's overfitting signal is neither confirmed nor refuted. No further folds. Note: the phase-3 guard's exit race (snapshot vs process-list) remains a known limitation of this guard version; the GINO guard has the fix.
|
||||
- 2026-11-19: **Shared-miss attribute study CLOSED** (descriptive; MoldAstra prereg d62b919e; deliveries 44c1d5a1 + 40f9e4ce; MeltAssist PASS 77639066-series: 7029a6e6 and combined 2930943d; 0 GPU-h, 109 CPU-s; true test-role fields read once under a bounded CPU-only scope, hypothesis-generating only). 34 shared-miss parts / 28 families vs 518 / 193 controls. **Only clear difference: A also misses** 17/34 vs 32/518 (family-weighted 41.1 % vs 6.7 %, +34.3 pp, family-block CI [17.0, 53.1]). Main tail fragments (1.29 vs 1.28), near-tie share (22.1 % vs 21.3 %) and weighted gate distance (2.72 vs 3.06 Rg) show no difference (CIs cross 0); single gate everywhere; wall thickness, physical branches and semantic type remain NA. **Reading:** the shared misses are largely parts that are hard for both model families; the true-tail geometry measures tried here do not explain them. Candidate explanations left (untested): missing inputs (thickness, process), label quality on those parts, part semantics. **Ruling:** close the study; no new last-fill loss; the 34-part list is kept as a named hard subset to report separately in future evaluations (Track B / new families). Any fix must be confirmed on data not used here.
|
||||
- 2026-11-19: **H2 family/seed diagnostic** (descriptive, pre-registered 97f29e53; result 2f8d8787; MeltAssist PASS 77639066; 0 GPU-h). 552 / 204. Family-weighted field L2: A 7.083 %, H2 seed 0 6.579 %, seed 1 6.594 %; both seeds improve in all five folds and no leave-one-family-out flips the sign, so the field gain holds at family level. Tail misses (> .10 Rg from the true tail): both seeds 34 parts / 28 families, seed 0 only 37, seed 1 only 28, neither 453; the reference count expected if the two seeds' misses were independent is 71 × 62 / 552 ≈ 8. **Reading (corrected wording, MeltAssist):** the shared misses are repeated descriptive evidence that gives a candidate list for a mechanism study. They do not establish a mechanism, rule out seed effects, or carry formal significance. (My Slack reply had called it 'systematic, not seed noise'; that was too strong.) Next: pre-registered descriptive attribute study of the 34 parts (MoldAstra attributes, MeltSol), 0 GPU-h.
|
||||
- 2026-11-19: **Planning ruled** (four independent answers at 2c0dd614; ruling in planning-discussion-2026-11-19.md). Short: 1b + a zero-GPU family/seed/fold paired table from frozen scores. Medium chain: GINO reproduction on ShapeNet-611 → H2-P vs GINO on the same protocol → GINO as a Greif fill-time baseline. Long: new families with full process inputs, whole-family holdout and paired gate/process interventions; blocked on data rights (question to Yanqi).
|
||||
|
||||
Reference in new issue
Block a user