research-tree: grouped 552/204 roster is v5-based (correction)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
ClaudeandClaude Opus 5.5 committed 2026-11-20 14:16:52 +00:00
1 parent 30c73d6c41
commit 276dbe7f4b
1 file changed
+1 -1
+1 -1
View File
@@ -39,7 +39,7 @@ Log (newest first):
- 2026-11-20: **NEW-FAMILY HOLDOUT RESULT: H2's field gain TRANSFERS** (Zenodo 17831586, 170 cases / 98 ABC families, zero roster/near-duplicate overlap; frozen 5-fold ensembles of A, H2 seed 0, H2 seed 1, no retraining; pre-score PASS a670a4d4/f314ca15 + split PASS 06c35e1a; predictions frozen 202a01a1 before any target read; each Fill_time decoded once; result a236d696, target ledger 0f3cd58d). Family-weighted field relative L2, H2 − A, 98-family paired bootstrap (2,000, seed 2026111408): seed 0 −1.322 pp, CI [−1.721, −0.959]; seed 1 −1.364 pp, CI [−1.769, −0.971] → both FIELD_GAIN_TRANSFERS (pre-registered). Last fill: hit counts equal across the three; distance up for seed 0, slightly down for seed 1 (descriptive, no gate). Reading: on genuinely new part families from a different public release, the learned mesh model's field advantage over the tree model holds and is larger in absolute terms than on the grouped Greif protocol (−0.50 pp); last fill is still not improved. Limits: same solver/material/process as training; single gate per part; one release. Compute: 1a 37,748 CPU-s, 1b ~196 GPU-s, scoring 83 CPU-s.
- 2026-11-20: **34 shared misses classified by true last-3 % region** (bounded CPU read, MeltAssist PASS 53c9c543; result by-part.csv 3d6c38e1; hypothesis-generating). Same region / different region / NA (peak > .10 Rg from every last-3 % component): H2 seed 0 4/5/25, seed 1 8/4/22, A 16/4/14 (A on query nodes only). **Reading:** for most of H2's shared misses the predicted last point is not in the true late zone at all; A's misses are mostly inside the right late region. This corrects my visual note (four pairs suggested 'same end region, different point' was the main case; that is the minority for H2) and is consistent with the S2 diagnostic (H2 more far-from-tail picks, 71 vs 49). Untested hypothesis: H2's predicted field has spurious late maxima away from the true late zone (endpoint = argmax is sensitive to small local errors), rather than a wrong branch choice.
- 2026-11-20: **New-family holdout established: 170 cases / 98 families** (warpage set, Zenodo 17831586). ZIP verified on Horsea (MD5/SHA-256 49884675…). Geometry vetting under MeltAssist PASS d2a31203 (scope COMBINED_VTU_LOG_SCALE_YML_SURFACE_ALIGNMENT; Points/Cells only, Fill_time sealed): 173 pass (unit uniquely mm from LOG volume ≤ 0.5 %, counts, finite/positive volumes, YML inlet on surface), 23 excluded NO_LOG_SCALE_MATCH. Near-duplicates (pre-frozen < 1 % fingerprint rule) vs our 552 / 204 families: 0 of 95,496 pairs; within the set 0 of 14,878; roster identity overlap 0. Minus 3 cases with V/P switchover < 99 % (10555, 10656, 10941; pre-registered rule) → 170 cases / 98 ABC families: same solver, material, melt/mold temperatures and fill rule as Greif, complete fill, new families. This is the first independent test of 'new parts'. Next: frozen-model evaluation spec (pre-registered before any Fill_time read).
- 2026-11-19: **Warpage set (Zenodo 17831586) metadata census: candidate new-family fill-time holdout** (Claude, HTTP range reads of the 392 LOG/YML entries only; no VTU bytes fetched; docs/claude/data/greif_warpage_log_census.csv sha256 e44ff604…, scripts warp_fetch.py / warp_census.py). 588 ZIP entries = 196 VTU + 196 LOG + 196 YML. All 196: melt 543.15 K / mold 318.15 K (same as main corpus), last filling-phase row 100 % 'Filled' before packing starts, packing profile 0 % (applies only after fill), no short-shot text; V/P switchover median 99.83 %, 193/196 ≥ 99 % (3 between 98.51 and 99 %); gate coordinates + normals present for all. **Family overlap: 110 ABC chunk hashes, 0 shared with the 249 v5 hashes, 0 shared abc_id+step.** Reading: under the pre-registered rule (complete fill, switchover ≥ 99 %, new families) 193 cases qualify as a same-process new-family holdout, pending (i) overlap check against our actual 552-part roster (v4-based) and (ii) a geometry near-duplicate check once the ZIP is on Horsea. Labels (nodal Fill_time) are listed in the record but untouched. **Access note:** Zenodo returned 403 to a 'Mozilla/5.0' User-Agent and 206 to curl's default UA from the same host; Horsea's 403s likely came from the UA I had suggested.
- 2026-11-19: **Warpage set (Zenodo 17831586) metadata census: candidate new-family fill-time holdout** (Claude, HTTP range reads of the 392 LOG/YML entries only; no VTU bytes fetched; docs/claude/data/greif_warpage_log_census.csv sha256 e44ff604…, scripts warp_fetch.py / warp_census.py). 588 ZIP entries = 196 VTU + 196 LOG + 196 YML. All 196: melt 543.15 K / mold 318.15 K (same as main corpus), last filling-phase row 100 % 'Filled' before packing starts, packing profile 0 % (applies only after fill), no short-shot text; V/P switchover median 99.83 %, 193/196 ≥ 99 % (3 between 98.51 and 99 %); gate coordinates + normals present for all. **Family overlap: 110 ABC chunk hashes, 0 shared with the 249 v5 hashes, 0 shared abc_id+step.** Reading: under the pre-registered rule (complete fill, switchover ≥ 99 %, new families) 193 cases qualify as a same-process new-family holdout, pending (i) overlap check against our actual 552-part roster (v5-based: Zenodo 18598121; corrected 2026-11-20, MeltSol) and (ii) a geometry near-duplicate check once the ZIP is on Horsea. Labels (nodal Fill_time) are listed in the record but untouched. **Access note:** Zenodo returned 403 to a 'Mozilla/5.0' User-Agent and 206 to curl's default UA from the same host; Horsea's 403s likely came from the UA I had suggested.
- 2026-11-19: **H2-P on ShapeNet-611: H2_P_IMPROVEMENT_NOT_ESTABLISHED (worse).** Combined entry PASS 1359ba98; three seeds, 100 epochs, matched budget, untuned direct pressure head, molding inputs removed; 111 targets read once per seed. H2-P 10.013 % vs reproduced GINO 7.435 %; pre-registered paired H2-P − GINO +2.578 pp, 95 % CI [+2.327, +2.849] over 111 single-part components (no family structure). Frozen result fcff9e9c (MeltSol); MeltAssist checked. **Reading:** on this pressure protocol, the H2 architecture as adapted is clearly worse than GINO. This is not weight transfer (trained from scratch) and says nothing about H2's Greif result; it is the planning ruling's 'H2-P behind GINO' branch. Stage review SR-20261119-2137 factual cutoff = this publication.
- 2026-11-19: **Moldflow Adviser data route NOT ESTABLISHED for per-node labels (wording corrected 2026-11-19 22:47, RESET-20261119-2247: an STL-import solve is not ruled out; what was not established is direct import of the original BDF and a usable per-node export / ID mapping)** (MeltWin on ARON: Adviser 2027 imports STL, no BDF; Grok, official docs: Adviser exports only .mfr for Communicator, API scripts unsupported; Communicator is a viewer with no documented per-node export; per-node XML export is Insight-only). The approved single original-mesh local solve was not used (0 solves, 0 credits); MeltWin stays stood down. Data generation would need Insight/Synergy via another licence (question for Yanqi at the next stage report). **New lead instead (Grok):** the public Greif–Meyer corpus ships Moldflow LOG + inlet YML from v4 on, and a 196-case warpage set (Zenodo 17831586, Dec 2025; packing pressure removed, so late fill may differ, per TRON/Autodesk V/P docs). MeltSol checks overlap with our 552/204, v4/v5 LOG/YML coverage of B8 and the 94 sealed candidates, and per-case V/P switchover / end-of-fill / short-shot (metadata only). Pre-registered: a warpage case counts as same-process new-family holdout only if fill completes and switchover ≥ 99 %, with the post-switchover tail reported separately; otherwise 'transfer under changed process'.
- 2026-11-19: **Track B: GINO reproduced on ShapeNet-611 (pre-registered tolerance).** Identity: NeurIPS supplement code + 2-keyword patch (inp/outp_features → in/out_features; no variant accepting the old names found). Paper package, 500/111, 100 epochs, 64³, de-normalised per-part relative L2; each seed read the 111 held-out cars once after its frozen epoch-100 checkpoint. Seeds 0/1/2: 6.948 / 7.764 / 7.591 %; equal-weight mean 7.435 %, inside [6.62, 7.62] → REPRODUCED. 30,351.6 GPU-s (+ 222.8 stopped measurement). **Reading:** the baseline is usable for same-protocol comparison, but our mean is .31 pp above the paper's 7.12 % and seeds spread .82 pp (one seed alone is above the band), so any ranking must be seed-paired and multi-seed; single-seed comparisons against 7.12 % are not meaningful. Weights in private Drive with SHA read-back.