SR-20261119-2137: discussion checkpoint and draft synthesis

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
ClaudeandClaude Opus 5.5 committed 2026-11-19 14:03:00 +00:00
1 parent adc57de49d
commit 80fbb89bf2
1 file changed
+26
@@ -35,3 +35,29 @@ Facts at cutoff (details: `research-tree.md`):
1. Independent reports → MeltSol publishes all to Git (Grok's from Slack), links posted.
2. Discussion checkpoint: Claude lists agreements and disagreements; members answer only the disagreements they are named in (one short reply each).
3. Claude's synthesis: agreements, unresolved disagreements, prioritised next tests with stop criteria; plain-language summary for Yanqi plus links to each contribution.
## Discussion checkpoint and draft synthesis (Claude, after all reports; bundle at 605f2987 + MoldSol / NewMeltAstra appended)
Reports: MeltSol, MeltAssist, MoldSol, NewMeltAstra, Grok, MeltWin (stood down), TRON (process), Undermind (tool-assisted literature note). Factual cutoff: H2-P formal paired result, 21:46:45 CST.
### Agreements (all reports consistent)
1. **What H2 is in 3D.** A mesh message-passing architecture (local messages on real mesh edges, mass-weighted aggregation, per-component global tokens, per-node decoder) that can be re-instantiated on tetrahedral volumes (Greif) and triangle surfaces (ShapeNet). Input layer, normalisation, backbone and head were retrained from scratch for ShapeNet; no weight or fill-prior transfer has been tested.
2. **What Greif establishes.** On our grouped protocol (552 parts / 204 families, 5 folds) H2 lowers family-weighted field error 7.08 → 6.58 / 6.59 % (two seeds), in every fold and robust to leaving out any family. Hard last-fill location is worse (.377 → .457 / .408 Rg). 34 shared misses (half also missed by A) are unexplained by tail-geometry attributes. Not established: new families from another source, process or gate interventions, any last-fill benefit, any paper-level comparison.
3. **What ShapeNet establishes.** GINO reproduced on its own protocol (7.43 %, 3 seeds; paper 7.12 %). The untuned H2-P is clearly worse: +2.58 pp, paired CI [+2.33, +2.85]. Only GINO's Table 2 is a verified same-protocol public number; OTNO / PCNO undetermined. No SOTA claim is possible or made.
4. **Next test.** GINO-Greif (matched protocol, 2 folds × 2 seeds, 212 parts / 78 families, paired GINO − H2) is unanimously first. Its reviews have passed (combined pre-score + custody delta fbaef6e2); it needs only Yanqi's launch OK.
5. **Generality needs data we do not have.** A real benchmark needs independent families with an official family split, explicit and varying gates, material/process variation, per-node fill time and a public licence. None public was found (Grok). Best available probes: family holdouts from ABC chunk hashes in v4/v5, and the 196-case warpage set if its families are new and its fill phase is shown to match.
### Points resolved in this checkpoint (no further round needed)
- **Packing removal and the fill phase** (Grok: should not change fill, inferred; TRON/MeltSol: switchover precedes full fill, so late fill can change). Not a matter of opinion: the pre-registered rule stands (case counts as same-process only if fill completes and switchover ≥ 99 %, post-switchover tail reported separately); the logs decide.
- **Remeshing variability** (NewMeltAstra): adopted for future intervention benchmarks: a design ranking is declared unjudgeable where the true gate/process effect is smaller than the remeshing variability of the reference solver.
- **Grid mapping / near-wall aliasing** (MoldSol): added as a report item for GINO-Greif (error by distance-to-wall band), not a gate; the pre-registered gate is unchanged.
- **H2-P tuning**: not now (MeltAssist, MeltSol). A tuned H2-P would need its own pre-registered entry and would still be compared with a GINO given equal tuning.
### Prioritised next tests with stop criteria
1. **GINO-Greif** (needs Yanqi's launch OK). Stop if the first-epoch projection exceeds 100,000 GPU-s, pairing is incomplete, or custody/frozen-hash gates fail. Outcome per pre-registration: GINO better → GINO-type becomes the default for both tasks; comparable → keep both, decide on cost; H2 better → isolate H2's molding-specific advantage. Last fill and the hard subset reported, not gated.
2. **Metadata audit** (CPU, no labels): v4 LOG/YML coverage, warpage-set family overlap and V/P fields. Stop treating a source as a same-process holdout if families overlap, fill is incomplete or switchover < 99 %.
3. **Family-holdout evaluation** on genuinely new families (from step 2), frozen models only, pre-registered field and tail tolerances. Stop promoting any model whose CI on new families fails the tolerance.
4. **Parked:** last-fill losses (until a cross-seed reproducible mechanism appears), Moldflow generation (Adviser cannot export per-node fields; needs Insight/Synergy), pretraining / weight transfer (would need pretrained-vs-random at fixed target data and compute).
### Unresolved
None of substance among members. Open external dependency: data rights for new simulated families (Insight/Synergy licence or partner data).