Files
MeltMind/docs/phase3-item1-results-2026-11-18.md
T

31 lines
3.5 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# Item1 data-sufficiency postfit — terminal result, 2026-11-18
The single authorized recovery completed with all six resumed prediction guards and scoring PASS. Original predict0 was reused by hash (686 files), and the original zero-worker GPU-busy STOP remains unchanged. All4582 canonical predictions were frozen before552 unique target reads (121 test). S1 original121 metric rows were reused. No training or scientific source changed.
**Sign convention:** `s_2U = [error(50%,2U) − error(100%,2U)] / log2(K100/K50)`, where K is the actual nested learning-component count; positive means benefit from the larger pool. `g_50 = error(50%,U) − error(50%,2U)` and `g_100 = error(100%,U) − error(100%,2U)`; positive means benefit from more updates, negative means **higher error at2U**. Test50% error rises0.068848977→0.072841268; test100% rises0.066848549→0.069586623; validation100% rises0.058409554→0.061272961. This result does not support the statement that longer training reduced error.
Both validation and the reused external test fold retain the frozen classification `UNIDENTIFIED_OR_OVERFIT_SIGNS`. This does not establish that extra data cannot help, or prove overfitting as the cause. External test contrasts are descriptive on the reused fold; uncertainty covers evaluation components, not training seed/pool uncertainty. Update-budget contrasts jointly change the complete schedule and update count.
| Domain | Contrast | Value | 95% interval |
|---|---|---:|---|
| common_validation | s_U | 0.003906463 | [0.000680483, 0.007145781] |
| common_validation | s_2U | 0.003269779 | [0.001118877, 0.005473240] |
| common_validation | g_50 | -0.002212699 | [-0.006578530, 0.002078290] |
| common_validation | g_100 | -0.002863407 | [-0.005320848, -0.000478482] |
| common_validation | s_2U_minus_s_U | -0.000636684 | [-0.004435444, 0.003029046] |
| common_validation | epoch_s_25to50 | 0.001920445 | [-0.002090456, 0.006225782] |
| common_validation | epoch_s_50to100 | 0.002614435 | [-0.001558464, 0.006148817] |
| common_test | s_U | 0.001957316 | [-0.001526956, 0.005417185] |
| common_test | s_2U | 0.003184503 | [-0.000897271, 0.007680015] |
| common_test | g_50 | -0.003992291 | [-0.007872280, -0.000289727] |
| common_test | g_100 | -0.002738074 | [-0.005973915, 0.000581431] |
| common_test | s_2U_minus_s_U | 0.001227187 | [-0.004228780, 0.006427824] |
| common_test | epoch_s_25to50 | 0.005589158 | [0.001609502, 0.009629431] |
| common_test | epoch_s_50to100 | 0.002279737 | [-0.000646325, 0.005217090] |
These are the original frozen relative-L2 contrasts, not new posthoc calculations. Positive s denotes the registered data-pool benefit; positive g denotes benefit from the longer update budget. Full arm/domain means, last-location and Kendall metrics, exclusions and all rows remain in `score/result.json`. Negative predictions are preserved without clipping.
Final cumulative postfit GPU 1229.244214134/7200s; CPU 1167.436862818/3600s. Original training71192.071785253s counted once; item total 72421.315999387/120000 GPU-s. All costs include the earlier STOP once.
Root: `/home/frank14f/MeltMind-runs/phase3-item1-postfit-recovery-2026-11-18`. Terminal audit and immutable source/model/prediction/review/terminal receipts are retained. Service exited0 and no item1 postfit process remains. No restart or rescoring. Stage interpretation and next-stage decision are submitted to Claude; Track A continues its already approved training, and seed1 remains separate reviewed-entry preparation.