Files
MeltMind/docs/phase3-item1-results-2026-11-18.md
T

3.5 KiB
Raw Blame History

Item1 data-sufficiency postfit — terminal result, 2026-11-18

The single authorized recovery completed with all six resumed prediction guards and scoring PASS. Original predict0 was reused by hash (686 files), and the original zero-worker GPU-busy STOP remains unchanged. All4582 canonical predictions were frozen before552 unique target reads (121 test). S1 original121 metric rows were reused. No training or scientific source changed.

Sign convention: s_2U = [error(50%,2U) − error(100%,2U)] / log2(K100/K50), where K is the actual nested learning-component count; positive means benefit from the larger pool. g_50 = error(50%,U) − error(50%,2U) and g_100 = error(100%,U) − error(100%,2U); positive means benefit from more updates, negative means higher error at2U. Test50% error rises0.068848977→0.072841268; test100% rises0.066848549→0.069586623; validation100% rises0.058409554→0.061272961. This result does not support the statement that longer training reduced error.

Both validation and the reused external test fold retain the frozen classification UNIDENTIFIED_OR_OVERFIT_SIGNS. This does not establish that extra data cannot help, or prove overfitting as the cause. External test contrasts are descriptive on the reused fold; uncertainty covers evaluation components, not training seed/pool uncertainty. Update-budget contrasts jointly change the complete schedule and update count.

Domain Contrast Value 95% interval
common_validation s_U 0.003906463 [0.000680483, 0.007145781]
common_validation s_2U 0.003269779 [0.001118877, 0.005473240]
common_validation g_50 -0.002212699 [-0.006578530, 0.002078290]
common_validation g_100 -0.002863407 [-0.005320848, -0.000478482]
common_validation s_2U_minus_s_U -0.000636684 [-0.004435444, 0.003029046]
common_validation epoch_s_25to50 0.001920445 [-0.002090456, 0.006225782]
common_validation epoch_s_50to100 0.002614435 [-0.001558464, 0.006148817]
common_test s_U 0.001957316 [-0.001526956, 0.005417185]
common_test s_2U 0.003184503 [-0.000897271, 0.007680015]
common_test g_50 -0.003992291 [-0.007872280, -0.000289727]
common_test g_100 -0.002738074 [-0.005973915, 0.000581431]
common_test s_2U_minus_s_U 0.001227187 [-0.004228780, 0.006427824]
common_test epoch_s_25to50 0.005589158 [0.001609502, 0.009629431]
common_test epoch_s_50to100 0.002279737 [-0.000646325, 0.005217090]

These are the original frozen relative-L2 contrasts, not new posthoc calculations. Positive s denotes the registered data-pool benefit; positive g denotes benefit from the longer update budget. Full arm/domain means, last-location and Kendall metrics, exclusions and all rows remain in score/result.json. Negative predictions are preserved without clipping.

Final cumulative postfit GPU 1229.244214134/7200s; CPU 1167.436862818/3600s. Original training71192.071785253s counted once; item total 72421.315999387/120000 GPU-s. All costs include the earlier STOP once.

Root: /home/frank14f/MeltMind-runs/phase3-item1-postfit-recovery-2026-11-18. Terminal audit and immutable source/model/prediction/review/terminal receipts are retained. Service exited0 and no item1 postfit process remains. No restart or rescoring. Stage interpretation and next-stage decision are submitted to Claude; Track A continues its already approved training, and seed1 remains separate reviewed-entry preparation.