Results

Comparisons across training methods, inference steps, and checkpoint selection.

Ordinary versus rollout training

Choose the checkpoint comparison

Each method gets its best validation checkpoint. This is the overview’s more conservative comparison. All three ordinary runs select the original parent, before additional training.

Ordinary + correctionStep-specific rollout + correction
Foreground NRMSE ↓0.080.100.120.140.160.1200.1250.1270.1020.1010.1022 steps4 steps8 steps
Means across 3 seeds and 16 scans. Select a step count below for paired uncertainty intervals.
19.2%lower Foreground NRMSE95% CI 18.2–20.1%
0.1246 → 0.1007
lower is better
36.0%lower Full-image LPIPS95% CI 33.7–38.3%
0.0827 → 0.0529
lower is better
+0.0456increase in Foreground SSIM95% CI 0.0437–0.0477
0.8156 → 0.8613
higher is better
Full-image metrics and 10% foreground sensitivity
MetricOrdinaryRolloutDifference [95% CI]
Full NRMSE ↓0.14900.1304-0.0186 [-0.0204, -0.0166]
Full SSIM ↑0.68080.70830.0274 [0.0128, 0.0440]
10% foreground NRMSE ↓0.12320.0994-0.0238 [-0.0251, -0.0226]
10% foreground SSIM ↑0.80700.85490.0479 [0.0458, 0.0502]

Difference = rollout − ordinary. Negative is better for error metrics; positive is better for SSIM.

Training for different inference step counts

Two-step-specific training improves two-step inference. At eight-step inference, the four-step-trained model performs better than the eight-step-trained model.

Final training checkpoints, with measurement correction enabled. Lower is better.
Training methodInference steps
2 steps4 steps8 steps
Ordinary SelfDB0.13060.14220.1469
2-step rollout0.10230.10120.1019
4-step rollout0.10440.10070.0996
8-step rollout0.10710.10300.1016

Bold marks the best result in each inference column. Shading marks matching training and inference step counts.

Step-specific training versus four-step training, at the same inference step count. Terminal checkpoints; exploratory contrasts.
InferenceForeground NRMSELPIPSForeground SSIMFull SSIM
2 steps2.07% lower6.52% lower+0.00508−0.01085
8 steps1.96% higher6.49% higher−0.00567−0.00268

The paired 95% intervals support improvement at two steps and worsening at eight on all three foreground/perceptual metrics. Full SSIM worsens at two steps; the eight-step full-SSIM interval crosses zero.

Evaluation details

Metrics and uncertainty

NRMSE measures normalized pixel error; lower is better. LPIPS measures feature-space distance; lower is better, but it is not a clinical quality score. SSIM measures local structural similarity; higher is better. Foreground NRMSE and interior-window SSIM use a 5% reference-intensity mask. LPIPS is full-image.

We average slices within each scan, then give scans and seeds equal weight. The paired two-way bootstrap resamples the three seeds and sixteen scans, with 10,000 draws. Displayed intervals are pointwise 95%; the analysis also applies a Bonferroni correction for three step counts. Three seeds still give limited uncertainty coverage.

The test set was held out from model training.

All 21 final configurations, including uncorrected ordinary inference
Checkpoint / inferenceFG NRMSE ↓LPIPS ↓FG SSIM ↑Full SSIM ↑
ordinary k2 correction10.130640.076410.797220.69506
ordinary k4 correction10.142190.086050.781930.68522
ordinary k8 correction10.146900.090310.773870.67912
ordinary k2 correction00.165180.100170.695130.61900
ordinary k4 correction00.177640.101390.666100.60082
ordinary k8 correction00.192920.105810.634910.58175
rollout2 k2 correction10.102270.052700.858200.69583
rollout2 k4 correction10.101170.050800.860740.69373
rollout2 k8 correction10.101940.051160.859490.69349
rollout4 k2 correction10.104430.056370.853110.70668
rollout4 k4 correction10.100690.052920.861260.70826
rollout4 k8 correction10.099600.051760.863980.70913
rollout8 k2 correction10.107080.060310.846410.70170
rollout8 k4 correction10.103020.056560.854930.70520
rollout8 k8 correction10.101550.055120.858320.70645
Best validation: ordinary k2 correction10.120040.079530.820110.68659
Best validation: ordinary k4 correction10.124560.082730.815640.68084
Best validation: ordinary k8 correction10.126810.084380.811590.67732
Best validation: rollout2 k2 correction10.101980.053030.858950.69711
Best validation: rollout4 k4 correction10.100690.052920.861260.70826
Best validation: rollout8 k8 correction10.101550.055120.858320.70645

k = inference steps; correction1 = on; correction0 = off. Unprefixed rows use terminal checkpoints.

Earlier saved-model sweep: all configurations
ConfigurationFG NRMSE ↓LPIPS ↓FG SSIM ↑Full SSIM ↑
bridge k2 correction10.119290.068690.829900.74421
bridge k4 correction10.129820.074060.819370.73710
bridge k8 correction10.134670.076570.811910.73170
bridge k2 correction00.161430.106990.706630.65113
bridge k4 correction00.175620.108390.673500.63171
bridge k8 correction00.193390.111580.637800.61260
rollout k2 correction10.103380.052710.857080.70212
rollout k4 correction10.099100.049780.865860.70663
rollout k8 correction10.097990.049130.868570.70865
rollout k2 correction00.191270.186790.652560.54376
rollout k4 correction00.220740.232040.595600.50505
rollout k8 correction00.240780.259030.558010.48067

Earlier best-validation models, not the twelve newly trained step-study models. This correction-off diagnostic does not isolate the effect of training without correction.