Compute costs

$117.04 on Modal, using approximately 28 GPU-hours across the project.

Resource	Cost	Estimated GPU-hours
H100	$99.12	25.10
A100-80GB	$4.93	1.97
A10G	$1.04	0.95
CPU and memory	$11.94	—
Total	$117.04	28.0

Includes data preparation, profiling, training, evaluation, and retries. We ran up to six models in parallel, usually with one GPU each. All research jobs are stopped.

GPU-hours are estimated from GPU charges and Modal’s rates, summed across devices. They are not elapsed time. The total excludes OpenAI costs.

Modal dashboard showing $117.04 in usage: $30 in credits and $87.04 in charges, against a $200 usage limit.

Run log

All 34 charged Modal runs, including preparation, interrupted jobs, and recoveries. Expand a run for its recorded times, cost, and outcome.

34 of 34 charged apps · chronological where timestamps are retained · UTC

01Data preparation: first attempt$0.000435

Failed: official archive returned HTTP 403.

Metered total: $0.00043468
Charged resources: Memory: $0.000046 · CPU: $0.000389
App created: 2026-09-07 01:24:20 UTC
App stopped: 2026-09-07 01:24:43 UTC

App lifespan: 0.4 minutes. This includes non-GPU time and is not allocated GPU duration.

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 01:00:00Z	Memory	$0.00004556
2026-09-07 01:00:00Z	CPU	$0.00038913

02CPU data preparation retry$0.002467

completed

Metered total: $0.00246709
Charged resources: Memory: $0.000996 · CPU: $0.001472
App created: 2026-09-07 01:31:53 UTC
App stopped: 2026-09-07 01:32:58 UTC

App lifespan: 1.1 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
function seconds	47.40470838546753
cpu	2
memory gib	8

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 01:00:00Z	Memory	$0.00099555
2026-09-07 01:00:00Z	CPU	$0.00147154

03Pilot: aborted launch$0.000860

Setup attempt stopped before the successful pilot; no separate efficacy result.

Metered total: $0.00085977
Charged resources: Memory: $0.000082 · CPU: $0.000778
App created: 2026-09-07 01:36:46 UTC
App stopped: 2026-09-07 01:38:34 UTC

App lifespan: 1.8 minutes. This includes non-GPU time and is not allocated GPU duration.

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 01:00:00Z	Memory	$0.00008167
2026-09-07 01:00:00Z	CPU	$0.00077810

04single A100 80GB pilot, baseline training plus four-step validation comparison$0.1235

completed; app verified stopped

Metered total: $0.12353346
Charged resources: A100-80GB: $0.1096 · Memory: $0.005613 · CPU: $0.008296
App created: 2026-09-07 01:45:52 UTC
App stopped: 2026-09-07 01:48:39 UTC

App lifespan: 2.8 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
training timeout seconds	1800
function timeout seconds	2700
startup timeout seconds	300
max containers	1
retries	0
limits / max gpus	1
limits / cpu request and limit	4
limits / memory request and limit gib	16
limits / training seconds	1800
limits / function timeout seconds	2700
limits / startup timeout seconds	300
limits / retries	0
limits / max containers	1
training seconds	137.20008408
completed steps	3000

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 01:00:00Z	A100-80GB	$0.10962433
2026-09-07 01:00:00Z	Memory	$0.00561277
2026-09-07 01:00:00Z	CPU	$0.00829637

05matched ordinary vs rollout fine-tuning pair$0.5791

completed; both GPUs stopped

Metered total: $0.57909051
Charged resources: A100-80GB: $0.5139 · Memory: $0.0263 · CPU: $0.0389
App created: 2026-09-07 01:55:14 UTC
App stopped: 2026-09-07 02:02:02 UTC

App lifespan: 6.8 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
maximum gpus	2
training timeout seconds per job	900
function timeout seconds per job	1200
startup timeout seconds per job	300
retries	0
bridge training seconds	382.940770132
rollout training seconds	320.04026066800003
nfe per branch	12000

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 01:00:00Z	A100-80GB	$0.37916637
2026-09-07 01:00:00Z	Memory	$0.01941332
2026-09-07 01:00:00Z	CPU	$0.02869531
2026-09-07 02:00:00Z	A100-80GB	$0.13472198
2026-09-07 02:00:00Z	Memory	$0.00689777
2026-09-07 02:00:00Z	CPU	$0.01019576

06three-seed held-out confirmation$1.3100

completed; all research apps verified stopped with zero tasks

Metered total: $1.30999081
Charged resources: A100-80GB: $1.1625 · Memory: $0.0595 · CPU: $0.0880
App created: 2026-09-07 02:31:53 UTC
App stopped: 2026-09-07 02:46:43 UTC

App lifespan: 14.8 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
maximum gpus	2
retries	0
function timeouts seconds	[180,1800,1800]
startup timeouts seconds	[120,180,180]
training / 1 / pretrain / completed steps	3000
training / 1 / pretrain / seconds	110.16987
training / 1 / bridge / completed steps	12000
training / 1 / bridge / seconds	352.673685305
training / 1 / rollout / completed steps	3000
training / 1 / rollout / seconds	297.45149137900006
training / 2 / pretrain / completed steps	3000
training / 2 / pretrain / seconds	128.58816731800002
training / 2 / bridge / completed steps	12000
training / 2 / bridge / seconds	384.774743131
training / 2 / rollout / completed steps	3000
training / 2 / rollout / seconds	314.5762298540001

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 02:00:00Z	A100-80GB	$1.16249362
2026-09-07 02:00:00Z	Memory	$0.05951967
2026-09-07 02:00:00Z	CPU	$0.08797752

07single-scan real multi-coil GPU profiling pilot$0.0454

completed; all related apps stopped with zero tasks

Metered total: $0.04538802
Charged resources: A100-80GB: $0.0403 · Memory: $0.002062 · CPU: $0.003048
App created: 2026-09-07 03:27:43 UTC
App stopped: 2026-09-07 03:28:49 UTC

App lifespan: 1.1 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
maximum gpus	1
function timeout seconds	600
startup timeout seconds	180
internal timeout seconds	480
retries	0
profile seconds	51.122320076

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 03:00:00Z	A100-80GB	$0.04027760
2026-09-07 03:00:00Z	Memory	$0.00206221
2026-09-07 03:00:00Z	CPU	$0.00304821

08Multi-coil preparation: preempted$0.0169

CPU preemption; continued in a separate app.

Metered total: $0.01687290
Charged resources: Memory: $0.006625 · CPU: $0.0102
App created: 2026-09-07 03:41:15 UTC
App stopped: 2026-09-07 03:45:22 UTC

App lifespan: 4.1 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
maximum gpus	2
cpu preparation timeout seconds	7200
gpu timeout seconds per seed	2400
retries	0
preparation seconds recovery	2009.393233229

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 03:00:00Z	Memory	$0.00662501
2026-09-07 03:00:00Z	CPU	$0.01024788

09Multi-coil benchmark: recovery$3.3387

Prepared data and ran benchmark; seed 2 required a later recovery.

Metered total: $3.33873385
Charged resources: Memory: $0.3423 · CPU: $0.5060 · A100-80GB: $2.4904
App created: 2026-09-07 03:49:36 UTC
App stopped: 2026-09-07 05:02:15 UTC

App lifespan: 72.7 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
nonpreemptible cpu	true
cpu price multiplier	3

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 03:00:00Z	Memory	$0.06570671
2026-09-07 03:00:00Z	CPU	$0.09712273
2026-09-07 04:00:00Z	A100-80GB	$2.40149758
2026-09-07 04:00:00Z	Memory	$0.27207668
2026-09-07 04:00:00Z	CPU	$0.40216335
2026-09-07 05:00:00Z	A100-80GB	$0.08888861
2026-09-07 05:00:00Z	Memory	$0.00455110
2026-09-07 05:00:00Z	CPU	$0.00672709

10multicoil seed2 recovery$0.6161

Provider preemption at 2500/3000 rollout steps; no seed-2 evaluation existed

Metered total: $0.61611571
Charged resources: A100-80GB: $0.5467 · Memory: $0.0280 · CPU: $0.0414
App created: 2026-09-07 05:05:04 UTC
App stopped: 2026-09-07 05:18:19 UTC

App lifespan: 13.3 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
discarded rollout seconds lower bound	419.898237503

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 05:00:00Z	A100-80GB	$0.54674474
2026-09-07 05:00:00Z	Memory	$0.02799333
2026-09-07 05:00:00Z	CPU	$0.04137764

11Original repository 149.6M U-Net training-only GPU preflight$0.0752

Completed; app verified stopped with zero tasks

Metered total: $0.07516631
Charged resources: A100-80GB: $0.0667 · Memory: $0.003415 · CPU: $0.005048
App created: 2026-09-07 06:26:44 UTC
App stopped: 2026-09-07 06:28:26 UTC

App lifespan: 1.7 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
maximum gpus	1
function timeout seconds	720
startup timeout seconds	180
retries	0
profile seconds	83.766152403

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 06:00:00Z	A100-80GB	$0.06670303
2026-09-07 06:00:00Z	Memory	$0.00341520
2026-09-07 06:00:00Z	CPU	$0.00504809

12Parallel H100 original U-Net batch with speed gate$16.1676

Completed; all fixed training budgets and evaluations verified; both apps stopped with zero tasks

Metered total: $16.16764511
Charged resources: Memory: $0.4850 · CPU: $0.7168 · H100: $14.9658
App created: 2026-09-07 06:50:21 UTC
App stopped: 2026-09-07 07:39:53 UTC

App lifespan: 49.5 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
maximum gpus	6
retries	0
seed 0 / bridge / function seconds	2208.327066071
seed 0 / bridge / training seconds	2101.263839014
seed 0 / bridge / training nfe	13300
seed 0 / bridge / training completed steps	13300
seed 0 / bridge / training gpu	NVIDIA H100 80GB HBM3
seed 0 / bridge / training peak gpu memory gb	11.605156864
seed 0 / rollout / function seconds	1613.877830046
seed 0 / rollout / training seconds	1561.809403791
seed 0 / rollout / training nfe	12000
seed 0 / rollout / training completed steps	3000
seed 0 / rollout / training gpu	NVIDIA H100 80GB HBM3
seed 0 / rollout / training peak gpu memory gb	12.017135104
seed 1 / bridge / training seconds	2461.4580230700003
seed 1 / bridge / training nfe	13300
seed 1 / bridge / training completed steps	13300
seed 1 / bridge / training gpu	NVIDIA H100 80GB HBM3
seed 1 / bridge / training peak gpu memory gb	11.605156864
seed 1 / rollout / function seconds	1726.175263221
seed 1 / rollout / training seconds	1669.2462002480002
seed 1 / rollout / training nfe	12000
seed 1 / rollout / training completed steps	3000
seed 1 / rollout / training gpu	NVIDIA H100 80GB HBM3
seed 1 / rollout / training peak gpu memory gb	12.01722624
seed 2 / bridge / function seconds	2464.6480095929996
seed 2 / bridge / training seconds	2343.1742475329997
seed 2 / bridge / training nfe	13300
seed 2 / bridge / training completed steps	13300
seed 2 / bridge / training gpu	NVIDIA H100 80GB HBM3
seed 2 / bridge / training peak gpu memory gb	11.605156864
seed 2 / rollout / function seconds	1765.85444202
seed 2 / rollout / training seconds	1699.412718578
seed 2 / rollout / training nfe	12000
seed 2 / rollout / training completed steps	3000
seed 2 / rollout / training gpu	NVIDIA H100 80GB HBM3
seed 2 / rollout / training peak gpu memory gb	12.017135104

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 06:00:00Z	Memory	$0.06579396
2026-09-07 06:00:00Z	CPU	$0.09725170
2026-09-07 06:00:00Z	H100	$2.03036055
2026-09-07 07:00:00Z	Memory	$0.41917477
2026-09-07 07:00:00Z	CPU	$0.61959271
2026-09-07 07:00:00Z	H100	$12.93547143

13Original U-Net: seed 1 continuation$0.2219

Completed the remaining 300 updates.

Metered total: $0.22186325
Charged resources: Memory: $0.006655 · CPU: $0.009837 · H100: $0.2054
App created: 2026-09-07 07:41:40 UTC
App stopped: 2026-09-07 07:44:53 UTC

App lifespan: 3.2 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
prior seconds lower bound	2387.222473878
maximum gpus	1
retries	0
function timeout seconds	900
startup timeout seconds	180
original plus continuation timeout compute bound usd	26.6607

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 07:00:00Z	Memory	$0.00665507
2026-09-07 07:00:00Z	CPU	$0.00983702
2026-09-07 07:00:00Z	H100	$0.20537117

14Full 16-scan three-seed foreground evaluation only$0.1849

Completed; all six evaluations and saved reconstructions verified; GPU stopped with zero tasks

Metered total: $0.18491267
Charged resources: Memory: $0.005547 · CPU: $0.008199 · H100: $0.1712
App created: 2026-09-07 08:11:18 UTC
App stopped: 2026-09-07 08:14:02 UTC

App lifespan: 2.7 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
maximum gpus	1
retries	0

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 08:00:00Z	Memory	$0.00554669
2026-09-07 08:00:00Z	CPU	$0.00819870
2026-09-07 08:00:00Z	H100	$0.17116729

15M4Raw external evaluation, 25 subjects, six frozen original-model checkpoints$0.3129

Completed; all six evaluations verified; app stopped with zero tasks

Metered total: $0.31292803
Charged resources: Memory: $0.009387 · CPU: $0.0139 · H100: $0.2897
App created: 2026-09-07 08:43:34 UTC
App stopped: 2026-09-07 08:48:07 UTC

App lifespan: 4.5 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max containers	1
function timeout seconds	1200
startup timeout seconds	180
retries	0
execution seconds	255.681085403

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 08:00:00Z	Memory	$0.00938667
2026-09-07 08:00:00Z	CPU	$0.01387467
2026-09-07 08:00:00Z	H100	$0.28966670

16Expanded Calgary training preparation: 37 scans / 5032 slices$2.5095

Completed; 37 scans / 5032 slices audited; all preparation apps stopped with zero tasks

Metered total: $2.50954569
Charged resources: Memory: $1.0127 · CPU: $1.4969
App created: 2026-09-07 09:51:37 UTC
App stopped: 2026-09-07 10:11:41 UTC

App lifespan: 20.1 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max parallel workers	8
worker timeout seconds	900
startup timeout seconds	180
retries	0
training slices	5032
training scans	37

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 09:00:00Z	Memory	$0.42053896
2026-09-07 09:00:00Z	CPU	$0.62160914
2026-09-07 10:00:00Z	Memory	$0.59214026
2026-09-07 10:00:00Z	CPU	$0.87525732

17GPU calibration: setup attempt$0.000083

Failed setup; retained in the cost ledger.

Metered total: $0.00008350
Charged resources: Memory: $0.000003 · CPU: $0.000080
App created: 2026-09-07 10:05:34 UTC
App stopped: 2026-09-07 10:05:47 UTC

App lifespan: 0.2 minutes. This includes non-GPU time and is not allocated GPU duration.

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 10:00:00Z	Memory	$0.00000333
2026-09-07 10:00:00Z	CPU	$0.00008016

18GPU calibration: attempt 2$0.008678

Calibration/preparation work; no efficacy claim.

Metered total: $0.00867761
Charged resources: Memory: $0.000784 · A10G: $0.006735 · CPU: $0.001158
App created: 2026-09-07 10:06:53 UTC
App stopped: 2026-09-07 10:07:33 UTC

App lifespan: 0.7 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max containers	1
timeout seconds	300
startup timeout seconds	180

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 10:00:00Z	Memory	$0.00078375
2026-09-07 10:00:00Z	A10G	$0.00673537
2026-09-07 10:00:00Z	CPU	$0.00115848

19GPU calibration: attempt 3$0.007885

Calibration/preparation work; no efficacy claim.

Metered total: $0.00788483
Charged resources: Memory: $0.000713 · A10G: $0.006111 · CPU: $0.001061
App created: 2026-09-07 10:08:24 UTC
App stopped: 2026-09-07 10:09:00 UTC

App lifespan: 0.6 minutes. This includes non-GPU time and is not allocated GPU duration.

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 10:00:00Z	Memory	$0.00071278
2026-09-07 10:00:00Z	A10G	$0.00611109
2026-09-07 10:00:00Z	CPU	$0.00106096

20calgary expansion gpu finish$0.4094

Initial app stopped after numerical rejection; outputs preserved and all unfinished chunks subsequently recovered

Metered total: $0.40941308
Charged resources: Memory: $0.0370 · A10G: $0.3178 · CPU: $0.0547
App created: 2026-09-07 10:12:54 UTC
App stopped: 2026-09-07 10:17:54 UTC

App lifespan: 5.0 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
cpu app confirmed stopped	true
cpu stop observed unix	1788775958.404754
cpu conservative cost bound usd	2.6812838776397703
gpu max containers	4
worker timeout seconds	660
startup timeout seconds	120
maximum gpu compute usd	1.22824

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 10:00:00Z	Memory	$0.03697775
2026-09-07 10:00:00Z	A10G	$0.31777758
2026-09-07 10:00:00Z	CPU	$0.05465774

21calgary expansion gpu recovery$0.2740

Completed; one entire scan rebuilt with original CPU maps

Metered total: $0.27399212
Charged resources: Memory: $0.0247 · A10G: $0.2127 · CPU: $0.0366
App created: 2026-09-07 10:18:57 UTC
App stopped: 2026-09-07 10:30:39 UTC

App lifespan: 11.7 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
cpu app confirmed stopped	true
cpu stop observed unix	1788775958.404754
cpu conservative cost bound usd	2.6812838776397703
gpu max containers	4
worker timeout seconds	660
startup timeout seconds	120
maximum gpu compute usd	1.22824
recovery gpu max containers	1
recovery timeout seconds	1200
recovery startup timeout seconds	120

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 10:00:00Z	Memory	$0.02474668
2026-09-07 10:00:00Z	A10G	$0.21266676
2026-09-07 10:00:00Z	CPU	$0.03657868

22calgary expansion gpu finish rest$0.6455

Completed

Metered total: $0.64545700
Charged resources: Memory: $0.0583 · A10G: $0.5010 · CPU: $0.0862
App created: 2026-09-07 10:21:16 UTC
App stopped: 2026-09-07 10:33:09 UTC

App lifespan: 11.9 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
cpu app confirmed stopped	true
cpu stop observed unix	1788775958.404754
cpu conservative cost bound usd	2.6812838776397703
gpu max containers	4
worker timeout seconds	660
startup timeout seconds	120
maximum gpu compute usd	1.22824

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 10:00:00Z	Memory	$0.05829699
2026-09-07 10:00:00Z	A10G	$0.50098977
2026-09-07 10:00:00Z	CPU	$0.08617024

23calgary expansion final audit$0.005172

Passed; stopped with zero tasks

Metered total: $0.00517169
Charged resources: Memory: $0.001307 · CPU: $0.003864
App created: 2026-09-07 10:33:33 UTC
App stopped: 2026-09-07 10:36:06 UTC

App lifespan: 2.5 minutes. This includes non-GPU time and is not allocated GPU duration.

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 10:00:00Z	Memory	$0.00130722
2026-09-07 10:00:00Z	CPU	$0.00386447

24Full 5032-slice original-U-Net H100 memory and throughput profile$0.3627

Completed; both shapes and methods passed; app stopped with zero tasks

Metered total: $0.36272279
Charged resources: Memory: $0.0109 · CPU: $0.0161 · H100: $0.3357
App created: 2026-09-07 10:40:22 UTC
App stopped: 2026-09-07 10:45:47 UTC

App lifespan: 5.4 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max containers	1
retries	0
timeout seconds	660
startup timeout seconds	120
profile seconds	292.834761427
data load seconds	270.724702493
peak allocated gpu gb	45.53410048
peak reserved gpu gb	51.868860416

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 10:00:00Z	Memory	$0.01088164
2026-09-07 10:00:00Z	CPU	$0.01609182
2026-09-07 10:00:00Z	H100	$0.33574933

25Four-GPU training profile$0.2465

Distributed training was slower; subsequent models used one GPU each.

Metered total: $0.24651958
Charged resources: Memory: $0.003840 · CPU: $0.005676 · H100: $0.2370
App created: 2026-09-07 11:07:37 UTC
App stopped: 2026-09-07 11:08:42 UTC

App lifespan: 1.1 minutes. This includes non-GPU time and is not allocated GPU duration.

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 11:00:00Z	Memory	$0.00384006
2026-09-07 11:00:00Z	CPU	$0.00567608
2026-09-07 11:00:00Z	H100	$0.23700344

26Expanded Calgary longer-training comparison, three seeds by two methods$19.7001

Completed; all six initial-segment evaluations saved; three baselines met validation stopping rule, three rollouts reached segment time budget

Metered total: $19.70007157
Charged resources: Memory: $0.5909 · CPU: $0.8735 · H100: $18.2357
App created: 2026-09-07 11:13:33 UTC
App stopped: 2026-09-07 12:09:07 UTC

App lifespan: 55.6 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max containers	6
retries	0
timeout seconds	3600
startup timeout seconds	120
seed 0 / bridge / function seconds	1999.399273732
seed 0 / bridge / training seconds this engine	1745.542645929
seed 0 / bridge / training nfe	12000
seed 0 / bridge / training step	12000
seed 0 / bridge / training reason	validation_plateau
seed 0 / rollout / function seconds	3281.6361932540003
seed 0 / rollout / training seconds this engine	3068.466228705
seed 0 / rollout / training nfe	21792
seed 0 / rollout / training step	5448
seed 0 / rollout / training reason	segment_budget_exhausted
seed 1 / bridge / function seconds	2540.774733687
seed 1 / bridge / training seconds this engine	2166.774261885
seed 1 / bridge / training nfe	12000
seed 1 / bridge / training step	12000
seed 1 / bridge / training reason	validation_plateau
seed 1 / rollout / function seconds	3298.4440890769997
seed 1 / rollout / training seconds this engine	3037.233545659
seed 1 / rollout / training nfe	21564
seed 1 / rollout / training step	5391
seed 1 / rollout / training reason	segment_budget_exhausted
seed 2 / bridge / function seconds	2135.030535289
seed 2 / bridge / training seconds this engine	1877.778090856
seed 2 / bridge / training nfe	13200
seed 2 / bridge / training step	13200
seed 2 / bridge / training reason	validation_plateau
seed 2 / rollout / function seconds	3283.9632826899997
seed 2 / rollout / training seconds this engine	3091.535091297
seed 2 / rollout / training nfe	22096
seed 2 / rollout / training step	5524
seed 2 / rollout / training reason	segment_budget_exhausted

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 11:00:00Z	Memory	$0.53503268
2026-09-07 11:00:00Z	CPU	$0.79084518
2026-09-07 11:00:00Z	H100	$16.51077403
2026-09-07 12:00:00Z	Memory	$0.05589560
2026-09-07 12:00:00Z	CPU	$0.08262069
2026-09-07 12:00:00Z	H100	$1.72490339

27Continue the three unfinished rollout branches under the unchanged validation stopping rule$9.7363

Completed; evaluations saved and app stopped with zero tasks. Final combined stopping audit passed.

Metered total: $9.73625134
Charged resources: Memory: $0.2921 · CPU: $0.4317 · H100: $9.0125
App created: 2026-09-07 12:10:23 UTC
App stopped: 2026-09-07 13:05:42 UTC

App lifespan: 55.3 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max containers	3
timeout seconds	3600
startup timeout seconds	120
retries	0
seed 0 / rollout / function seconds	1603.701518156
seed 0 / rollout / training seconds this engine	1316.340760753
seed 0 / rollout / training nfe	30000
seed 0 / rollout / training step	7500
seed 0 / rollout / training reason	validation_plateau
seed 1 / rollout / function seconds	3290.21160365
seed 1 / rollout / training seconds this engine	3091.17889756
seed 1 / rollout / training nfe	40984
seed 1 / rollout / training step	10246
seed 1 / rollout / training reason	segment_budget_exhausted
seed 2 / rollout / function seconds	3292.491466699
seed 2 / rollout / training seconds this engine	3088.341660494
seed 2 / rollout / training nfe	42276
seed 2 / rollout / training step	10569
seed 2 / rollout / training reason	segment_budget_exhausted

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 12:00:00Z	Memory	$0.26885657
2026-09-07 12:00:00Z	CPU	$0.39740361
2026-09-07 12:00:00Z	H100	$8.29674560
2026-09-07 13:00:00Z	Memory	$0.02319447
2026-09-07 13:00:00Z	CPU	$0.03428432
2026-09-07 13:00:00Z	H100	$0.71576677

28Finish the two remaining rollout stopping assessments$2.0083

Completed; evaluations saved and app stopped with zero tasks. Final combined stopping audit passed.

Metered total: $2.00831299
Charged resources: Memory: $0.0602 · CPU: $0.0890 · H100: $1.8590
App created: 2026-09-07 13:07:00 UTC
App stopped: 2026-09-07 13:21:53 UTC

App lifespan: 14.9 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max containers	2
timeout seconds	3600
startup timeout seconds	120
retries	0
seed 1 / rollout / function seconds	868.860904786
seed 1 / rollout / training seconds this engine	648.78295765
seed 1 / rollout / training nfe	44400
seed 1 / rollout / training step	11100
seed 1 / rollout / training reason	validation_plateau
seed 2 / rollout / function seconds	811.39535414
seed 2 / rollout / training seconds this engine	614.433981653
seed 2 / rollout / training nfe	45600
seed 2 / rollout / training step	11400
seed 2 / rollout / training reason	validation_plateau

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 13:00:00Z	Memory	$0.06024186
2026-09-07 13:00:00Z	CPU	$0.08904500
2026-09-07 13:00:00Z	H100	$1.85902613

29Frozen six-model 2/4/8-step correction-on/off sweep and training-only memory/speed profile$0.7220

Completed; all 36 evaluations and all four profile configurations passed

Metered total: $0.72201082
Charged resources: Memory: $0.0217 · CPU: $0.0320 · H100: $0.6683
App created: 2026-09-07 18:57:16 UTC
App stopped: 2026-09-07 19:00:40 UTC

App lifespan: 3.4 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max containers	4
timeout seconds	900
startup timeout seconds	120
retries	0
seed 0 sweep reported function seconds	154.33789599000002
seed 1 sweep reported function seconds	152.66186558700002
seed 2 sweep reported function seconds	151.116914712
seed -1 profile reported function seconds	121.731616136

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 18:00:00Z	Memory	$0.02147557
2026-09-07 18:00:00Z	CPU	$0.03174358
2026-09-07 18:00:00Z	H100	$0.66272270
2026-09-07 19:00:00Z	Memory	$0.00018205
2026-09-07 19:00:00Z	CPU	$0.00026909
2026-09-07 19:00:00Z	H100	$0.00561784

30Step study · wave 1$24.0231

Six workers: 2-step and 8-step rollout across three seeds. Three completed; three resumed later.

Metered total: $24.02308630
Charged resources: Memory: $0.7206 · CPU: $1.0651 · H100: $22.2373
App created: 2026-09-07 19:05:08 UTC
App stopped: 2026-09-07 20:03:48 UTC

App lifespan: 58.7 minutes. This includes non-GPU time and is not allocated GPU duration.

Individual workers · one GPU requested per model
Seed / branch	Calls before → after	Execution cap	Reported function time	Outcome
0 / rollout2	0 → 24,000	3600s	3216.7s	matched budget complete
0 / rollout8	0 → 24,000	3600s	3264.4s	matched budget complete
1 / rollout2	0 → 24,000	3600s	3266.9s	matched budget complete
1 / rollout8	0 → 23,832	3600s	3479.2s	segment budget exhausted
2 / rollout2	0 → 20,304	3600s	3483.5s	segment budget exhausted
2 / rollout8	0 → 23,664	3600s	3478.8s	segment budget exhausted

Retained configuration and timing fields
max containers	6
timeout seconds	3600
startup timeout seconds	120
retries	0

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 19:00:00Z	Memory	$0.69795986
2026-09-07 19:00:00Z	CPU	$1.03167191
2026-09-07 19:00:00Z	H100	$21.53860494
2026-09-07 20:00:00Z	Memory	$0.02264266
2026-09-07 20:00:00Z	CPU	$0.03346868
2026-09-07 20:00:00Z	H100	$0.69873825

31Step study · wave 2$25.0689

Six workers: ordinary and 4-step controls. Two provider timeouts; all six resumed from durable checkpoints.

Metered total: $25.06891159
Charged resources: Memory: $0.7520 · CPU: $1.1115 · H100: $23.2054
App created: 2026-09-07 20:04:51 UTC
App stopped: 2026-09-07 21:07:12 UTC

App lifespan: 62.4 minutes. This includes non-GPU time and is not allocated GPU duration.

Individual workers · one GPU requested per model
Seed / branch	Calls before → after	Execution cap	Reported function time	Outcome
0 / bridge	0 → 23,082	3600s	3491.0s	segment budget exhausted
0 / rollout4	0 → 19,932	3600s	3488.9s	segment budget exhausted
1 / bridge	0 → 22,482	3600s	3510.3s	segment budget exhausted
1 / rollout4	0 → 22,796	3600s	3483.2s	segment budget exhausted
2 / bridge	0 → receipt unavailable	3600s	Not returned	Provider timeout; durable checkpoint used in wave 3.
2 / rollout4	0 → receipt unavailable	3600s	Not returned	Provider timeout; durable checkpoint used in wave 3.

Retained configuration and timing fields
max containers	6
timeout seconds	3600
startup timeout seconds	120
retries	0

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 20:00:00Z	Memory	$0.69434259
2026-09-07 20:00:00Z	CPU	$1.02632514
2026-09-07 20:00:00Z	H100	$21.42697840
2026-09-07 21:00:00Z	Memory	$0.05763076
2026-09-07 21:00:00Z	CPU	$0.08518547
2026-09-07 21:00:00Z	H100	$1.77844922

32Step study · wave 3$6.4473

Six resumed workers, including both verified timeout recoveries. All six reached 24,000 additional calls.

Metered total: $6.44730771
Charged resources: Memory: $0.1934 · CPU: $0.2859 · H100: $5.9681
App created: 2026-09-07 21:13:10 UTC
App stopped: 2026-09-07 21:42:05 UTC

App lifespan: 28.9 minutes. This includes non-GPU time and is not allocated GPU duration.

Individual workers · one GPU requested per model
Seed / branch	Calls before → after	Execution cap	Reported function time	Outcome
2 / bridge	12,000 → 24,000	3600s	1693.8s	matched budget complete
2 / rollout4	12,808 → 24,000	3600s	1670.9s	matched budget complete
0 / rollout4	19,932 → 24,000	1800s	620.5s	matched budget complete
2 / rollout2	20,304 → 24,000	1800s	664.7s	matched budget complete
1 / bridge	22,482 → 24,000	1200s	372.4s	matched budget complete
1 / rollout4	22,796 → 24,000	1200s	321.7s	matched budget complete

Retained configuration and timing fields
max containers	6
timeout seconds	3600
startup timeout seconds	120
retries	0

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 21:00:00Z	Memory	$0.19339506
2026-09-07 21:00:00Z	CPU	$0.28586207
2026-09-07 21:00:00Z	H100	$5.96805059

33Step study · wave 4$0.7939

Three residual completions. All twelve study models now complete.

Metered total: $0.79386250
Charged resources: Memory: $0.0238 · CPU: $0.0352 · H100: $0.7349
App created: 2026-09-07 21:42:58 UTC
App stopped: 2026-09-07 21:47:57 UTC

App lifespan: 5.0 minutes. This includes non-GPU time and is not allocated GPU duration.

Individual workers · one GPU requested per model
Seed / branch	Calls before → after	Execution cap	Reported function time	Outcome
0 / bridge	23,082 → 24,000	1200s	270.3s	matched budget complete
1 / rollout8	23,832 → 24,000	1200s	153.8s	matched budget complete
2 / rollout8	23,664 → 24,000	1200s	201.1s	matched budget complete

Retained configuration and timing fields
max containers	3
timeout seconds	3600
execution seconds	1200
startup timeout seconds	120
retries	0

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 21:00:00Z	Memory	$0.02381290
2026-09-07 21:00:00Z	CPU	$0.03519844
2026-09-07 21:00:00Z	H100	$0.73485116

34Step study · final evaluation$1.0750

63 evaluations and 12 model exports completed. A later client download failed; recovered read-only without another GPU run.

Metered total: $1.07499632
Charged resources: Memory: $0.0322 · CPU: $0.0477 · H100: $0.9951
App created: 2026-09-07 21:49:05 UTC
App stopped: 2026-09-07 21:56:23 UTC

App lifespan: 7.3 minutes. This includes non-GPU time and is not allocated GPU duration.

Retained configuration and timing fields
max containers	3
timeout seconds	1800
startup timeout seconds	120
retries	0
seed 0 evaluation reported function seconds	302.389034057
seed 1 evaluation reported function seconds	289.64900080800004
seed 2 evaluation reported function seconds	281.044859598

Hourly resource charges

UTC hour beginning	Resource	Metered USD
2026-09-07 21:00:00Z	Memory	$0.03224586
2026-09-07 21:00:00Z	CPU	$0.04766341
2026-09-07 21:00:00Z	H100	$0.99508705