AWS CodeBuild runner benchmark.
272 of 282 jobs finished across every suite, 10 failed (TypeScript).
- TypeScript is borderline at 8 GB or less: AWS CodeBuild's medium and small ran out of memory; Blacksmith and Warpbuild never ran out; GitHub, Namespace, RunsOn and Ubicloud ran out on some runs; 16 GB passes everywhere.
- Measured swap at 8 GB or less: Blacksmith 2 vCPU has 11 GiB, GitHub 2 vCPU 3 GiB, RunsOn 2 vCPU 7.6 GiB, Ubicloud 2 vCPU 4 GiB and Warpbuild 2 vCPU 4 GiB; AWS CodeBuild 4 vCPU and Namespace 2 vCPU have none.
Fastest variant per build, any size
Variants
Fastest firstCheapest first; × against AWS CodeBuild's fastest variant with 3 runs; cost per build, on the whole job's time.
Build
Bar shades, light to dark, in execution order: setup = checkout + packages + toolchaincargo fmtcargo testclippy
Bar shades, light to dark, in execution order: toolchainclonebun installtypecheck
Bar shades, light to dark, in execution order: fetch sourcebuildx setupdocker build
Fixed costs not in cost per build
- On-demand no feeS3, CloudWatch Logs and data transfer billed separately
100 free build minutes a month on general1.small or arm1.small (AWS Free Tier). Checked 2026-09-30
Over timeone point per run · since Sep 30
Loading every run…