AWS CodeBuild runner benchmark.
402 of 416 jobs finished across every suite, 14 failed (TypeScript).
- TypeScript is borderline at 8 GB or less: AWS CodeBuild's medium and small ran out of memory; Blacksmith and boat never ran out; Avrea, GitHub, Namespace, RunsOn, Ubicloud and Warpbuild ran out on some runs; 16 GB passes everywhere.
- Measured swap at 8 GB or less: Avrea has 3 GiB, Blacksmith 11 GiB, boat 6 GiB, GitHub 3 GiB, RunsOn 7.6 GiB, Ubicloud 4 GiB and Warpbuild 4 GiB; AWS CodeBuild and Namespace have none.
Fastest variant per build, any size
Variants
Fastest firstCheapest first; × against AWS CodeBuild's fastest variant with 3 runs; cost per build, on the whole job's time.
Bar shades, light to dark, in execution order: setup = checkout + packages + toolchaincargo fmtcargo testclippy
Bar shades, light to dark, in execution order: toolchainclonebun installtypecheck
Bar shades, light to dark, in execution order: fetch sourcebuildx setupdocker build
Fixed costs not in cost per build
- On-demand no feeS3, CloudWatch Logs and data transfer billed separately
100 free build minutes a month on general1.small or arm1.small (AWS Free Tier). Checked 2026-09-30
Over timeone point per run · since Sep 30
Loading every run…