self-host →

AWS CodeBuild runner benchmark.

self-hosted · your AWS account jobs ran from Amazon.com (US) in Virginia, US 3 variants 2–8 vCPU x64 AWS CodeBuild pricing

272 of 282 jobs finished across every suite, 10 failed (TypeScript).

  • TypeScript is borderline at 8 GB or less: AWS CodeBuild's medium and small ran out of memory; Blacksmith and Warpbuild never ran out; GitHub, Namespace, RunsOn and Ubicloud ran out on some runs; 16 GB passes everywhere.
  • Measured swap at 8 GB or less: Blacksmith 2 vCPU has 11 GiB, GitHub 2 vCPU 3 GiB, RunsOn 2 vCPU 7.6 GiB, Ubicloud 2 vCPU 4 GiB and Warpbuild 2 vCPU 4 GiB; AWS CodeBuild 4 vCPU and Namespace 2 vCPU have none.

Variants

Fastest firstCheapest first; × against AWS CodeBuild's fastest variant with 3 runs; cost per build, on the whole job's time.

Build
  1. large8 vCPU · 16 GBEBS · 4 runs3m 00s, cost per build $0.0642; phases: setup 44s, cargo test 1m 29s, clippy 51s, ×1.00
  2. medium4 vCPU · 8 GBEBS · 4 runs4m 42s, cost per build $0.0500; phases: setup 45s, cargo test 2m 33s, clippy 1m 25s, ×1.57
  3. small2 vCPU · 3 GBEBS · 4 runs8m 19s, cost per build $0.0430; phases: setup 45s, cargo fmt 1s, cargo test 5m 00s, clippy 2m 35s, ×2.78
  1. large8 vCPU · 16 GBEBS · 5 runs1m 17s, cost per build $0.0370; phases: toolchain 3s, clone 2s, bun install 24s, typecheck 50s, ×1.00
  2. medium4 vCPU · 8 GBEBSfailed · out of memory
  3. small2 vCPU · 3 GBEBSfailed · out of memory
  1. large8 vCPU · 16 GBEBS · 4 runs13m 41s, cost per build $0.2855; phases: fetch source 15s, buildx setup 8s, docker build 13m 18s, ×1.00
  2. medium4 vCPU · 8 GBEBSn/a · not run: needs more than 8 GB of memory
  3. small2 vCPU · 3 GBEBSn/a · not run: needs more than 8 GB of memory

Bar shades, light to dark, in execution order: setup = checkout + packages + toolchaincargo fmtcargo testclippy

Bar shades, light to dark, in execution order: toolchainclonebun installtypecheck

Bar shades, light to dark, in execution order: fetch sourcebuildx setupdocker build

Fixed costs not in cost per build

  • On-demand no feeS3, CloudWatch Logs and data transfer billed separately

100 free build minutes a month on general1.small or arm1.small (AWS Free Tier). Checked 2026-09-30

Over timeone point per run · since Sep 30

Loading every run…