GitHub runner benchmark.
641 of 644 jobs finished across every suite, 3 failed (TypeScript).
- TypeScript is borderline at 8 GB or less: GitHub's 2 vCPU (arm64 and x64) ran out of memory, on some runs only; Blacksmith and boat never ran out; Avrea, Namespace, RunsOn, Ubicloud and Warpbuild ran out on some runs; AWS CodeBuild ran out too; 16 GB passes everywhere.
- Measured swap at 8 GB or less: Avrea has 3 GiB, Blacksmith 11 GiB, boat 6 GiB, GitHub 3 GiB, RunsOn 7.6 GiB, Ubicloud 4 GiB and Warpbuild 4 GiB; AWS CodeBuild and Namespace have none.
Fastest variant per build, any size
Fastest variant per build, any size
Variants
Fastest firstCheapest first; × against GitHub's fastest variant with 3 runs; cost per build, on the whole job's time.
Bar shades, light to dark, in execution order: setup = checkout + packages + toolchaincargo fmtcargo testclippy
Bar shades, light to dark, in execution order: toolchainclonebun installtypecheck
Bar shades, light to dark, in execution order: fetch sourcebuildx setupdocker build
Fixed costs not in cost per build
- GitHub Free $0/user/month$12 of included compute a month for private repositories (2,000 minutes on a 2-core Linux runner)
- GitHub Team $4/user/month$18 of included compute a month, which larger runners can draw from too (3,000 minutes on a 2-core Linux runner)
- GitHub Enterprise Cloud $21/user/month$300 of included compute a month, which larger runners can draw from too (50,000 minutes on a 2-core Linux runner)
Every runner here needs a GitHub plan, so its per-user fee is not a cost of GitHub's own runners.
Standard runners are free in public repositories. Larger runners are billed in public repositories too; on Team and Enterprise Cloud they can draw from the plan's included compute. Checked 2026-11-05
Over timeone point per run · since Sep 30
Loading every run…