quickstart →

GitHub runner benchmark.

GitHub-hosted · Azure jobs ran from Microsoft (US, CA, MX) in Iowa, US; Virginia, US +9 more 5 variants 2–8 vCPU x64, arm64 GitHub pricing

641 of 644 jobs finished across every suite, 3 failed (TypeScript).

  • TypeScript is borderline at 8 GB or less: GitHub's 2 vCPU (arm64 and x64) ran out of memory, on some runs only; Blacksmith and boat never ran out; Avrea, Namespace, RunsOn, Ubicloud and Warpbuild ran out on some runs; AWS CodeBuild ran out too; 16 GB passes everywhere.
  • Measured swap at 8 GB or less: Avrea has 3 GiB, Blacksmith 11 GiB, boat 6 GiB, GitHub 3 GiB, RunsOn 7.6 GiB, Ubicloud 4 GiB and Warpbuild 4 GiB; AWS CodeBuild and Namespace have none.

Variants

Fastest firstCheapest first; × against GitHub's fastest variant with 3 runs; cost per build, on the whole job's time.

  1. GitHub8 vCPU · 32 GBVM disk · 8 runs2m 10s, cost per build $0.0510; phases: setup 27s, cargo test 1m 09s, clippy 40s, ×1.00
  2. GitHub4 vCPU · 16 GBnetwork disk · 8 runs3m 38s, cost per build $0.0457; phases: setup 21s, cargo test 2m 08s, clippy 1m 11s, ×1.68
  3. GitHub2 vCPU · 8 GBVM disk · 8 runs5m 42s, cost per build $0.0353; phases: setup 23s, cargo test 3m 26s, clippy 1m 51s, ×2.64
  1. GitHub8 vCPU · 32 GBVM disk · 7 runs1m 05s, cost per build $0.0326; phases: toolchain 2s, clone 2s, bun install 20s, typecheck 39s, ×1.00
  2. GitHub4 vCPU · 16 GBnetwork disk · 7 runs1m 44s, cost per build $0.0258; phases: toolchain 1s, clone 2s, bun install 23s, typecheck 1m 11s, ×1.60
  3. GitHub2 vCPU · 8 GBVM disk · 6 runs4m 13s, cost per build $0.0289; phases: toolchain 1s, clone 3s, bun install 33s, typecheck 3m 26s, ×3.89
  1. GitHub8 vCPU · 32 GBVM disk · 8 runs8m 00s, cost per build $0.2150; phases: fetch source 24s, buildx setup 8s, docker build 7m 30s, ×1.00
  2. GitHub4 vCPU · 16 GBnetwork disk · 8 runs12m 30s, cost per build $0.1746; phases: fetch source 24s, buildx setup 9s, docker build 11m 58s, ×1.56
  3. GitHub2 vCPU · 8 GBVM diskn/a · not run: needs more than 8 GB of memory
  1. GitHub4 vCPU · 16 GBnetwork disk · 8 runs3m 14s, cost per build $0.0269; phases: setup 22s, cargo test 1m 54s, clippy 59s, ×1.00
  2. GitHub2 vCPU · 8 GBVM disk · 8 runs5m 30s, cost per build $0.0285; phases: setup 26s, cargo test 3m 18s, clippy 1m 42s, ×1.71
  1. GitHub4 vCPU · 16 GBnetwork disk · 7 runs1m 26s, cost per build $0.0137; phases: toolchain 1s, clone 2s, bun install 25s, typecheck 58s, ×1.00
  2. GitHub2 vCPU · 8 GBVM disk · 5 runs3m 12s, cost per build $0.0176; phases: toolchain 1s, clone 3s, bun install 38s, typecheck 2m 30s, ×2.23
  1. GitHub4 vCPU · 16 GBnetwork disk · 8 runs10m 06s, cost per build $0.0921; phases: fetch source 22s, buildx setup 9s, docker build 9m 36s, ×1.00
  2. GitHub2 vCPU · 8 GBVM diskn/a · not run: needs more than 8 GB of memory

Bar shades, light to dark, in execution order: setup = checkout + packages + toolchaincargo fmtcargo testclippy

Bar shades, light to dark, in execution order: toolchainclonebun installtypecheck

Bar shades, light to dark, in execution order: fetch sourcebuildx setupdocker build

Fixed costs not in cost per build

  • GitHub Free $0/user/month$12 of included compute a month for private repositories (2,000 minutes on a 2-core Linux runner)
  • GitHub Team $4/user/month$18 of included compute a month, which larger runners can draw from too (3,000 minutes on a 2-core Linux runner)
  • GitHub Enterprise Cloud $21/user/month$300 of included compute a month, which larger runners can draw from too (50,000 minutes on a 2-core Linux runner)

Every runner here needs a GitHub plan, so its per-user fee is not a cost of GitHub's own runners.

Standard runners are free in public repositories. Larger runners are billed in public repositories too; on Team and Enterprise Cloud they can draw from the plan's included compute. Checked 2026-11-05

Over timeone point per run · since Sep 30

Loading every run…