self-host →

Ubicloud runner benchmark.

SaaS · Hetzner / Leaseweb (Germany) jobs ran from Hetzner Online (DE) and Leaseweb Deutschland (DE) in Saxony, DE; Hesse, DE 9 variants 2–8 vCPU x64, arm64 Ubicloud pricing

880 of 885 jobs finished across every suite, 5 failed (TypeScript 3, Cache 2).

  • TypeScript is borderline at 8 GB or less: Ubicloud's standard ran out of memory, on some runs only; Blacksmith and Warpbuild never ran out; GitHub, Namespace and RunsOn ran out on some runs; AWS CodeBuild ran out too; 16 GB passes everywhere.
  • Measured swap at 8 GB or less: Blacksmith 2 vCPU has 11 GiB, GitHub 2 vCPU 3 GiB, RunsOn 2 vCPU 7.6 GiB, Ubicloud 2 vCPU 4 GiB and Warpbuild 2 vCPU 4 GiB; AWS CodeBuild 4 vCPU and Namespace 2 vCPU have none.
Arch

Variants

Fastest firstCheapest first; × against Ubicloud's fastest variant with 3 runs; cost per build, on the whole job's time.

Build
  1. premium8 vCPU · 32 GBVM disk · 5 runs1m 41s, cost per build $0.0148; phases: setup 20s, cargo test 51s, clippy 29s, ×1.00
  2. standard8 vCPU · 32 GBVM disk · 5 runs2m 00s, cost per build $0.0112; phases: setup 25s, cargo test 58s, clippy 36s, ×1.19
  3. premium4 vCPU · 16 GBVM disk · 5 runs2m 38s, cost per build $0.0114; phases: setup 23s, cargo test 1m 24s, clippy 51s, ×1.56
  4. standard4 vCPU · 16 GBVM disk · 5 runs3m 25s, cost per build $0.0091; phases: setup 28s, cargo test 1m 39s, clippy 47s, ×2.03
  5. standard2 vCPU · 8 GBVM disk · 5 runs3m 58s, cost per build $0.0052; phases: setup 23s, cargo test 2m 21s, clippy 1m 14s, ×2.36
  6. premium2 vCPU · 8 GBVM disk · 5 runs4m 33s, cost per build $0.0096; phases: setup 26s, cargo test 2m 31s, clippy 1m 08s, ×2.70
  1. premium8 vCPU · 32 GBVM disk · 5 runs45s, cost per build $0.0079; phases: toolchain 3s, clone 4s, bun install 13s, typecheck 26s, ×1.00
  2. standard8 vCPU · 32 GBVM disk · 5 runs1m 10s, cost per build $0.0076; phases: toolchain 3s, clone 4s, bun install 18s, typecheck 40s, ×1.56
  3. standard4 vCPU · 16 GBVM disk · 5 runs1m 29s, cost per build $0.0043; phases: toolchain 1s, clone 5s, bun install 20s, typecheck 1m 04s, ×1.98
  4. premium4 vCPU · 16 GBVM disk · 5 runs1m 36s, cost per build $0.0075; phases: toolchain 2s, clone 5s, bun install 22s, typecheck 1m 02s, ×2.13
  5. premium2 vCPU · 8 GBVM disk · 5 runs2m 28s, cost per build $0.0056; phases: toolchain 1s, clone 4s, bun install 31s, typecheck 1m 53s, ×3.29
  6. standard2 vCPU · 8 GBVM disk · 5 runs2m 57s, cost per build $0.0041; phases: toolchain 7s, clone 9s, bun install 31s, typecheck 2m 01s, ×3.93
  1. premium8 vCPU · 32 GBVM disk · 5 runs7m 09s, cost per build $0.0615; phases: fetch source 28s, buildx setup 9s, docker build 6m 24s, ×1.00
  2. standard8 vCPU · 32 GBVM disk · 5 runs7m 16s, cost per build $0.0393; phases: fetch source 24s, buildx setup 8s, docker build 6m 47s, ×1.02
  3. premium4 vCPU · 16 GBVM disk · 5 runs10m 35s, cost per build $0.0447; phases: fetch source 25s, buildx setup 12s, docker build 10m 12s, ×1.48
  4. standard4 vCPU · 16 GBVM disk · 5 runs11m 24s, cost per build $0.0300; phases: fetch source 22s, buildx setup 10s, docker build 10m 58s, ×1.59
  5. standard2 vCPU · 8 GBVM diskn/a · not run: needs more than 8 GB of memory
  6. premium2 vCPU · 8 GBVM diskn/a · not run: needs more than 8 GB of memory
  1. standard8 vCPU · 32 GBVM disk · 5 runs3m 14s, cost per build $0.0173; phases: setup 33s, cargo test 1m 46s, clippy 56s, ×1.00
  2. standard4 vCPU · 16 GBVM disk · 5 runs5m 34s, cost per build $0.0145; phases: setup 34s, cargo test 3m 18s, clippy 1m 39s, ×1.72
  3. standard2 vCPU · 8 GBVM disk · 5 runs8m 42s, cost per build $0.0112; phases: setup 34s, cargo test 5m 26s, clippy 2m 41s, ×2.69
  1. standard8 vCPU · 32 GBVM disk · 5 runs1m 17s, cost per build $0.0080; phases: toolchain 1s, clone 4s, bun install 24s, typecheck 48s, ×1.00
  2. standard4 vCPU · 16 GBVM disk · 5 runs2m 04s, cost per build $0.0060; phases: toolchain 2s, clone 5s, bun install 25s, typecheck 1m 28s, ×1.61
  3. standard2 vCPU · 8 GBVM disk5m 29s, cost per build $0.0074; phases: toolchain 2s, clone 5s, bun install 56s, typecheck 4m 27s, 2 runs
  1. standard8 vCPU · 32 GBVM disk · 5 runs10m 14s, cost per build $0.0541; phases: fetch source 24s, buildx setup 12s, docker build 9m 44s, ×1.00
  2. standard4 vCPU · 16 GBVM disk · 5 runs15m 17s, cost per build $0.0399; phases: fetch source 23s, buildx setup 10s, docker build 14m 47s, ×1.49
  3. standard2 vCPU · 8 GBVM diskn/a · not run: needs more than 8 GB of memory

Bar shades, light to dark, in execution order: setup = checkout + packages + toolchaincargo fmtcargo testclippy

Bar shades, light to dark, in execution order: toolchainclonebun installtypecheck

Bar shades, light to dark, in execution order: fetch sourcebuildx setupdocker build

Fixed costs not in cost per build

  • Pay as you go no fee

$2.50 of free credit a month per account. Checked 2026-09-30

Over timeone point per run · since Sep 30

Loading every run…