GitHub Actions runner benchmarks
9 providers, 94 runners, the same jobs on each: price, real builds, CPU, network, disk and cache. AWS CodeBuild and RunsOn run in your own AWS account; the others run your jobs on theirs. Run by RunsOn from an open harness, last on 15 Nov 2026. Where another runner is faster, it says so.
Scorecard
Scorecardevery provider, every categoryx64 · 2 vCPU Share Save image
RunsOn tmpfs leads on build cost, network and cache; Namespace on CPU and disk; Avrea on build time; boat on price.
| Provider | Runs in | Price per minute ↓ lower | Build cost Rust + TypeScript ↓ lower | Build time Rust + TypeScript ↓ lower | CPU PassMark single-thread ↑ higher | Network download from GitHub ↑ higher | Disk random reads per second ↑ higher | Cache 4 GB restore ↓ lower |
|---|---|---|---|---|---|---|---|---|
| RunsOn | your AWS account | $0.00082 | $0.00522 | 5m 19s3 | 4,2383 | 225 MiB/s2 | 12,4195 | 17s4 |
| RunsOntmpfs | your AWS account | $0.00093 | $0.00491 | 5m 04s2 | 3,7896 | 265 MiB/s1 | workspace in RAM, no disk | 7s1 |
| Avrea | vendor's cloud | $0.00405 | $0.01534 | 3m 50s1 | 4,3202 | 98 MiB/s7 | 53,0183 | 13s3 |
| Blacksmith | vendor's cloud | $0.00406 | $0.02525 | 6m 19s4 | 3,8545 | 99 MiB/s6 | 73,7792 | 10s2 |
| Namespace | vendor's cloud | $0.006010 | TypeScript: failed · out of memory | TypeScript: failed · out of memory | 4,5471 | 151 MiB/s4 | 104,6751 | 22s5 |
| Warpbuild | vendor's cloud | $0.00407 | $0.02726 | 6m 48s5 | 3,9824 | 105 MiB/s5 | 51,5934 | 28s6 |
| Ubicloud | vendor's cloud | $0.00134 | $0.01263 | 7m 59s6 | 2,7128 | 46 MiB/s9 | 6,8287 | 57s8 |
| boat | vendor's cloud | $0.00031 | $0.0034 | 11m 20s | 3,6107 | 42 MiB/s10 | 10,6636 | 1m 21s |
| AWS CodeBuild | your AWS account | $0.00508 | TypeScript: failed · out of memory | TypeScript: failed · out of memory | 2,5839 | 160 MiB/s3 | 1,7629 | 52s7 |
| GitHub | GitHub's cloud | $0.00609 | $0.06397 | 10m 39s7 | 2,29610 | 66 MiB/s8 | 6,3958 | 1m 01s9 |
| NamespaceApple silicon | vendor's cloud | arm64 only | Rust: arm64 only | Rust: arm64 only | arm64 only | arm64 only | arm64 only | arm64 only |
| WarpbuildApple silicon | vendor's cloud | arm64 only | Rust: arm64 only | Rust: arm64 only | arm64 only | arm64 only | arm64 only | arm64 only |
Each figure is the row's best machine of this size for that column, named in the panel below; the small number is its place. Yellow marks a column's leader, ties within 5% included; rose marks a figure 2 times worse than the column's median or more, RunsOn's included. Build cost and time add up Rust + TypeScript (the builds two providers or more finished at this size); RunsOn is priced at EC2 spot, licenses and plan fees are flat and not in a per-minute figure. Runners of another kind have a row and a place of their own: Apple silicon machines, and RunsOn's large-memory instances with the workspace in RAM (tmpfs). A faded figure takes no place: under 3 runs, or a machine of another size. Runs in: your own AWS account your own AWS account (AWS CodeBuild and RunsOn), so jobs, code and secrets never leave it; the provider's cloud the provider's cloud. Rows are in order of average place across the columns: an order, not a score.
Scorecardevery provider, every categoryx64 · 4 vCPU Share Save image
RunsOn tmpfs leads on build cost and cache; Namespace on build time, CPU and disk; AWS CodeBuild on network; boat on price.
| Provider | Runs in | Price per minute ↓ lower | Build cost all 3 builds ↓ lower | Build time all 3 builds ↓ lower | CPU PassMark single-thread ↑ higher | Network download from GitHub ↑ higher | Disk random reads per second ↑ higher | Cache 4 GB restore ↓ lower |
|---|---|---|---|---|---|---|---|---|
| Avrea | vendor's cloud | $0.00805 | $0.06314 | 7m 53s2 | 4,3672 | 163 MiB/s4 | 49,9553 | 11s2 |
| RunsOn | your AWS account | $0.00122 | $0.04982 | 10m 56s5 | 4,2543 | 171 MiB/s3 | 11,1925 | 16s4 |
| RunsOntmpfs | your AWS account | $0.00163 | $0.01451 | 8m 22s3 | 3,8057 | 173 MiB/s2 | workspace in RAM, no disk | 5s1 |
| Namespace | vendor's cloud | $0.012010 | $0.08166 | 7m 41s1 | 4,4241 | 158 MiB/s5 | 105,7441 | 18s5 |
| Blacksmith | vendor's cloud | $0.00806 | $0.07695 | 9m 37s4 | 3,8376 | 76 MiB/s8 | 71,7282 | 11s3 |
| Warpbuild | vendor's cloud | $0.00807 | $0.08977 | 11m 13s6 | 4,0694 | 100 MiB/s6 | 47,4234 | 21s6 |
| Ubicloud | vendor's cloud | $0.00254 | $0.05533 | 15m 31s7 | 2,8458 | 48 MiB/s9 | 7,7757 | 55s9 |
| boat | vendor's cloud | $0.00061 | Docker: not run: needs more than 8 GB of memory | Docker: not run: needs more than 8 GB of memory | 3,9325 | 41 MiB/s10 | 8,8146 | 2m 15s |
| AWS CodeBuild | your AWS account | $0.01008 | TypeScript: failed · out of memory | TypeScript: failed · out of memory | 2,6029 | 197 MiB/s1 | 1,7969 | 36s7 |
| GitHub | GitHub's cloud | $0.01209 | $0.24608 | 20m 30s8 | 2,36210 | 95 MiB/s7 | 7,2868 | 41s8 |
| NamespaceApple silicon | vendor's cloud | arm64 only | Rust: arm64 only | Rust: arm64 only | arm64 only | arm64 only | arm64 only | arm64 only |
| WarpbuildApple silicon | vendor's cloud | arm64 only | Rust: arm64 only | Rust: arm64 only | arm64 only | arm64 only | arm64 only | arm64 only |
Each figure is the row's best machine of this size for that column, named in the panel below; the small number is its place. Yellow marks a column's leader, ties within 5% included; rose marks a figure 2 times worse than the column's median or more, RunsOn's included. Build cost and time add up all 3 builds; RunsOn is priced at EC2 spot, licenses and plan fees are flat and not in a per-minute figure. Runners of another kind have a row and a place of their own: Apple silicon machines, and RunsOn's large-memory instances with the workspace in RAM (tmpfs). A faded figure takes no place: under 3 runs, or a machine of another size. Runs in: your own AWS account your own AWS account (AWS CodeBuild and RunsOn), so jobs, code and secrets never leave it; the provider's cloud the provider's cloud. Rows are in order of average place across the columns: an order, not a score.
Scorecardevery provider, every categoryx64 · 8 vCPU Share Save image
RunsOn tmpfs leads on network and cache; Namespace on build time, CPU and disk; boat on price and build cost.
| Provider | Runs in | Price per minute ↓ lower | Build cost all 3 builds ↓ lower | Build time all 3 builds ↓ lower | CPU PassMark single-thread ↑ higher | Network download from GitHub ↑ higher | Disk random reads per second ↑ higher | Cache 4 GB restore ↓ lower |
|---|---|---|---|---|---|---|---|---|
| Avrea | vendor's cloud | $0.01605 | $0.09446 | 5m 54s2 | 4,4392 | 142 MiB/s4 | 52,3833 | 11s3 |
| RunsOntmpfs | your AWS account | $0.00273 | $0.01982 | 6m 13s3 | 3,8005 | 184 MiB/s1 | workspace in RAM, no disk | 5s1 |
| Namespace | vendor's cloud | $0.024010 | $0.07664 | 5m 46s1 | 4,5591 | 137 MiB/s5 | 106,1911 | 17s5 |
| RunsOn | your AWS account | $0.00252 | $0.03563 | 7m 17s5 | 3,7976 | 160 MiB/s3 | 11,5845 | 11s4 |
| Blacksmith | vendor's cloud | $0.01606 | $0.10137 | 6m 20s4 | 3,8014 | 105 MiB/s8 | 70,7032 | 10s2 |
| Warpbuild | vendor's cloud | $0.01607 | $0.12518 | 7m 49s6 | 4,1273 | 107 MiB/s7 | 38,6844 | 25s6 |
| boat | vendor's cloud | $0.00121 | $0.01551 | 12m 57s8 | 3,4218 | 73 MiB/s9 | 8,1817 | 1m 11s10 |
| Ubicloud | vendor's cloud | $0.00504 | $0.08585 | 10m 44s7 | 3,5247 | 42 MiB/s10 | 8,6386 | 55s9 |
| AWS CodeBuild | your AWS account | $0.02008 | $0.342710 | 17m 08s10 | 2,5979 | 166 MiB/s2 | 1,7589 | 35s8 |
| GitHub | GitHub's cloud | $0.02209 | $0.30149 | 13m 42s9 | 2,37410 | 115 MiB/s6 | 7,5298 | 33s7 |
| NamespaceApple silicon | vendor's cloud | arm64 only | Rust: arm64 only | Rust: arm64 only | arm64 only | arm64 only | arm64 only | arm64 only |
| WarpbuildApple silicon | vendor's cloud | arm64 only | Rust: arm64 only | Rust: arm64 only | arm64 only | arm64 only | arm64 only | arm64 only |
Each figure is the row's best machine of this size for that column, named in the panel below; the small number is its place. Yellow marks a column's leader, ties within 5% included; rose marks a figure 2 times worse than the column's median or more, RunsOn's included. Build cost and time add up all 3 builds; RunsOn is priced at EC2 spot, licenses and plan fees are flat and not in a per-minute figure. Runners of another kind have a row and a place of their own: Apple silicon machines, and RunsOn's large-memory instances with the workspace in RAM (tmpfs). A faded figure takes no place: under 3 runs, or a machine of another size. Runs in: your own AWS account your own AWS account (AWS CodeBuild and RunsOn), so jobs, code and secrets never leave it; the provider's cloud the provider's cloud. Rows are in order of average place across the columns: an order, not a score.
Scorecardevery provider, every categoryarm64 · 2 vCPU Share Save image
RunsOn leads on price and build cost; RunsOn tmpfs on network and cache; Avrea on build time and CPU; Blacksmith on disk.
| Provider | Runs in | Price per minute ↓ lower | Build cost Rust + TypeScript ↓ lower | Build time Rust + TypeScript ↓ lower | CPU PassMark single-thread ↑ higher | Network download from GitHub ↑ higher | Disk random reads per second ↑ higher | Cache 4 GB restore ↓ lower |
|---|---|---|---|---|---|---|---|---|
| RunsOn | your AWS account | $0.00071 | $0.00451 | 5m 05s3 | 2,4743 | 201 MiB/s2 | 13,5175 | 19s3 |
| RunsOntmpfs | your AWS account | $0.00092 | $0.00562 | 4m 55s2 | 2,4674 | 269 MiB/s1 | workspace in RAM, no disk | 8s1 |
| Avrea | vendor's cloud | $0.01208 | $0.04105 | 3m 25s1 | 4,6621 | 139 MiB/s5 | 20,9052 | 12s2 |
| Blacksmith | vendor's cloud | $0.00254 | $0.03034 | 12m 08s6 | 1,3287 | 88 MiB/s8 | 29,9681 | 24s4 |
| Warpbuild | vendor's cloud | $0.00305 | $0.02613 | 8m 42s4 | 1,9395 | 167 MiB/s4 | 1,7938 | 29s6 |
| NamespaceApple silicon | vendor's cloud | $0.04209 | TypeScript: failed · out of memory | TypeScript: failed · out of memory | 4,1552 | 168 MiB/s3 | 19,8933 | 25s5 |
| GitHub | GitHub's cloud | $0.00506 | $0.04526 | 9m 03s5 | 1,8696 | 93 MiB/s7 | 7,9947 | 53s8 |
| Namespace | vendor's cloud | $0.00607 | TypeScript: failed · out of memory | TypeScript: failed · out of memory | 1,1419 | 121 MiB/s6 | 15,9104 | 42s7 |
| Ubicloud | vendor's cloud | $0.00133 | $0.0193 | 15m 28s | 1,2978 | 63 MiB/s9 | 8,1496 | 1m 02s9 |
| AWS CodeBuild | your AWS account | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner |
| boat | vendor's cloud | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner |
| WarpbuildApple silicon | vendor's cloud | no 2 vCPU arm64 runner | no 2 vCPU arm64 runner | no 2 vCPU arm64 runner | no 2 vCPU arm64 runner | no 2 vCPU arm64 runner | no 2 vCPU arm64 runner | no 2 vCPU arm64 runner |
Each figure is the row's best machine of this size for that column, named in the panel below; the small number is its place. Yellow marks a column's leader, ties within 5% included; rose marks a figure 2 times worse than the column's median or more, RunsOn's included. Build cost and time add up Rust + TypeScript (the builds two providers or more finished at this size); RunsOn is priced at EC2 spot, licenses and plan fees are flat and not in a per-minute figure. Runners of another kind have a row and a place of their own: Apple silicon machines, and RunsOn's large-memory instances with the workspace in RAM (tmpfs). A faded figure takes no place: under 3 runs, or a machine of another size. Runs in: your own AWS account your own AWS account (AWS CodeBuild and RunsOn), so jobs, code and secrets never leave it; the provider's cloud the provider's cloud. Rows are in order of average place across the columns: an order, not a score.
Scorecardevery provider, every categoryarm64 · 4 vCPU Share Save image
RunsOn leads on price, build cost and network; RunsOn tmpfs on cache; Avrea on build time and CPU; Blacksmith on disk.
| Provider | Runs in | Price per minute ↓ lower | Build cost all 3 builds ↓ lower | Build time all 3 builds ↓ lower | CPU PassMark single-thread ↑ higher | Network download from GitHub ↑ higher | Disk random reads per second ↑ higher | Cache 4 GB restore ↓ lower |
|---|---|---|---|---|---|---|---|---|
| RunsOn | your AWS account | $0.00141 | $0.01481 | 9m 52s4 | 2,4713 | 172 MiB/s1 | 13,3755 | 16s3 |
| RunsOntmpfs | your AWS account | $0.00162 | $0.01952 | 8m 49s3 | 2,4674 | 170 MiB/s2 | workspace in RAM, no disk | 5s1 |
| Avrea | vendor's cloud | $0.02408 | $0.17727 | 7m 23s1 | 4,8231 | 83 MiB/s8 | 19,9512 | 11s2 |
| Blacksmith | vendor's cloud | $0.00504 | $0.08724 | 17m 27s7 | 1,3417 | 100 MiB/s7 | 32,7401 | 21s4 |
| NamespaceApple silicon | vendor's cloud | $0.08409 | $0.63919 | 7m 37s2 | 4,5222 | 131 MiB/s4 | 18,7363 | 22s5 |
| Warpbuild | vendor's cloud | $0.00605 | $0.09485 | 15m 48s5 | 1,9405 | 144 MiB/s3 | 1,8068 | 27s6 |
| GitHub | GitHub's cloud | $0.00806 | $0.13206 | 16m 30s6 | 1,8706 | 109 MiB/s6 | 6,8927 | 36s7 |
| Ubicloud | vendor's cloud | $0.00253 | $0.06173 | 24m 42s9 | 1,2868 | 75 MiB/s9 | 8,7056 | 57s9 |
| Namespace | vendor's cloud | $0.01207 | $0.24748 | 23m 33s8 | 1,1659 | 121 MiB/s5 | 16,6344 | 38s8 |
| AWS CodeBuild | your AWS account | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner |
| boat | vendor's cloud | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner |
| WarpbuildApple · 6 vCPU | vendor's cloud | $0.0800 | $0.7647 | 9m 34s | 2,845 | 70 MiB/s | 29,877 | 29s |
Each figure is the row's best machine of this size for that column, named in the panel below; the small number is its place. Yellow marks a column's leader, ties within 5% included; rose marks a figure 2 times worse than the column's median or more, RunsOn's included. Build cost and time add up all 3 builds; RunsOn is priced at EC2 spot, licenses and plan fees are flat and not in a per-minute figure. Runners of another kind have a row and a place of their own: Apple silicon machines, and RunsOn's large-memory instances with the workspace in RAM (tmpfs). A faded figure takes no place: under 3 runs, or a machine of another size. Runs in: your own AWS account your own AWS account (AWS CodeBuild and RunsOn), so jobs, code and secrets never leave it; the provider's cloud the provider's cloud. Rows are in order of average place across the columns: an order, not a score.
Scorecardevery provider, every categoryarm64 · 8 vCPU Share Save image
RunsOn leads on price; RunsOn tmpfs on build cost, network and cache; Avrea on build time and CPU; Blacksmith on disk.
| Provider | Runs in | Price per minute ↓ lower | Build cost all 3 builds ↓ lower | Build time all 3 builds ↓ lower | CPU PassMark single-thread ↑ higher | Network download from GitHub ↑ higher | Disk random reads per second ↑ higher | Cache 4 GB restore ↓ lower |
|---|---|---|---|---|---|---|---|---|
| RunsOntmpfs | your AWS account | $0.00242 | $0.01741 | 6m 42s2 | 2,4703 | 298 MiB/s1 | workspace in RAM, no disk | 5s1 |
| RunsOn | your AWS account | $0.00241 | $0.02382 | 7m 02s3 | 2,4722 | 161 MiB/s3 | 13,4544 | 11s3 |
| Avrea | vendor's cloud | $0.04807 | $0.27527 | 5m 44s1 | 4,8151 | 69 MiB/s6 | 20,7432 | 10s2 |
| Blacksmith | vendor's cloud | $0.01004 | $0.11994 | 12m 00s5 | 1,3445 | 97 MiB/s5 | 29,3121 | 18s4 |
| Warpbuild | vendor's cloud | $0.01205 | $0.12285 | 10m 14s4 | 1,9404 | 189 MiB/s2 | 1,7976 | 21s5 |
| Namespace | vendor's cloud | $0.02406 | $0.20566 | 17m 08s6 | 1,1657 | 125 MiB/s4 | 16,7833 | 32s6 |
| Ubicloud | vendor's cloud | $0.00503 | $0.09053 | 18m 07s7 | 1,3006 | 57 MiB/s7 | 9,3885 | 49s7 |
| AWS CodeBuild | your AWS account | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner |
| boat | vendor's cloud | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner | no arm64 runner |
| GitHub | GitHub's cloud | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner |
| NamespaceApple silicon | vendor's cloud | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner | no 8 vCPU arm64 runner |
| WarpbuildApple · 12 vCPU | vendor's cloud | $0.1600 | $1.27 | 7m 56s | 3,138 | 74 MiB/s | 30,249 | 46s |
Each figure is the row's best machine of this size for that column, named in the panel below; the small number is its place. Yellow marks a column's leader, ties within 5% included; rose marks a figure 2 times worse than the column's median or more, RunsOn's included. Build cost and time add up all 3 builds; RunsOn is priced at EC2 spot, licenses and plan fees are flat and not in a per-minute figure. Runners of another kind have a row and a place of their own: Apple silicon machines, and RunsOn's large-memory instances with the workspace in RAM (tmpfs). A faded figure takes no place: under 3 runs, or a machine of another size. Runs in: your own AWS account your own AWS account (AWS CodeBuild and RunsOn), so jobs, code and secrets never leave it; the provider's cloud the provider's cloud. Rows are in order of average place across the columns: an order, not a score.
Real builds
Real buildstime and cost per buildlower is betterx64 · 2 vCPU Share Save image
Rust cold build of spotify-player: cargo test and clippy
boat is the best value and the cheapest; Avrea is the fastest.
- boat 4 GB 4m 05s $0.0012
- RunsOn m8a.large · EBS gp3 · 8 GB 3m 06s $0.0031
- RunsOntmpfs r8a.large · 16 GB 3m 21s $0.0033
- Avrea 8 GB 2m 24s $0.0096
- Ubicloud standard · 8 GB 4m 31s $0.0056
- Namespace 2x8 · 8 GB 2m 43s $0.0163
- Warpbuild 8 GB 4m 00s $0.0160
- Blacksmith 8 GB 4m 06s $0.0164
- AWS CodeBuild small · 3 GB 6m 51s $0.0342
- GitHub 8 GB 5m 50s $0.0350
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
TypeScript cold bun install and typecheck of opencode
RunsOn is the best value; RunsOn tmpfs is the cheapest; Avrea is the fastest.
- RunsOn m8a.large · EBS gp3 · 8 GB 2m 13s $0.0021
- Avrea 8 GB 1m 26s $0.0057
- RunsOntmpfs r8a.large · 16 GB 1m 43s $0.0017
- Ubicloud premium · 8 GB 3m 28s $0.0069
- Blacksmith 8 GB 2m 13s $0.0088
- Warpbuild 8 GB 2m 48s $0.0112
- GitHub 8 GB 4m 49s $0.0289
- boat 4 GB 7m 15s $0.0022
- AWS CodeBuild failed · out of memory
- Namespace failed · out of memory
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Docker PostHog's production image, built cold with buildx
Only RunsOn finished this build.
- RunsOn r8a.large · EBS gp3 · 16 GB 12m 34s $0.0134
- Avrea not run: needs more than 8 GB of memory
- AWS CodeBuild not run: needs more than 8 GB of memory
- Blacksmith not run: needs more than 8 GB of memory
- boat not run: needs more than 8 GB of memory
- GitHub not run: needs more than 8 GB of memory
- Namespace not run: needs more than 8 GB of memory
- NamespaceApple silicon arm64 only
- RunsOntmpfs not run: needs more than 16 GB of RAM with tmpfs, where Docker's data root lives in RAM
- Ubicloud not run: needs more than 8 GB of memory
- Warpbuild not run: needs more than 8 GB of memory
- WarpbuildApple silicon arm64 only
Each row's best-value machine of this size for that build (lowest time × cost, ranked on p90), in that order, named under the provider. Time is the median whole job, cost is that job at the provider's per-minute price (RunsOn at EC2 spot). Yellow marks the fastest and the cheapest. Apple silicon and tmpfs (workspace in RAM) machines are rows of their own; a faded row is provisional or a machine of another size, and takes no place. A row that did not finish a build stays listed with the reason.
Full build benchmark every phase, p90 and worst runs, queue under a burst, run-to-run spread, bigger runners
Real buildstime and cost per buildlower is betterx64 · 4 vCPU Share Save image
Rust cold build of spotify-player: cargo test and clippy
RunsOn is the best value; boat is the cheapest; Avrea is the fastest.
- RunsOn c8a.xlarge · EBS gp3 · 8 GB 2m 02s $0.0036
- RunsOntmpfs r8a.xlarge · 32 GB 2m 04s $0.0036
- Avrea 16 GB 1m 37s $0.0129
- Namespace 4x8 · 8 GB 1m 46s $0.0106
- Ubicloud standard · 16 GB 2m 38s $0.0066
- boat 8 GB 4m 48s $0.0029
- Warpbuild 16 GB 2m 23s $0.0191
- Blacksmith 16 GB 1m 59s $0.0159
- AWS CodeBuild medium · 8 GB 3m 48s $0.0380
- GitHub 16 GB 3m 48s $0.0456
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
TypeScript cold bun install and typecheck of opencode
boat is the best value and the cheapest; Avrea is the fastest.
- boat 8 GB 1m 36s $0.0010
- RunsOntmpfs r8a.xlarge · 32 GB 1m 03s $0.0021
- Avrea 16 GB 50s $0.0067
- RunsOn m8azn.xlarge · gp3 1000 MiB/s · 16 GB 1m 01s $0.0061
- Ubicloud standard · 16 GB 1m 52s $0.0047
- Namespace 4x16 · 16 GB 53s $0.0106
- Warpbuild 16 GB 1m 21s $0.0108
- Blacksmith 16 GB 1m 45s $0.0139
- GitHub 16 GB 2m 05s $0.0250
- AWS CodeBuild failed · out of memory
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Docker PostHog's production image, built cold with buildx
RunsOn tmpfs is the best value and the cheapest; Namespace is the fastest.
- RunsOntmpfs r8a.xlarge · 32 GB 5m 15s $0.0087
- Avrea 16 GB 5m 26s $0.0435
- RunsOn m8azn.xlarge · gp3 1000 MiB/s · 16 GB 7m 53s $0.0402
- Namespace 4x16 · 16 GB 5m 02s $0.0604
- Blacksmith 16 GB 5m 53s $0.0471
- Warpbuild 16 GB 7m 29s $0.0599
- Ubicloud premium · 16 GB 11m 01s $0.0441
- GitHub 16 GB 14m 37s $0.1754
- AWS CodeBuild not run: needs more than 8 GB of memory
- boat not run: needs more than 8 GB of memory
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Each row's best-value machine of this size for that build (lowest time × cost, ranked on p90), in that order, named under the provider. Time is the median whole job, cost is that job at the provider's per-minute price (RunsOn at EC2 spot). Yellow marks the fastest and the cheapest. Apple silicon and tmpfs (workspace in RAM) machines are rows of their own; a faded row is provisional or a machine of another size, and takes no place. A row that did not finish a build stays listed with the reason.
Full build benchmark every phase, p90 and worst runs, queue under a burst, run-to-run spread, bigger runners
Real buildstime and cost per buildlower is betterx64 · 8 vCPU Share Save image
Rust cold build of spotify-player: cargo test and clippy
RunsOn tmpfs is the best value; boat is the cheapest; Avrea is the fastest.
- RunsOntmpfs m8a.2xlarge · 32 GB 1m 28s $0.0047
- RunsOn m8a.2xlarge · EBS gp3 · 32 GB 1m 28s $0.0046
- Avrea 32 GB 1m 13s $0.0195
- Namespace 8x16 · 16 GB 1m 16s $0.0152
- Ubicloud premium · 32 GB 1m 54s $0.0152
- Warpbuild 32 GB 1m 37s $0.0259
- boat 16 GB 2m 06s $0.0025
- Blacksmith 32 GB 1m 21s $0.0216
- AWS CodeBuild large · 16 GB 2m 28s $0.0493
- GitHub 32 GB 2m 19s $0.0510
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
TypeScript cold bun install and typecheck of opencode
RunsOn tmpfs is the best value; boat is the cheapest; Avrea is the fastest.
- RunsOntmpfs m8a.2xlarge · 32 GB 50s $0.0028
- RunsOn m8a.2xlarge · gp3 1000 MiB/s · 32 GB 49s $0.0048
- boat 16 GB 1m 28s $0.0017
- Avrea 32 GB 37s $0.0099
- Blacksmith 32 GB 52s $0.0139
- Warpbuild 32 GB 55s $0.0147
- Ubicloud premium · 32 GB 1m 12s $0.0095
- Namespace 8x32 · 32 GB 37s $0.0148
- AWS CodeBuild large · 16 GB 1m 41s $0.0337
- GitHub 32 GB 1m 30s $0.0330
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Docker PostHog's production image, built cold with buildx
RunsOn tmpfs is the best value; boat is the cheapest; Namespace is the fastest.
- RunsOntmpfs m8a.2xlarge · 32 GB 3m 55s $0.0123
- Namespace 8x16 · 16 GB 3m 53s $0.0466
- RunsOn m8a.2xlarge · gp3 1000 MiB/s · 32 GB 5m 00s $0.0262
- Avrea 32 GB 4m 04s $0.0651
- boat 16 GB 9m 24s $0.0113
- Blacksmith 32 GB 4m 07s $0.0659
- Ubicloud premium · 32 GB 7m 38s $0.0611
- Warpbuild 32 GB 5m 17s $0.0845
- GitHub 32 GB 9m 53s $0.2174
- AWS CodeBuild large · 16 GB 12m 59s $0.2597
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Each row's best-value machine of this size for that build (lowest time × cost, ranked on p90), in that order, named under the provider. Time is the median whole job, cost is that job at the provider's per-minute price (RunsOn at EC2 spot). Yellow marks the fastest and the cheapest. Apple silicon and tmpfs (workspace in RAM) machines are rows of their own; a faded row is provisional or a machine of another size, and takes no place. A row that did not finish a build stays listed with the reason.
Full build benchmark every phase, p90 and worst runs, queue under a burst, run-to-run spread, bigger runners
Real buildstime and cost per buildlower is betterarm64 · 2 vCPU Share Save image
Rust cold build of spotify-player: cargo test and clippy
RunsOn is the best value and the cheapest; Avrea is the fastest.
- RunsOn m9gd.large · local NVMe · 8 GB 3m 01s $0.0026
- RunsOntmpfs r9g.large · 16 GB 3m 13s $0.0037
- Avrea 8 GB 2m 04s $0.0248
- Warpbuild 8 GB 5m 01s $0.0151
- Ubicloud standard · 8 GB 10m 27s $0.0131
- Blacksmith 6 GB 6m 48s $0.0170
- GitHub 8 GB 5m 41s $0.0284
- NamespaceApple silicon 2x8 · 8 GB 2m 11s $0.0917
- Namespace 2x8 · 8 GB 9m 44s $0.0584
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- WarpbuildApple silicon no 2 vCPU arm64 runner
TypeScript cold bun install and typecheck of opencode
RunsOn is the cheapest; RunsOn tmpfs is the best value; Avrea is the fastest.
- RunsOntmpfs r9g.large · 16 GB 1m 42s $0.0019
- RunsOn m9gd.large · local NVMe · 8 GB 2m 04s $0.0019
- Avrea 8 GB 1m 21s $0.0162
- Warpbuild 8 GB 3m 41s $0.0110
- Blacksmith 6 GB 5m 20s $0.0133
- GitHub 8 GB 3m 22s $0.0168
- Ubicloud standard · 8 GB 5m 01s $0.0063
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- Namespace failed · out of memory
- NamespaceApple silicon failed · out of memory
- WarpbuildApple silicon no 2 vCPU arm64 runner
Docker PostHog's production image, built cold with buildx
No 2 vCPU arm64 runner finished this build.
- Avrea not run: needs more than 8 GB of memory
- AWS CodeBuild no arm64 runner
- Blacksmith not run: needs more than 8 GB of memory
- boat no arm64 runner
- GitHub not run: needs more than 8 GB of memory
- Namespace not run: needs more than 8 GB of memory
- NamespaceApple silicon not run: needs more than 8 GB of memory
- RunsOn not run: needs more than 8 GB of memory
- RunsOntmpfs not run: needs more than 16 GB of RAM with tmpfs, where Docker's data root lives in RAM
- Ubicloud not run: needs more than 8 GB of memory
- Warpbuild not run: needs more than 8 GB of memory
- WarpbuildApple silicon no 2 vCPU arm64 runner
Each row's best-value machine of this size for that build (lowest time × cost, ranked on p90), in that order, named under the provider. Time is the median whole job, cost is that job at the provider's per-minute price (RunsOn at EC2 spot). Yellow marks the fastest and the cheapest. Apple silicon and tmpfs (workspace in RAM) machines are rows of their own; a faded row is provisional or a machine of another size, and takes no place. A row that did not finish a build stays listed with the reason.
Full build benchmark every phase, p90 and worst runs, queue under a burst, run-to-run spread, bigger runners
Real buildstime and cost per buildlower is betterarm64 · 4 vCPU Share Save image
Rust cold build of spotify-player: cargo test and clippy
RunsOn is the best value and the cheapest; Namespace Apple silicon is the fastest.
- RunsOn m9g.xlarge · EBS gp3 · 16 GB 2m 01s $0.0035
- RunsOntmpfs m9g.xlarge · 16 GB 2m 05s $0.0035
- Avrea 16 GB 1m 27s $0.0348
- Warpbuild 16 GB 3m 14s $0.0194
- GitHub 16 GB 3m 18s $0.0264
- Ubicloud standard · 16 GB 6m 07s $0.0153
- Blacksmith 16 GB 4m 13s $0.0211
- NamespaceApple silicon 4x16 · 16 GB 1m 25s $0.1190
- Namespace 4x8 · 8 GB 5m 51s $0.0351
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · 14 GB 1m 28s $0.1173
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
TypeScript cold bun install and typecheck of opencode
RunsOn is the best value and the cheapest; Namespace Apple silicon is the fastest.
- RunsOn m9gd.xlarge · local NVMe · 16 GB 1m 03s $0.0017
- RunsOntmpfs m9g.xlarge · 16 GB 1m 04s $0.0021
- Warpbuild 16 GB 1m 37s $0.0097
- GitHub 16 GB 1m 44s $0.0139
- Blacksmith 16 GB 2m 14s $0.0111
- Avrea 16 GB 49s $0.0196
- Namespace 4x16 · 16 GB 3m 24s $0.0407
- NamespaceApple silicon 4x16 · 16 GB 49s $0.0679
- Ubicloud standard · 16 GB 2m 44s $0.0068
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · 14 GB 58s $0.0767
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
Docker PostHog's production image, built cold with buildx
RunsOn is the best value and the cheapest; Avrea is the fastest.
- RunsOn m9gd.xlarge · local NVMe · 16 GB 6m 48s $0.0097
- RunsOntmpfs r9g.xlarge · 32 GB 5m 40s $0.0139
- Ubicloud standard · 16 GB 15m 51s $0.0396
- Avrea 16 GB 5m 07s $0.1228
- Blacksmith 16 GB 11m 00s $0.0550
- Warpbuild 16 GB 10m 57s $0.0657
- GitHub 16 GB 11m 28s $0.0917
- Namespace 4x16 · 16 GB 14m 18s $0.1716
- NamespaceApple silicon 4x16 · 16 GB 5m 23s $0.4522
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · 14 GB 7m 08s $0.5707
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
Each row's best-value machine of this size for that build (lowest time × cost, ranked on p90), in that order, named under the provider. Time is the median whole job, cost is that job at the provider's per-minute price (RunsOn at EC2 spot). Yellow marks the fastest and the cheapest. Apple silicon and tmpfs (workspace in RAM) machines are rows of their own; a faded row is provisional or a machine of another size, and takes no place. A row that did not finish a build stays listed with the reason.
Full build benchmark every phase, p90 and worst runs, queue under a burst, run-to-run spread, bigger runners
Real buildstime and cost per buildlower is betterarm64 · 8 vCPU Share Save image
Rust cold build of spotify-player: cargo test and clippy
RunsOn is the cheapest; RunsOn tmpfs is the best value; Avrea is the fastest.
- RunsOntmpfs m9g.2xlarge · 32 GB 1m 27s $0.0040
- RunsOn m9g.2xlarge · EBS gp3 · 32 GB 1m 27s $0.0040
- Avrea 32 GB 1m 07s $0.0536
- Warpbuild 32 GB 2m 13s $0.0266
- Ubicloud standard · 32 GB 4m 04s $0.0203
- Blacksmith 32 GB 2m 55s $0.0292
- Namespace 8x16 · 16 GB 4m 08s $0.0496
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · 28 GB 1m 10s $0.1867
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
TypeScript cold bun install and typecheck of opencode
RunsOn tmpfs is the best value and the cheapest; Avrea is the fastest.
- RunsOntmpfs m9g.2xlarge · 32 GB 46s $0.0024
- RunsOn m9gd.2xlarge · local NVMe · 32 GB 44s $0.0031
- Warpbuild 32 GB 1m 03s $0.0126
- Ubicloud standard · 32 GB 1m 51s $0.0092
- Blacksmith 32 GB 1m 26s $0.0143
- Namespace 8x16 · 16 GB 2m 03s $0.0246
- Avrea 32 GB 40s $0.0320
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · 28 GB 47s $0.1240
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
Docker PostHog's production image, built cold with buildx
RunsOn is the best value; RunsOn tmpfs is the cheapest; Avrea is the fastest.
- RunsOn m9gd.2xlarge · local NVMe · 32 GB 4m 51s $0.0167
- RunsOntmpfs m9g.2xlarge · 32 GB 4m 29s $0.0110
- Warpbuild 32 GB 6m 58s $0.0836
- Blacksmith 32 GB 7m 39s $0.0765
- Ubicloud standard · 32 GB 12m 12s $0.0610
- Avrea 32 GB 3m 57s $0.1896
- Namespace 8x16 · 16 GB 10m 57s $0.1314
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · 28 GB 5m 59s $0.9573
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
Each row's best-value machine of this size for that build (lowest time × cost, ranked on p90), in that order, named under the provider. Time is the median whole job, cost is that job at the provider's per-minute price (RunsOn at EC2 spot). Yellow marks the fastest and the cheapest. Apple silicon and tmpfs (workspace in RAM) machines are rows of their own; a faded row is provisional or a machine of another size, and takes no place. A row that did not finish a build stays listed with the reason.
Full build benchmark every phase, p90 and worst runs, queue under a burst, run-to-run spread, bigger runners
CPU
CPUsingle-thread PassMarkhigher is betterx64 · 2 vCPU Share Save image
Namespace has the fastest core.
RunsOn is 3rd of 10, 7% below the leader. Namespace to GitHub: 2.0× apart.
- Namespace 2x8 · 8 GB 4,547
- Avrea 8 GB 4,320
- RunsOn m8azn.large · EBS gp3 · 8 GB 4,238
- Warpbuild 8 GB 3,982
- Blacksmith 8 GB 3,854
- RunsOntmpfs r8a.large · 16 GB 3,789
- boat 4 GB 3,610
- Ubicloud standard · 8 GB 2,712
- AWS CodeBuild small · 3 GB 2,583
- GitHub 8 GB 2,296
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
The figure is the score a runner's jobs reach 9 times out of 10 (p10), so a label that sometimes lands on an older CPU ranks below one that never does. Over the bar: the lowest and the highest job (the line), 9 in 10 to 1 in 10 (the box) and the median (the tick). A long box or line is a CPU lottery. The trend is the daily median, on a scale of at least ±10%, so only a real change shows as a slope.
CPUsingle-thread PassMarkhigher is betterx64 · 4 vCPU Share Save image
RunsOn, Namespace and Avrea tie for the fastest core.
Namespace to GitHub: 1.9× apart.
- Namespace 4x16 · 16 GB 4,424
- Avrea 16 GB 4,367
- RunsOn m8azn.xlarge · gp3 1000 MiB/s · 16 GB 4,254
- Warpbuild 16 GB 4,069
- boat 8 GB 3,932
- Blacksmith 16 GB 3,837
- RunsOntmpfs r8a.xlarge · 32 GB 3,805
- Ubicloud premium · 16 GB 2,845
- AWS CodeBuild medium · 8 GB 2,602
- GitHub 16 GB 2,362
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
The figure is the score a runner's jobs reach 9 times out of 10 (p10), so a label that sometimes lands on an older CPU ranks below one that never does. Over the bar: the lowest and the highest job (the line), 9 in 10 to 1 in 10 (the box) and the median (the tick). A long box or line is a CPU lottery. The trend is the daily median, on a scale of at least ±10%, so only a real change shows as a slope.
CPUsingle-thread PassMarkhigher is betterx64 · 8 vCPU Share Save image
Namespace and Avrea tie for the fastest core.
RunsOn is 6th of 10, 17% below the leader. Namespace to GitHub: 1.9× apart.
- Namespace 8x32 · 32 GB 4,559
- Avrea 32 GB 4,439
- Warpbuild 32 GB 4,127
- Blacksmith 32 GB 3,801
- RunsOntmpfs r8a.2xlarge · 64 GB 3,800
- RunsOn m8a.2xlarge · gp3 1000 MiB/s · 32 GB 3,797
- Ubicloud premium · 32 GB 3,524
- boat 16 GB 3,421
- AWS CodeBuild large · 16 GB 2,597
- GitHub 32 GB 2,374
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
The figure is the score a runner's jobs reach 9 times out of 10 (p10), so a label that sometimes lands on an older CPU ranks below one that never does. Over the bar: the lowest and the highest job (the line), 9 in 10 to 1 in 10 (the box) and the median (the tick). A long box or line is a CPU lottery. The trend is the daily median, on a scale of at least ±10%, so only a real change shows as a slope.
CPUsingle-thread PassMarkhigher is betterarm64 · 2 vCPU Share Save image
Avrea has the fastest core.
RunsOn is 3rd of 9, 47% below the leader. Avrea to Namespace: 4.1× apart.
- Avrea 8 GB 4,662
- NamespaceApple silicon 2x8 · 8 GB 4,155
- RunsOn m9gd.large · local NVMe · 8 GB 2,474
- RunsOntmpfs r9g.large · 16 GB 2,467
- Warpbuild 8 GB 1,939
- GitHub 8 GB 1,869
- Blacksmith 6 GB 1,328
- Ubicloud standard · 8 GB 1,297
- Namespace 2x8 · 8 GB 1,141
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- WarpbuildApple silicon no 2 vCPU arm64 runner
The figure is the score a runner's jobs reach 9 times out of 10 (p10), so a label that sometimes lands on an older CPU ranks below one that never does. Over the bar: the lowest and the highest job (the line), 9 in 10 to 1 in 10 (the box) and the median (the tick). A long box or line is a CPU lottery. The trend is the daily median, on a scale of at least ±10%, so only a real change shows as a slope.
CPUsingle-thread PassMarkhigher is betterarm64 · 4 vCPU Share Save image
Avrea has the fastest core.
RunsOn is 3rd of 9, 49% below the leader. Avrea to Namespace: 4.1× apart.
- Avrea 16 GB 4,823
- NamespaceApple silicon 4x16 · 16 GB 4,522
- RunsOn m9gd.xlarge · local NVMe · 16 GB 2,471
- RunsOntmpfs r9g.xlarge · 32 GB 2,467
- Warpbuild 16 GB 1,940
- GitHub 16 GB 1,870
- Blacksmith 16 GB 1,341
- Ubicloud standard · 16 GB 1,286
- Namespace 4x16 · 16 GB 1,165
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · 14 GB 2,845 not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
The figure is the score a runner's jobs reach 9 times out of 10 (p10), so a label that sometimes lands on an older CPU ranks below one that never does. Over the bar: the lowest and the highest job (the line), 9 in 10 to 1 in 10 (the box) and the median (the tick). A long box or line is a CPU lottery. The trend is the daily median, on a scale of at least ±10%, so only a real change shows as a slope.
CPUsingle-thread PassMarkhigher is betterarm64 · 8 vCPU Share Save image
Avrea has the fastest core.
RunsOn is 2nd of 7, 49% below the leader. Avrea to Namespace: 4.1× apart.
- Avrea 32 GB 4,815
- RunsOn m9g.2xlarge · EBS gp3 · 32 GB 2,472
- RunsOntmpfs m9g.2xlarge · 32 GB 2,470
- Warpbuild 32 GB 1,940
- Blacksmith 32 GB 1,344
- Ubicloud standard · 32 GB 1,300
- Namespace 8x16 · 16 GB 1,165
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · 28 GB 3,138 not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
The figure is the score a runner's jobs reach 9 times out of 10 (p10), so a label that sometimes lands on an older CPU ranks below one that never does. Over the bar: the lowest and the highest job (the line), 9 in 10 to 1 in 10 (the box) and the median (the tick). A long box or line is a CPU lottery. The trend is the daily median, on a scale of at least ±10%, so only a real change shows as a slope.
Price
Priceper minutelower is betterx64 · 2 vCPU Share Save image
boat has the lowest price per minute.
RunsOn is 2nd of 10, the leader is 2.8× lower. boat to Namespace: 20× apart.
- boat 4 GB $0.0003
- RunsOn m8id.large · local NVMe · 8 GB $0.0008 $0.0025 on-demand
- RunsOntmpfs r8a.large · 16 GB $0.0009 $0.0030 on-demand
- Ubicloud standard · 8 GB $0.0013
- Avrea 8 GB $0.0040
- Blacksmith 8 GB $0.0040
- Warpbuild 8 GB $0.0040
- AWS CodeBuild small · 3 GB $0.0050
- GitHub 8 GB $0.0060
- Namespace 2x8 · 8 GB $0.0060
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Pay-as-you-go price of a 2 vCPU runner. RunsOn is the EC2 + EBS bill in your own AWS account, at spot (the bar) and on-demand (the outline); its license is flat, like the other providers' plan fees.
Priceper minutelower is betterx64 · 4 vCPU Share Save image
boat has the lowest price per minute.
RunsOn is 2nd of 10, the leader is 2.1× lower. boat to Namespace: 20× apart.
- boat 8 GB $0.0006
- RunsOn m8i-flex.xlarge · EBS gp3 · 16 GB $0.0012 $0.0037 on-demand
- RunsOntmpfs r8a.xlarge · 32 GB $0.0016 $0.0056 on-demand
- Ubicloud standard · 16 GB $0.0025
- Avrea 16 GB $0.0080
- Blacksmith 16 GB $0.0080
- Warpbuild 16 GB $0.0080
- AWS CodeBuild medium · 8 GB $0.0100
- GitHub 16 GB $0.0120
- Namespace 4x16 · 16 GB $0.0120
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Pay-as-you-go price of a 4 vCPU runner. RunsOn is the EC2 + EBS bill in your own AWS account, at spot (the bar) and on-demand (the outline); its license is flat, like the other providers' plan fees.
Priceper minutelower is betterx64 · 8 vCPU Share Save image
boat has the lowest price per minute.
RunsOn is 2nd of 10, the leader is 2.1× lower. boat to Namespace: 20× apart.
- boat 16 GB $0.0012
- RunsOn m8i-flex.2xlarge · EBS gp3 · 32 GB $0.0025 $0.0070 on-demand
- RunsOntmpfs m8a.2xlarge · 32 GB $0.0027 $0.0084 on-demand
- Ubicloud standard · 32 GB $0.0050
- Avrea 32 GB $0.0160
- Blacksmith 32 GB $0.0160
- Warpbuild 32 GB $0.0160
- AWS CodeBuild large · 16 GB $0.0200
- GitHub 32 GB $0.0220
- Namespace 8x32 · 32 GB $0.0240
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Pay-as-you-go price of a 8 vCPU runner. RunsOn is the EC2 + EBS bill in your own AWS account, at spot (the bar) and on-demand (the outline); its license is flat, like the other providers' plan fees.
Priceper minutelower is betterarm64 · 2 vCPU Share Save image
RunsOn has the lowest price per minute.
RunsOn to Namespace Apple silicon: 57× apart.
- RunsOn m9g.large · EBS gp3 · 8 GB $0.0007 $0.0019 on-demand
- RunsOntmpfs r9g.large · 16 GB $0.0009 $0.0024 on-demand
- Ubicloud standard · 8 GB $0.0013
- Blacksmith 6 GB $0.0025
- Warpbuild 8 GB $0.0030
- GitHub 8 GB $0.0050
- Namespace 2x8 · 8 GB $0.0060
- Avrea 8 GB $0.0120
- NamespaceApple silicon 2x8 · 8 GB $0.0420
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- WarpbuildApple silicon no 2 vCPU arm64 runner
Pay-as-you-go price of a 2 vCPU runner. RunsOn is the EC2 + EBS bill in your own AWS account, at spot (the bar) and on-demand (the outline); its license is flat, like the other providers' plan fees.
Priceper minutelower is betterarm64 · 4 vCPU Share Save image
RunsOn has the lowest price per minute.
RunsOn to Namespace Apple silicon: 62× apart.
- RunsOn m9gd.xlarge · local NVMe · 16 GB $0.0014 $0.0045 on-demand
- RunsOntmpfs m9g.xlarge · 16 GB $0.0016 $0.0036 on-demand
- Ubicloud standard · 16 GB $0.0025
- Blacksmith 16 GB $0.0050
- Warpbuild 16 GB $0.0060
- GitHub 16 GB $0.0080
- Namespace 4x16 · 16 GB $0.0120
- Avrea 16 GB $0.0240
- NamespaceApple silicon 4x16 · 16 GB $0.0840
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · 14 GB $0.0800 not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
Pay-as-you-go price of a 4 vCPU runner. RunsOn is the EC2 + EBS bill in your own AWS account, at spot (the bar) and on-demand (the outline); its license is flat, like the other providers' plan fees.
Priceper minutelower is betterarm64 · 8 vCPU Share Save image
RunsOn and RunsOn tmpfs tie for the lowest price per minute.
RunsOn to Avrea: 20× apart.
- RunsOn m9g.2xlarge · EBS gp3 · 32 GB $0.0024 $0.0068 on-demand
- RunsOntmpfs m9g.2xlarge · 32 GB $0.0024 $0.0068 on-demand
- Ubicloud standard · 32 GB $0.0050
- Blacksmith 32 GB $0.0100
- Warpbuild 32 GB $0.0120
- Namespace 8x32 · 32 GB $0.0240
- Avrea 32 GB $0.0480
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · 28 GB $0.1600 not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
Pay-as-you-go price of a 8 vCPU runner. RunsOn is the EC2 + EBS bill in your own AWS account, at spot (the bar) and on-demand (the outline); its license is flat, like the other providers' plan fees.
Network
Networkdownload from GitHubhigher is betterx64 · 2 vCPU Share Save image
RunsOn tmpfs downloads from GitHub fastest.
RunsOn is 2nd of 10, 15% below the leader. RunsOn tmpfs to boat: 6.3× apart.
- RunsOntmpfs r8a.large · 16 GB 265 MiB/s
- RunsOn median of 9 machines 225 MiB/s
- AWS CodeBuild small · 3 GB 160 MiB/s
- Namespace 2x8 · 8 GB 151 MiB/s
- Warpbuild 8 GB 105 MiB/s
- Blacksmith 8 GB 99 MiB/s
- Avrea 8 GB 98 MiB/s
- GitHub 8 GB 66 MiB/s
- Ubicloud median of 2 machines 46 MiB/s
- boat 4 GB 42 MiB/s
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
A large file fetched from GitHub inside the job. Downloads vary from machine to machine, so a bar is the median of the line's machines of this size and the mark over it runs from its slowest to its fastest.
Networkdownload from GitHubhigher is betterx64 · 4 vCPU Share Save image
AWS CodeBuild downloads from GitHub fastest.
RunsOn is 3rd of 10, 13% below the leader. AWS CodeBuild to boat: 4.8× apart.
- AWS CodeBuild medium · 8 GB 197 MiB/s
- RunsOntmpfs r8a.xlarge · 32 GB 173 MiB/s
- RunsOn median of 8 machines 171 MiB/s
- Avrea 16 GB 163 MiB/s
- Namespace median of 2 machines 158 MiB/s
- Warpbuild 16 GB 100 MiB/s
- GitHub 16 GB 95 MiB/s
- Blacksmith 16 GB 76 MiB/s
- Ubicloud median of 2 machines 48 MiB/s
- boat 8 GB 41 MiB/s
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
A large file fetched from GitHub inside the job. Downloads vary from machine to machine, so a bar is the median of the line's machines of this size and the mark over it runs from its slowest to its fastest.
Networkdownload from GitHubhigher is betterx64 · 8 vCPU Share Save image
RunsOn tmpfs downloads from GitHub fastest.
RunsOn is 3rd of 10, 13% below the leader. RunsOn tmpfs to Ubicloud: 4.4× apart.
- RunsOntmpfs median of 2 machines 184 MiB/s
- AWS CodeBuild large · 16 GB 166 MiB/s
- RunsOn median of 7 machines 160 MiB/s
- Avrea 32 GB 142 MiB/s
- Namespace median of 2 machines 137 MiB/s
- GitHub 32 GB 115 MiB/s
- Warpbuild 32 GB 107 MiB/s
- Blacksmith 32 GB 105 MiB/s
- boat 16 GB 73 MiB/s
- Ubicloud median of 2 machines 42 MiB/s
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
A large file fetched from GitHub inside the job. Downloads vary from machine to machine, so a bar is the median of the line's machines of this size and the mark over it runs from its slowest to its fastest.
Networkdownload from GitHubhigher is betterarm64 · 2 vCPU Share Save image
RunsOn tmpfs downloads from GitHub fastest.
RunsOn is 2nd of 9, 25% below the leader. RunsOn tmpfs to Ubicloud: 4.3× apart.
- RunsOntmpfs r9g.large · 16 GB 269 MiB/s
- RunsOn median of 3 machines 201 MiB/s
- NamespaceApple silicon 2x8 · 8 GB 168 MiB/s
- Warpbuild 8 GB 167 MiB/s
- Avrea 8 GB 139 MiB/s
- Namespace 2x8 · 8 GB 121 MiB/s
- GitHub 8 GB 93 MiB/s
- Blacksmith 6 GB 88 MiB/s
- Ubicloud standard · 8 GB 63 MiB/s
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- WarpbuildApple silicon no 2 vCPU arm64 runner
A large file fetched from GitHub inside the job. Downloads vary from machine to machine, so a bar is the median of the line's machines of this size and the mark over it runs from its slowest to its fastest.
Networkdownload from GitHubhigher is betterarm64 · 4 vCPU Share Save image
RunsOn and RunsOn tmpfs tie for the fastest download from GitHub.
RunsOn to Ubicloud: 2.3× apart.
- RunsOn median of 3 machines 172 MiB/s
- RunsOntmpfs median of 2 machines 170 MiB/s
- Warpbuild 16 GB 144 MiB/s
- NamespaceApple silicon 4x16 · 16 GB 131 MiB/s
- Namespace median of 2 machines 121 MiB/s
- GitHub 16 GB 109 MiB/s
- Blacksmith 16 GB 100 MiB/s
- Avrea 16 GB 83 MiB/s
- Ubicloud standard · 16 GB 75 MiB/s
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · 14 GB 70 MiB/s not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
A large file fetched from GitHub inside the job. Downloads vary from machine to machine, so a bar is the median of the line's machines of this size and the mark over it runs from its slowest to its fastest.
Networkdownload from GitHubhigher is betterarm64 · 8 vCPU Share Save image
RunsOn tmpfs downloads from GitHub fastest.
RunsOn is 3rd of 7, 46% below the leader. RunsOn tmpfs to Ubicloud: 5.2× apart.
- RunsOntmpfs m9g.2xlarge · 32 GB 298 MiB/s
- Warpbuild 32 GB 189 MiB/s
- RunsOn median of 3 machines 161 MiB/s
- Namespace median of 2 machines 125 MiB/s
- Blacksmith 32 GB 97 MiB/s
- Avrea 32 GB 69 MiB/s
- Ubicloud standard · 32 GB 57 MiB/s
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · 28 GB 74 MiB/s not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
A large file fetched from GitHub inside the job. Downloads vary from machine to machine, so a bar is the median of the line's machines of this size and the mark over it runs from its slowest to its fastest.
Disk
Diskrandom reads per secondhigher is betterx64 · 2 vCPU Share Save image
Namespace has the fastest disk on small reads.
RunsOn is 5th of 9, the leader is 8.4× higher. Namespace to AWS CodeBuild: 59× apart.
- Namespace 2x8 · 8 GB 104,675
- Blacksmith 8 GB 73,779
- Avrea 8 GB 53,018
- Warpbuild 8 GB 51,593
- RunsOn i7i.large · local NVMe · 16 GB 12,419
- boat 4 GB 10,663
- Ubicloud standard · 8 GB 6,828
- GitHub 8 GB 6,395
- AWS CodeBuild small · 3 GB 1,762
- NamespaceApple silicon arm64 only
- RunsOntmpfs workspace in RAM, no disk
- WarpbuildApple silicon arm64 only
4k random reads one at a time (fio, QD1) in the job's workspace, each provider's best disk. It is a disk's limit: a build often never reaches it, so read it next to the builds. A tmpfs workspace is RAM and has no disk figure.
Diskrandom reads per secondhigher is betterx64 · 4 vCPU Share Save image
Namespace has the fastest disk on small reads.
RunsOn is 5th of 9, the leader is 9.4× higher. Namespace to AWS CodeBuild: 59× apart.
- Namespace 4x8 · 8 GB 105,744
- Blacksmith 16 GB 71,728
- Avrea 16 GB 49,955
- Warpbuild 16 GB 47,423
- RunsOn i7i.xlarge · local NVMe · 32 GB 11,192
- boat 8 GB 8,814
- Ubicloud standard · 16 GB 7,775
- GitHub 16 GB 7,286
- AWS CodeBuild medium · 8 GB 1,796
- NamespaceApple silicon arm64 only
- RunsOntmpfs workspace in RAM, no disk
- WarpbuildApple silicon arm64 only
4k random reads one at a time (fio, QD1) in the job's workspace, each provider's best disk. It is a disk's limit: a build often never reaches it, so read it next to the builds. A tmpfs workspace is RAM and has no disk figure.
Diskrandom reads per secondhigher is betterx64 · 8 vCPU Share Save image
Namespace has the fastest disk on small reads.
RunsOn is 5th of 9, the leader is 9.2× higher. Namespace to AWS CodeBuild: 60× apart.
- Namespace 8x16 · 16 GB 106,191
- Blacksmith 32 GB 70,703
- Avrea 32 GB 52,383
- Warpbuild 32 GB 38,684
- RunsOn i7i.2xlarge · local NVMe · 64 GB 11,584
- Ubicloud premium · 32 GB 8,638
- boat 16 GB 8,181
- GitHub 32 GB 7,529
- AWS CodeBuild large · 16 GB 1,758
- NamespaceApple silicon arm64 only
- RunsOntmpfs workspace in RAM, no disk
- WarpbuildApple silicon arm64 only
4k random reads one at a time (fio, QD1) in the job's workspace, each provider's best disk. It is a disk's limit: a build often never reaches it, so read it next to the builds. A tmpfs workspace is RAM and has no disk figure.
Diskrandom reads per secondhigher is betterarm64 · 2 vCPU Share Save image
Blacksmith has the fastest disk on small reads.
RunsOn is 5th of 8, the leader is 2.2× higher. Blacksmith to Warpbuild: 17× apart.
- Blacksmith 6 GB 29,968
- Avrea 8 GB 20,905
- NamespaceApple silicon 2x8 · 8 GB 19,893
- Namespace 2x8 · 8 GB 15,910
- RunsOn m9gd.large · local NVMe · 8 GB 13,517
- Ubicloud standard · 8 GB 8,149
- GitHub 8 GB 7,994
- Warpbuild 8 GB 1,793
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- RunsOntmpfs workspace in RAM, no disk
- WarpbuildApple silicon no 2 vCPU arm64 runner
4k random reads one at a time (fio, QD1) in the job's workspace, each provider's best disk. It is a disk's limit: a build often never reaches it, so read it next to the builds. A tmpfs workspace is RAM and has no disk figure.
Diskrandom reads per secondhigher is betterarm64 · 4 vCPU Share Save image
Blacksmith has the fastest disk on small reads.
RunsOn is 5th of 8, the leader is 2.4× higher. Blacksmith to Warpbuild: 18× apart.
- Blacksmith 16 GB 32,740
- Avrea 16 GB 19,951
- NamespaceApple silicon 4x16 · 16 GB 18,736
- Namespace 4x8 · 8 GB 16,634
- RunsOn m9gd.xlarge · local NVMe · 16 GB 13,375
- Ubicloud standard · 16 GB 8,705
- GitHub 16 GB 6,892
- Warpbuild 16 GB 1,806
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · 14 GB 29,877 not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- RunsOntmpfs workspace in RAM, no disk
4k random reads one at a time (fio, QD1) in the job's workspace, each provider's best disk. It is a disk's limit: a build often never reaches it, so read it next to the builds. A tmpfs workspace is RAM and has no disk figure.
Diskrandom reads per secondhigher is betterarm64 · 8 vCPU Share Save image
Blacksmith has the fastest disk on small reads.
RunsOn is 4th of 6, the leader is 2.2× higher. Blacksmith to Warpbuild: 16× apart.
- Blacksmith 32 GB 29,312
- Avrea 32 GB 20,743
- Namespace 8x32 · 32 GB 16,783
- RunsOn m9gd.2xlarge · local NVMe · 32 GB 13,454
- Ubicloud standard · 32 GB 9,388
- Warpbuild 32 GB 1,797
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · 28 GB 30,249 not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
- RunsOntmpfs workspace in RAM, no disk
4k random reads one at a time (fio, QD1) in the job's workspace, each provider's best disk. It is a disk's limit: a build often never reaches it, so read it next to the builds. A tmpfs workspace is RAM and has no disk figure.
Cache
Cacherestoring 4 GBlower is betterx64 · 2 vCPU Share Save image
RunsOn tmpfs restores a 4 GB cache fastest.
RunsOn is 4th of 9, the leader is 2.4× lower. RunsOn tmpfs to GitHub: 8.6× apart.
- RunsOntmpfs r8a.large · actions/cache 7s
- Blacksmith actions/cache 10s
- Avrea actions/cache 13s
- RunsOn r8a.large · EBS gp3 · actions/cache 17s
- Namespace 2x8 · actions/cache 22s
- Warpbuild actions/cache 28s
- AWS CodeBuild small · actions/cache 52s
- Ubicloud standard · actions/cache 57s
- GitHub 2-core · actions/cache 1m 01s
- boat actions/cache 1m 21s provisional
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Restore of a 4 GB cache: each provider's fastest cache action on its standard storage, named under the provider; the tmpfs row restores into RAM.
Cacherestoring 4 GBlower is betterx64 · 4 vCPU Share Save image
RunsOn tmpfs restores a 4 GB cache fastest.
RunsOn is 4th of 9, the leader is 3.2× lower. RunsOn tmpfs to Ubicloud: 11× apart.
- RunsOntmpfs r8a.xlarge · actions/cache 5s
- Avrea actions/cache 11s
- Blacksmith actions/cache 11s
- RunsOn m8a.xlarge · EBS gp3 · actions/cache 16s
- Namespace 4x8 · actions/cache 18s
- Warpbuild actions/cache 21s
- AWS CodeBuild medium · actions/cache 36s
- GitHub 4-core · actions/cache 41s
- Ubicloud premium · actions/cache 55s
- boat actions/cache 2m 15s provisional
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Restore of a 4 GB cache: each provider's fastest cache action on its standard storage, named under the provider; the tmpfs row restores into RAM.
Cacherestoring 4 GBlower is betterx64 · 8 vCPU Share Save image
RunsOn tmpfs restores a 4 GB cache fastest.
RunsOn is 4th of 10, the leader is 2.2× lower. RunsOn tmpfs to boat: 14× apart.
- RunsOntmpfs m8a.2xlarge · actions/cache 5s
- Blacksmith actions/cache 10s
- Avrea actions/cache 11s
- RunsOn m8a.2xlarge · EBS gp3 · actions/cache 11s
- Namespace 8x16 · actions/cache 17s
- Warpbuild actions/cache 25s
- GitHub 8-core · actions/cache 33s
- AWS CodeBuild large · actions/cache 35s
- Ubicloud standard · actions/cache 55s
- boat actions/cache 1m 11s
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
Restore of a 4 GB cache: each provider's fastest cache action on its standard storage, named under the provider; the tmpfs row restores into RAM.
Cacherestoring 4 GBlower is betterarm64 · 2 vCPU Share Save image
RunsOn tmpfs restores a 4 GB cache fastest.
RunsOn is 3rd of 9, the leader is 2.4× lower. RunsOn tmpfs to Ubicloud: 7.8× apart.
- RunsOntmpfs r9g.large · actions/cache 8s
- Avrea actions/cache 12s
- RunsOn m9g.large · EBS gp3 · actions/cache 19s
- Blacksmith actions/cache 24s
- NamespaceApple silicon 2x8 · actions/cache 25s
- Warpbuild actions/cache 29s
- Namespace 2x8 · actions/cache 42s
- GitHub 2-core · actions/cache 53s
- Ubicloud standard · actions/cache 1m 02s
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- WarpbuildApple silicon no 2 vCPU arm64 runner
Restore of a 4 GB cache: each provider's fastest cache action on its standard storage, named under the provider; the tmpfs row restores into RAM.
Cacherestoring 4 GBlower is betterarm64 · 4 vCPU Share Save image
RunsOn tmpfs restores a 4 GB cache fastest.
RunsOn is 3rd of 9, the leader is 3.2× lower. RunsOn tmpfs to Ubicloud: 11× apart.
- RunsOntmpfs r9g.xlarge · actions/cache 5s
- Avrea actions/cache 11s
- RunsOn m9g.xlarge · EBS gp3 · actions/cache 16s
- Blacksmith actions/cache 21s
- NamespaceApple silicon 4x16 · actions/cache 22s
- Warpbuild actions/cache 27s
- GitHub 4-core · actions/cache 36s
- Namespace 4x8 · actions/cache 38s
- Ubicloud standard · actions/cache 57s
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · actions/cache 29s not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
Restore of a 4 GB cache: each provider's fastest cache action on its standard storage, named under the provider; the tmpfs row restores into RAM.
Cacherestoring 4 GBlower is betterarm64 · 8 vCPU Share Save image
RunsOn tmpfs restores a 4 GB cache fastest.
RunsOn is 3rd of 7, the leader is 2.2× lower. RunsOn tmpfs to Ubicloud: 9.8× apart.
- RunsOntmpfs m9g.2xlarge · actions/cache 5s
- Avrea actions/cache 10s
- RunsOn m9g.2xlarge · EBS gp3 · actions/cache 11s
- Blacksmith actions/cache 18s
- Warpbuild actions/cache 21s
- Namespace 8x16 · actions/cache 32s
- Ubicloud standard · actions/cache 49s
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · actions/cache 46s not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
Restore of a 4 GB cache: each provider's fastest cache action on its standard storage, named under the provider; the tmpfs row restores into RAM.
Predictability
Predictabilityrun to runlower is betterx64 · 2 vCPU Share Save image
Avrea has the steadiest build times.
RunsOn is 3rd of 7, at +10%.
- Avrea 8 GB · worst run 1.1× +4%
- RunsOntmpfs r8a.large · 16 GB · worst run 1.1× +6%
- RunsOn 2 machines · worst run 1.2× +10%
- Ubicloud 2 machines · worst run 1.5× +23%
- Warpbuild 8 GB · worst run 1.5× +25%
- GitHub 8 GB · worst run 1.3× +28%
- Blacksmith 8 GB · worst run 1.5× +33%
- AWS CodeBuild small · 3 GB · worst run 1.1× +8% provisional
- boat 4 GB · worst run 1.2× +17% provisional
- Namespace 2x8 · 8 GB · worst run 1.3× +20% provisional
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
How much a build's time moves from run to run on the same machine: the run that 9 runs in 10 beat (p90), over the typical run (p50), for each build on the machine Real builds picks, averaged over the builds with 3 runs or more. +10% means one run in ten took more than 10% longer than usual. A line measured on one build is shown, not ranked.
Predictabilityrun to runlower is betterx64 · 4 vCPU Share Save image
Avrea has the steadiest build times.
RunsOn is 3rd of 9, at +7%.
- Avrea 16 GB · worst run 1.1× +3%
- RunsOntmpfs r8a.xlarge · 32 GB · worst run 1.2× +4%
- RunsOn 2 machines · worst run 1.4× +7%
- Warpbuild 16 GB · worst run 1.2× +13%
- GitHub 16 GB · worst run 1.2× +15%
- Namespace 2 machines · worst run 1.7× +24%
- Ubicloud 2 machines · worst run 1.7× +30%
- Blacksmith 16 GB · worst run 2.8× +58%
- boat 8 GB · worst run 2.0× +58%
- AWS CodeBuild medium · 8 GB · worst run 1.1× +4% provisional
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
How much a build's time moves from run to run on the same machine: the run that 9 runs in 10 beat (p90), over the typical run (p50), for each build on the machine Real builds picks, averaged over the builds with 3 runs or more. +10% means one run in ten took more than 10% longer than usual. A line measured on one build is shown, not ranked.
Predictabilityrun to runlower is betterx64 · 8 vCPU Share Save image
Avrea has the steadiest build times.
RunsOn is 4th of 10, at +9%.
- Avrea 32 GB · worst run 1.1× +4%
- AWS CodeBuild large · 16 GB · worst run 1.1× +5%
- RunsOntmpfs m8a.2xlarge · 32 GB · worst run 1.1× +7%
- RunsOn 2 machines · worst run 1.5× +9%
- Warpbuild 32 GB · worst run 1.3× +12%
- Ubicloud premium · 32 GB · worst run 1.4× +15%
- GitHub 32 GB · worst run 1.3× +16%
- Namespace 2 machines · worst run 1.6× +22%
- Blacksmith 32 GB · worst run 1.9× +41%
- boat 16 GB · worst run 4.7× +147%
- NamespaceApple silicon arm64 only
- WarpbuildApple silicon arm64 only
How much a build's time moves from run to run on the same machine: the run that 9 runs in 10 beat (p90), over the typical run (p50), for each build on the machine Real builds picks, averaged over the builds with 3 runs or more. +10% means one run in ten took more than 10% longer than usual. A line measured on one build is shown, not ranked.
Predictabilityrun to runlower is betterarm64 · 2 vCPU Share Save image
RunsOn has the steadiest build times.
- RunsOn m9gd.large · local NVMe · 8 GB · worst run 1.1× +5%
- Blacksmith 6 GB · worst run 1.2× +8%
- Avrea 8 GB · worst run 1.2× +12%
- GitHub 8 GB · worst run 1.3× +15%
- RunsOntmpfs r9g.large · 16 GB · worst run 1.7× +26%
- Warpbuild 8 GB · worst run 1.5× +33%
- Ubicloud standard · 8 GB · worst run 1.0× +3% provisional
- Namespace 2x8 · 8 GB · worst run 1.1× +4% provisional
- NamespaceApple silicon 2x8 · 8 GB · worst run 1.1× +12% provisional
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- WarpbuildApple silicon no 2 vCPU arm64 runner
How much a build's time moves from run to run on the same machine: the run that 9 runs in 10 beat (p90), over the typical run (p50), for each build on the machine Real builds picks, averaged over the builds with 3 runs or more. +10% means one run in ten took more than 10% longer than usual. A line measured on one build is shown, not ranked.
Predictabilityrun to runlower is betterarm64 · 4 vCPU Share Save image
RunsOn has the steadiest build times.
- RunsOn 2 machines · worst run 1.1× +3%
- GitHub 16 GB · worst run 1.1× +5%
- Warpbuild 16 GB · worst run 1.2× +7%
- Avrea 16 GB · worst run 1.2× +9%
- Blacksmith 16 GB · worst run 1.3× +11%
- Namespace 2 machines · worst run 1.2× +12%
- RunsOntmpfs 2 machines · worst run 1.6× +14%
- NamespaceApple silicon 4x16 · 16 GB · worst run 2.1× +31%
- Ubicloud standard · 16 GB · worst run 10.7× +169%
- WarpbuildApple silicon 6 vCPU · xfast (Apple M4 Pro) · 14 GB · worst run 2.0× +34% not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
How much a build's time moves from run to run on the same machine: the run that 9 runs in 10 beat (p90), over the typical run (p50), for each build on the machine Real builds picks, averaged over the builds with 3 runs or more. +10% means one run in ten took more than 10% longer than usual. A line measured on one build is shown, not ranked.
Predictabilityrun to runlower is betterarm64 · 8 vCPU Share Save image
Avrea has the steadiest build times.
RunsOn is 2nd of 7, at +8%.
- Avrea 32 GB · worst run 1.1× +6%
- RunsOn 2 machines · worst run 1.2× +8%
- Ubicloud standard · 32 GB · worst run 1.3× +11%
- Warpbuild 32 GB · worst run 1.4× +11%
- Blacksmith 32 GB · worst run 1.2× +12%
- Namespace 8x16 · 16 GB · worst run 1.8× +17%
- RunsOntmpfs m9g.2xlarge · 32 GB · worst run 1.8× +17%
- WarpbuildApple silicon 12 vCPU · xfast (Apple M4 Pro) · 28 GB · worst run 2.6× +29% not ranked
- AWS CodeBuild no arm64 runner
- boat no arm64 runner
- GitHub no 8 vCPU arm64 runner
- NamespaceApple silicon no 8 vCPU arm64 runner
How much a build's time moves from run to run on the same machine: the run that 9 runs in 10 beat (p90), over the typical run (p50), for each build on the machine Real builds picks, averaged over the builds with 3 runs or more. +10% means one run in ten took more than 10% longer than usual. A line measured on one build is shown, not ranked.
Every benchmark
- Explorer Every benchmark, provider and runner in one place: pick a benchmark, open a provider, compare its runners.
- Builds in detail Every build phase, p50 to max, by best value, time or cost.
- Queue How long jobs wait for a runner in a burst, and how far build times move from run to run.
- Bigger runners What doubling the vCPU does to a build's time and cost.
- All runners All 94 runners in one table, and the price / performance chart.
- CPU Single and multi-thread scores, job-to-job spread, score per dollar.
- Cache Save and restore of a 4 GB cache, per cache action and storage.
- Disk I/O fio in the job's workspace: random and sequential, latency, sync writes.
- EC2 storage NVMe, gp3 and tmpfs on the same instances, and what each does to a build.
- EC2 CPU Every EC2 instance family by CPU score and price.
- Head-to-heads Two runners of the same size, build for build, cost first.
- Methodology How every figure is measured and ranked, and what changed.
- Calculator Your own minutes and sizes: what each provider would bill.