RunsOn m8a.xlarge · EBS gp3 vs GitHub 4-core x64
RunsOn does each build for 10.8–13.3× less; on time, RunsOn is faster on the Rust and TypeScript builds and neither is clearly faster on the Docker build. Both 4 vCPU x64.
All three builds 11.3× cheaper on RunsOn: $0.0218 vs $0.2461RunsOn 1.5× faster: 12m 00s vs 17m 52s
Rust build 13.3× cheaper on RunsOn: $0.0034 vs $0.0457RunsOn 2.0× faster: 1m 49s vs 3m 38s
TypeScript build 12.4× cheaper on RunsOn: $0.0021 vs $0.0258RunsOn 1.7× faster: 1m 03s vs 1m 44s
Docker build 10.8× cheaper on RunsOn: $0.0162 vs $0.1746within run-to-run spread: 9m 08s · 12m 30s
RunsOn m8a.xlarge · EBS gp3
jobs ran from Amazon.com (US)
GitHub 4-core
jobs ran from Microsoft (US)
Side by side
Every measurement both runners share, cost first. The dot marks the better value; gap is the larger over the smaller.
| Measurement | RunsOn | GitHub | Gap |
|---|---|---|---|
| Cost | |||
| Cost per Rust build | $0.0034 | $0.0457 | 13.3× RunsOn |
| Cost per TypeScript build | $0.0021 | $0.0258 | 12.4× RunsOn |
| Cost per Docker build | $0.0162 | $0.1746 | 10.8× RunsOn |
| Price per minute | $0.0013 | $0.0120 | 9.2× RunsOn |
| Real builds, wall time | |||
| Rust build (spotify-player) | 1m 49s | 3m 38s | 2.0× RunsOn |
| TypeScript build (opencode) | 1m 03s | 1m 44s | 1.7× RunsOn |
| Docker build (PostHog) | 9m 08s | 12m 30s | ≈ even |
| CPU & memory | |||
| PassMark single-thread (points) | 3,809 | 2,895 | 1.3× RunsOn |
| PassMark CPU Mark, all cores (points) | 13,481 | 7,511 | 1.8× RunsOn |
| sysbench CPU, 1 thread (events/s) | 5,012 | 4,076 | 1.2× RunsOn |
| 7-Zip compression (MIPS) | 38,485 | 18,743 | 2.1× RunsOn |
| Memory read bandwidth | 36.6 GiB/s | 24.1 GiB/s | 1.5× RunsOn |
| Measurement | RunsOn | GitHub | Gap |
|---|---|---|---|
| Workspace disk (fio) | |||
| Random read, 4k QD32 (IOPS) | 2,994 | 19,575 | 6.5× GitHub |
| Random write, 4k QD32 (IOPS) | 2,991 | 11,216 | 3.7× GitHub |
| Random read, 4k QD1 (IOPS) | 1,825 | 7,286 | 4.0× GitHub |
| QD1 read latency, p99 | 807 µs | 241 µs | 3.4× GitHub |
| Sequential read | 401 MiB/s | 394 MiB/s | ≈ even |
| Sequential write | 401 MiB/s | 244 MiB/s | 1.6× RunsOn |
| Sync write, 4k + fdatasync (IOPS) | 540 | 4,163 | 7.7× GitHub |
| Network, cache & Docker | |||
| Download from GitHub | 159 MiB/s | 95 MiB/s | 1.7× RunsOn |
| Cache restore, 4 GB (actions/cache) | 16s | 41s | 2.6× RunsOn |
| Cache save, 4 GB (actions/cache) | 16s | 34s | 2.1× RunsOn |
| docker pull | 4.8s | 16.4s | 3.4× RunsOn |
| Database | |||
| pgbench read/write (TPS) | 3,256 | 4,414 | 1.4× GitHub |
| pgbench read-only (TPS) | 142,376 | 40,172 | 3.5× RunsOn |
| Queue | |||
| Queue under burst load | 17s | 3s | 5.7× GitHub |
- ≈ even: under 5% apart, or a build inside both runners' run-to-run spread
- Queue: identical jobs queued at the same instant (burst suite)
- RunsOn at EC2 spot, its default (7-day average of the cheapest us-east-1 zone's spot price, fetched 16 Nov 2026); 9 of its jobs fell back to on-demand (AWS had no spot capacity for the type) and are priced at the spot rate over the same billed time
- Cost: a managed SaaS runner against RunsOn self-hosted on your AWS account; the effort of running it was not measured