RunsOn r9g.xlarge · tmpfs vs Blacksmith 4 vCPU arm64
RunsOn does each build for 3.6–4.0× less and 2.0–2.3× faster. Both 4 vCPU arm64.
All three builds 3.9× cheaper on RunsOn: $0.0223 vs $0.0876RunsOn 2.1× faster: 8m 01s vs 16m 26s
Rust build 3.8× cheaper on RunsOn: $0.0055 vs $0.0210RunsOn 2.2× faster: 1m 50s vs 3m 59s
TypeScript build 3.6× cheaper on RunsOn: $0.0030 vs $0.0111RunsOn 2.3× faster: 49s vs 1m 55s
Docker build 4.0× cheaper on RunsOn: $0.0138 vs $0.0555RunsOn 2.0× faster: 5m 22s vs 10m 32s
RunsOn r9g.xlarge · tmpfs
jobs ran from Amazon.com (US)
Blacksmith 4 vCPU
jobs ran from Secured Servers (US)
Side by side
Every measurement both runners share, cost first. The dot marks the better value; gap is the larger over the smaller.
| Measurement | RunsOn | Blacksmith | Gap |
|---|---|---|---|
| Cost | |||
| Cost per Rust build | $0.0055 | $0.0210 | 3.8× RunsOn |
| Cost per TypeScript build | $0.0030 | $0.0111 | 3.6× RunsOn |
| Cost per Docker build | $0.0138 | $0.0555 | 4.0× RunsOn |
| Price per minute | $0.0023 | $0.0050 | 2.2× RunsOn |
| Real builds, wall time | |||
| Rust build (spotify-player) | 1m 50s | 3m 59s | 2.2× RunsOn |
| TypeScript build (opencode) | 49s | 1m 55s | 2.3× RunsOn |
| Docker build (PostHog) | 5m 22s | 10m 32s | 2.0× RunsOn |
| CPU & memory | |||
| PassMark single-thread (points) | 2,471 | 1,353 | 1.8× RunsOn |
| PassMark CPU Mark, all cores (points) | 5,620 | 3,783 | 1.5× RunsOn |
| sysbench CPU, 1 thread (events/s) | 3,768 | 929 | 4.1× RunsOn |
| 7-Zip compression (MIPS) | 40,741 | 17,447 | 2.3× RunsOn |
| Memory read bandwidth | 28.2 GiB/s | 9.0 GiB/s | 3.1× RunsOn |
| Measurement | RunsOn | Blacksmith | Gap |
|---|---|---|---|
| Workspace disk (fio) | |||
| Random read, 4k QD32 (IOPS) | 2,605,268 | 253,175 | 10.3× RunsOn |
| Random write, 4k QD32 (IOPS) | 2,485,222 | 35,622 | 69.8× RunsOn |
| Random read, 4k QD1 (IOPS) | 643,948 | 32,740 | 19.7× RunsOn |
| QD1 read latency, p99 | <1 µs | 37 µs | 73.2× RunsOn |
| Sequential read | 14.0 GiB/s | 1.7 GiB/s | 8.4× RunsOn |
| Sequential write | 8.9 GiB/s | 829 MiB/s | 11.0× RunsOn |
| Sync write, 4k + fdatasync (IOPS) | 301,871 | 9,366 | 32.2× RunsOn |
| Network, cache & Docker | |||
| Download from GitHub | 174 MiB/s | 100 MiB/s | 1.7× RunsOn |
| Cache restore, 4 GB (actions/cache) | 5s | 21s | 4.2× RunsOn |
| Cache save, 4 GB (actions/cache) | 7s | 14s | 2.0× RunsOn |
| docker pull | 4.5s | 12.9s | 2.9× RunsOn |
| Database | |||
| pgbench read/write (TPS) | 9,965 | 2,948 | 3.4× RunsOn |
| pgbench read-only (TPS) | 64,571 | 24,073 | 2.7× RunsOn |
| Queue | |||
| Queue under burst load | 17s | 12s | 1.4× Blacksmith |
- ≈ even: under 5% apart, or a build inside both runners' run-to-run spread
- Queue: identical jobs queued at the same instant (burst suite)
- RunsOn at EC2 spot, its default (7-day average of the cheapest us-east-1 zone's spot price, fetched 16 Nov 2026); 10 of its jobs fell back to on-demand (AWS had no spot capacity for the type) and are priced at the spot rate over the same billed time
- Cost: a managed SaaS runner against RunsOn self-hosted on your AWS account; the effort of running it was not measured