quickstart →

RunsOn m8azn.xlarge · EBS gp3 vs Blacksmith 4 vCPU x64

RunsOn does each build for 1.6–3.0× less; neither is clearly faster (within 5% or inside each other's run-to-run range). Both 4 vCPU x64.

All three builds 1.9× cheaper on RunsOn: $0.0401 vs $0.0741Blacksmith 1.4× faster: 8m 27s vs 11m 26s
Rust build 2.5× cheaper on RunsOn: $0.0061 vs $0.0155within run-to-run spread: 1m 42s · 1m 47s
TypeScript build 3.0× cheaper on RunsOn: $0.0041 vs $0.0121within run-to-run spread: 57s · 1m 19s
Docker build 1.6× cheaper on RunsOn: $0.0298 vs $0.0465within run-to-run spread: 8m 48s · 5m 22s

Side by side

Every measurement both runners share, cost first. The dot marks the better value; gap is the larger over the smaller.

Measurement RunsOn Blacksmith Gap
Cost
Cost per Rust build $0.0061 $0.0155 2.5× RunsOn
Cost per TypeScript build $0.0041 $0.0121 3.0× RunsOn
Cost per Docker build $0.0298 $0.0465 1.6× RunsOn
Price per minute $0.0024 $0.0080 3.4× RunsOn
Real builds, wall time
Rust build (spotify-⁠player) 1m 42s 1m 47s ≈ even
TypeScript build (opencode) 57s 1m 19s ≈ even
Docker build (PostHog) 8m 48s 5m 22s ≈ even
CPU & memory
PassMark single-⁠thread (points) 4,267 4,332 ≈ even
PassMark CPU Mark, all cores (points) 15,136 14,771 ≈ even
sysbench CPU, 1 thread (events/s) 5,617 6,493 1.2× Blacksmith
7-⁠Zip compression (MIPS) 42,512 28,802 1.5× RunsOn
Memory read bandwidth 40.9 GiB/s 41.7 GiB/s ≈ even
Measurement RunsOn Blacksmith Gap
Workspace disk (fio)
Random read, 4k QD32 (IOPS) 2,994 728,035 243.2× Blacksmith
Random write, 4k QD32 (IOPS) 2,992 218,915 73.2× Blacksmith
Random read, 4k QD1 (IOPS) 1,583 71,728 45.3× Blacksmith
QD1 read latency, p99 918 µs 16 µs 57.7× Blacksmith
Sequential read 401 MiB/s 7.0 GiB/s 18.0× Blacksmith
Sequential write 401 MiB/s 1.7 GiB/s 4.3× Blacksmith
Sync write, 4k + fdatasync (IOPS) 541 17,925 33.1× Blacksmith
Network, cache & Docker
Download from GitHub 267 MiB/s 76 MiB/s 3.5× RunsOn
Cache restore, 4 GB (actions/cache) 16s 11s 1.5× Blacksmith
Cache save, 4 GB (actions/cache) 16s 7s 2.5× Blacksmith
docker pull 4.6s 7.9s 1.7× RunsOn
Database
pgbench read/write (TPS) 3,326 12,408 3.7× Blacksmith
pgbench read-⁠only (TPS) 162,964 109,979 1.5× RunsOn
Queue
Queue under burst load 17s 10s 1.7× Blacksmith
  • ≈ even: under 5% apart, or a build inside both runners' run-to-run spread
  • Queue: identical jobs queued at the same instant (burst suite)
  • RunsOn at EC2 spot, its default (7-day average of the cheapest us-east-1 zone's spot price, fetched 16 Nov 2026); its jobs ran on spot
  • Cost: a managed SaaS runner against RunsOn self-hosted on your AWS account; the effort of running it was not measured

Other head-to-heads