Fastest GitHub Actions runners: disk I/O.
fio inside the job workspace of 93 runners from 9 providers, 2 to 12 vCPU. These are the disk's limits. A build goes through the Linux page cache and often never reaches them, so a large gap here can be no gap on a build.
How this shows up in real builds
Latency per provider
Each provider's best disk, RunsOn once per storage (the Storage pill). QD1 is one 4k read at a time: what a database or a cold read pays. Most build steps batch their I/O through the page cache. tmpfs is RAM, not a disk: add it to see the gap on the same scale.
Blacksmith and Namespace lead x64 QD1 read, within 5% (80,883 and 78,677).tmpfs for scale: 1,153,230 on RunsOn m8a.2xlarge · tmpfs.
Blacksmith and Namespace lead x64 synced writes, within 5% (18,654 and 18,198).volatile and nobarrier mounts make each flush cheaper by making it less durable.
Blacksmith and Namespace lead x64 2 vCPU QD1 read, within 5% (80,883 and 77,442).tmpfs for scale: 1,153,230 on RunsOn m8a.2xlarge · tmpfs.
Blacksmith and Namespace lead x64 2 vCPU synced writes, within 5% (18,654 and 17,813).volatile and nobarrier mounts make each flush cheaper by making it less durable.
Fastest x64 4 vCPU QD1 read: Namespace (78,187), ahead of Blacksmith (71,607).tmpfs for scale: 1,153,230 on RunsOn m8a.2xlarge · tmpfs.
Namespace and Blacksmith lead x64 4 vCPU synced writes, within 5% (18,087 and 17,872).volatile and nobarrier mounts make each flush cheaper by making it less durable.
Namespace and Blacksmith lead x64 8 vCPU QD1 read, within 5% (78,677 and 75,819).tmpfs for scale: 1,153,230 on RunsOn m8a.2xlarge · tmpfs.
Namespace and Blacksmith lead x64 8 vCPU synced writes, within 5% (18,198 and 18,157).volatile and nobarrier mounts make each flush cheaper by making it less durable.
Warpbuild and Blacksmith lead arm64 QD1 read, within 5% (26,620 and 25,841).tmpfs for scale: 700,578 on RunsOn m9g.xlarge · tmpfs.
Fastest arm64 synced writes: RunsOn m9gd.2xlarge · NVMe (17,511), ahead of Warpbuild (8,770).volatile and nobarrier mounts make each flush cheaper by making it less durable.
Fastest arm64 2 vCPU QD1 read: Blacksmith (21,992), ahead of Avrea (20,423).tmpfs for scale: 700,578 on RunsOn m9g.xlarge · tmpfs.
Fastest arm64 2 vCPU synced writes: RunsOn m9gd.large · NVMe (7,267), ahead of Blacksmith (6,383).volatile and nobarrier mounts make each flush cheaper by making it less durable.
Fastest arm64 4 vCPU QD1 read: Blacksmith (23,747), ahead of Avrea (21,376).tmpfs for scale: 700,578 on RunsOn m9g.xlarge · tmpfs.
Fastest arm64 4 vCPU synced writes: RunsOn m9gd.xlarge · NVMe (14,852), ahead of Blacksmith (7,280).volatile and nobarrier mounts make each flush cheaper by making it less durable.
Fastest arm64 8 vCPU QD1 read: Blacksmith (25,841), ahead of Avrea (20,543).tmpfs for scale: 700,578 on RunsOn m9g.xlarge · tmpfs.
Fastest arm64 8 vCPU synced writes: RunsOn m9gd.2xlarge · NVMe (17,511), ahead of Blacksmith (7,834).volatile and nobarrier mounts make each flush cheaper by making it less durable.
What the numbers say
Extremes on x64, and RAM against disk.
- On x64, one small read at a time (4k, QD1) comes back 80,883 times a second on Blacksmith 2 vCPU and 1,520 on RunsOn m8a.xlarge · EBS gp3, 53× apart; p99 latency is 17 µs against 922 µs.
- Synced 4k writes on x64 run from 498 per second on RunsOn m8i.2xlarge · EBS gp3 (workspace mounted nobarrier) to 18,654 on Blacksmith 2 vCPU (workspace mounted nobarrier).
- r8a.large with tmpfs ($0.0010/min at spot) answers 1,089,234 QD1 reads and 423,214 synced writes per second: 90× and 32× the best local NVMe at 2 vCPU (i7i.large, $0.0010) and 601× and 782× default EBS gp3 (c8a.large, $0.0010); its workspace is 23 GiB, from RAM. (EC2 storage suite) What that does to real builds.
More findings23: EBS, arm64, NVMe vs EBS, provisioned gp3, tmpfs, storage classes
- Every EBS-backed workspace (3 AWS CodeBuild x64 runners, 25 RunsOn configurations and 3 Warpbuild configurations) answers between 1,492 and 1,838 QD1 reads and 498 to 571 synced writes per second, whoever runs it and whatever throughput it is provisioned for: each request is a round trip to network storage.
- On arm64, one small read at a time (4k, QD1) comes back 26,620 times a second on Warpbuild xfast (Apple M4 Pro) 6 vCPU and 1,492 on RunsOn c8g.large · EBS gp3, 18× apart; p99 latency is 79 µs against 954 µs.
- Synced 4k writes on arm64 run from 537 per second on RunsOn c8g.large · EBS gp3 (workspace mounted nobarrier) to 17,511 on RunsOn m9gd.2xlarge · local NVMe.
- Same Xeon 6975P-C CPU, different disk: m8id.2xlarge on local NVMe answers 10,517 QD1 reads and 7,522 synced writes per second, m8i.2xlarge on EBS gp3 1,571 and 498.
- Same Xeon 6975P-C CPU, different disk: m8id.large on local NVMe answers 11,093 QD1 reads and 5,539 synced writes per second, m8i-flex.large on EBS gp3 1,745 and 532.
- Same Xeon 6975P-C CPU, different disk: m8id.xlarge on local NVMe answers 11,046 QD1 reads and 7,973 synced writes per second, m8i-flex.xlarge on EBS gp3 1,707 and 520.
- Same Neoverse-V3 CPU, different disk: m9gd.2xlarge on local NVMe answers 13,514 QD1 reads and 17,511 synced writes per second, m9g.2xlarge on EBS gp3 1,810 and 543.
- Same Neoverse-V3 CPU, different disk: m9gd.xlarge on local NVMe answers 13,439 QD1 reads and 14,852 synced writes per second, m9g.xlarge on EBS gp3 1,560 and 542.
- Same Neoverse-V3 CPU, different disk: m9gd.large on local NVMe answers 13,477 QD1 reads and 7,267 synced writes per second, m9g.large on EBS gp3 1,788 and 542.
- Provisioning gp3 at 1000 MiB/s on m8a.2xlarge takes sequential reads from 402 MiB/s to 1,002 MiB/s (2.5×); QD1 reads barely move (1,791 → 1,792 IOPS): it buys bandwidth, not latency.
- Provisioning gp3 at 1000 MiB/s on m8azn.xlarge takes sequential reads from 401 MiB/s to 1,001 MiB/s (2.5×); QD1 reads barely move (1,815 → 1,773 IOPS): it buys bandwidth, not latency.
- tmpfs on m8a.2xlarge is not a disk at all: 1,153,230 QD1 reads and 427,176 synced writes per second, from RAM. The workspace is 46 GiB, sized by memory.
- tmpfs on m9g.2xlarge is not a disk at all: 664,023 QD1 reads and 301,114 synced writes per second, from RAM. The workspace is 46 GiB, sized by memory.
- tmpfs on m9g.xlarge is not a disk at all: 700,578 QD1 reads and 303,857 synced writes per second, from RAM. The workspace is 23 GiB, sized by memory.
- tmpfs on r8a.2xlarge is not a disk at all: 1,151,439 QD1 reads and 428,713 synced writes per second, from RAM. The workspace is 92 GiB, sized by memory.
- tmpfs on r8a.xlarge is not a disk at all: 1,083,980 QD1 reads and 431,907 synced writes per second, from RAM. The workspace is 46 GiB, sized by memory.
- tmpfs on r9g.large is not a disk at all: 641,530 QD1 reads and 298,044 synced writes per second, from RAM. The workspace is 23 GiB, sized by memory.
- tmpfs on r9g.xlarge is not a disk at all: 658,442 QD1 reads and 302,438 synced writes per second, from RAM. The workspace is 46 GiB, sized by memory.
- tmpfs: 642k–1.2M QD1 reads and 298k–432k synced writes per second across 8 runners (8 RunsOn configurations).
- VM disk: 6.4k–81k QD1 reads and 1.3k–19k synced writes per second across 43 runners from 7 providers (6 Avrea runners, 6 Blacksmith runners, 3 GitHub runners, 12 Namespace runners, 2 StarSling x64 runners, 9 Ubicloud runners and 5 Warpbuild runners).
- local NVMe: 11k–14k QD1 reads and 5.5k–18k synced writes per second across 9 runners (9 RunsOn configurations).
- network disk: 7.5k–8.2k QD1 reads and 4.4k synced writes per second across 2 runners (2 GitHub runners).
- EBS: 1.5k–1.8k QD1 reads and 498–571 synced writes per second across 31 runners from 3 providers (3 AWS CodeBuild x64 runners, 25 RunsOn configurations and 3 Warpbuild configurations).
Reading these numbers
fio measures what a disk can do. Whether a job gets there depends on the job.
At 4 vCPU, Namespace 4x8 answers 51× the QD1 reads of RunsOn m8a.xlarge · EBS gp3 (78,187 against 1,520 per second), and the Rust build takes 1m 52s on one and 1m 48s on the other. Every build, per runner.
What each column says about a job
- QD1 reads and synced writes: databases, SQLite-backed tests and anything that flushes each write. Every flush waits for the storage, and a network disk pays a round trip each time.
-
Random writes at depth and sequential throughput:
docker buildlayers, package installs and cache archives. They batch their writes and run into the disk's ceiling, not its latency. - None of them: compile jobs. A compiler waits for the CPU, and it reads its files back from the page cache.
Every runner
Each provider's best disk first; its other machines sit behind +N more. Bars are log scale.
| One request at a time | 4k, 32 in flight | Sequential, 1M | |||||
|---|---|---|---|---|---|---|---|
| Runner | QD1 read ↑ | p99 ↓ | Sync write ↑ | Read ↑ | Write ↑ | Read ↑ | Write ↑ |
| x64 | |||||||
| Blacksmith | 17 µs | 795,024 | 190,497 | 7.3 GiB/s | 2.1 GiB/s | ||
| 8 vCPU | 13 µs | 571,040 | 337,040 | 6.5 GiB/s | 2.1 GiB/s | ||
| 4 vCPU | 14 µs | 769,525 | 239,556 | 6.5 GiB/s | 2.0 GiB/s | ||
| Namespace 8x32 | 12 µs | 1,106,358 | 522,909 | 4.1 GiB/s | 2.9 GiB/s | ||
| 8x16 | 13 µs | 1,109,002 | 476,969 | 4.1 GiB/s | 2.9 GiB/s | ||
| 4x16 | 13 µs | 988,446 | 406,763 | 4.1 GiB/s | 2.9 GiB/s | ||
| 4x8 | 13 µs | 1,000,575 | 429,133 | 4.1 GiB/s | 2.9 GiB/s | ||
| 2x8 | 13 µs | 351,895 | 227,732 | 4.1 GiB/s | 2.9 GiB/s | ||
| StarSling | 17 µs | 231,481 | 40,717 | 2.4 GiB/s | 2.7 GiB/s | ||
| 4 vCPU | 18 µs | 243,587 | 47,132 | 3.9 GiB/s | 3.3 GiB/s | ||
| Avrea | 17 µs | 366,117 | 317,490 | 12.0 GiB/s | 7.5 GiB/s | ||
| 8 vCPU | 16 µs | 343,640 | 217,415 | 6.6 GiB/s | 6.8 GiB/s | ||
| 4 vCPU | 20 µs | 468,080 | 224,464 | 8.6 GiB/s | 5.6 GiB/s | ||
| Warpbuild | 48 µs | 154,260 | 45,671 | 8.4 GiB/s | 5.1 GiB/s | ||
| 4 vCPU | 58 µs | 185,061 | 38,883 | 9.1 GiB/s | 5.4 GiB/s | ||
| 2 vCPU | 59 µs | 152,215 | 53,614 | 6.7 GiB/s | 4.5 GiB/s | ||
| RunsOn i7i.xlarge | 301 µs | 150,052 | 82,489 | 1,010 MiB/s | 788 MiB/s | ||
| m8azn.3xlarge | 995 µs | 2,997 | 2,994 | 401 MiB/s | 401 MiB/s | ||
| m8a.2xlarge | 905 µs | 2,994 | 2,994 | 401 MiB/s | 401 MiB/s | ||
| m8a.2xlarge | 946 µs | 15,996 | 15,992 | 1,001 MiB/s | 1,001 MiB/s | ||
| c8a.2xlarge | 856 µs | 2,995 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| r8a.2xlarge | <1 µs | 4,271,309 | 3,819,444 | 18.5 GiB/s | 10.0 GiB/s | ||
| m8a.2xlarge | <1 µs | 4,255,814 | 3,787,945 | 18.1 GiB/s | 9.9 GiB/s | ||
| m8azn.xlarge | 848 µs | 2,994 | 2,991 | 401 MiB/s | 401 MiB/s | ||
| m8azn.xlarge | 823 µs | 15,994 | 15,992 | 1,001 MiB/s | 1,001 MiB/s | ||
| m8id.2xlarge | 272 µs | 134,258 | 67,071 | 905 MiB/s | 432 MiB/s | ||
| m8i.2xlarge | 913 µs | 2,994 | 2,993 | 401 MiB/s | 401 MiB/s | ||
| m8i-flex.2xlarge | 922 µs | 2,993 | 2,994 | 401 MiB/s | 401 MiB/s | ||
| i7i.2xlarge | 313 µs | 300,465 | 165,111 | 2.0 GiB/s | 1.5 GiB/s | ||
| m8a.xlarge | 922 µs | 2,994 | 2,991 | 401 MiB/s | 401 MiB/s | ||
| r8a.xlarge | <1 µs | 4,122,257 | 3,786,762 | 18.4 GiB/s | 9.9 GiB/s | ||
| c8a.xlarge | 832 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m8azn.large | 815 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m8id.xlarge | 206 µs | 67,090 | 33,524 | 451 MiB/s | 216 MiB/s | ||
| m8i-flex.xlarge | 848 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m8i.xlarge | 832 µs | 2,992 | 2,994 | 401 MiB/s | 401 MiB/s | ||
| m8a.large | 774 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| r8a.large | 766 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| r8a.large | <1 µs | 2,164,544 | 1,939,598 | 18.3 GiB/s | 9.8 GiB/s | ||
| c8a.large | 741 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m8id.large | 216 µs | 33,542 | 16,754 | 226 MiB/s | 108 MiB/s | ||
| i7i.large | 313 µs | 75,023 | 41,229 | 503 MiB/s | 395 MiB/s | ||
| m8i-flex.large | 848 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m8i.large | 881 µs | 2,993 | 2,994 | 401 MiB/s | 401 MiB/s | ||
| t8i.medium | 823 µs | 3,016 | 2,998 | 401 MiB/s | 401 MiB/s | ||
| Ubicloud premium | 167 µs | 366,118 | 22,032 | 3.5 GiB/s | 1.4 GiB/s | ||
| standard 8 vCPU | 528 µs | 251,230 | 13,012 | 2.7 GiB/s | 752 MiB/s | ||
| premium 4 vCPU | 2,073 µs | 143,006 | 8,602 | 2.4 GiB/s | 537 MiB/s | ||
| standard 4 vCPU | 465 µs | 193,790 | 12,781 | 2.5 GiB/s | 668 MiB/s | ||
| standard 2 vCPU | 1,106 µs | 105,928 | 60,814 | 2.6 GiB/s | 622 MiB/s | ||
| premium 2 vCPU | 1,597 µs | 129,551 | 69,948 | 2.6 GiB/s | 764 MiB/s | ||
| GitHub | 202 µs | 38,946 | 18,507 | 783 MiB/s | 532 MiB/s | ||
| 4-core | 210 µs | 19,578 | 9,322 | 394 MiB/s | 247 MiB/s | ||
| 2-core | 222 µs | 9,383 | 8,788 | 199 MiB/s | 130 MiB/s | ||
| AWS CodeBuild medium | 717 µs | 2,990 | 2,979 | 251 MiB/s | 251 MiB/s | ||
| large | 733 µs | 2,993 | 2,977 | 251 MiB/s | 251 MiB/s | ||
| small | 774 µs | 2,990 | 2,972 | 195 MiB/s | 251 MiB/s | ||
| arm64 | |||||||
| Warpbuild xfast (Apple M4 Pro) | 79 µs | 321,484 | 5,369 | 19.4 GiB/s | 25.4 GiB/s | ||
| xfast (Apple M4 Pro) 12 vCPU | 52 µs | 329,647 | 4,460 | 21.6 GiB/s | 25.1 GiB/s | ||
| 8 vCPU | 750 µs | 4,995 | 4,993 | 401 MiB/s | 401 MiB/s | ||
| 4 vCPU | 823 µs | 4,193 | 4,193 | 302 MiB/s | 302 MiB/s | ||
| 2 vCPU | 823 µs | 4,194 | 4,193 | 302 MiB/s | 301 MiB/s | ||
| Blacksmith | 33 µs | 259,773 | 29,073 | 1.6 GiB/s | 993 MiB/s | ||
| 4 vCPU | 44 µs | 171,567 | 27,356 | 1.6 GiB/s | 863 MiB/s | ||
| 2 vCPU | 50 µs | 74,915 | 26,068 | 1.7 GiB/s | 823 MiB/s | ||
| Avrea | 57 µs | 147,493 | 67,748 | 31.5 GiB/s | 17.1 GiB/s | ||
| 8 vCPU | 53 µs | 139,939 | 17,597 | 43.1 GiB/s | 16.1 GiB/s | ||
| 2 vCPU | 58 µs | 167,165 | 14,993 | 30.4 GiB/s | 14.8 GiB/s | ||
| Namespace Apple silicon 4x16 | 85 µs | 148,271 | 13,347 | 31.2 GiB/s | 14.7 GiB/s | ||
| Apple silicon 2x8 | 90 µs | 155,899 | 22,462 | 32.7 GiB/s | 12.4 GiB/s | ||
| 8x32 | 98 µs | 180,257 | 39,396 | 942 MiB/s | 756 MiB/s | ||
| 8x16 | 90 µs | 171,247 | 45,165 | 901 MiB/s | 746 MiB/s | ||
| 4x8 | 87 µs | 144,201 | 32,144 | 962 MiB/s | 739 MiB/s | ||
| 4x16 | 88 µs | 141,434 | 32,179 | 962 MiB/s | 750 MiB/s | ||
| 2x8 | 92 µs | 79,835 | 28,646 | 941 MiB/s | 696 MiB/s | ||
| RunsOn m9gd.2xlarge | 81 µs | 174,572 | 87,209 | 1.1 GiB/s | 561 MiB/s | ||
| m9g.2xlarge | 774 µs | 2,995 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m9g.2xlarge | <1 µs | 2,693,202 | 2,518,860 | 14.1 GiB/s | 9.9 GiB/s | ||
| c8g.2xlarge | 848 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m9gd.xlarge | 85 µs | 87,221 | 43,593 | 585 MiB/s | 281 MiB/s | ||
| m9g.xlarge | 938 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m9g.xlarge | <1 µs | 2,759,837 | 2,553,373 | 15.9 GiB/s | 10.1 GiB/s | ||
| r9g.xlarge | <1 µs | 2,646,436 | 2,497,143 | 13.9 GiB/s | 9.2 GiB/s | ||
| c8g.xlarge | 913 µs | 2,994 | 2,992 | 401 MiB/s | 401 MiB/s | ||
| m9gd.large | 81 µs | 43,607 | 21,783 | 293 MiB/s | 141 MiB/s | ||
| m9g.large | 823 µs | 2,993 | 2,994 | 401 MiB/s | 401 MiB/s | ||
| r9g.large | <1 µs | 1,252,121 | 1,219,266 | 13.3 GiB/s | 8.9 GiB/s | ||
| c8g.large | 954 µs | 2,992 | 2,994 | 401 MiB/s | 401 MiB/s | ||
| Ubicloud standard | 379 µs | 223,613 | 119,660 | 886 MiB/s | 487 MiB/s | ||
| standard 4 vCPU | 594 µs | 173,246 | 46,361 | 810 MiB/s | 392 MiB/s | ||
| standard 2 vCPU | 342 µs | 93,715 | 33,743 | 892 MiB/s | 481 MiB/s | ||
| GitHub | 206 µs | 19,606 | 11,809 | 394 MiB/s | 339 MiB/s | ||
| 2-core | 232 µs | 9,376 | 6,017 | 199 MiB/s | 164 MiB/s | ||
- IOPS are 4k blocks, medians of finished jobs
- bold best disk measured on the arch (tmpfs is RAM, left out)
- , : cheaper, less durable flushes
Pick the disk per job on RunsOn
-
The instance type sets the storage under the workspace: EBS gp3 by default, provisioned gp3 for bandwidth, local NVMe
on the
dandifamilies, or tmpfs when the job fits in RAM. Pick it with thefamilylabel; each one, measured: EC2 storage benchmark. - What tmpfs does to real builds, what it costs and where it does nothing: Disks? Where we're going, we don't need disks.
How it's measured
fio runs inside the job, in GITHUB_WORKSPACE: the disk a build writes to, on the filesystem the provider
mounted there. Every runner is compared, whatever its shape.
fio settingsblock sizes, queue depths, mounts
- QD1 random read: 4k blocks, one request in flight; IOPS and p99 latency.
- Sync write: 4k writes, each followed by
fdatasync. - Random read and write: 4k blocks, 4 jobs with 32 requests in flight each.
- Sequential read and write: 1M blocks, 32 requests in flight.
- The workspace filesystem, its size and its mount options come from the job's own mount table.
- Earlier versions of this page used a different harness and other fio settings on 2 vCPU runners; those numbers are gone rather than mixed in.