quickstart →

Fastest GitHub Actions runners: disk I/O.

fio inside the job workspace of 94 runners from 9 providers, 2 to 12 vCPU. These are the disk's limits. A build goes through the Linux page cache and often never reaches them.

Fastest QD1 read, x64 at 4 vCPU 105,744 Namespace 4x8 (4 vCPU) · reads/s
Fastest QD1 read, arm64 at 4 vCPU 32,740 Blacksmith 4 vCPU · reads/s
GitHub at 4 vCPU 7,286 x64 QD1 reads/s on GitHub 4-core
Fastest synced writes, x64 at 4 vCPU 30,836 Namespace 4x8 · writes/s
tmpfs, for scale 1.2M QD1 reads/s on RunsOn r8a.2xlarge · tmpfs: the workspace in RAM

Latency per provider

Each provider's best disk, RunsOn once per storage (the Storage pill). QD1 is one 4k read at a time: what a database or a cold read pays. Most build steps batch their I/O through the page cache. tmpfs is RAM, not a disk: add it to see the gap on the same scale.

QD1 random readx64 · 4k, one request in flight · IOPS, higher is better
  1. Namespace8 vCPU8x16 · VM disk106,191, p99 10 µs, ×1.00
  2. Blacksmith2 vCPUVM disk73,779, p99 17 µs, ×0.69
  3. Avrea2 vCPUVM disk53,018, p99 14 µs, ×0.50
  4. Warpbuild2 vCPUVM disk51,593, p99 37 µs, ×0.49
  5. RunsOn2 vCPUi7i.large · local NVMe12,419, p99 289 µs, ×0.12
  6. boat2 vCPUVM disk10,663, p99 218 µs, ×0.10
  7. Ubicloud8 vCPUpremium · VM disk8,638, p99 515 µs, ×0.08
  8. GitHub8 vCPUVM disk7,529, p99 231 µs, ×0.07
  9. RunsOn4 vCPUm8a.xlarge · EBS gp31,825, p99 807 µs, ×0.02
  10. AWS CodeBuild4 vCPUmedium · EBS1,796, p99 786 µs, ×0.02

Fastest x64 QD1 read: Namespace (106,191), ahead of Blacksmith (73,779).tmpfs for scale: 1,153,982 on RunsOn r8a.2xlarge · tmpfs.

Synced writesx64 · 4k + fdatasync · IOPS, higher is better
  1. Namespace4 vCPU4x8 · VM disk30,836, p99 14 µs, ×1.00
  2. Blacksmith4 vCPUVM disk · nobarrier17,925, p99 25 µs, ×0.58
  3. RunsOn2 vCPUi7i.large · local NVMe12,910, p99 33 µs, ×0.42
  4. Avrea2 vCPUVM disk · nobarrier12,665, p99 28 µs, ×0.41
  5. GitHub4 vCPUnetwork disk · nobarrier4,163, p99 258 µs, ×0.13
  6. Warpbuild2 vCPUVM disk3,078, p99 43 µs, ×0.10
  7. Ubicloud8 vCPUpremium · VM disk · nobarrier2,698, p99 1,917 µs, ×0.09
  8. boat2 vCPUVM disk2,270, p99 358 µs, ×0.07
  9. AWS CodeBuild2 vCPUsmall · EBS571, p99 991 µs, ×0.02
  10. RunsOn2 vCPUm8azn.large · EBS gp3 · nobarrier542, p99 963 µs, ×0.02

Fastest x64 synced writes: Namespace (30,836), ahead of Blacksmith (17,925).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readx64 at 2 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Namespace2 vCPU2x8 · VM disk104,675, p99 10 µs, ×1.00
  2. Blacksmith2 vCPUVM disk73,779, p99 17 µs, ×0.70
  3. Avrea2 vCPUVM disk53,018, p99 14 µs, ×0.51
  4. Warpbuild2 vCPUVM disk51,593, p99 37 µs, ×0.49
  5. RunsOn2 vCPUi7i.large · local NVMe12,419, p99 289 µs, ×0.12
  6. boat2 vCPUVM disk10,663, p99 218 µs, ×0.10
  7. Ubicloud2 vCPUstandard · VM disk6,828, p99 763 µs, ×0.07
  8. GitHub2 vCPUVM disk6,395, p99 262 µs, ×0.06
  9. RunsOn2 vCPUc8a.large · EBS gp31,811, p99 754 µs, ×0.02
  10. AWS CodeBuild2 vCPUsmall · EBS1,762, p99 803 µs, ×0.02

Fastest x64 2 vCPU QD1 read: Namespace (104,675), ahead of Blacksmith (73,779).tmpfs for scale: 1,153,982 on RunsOn r8a.2xlarge · tmpfs.

Synced writesx64 at 2 vCPU · 4k + fdatasync · IOPS, higher is better
  1. Namespace2 vCPU2x8 · VM disk30,063, p99 14 µs, ×1.00
  2. Blacksmith2 vCPUVM disk · nobarrier17,755, p99 27 µs, ×0.59
  3. RunsOn2 vCPUi7i.large · local NVMe12,910, p99 33 µs, ×0.43
  4. Avrea2 vCPUVM disk · nobarrier12,665, p99 28 µs, ×0.42
  5. GitHub2 vCPUVM disk · nobarrier3,665, p99 209 µs, ×0.12
  6. Warpbuild2 vCPUVM disk3,078, p99 43 µs, ×0.10
  7. boat2 vCPUVM disk2,270, p99 358 µs, ×0.08
  8. Ubicloud2 vCPUpremium · VM disk · nobarrier1,444, p99 3,785 µs, ×0.05
  9. AWS CodeBuild2 vCPUsmall · EBS571, p99 991 µs, ×0.02
  10. RunsOn2 vCPUm8azn.large · EBS gp3 · nobarrier542, p99 963 µs, ×0.02

Fastest x64 2 vCPU synced writes: Namespace (30,063), ahead of Blacksmith (17,755).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readx64 at 4 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Namespace4 vCPU4x8 · VM disk105,744, p99 10 µs, ×1.00
  2. Blacksmith4 vCPUVM disk71,728, p99 16 µs, ×0.68
  3. Avrea4 vCPUVM disk49,955, p99 21 µs, ×0.47
  4. Warpbuild4 vCPUVM disk47,423, p99 31 µs, ×0.45
  5. RunsOn4 vCPUi7i.xlarge · local NVMe11,192, p99 281 µs, ×0.11
  6. boat4 vCPUVM disk8,814, p99 297 µs, ×0.08
  7. Ubicloud4 vCPUstandard · VM disk7,775, p99 713 µs, ×0.07
  8. GitHub4 vCPUnetwork disk7,286, p99 241 µs, ×0.07
  9. RunsOn4 vCPUm8a.xlarge · EBS gp31,825, p99 807 µs, ×0.02
  10. AWS CodeBuild4 vCPUmedium · EBS1,796, p99 786 µs, ×0.02

Fastest x64 4 vCPU QD1 read: Namespace (105,744), ahead of Blacksmith (71,728).tmpfs for scale: 1,153,982 on RunsOn r8a.2xlarge · tmpfs.

Synced writesx64 at 4 vCPU · 4k + fdatasync · IOPS, higher is better
  1. Namespace4 vCPU4x8 · VM disk30,836, p99 14 µs, ×1.00
  2. Blacksmith4 vCPUVM disk · nobarrier17,925, p99 25 µs, ×0.58
  3. RunsOn4 vCPUi7i.xlarge · local NVMe12,431, p99 34 µs, ×0.40
  4. Avrea4 vCPUVM disk · nobarrier12,305, p99 33 µs, ×0.40
  5. GitHub4 vCPUnetwork disk · nobarrier4,163, p99 258 µs, ×0.13
  6. Warpbuild4 vCPUVM disk2,989, p99 100 µs, ×0.10
  7. Ubicloud4 vCPUpremium · VM disk · nobarrier2,661, p99 2,052 µs, ×0.09
  8. boat4 vCPUVM disk2,235, p99 1,045 µs, ×0.07
  9. AWS CodeBuild4 vCPUmedium · EBS566, p99 983 µs, ×0.02
  10. RunsOn4 vCPUm8azn.xlarge · EBS gp3 · nobarrier541, p99 1,004 µs, ×0.02

Fastest x64 4 vCPU synced writes: Namespace (30,836), ahead of Blacksmith (17,925).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readx64 at 8 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Namespace8 vCPU8x16 · VM disk106,191, p99 10 µs, ×1.00
  2. Blacksmith8 vCPUVM disk70,703, p99 17 µs, ×0.67
  3. Avrea8 vCPUVM disk52,383, p99 18 µs, ×0.49
  4. Warpbuild8 vCPUVM disk38,684, p99 27 µs, ×0.36
  5. RunsOn8 vCPUi7i.2xlarge · local NVMe11,584, p99 324 µs, ×0.11
  6. Ubicloud8 vCPUpremium · VM disk8,638, p99 515 µs, ×0.08
  7. boat8 vCPUVM disk8,181, p99 545 µs, ×0.08
  8. GitHub8 vCPUVM disk7,529, p99 231 µs, ×0.07
  9. RunsOn8 vCPUc8a.2xlarge · EBS gp31,821, p99 897 µs, ×0.02
  10. AWS CodeBuild8 vCPUlarge · EBS1,758, p99 741 µs, ×0.02

Fastest x64 8 vCPU QD1 read: Namespace (106,191), ahead of Blacksmith (70,703).tmpfs for scale: 1,153,982 on RunsOn r8a.2xlarge · tmpfs.

Synced writesx64 at 8 vCPU · 4k + fdatasync · IOPS, higher is better
  1. Namespace8 vCPU8x32 · VM disk29,050, p99 14 µs, ×1.00
  2. Blacksmith8 vCPUVM disk · nobarrier17,670, p99 26 µs, ×0.61
  3. RunsOn8 vCPUi7i.2xlarge · local NVMe11,551, p99 39 µs, ×0.40
  4. Avrea8 vCPUVM disk · nobarrier11,105, p99 47 µs, ×0.38
  5. GitHub8 vCPUVM disk · nobarrier4,104, p99 235 µs, ×0.14
  6. Warpbuild8 vCPUVM disk2,993, p99 95 µs, ×0.10
  7. Ubicloud8 vCPUpremium · VM disk · nobarrier2,698, p99 1,917 µs, ×0.09
  8. boat8 vCPUVM disk1,390, p99 477 µs, ×0.05
  9. AWS CodeBuild8 vCPUlarge · EBS566, p99 979 µs, ×0.02
  10. RunsOn8 vCPUc8a.2xlarge · EBS gp3 · nobarrier540, p99 1,008 µs, ×0.02

Fastest x64 8 vCPU synced writes: Namespace (29,050), ahead of Blacksmith (17,670).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readarm64 · 4k, one request in flight · IOPS, higher is better
  1. Blacksmith4 vCPUVM disk32,740, p99 37 µs, ×1.00
  2. Warpbuild12 vCPUxfast (Apple M4 Pro) · VM disk30,249, p99 33 µs, ×0.92
  3. Avrea2 vCPUVM disk20,905, p99 60 µs, ×0.64
  4. Namespace2 vCPUApple silicon 2x8 · VM disk19,893, p99 78 µs, ×0.61
  5. RunsOn2 vCPUm9gd.large · local NVMe13,517, p99 81 µs, ×0.41
  6. Ubicloud8 vCPUstandard · VM disk9,388, p99 389 µs, ×0.29
  7. GitHub2 vCPUVM disk7,994, p99 215 µs, ×0.24
  8. RunsOn4 vCPUm9g.xlarge · EBS gp31,837, p99 868 µs, ×0.06
  9. Warpbuild4 vCPUEBS1,806, p99 856 µs, ×0.06

Fastest arm64 QD1 read: Blacksmith (32,740), ahead of Warpbuild (30,249).tmpfs for scale: 667,201 on RunsOn m9g.xlarge · tmpfs.

Synced writesarm64 · 4k + fdatasync · IOPS, higher is better
  1. RunsOn8 vCPUm9gd.2xlarge · local NVMe17,389, p99 20 µs, ×1.00
  2. Blacksmith8 vCPUVM disk · nobarrier9,537, p99 56 µs, ×0.55
  3. Warpbuild12 vCPUxfast (Apple M4 Pro) · VM disk · nobarrier9,354, p99 52 µs, ×0.54
  4. Ubicloud8 vCPUstandard · VM disk · nobarrier4,194, p99 807 µs, ×0.24
  5. Namespace8 vCPU8x16 · VM disk4,158, p99 164 µs, ×0.24
  6. Avrea2 vCPUVM disk3,876, p99 89 µs, ×0.22
  7. GitHub4 vCPUnetwork disk · nobarrier3,515, p99 291 µs, ×0.20
  8. RunsOn8 vCPUm9g.2xlarge · EBS gp3 · nobarrier543, p99 987 µs, ×0.03
  9. Warpbuild8 vCPUEBS · nobarrier539, p99 983 µs, ×0.03

Fastest arm64 synced writes: RunsOn m9gd.2xlarge · NVMe (17,389), ahead of Blacksmith (9,537).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readarm64 at 2 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Blacksmith2 vCPUVM disk29,968, p99 40 µs, ×1.00
  2. Avrea2 vCPUVM disk20,905, p99 60 µs, ×0.70
  3. Namespace2 vCPUApple silicon 2x8 · VM disk19,893, p99 78 µs, ×0.66
  4. RunsOn2 vCPUm9gd.large · local NVMe13,517, p99 81 µs, ×0.45
  5. Ubicloud2 vCPUstandard · VM disk8,149, p99 510 µs, ×0.27
  6. GitHub2 vCPUVM disk7,994, p99 215 µs, ×0.27
  7. RunsOn2 vCPUc8g.large · EBS gp31,803, p99 836 µs, ×0.06
  8. Warpbuild2 vCPUEBS1,793, p99 819 µs, ×0.06

Fastest arm64 2 vCPU QD1 read: Blacksmith (29,968), ahead of Avrea (20,905).tmpfs for scale: 667,201 on RunsOn m9g.xlarge · tmpfs.

Synced writesarm64 at 2 vCPU · 4k + fdatasync · IOPS, higher is better
  1. Blacksmith2 vCPUVM disk · nobarrier8,115, p99 72 µs, ×1.00
  2. RunsOn2 vCPUm9gd.large · local NVMe7,267, p99 49 µs, ×0.90
  3. Ubicloud2 vCPUstandard · VM disk · nobarrier4,031, p99 926 µs, ×0.50
  4. Avrea2 vCPUVM disk3,876, p99 89 µs, ×0.48
  5. Namespace2 vCPUApple silicon 2x8 · VM disk3,716, p99 99 µs, ×0.46
  6. GitHub2 vCPUVM disk · nobarrier3,112, p99 631 µs, ×0.38
  7. RunsOn2 vCPUm9g.large · EBS gp3 · nobarrier542, p99 971 µs, ×0.07
  8. Warpbuild2 vCPUEBS · nobarrier538, p99 987 µs, ×0.07

Fastest arm64 2 vCPU synced writes: Blacksmith (8,115), ahead of RunsOn m9gd.large · NVMe (7,267).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readarm64 at 4 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Blacksmith4 vCPUVM disk32,740, p99 37 µs, ×1.00
  2. Avrea4 vCPUVM disk19,951, p99 59 µs, ×0.61
  3. Namespace4 vCPUApple silicon 4x16 · VM disk18,736, p99 97 µs, ×0.57
  4. RunsOn4 vCPUm9gd.xlarge · local NVMe13,375, p99 111 µs, ×0.41
  5. Ubicloud4 vCPUstandard · VM disk8,705, p99 420 µs, ×0.27
  6. GitHub4 vCPUnetwork disk6,892, p99 225 µs, ×0.21
  7. RunsOn4 vCPUm9g.xlarge · EBS gp31,837, p99 868 µs, ×0.06
  8. Warpbuild4 vCPUEBS1,806, p99 856 µs, ×0.06

Fastest arm64 4 vCPU QD1 read: Blacksmith (32,740), ahead of Avrea (19,951).tmpfs for scale: 667,201 on RunsOn m9g.xlarge · tmpfs.

Synced writesarm64 at 4 vCPU · 4k + fdatasync · IOPS, higher is better
  1. RunsOn4 vCPUm9gd.xlarge · local NVMe14,860, p99 24 µs, ×1.00
  2. Blacksmith4 vCPUVM disk · nobarrier9,366, p99 64 µs, ×0.63
  3. Namespace4 vCPU4x16 · VM disk3,907, p99 176 µs, ×0.26
  4. Avrea4 vCPUVM disk3,782, p99 57 µs, ×0.25
  5. GitHub4 vCPUnetwork disk · nobarrier3,515, p99 291 µs, ×0.24
  6. Ubicloud4 vCPUstandard · VM disk · nobarrier3,293, p99 1,565 µs, ×0.22
  7. RunsOn4 vCPUm9g.xlarge · EBS gp3 · nobarrier543, p99 1,059 µs, ×0.04
  8. Warpbuild4 vCPUEBS · nobarrier539, p99 995 µs, ×0.04

Fastest arm64 4 vCPU synced writes: RunsOn m9gd.xlarge · NVMe (14,860), ahead of Blacksmith (9,366).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readarm64 at 8 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Blacksmith8 vCPUVM disk29,312, p99 36 µs, ×1.00
  2. Avrea8 vCPUVM disk20,743, p99 56 µs, ×0.71
  3. Namespace8 vCPU8x32 · VM disk16,783, p99 90 µs, ×0.57
  4. RunsOn8 vCPUm9gd.2xlarge · local NVMe13,454, p99 83 µs, ×0.46
  5. Ubicloud8 vCPUstandard · VM disk9,388, p99 389 µs, ×0.32
  6. Warpbuild8 vCPUEBS1,797, p99 823 µs, ×0.06
  7. RunsOn8 vCPUc8g.2xlarge · EBS gp31,783, p99 856 µs, ×0.06

Fastest arm64 8 vCPU QD1 read: Blacksmith (29,312), ahead of Avrea (20,743).tmpfs for scale: 667,201 on RunsOn m9g.xlarge · tmpfs.

Synced writesarm64 at 8 vCPU · 4k + fdatasync · IOPS, higher is better
  1. RunsOn8 vCPUm9gd.2xlarge · local NVMe17,389, p99 20 µs, ×1.00
  2. Blacksmith8 vCPUVM disk · nobarrier9,537, p99 56 µs, ×0.55
  3. Ubicloud8 vCPUstandard · VM disk · nobarrier4,194, p99 807 µs, ×0.24
  4. Namespace8 vCPU8x16 · VM disk4,158, p99 164 µs, ×0.24
  5. Avrea8 vCPUVM disk3,709, p99 58 µs, ×0.21
  6. RunsOn8 vCPUm9g.2xlarge · EBS gp3 · nobarrier543, p99 987 µs, ×0.03
  7. Warpbuild8 vCPUEBS · nobarrier539, p99 983 µs, ×0.03

Fastest arm64 8 vCPU synced writes: RunsOn m9gd.2xlarge · NVMe (17,389), ahead of Blacksmith (9,537).volatile and nobarrier mounts make each flush cheaper by making it less durable.

What the numbers say

Extremes on x64, and RAM against disk.

  • On x64, one small read at a time (4k, QD1) comes back 106,191 times a second on Namespace 8x16 and 1,471 on RunsOn m8a.2xlarge · EBS gp3, 72× apart; p99 latency is 10 µs against 963 µs.
  • Synced 4k writes on x64 run from 486 per second on RunsOn m8i.2xlarge · EBS gp3 (workspace mounted nobarrier) to 30,836 on Namespace 4x8.
  • r8a.large with tmpfs ($0.0009/min at spot) answers 1,106,090 QD1 reads and 428,067 synced writes per second: 90× and 33× the best local NVMe at 2 vCPU (i7i.large, $0.0010) and 611× and 791× default EBS gp3 (c8a.large, $0.0009); its workspace is 14 GiB, from RAM. (EC2 storage suite) What that does to real builds.
More findings23: EBS, arm64, NVMe vs EBS, provisioned gp3, tmpfs, storage classes
  • Every EBS-backed workspace (3 AWS CodeBuild x64 runners, 25 RunsOn configurations and 3 Warpbuild configurations) answers between 1,471 and 1,837 QD1 reads and 486 to 571 synced writes per second, whoever runs it and whatever throughput it is provisioned for: each request is a round trip to network storage.
  • On arm64, one small read at a time (4k, QD1) comes back 32,740 times a second on Blacksmith 4 vCPU and 1,702 on RunsOn m9g.large · EBS gp3, 19× apart; p99 latency is 37 µs against 905 µs.
  • Synced 4k writes on arm64 run from 537 per second on RunsOn c8g.large · EBS gp3 (workspace mounted nobarrier) to 17,389 on RunsOn m9gd.2xlarge · local NVMe.
  • Same Xeon 6975P-C CPU, different disk: m8id.2xlarge on local NVMe answers 11,025 QD1 reads and 7,516 synced writes per second, m8i.2xlarge on EBS gp3 1,565 and 486.
  • Same Xeon 6975P-C CPU, different disk: m8id.large on local NVMe answers 11,102 QD1 reads and 5,555 synced writes per second, m8i-flex.large on EBS gp3 1,771 and 530.
  • Same Xeon 6975P-C CPU, different disk: m8id.xlarge on local NVMe answers 10,866 QD1 reads and 7,903 synced writes per second, m8i-flex.xlarge on EBS gp3 1,753 and 525.
  • Same Neoverse-V3 CPU, different disk: m9gd.2xlarge on local NVMe answers 13,454 QD1 reads and 17,389 synced writes per second, m9g.2xlarge on EBS gp3 1,768 and 543.
  • Same Neoverse-V3 CPU, different disk: m9gd.xlarge on local NVMe answers 13,375 QD1 reads and 14,860 synced writes per second, m9g.xlarge on EBS gp3 1,837 and 543.
  • Same Neoverse-V3 CPU, different disk: m9gd.large on local NVMe answers 13,517 QD1 reads and 7,267 synced writes per second, m9g.large on EBS gp3 1,702 and 542.
  • Provisioning gp3 at 1000 MiB/s on m8a.2xlarge takes sequential reads from 401 MiB/s to 1,001 MiB/s (2.5×); QD1 reads go (1,587 → 1,776 IOPS).
  • Provisioning gp3 at 1000 MiB/s on m8azn.xlarge takes sequential reads from 401 MiB/s to 1,001 MiB/s (2.5×); QD1 reads go (1,583 → 1,772 IOPS).
  • tmpfs on m8a.2xlarge is not a disk at all: 1,136,061 QD1 reads and 429,749 synced writes per second, from RAM. The workspace is 29 GiB, sized by memory.
  • tmpfs on m9g.2xlarge is not a disk at all: 653,110 QD1 reads and 300,477 synced writes per second, from RAM. The workspace is 29 GiB, sized by memory.
  • tmpfs on m9g.xlarge is not a disk at all: 667,201 QD1 reads and 303,829 synced writes per second, from RAM. The workspace is 14 GiB, sized by memory.
  • tmpfs on r8a.2xlarge is not a disk at all: 1,153,982 QD1 reads and 430,608 synced writes per second, from RAM. The workspace is 59 GiB, sized by memory.
  • tmpfs on r8a.xlarge is not a disk at all: 1,102,306 QD1 reads and 433,841 synced writes per second, from RAM. The workspace is 29 GiB, sized by memory.
  • tmpfs on r9g.large is not a disk at all: 652,948 QD1 reads and 297,441 synced writes per second, from RAM. The workspace is 14 GiB, sized by memory.
  • tmpfs on r9g.xlarge is not a disk at all: 643,948 QD1 reads and 301,871 synced writes per second, from RAM. The workspace is 29 GiB, sized by memory.
  • tmpfs: 644k–1.2M QD1 reads and 297k–434k synced writes per second across 8 runners (8 RunsOn configurations).
  • VM disk: 4.8k–106k QD1 reads and 749–31k synced writes per second across 44 runners from 7 providers (6 Avrea runners, 6 Blacksmith runners, 3 boat x64 runners, 3 GitHub runners, 12 Namespace runners, 9 Ubicloud runners and 5 Warpbuild runners).
  • local NVMe: 11k–14k QD1 reads and 5.6k–17k synced writes per second across 9 runners (9 RunsOn configurations).
  • network disk: 6.9k–7.3k QD1 reads and 3.5k–4.2k synced writes per second across 2 runners (2 GitHub runners).
  • EBS: 1.5k–1.8k QD1 reads and 486–571 synced writes per second across 31 runners from 3 providers (3 AWS CodeBuild x64 runners, 25 RunsOn configurations and 3 Warpbuild configurations).

Reading these numbers

fio measures what a disk can do. Whether a job gets there depends on the job.

What each column says about a job

  • QD1 reads and synced writes: databases, SQLite-backed tests and anything that flushes each write. Every flush waits for the storage, and a network disk pays a round trip each time.
  • Random writes at depth and sequential throughput: docker build layers, package installs and cache archives. They batch their writes and run into the disk's ceiling, not its latency.
  • None of them: compile jobs. A compiler waits for the CPU, and it reads its files back from the page cache.

Every runner

Each provider's best disk first; its other machines sit behind +N more. Bars are log scale.

One request at a time 4k, 32 in flight Sequential, 1M
Runner QD1 read ↑p99 ↓Sync write ↑Read ↑Write ↑Read ↑Write ↑
x6458 runners, 9 providers
Namespace 8x16 8 vCPU 16 GB VM disk EPYC · model hidden 106,191 10 µs 27,450 931,530 546,288 4.5 GiB/s 2.9 GiB/s
8x32 8 vCPU 32 GB VM disk EPYC · model hidden 104,850 10 µs 29,050 1,095,705 569,755 5.0 GiB/s 3.4 GiB/s
4x16 4 vCPU 16 GB VM disk EPYC · model hidden 104,443 11 µs 28,561 1,202,685 564,373 5.0 GiB/s 3.4 GiB/s
4x8 4 vCPU 8 GB VM disk EPYC · model hidden 105,744 10 µs 30,836 1,209,187 607,540 5.0 GiB/s 3.4 GiB/s
2x8 2 vCPU 8 GB VM disk EPYC · model hidden 104,675 10 µs 30,063 820,729 574,093 4.5 GiB/s 3.0 GiB/s
Blacksmith 2 vCPU 8 GB VM disk EPYC · model hidden nobarrier 73,779 17 µs 17,755 703,229 166,801 5.5 GiB/s 2.0 GiB/s
8 vCPU 8 vCPU 32 GB VM disk EPYC · model hidden nobarrier 70,703 17 µs 17,670 511,769 231,934 6.4 GiB/s 1.9 GiB/s
4 vCPU 4 vCPU 16 GB VM disk EPYC · model hidden nobarrier 71,728 16 µs 17,925 728,035 218,915 7.0 GiB/s 1.7 GiB/s
Avrea 2 vCPU 8 GB VM disk EPYC 4585PX nobarrier 53,018 14 µs 12,665 564,218 245,269 16.0 GiB/s 10.6 GiB/s
8 vCPU 8 vCPU 32 GB VM disk EPYC 4585PX nobarrier 52,383 18 µs 11,105 343,658 200,865 16.8 GiB/s 11.2 GiB/s
4 vCPU 4 vCPU 16 GB VM disk EPYC 4585PX nobarrier 49,955 21 µs 12,305 453,992 236,446 15.9 GiB/s 11.0 GiB/s
Warpbuild 2 vCPU 8 GB VM disk Ryzen 9 9950X 51,593 37 µs 3,078 199,592 90,570 4.2 GiB/s 2.7 GiB/s
8 vCPU 8 vCPU 32 GB VM disk Ryzen 9 9950X 38,684 27 µs 2,993 189,921 75,793 4.4 GiB/s 3.1 GiB/s
4 vCPU 4 vCPU 16 GB VM disk Ryzen 9 9950X 47,423 31 µs 2,989 198,918 75,037 4.2 GiB/s 2.9 GiB/s
RunsOn i7i.large 2 vCPU 16 GB local NVMe Xeon 8559C 12,419 289 µs 12,910 75,023 41,231 503 MiB/s 395 MiB/s
m8azn.3xlarge 12 vCPU 48 GB EBS gp3 EPYC 9R05 nobarrier 1,802 811 µs 538 2,997 2,994 401 MiB/s 401 MiB/s
c8a.2xlarge 8 vCPU 16 GB EBS gp3 EPYC 9R45 nobarrier 1,821 897 µs 540 2,995 2,991 401 MiB/s 401 MiB/s
m8a.2xlarge 8 vCPU 32 GB tmpfs EPYC 9R45 1,136,061 <1 µs 429,749 4,238,812 3,808,170 18.6 GiB/s 9.9 GiB/s
m8a.2xlarge 8 vCPU 32 GB gp3 1000 MiB/s EPYC 9R45 nobarrier 1,774 795 µs 540 15,995 15,992 1,001 MiB/s 1,001 MiB/s
r8a.2xlarge 8 vCPU 64 GB tmpfs EPYC 9R45 1,153,982 <1 µs 430,608 4,310,049 3,831,509 18.4 GiB/s 10.0 GiB/s
m8a.2xlarge 8 vCPU 32 GB EBS gp3 EPYC 9R45 nobarrier 1,471 963 µs 540 2,995 2,991 401 MiB/s 401 MiB/s
m8azn.xlarge 4 vCPU 16 GB EBS gp3 EPYC 9R05 nobarrier 1,583 918 µs 541 2,994 2,992 401 MiB/s 401 MiB/s
m8azn.xlarge 4 vCPU 16 GB gp3 1000 MiB/s EPYC 9R05 nobarrier 1,772 799 µs 541 15,994 15,991 1,001 MiB/s 1,001 MiB/s
m8i.2xlarge 8 vCPU 32 GB EBS gp3 Xeon 6975P-C nobarrier 1,565 995 µs 486 2,993 2,994 401 MiB/s 401 MiB/s
m8id.2xlarge 8 vCPU 32 GB local NVMe Xeon 6975P-C 11,025 239 µs 7,516 134,258 67,076 905 MiB/s 432 MiB/s
m8i-flex.2xlarge 8 vCPU 32 GB EBS gp3 Xeon 6975P-C nobarrier 1,780 954 µs 518 2,993 2,995 401 MiB/s 401 MiB/s
m8a.xlarge 4 vCPU 16 GB EBS gp3 EPYC 9R45 nobarrier 1,825 807 µs 540 2,994 2,991 401 MiB/s 401 MiB/s
c8a.xlarge 4 vCPU 8 GB EBS gp3 EPYC 9R45 nobarrier 1,773 897 µs 540 2,994 2,991 401 MiB/s 401 MiB/s
i7i.2xlarge 8 vCPU 64 GB local NVMe Xeon 8559C 11,584 324 µs 11,551 300,467 165,110 2.0 GiB/s 1.5 GiB/s
r8a.xlarge 4 vCPU 32 GB tmpfs EPYC 9R45 1,102,306 <1 µs 433,841 4,201,526 3,800,170 17.8 GiB/s 9.9 GiB/s
m8azn.large 2 vCPU 8 GB EBS gp3 EPYC 9R05 nobarrier 1,782 754 µs 542 2,994 2,992 401 MiB/s 401 MiB/s
m8id.xlarge 4 vCPU 16 GB local NVMe Xeon 6975P-C 10,866 249 µs 7,903 67,090 33,526 451 MiB/s 216 MiB/s
m8i-flex.xlarge 4 vCPU 16 GB EBS gp3 Xeon 6975P-C nobarrier 1,753 918 µs 525 2,993 2,994 401 MiB/s 401 MiB/s
m8i.xlarge 4 vCPU 16 GB EBS gp3 Xeon 6975P-C nobarrier 1,666 954 µs 518 2,993 2,994 401 MiB/s 401 MiB/s
i7i.xlarge 4 vCPU 32 GB local NVMe Xeon 8559C 11,192 281 µs 12,431 150,053 82,487 1,010 MiB/s 788 MiB/s
m8a.large 2 vCPU 8 GB EBS gp3 EPYC 9R45 nobarrier 1,734 872 µs 541 2,994 2,992 401 MiB/s 401 MiB/s
r8a.large 2 vCPU 16 GB EBS gp3 EPYC 9R45 nobarrier 1,703 860 µs 541 2,995 2,992 401 MiB/s 401 MiB/s
r8a.large 2 vCPU 16 GB tmpfs EPYC 9R45 1,106,090 <1 µs 428,067 2,147,299 1,930,574 18.0 GiB/s 10.0 GiB/s
c8a.large 2 vCPU 4 GB EBS gp3 EPYC 9R45 nobarrier 1,811 754 µs 541 2,994 2,992 401 MiB/s 401 MiB/s
m8id.large 2 vCPU 8 GB local NVMe Xeon 6975P-C 11,102 167 µs 5,555 33,541 16,753 226 MiB/s 108 MiB/s
m8i.large 2 vCPU 8 GB EBS gp3 Xeon 6975P-C nobarrier 1,625 987 µs 535 2,993 2,994 401 MiB/s 401 MiB/s
m8i-flex.large 2 vCPU 8 GB EBS gp3 Xeon 6975P-C nobarrier 1,771 881 µs 530 2,993 2,994 401 MiB/s 401 MiB/s
t8i.medium 2 vCPU 4 GB EBS gp3 Xeon 6975P-C nobarrier 1,737 827 µs 523 3,001 2,998 401 MiB/s 401 MiB/s
boat 2 vCPU 4 GB VM disk Ryzen 7 9700X 10,663 218 µs 2,270 460,252 120,989 10.2 GiB/s 832 MiB/s
8 vCPU 8 vCPU 16 GB VM disk EPYC 4585PX 8,181 545 µs 1,390 309,424 85,110 8.1 GiB/s 1,020 MiB/s
4 vCPU 4 vCPU 8 GB VM disk Ryzen 9 9950X 8,814 297 µs 2,235 385,820 154,383 7.8 GiB/s 1.3 GiB/s
Ubicloud premium 8 vCPU 32 GB VM disk Ryzen 9 7950X3D nobarrier 8,638 515 µs 2,698 289,856 19,284 2.9 GiB/s 993 MiB/s
standard 8 vCPU 8 vCPU 32 GB VM disk Ryzen 9 7950X3D nobarrier 8,526 587 µs 2,039 258,356 20,072 2.6 GiB/s 989 MiB/s
standard 4 vCPU 4 vCPU 16 GB VM disk EPYC 9454P nobarrier 7,775 713 µs 1,622 176,445 24,130 2.4 GiB/s 620 MiB/s
premium 4 vCPU 4 vCPU 16 GB VM disk Ryzen 9 7950X3D nobarrier 7,621 860 µs 2,661 224,242 23,696 2.3 GiB/s 902 MiB/s
standard 2 vCPU 2 vCPU 8 GB VM disk EPYC 9454P nobarrier 6,828 763 µs 749 128,623 23,218 2.4 GiB/s 710 MiB/s
premium 2 vCPU 2 vCPU 8 GB VM disk Ryzen 9 7950X3D nobarrier 4,832 1,733 µs 1,444 116,749 23,514 2.5 GiB/s 832 MiB/s
GitHub 8 vCPU 32 GB VM disk EPYC 9V45 nobarrier 7,529 231 µs 4,104 38,976 18,540 784 MiB/s 540 MiB/s
4-core 4 vCPU 16 GB network disk Xeon 8573C nobarrier 7,286 241 µs 4,163 19,575 11,216 394 MiB/s 244 MiB/s
2-core 2 vCPU 8 GB VM disk Xeon 8573C nobarrier 6,395 262 µs 3,665 9,377 8,367 199 MiB/s 166 MiB/s
AWS CodeBuild medium 4 vCPU 8 GB EBS Xeon 8488C 1,796 786 µs 566 2,992 2,974 241 MiB/s 251 MiB/s
large 8 vCPU 16 GB EBS Xeon 8488C 1,758 741 µs 566 2,989 2,977 243 MiB/s 251 MiB/s
small 2 vCPU 3 GB EBS Xeon 8488C 1,762 803 µs 571 2,988 2,972 251 MiB/s 251 MiB/s
arm6436 runners, 7 providers
Blacksmith 4 vCPU 16 GB VM disk Ampere-1a nobarrier 32,740 37 µs 9,366 253,175 35,622 1.7 GiB/s 829 MiB/s
8 vCPU 8 vCPU 32 GB VM disk Ampere-1a nobarrier 29,312 36 µs 9,537 251,923 32,466 1.7 GiB/s 837 MiB/s
2 vCPU 2 vCPU 6 GB VM disk Ampere-1a nobarrier 29,968 40 µs 8,115 250,107 32,701 1.7 GiB/s 832 MiB/s
Warpbuild xfast (Apple M4 Pro) 12 vCPU 28 GB VM disk nobarrier 30,249 33 µs 9,354 383,964 5,773 11.0 GiB/s 11.6 GiB/s
xfast (Apple M4 Pro) 6 vCPU 6 vCPU 14 GB VM disk nobarrier 29,877 48 µs 9,327 362,075 5,561 12.2 GiB/s 10.8 GiB/s
8 vCPU 8 vCPU 32 GB EBS Neoverse-V2 nobarrier 1,797 823 µs 539 4,995 4,993 401 MiB/s 401 MiB/s
4 vCPU 4 vCPU 16 GB EBS Neoverse-V2 nobarrier 1,806 856 µs 539 4,194 4,193 302 MiB/s 302 MiB/s
2 vCPU 2 vCPU 8 GB EBS Neoverse-V2 nobarrier 1,793 819 µs 538 4,194 4,194 302 MiB/s 301 MiB/s
Avrea 2 vCPU 8 GB VM disk Apple M5 Max · as stated by the provider 20,905 60 µs 3,876 152,164 17,974 31.1 GiB/s 14.7 GiB/s
8 vCPU 8 vCPU 32 GB VM disk Apple M5 Max · as stated by the provider 20,743 56 µs 3,709 143,512 14,241 40.1 GiB/s 16.0 GiB/s
4 vCPU 4 vCPU 16 GB VM disk Apple M5 Max · as stated by the provider 19,951 59 µs 3,782 147,857 16,821 36.8 GiB/s 15.6 GiB/s
Namespace Apple silicon 2x8 2 vCPU 8 GB VM disk CPU not reported 19,893 78 µs 3,716 153,165 15,192 31.2 GiB/s 11.8 GiB/s
Apple silicon 4x16 4 vCPU 16 GB VM disk CPU not reported 18,736 97 µs 3,380 145,293 23,426 32.6 GiB/s 12.7 GiB/s
8x32 8 vCPU 32 GB VM disk Ampere-1a 16,783 90 µs 3,945 183,882 50,801 919 MiB/s 772 MiB/s
8x16 8 vCPU 16 GB VM disk Ampere-1a 16,692 94 µs 4,158 183,210 39,558 923 MiB/s 695 MiB/s
4x8 4 vCPU 8 GB VM disk Ampere-1a 16,634 92 µs 3,812 142,916 37,163 930 MiB/s 650 MiB/s
4x16 4 vCPU 16 GB VM disk Ampere-1a 16,447 94 µs 3,907 147,080 34,602 932 MiB/s 680 MiB/s
2x8 2 vCPU 8 GB VM disk Ampere-1a 15,910 103 µs 3,702 75,288 25,671 924 MiB/s 663 MiB/s
RunsOn m9gd.large 2 vCPU 8 GB local NVMe Neoverse-V3 13,517 81 µs 7,267 43,609 21,784 293 MiB/s 141 MiB/s
m9gd.2xlarge 8 vCPU 32 GB local NVMe Neoverse-V3 13,454 83 µs 17,389 174,573 87,209 1.1 GiB/s 561 MiB/s
m9g.2xlarge 8 vCPU 32 GB EBS gp3 Neoverse-V3 nobarrier 1,768 901 µs 543 2,995 2,992 401 MiB/s 401 MiB/s
m9g.2xlarge 8 vCPU 32 GB tmpfs Neoverse-V3 653,110 <1 µs 300,477 2,615,598 2,487,852 13.0 GiB/s 9.1 GiB/s
c8g.2xlarge 8 vCPU 16 GB EBS gp3 Neoverse-V2 nobarrier 1,783 856 µs 539 2,994 2,993 401 MiB/s 401 MiB/s
m9gd.xlarge 4 vCPU 16 GB local NVMe Neoverse-V3 13,375 111 µs 14,860 87,221 43,591 585 MiB/s 281 MiB/s
m9g.xlarge 4 vCPU 16 GB EBS gp3 Neoverse-V3 nobarrier 1,837 868 µs 543 2,994 2,992 401 MiB/s 401 MiB/s
r9g.xlarge 4 vCPU 32 GB tmpfs Neoverse-V3 643,948 <1 µs 301,871 2,605,268 2,485,222 14.0 GiB/s 8.9 GiB/s
m9g.xlarge 4 vCPU 16 GB tmpfs Neoverse-V3 667,201 <1 µs 303,829 2,686,147 2,522,480 14.7 GiB/s 9.3 GiB/s
c8g.xlarge 4 vCPU 8 GB EBS gp3 Neoverse-V2 nobarrier 1,803 860 µs 538 2,992 2,994 401 MiB/s 401 MiB/s
m9g.large 2 vCPU 8 GB EBS gp3 Neoverse-V3 nobarrier 1,702 905 µs 542 2,993 2,994 401 MiB/s 401 MiB/s
r9g.large 2 vCPU 16 GB tmpfs Neoverse-V3 652,948 <1 µs 297,441 1,277,889 1,234,447 13.8 GiB/s 9.2 GiB/s
c8g.large 2 vCPU 4 GB EBS gp3 Neoverse-V2 nobarrier 1,803 836 µs 537 2,993 2,993 401 MiB/s 401 MiB/s
Ubicloud standard 8 vCPU 32 GB VM disk Neoverse-N1 nobarrier 9,388 389 µs 4,194 234,460 77,711 755 MiB/s 509 MiB/s
standard 4 vCPU 4 vCPU 16 GB VM disk Neoverse-N1 nobarrier 8,705 420 µs 3,293 147,368 34,056 738 MiB/s 379 MiB/s
standard 2 vCPU 2 vCPU 8 GB VM disk Neoverse-N1 nobarrier 8,149 510 µs 4,031 98,852 28,872 761 MiB/s 414 MiB/s
GitHub 2 vCPU 8 GB VM disk Neoverse-V3 nobarrier 7,994 215 µs 3,112 9,376 6,264 199 MiB/s 164 MiB/s
4-core 4 vCPU 16 GB network disk Neoverse-N2 nobarrier 6,892 225 µs 3,515 19,575 12,113 394 MiB/s 325 MiB/s
  • IOPS are 4k blocks, medians of finished jobs
  • bold best disk measured on the arch (tmpfs is RAM, left out)
  • volatile, nobarrier: cheaper, less durable flushes

Pick the disk per job on RunsOn

How it's measured

Methodology

fio runs inside the job, in GITHUB_WORKSPACE: the disk a build writes to, on the filesystem the provider mounted there. Every runner is compared, whatever its shape.

fio settingsblock sizes, queue depths, mounts
  • QD1 random read: 4k blocks, one request in flight; IOPS and p99 latency.
  • Sync write: 4k writes, each followed by fdatasync.
  • Random read and write: 4k blocks, 4 jobs with 32 requests in flight each.
  • Sequential read and write: 1M blocks, 32 requests in flight.
  • The workspace filesystem, its size and its mount options come from the job's own mount table.
  • Earlier versions of this page used a different harness and other fio settings on 2 vCPU runners; those numbers are gone rather than mixed in.