quickstart →

Fastest GitHub Actions runners: disk I/O.

fio inside the job workspace of 102 runners from 11 providers, 2 to 12 vCPU. These are the disk's limits. A build goes through the Linux page cache and often never reaches them.

Fastest QD1 read, x64 at 4 vCPU 104,646 Namespace 4x8 (4 vCPU) · reads/s
Fastest QD1 read, arm64 at 4 vCPU 32,691 Blacksmith 4 vCPU · reads/s
GitHub at 4 vCPU 7,332 x64 QD1 reads/s on GitHub 4-core
Fastest synced writes, x64 at 4 vCPU 29,746 Namespace 4x8 · writes/s
tmpfs, for scale 1.2M QD1 reads/s on RunsOn r8a.2xlarge · tmpfs: the workspace in RAM

Latency per provider

Each provider's best disk, RunsOn once per storage (the Storage pill). QD1 is one 4k read at a time: what a database or a cold read pays. Most build steps batch their I/O through the page cache. tmpfs is RAM, not a disk: add it to see the gap on the same scale.

QD1 random readx64 · 4k, one request in flight · IOPS, higher is better
  1. Namespace8 vCPU8x32 · VM disk106,228, p99 10 µs, ×1.00
  2. Blacksmith4 vCPUVM disk82,000, p99 16 µs, ×0.77
  3. Warpbuild4 vCPUVM disk63,558, p99 22 µs, ×0.60
  4. Avrea2 vCPUVM disk53,598, p99 14 µs, ×0.50
  5. StarSling8 vCPUVM disk52,058, p99 22 µs, ×0.49
  6. Warpbuild8 vCPUEBS37,153, p99 29 µs, ×0.35
  7. RunsOn2 vCPUi7i.large · local NVMe12,510, p99 293 µs, ×0.12
  8. boat8 vCPUVM disk11,383, p99 158 µs, ×0.11
  9. Ubicloud8 vCPUpremium · VM disk9,543, p99 338 µs, ×0.09
  10. GitHub8 vCPUVM disk7,559, p99 224 µs, ×0.07
  11. RunsOn4 vCPUm8a.xlarge · EBS gp31,820, p99 799 µs, ×0.02
  12. AWS CodeBuild4 vCPUmedium · EBS1,794, p99 733 µs, ×0.02
  13. Sengi8 vCPUpremium · VM disk13,912, p99 81 µs, 1 run

Faded: provisional, under 3 runs, not ranked.

Fastest x64 QD1 read: Namespace (106,228), ahead of Blacksmith (82,000).tmpfs for scale: 1,150,238 on RunsOn r8a.2xlarge · tmpfs.

Synced writesx64 · 4k + fdatasync · IOPS, higher is better
  1. Namespace2 vCPU2x8 · VM disk31,543, p99 13 µs, ×1.00
  2. StarSling4 vCPUVM disk24,988, p99 41 µs, ×0.79
  3. Blacksmith8 vCPUVM disk · nobarrier18,082, p99 25 µs, ×0.57
  4. RunsOn2 vCPUi7i.large · local NVMe12,959, p99 33 µs, ×0.41
  5. Avrea2 vCPUVM disk · nobarrier12,521, p99 29 µs, ×0.40
  6. GitHub8 vCPUVM disk · nobarrier4,270, p99 208 µs, ×0.14
  7. Warpbuild8 vCPUEBS · nobarrier2,984, p99 85 µs, ×0.09
  8. Ubicloud8 vCPUpremium · VM disk · nobarrier2,822, p99 1,843 µs, ×0.09
  9. Warpbuild4 vCPUVM disk2,759, p99 138 µs, ×0.09
  10. boat8 vCPUVM disk · nobarrier2,368, p99 151 µs, ×0.08
  11. AWS CodeBuild2 vCPUsmall · EBS571, p99 987 µs, ×0.02
  12. RunsOn2 vCPUm8azn.large · EBS gp3 · nobarrier542, p99 963 µs, ×0.02
  13. Sengi2 vCPUpremium · VM disk14,279, p99 25 µs, 1 run

Faded: provisional, under 3 runs, not ranked.

Fastest x64 synced writes: Namespace (31,543), ahead of StarSling (24,988).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readx64 at 2 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Namespace2 vCPU2x8 · VM disk105,054, p99 10 µs, ×1.00
  2. Blacksmith2 vCPUVM disk71,426, p99 19 µs, ×0.68
  3. Avrea2 vCPUVM disk53,598, p99 14 µs, ×0.51
  4. Warpbuild2 vCPUVM disk24,481, p99 45 µs, ×0.23
  5. RunsOn2 vCPUi7i.large · local NVMe12,510, p99 293 µs, ×0.12
  6. boat2 vCPUVM disk10,783, p99 183 µs, ×0.10
  7. Ubicloud2 vCPUstandard · VM disk6,889, p99 436 µs, ×0.07
  8. GitHub2 vCPUVM disk6,868, p99 272 µs, ×0.07
  9. RunsOn2 vCPUc8a.large · EBS gp31,803, p99 766 µs, ×0.02
  10. AWS CodeBuild2 vCPUsmall · EBS1,763, p99 815 µs, ×0.02
  11. Sengi2 vCPUpremium · VM disk13,893, p99 84 µs, 1 run

Faded: provisional, under 3 runs, not ranked.

Fastest x64 2 vCPU QD1 read: Namespace (105,054), ahead of Blacksmith (71,426).tmpfs for scale: 1,150,238 on RunsOn r8a.2xlarge · tmpfs.

Synced writesx64 at 2 vCPU · 4k + fdatasync · IOPS, higher is better
  1. Namespace2 vCPU2x8 · VM disk31,543, p99 13 µs, ×1.00
  2. Blacksmith2 vCPUVM disk · nobarrier16,231, p99 28 µs, ×0.51
  3. RunsOn2 vCPUi7i.large · local NVMe12,959, p99 33 µs, ×0.41
  4. Avrea2 vCPUVM disk · nobarrier12,521, p99 29 µs, ×0.40
  5. GitHub2 vCPUVM disk · nobarrier3,862, p99 206 µs, ×0.12
  6. boat2 vCPUVM disk · nobarrier2,355, p99 273 µs, ×0.07
  7. Warpbuild2 vCPUVM disk2,287, p99 58 µs, ×0.07
  8. Ubicloud2 vCPUpremium · VM disk · nobarrier1,935, p99 3,260 µs, ×0.06
  9. AWS CodeBuild2 vCPUsmall · EBS571, p99 987 µs, ×0.02
  10. RunsOn2 vCPUm8azn.large · EBS gp3 · nobarrier542, p99 963 µs, ×0.02
  11. Sengi2 vCPUpremium · VM disk14,279, p99 25 µs, 1 run

Faded: provisional, under 3 runs, not ranked.

Fastest x64 2 vCPU synced writes: Namespace (31,543), ahead of Blacksmith (16,231).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readx64 at 4 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Namespace4 vCPU4x8 · VM disk104,646, p99 11 µs, ×1.00
  2. Blacksmith4 vCPUVM disk82,000, p99 16 µs, ×0.78
  3. Warpbuild4 vCPUVM disk63,558, p99 22 µs, ×0.61
  4. Avrea4 vCPUVM disk49,550, p99 21 µs, ×0.47
  5. StarSling4 vCPUVM disk32,038, p99 30 µs, ×0.31
  6. RunsOn4 vCPUi7i.xlarge · local NVMe11,950, p99 210 µs, ×0.11
  7. boat4 vCPUVM disk10,338, p99 198 µs, ×0.10
  8. Ubicloud4 vCPUpremium · VM disk7,801, p99 725 µs, ×0.07
  9. GitHub4 vCPUnetwork disk7,332, p99 226 µs, ×0.07
  10. RunsOn4 vCPUm8a.xlarge · EBS gp31,820, p99 799 µs, ×0.02
  11. AWS CodeBuild4 vCPUmedium · EBS1,794, p99 733 µs, ×0.02
  12. Sengi4 vCPUpremium · VM disk13,632, p99 111 µs, 1 run

Faded: provisional, under 3 runs, not ranked.

Fastest x64 4 vCPU QD1 read: Namespace (104,646), ahead of Blacksmith (82,000).tmpfs for scale: 1,150,238 on RunsOn r8a.2xlarge · tmpfs.

Synced writesx64 at 4 vCPU · 4k + fdatasync · IOPS, higher is better
  1. Namespace4 vCPU4x8 · VM disk29,746, p99 14 µs, ×1.00
  2. StarSling4 vCPUVM disk24,988, p99 41 µs, ×0.84
  3. Blacksmith4 vCPUVM disk · nobarrier17,485, p99 26 µs, ×0.59
  4. RunsOn4 vCPUi7i.xlarge · local NVMe12,565, p99 35 µs, ×0.42
  5. Avrea4 vCPUVM disk · nobarrier12,224, p99 35 µs, ×0.41
  6. GitHub4 vCPUnetwork disk · nobarrier4,203, p99 247 µs, ×0.14
  7. Warpbuild4 vCPUVM disk2,759, p99 138 µs, ×0.09
  8. Ubicloud4 vCPUpremium · VM disk · nobarrier2,724, p99 1,942 µs, ×0.09
  9. boat4 vCPUVM disk · nobarrier2,338, p99 617 µs, ×0.08
  10. AWS CodeBuild4 vCPUmedium · EBS565, p99 979 µs, ×0.02
  11. RunsOn4 vCPUm8azn.xlarge · EBS gp3 · nobarrier541, p99 995 µs, ×0.02
  12. Sengi4 vCPUpremium · VM disk9,159, p99 51 µs, 1 run

Faded: provisional, under 3 runs, not ranked.

Fastest x64 4 vCPU synced writes: Namespace (29,746), ahead of StarSling (24,988).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readx64 at 8 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Namespace8 vCPU8x32 · VM disk106,228, p99 10 µs, ×1.00
  2. Blacksmith8 vCPUVM disk74,095, p99 16 µs, ×0.70
  3. Avrea8 vCPUVM disk52,121, p99 17 µs, ×0.49
  4. StarSling8 vCPUVM disk52,058, p99 22 µs, ×0.49
  5. Warpbuild8 vCPUEBS37,153, p99 29 µs, ×0.35
  6. boat8 vCPUVM disk11,383, p99 158 µs, ×0.11
  7. RunsOn8 vCPUm8id.2xlarge · local NVMe11,083, p99 230 µs, ×0.10
  8. Ubicloud8 vCPUpremium · VM disk9,543, p99 338 µs, ×0.09
  9. GitHub8 vCPUVM disk7,559, p99 224 µs, ×0.07
  10. RunsOn8 vCPUc8a.2xlarge · EBS gp31,807, p99 897 µs, ×0.02
  11. AWS CodeBuild8 vCPUlarge · EBS1,758, p99 758 µs, ×0.02
  12. Sengi8 vCPUpremium · VM disk13,912, p99 81 µs, 1 run

Faded: provisional, under 3 runs, not ranked.

Fastest x64 8 vCPU QD1 read: Namespace (106,228), ahead of Blacksmith (74,095).tmpfs for scale: 1,150,238 on RunsOn r8a.2xlarge · tmpfs.

Synced writesx64 at 8 vCPU · 4k + fdatasync · IOPS, higher is better
  1. Namespace8 vCPU8x32 · VM disk28,970, p99 14 µs, ×1.00
  2. Blacksmith8 vCPUVM disk · nobarrier18,082, p99 25 µs, ×0.62
  3. RunsOn8 vCPUi7i.2xlarge · local NVMe11,551, p99 39 µs, ×0.40
  4. Avrea8 vCPUVM disk · nobarrier11,059, p99 48 µs, ×0.38
  5. GitHub8 vCPUVM disk · nobarrier4,270, p99 208 µs, ×0.15
  6. StarSling8 vCPUVM disk3,466, p99 31 µs, ×0.12
  7. Warpbuild8 vCPUEBS · nobarrier2,984, p99 85 µs, ×0.10
  8. Ubicloud8 vCPUpremium · VM disk · nobarrier2,822, p99 1,843 µs, ×0.10
  9. boat8 vCPUVM disk · nobarrier2,368, p99 151 µs, ×0.08
  10. AWS CodeBuild8 vCPUlarge · EBS566, p99 987 µs, ×0.02
  11. RunsOn8 vCPUc8a.2xlarge · EBS gp3 · nobarrier540, p99 1,012 µs, ×0.02
  12. Sengi8 vCPUpremium · VM disk9,146, p99 43 µs, 1 run

Faded: provisional, under 3 runs, not ranked.

Fastest x64 8 vCPU synced writes: Namespace (28,970), ahead of Blacksmith (18,082).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readarm64 · 4k, one request in flight · IOPS, higher is better
  1. Blacksmith4 vCPUVM disk32,691, p99 37 µs, ×1.00
  2. Warpbuild12 vCPUxfast (Apple M4 Pro) · VM disk30,102, p99 33 µs, ×0.92
  3. Avrea2 vCPUVM disk20,909, p99 60 µs, ×0.64
  4. Namespace2 vCPUApple silicon 2x8 · VM disk19,829, p99 78 µs, ×0.61
  5. RunsOn2 vCPUm9gd.large · local NVMe13,533, p99 81 µs, ×0.41
  6. Ubicloud8 vCPUstandard · VM disk8,453, p99 424 µs, ×0.26
  7. GitHub2 vCPUVM disk8,119, p99 214 µs, ×0.25
  8. RunsOn4 vCPUm9g.xlarge · EBS gp31,837, p99 856 µs, ×0.06
  9. Warpbuild4 vCPUEBS1,812, p99 848 µs, ×0.06

Fastest arm64 QD1 read: Blacksmith (32,691), ahead of Warpbuild (30,102).tmpfs for scale: 667,201 on RunsOn m9g.xlarge · tmpfs.

Synced writesarm64 · 4k + fdatasync · IOPS, higher is better
  1. RunsOn8 vCPUm9gd.2xlarge · local NVMe17,361, p99 20 µs, ×1.00
  2. Blacksmith8 vCPUVM disk · nobarrier9,981, p99 56 µs, ×0.57
  3. Warpbuild12 vCPUxfast (Apple M4 Pro) · VM disk · nobarrier9,352, p99 62 µs, ×0.54
  4. Namespace8 vCPU8x16 · VM disk4,158, p99 161 µs, ×0.24
  5. Ubicloud2 vCPUstandard · VM disk · nobarrier4,024, p99 848 µs, ×0.23
  6. Avrea2 vCPUVM disk3,880, p99 58 µs, ×0.22
  7. GitHub4 vCPUnetwork disk · nobarrier3,483, p99 293 µs, ×0.20
  8. RunsOn8 vCPUm9g.2xlarge · EBS gp3 · nobarrier543, p99 995 µs, ×0.03
  9. Warpbuild8 vCPUEBS · nobarrier539, p99 995 µs, ×0.03

Fastest arm64 synced writes: RunsOn m9gd.2xlarge · NVMe (17,361), ahead of Blacksmith (9,981).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readarm64 at 2 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Blacksmith2 vCPUVM disk31,028, p99 39 µs, ×1.00
  2. Avrea2 vCPUVM disk20,909, p99 60 µs, ×0.67
  3. Namespace2 vCPUApple silicon 2x8 · VM disk19,829, p99 78 µs, ×0.64
  4. RunsOn2 vCPUm9gd.large · local NVMe13,533, p99 81 µs, ×0.44
  5. Ubicloud2 vCPUstandard · VM disk8,452, p99 461 µs, ×0.27
  6. GitHub2 vCPUVM disk8,119, p99 214 µs, ×0.26
  7. RunsOn2 vCPUm9g.large · EBS gp31,789, p99 848 µs, ×0.06
  8. Warpbuild2 vCPUEBS1,779, p99 799 µs, ×0.06

Fastest arm64 2 vCPU QD1 read: Blacksmith (31,028), ahead of Avrea (20,909).tmpfs for scale: 667,201 on RunsOn m9g.xlarge · tmpfs.

Synced writesarm64 at 2 vCPU · 4k + fdatasync · IOPS, higher is better
  1. Blacksmith2 vCPUVM disk · nobarrier8,442, p99 71 µs, ×1.00
  2. RunsOn2 vCPUm9gd.large · local NVMe7,267, p99 49 µs, ×0.86
  3. Ubicloud2 vCPUstandard · VM disk · nobarrier4,024, p99 848 µs, ×0.48
  4. Avrea2 vCPUVM disk3,880, p99 58 µs, ×0.46
  5. Namespace2 vCPUApple silicon 2x8 · VM disk3,706, p99 98 µs, ×0.44
  6. GitHub2 vCPUVM disk · nobarrier3,115, p99 627 µs, ×0.37
  7. RunsOn2 vCPUm9g.large · EBS gp3 · nobarrier542, p99 971 µs, ×0.06
  8. Warpbuild2 vCPUEBS · nobarrier538, p99 987 µs, ×0.06

Fastest arm64 2 vCPU synced writes: Blacksmith (8,442), ahead of RunsOn m9gd.large · NVMe (7,267).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readarm64 at 4 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Blacksmith4 vCPUVM disk32,691, p99 37 µs, ×1.00
  2. Avrea4 vCPUVM disk20,301, p99 58 µs, ×0.62
  3. Namespace4 vCPUApple silicon 4x16 · VM disk18,570, p99 90 µs, ×0.57
  4. RunsOn4 vCPUm9gd.xlarge · local NVMe13,368, p99 116 µs, ×0.41
  5. Ubicloud4 vCPUstandard · VM disk8,334, p99 498 µs, ×0.25
  6. GitHub4 vCPUnetwork disk7,694, p99 228 µs, ×0.24
  7. RunsOn4 vCPUm9g.xlarge · EBS gp31,837, p99 856 µs, ×0.06
  8. Warpbuild4 vCPUEBS1,812, p99 848 µs, ×0.06

Fastest arm64 4 vCPU QD1 read: Blacksmith (32,691), ahead of Avrea (20,301).tmpfs for scale: 667,201 on RunsOn m9g.xlarge · tmpfs.

Synced writesarm64 at 4 vCPU · 4k + fdatasync · IOPS, higher is better
  1. RunsOn4 vCPUm9gd.xlarge · local NVMe14,867, p99 24 µs, ×1.00
  2. Blacksmith4 vCPUVM disk · nobarrier9,201, p99 69 µs, ×0.62
  3. Namespace4 vCPU4x16 · VM disk3,945, p99 175 µs, ×0.27
  4. Avrea4 vCPUVM disk3,694, p99 58 µs, ×0.25
  5. GitHub4 vCPUnetwork disk · nobarrier3,483, p99 293 µs, ×0.23
  6. Ubicloud4 vCPUstandard · VM disk · nobarrier2,434, p99 1,696 µs, ×0.16
  7. RunsOn4 vCPUm9g.xlarge · EBS gp3 · nobarrier543, p99 1,059 µs, ×0.04
  8. Warpbuild4 vCPUEBS · nobarrier539, p99 995 µs, ×0.04

Fastest arm64 4 vCPU synced writes: RunsOn m9gd.xlarge · NVMe (14,867), ahead of Blacksmith (9,201).volatile and nobarrier mounts make each flush cheaper by making it less durable.

QD1 random readarm64 at 8 vCPU · 4k, one request in flight · IOPS, higher is better
  1. Blacksmith8 vCPUVM disk31,905, p99 35 µs, ×1.00
  2. Avrea8 vCPUVM disk20,397, p99 57 µs, ×0.64
  3. Namespace8 vCPU8x16 · VM disk17,452, p99 86 µs, ×0.55
  4. RunsOn8 vCPUm9gd.2xlarge · local NVMe13,462, p99 82 µs, ×0.42
  5. Ubicloud8 vCPUstandard · VM disk8,453, p99 424 µs, ×0.26
  6. Warpbuild8 vCPUEBS1,781, p99 864 µs, ×0.06
  7. RunsOn8 vCPUm9g.2xlarge · EBS gp31,723, p99 954 µs, ×0.05

Fastest arm64 8 vCPU QD1 read: Blacksmith (31,905), ahead of Avrea (20,397).tmpfs for scale: 667,201 on RunsOn m9g.xlarge · tmpfs.

Synced writesarm64 at 8 vCPU · 4k + fdatasync · IOPS, higher is better
  1. RunsOn8 vCPUm9gd.2xlarge · local NVMe17,361, p99 20 µs, ×1.00
  2. Blacksmith8 vCPUVM disk · nobarrier9,981, p99 56 µs, ×0.57
  3. Namespace8 vCPU8x16 · VM disk4,158, p99 161 µs, ×0.24
  4. Avrea8 vCPUVM disk3,688, p99 58 µs, ×0.21
  5. Ubicloud8 vCPUstandard · VM disk · nobarrier3,147, p99 946 µs, ×0.18
  6. RunsOn8 vCPUm9g.2xlarge · EBS gp3 · nobarrier543, p99 995 µs, ×0.03
  7. Warpbuild8 vCPUEBS · nobarrier539, p99 995 µs, ×0.03

Fastest arm64 8 vCPU synced writes: RunsOn m9gd.2xlarge · NVMe (17,361), ahead of Blacksmith (9,981).volatile and nobarrier mounts make each flush cheaper by making it less durable.

What the numbers say

Extremes on x64, and RAM against disk.

  • On x64, one small read at a time (4k, QD1) comes back 106,228 times a second on Namespace 8x32 and 1,511 on RunsOn m8a.2xlarge · EBS gp3, 70× apart; p99 latency is 10 µs against 930 µs.
  • Synced 4k writes on x64 run from 487 per second on RunsOn m8i.2xlarge · EBS gp3 (workspace mounted nobarrier) to 31,543 on Namespace 2x8.
  • r8a.large with tmpfs ($0.0008/min at spot) answers 1,100,344 QD1 reads and 428,125 synced writes per second: 90× and 33× the best local NVMe at 2 vCPU (i7i.large, $0.0009) and 610× and 791× default EBS gp3 (c8a.large, $0.0008); its workspace is 14 GiB, from RAM. (EC2 storage suite) What that does to real builds.
More findings22: arm64, NVMe vs EBS, provisioned gp3, tmpfs, storage classes
  • On arm64, one small read at a time (4k, QD1) comes back 32,691 times a second on Blacksmith 4 vCPU and 1,697 on RunsOn c8g.2xlarge · EBS gp3, 19× apart; p99 latency is 37 µs against 856 µs.
  • Synced 4k writes on arm64 run from 537 per second on RunsOn c8g.large · EBS gp3 (workspace mounted nobarrier) to 17,361 on RunsOn m9gd.2xlarge · local NVMe.
  • Same Xeon 6975P-C CPU, different disk: m8id.2xlarge on local NVMe answers 11,083 QD1 reads and 7,619 synced writes per second, m8i.2xlarge on EBS gp3 1,568 and 487.
  • Same Xeon 6975P-C CPU, different disk: m8id.large on local NVMe answers 11,102 QD1 reads and 5,555 synced writes per second, m8i-flex.large on EBS gp3 1,774 and 528.
  • Same Xeon 6975P-C CPU, different disk: m8id.xlarge on local NVMe answers 10,813 QD1 reads and 7,901 synced writes per second, m8i-flex.xlarge on EBS gp3 1,756 and 525.
  • Same Neoverse-V3 CPU, different disk: m9gd.2xlarge on local NVMe answers 13,462 QD1 reads and 17,361 synced writes per second, m9g.2xlarge on EBS gp3 1,723 and 543.
  • Same Neoverse-V3 CPU, different disk: m9gd.xlarge on local NVMe answers 13,368 QD1 reads and 14,867 synced writes per second, m9g.xlarge on EBS gp3 1,837 and 543.
  • Same Neoverse-V3 CPU, different disk: m9gd.large on local NVMe answers 13,533 QD1 reads and 7,267 synced writes per second, m9g.large on EBS gp3 1,789 and 542.
  • Provisioning gp3 at 1000 MiB/s on m8a.2xlarge takes sequential reads from 401 MiB/s to 1,001 MiB/s (2.5×); QD1 reads go (1,587 → 1,776 IOPS).
  • Provisioning gp3 at 1000 MiB/s on m8azn.xlarge takes sequential reads from 401 MiB/s to 1,001 MiB/s (2.5×); QD1 reads barely move (1,769 → 1,771 IOPS): it buys bandwidth, not latency.
  • tmpfs on m8a.2xlarge is not a disk at all: 1,137,009 QD1 reads and 428,937 synced writes per second, from RAM. The workspace is 29 GiB, sized by memory.
  • tmpfs on m9g.2xlarge is not a disk at all: 653,126 QD1 reads and 300,592 synced writes per second, from RAM. The workspace is 29 GiB, sized by memory.
  • tmpfs on m9g.xlarge is not a disk at all: 667,201 QD1 reads and 303,876 synced writes per second, from RAM. The workspace is 14 GiB, sized by memory.
  • tmpfs on r8a.2xlarge is not a disk at all: 1,150,238 QD1 reads and 430,608 synced writes per second, from RAM. The workspace is 59 GiB, sized by memory.
  • tmpfs on r8a.xlarge is not a disk at all: 1,083,747 QD1 reads and 433,705 synced writes per second, from RAM. The workspace is 29 GiB, sized by memory.
  • tmpfs on r9g.large is not a disk at all: 651,023 QD1 reads and 298,146 synced writes per second, from RAM. The workspace is 14 GiB, sized by memory.
  • tmpfs on r9g.xlarge is not a disk at all: 644,142 QD1 reads and 301,942 synced writes per second, from RAM. The workspace is 29 GiB, sized by memory.
  • tmpfs: 644k–1.2M QD1 reads and 298k–434k synced writes per second across 8 runners (8 RunsOn configurations).
  • VM disk: 5.3k–106k QD1 reads and 1.4k–32k synced writes per second across 51 runners from 9 providers (6 Avrea runners, 6 Blacksmith runners, 3 boat x64 runners, 3 GitHub runners, 12 Namespace runners, 6 Sengi x64 runners, 2 StarSling x64 runners, 9 Ubicloud runners and 4 Warpbuild runners).
  • local NVMe: 11k–14k QD1 reads and 5.6k–17k synced writes per second across 9 runners (9 RunsOn configurations).
  • network disk: 7.3k–7.7k QD1 reads and 3.5k–4.2k synced writes per second across 2 runners (2 GitHub runners).
  • EBS: 1.5k–37k QD1 reads and 487–3.0k synced writes per second across 32 runners from 3 providers (3 AWS CodeBuild x64 runners, 25 RunsOn configurations and 4 Warpbuild configurations).

Reading these numbers

fio measures what a disk can do. Whether a job gets there depends on the job.

What each column says about a job

  • QD1 reads and synced writes: databases, SQLite-backed tests and anything that flushes each write. Every flush waits for the storage, and a network disk pays a round trip each time.
  • Random writes at depth and sequential throughput: docker build layers, package installs and cache archives. They batch their writes and run into the disk's ceiling, not its latency.
  • None of them: compile jobs. A compiler waits for the CPU, and it reads its files back from the page cache.

Every runner

Each provider's best disk first; its other machines sit behind +N more. Bars are log scale.

One request at a time 4k, 32 in flight Sequential, 1M
Runner QD1 read ↑p99 ↓Sync write ↑Read ↑Write ↑Read ↑Write ↑
x6466 runners, 11 providers
Namespace 8x32 8 vCPU 32 GB VM disk EPYC · model hidden 106,228 10 µs 28,970 1,096,275 576,011 5.0 GiB/s 3.4 GiB/s
8x16 8 vCPU 16 GB VM disk EPYC · model hidden 105,232 10 µs 28,289 954,329 543,808 4.6 GiB/s 3.0 GiB/s
4x8 4 vCPU 8 GB VM disk EPYC · model hidden 104,646 11 µs 29,746 1,156,765 575,099 5.0 GiB/s 3.2 GiB/s
4x16 4 vCPU 16 GB VM disk EPYC · model hidden 103,441 11 µs 28,491 1,196,382 553,982 5.0 GiB/s 3.3 GiB/s
2x8 2 vCPU 8 GB VM disk EPYC · model hidden 105,054 10 µs 31,543 839,416 603,279 4.6 GiB/s 3.0 GiB/s
Blacksmith 4 vCPU 16 GB VM disk EPYC · model hidden nobarrier 82,000 16 µs 17,485 700,085 217,634 6.6 GiB/s 1.6 GiB/s
8 vCPU 8 vCPU 32 GB VM disk EPYC · model hidden nobarrier 74,095 16 µs 18,082 598,298 241,065 6.9 GiB/s 1.8 GiB/s
2 vCPU 2 vCPU 8 GB VM disk EPYC · model hidden nobarrier 71,426 19 µs 16,231 622,999 154,296 4.7 GiB/s 1.7 GiB/s
Warpbuild 4 vCPU 16 GB VM disk Ryzen 9 9950X 63,558 22 µs 2,759 187,737 70,031 4.1 GiB/s 2.7 GiB/s
8 vCPU 8 vCPU 32 GB EBS EPYC 9R45 nobarrier 37,153 29 µs 2,984 188,027 67,698 4.3 GiB/s 2.8 GiB/s
2 vCPU 2 vCPU 8 GB VM disk Ryzen 9 9950X 24,481 45 µs 2,287 232,952 88,324 4.3 GiB/s 2.9 GiB/s
Avrea 2 vCPU 8 GB VM disk EPYC 4585PX nobarrier 53,598 14 µs 12,521 583,528 228,550 16.2 GiB/s 10.8 GiB/s
8 vCPU 8 vCPU 32 GB VM disk EPYC 4585PX nobarrier 52,121 17 µs 11,059 317,363 198,055 17.0 GiB/s 11.1 GiB/s
4 vCPU 4 vCPU 16 GB VM disk EPYC 4585PX nobarrier 49,550 21 µs 12,224 456,155 219,963 16.0 GiB/s 10.8 GiB/s
StarSling 8 vCPU 32 GB VM disk EPYC · model hidden 52,058 22 µs 3,466 296,735 48,228 2.4 GiB/s 3.3 GiB/s
4 vCPU 4 vCPU 16 GB VM disk EPYC 9655P 32,038 30 µs 24,988 342,267 69,942 4.9 GiB/s 4.1 GiB/s
Sengi premium 8 vCPU 32 GB VM disk EPYC 9455 13,912 81 µs 9,146 353,085 154,538 3.1 GiB/s 1.4 GiB/s
basic 8 vCPU 8 vCPU 32 GB VM disk Ryzen 9 7950X3D 9,494 235 µs 4,268 465,853 67,027 3.3 GiB/s 2.5 GiB/s
premium 4 vCPU 4 vCPU 16 GB VM disk EPYC 9455 13,632 111 µs 9,159 320,646 144,114 4.4 GiB/s 2.6 GiB/s
basic 4 vCPU 4 vCPU 16 GB VM disk Ryzen 9 7950X3D 8,591 627 µs 2,822 253,419 36,902 3.1 GiB/s 2.1 GiB/s
premium 2 vCPU 2 vCPU 8 GB VM disk EPYC 9455 13,893 84 µs 14,279 321,467 152,642 2.8 GiB/s 1.2 GiB/s
basic 2 vCPU 2 vCPU 8 GB VM disk Ryzen 9 7950X3D 8,231 334 µs 4,151 145,581 103,680 2.9 GiB/s 2.3 GiB/s
RunsOn i7i.large 2 vCPU 16 GB local NVMe Xeon 8559C 12,510 293 µs 12,959 75,023 41,229 503 MiB/s 395 MiB/s
m8azn.3xlarge 12 vCPU 48 GB EBS gp3 EPYC 9R05 nobarrier 1,788 840 µs 538 2,997 2,994 401 MiB/s 401 MiB/s
c8a.2xlarge 8 vCPU 16 GB EBS gp3 EPYC 9R45 nobarrier 1,807 897 µs 540 2,995 2,991 401 MiB/s 401 MiB/s
r8a.2xlarge 8 vCPU 64 GB tmpfs EPYC 9R45 1,150,238 <1 µs 430,608 4,286,650 3,818,921 18.4 GiB/s 10.0 GiB/s
m8a.2xlarge 8 vCPU 32 GB EBS gp3 EPYC 9R45 nobarrier 1,511 930 µs 540 2,995 2,992 401 MiB/s 401 MiB/s
m8a.2xlarge 8 vCPU 32 GB gp3 1000 MiB/s EPYC 9R45 nobarrier 1,775 782 µs 540 15,995 15,992 1,001 MiB/s 1,001 MiB/s
m8a.2xlarge 8 vCPU 32 GB tmpfs EPYC 9R45 1,137,009 <1 µs 428,937 4,245,514 3,822,441 18.3 GiB/s 10.0 GiB/s
m8azn.xlarge 4 vCPU 16 GB EBS gp3 EPYC 9R05 nobarrier 1,769 872 µs 541 2,994 2,992 401 MiB/s 401 MiB/s
m8azn.xlarge 4 vCPU 16 GB gp3 1000 MiB/s EPYC 9R05 nobarrier 1,771 823 µs 541 15,994 15,991 1,001 MiB/s 1,001 MiB/s
m8i.2xlarge 8 vCPU 32 GB EBS gp3 Xeon 6975P-C nobarrier 1,568 1,004 µs 487 2,993 2,994 401 MiB/s 401 MiB/s
m8id.2xlarge 8 vCPU 32 GB local NVMe Xeon 6975P-C 11,083 230 µs 7,619 134,258 67,076 905 MiB/s 432 MiB/s
m8i-flex.2xlarge 8 vCPU 32 GB EBS gp3 Xeon 6975P-C nobarrier 1,774 905 µs 519 2,993 2,995 401 MiB/s 401 MiB/s
c8a.xlarge 4 vCPU 8 GB EBS gp3 EPYC 9R45 nobarrier 1,782 938 µs 541 2,994 2,992 401 MiB/s 401 MiB/s
m8a.xlarge 4 vCPU 16 GB EBS gp3 EPYC 9R45 nobarrier 1,820 799 µs 540 2,994 2,991 401 MiB/s 401 MiB/s
i7i.2xlarge 8 vCPU 64 GB local NVMe Xeon 8559C 11,058 344 µs 11,551 300,466 165,109 2.0 GiB/s 1.5 GiB/s
r8a.xlarge 4 vCPU 32 GB tmpfs EPYC 9R45 1,083,747 <1 µs 433,705 4,126,468 3,769,822 18.2 GiB/s 9.9 GiB/s
m8azn.large 2 vCPU 8 GB EBS gp3 EPYC 9R05 nobarrier 1,782 758 µs 542 2,994 2,992 401 MiB/s 401 MiB/s
m8i.xlarge 4 vCPU 16 GB EBS gp3 Xeon 6975P-C nobarrier 1,658 995 µs 516 2,993 2,994 401 MiB/s 401 MiB/s
m8id.xlarge 4 vCPU 16 GB local NVMe Xeon 6975P-C 10,813 257 µs 7,901 67,090 33,526 451 MiB/s 216 MiB/s
m8i-flex.xlarge 4 vCPU 16 GB EBS gp3 Xeon 6975P-C nobarrier 1,756 881 µs 525 2,993 2,993 401 MiB/s 401 MiB/s
i7i.xlarge 4 vCPU 32 GB local NVMe Xeon 8559C 11,950 210 µs 12,565 150,053 82,487 1,010 MiB/s 788 MiB/s
r8a.large 2 vCPU 16 GB tmpfs EPYC 9R45 1,100,344 <1 µs 428,125 2,115,833 1,927,435 17.0 GiB/s 10.0 GiB/s
r8a.large 2 vCPU 16 GB EBS gp3 EPYC 9R45 nobarrier 1,780 807 µs 541 2,994 2,992 401 MiB/s 401 MiB/s
m8a.large 2 vCPU 8 GB EBS gp3 EPYC 9R45 nobarrier 1,778 774 µs 541 2,994 2,992 401 MiB/s 401 MiB/s
c8a.large 2 vCPU 4 GB EBS gp3 EPYC 9R45 nobarrier 1,803 766 µs 541 2,994 2,992 401 MiB/s 401 MiB/s
m8id.large 2 vCPU 8 GB local NVMe Xeon 6975P-C 11,102 185 µs 5,555 33,541 16,753 226 MiB/s 108 MiB/s
m8i.large 2 vCPU 8 GB EBS gp3 Xeon 6975P-C nobarrier 1,602 1,004 µs 535 2,993 2,994 401 MiB/s 401 MiB/s
m8i-flex.large 2 vCPU 8 GB EBS gp3 Xeon 6975P-C nobarrier 1,774 872 µs 528 2,993 2,994 401 MiB/s 401 MiB/s
t8i.medium 2 vCPU 4 GB EBS gp3 Xeon 6975P-C nobarrier 1,734 864 µs 523 3,003 2,998 401 MiB/s 401 MiB/s
boat 8 vCPU 16 GB VM disk EPYC 8224P nobarrier 11,383 158 µs 2,368 325,400 185,423 9.8 GiB/s 1.0 GiB/s
4 vCPU 4 vCPU 8 GB VM disk EPYC 8224P nobarrier 10,338 198 µs 2,338 372,459 155,448 7.6 GiB/s 1.3 GiB/s
2 vCPU 2 vCPU 4 GB VM disk EPYC 4585PX nobarrier 10,783 183 µs 2,355 456,909 165,954 10.2 GiB/s 892 MiB/s
Ubicloud premium 8 vCPU 32 GB VM disk Ryzen 9 7950X3D nobarrier 9,543 338 µs 2,822 330,381 21,612 2.9 GiB/s 1.2 GiB/s
standard 8 vCPU 8 vCPU 32 GB VM disk EPYC 9454P nobarrier 7,548 856 µs 1,921 255,065 12,701 2.5 GiB/s 1.0 GiB/s
premium 4 vCPU 4 vCPU 16 GB VM disk Ryzen 9 7950X3D nobarrier 7,801 725 µs 2,724 224,391 23,539 2.3 GiB/s 1.1 GiB/s
standard 4 vCPU 4 vCPU 16 GB VM disk EPYC 9454P nobarrier 5,985 1,106 µs 1,417 163,941 17,458 2.2 GiB/s 694 MiB/s
standard 2 vCPU 2 vCPU 8 GB VM disk Ryzen 9 7950X3D nobarrier 6,889 436 µs 1,724 151,057 26,808 2.5 GiB/s 845 MiB/s
premium 2 vCPU 2 vCPU 8 GB VM disk Ryzen 9 7950X3D nobarrier 5,289 1,352 µs 1,935 117,486 13,095 2.4 GiB/s 806 MiB/s
GitHub 8 vCPU 32 GB VM disk EPYC 7763 nobarrier 7,559 224 µs 4,270 38,973 18,243 784 MiB/s 545 MiB/s
4-core 4 vCPU 16 GB network disk Xeon 8573C nobarrier 7,332 226 µs 4,203 19,574 10,264 394 MiB/s 245 MiB/s
2-core 2 vCPU 8 GB VM disk EPYC 9V45 nobarrier 6,868 272 µs 3,862 9,378 8,843 199 MiB/s 133 MiB/s
AWS CodeBuild medium 4 vCPU 8 GB EBS Xeon 8488C 1,794 733 µs 565 2,993 2,974 241 MiB/s 251 MiB/s
large 8 vCPU 16 GB EBS Xeon 8488C 1,758 758 µs 566 2,990 2,977 243 MiB/s 251 MiB/s
small 2 vCPU 3 GB EBS Xeon 8488C 1,763 815 µs 571 2,988 2,971 251 MiB/s 251 MiB/s
arm6436 runners, 7 providers
Blacksmith 4 vCPU 16 GB VM disk Ampere-1a nobarrier 32,691 37 µs 9,201 256,503 35,819 1.6 GiB/s 786 MiB/s
8 vCPU 8 vCPU 32 GB VM disk Ampere-1a nobarrier 31,905 35 µs 9,981 255,453 37,077 1.7 GiB/s 893 MiB/s
2 vCPU 2 vCPU 6 GB VM disk Ampere-1a nobarrier 31,028 39 µs 8,442 252,404 36,713 1.6 GiB/s 806 MiB/s
Warpbuild xfast (Apple M4 Pro) 12 vCPU 28 GB VM disk nobarrier 30,102 33 µs 9,352 383,165 5,949 11.5 GiB/s 12.1 GiB/s
xfast (Apple M4 Pro) 6 vCPU 6 vCPU 14 GB VM disk nobarrier 29,080 64 µs 8,416 347,190 6,482 12.6 GiB/s 10.7 GiB/s
8 vCPU 8 vCPU 32 GB EBS Neoverse-V2 nobarrier 1,781 864 µs 539 4,995 4,993 401 MiB/s 401 MiB/s
4 vCPU 4 vCPU 16 GB EBS Neoverse-V2 nobarrier 1,812 848 µs 539 4,194 4,193 302 MiB/s 302 MiB/s
2 vCPU 2 vCPU 8 GB EBS Neoverse-V2 nobarrier 1,779 799 µs 538 4,194 4,193 302 MiB/s 301 MiB/s
Avrea 2 vCPU 8 GB VM disk Apple M5 Max · as stated by the provider 20,909 60 µs 3,880 155,527 18,394 30.4 GiB/s 14.6 GiB/s
8 vCPU 8 vCPU 32 GB VM disk Apple M5 Max · as stated by the provider 20,397 57 µs 3,688 150,734 17,825 28.7 GiB/s 16.0 GiB/s
4 vCPU 4 vCPU 16 GB VM disk Apple M5 Max · as stated by the provider 20,301 58 µs 3,694 150,737 18,814 31.9 GiB/s 15.8 GiB/s
Namespace Apple silicon 2x8 2 vCPU 8 GB VM disk CPU not reported 19,829 78 µs 3,706 155,576 16,238 35.2 GiB/s 11.8 GiB/s
Apple silicon 4x16 4 vCPU 16 GB VM disk CPU not reported 18,570 90 µs 3,451 146,835 25,918 33.5 GiB/s 13.4 GiB/s
8x32 8 vCPU 32 GB VM disk Ampere-1a 16,635 91 µs 4,047 181,390 58,090 920 MiB/s 769 MiB/s
8x16 8 vCPU 16 GB VM disk Ampere-1a 17,452 86 µs 4,158 182,592 38,702 922 MiB/s 700 MiB/s
4x8 4 vCPU 8 GB VM disk Ampere-1a 16,654 89 µs 3,829 144,427 39,668 915 MiB/s 628 MiB/s
4x16 4 vCPU 16 GB VM disk Ampere-1a 16,759 88 µs 3,945 147,879 40,493 928 MiB/s 657 MiB/s
2x8 2 vCPU 8 GB VM disk Ampere-1a 15,941 104 µs 3,704 68,480 25,565 924 MiB/s 654 MiB/s
RunsOn m9gd.large 2 vCPU 8 GB local NVMe Neoverse-V3 13,533 81 µs 7,267 43,609 21,784 293 MiB/s 141 MiB/s
m9gd.2xlarge 8 vCPU 32 GB local NVMe Neoverse-V3 13,462 82 µs 17,361 174,573 87,209 1.1 GiB/s 561 MiB/s
m9g.2xlarge 8 vCPU 32 GB tmpfs Neoverse-V3 653,126 <1 µs 300,592 2,616,178 2,495,107 13.3 GiB/s 9.1 GiB/s
m9g.2xlarge 8 vCPU 32 GB EBS gp3 Neoverse-V3 nobarrier 1,723 954 µs 543 2,995 2,992 401 MiB/s 401 MiB/s
c8g.2xlarge 8 vCPU 16 GB EBS gp3 Neoverse-V2 nobarrier 1,697 856 µs 539 2,994 2,992 401 MiB/s 401 MiB/s
m9gd.xlarge 4 vCPU 16 GB local NVMe Neoverse-V3 13,368 116 µs 14,867 87,221 43,592 585 MiB/s 281 MiB/s
m9g.xlarge 4 vCPU 16 GB EBS gp3 Neoverse-V3 nobarrier 1,837 856 µs 543 2,994 2,991 401 MiB/s 401 MiB/s
r9g.xlarge 4 vCPU 32 GB tmpfs Neoverse-V3 644,142 <1 µs 301,942 2,581,865 2,478,450 13.7 GiB/s 8.9 GiB/s
m9g.xlarge 4 vCPU 16 GB tmpfs Neoverse-V3 667,201 <1 µs 303,876 2,686,147 2,522,480 14.8 GiB/s 9.3 GiB/s
c8g.xlarge 4 vCPU 8 GB EBS gp3 Neoverse-V2 nobarrier 1,796 864 µs 538 2,992 2,994 401 MiB/s 401 MiB/s
m9g.large 2 vCPU 8 GB EBS gp3 Neoverse-V3 nobarrier 1,789 848 µs 542 2,992 2,994 401 MiB/s 401 MiB/s
r9g.large 2 vCPU 16 GB tmpfs Neoverse-V3 651,023 <1 µs 298,146 1,277,313 1,235,007 13.9 GiB/s 9.5 GiB/s
c8g.large 2 vCPU 4 GB EBS gp3 Neoverse-V2 nobarrier 1,778 840 µs 537 2,994 2,992 401 MiB/s 401 MiB/s
Ubicloud standard 8 vCPU 32 GB VM disk Neoverse-N1 nobarrier 8,453 424 µs 3,147 223,224 43,151 763 MiB/s 515 MiB/s
standard 4 vCPU 4 vCPU 16 GB VM disk Neoverse-N1 nobarrier 8,334 498 µs 2,434 149,499 30,170 734 MiB/s 394 MiB/s
standard 2 vCPU 2 vCPU 8 GB VM disk Neoverse-N1 nobarrier 8,452 461 µs 4,024 84,409 27,725 746 MiB/s 405 MiB/s
GitHub 2 vCPU 8 GB VM disk Neoverse-N2 nobarrier 8,119 214 µs 3,115 9,376 6,333 200 MiB/s 164 MiB/s
4-core 4 vCPU 16 GB network disk Neoverse-N2 nobarrier 7,694 228 µs 3,483 19,575 12,279 394 MiB/s 330 MiB/s
  • IOPS are 4k blocks, medians of finished jobs
  • bold best disk measured on the arch (tmpfs is RAM, left out)
  • volatile, nobarrier: cheaper, less durable flushes

Pick the disk per job on RunsOn

How it's measured

Methodology

fio runs inside the job, in GITHUB_WORKSPACE: the disk a build writes to, on the filesystem the provider mounted there. Every runner is compared, whatever its shape.

fio settingsblock sizes, queue depths, mounts
  • QD1 random read: 4k blocks, one request in flight; IOPS and p99 latency.
  • Sync write: 4k writes, each followed by fdatasync.
  • Random read and write: 4k blocks, 4 jobs with 32 requests in flight each.
  • Sequential read and write: 1M blocks, 32 requests in flight.
  • The workspace filesystem, its size and its mount options come from the job's own mount table.
  • Earlier versions of this page used a different harness and other fio settings on 2 vCPU runners; those numbers are gone rather than mixed in.