== sanity test 398b: DIO and buffer IO race ============== 23:06:45 (1781233605) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.09524 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145123: Thu Jun 11 23:09:08 2026 read: IOPS=12, BW=48.1KiB/s (49.2kB/s)(5992KiB/124600msec) clat (usec): min=35, max=529775, avg=42517.97, stdev=33631.55 lat (usec): min=35, max=529776, avg=42519.64, stdev=33631.46 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 72], 10.00th=[ 12125], 20.00th=[ 20317], | 30.00th=[ 26084], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[124257], 99.50th=[183501], 99.90th=[421528], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 111, per=24.96%, avg=47.91, stdev=19.26, samples=244 iops : min= 1, max= 27, avg=11.33, stdev= 4.88, samples=244 write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6296KiB/124600msec); 0 zone resets clat (usec): min=1029, max=265826, avg=38424.15, stdev=37035.60 lat (usec): min=1030, max=265828, avg=38429.19, stdev=37039.06 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1532], 10.00th=[ 2180], 20.00th=[ 4948], | 30.00th=[ 10552], 40.00th=[ 19530], 50.00th=[ 27919], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[152044], 99.50th=[173016], 99.90th=[219153], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 111, per=24.96%, avg=50.18, stdev=21.28, samples=245 iops : min= 1, max= 27, avg=11.89, stdev= 5.34, samples=245 lat (usec) : 50=0.20%, 100=3.45%, 250=0.20%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.59%, 4=4.00%, 10=6.84%, 20=10.64%, 50=38.31% lat (msec) : 100=26.24%, 250=5.14%, 500=0.13%, 750=0.03% cpu : usr=0.09%, sys=5.52%, ctx=6821, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145124: Thu Jun 11 23:09:08 2026 read: IOPS=12, BW=48.3KiB/s (49.5kB/s)(5940KiB/122874msec) clat (usec): min=32, max=509940, avg=41252.19, stdev=31439.07 lat (usec): min=32, max=509942, avg=41259.06, stdev=31442.55 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 12256], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 87557], | 99.00th=[119014], 99.50th=[158335], 99.90th=[417334], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 5, max= 118, per=25.10%, avg=48.20, stdev=21.20, samples=240 iops : min= 1, max= 29, avg=11.38, stdev= 5.33, samples=240 write: IOPS=12, BW=51.7KiB/s (52.9kB/s)(6348KiB/122874msec); 0 zone resets clat (usec): min=896, max=380663, avg=38633.86, stdev=40430.92 lat (usec): min=896, max=380663, avg=38637.14, stdev=40429.91 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1516], 10.00th=[ 1926], 20.00th=[ 4948], | 30.00th=[ 8848], 40.00th=[ 17171], 50.00th=[ 27919], 60.00th=[ 38536], | 70.00th=[ 50070], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[112722], | 99.00th=[173016], 99.50th=[227541], 99.90th=[320865], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 141, per=25.51%, avg=51.28, stdev=20.76, samples=241 iops : min= 1, max= 35, avg=12.15, stdev= 5.23, samples=241 lat (usec) : 50=0.26%, 100=3.35%, 250=0.29%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=5.24%, 4=3.26%, 10=8.40%, 20=9.83%, 50=37.99% lat (msec) : 100=25.88%, 250=4.92%, 500=0.16%, 750=0.03% cpu : usr=0.09%, sys=5.52%, ctx=6737, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145125: Thu Jun 11 23:09:08 2026 read: IOPS=12, BW=48.5KiB/s (49.7kB/s)(6028KiB/124281msec) clat (usec): min=32, max=338853, avg=40965.37, stdev=28959.73 lat (usec): min=33, max=338855, avg=40967.37, stdev=28959.82 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 70], 10.00th=[ 10159], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[166724], 99.90th=[208667], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 112, per=25.25%, avg=48.49, stdev=19.25, samples=242 iops : min= 1, max= 28, avg=11.46, stdev= 4.84, samples=242 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6260KiB/124281msec); 0 zone resets clat (usec): min=1052, max=589993, avg=39737.43, stdev=40988.01 lat (usec): min=1053, max=589996, avg=39744.97, stdev=40987.99 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1549], 10.00th=[ 2278], 20.00th=[ 5080], | 30.00th=[ 8979], 40.00th=[ 19792], 50.00th=[ 29754], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[160433], 99.50th=[185598], 99.90th=[265290], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 127, per=24.84%, avg=49.93, stdev=20.21, samples=244 iops : min= 1, max= 31, avg=11.82, stdev= 5.07, samples=244 lat (usec) : 50=0.55%, 100=3.19%, 250=0.49%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.49%, 4=4.20%, 10=7.62%, 20=8.69%, 50=39.06% lat (msec) : 100=25.65%, 250=5.63%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=5.44%, ctx=6813, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145126: Thu Jun 11 23:09:08 2026 read: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6052KiB/124919msec) clat (usec): min=33, max=225429, avg=40450.68, stdev=29179.59 lat (usec): min=33, max=225430, avg=40453.20, stdev=29179.65 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 441], 20.00th=[ 19268], | 30.00th=[ 24773], 40.00th=[ 30540], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[173016], 99.90th=[219153], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 7, max= 103, per=24.93%, avg=47.86, stdev=18.97, samples=244 iops : min= 1, max= 25, avg=11.31, stdev= 4.77, samples=244 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6236KiB/124919msec); 0 zone resets clat (usec): min=929, max=486624, avg=40597.12, stdev=39803.36 lat (usec): min=931, max=486624, avg=40617.02, stdev=39808.96 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1565], 10.00th=[ 2311], 20.00th=[ 5211], | 30.00th=[ 10945], 40.00th=[ 21365], 50.00th=[ 30802], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[166724], 99.50th=[185598], 99.90th=[270533], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 7, max= 126, per=24.42%, avg=49.08, stdev=20.58, samples=246 iops : min= 1, max= 31, avg=11.62, stdev= 5.17, samples=246 lat (usec) : 50=0.65%, 100=3.68%, 250=0.52%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.30%, 4=3.32%, 10=7.36%, 20=9.90%, 50=39.23% lat (msec) : 100=25.26%, 250=5.47%, 500=0.10% cpu : usr=0.08%, sys=5.49%, ctx=6977, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=192KiB/s (197kB/s), 48.1KiB/s-48.5KiB/s (49.2kB/s-49.7kB/s), io=23.4MiB (24.6MB), run=122874-124919msec WRITE: bw=201KiB/s (206kB/s), 49.9KiB/s-51.7KiB/s (51.1kB/s-52.9kB/s), io=24.6MiB (25.7MB), run=122874-124919msec fio: pid=145119, err=5/file:backend.c:481, func=full resid, error=Input/output error fio: pid=145120, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145119: Thu Jun 11 23:11:09 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(4408KiB/205793msec) clat (msec): min=5, max=531, avg=41.29, stdev=38.72 lat (msec): min=5, max=531, avg=41.29, stdev=38.72 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 85], 95.00th=[ 108], | 99.00th=[ 178], 99.50th=[ 220], 99.90th=[ 355], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 95, per=26.40%, avg=23.50, stdev=16.10, samples=361 iops : min= 1, max= 23, avg= 5.21, stdev= 4.06, samples=361 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(4624KiB/205793msec); 0 zone resets clat (msec): min=30, max=551, avg=138.36, stdev=64.35 lat (msec): min=30, max=551, avg=138.37, stdev=64.35 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 112], 50.00th=[ 129], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 220], 95.00th=[ 257], | 99.00th=[ 351], 99.50th=[ 414], 99.90th=[ 489], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 56, per=23.76%, avg=22.10, stdev=10.19, samples=401 iops : min= 1, max= 14, avg= 4.86, stdev= 2.58, samples=401 lat (msec) : 10=2.26%, 20=11.78%, 50=22.13%, 100=26.91%, 250=33.69% lat (msec) : 500=3.10%, 750=0.09% cpu : usr=0.04%, sys=1.35%, ctx=3716, majf=0, minf=23 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1103,1156,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145120: Thu Jun 11 23:11:09 2026 read: IOPS=5, BW=23.7KiB/s (24.3kB/s)(5632KiB/237174msec) clat (msec): min=4, max=508, avg=35.09, stdev=33.56 lat (msec): min=4, max=508, avg=35.10, stdev=33.56 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 73], 95.00th=[ 99], | 99.00th=[ 159], 99.50th=[ 207], 99.90th=[ 257], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 103, per=29.36%, avg=26.13, stdev=17.62, samples=414 iops : min= 1, max= 25, avg= 5.88, stdev= 4.43, samples=414 write: IOPS=6, BW=25.1KiB/s (25.7kB/s)(5956KiB/237174msec); 0 zone resets clat (msec): min=31, max=487, avg=125.84, stdev=60.90 lat (msec): min=31, max=487, avg=125.85, stdev=60.90 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 75], | 30.00th=[ 87], 40.00th=[ 99], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 209], 95.00th=[ 241], | 99.00th=[ 317], 99.50th=[ 342], 99.90th=[ 477], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 63, per=26.53%, avg=24.68, stdev=11.69, samples=465 iops : min= 1, max= 15, avg= 5.51, stdev= 2.96, samples=465 lat (msec) : 10=3.07%, 20=16.46%, 50=20.84%, 100=27.23%, 250=30.02% lat (msec) : 500=2.31%, 750=0.03% cpu : usr=0.04%, sys=1.50%, ctx=4928, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1409,1489,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145121: Thu Jun 11 23:11:09 2026 read: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6028KiB/246088msec) clat (msec): min=5, max=289, avg=35.29, stdev=31.58 lat (msec): min=5, max=289, avg=35.30, stdev=31.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 99], | 99.00th=[ 146], 99.50th=[ 188], 99.90th=[ 279], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 118, per=29.44%, avg=26.20, stdev=17.75, samples=444 iops : min= 1, max= 29, avg= 5.90, stdev= 4.47, samples=444 write: IOPS=6, BW=25.4KiB/s (26.0kB/s)(6260KiB/246088msec); 0 zone resets clat (msec): min=34, max=602, avg=123.03, stdev=60.09 lat (msec): min=34, max=602, avg=123.04, stdev=60.08 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 110], 60.00th=[ 124], | 70.00th=[ 142], 80.00th=[ 167], 90.00th=[ 203], 95.00th=[ 234], | 99.00th=[ 317], 99.50th=[ 359], 99.90th=[ 493], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 56, per=26.68%, avg=24.81, stdev=11.99, samples=486 iops : min= 1, max= 14, avg= 5.55, stdev= 3.04, samples=486 lat (msec) : 10=3.06%, 20=16.11%, 50=21.42%, 100=27.93%, 250=29.52% lat (msec) : 500=1.92%, 750=0.03% cpu : usr=0.04%, sys=1.54%, ctx=5364, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145122: Thu Jun 11 23:11:09 2026 read: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6052KiB/246355msec) clat (msec): min=5, max=354, avg=35.23, stdev=31.89 lat (msec): min=5, max=354, avg=35.23, stdev=31.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 99], | 99.00th=[ 155], 99.50th=[ 203], 99.90th=[ 239], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 111, per=30.25%, avg=26.92, stdev=18.56, samples=435 iops : min= 1, max= 27, avg= 6.08, stdev= 4.66, samples=435 write: IOPS=6, BW=25.3KiB/s (25.9kB/s)(6236KiB/246355msec); 0 zone resets clat (msec): min=30, max=679, avg=123.60, stdev=62.86 lat (msec): min=30, max=679, avg=123.61, stdev=62.86 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 62], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 110], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 236], | 99.00th=[ 334], 99.50th=[ 401], 99.90th=[ 550], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 63, per=26.68%, avg=24.82, stdev=11.97, samples=485 iops : min= 1, max= 15, avg= 5.55, stdev= 3.03, samples=485 lat (msec) : 10=3.52%, 20=15.69%, 50=21.94%, 100=27.80%, 250=29.10% lat (msec) : 500=1.89%, 750=0.07% cpu : usr=0.05%, sys=1.55%, ctx=5311, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.8KiB/s (91.9kB/s), 21.4KiB/s-24.6KiB/s (21.9kB/s-25.2kB/s), io=21.6MiB (22.7MB), run=205793-246355msec WRITE: bw=93.7KiB/s (95.9kB/s), 22.5KiB/s-25.4KiB/s (23.0kB/s-26.0kB/s), io=22.5MiB (23.6MB), run=205793-246355msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145180: Thu Jun 11 23:11:50 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(5920KiB/29062msec) clat (usec): min=38, max=226178, avg=38403.52, stdev=34156.30 lat (usec): min=38, max=226178, avg=38407.37, stdev=34157.83 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 167], | 30.00th=[ 22414], 40.00th=[ 29230], 50.00th=[ 36439], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 70779], 95.00th=[ 93848], | 99.00th=[189793], 99.50th=[219153], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 63, max= 437, per=25.25%, avg=205.55, stdev=86.65, samples=56 iops : min= 3, max= 27, avg=12.07, stdev= 5.49, samples=56 write: IOPS=13, BW=219KiB/s (224kB/s)(6368KiB/29062msec); 0 zone resets clat (usec): min=1535, max=392100, avg=36989.63, stdev=43399.16 lat (usec): min=1537, max=392103, avg=37005.31, stdev=43425.53 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2311], 10.00th=[ 3294], 20.00th=[ 5276], | 30.00th=[ 8225], 40.00th=[ 14615], 50.00th=[ 22938], 60.00th=[ 33817], | 70.00th=[ 47449], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[183501], 99.50th=[383779], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 27, max= 446, per=25.59%, avg=219.07, stdev=88.19, samples=57 iops : min= 1, max= 27, avg=12.91, stdev= 5.56, samples=57 lat (usec) : 50=0.91%, 100=7.03%, 250=2.08%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.82%, 4=5.47%, 10=11.72%, 20=7.55%, 50=34.90% lat (msec) : 100=22.79%, 250=5.21%, 500=0.26% cpu : usr=0.09%, sys=5.81%, ctx=1584, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145181: Thu Jun 11 23:11:50 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5744KiB/28728msec) clat (usec): min=40, max=189104, avg=39839.30, stdev=30205.33 lat (usec): min=40, max=189106, avg=39840.85, stdev=30205.46 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 81], 20.00th=[ 16450], | 30.00th=[ 25297], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 62129], 90.00th=[ 80217], 95.00th=[ 89654], | 99.00th=[137364], 99.50th=[152044], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 28, max= 379, per=25.53%, avg=207.78, stdev=74.49, samples=54 iops : min= 1, max= 23, avg=12.20, stdev= 4.69, samples=54 write: IOPS=14, BW=228KiB/s (233kB/s)(6544KiB/28728msec); 0 zone resets clat (usec): min=1692, max=345502, avg=34423.20, stdev=40365.96 lat (usec): min=1695, max=345507, avg=34429.29, stdev=40368.50 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2638], 10.00th=[ 3687], 20.00th=[ 5604], | 30.00th=[ 8455], 40.00th=[ 12387], 50.00th=[ 18744], 60.00th=[ 27395], | 70.00th=[ 42730], 80.00th=[ 62129], 90.00th=[ 82314], 95.00th=[109577], | 99.00th=[189793], 99.50th=[214959], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 510, per=26.69%, avg=228.48, stdev=103.59, samples=56 iops : min= 1, max= 31, avg=13.52, stdev= 6.52, samples=56 lat (usec) : 50=0.52%, 100=5.99%, 250=0.52%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=1.82%, 4=4.82%, 10=11.59%, 20=12.63%, 50=33.85% lat (msec) : 100=22.27%, 250=4.82%, 500=0.13% cpu : usr=0.11%, sys=6.30%, ctx=1582, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145182: Thu Jun 11 23:11:50 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(6256KiB/29414msec) clat (usec): min=40, max=184837, avg=38689.92, stdev=32824.03 lat (usec): min=40, max=184839, avg=38698.17, stdev=32817.38 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 176], | 30.00th=[ 22938], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[156238], 99.50th=[181404], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 62, max= 506, per=26.64%, avg=216.82, stdev=84.32, samples=57 iops : min= 3, max= 31, avg=12.77, stdev= 5.30, samples=57 write: IOPS=12, BW=205KiB/s (210kB/s)(6032KiB/29414msec); 0 zone resets clat (usec): min=1684, max=341190, avg=37020.64, stdev=42243.81 lat (usec): min=1687, max=341193, avg=37028.52, stdev=42240.22 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2147], 10.00th=[ 3523], 20.00th=[ 6718], | 30.00th=[ 9503], 40.00th=[ 15533], 50.00th=[ 23200], 60.00th=[ 32113], | 70.00th=[ 44303], 80.00th=[ 61080], 90.00th=[ 88605], 95.00th=[120062], | 99.00th=[179307], 99.50th=[325059], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 62, max= 446, per=24.36%, avg=208.49, stdev=82.85, samples=57 iops : min= 3, max= 27, avg=12.25, stdev= 5.16, samples=57 lat (usec) : 50=0.91%, 100=7.55%, 250=2.08%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.43%, 4=4.43%, 10=10.42%, 20=8.72%, 50=35.81% lat (msec) : 100=22.01%, 250=5.60%, 500=0.26% cpu : usr=0.10%, sys=6.12%, ctx=1642, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145183: Thu Jun 11 23:11:50 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28023msec) clat (usec): min=35, max=360004, avg=39901.10, stdev=36188.69 lat (usec): min=35, max=360005, avg=39902.87, stdev=36188.35 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 77], 20.00th=[ 198], | 30.00th=[ 23987], 40.00th=[ 29492], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[189793], 99.50th=[227541], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 414, per=26.85%, avg=218.54, stdev=89.36, samples=54 iops : min= 1, max= 25, avg=12.87, stdev= 5.55, samples=54 write: IOPS=13, BW=223KiB/s (229kB/s)(6256KiB/28023msec); 0 zone resets clat (usec): min=1409, max=366718, avg=32384.88, stdev=37876.53 lat (usec): min=1411, max=366722, avg=32388.15, stdev=37876.42 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2442], 10.00th=[ 3359], 20.00th=[ 5800], | 30.00th=[ 7963], 40.00th=[ 11863], 50.00th=[ 18220], 60.00th=[ 27132], | 70.00th=[ 37487], 80.00th=[ 55837], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[152044], 99.50th=[206570], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 31, max= 479, per=26.13%, avg=223.71, stdev=98.29, samples=55 iops : min= 1, max= 29, avg=13.20, stdev= 6.14, samples=55 lat (usec) : 50=0.52%, 100=7.81%, 250=1.56%, 500=0.13%, 1000=0.26% lat (msec) : 2=1.95%, 4=4.95%, 10=12.63%, 20=8.98%, 50=33.33% lat (msec) : 100=23.44%, 250=4.17%, 500=0.26% cpu : usr=0.08%, sys=6.55%, ctx=1524, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=814KiB/s (834kB/s), 200KiB/s-215KiB/s (205kB/s-220kB/s), io=23.4MiB (24.5MB), run=28023-29414msec WRITE: bw=857KiB/s (877kB/s), 205KiB/s-228KiB/s (210kB/s-233kB/s), io=24.6MiB (25.8MB), run=28023-29414msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145176: Thu Jun 11 23:12:32 2026 read: IOPS=5, BW=83.0KiB/s (85.0kB/s)(5920KiB/70497msec) clat (msec): min=6, max=240, avg=38.78, stdev=32.52 lat (msec): min=6, max=240, avg=38.79, stdev=32.52 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 110], | 99.00th=[ 157], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 28, max= 288, per=28.42%, avg=94.92, stdev=60.08, samples=122 iops : min= 1, max= 18, avg= 5.10, stdev= 3.84, samples=122 write: IOPS=5, BW=90.3KiB/s (92.5kB/s)(6368KiB/70497msec); 0 zone resets clat (msec): min=38, max=507, avg=140.60, stdev=62.95 lat (msec): min=38, max=507, avg=140.60, stdev=62.95 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 92], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 249], | 99.00th=[ 363], 99.50th=[ 498], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 27, max= 192, per=25.85%, avg=90.98, stdev=38.77, samples=137 iops : min= 1, max= 12, avg= 4.85, stdev= 2.46, samples=137 lat (msec) : 10=1.95%, 20=10.29%, 50=27.34%, 100=19.40%, 250=38.54% lat (msec) : 500=2.34%, 750=0.13% cpu : usr=0.03%, sys=1.50%, ctx=1315, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145177: Thu Jun 11 23:12:32 2026 read: IOPS=5, BW=80.0KiB/s (82.9kB/s)(5744KiB/70933msec) clat (msec): min=8, max=190, avg=39.75, stdev=34.33 lat (msec): min=8, max=190, avg=39.75, stdev=34.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 124], | 99.00th=[ 169], 99.50th=[ 174], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 27, max= 316, per=27.30%, avg=91.18, stdev=60.35, samples=124 iops : min= 1, max= 19, avg= 4.86, stdev= 3.79, samples=124 write: IOPS=5, BW=92.3KiB/s (94.5kB/s)(6544KiB/70933msec); 0 zone resets clat (msec): min=47, max=459, avg=138.08, stdev=64.37 lat (msec): min=47, max=459, avg=138.09, stdev=64.36 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 113], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 266], | 99.00th=[ 384], 99.50th=[ 405], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 27, max= 222, per=26.27%, avg=92.47, stdev=39.59, samples=139 iops : min= 1, max= 13, avg= 4.94, stdev= 2.53, samples=139 lat (msec) : 10=1.04%, 20=14.06%, 50=22.27%, 100=20.31%, 250=39.06% lat (msec) : 500=3.26% cpu : usr=0.05%, sys=1.45%, ctx=1303, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145178: Thu Jun 11 23:12:32 2026 read: IOPS=5, BW=90.7KiB/s (92.8kB/s)(6256KiB/68999msec) clat (msec): min=6, max=216, avg=39.23, stdev=31.77 lat (msec): min=6, max=216, avg=39.23, stdev=31.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 80], 95.00th=[ 108], | 99.00th=[ 153], 99.50th=[ 201], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 30, max= 319, per=29.97%, avg=100.11, stdev=65.70, samples=123 iops : min= 1, max= 19, avg= 5.42, stdev= 4.14, samples=123 write: IOPS=5, BW=87.4KiB/s (89.5kB/s)(6032KiB/68999msec); 0 zone resets clat (msec): min=36, max=481, avg=142.07, stdev=60.47 lat (msec): min=36, max=481, avg=142.09, stdev=60.48 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 120], 50.00th=[ 131], 60.00th=[ 144], | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 255], | 99.00th=[ 351], 99.50th=[ 414], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 28, max= 190, per=25.02%, avg=88.06, stdev=34.70, samples=134 iops : min= 1, max= 11, avg= 4.66, stdev= 2.21, samples=134 lat (msec) : 10=1.04%, 20=13.41%, 50=26.43%, 100=17.97%, 250=38.54% lat (msec) : 500=2.60% cpu : usr=0.05%, sys=1.56%, ctx=1315, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145179: Thu Jun 11 23:12:32 2026 read: IOPS=5, BW=84.4KiB/s (86.4kB/s)(6032KiB/71508msec) clat (msec): min=7, max=337, avg=41.73, stdev=40.50 lat (msec): min=7, max=337, avg=41.73, stdev=40.50 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 85], 95.00th=[ 122], | 99.00th=[ 205], 99.50th=[ 268], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 347, per=28.61%, avg=95.55, stdev=59.55, samples=123 iops : min= 1, max= 21, avg= 5.15, stdev= 3.76, samples=123 write: IOPS=5, BW=87.5KiB/s (89.6kB/s)(6256KiB/71508msec); 0 zone resets clat (msec): min=39, max=495, avg=142.05, stdev=66.29 lat (msec): min=39, max=495, avg=142.05, stdev=66.29 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 73], 20.00th=[ 89], | 30.00th=[ 104], 40.00th=[ 114], 50.00th=[ 128], 60.00th=[ 146], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 222], 95.00th=[ 268], | 99.00th=[ 372], 99.50th=[ 489], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 31, max= 191, per=25.01%, avg=88.03, stdev=38.14, samples=139 iops : min= 1, max= 11, avg= 4.68, stdev= 2.45, samples=139 lat (msec) : 10=1.04%, 20=13.15%, 50=24.61%, 100=21.48%, 250=36.07% lat (msec) : 500=3.65% cpu : usr=0.05%, sys=1.57%, ctx=1305, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=335KiB/s (343kB/s), 80.0KiB/s-90.7KiB/s (82.9kB/s-92.8kB/s), io=23.4MiB (24.5MB), run=68999-71508msec WRITE: bw=352KiB/s (361kB/s), 87.4KiB/s-92.3KiB/s (89.5kB/s-94.5kB/s), io=24.6MiB (25.8MB), run=68999-71508msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145204: Thu Jun 11 23:12:53 2026 read: IOPS=0, BW=724KiB/s (741kB/s)(7168KiB/9904msec) clat (usec): min=643, max=5235.0k, avg=946987.26, stdev=1895266.28 lat (usec): min=644, max=5235.0k, avg=946989.30, stdev=1895266.27 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], | 20.00th=[ 185598], 30.00th=[ 217056], 40.00th=[ 217056], | 50.00th=[ 233833], 60.00th=[ 354419], 70.00th=[ 354419], | 80.00th=[ 404751], 90.00th=[5268046], 95.00th=[5268046], | 99.00th=[5268046], 99.50th=[5268046], 99.90th=[5268046], | 99.95th=[5268046], 99.99th=[5268046] bw ( KiB/s): min= 1643, max= 4071, per=100.00%, avg=2361.40, stdev=970.39, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=517KiB/s (529kB/s)(5120KiB/9904msec); 0 zone resets clat (msec): min=205, max=2076, avg=619.79, stdev=814.97 lat (msec): min=205, max=2076, avg=619.88, stdev=815.00 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 2007, max= 4087, per=93.63%, avg=2709.67, stdev=1192.89, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, >=2000=16.67% cpu : usr=0.01%, sys=5.66%, ctx=508, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145205: Thu Jun 11 23:12:53 2026 read: IOPS=0, BW=267KiB/s (273kB/s)(2048KiB/7670msec) clat (usec): min=680, max=402425, avg=201552.71, stdev=284076.73 lat (usec): min=681, max=402428, avg=201555.06, stdev=284077.83 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[ 685], | 30.00th=[ 685], 40.00th=[ 685], 50.00th=[ 685], 60.00th=[400557], | 70.00th=[400557], 80.00th=[400557], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 1662, max= 2043, per=89.62%, avg=1852.50, stdev=269.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1335KiB/s (1367kB/s)(10.0MiB/7670msec); 0 zone resets clat (msec): min=127, max=3069, avg=712.15, stdev=899.47 lat (msec): min=127, max=3069, avg=712.57, stdev=899.31 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 167], | 30.00th=[ 199], 40.00th=[ 259], 50.00th=[ 271], 60.00th=[ 397], | 70.00th=[ 485], 80.00th=[ 1020], 90.00th=[ 1133], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 2035, max= 4087, per=100.00%, avg=3054.33, stdev=1113.75, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 2000=16.67%, >=2000=8.33% cpu : usr=0.05%, sys=6.88%, ctx=127, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145206: Thu Jun 11 23:12:53 2026 read: IOPS=0, BW=784KiB/s (803kB/s)(6144KiB/7832msec) clat (usec): min=703, max=4662.6k, avg=900890.34, stdev=1852761.68 lat (usec): min=705, max=4662.6k, avg=900891.98, stdev=1852761.75 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], | 20.00th=[ 4228], 30.00th=[ 4228], 40.00th=[ 4293], | 50.00th=[ 4293], 60.00th=[ 256902], 70.00th=[ 476054], | 80.00th=[ 476054], 90.00th=[4664067], 95.00th=[4664067], | 99.00th=[4664067], 99.50th=[4664067], 99.90th=[4664067], | 99.95th=[4664067], 99.99th=[4664067] bw ( KiB/s): min= 4055, max= 6119, per=100.00%, avg=5087.00, stdev=1459.47, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=0, BW=784KiB/s (803kB/s)(6144KiB/7832msec); 0 zone resets clat (msec): min=142, max=991, avg=379.28, stdev=313.20 lat (msec): min=142, max=991, avg=379.59, stdev=313.18 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 338], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1750, max= 4079, per=82.58%, avg=2390.00, stdev=952.52, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 10=16.67%, 250=16.67%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.21%, ctx=599, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145207: Thu Jun 11 23:12:53 2026 read: IOPS=0, BW=745KiB/s (763kB/s)(5120KiB/6875msec) clat (usec): min=1520, max=470350, avg=217725.28, stdev=186398.38 lat (usec): min=1522, max=470352, avg=217726.89, stdev=186398.23 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1516], 10.00th=[ 1516], 20.00th=[ 1516], | 30.00th=[ 71828], 40.00th=[ 71828], 50.00th=[248513], 60.00th=[248513], | 70.00th=[295699], 80.00th=[295699], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 4055, max= 4087, per=100.00%, avg=4071.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1043KiB/s (1068kB/s)(7168KiB/6875msec); 0 zone resets clat (msec): min=122, max=3637, avg=817.89, stdev=1270.40 lat (msec): min=122, max=3638, avg=818.15, stdev=1270.79 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 224], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 251], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 911], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1678, max= 6107, per=100.00%, avg=3476.75, stdev=2049.78, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.68%, ctx=220, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2068KiB/s (2117kB/s), 267KiB/s-784KiB/s (273kB/s-803kB/s), io=20.0MiB (20.0MB), run=6875-9904msec WRITE: bw=2895KiB/s (2964kB/s), 517KiB/s-1335KiB/s (529kB/s-1367kB/s), io=28.0MiB (29.4MB), run=6875-9904msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145209: Thu Jun 11 23:12:54 2026 read: IOPS=0, BW=768KiB/s (787kB/s)(7168KiB/9331msec) clat (msec): min=53, max=3815, avg=801.30, stdev=1347.86 lat (msec): min=53, max=3815, avg=801.30, stdev=1347.86 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 100], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 249], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 651], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1771, max= 2031, per=87.72%, avg=1924.67, stdev=119.32, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=549KiB/s (562kB/s)(5120KiB/9331msec); 0 zone resets clat (msec): min=64, max=2615, avg=709.37, stdev=1083.59 lat (msec): min=64, max=2615, avg=709.46, stdev=1083.63 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1996, max= 6011, per=100.00%, avg=3339.33, stdev=2313.74, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 750=25.00%, >=2000=16.67% cpu : usr=0.01%, sys=1.53%, ctx=63, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145210: Thu Jun 11 23:12:54 2026 read: IOPS=0, BW=228KiB/s (234kB/s)(2048KiB/8980msec) clat (msec): min=247, max=305, avg=276.68, stdev=40.69 lat (msec): min=247, max=305, avg=276.68, stdev=40.69 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1762, max= 2011, per=85.98%, avg=1886.50, stdev=176.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1140KiB/s (1168kB/s)(10.0MiB/8980msec); 0 zone resets clat (msec): min=222, max=4869, avg=821.70, stdev=1428.65 lat (msec): min=222, max=4870, avg=822.30, stdev=1428.52 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 275], | 30.00th=[ 284], 40.00th=[ 305], 50.00th=[ 330], 60.00th=[ 359], | 70.00th=[ 397], 80.00th=[ 498], 90.00th=[ 684], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 1771, max= 3992, per=72.48%, avg=2226.62, stdev=718.71, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=16.67%, 500=66.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.81%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145211: Thu Jun 11 23:12:54 2026 read: IOPS=0, BW=763KiB/s (781kB/s)(6144KiB/8055msec) clat (msec): min=110, max=4342, avg=869.04, stdev=1702.76 lat (msec): min=110, max=4342, avg=869.05, stdev=1702.76 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 182], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 2011, max= 4063, per=100.00%, avg=3332.33, stdev=1146.45, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=763KiB/s (781kB/s)(6144KiB/8055msec); 0 zone resets clat (msec): min=261, max=595, avg=447.37, stdev=135.57 lat (msec): min=261, max=596, avg=447.65, stdev=135.82 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1771, max= 2043, per=62.98%, avg=1934.80, stdev=129.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=2.09%, ctx=70, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145212: Thu Jun 11 23:12:54 2026 read: IOPS=0, BW=576KiB/s (590kB/s)(5120KiB/8883msec) clat (msec): min=130, max=421, avg=238.38, stdev=118.20 lat (msec): min=130, max=421, avg=238.38, stdev=118.20 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1935, max= 3900, per=100.00%, avg=2624.67, stdev=1105.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=807KiB/s (826kB/s)(7168KiB/8883msec); 0 zone resets clat (msec): min=187, max=5058, avg=1091.08, stdev=1763.87 lat (msec): min=188, max=5058, avg=1091.18, stdev=1763.86 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 292], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 852], 90.00th=[ 5067], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 1432, max= 4031, per=72.00%, avg=2211.83, stdev=916.84, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.46%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2195KiB/s (2248kB/s), 228KiB/s-768KiB/s (234kB/s-787kB/s), io=20.0MiB (20.0MB), run=8055-9331msec WRITE: bw=3073KiB/s (3147kB/s), 549KiB/s-1140KiB/s (562kB/s-1168kB/s), io=28.0MiB (29.4MB), run=8055-9331msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145219: Thu Jun 11 23:13:13 2026 read: IOPS=0, BW=2232KiB/s (2285kB/s)(12.0MiB/5506msec) clat (msec): min=648, max=3968, avg=1773.19, stdev=1901.05 lat (msec): min=648, max=3968, avg=1773.19, stdev=1901.05 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.43%, ctx=558, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145220: Thu Jun 11 23:13:13 2026 read: IOPS=0, BW=1735KiB/s (1776kB/s)(4096KiB/2361msec) clat (nsec): min=1024.8M, max=1024.8M, avg=1024797721.00, stdev= 0.00 lat (nsec): min=1024.8M, max=1024.8M, avg=1024800852.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3470KiB/s (3553kB/s)(8192KiB/2361msec); 0 zone resets clat (msec): min=406, max=786, avg=596.67, stdev=268.48 lat (msec): min=407, max=788, avg=598.26, stdev=269.20 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.92%, ctx=121, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145221: Thu Jun 11 23:13:13 2026 write: IOPS=0, BW=1805KiB/s (1849kB/s)(12.0MiB/6807msec); 0 zone resets clat (msec): min=261, max=6039, avg=2222.94, stdev=3305.45 lat (msec): min=262, max=6039, avg=2223.21, stdev=3305.57 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 6007], 80.00th=[ 6007], 90.00th=[ 6007], 95.00th=[ 6007], | 99.00th=[ 6007], 99.50th=[ 6007], 99.90th=[ 6007], 99.95th=[ 6007], | 99.99th=[ 6007] bw ( KiB/s): min=16157, max=16157, per=100.00%, avg=16157.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.04%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145222: Thu Jun 11 23:13:13 2026 write: IOPS=0, BW=1873KiB/s (1918kB/s)(12.0MiB/6561msec); 0 zone resets clat (msec): min=507, max=4966, avg=2157.77, stdev=2444.61 lat (msec): min=507, max=4966, avg=2158.45, stdev=2444.47 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 5000], 80.00th=[ 5000], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 8047, max= 8143, per=100.00%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.95%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2976KiB/s (3047kB/s), 1735KiB/s-2232KiB/s (1776kB/s-2285kB/s), io=16.0MiB (16.8MB), run=2361-5506msec WRITE: bw=4814KiB/s (4929kB/s), 1805KiB/s-3470KiB/s (1849kB/s-3553kB/s), io=32.0MiB (33.6MB), run=2361-6807msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145224: Thu Jun 11 23:13:14 2026 read: IOPS=0, BW=2139KiB/s (2191kB/s)(12.0MiB/5744msec) clat (msec): min=677, max=3796, avg=1898.83, stdev=1665.99 lat (msec): min=677, max=3796, avg=1898.83, stdev=1665.99 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 7968, max= 8192, per=100.00%, avg=8080.00, stdev=158.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=0.99%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145225: Thu Jun 11 23:13:14 2026 read: IOPS=0, BW=720KiB/s (737kB/s)(4096KiB/5690msec) clat (nsec): min=4401.0M, max=4401.0M, avg=4401040362.00, stdev= 0.00 lat (nsec): min=4401.0M, max=4401.0M, avg=4401043702.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4396], 5.00th=[ 4396], 10.00th=[ 4396], 20.00th=[ 4396], | 30.00th=[ 4396], 40.00th=[ 4396], 50.00th=[ 4396], 60.00th=[ 4396], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1440KiB/s (1474kB/s)(8192KiB/5690msec); 0 zone resets clat (msec): min=313, max=914, avg=614.17, stdev=424.87 lat (msec): min=313, max=914, avg=614.47, stdev=424.96 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.78%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145226: Thu Jun 11 23:13:14 2026 write: IOPS=0, BW=1732KiB/s (1774kB/s)(12.0MiB/7093msec); 0 zone resets clat (msec): min=297, max=6392, avg=2348.00, stdev=3502.65 lat (msec): min=297, max=6392, avg=2348.45, stdev=3502.63 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 6409], 80.00th=[ 6409], 90.00th=[ 6409], 95.00th=[ 6409], | 99.00th=[ 6409], 99.50th=[ 6409], 99.90th=[ 6409], 99.95th=[ 6409], | 99.99th=[ 6409] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.04%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145227: Thu Jun 11 23:13:14 2026 write: IOPS=0, BW=1897KiB/s (1942kB/s)(12.0MiB/6479msec); 0 zone resets clat (msec): min=390, max=4868, avg=2125.30, stdev=2402.98 lat (msec): min=392, max=4868, avg=2126.47, stdev=2402.20 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.01%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2852KiB/s (2921kB/s), 720KiB/s-2139KiB/s (737kB/s-2191kB/s), io=16.0MiB (16.8MB), run=5690-5744msec WRITE: bw=4620KiB/s (4731kB/s), 1440KiB/s-1897KiB/s (1474kB/s-1942kB/s), io=32.0MiB (33.6MB), run=5690-7093msec