== sanity test 398b: DIO and buffer IO race ============== 15:20:21 (1790104821) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.39947 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143864: Tue Sep 22 15:23:13 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(5992KiB/153308msec) clat (usec): min=32, max=1079.6k, avg=50229.68, stdev=51466.11 lat (usec): min=32, max=1079.6k, avg=50232.44, stdev=51465.35 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 8848], | 20.00th=[ 20055], 30.00th=[ 26608], 40.00th=[ 32900], | 50.00th=[ 39584], 60.00th=[ 47973], 70.00th=[ 58983], | 80.00th=[ 73925], 90.00th=[ 98042], 95.00th=[ 123208], | 99.00th=[ 212861], 99.50th=[ 258999], 99.90th=[ 530580], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 143, per=25.03%, avg=39.05, stdev=21.38, samples=296 iops : min= 1, max= 35, avg= 9.10, stdev= 5.40, samples=296 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6296KiB/153308msec); 0 zone resets clat (usec): min=892, max=905420, avg=49315.93, stdev=57260.92 lat (usec): min=893, max=905422, avg=49318.15, stdev=57261.30 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1352], 20.00th=[ 4015], | 30.00th=[ 8586], 40.00th=[ 20579], 50.00th=[ 33424], 60.00th=[ 47973], | 70.00th=[ 62653], 80.00th=[ 84411], 90.00th=[120062], 95.00th=[156238], | 99.00th=[227541], 99.50th=[263193], 99.90th=[404751], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 6, max= 149, per=25.30%, avg=41.23, stdev=23.08, samples=295 iops : min= 1, max= 37, avg= 9.67, stdev= 5.81, samples=295 lat (usec) : 50=0.85%, 100=3.22%, 250=0.33%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=7.29%, 4=2.70%, 10=6.48%, 20=8.59%, 50=31.93% lat (msec) : 100=25.91%, 250=11.62%, 500=0.46%, 750=0.07%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.07%, sys=4.21%, ctx=6415, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143865: Tue Sep 22 15:23:13 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(5940KiB/148790msec) clat (usec): min=31, max=434018, avg=47302.64, stdev=39158.48 lat (usec): min=31, max=434020, avg=47304.80, stdev=39158.75 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 159], 20.00th=[ 20055], | 30.00th=[ 26608], 40.00th=[ 32113], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[183501], 99.50th=[227541], 99.90th=[354419], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 115, per=26.17%, avg=40.83, stdev=20.30, samples=282 iops : min= 1, max= 28, avg= 9.56, stdev= 5.11, samples=282 write: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6348KiB/148790msec); 0 zone resets clat (usec): min=948, max=1021.3k, avg=49216.90, stdev=65103.29 lat (usec): min=949, max=1021.3k, avg=49226.01, stdev=65105.03 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1254], | 20.00th=[ 3326], 30.00th=[ 7963], 40.00th=[ 18482], | 50.00th=[ 31851], 60.00th=[ 44827], 70.00th=[ 61604], | 80.00th=[ 81265], 90.00th=[ 122160], 95.00th=[ 158335], | 99.00th=[ 244319], 99.50th=[ 304088], 99.90th=[ 910164], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 127, per=26.15%, avg=42.63, stdev=22.73, samples=288 iops : min= 1, max= 31, avg=10.01, stdev= 5.74, samples=288 lat (usec) : 50=0.68%, 100=3.81%, 250=0.42%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=7.94%, 4=2.86%, 10=5.99%, 20=8.79%, 50=32.36% lat (msec) : 100=25.39%, 250=10.77%, 500=0.46%, 1000=0.07%, 2000=0.03% cpu : usr=0.06%, sys=4.11%, ctx=6141, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143866: Tue Sep 22 15:23:13 2026 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6028KiB/153530msec) clat (usec): min=31, max=980880, avg=48806.01, stdev=51125.18 lat (usec): min=31, max=980881, avg=48807.70, stdev=51125.33 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 198], 20.00th=[ 18744], | 30.00th=[ 26346], 40.00th=[ 31851], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 57410], 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[193987], 99.50th=[248513], 99.90th=[868221], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 133, per=25.36%, avg=39.57, stdev=22.54, samples=295 iops : min= 1, max= 33, avg= 9.24, stdev= 5.67, samples=295 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6260KiB/153530msec); 0 zone resets clat (usec): min=821, max=946097, avg=50826.96, stdev=58396.09 lat (usec): min=822, max=946099, avg=50829.87, stdev=58395.15 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 3228], | 30.00th=[ 8455], 40.00th=[ 22414], 50.00th=[ 36439], 60.00th=[ 49546], | 70.00th=[ 66323], 80.00th=[ 87557], 90.00th=[125305], 95.00th=[158335], | 99.00th=[231736], 99.50th=[261096], 99.90th=[383779], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 149, per=24.84%, avg=40.48, stdev=21.44, samples=299 iops : min= 1, max= 37, avg= 9.47, stdev= 5.41, samples=299 lat (usec) : 50=0.78%, 100=3.78%, 250=0.39%, 500=0.03%, 1000=0.42% lat (msec) : 2=7.32%, 4=3.45%, 10=5.66%, 20=8.11%, 50=32.16% lat (msec) : 100=25.52%, 250=11.78%, 500=0.49%, 1000=0.10% cpu : usr=0.06%, sys=4.18%, ctx=6338, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143867: Tue Sep 22 15:23:13 2026 read: IOPS=9, BW=39.8KiB/s (40.7kB/s)(6052KiB/152172msec) clat (usec): min=32, max=938865, avg=49559.39, stdev=51289.77 lat (usec): min=32, max=938867, avg=49561.52, stdev=51289.73 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 87], 20.00th=[ 20841], | 30.00th=[ 25822], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[200279], 99.50th=[295699], 99.90th=[742392], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 104, per=25.37%, avg=39.57, stdev=21.68, samples=296 iops : min= 1, max= 26, avg= 9.24, stdev= 5.47, samples=296 write: IOPS=10, BW=40.0KiB/s (41.0kB/s)(6236KiB/152172msec); 0 zone resets clat (usec): min=865, max=913416, avg=49262.62, stdev=57047.68 lat (usec): min=867, max=913418, avg=49274.31, stdev=57042.49 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3687], | 30.00th=[ 8848], 40.00th=[ 18744], 50.00th=[ 33817], 60.00th=[ 47449], | 70.00th=[ 65274], 80.00th=[ 86508], 90.00th=[121111], 95.00th=[152044], | 99.00th=[233833], 99.50th=[261096], 99.90th=[354419], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 143, per=25.52%, avg=41.60, stdev=21.79, samples=290 iops : min= 1, max= 35, avg= 9.76, stdev= 5.49, samples=290 lat (usec) : 50=1.01%, 100=4.07%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=7.13%, 4=3.29%, 10=5.50%, 20=8.66%, 50=31.64% lat (msec) : 100=25.85%, 250=11.56%, 500=0.55%, 750=0.03%, 1000=0.07% cpu : usr=0.06%, sys=4.19%, ctx=6293, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (160kB/s), 39.1KiB/s-39.9KiB/s (40.0kB/s-40.9kB/s), io=23.4MiB (24.6MB), run=148790-153530msec WRITE: bw=164KiB/s (168kB/s), 40.8KiB/s-42.7KiB/s (41.8kB/s-43.7kB/s), io=24.6MiB (25.7MB), run=148790-153530msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143869: Tue Sep 22 15:25:45 2026 read: IOPS=4, BW=19.7KiB/s (20.1kB/s)(5992KiB/304822msec) clat (msec): min=5, max=1012, avg=39.67, stdev=52.74 lat (msec): min=5, max=1012, avg=39.67, stdev=52.74 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 87], 95.00th=[ 122], | 99.00th=[ 239], 99.50th=[ 296], 99.90th=[ 531], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 3, max= 87, per=29.62%, avg=23.10, stdev=16.03, samples=498 iops : min= 0, max= 21, avg= 5.15, stdev= 4.06, samples=498 write: IOPS=5, BW=20.7KiB/s (21.1kB/s)(6296KiB/304822msec); 0 zone resets clat (msec): min=38, max=1263, avg=155.81, stdev=97.22 lat (msec): min=38, max=1263, avg=155.81, stdev=97.22 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 103], 40.00th=[ 116], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 207], 90.00th=[ 271], 95.00th=[ 342], | 99.00th=[ 506], 99.50th=[ 558], 99.90th=[ 1011], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 6, max= 63, per=25.50%, avg=20.91, stdev=10.90, samples=576 iops : min= 1, max= 15, avg= 4.60, stdev= 2.81, samples=576 lat (msec) : 10=3.09%, 20=16.83%, 50=19.37%, 100=20.38%, 250=33.56% lat (msec) : 500=6.02%, 750=0.65%, 2000=0.10% cpu : usr=0.04%, sys=1.00%, ctx=5084, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143870: Tue Sep 22 15:25:45 2026 read: IOPS=4, BW=19.5KiB/s (19.0kB/s)(5940KiB/304500msec) clat (msec): min=5, max=986, avg=38.78, stdev=50.91 lat (msec): min=5, max=986, avg=38.79, stdev=50.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 53], 90.00th=[ 85], 95.00th=[ 126], | 99.00th=[ 230], 99.50th=[ 279], 99.90th=[ 535], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 6, max= 95, per=30.33%, avg=23.66, stdev=16.03, samples=484 iops : min= 1, max= 23, avg= 5.30, stdev= 4.08, samples=484 write: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6348KiB/304500msec); 0 zone resets clat (msec): min=37, max=917, avg=155.51, stdev=93.48 lat (msec): min=37, max=917, avg=155.51, stdev=93.48 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 115], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 209], 90.00th=[ 275], 95.00th=[ 342], | 99.00th=[ 510], 99.50th=[ 575], 99.90th=[ 911], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 6, max= 56, per=25.52%, avg=20.93, stdev=10.99, samples=581 iops : min= 1, max= 14, avg= 4.60, stdev= 2.83, samples=581 lat (msec) : 10=3.58%, 20=17.32%, 50=18.10%, 100=20.96%, 250=32.98% lat (msec) : 500=6.35%, 750=0.62%, 1000=0.10% cpu : usr=0.04%, sys=0.94%, ctx=4922, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143871: Tue Sep 22 15:25:45 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6028KiB/303726msec) clat (msec): min=4, max=486, avg=40.13, stdev=46.70 lat (msec): min=4, max=486, avg=40.13, stdev=46.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 39], 80.00th=[ 57], 90.00th=[ 94], 95.00th=[ 125], | 99.00th=[ 236], 99.50th=[ 292], 99.90th=[ 456], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 6, max= 112, per=30.04%, avg=23.43, stdev=16.09, samples=496 iops : min= 1, max= 28, avg= 5.24, stdev= 4.08, samples=496 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6260KiB/303726msec); 0 zone resets clat (msec): min=38, max=1668, avg=155.33, stdev=102.06 lat (msec): min=38, max=1668, avg=155.33, stdev=102.06 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 146], | 70.00th=[ 171], 80.00th=[ 203], 90.00th=[ 271], 95.00th=[ 347], | 99.00th=[ 502], 99.50th=[ 575], 99.90th=[ 1070], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 6, max= 56, per=25.43%, avg=20.85, stdev=11.30, samples=575 iops : min= 1, max= 14, avg= 4.58, stdev= 2.92, samples=575 lat (msec) : 10=4.20%, 20=16.73%, 50=17.48%, 100=21.94%, 250=32.88% lat (msec) : 500=6.25%, 750=0.42%, 1000=0.03%, 2000=0.07% cpu : usr=0.03%, sys=0.95%, ctx=4964, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143872: Tue Sep 22 15:25:45 2026 read: IOPS=5, BW=20.0KiB/s (20.5kB/s)(6052KiB/302252msec) clat (msec): min=5, max=968, avg=38.09, stdev=49.84 lat (msec): min=5, max=968, avg=38.09, stdev=49.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 91], 95.00th=[ 124], | 99.00th=[ 197], 99.50th=[ 253], 99.90th=[ 498], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 3, max= 136, per=30.77%, avg=24.00, stdev=16.96, samples=485 iops : min= 0, max= 34, avg= 5.38, stdev= 4.32, samples=485 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6236KiB/302252msec); 0 zone resets clat (msec): min=36, max=1169, avg=156.82, stdev=98.46 lat (msec): min=36, max=1169, avg=156.82, stdev=98.46 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 116], 50.00th=[ 132], 60.00th=[ 150], | 70.00th=[ 174], 80.00th=[ 207], 90.00th=[ 271], 95.00th=[ 347], | 99.00th=[ 510], 99.50th=[ 584], 99.90th=[ 1036], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 6, max= 56, per=25.57%, avg=20.97, stdev=10.93, samples=570 iops : min= 1, max= 14, avg= 4.61, stdev= 2.82, samples=570 lat (msec) : 10=4.56%, 20=17.97%, 50=17.94%, 100=19.76%, 250=33.30% lat (msec) : 500=5.83%, 750=0.49%, 1000=0.10%, 2000=0.07% cpu : usr=0.04%, sys=0.97%, ctx=5014, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=78.8KiB/s (80.7kB/s), 19.5KiB/s-20.0KiB/s (19.0kB/s-20.5kB/s), io=23.4MiB (24.6MB), run=302252-304822msec WRITE: bw=82.5KiB/s (84.5kB/s), 20.6KiB/s-20.8KiB/s (21.1kB/s-21.3kB/s), io=24.6MiB (25.7MB), run=302252-304822msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143929: Tue Sep 22 15:26:32 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(5920KiB/32961msec) clat (usec): min=33, max=262610, avg=45445.77, stdev=41794.60 lat (usec): min=33, max=262612, avg=45446.95, stdev=41794.64 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 76], | 30.00th=[ 19268], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 50594], | 70.00th=[ 62653], 80.00th=[ 77071], 90.00th=[102237], 95.00th=[121111], | 99.00th=[166724], 99.50th=[229639], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 352, per=25.26%, avg=177.08, stdev=71.54, samples=64 iops : min= 1, max= 22, avg=10.30, stdev= 4.49, samples=64 write: IOPS=12, BW=193KiB/s (198kB/s)(6368KiB/32961msec); 0 zone resets clat (usec): min=1317, max=343098, avg=39889.86, stdev=44429.38 lat (usec): min=1320, max=343099, avg=39903.36, stdev=44425.93 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1696], 10.00th=[ 2040], 20.00th=[ 4555], | 30.00th=[ 7767], 40.00th=[ 13435], 50.00th=[ 21103], 60.00th=[ 35914], | 70.00th=[ 52167], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[129500], | 99.00th=[164627], 99.50th=[240124], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 22, max= 571, per=26.56%, avg=195.73, stdev=93.86, samples=63 iops : min= 1, max= 35, avg=11.48, stdev= 5.89, samples=63 lat (usec) : 50=1.82%, 100=9.77%, 250=1.04%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.47%, 4=4.04%, 10=9.11%, 20=8.20%, 50=25.00% lat (msec) : 100=24.87%, 250=10.16%, 500=0.26% cpu : usr=0.05%, sys=4.75%, ctx=1366, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143930: Tue Sep 22 15:26:32 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(5744KiB/31775msec) clat (usec): min=33, max=220581, avg=43343.79, stdev=38063.36 lat (usec): min=33, max=220582, avg=43345.05, stdev=38063.49 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 80], | 30.00th=[ 23200], 40.00th=[ 33424], 50.00th=[ 40633], 60.00th=[ 46400], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[114820], | 99.00th=[156238], 99.50th=[200279], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 32, max= 538, per=26.04%, avg=182.56, stdev=92.70, samples=61 iops : min= 2, max= 33, avg=10.62, stdev= 5.81, samples=61 write: IOPS=12, BW=206KiB/s (211kB/s)(6544KiB/31775msec); 0 zone resets clat (usec): min=1315, max=282166, avg=39418.90, stdev=42477.42 lat (usec): min=1317, max=282169, avg=39422.44, stdev=42476.83 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1713], 10.00th=[ 1893], 20.00th=[ 4621], | 30.00th=[ 8455], 40.00th=[ 13960], 50.00th=[ 23462], 60.00th=[ 38011], | 70.00th=[ 52691], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[121111], | 99.00th=[168821], 99.50th=[193987], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 63, max= 476, per=27.83%, avg=205.08, stdev=91.34, samples=62 iops : min= 3, max= 29, avg=12.05, stdev= 5.72, samples=62 lat (usec) : 50=1.82%, 100=8.33%, 250=1.30%, 500=0.65%, 1000=0.26% lat (msec) : 2=5.47%, 4=3.65%, 10=9.38%, 20=7.55%, 50=27.47% lat (msec) : 100=26.30%, 250=7.55%, 500=0.26% cpu : usr=0.05%, sys=4.37%, ctx=1311, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143931: Tue Sep 22 15:26:32 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(6256KiB/34161msec) clat (usec): min=37, max=310034, avg=45468.15, stdev=44378.75 lat (usec): min=37, max=310035, avg=45472.37, stdev=44381.98 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 65], 20.00th=[ 89], | 30.00th=[ 20841], 40.00th=[ 31327], 50.00th=[ 39584], 60.00th=[ 47449], | 70.00th=[ 58983], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[111674], | 99.00th=[214959], 99.50th=[238027], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 29, max= 381, per=26.72%, avg=187.29, stdev=81.00, samples=66 iops : min= 1, max= 23, avg=10.92, stdev= 5.11, samples=66 write: IOPS=11, BW=177KiB/s (181kB/s)(6032KiB/34161msec); 0 zone resets clat (usec): min=1458, max=330178, avg=42315.31, stdev=49843.60 lat (usec): min=1460, max=330183, avg=42317.45, stdev=49843.62 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1663], 10.00th=[ 1909], 20.00th=[ 4817], | 30.00th=[ 8291], 40.00th=[ 13960], 50.00th=[ 23200], 60.00th=[ 38011], | 70.00th=[ 51643], 80.00th=[ 70779], 90.00th=[111674], 95.00th=[129500], | 99.00th=[223347], 99.50th=[312476], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 22, max= 512, per=24.05%, avg=177.28, stdev=98.78, samples=67 iops : min= 1, max= 32, avg=10.30, stdev= 6.26, samples=67 lat (usec) : 50=1.04%, 100=10.03%, 250=0.91%, 500=0.13%, 750=0.39% lat (msec) : 2=5.47%, 4=4.43%, 10=8.07%, 20=7.55%, 50=28.39% lat (msec) : 100=23.83%, 250=9.24%, 500=0.52% cpu : usr=0.07%, sys=4.17%, ctx=1337, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143932: Tue Sep 22 15:26:32 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(6032KiB/32551msec) clat (usec): min=34, max=334223, avg=42544.36, stdev=42507.10 lat (usec): min=34, max=334224, avg=42547.68, stdev=42506.87 clat percentiles (usec): | 1.00th=[ 36], 5.00th=[ 47], 10.00th=[ 57], 20.00th=[ 69], | 30.00th=[ 198], 40.00th=[ 27919], 50.00th=[ 36439], 60.00th=[ 47449], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[173016], 99.50th=[193987], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 31, max= 382, per=26.51%, avg=185.81, stdev=80.70, samples=63 iops : min= 1, max= 23, avg=10.84, stdev= 5.06, samples=63 write: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32551msec); 0 zone resets clat (usec): min=1379, max=284423, avg=41517.76, stdev=47848.27 lat (usec): min=1380, max=284426, avg=41525.77, stdev=47843.54 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1680], 10.00th=[ 1958], 20.00th=[ 4178], | 30.00th=[ 6915], 40.00th=[ 12256], 50.00th=[ 21627], 60.00th=[ 35914], | 70.00th=[ 53740], 80.00th=[ 78119], 90.00th=[101188], 95.00th=[135267], | 99.00th=[229639], 99.50th=[246416], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 448, per=26.33%, avg=194.05, stdev=80.46, samples=63 iops : min= 1, max= 28, avg=11.37, stdev= 5.10, samples=63 lat (usec) : 50=3.39%, 100=10.68%, 250=0.78%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=5.60%, 4=4.43%, 10=8.98%, 20=6.38%, 50=23.44% lat (msec) : 100=25.65%, 250=9.77%, 500=0.26% cpu : usr=0.07%, sys=4.55%, ctx=1316, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=701KiB/s (718kB/s), 180KiB/s-185KiB/s (184kB/s-190kB/s), io=23.4MiB (24.5MB), run=31775-34161msec WRITE: bw=738KiB/s (755kB/s), 177KiB/s-206KiB/s (181kB/s-211kB/s), io=24.6MiB (25.8MB), run=31775-34161msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143933: Tue Sep 22 15:27:21 2026 read: IOPS=4, BW=71.1KiB/s (72.8kB/s)(5920KiB/83263msec) clat (msec): min=5, max=345, avg=46.45, stdev=48.06 lat (msec): min=5, max=345, avg=46.46, stdev=48.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 109], 95.00th=[ 144], | 99.00th=[ 234], 99.50th=[ 292], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 288, per=28.68%, avg=82.01, stdev=51.87, samples=140 iops : min= 1, max= 18, avg= 4.38, stdev= 3.31, samples=140 write: IOPS=4, BW=76.5KiB/s (78.3kB/s)(6368KiB/83263msec); 0 zone resets clat (msec): min=37, max=497, avg=165.74, stdev=79.52 lat (msec): min=37, max=497, avg=165.75, stdev=79.52 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 84], 20.00th=[ 99], | 30.00th=[ 118], 40.00th=[ 131], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 188], 80.00th=[ 218], 90.00th=[ 271], 95.00th=[ 334], | 99.00th=[ 439], 99.50th=[ 477], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 21, max= 223, per=25.62%, avg=77.11, stdev=36.85, samples=161 iops : min= 1, max= 13, avg= 4.06, stdev= 2.36, samples=161 lat (msec) : 10=2.99%, 20=10.68%, 50=22.53%, 100=17.58%, 250=39.32% lat (msec) : 500=6.90% cpu : usr=0.03%, sys=0.95%, ctx=1286, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143934: Tue Sep 22 15:27:21 2026 read: IOPS=4, BW=68.7KiB/s (70.4kB/s)(5744KiB/83573msec) clat (msec): min=6, max=307, avg=46.25, stdev=48.58 lat (msec): min=6, max=307, avg=46.25, stdev=48.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 114], 95.00th=[ 174], | 99.00th=[ 222], 99.50th=[ 288], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 21, max= 254, per=29.55%, avg=84.51, stdev=56.06, samples=134 iops : min= 1, max= 15, avg= 4.53, stdev= 3.57, samples=134 write: IOPS=4, BW=78.3KiB/s (80.2kB/s)(6544KiB/83573msec); 0 zone resets clat (msec): min=27, max=568, avg=162.63, stdev=79.86 lat (msec): min=27, max=568, avg=162.64, stdev=79.86 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 68], 10.00th=[ 85], 20.00th=[ 103], | 30.00th=[ 115], 40.00th=[ 133], 50.00th=[ 146], 60.00th=[ 165], | 70.00th=[ 188], 80.00th=[ 209], 90.00th=[ 259], 95.00th=[ 300], | 99.00th=[ 447], 99.50th=[ 506], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 21, max= 287, per=26.55%, avg=79.91, stdev=40.47, samples=161 iops : min= 1, max= 17, avg= 4.23, stdev= 2.58, samples=161 lat (msec) : 10=1.17%, 20=10.94%, 50=25.00%, 100=14.19%, 250=42.32% lat (msec) : 500=5.99%, 750=0.39% cpu : usr=0.04%, sys=0.99%, ctx=1280, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143935: Tue Sep 22 15:27:21 2026 read: IOPS=4, BW=77.3KiB/s (79.1kB/s)(6256KiB/80950msec) clat (msec): min=8, max=371, avg=43.14, stdev=43.43 lat (msec): min=8, max=371, avg=43.14, stdev=43.43 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 87], 95.00th=[ 124], | 99.00th=[ 249], 99.50th=[ 255], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 320, per=31.52%, avg=90.15, stdev=63.88, samples=137 iops : min= 1, max= 20, avg= 4.89, stdev= 4.07, samples=137 write: IOPS=4, BW=74.5KiB/s (76.3kB/s)(6032KiB/80950msec); 0 zone resets clat (msec): min=53, max=568, avg=169.10, stdev=80.97 lat (msec): min=53, max=568, avg=169.11, stdev=80.96 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 77], 10.00th=[ 87], 20.00th=[ 103], | 30.00th=[ 120], 40.00th=[ 133], 50.00th=[ 148], 60.00th=[ 167], | 70.00th=[ 194], 80.00th=[ 234], 90.00th=[ 275], 95.00th=[ 326], | 99.00th=[ 464], 99.50th=[ 506], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 21, max= 160, per=25.19%, avg=75.83, stdev=33.04, samples=155 iops : min= 1, max= 10, avg= 3.97, stdev= 2.15, samples=155 lat (msec) : 10=0.91%, 20=12.11%, 50=26.30%, 100=16.67%, 250=36.07% lat (msec) : 500=7.68%, 750=0.26% cpu : usr=0.04%, sys=1.13%, ctx=1325, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143936: Tue Sep 22 15:27:21 2026 read: IOPS=4, BW=72.0KiB/s (74.7kB/s)(6032KiB/82633msec) clat (msec): min=7, max=339, avg=46.22, stdev=46.61 lat (msec): min=7, max=339, avg=46.22, stdev=46.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 101], 95.00th=[ 140], | 99.00th=[ 247], 99.50th=[ 305], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 351, per=30.51%, avg=87.24, stdev=57.68, samples=135 iops : min= 1, max= 21, avg= 4.70, stdev= 3.66, samples=135 write: IOPS=4, BW=75.7KiB/s (77.5kB/s)(6256KiB/82633msec); 0 zone resets clat (msec): min=57, max=592, avg=165.98, stdev=82.45 lat (msec): min=57, max=592, avg=165.99, stdev=82.45 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 80], 10.00th=[ 86], 20.00th=[ 105], | 30.00th=[ 115], 40.00th=[ 130], 50.00th=[ 142], 60.00th=[ 167], | 70.00th=[ 184], 80.00th=[ 218], 90.00th=[ 275], 95.00th=[ 313], | 99.00th=[ 485], 99.50th=[ 567], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 30, max= 159, per=26.00%, avg=78.27, stdev=33.96, samples=157 iops : min= 1, max= 9, avg= 4.13, stdev= 2.18, samples=157 lat (msec) : 10=1.04%, 20=12.76%, 50=22.01%, 100=17.58%, 250=39.58% lat (msec) : 500=6.64%, 750=0.39% cpu : usr=0.03%, sys=1.00%, ctx=1240, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=287KiB/s (293kB/s), 68.7KiB/s-77.3KiB/s (70.4kB/s-79.1kB/s), io=23.4MiB (24.5MB), run=80950-83573msec WRITE: bw=302KiB/s (309kB/s), 74.5KiB/s-78.3KiB/s (76.3kB/s-80.2kB/s), io=24.6MiB (25.8MB), run=80950-83573msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143962: Tue Sep 22 15:27:40 2026 read: IOPS=1, BW=1254KiB/s (1285kB/s)(7168KiB/5714msec) clat (msec): min=103, max=740, avg=316.53, stdev=225.57 lat (msec): min=103, max=740, avg=316.54, stdev=225.57 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 284], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 477], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1521, max= 2027, per=69.87%, avg=1917.17, stdev=199.00, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=896KiB/s (918kB/s)(5120KiB/5714msec); 0 zone resets clat (msec): min=472, max=872, avg=634.54, stdev=147.69 lat (msec): min=473, max=872, avg=634.73, stdev=147.69 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1845, max= 3946, per=67.83%, avg=2606.00, stdev=1164.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=25.00%, 500=33.33%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=2.31%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143963: Tue Sep 22 15:27:40 2026 read: IOPS=0, BW=284KiB/s (291kB/s)(2048KiB/7209msec) clat (msec): min=91, max=165, avg=128.30, stdev=52.22 lat (msec): min=91, max=165, avg=128.31, stdev=52.22 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 165], 95.00th=[ 165], | 99.00th=[ 165], 99.50th=[ 165], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 1539, max= 2003, per=64.54%, avg=1771.00, stdev=328.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1420KiB/s (1455kB/s)(10.0MiB/7209msec); 0 zone resets clat (msec): min=191, max=1718, avg=653.51, stdev=425.96 lat (msec): min=191, max=1720, avg=653.93, stdev=426.44 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 330], | 30.00th=[ 456], 40.00th=[ 498], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 676], 80.00th=[ 735], 90.00th=[ 911], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1845, max= 2043, per=51.58%, avg=1981.88, stdev=70.00, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (msec) : 100=8.33%, 250=16.67%, 500=25.00%, 750=33.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.01%, sys=4.04%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143964: Tue Sep 22 15:27:40 2026 read: IOPS=0, BW=933KiB/s (956kB/s)(6144KiB/6582msec) clat (msec): min=99, max=1217, avg=389.43, stdev=418.90 lat (msec): min=99, max=1217, avg=389.43, stdev=418.90 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 249], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1973, max= 4047, per=91.53%, avg=2511.50, stdev=1023.87, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=933KiB/s (956kB/s)(6144KiB/6582msec); 0 zone resets clat (msec): min=270, max=1727, avg=658.25, stdev=545.20 lat (msec): min=270, max=1727, avg=658.39, stdev=545.17 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 575], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1492, max= 2027, per=49.89%, avg=1916.80, stdev=237.49, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=2.26%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143965: Tue Sep 22 15:27:40 2026 read: IOPS=0, BW=686KiB/s (703kB/s)(5120KiB/7461msec) clat (msec): min=169, max=504, avg=280.99, stdev=145.88 lat (msec): min=169, max=504, avg=280.99, stdev=145.88 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 3946, max= 4007, per=100.00%, avg=3976.50, stdev=43.13, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=961KiB/s (984kB/s)(7168KiB/7461msec); 0 zone resets clat (msec): min=226, max=1564, avg=858.17, stdev=507.18 lat (msec): min=226, max=1564, avg=858.35, stdev=507.22 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 372], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 978], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1234], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1542, max= 4063, per=58.32%, avg=2240.50, stdev=910.81, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=25.00% cpu : usr=0.01%, sys=1.55%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2745KiB/s (2811kB/s), 284KiB/s-1254KiB/s (291kB/s-1285kB/s), io=20.0MiB (20.0MB), run=5714-7461msec WRITE: bw=3843KiB/s (3935kB/s), 896KiB/s-1420KiB/s (918kB/s-1455kB/s), io=28.0MiB (29.4MB), run=5714-7461msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143958: Tue Sep 22 15:27:40 2026 read: IOPS=2, BW=2380KiB/s (2437kB/s)(7168KiB/3012msec) clat (usec): min=498, max=446401, avg=220147.72, stdev=150484.59 lat (usec): min=499, max=446402, avg=220149.10, stdev=150484.65 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[120062], | 30.00th=[123208], 40.00th=[123208], 50.00th=[225444], 60.00th=[312476], | 70.00th=[312476], 80.00th=[312476], 90.00th=[446694], 95.00th=[446694], | 99.00th=[446694], 99.50th=[446694], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 2035, max= 4031, per=100.00%, avg=2856.00, stdev=989.36, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1700KiB/s (1741kB/s)(5120KiB/3012msec); 0 zone resets clat (msec): min=118, max=372, avg=257.80, stdev=101.84 lat (msec): min=118, max=373, avg=257.87, stdev=101.85 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1988, max= 4031, per=66.52%, avg=2523.25, stdev=1005.43, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=41.67% cpu : usr=0.03%, sys=16.27%, ctx=380, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143959: Tue Sep 22 15:27:40 2026 read: IOPS=0, BW=326KiB/s (334kB/s)(2048KiB/6281msec) clat (usec): min=563, max=272462, avg=136513.09, stdev=192261.51 lat (usec): min=564, max=272464, avg=136514.58, stdev=192262.88 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[ 562], 60.00th=[270533], | 70.00th=[270533], 80.00th=[270533], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1825, max= 2007, per=70.73%, avg=1916.00, stdev=128.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1630KiB/s (1669kB/s)(10.0MiB/6281msec); 0 zone resets clat (msec): min=319, max=1046, avg=586.39, stdev=286.61 lat (msec): min=319, max=1046, avg=586.50, stdev=286.60 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 426], 60.00th=[ 592], | 70.00th=[ 743], 80.00th=[ 760], 90.00th=[ 1003], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1872, max= 2048, per=52.86%, avg=2005.11, stdev=52.89, samples=9 iops : min= 1, max= 2, avg= 1.11, stdev= 0.33, samples=9 lat (usec) : 750=8.33% lat (msec) : 500=50.00%, 750=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.02%, sys=8.47%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143960: Tue Sep 22 15:27:40 2026 read: IOPS=1, BW=1496KiB/s (1532kB/s)(6144KiB/4106msec) clat (msec): min=114, max=627, avg=351.25, stdev=163.32 lat (msec): min=114, max=627, avg=351.26, stdev=163.32 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2007, max= 4079, per=93.54%, avg=2534.00, stdev=1030.07, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1496KiB/s (1532kB/s)(6144KiB/4106msec); 0 zone resets clat (msec): min=101, max=535, avg=320.83, stdev=172.14 lat (msec): min=101, max=535, avg=320.95, stdev=172.14 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 380], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1988, max= 3340, per=62.03%, avg=2352.75, stdev=658.67, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=25.00%, 500=58.33%, 750=16.67% cpu : usr=0.05%, sys=12.55%, ctx=187, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143961: Tue Sep 22 15:27:40 2026 read: IOPS=0, BW=677KiB/s (694kB/s)(5120KiB/7558msec) clat (msec): min=2, max=455, avg=247.93, stdev=222.48 lat (msec): min=2, max=455, avg=247.94, stdev=222.48 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 15], 40.00th=[ 15], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1872, max= 4071, per=98.17%, avg=2659.33, stdev=1225.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=948KiB/s (971kB/s)(7168KiB/7558msec); 0 zone resets clat (msec): min=300, max=1508, avg=859.12, stdev=504.13 lat (msec): min=300, max=1508, avg=859.22, stdev=504.10 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 347], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 995], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1368], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 1988, max= 4055, per=62.20%, avg=2359.17, stdev=831.01, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 4=8.33%, 20=8.33%, 500=50.00%, 1000=8.33%, 2000=25.00% cpu : usr=0.00%, sys=5.81%, ctx=126, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2710KiB/s (2775kB/s), 326KiB/s-2380KiB/s (334kB/s-2437kB/s), io=20.0MiB (20.0MB), run=3012-7558msec WRITE: bw=3794KiB/s (3885kB/s), 948KiB/s-1700KiB/s (971kB/s-1741kB/s), io=28.0MiB (29.4MB), run=3012-7558msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143972: Tue Sep 22 15:27:55 2026 read: IOPS=0, BW=3846KiB/s (3938kB/s)(12.0MiB/3195msec) clat (msec): min=898, max=1270, avg=1032.09, stdev=207.34 lat (msec): min=898, max=1270, avg=1032.09, stdev=207.34 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8078, max= 8110, per=100.00%, avg=8094.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.52%, ctx=226, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143973: Tue Sep 22 15:27:55 2026 read: IOPS=0, BW=1011KiB/s (1035kB/s)(4096KiB/4052msec) clat (nsec): min=869464k, max=869464k, avg=869464231.00, stdev= 0.00 lat (nsec): min=869466k, max=869466k, avg=869466129.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2022KiB/s (2070kB/s)(8192KiB/4052msec); 0 zone resets clat (msec): min=857, max=2287, avg=1572.39, stdev=1010.77 lat (msec): min=857, max=2287, avg=1572.70, stdev=1010.84 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 2299], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.55%, ctx=91, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143974: Tue Sep 22 15:27:55 2026 write: IOPS=0, BW=3201KiB/s (3278kB/s)(12.0MiB/3839msec); 0 zone resets clat (msec): min=484, max=2053, avg=1273.35, stdev=784.55 lat (msec): min=484, max=2053, avg=1273.80, stdev=784.58 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.86%, ctx=76, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143976: Tue Sep 22 15:27:55 2026 write: IOPS=0, BW=3851KiB/s (3943kB/s)(12.0MiB/3191msec); 0 zone resets clat (msec): min=450, max=1736, avg=1050.14, stdev=646.93 lat (msec): min=451, max=1736, avg=1052.14, stdev=646.47 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.11%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4043KiB/s (4140kB/s), 1011KiB/s-3846KiB/s (1035kB/s-3938kB/s), io=16.0MiB (16.8MB), run=3195-4052msec WRITE: bw=8087KiB/s (8281kB/s), 2022KiB/s-3851KiB/s (2070kB/s-3943kB/s), io=32.0MiB (33.6MB), run=3191-4052msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143977: Tue Sep 22 15:27:56 2026 read: IOPS=0, BW=2621KiB/s (2683kB/s)(12.0MiB/4689msec) clat (msec): min=275, max=2236, avg=1530.45, stdev=1089.48 lat (msec): min=275, max=2236, avg=1530.46, stdev=1089.48 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 2072], 50.00th=[ 2072], 60.00th=[ 2072], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.92%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143978: Tue Sep 22 15:27:56 2026 read: IOPS=0, BW=856KiB/s (877kB/s)(4096KiB/4785msec) clat (nsec): min=1524.7M, max=1524.7M, avg=1524735598.00, stdev= 0.00 lat (nsec): min=1524.7M, max=1524.7M, avg=1524738485.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1519], 5.00th=[ 1519], 10.00th=[ 1519], 20.00th=[ 1519], | 30.00th=[ 1519], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1712KiB/s (1753kB/s)(8192KiB/4785msec); 0 zone resets clat (msec): min=677, max=2459, avg=1568.44, stdev=1260.33 lat (msec): min=677, max=2460, avg=1568.93, stdev=1260.56 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 2467], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.19%, ctx=35, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143979: Tue Sep 22 15:27:56 2026 write: IOPS=0, BW=2753KiB/s (2819kB/s)(12.0MiB/4463msec); 0 zone resets clat (msec): min=349, max=2654, avg=1464.81, stdev=1154.44 lat (msec): min=349, max=2658, avg=1467.50, stdev=1156.46 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 7907, max= 8175, per=100.00%, avg=8041.00, stdev=189.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.97%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143980: Tue Sep 22 15:27:56 2026 write: IOPS=0, BW=3308KiB/s (3387kB/s)(12.0MiB/3715msec); 0 zone resets clat (msec): min=337, max=2361, avg=1205.16, stdev=1042.36 lat (msec): min=341, max=2362, avg=1206.79, stdev=1041.13 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.48%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3424KiB/s (3506kB/s), 856KiB/s-2621KiB/s (877kB/s-2683kB/s), io=16.0MiB (16.8MB), run=4689-4785msec WRITE: bw=6848KiB/s (7012kB/s), 1712KiB/s-3308KiB/s (1753kB/s-3387kB/s), io=32.0MiB (33.6MB), run=3715-4785msec