== sanity test 398b: DIO and buffer IO race ============== 23:20:19 (1788924019) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.54235 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178834: Tue Sep 8 23:22:44 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(5992KiB/124898msec) clat (usec): min=41, max=748637, avg=45628.71, stdev=35113.56 lat (usec): min=42, max=748639, avg=45630.08, stdev=35113.51 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9896], 10.00th=[ 15664], 20.00th=[ 22676], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 63177], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[162530], 99.50th=[183501], 99.90th=[278922], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 5, max= 94, per=24.90%, avg=47.32, stdev=18.29, samples=246 iops : min= 1, max= 23, avg=11.19, stdev= 4.59, samples=246 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6296KiB/124898msec); 0 zone resets clat (usec): min=856, max=248554, avg=35631.78, stdev=36464.30 lat (usec): min=856, max=248555, avg=35642.70, stdev=36464.82 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1778], 20.00th=[ 3785], | 30.00th=[ 7308], 40.00th=[ 16057], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 62129], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[156238], 99.50th=[173016], 99.90th=[227541], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 119, per=25.14%, avg=50.02, stdev=21.15, samples=245 iops : min= 1, max= 29, avg=11.86, stdev= 5.33, samples=245 lat (usec) : 50=0.42%, 100=1.43%, 250=0.07%, 500=0.07%, 1000=0.16% lat (msec) : 2=5.60%, 4=4.95%, 10=7.26%, 20=10.03%, 50=39.62% lat (msec) : 100=24.67%, 250=5.66%, 500=0.03%, 750=0.03% cpu : usr=0.06%, sys=4.60%, ctx=6498, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178835: Tue Sep 8 23:22:44 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(5940KiB/124454msec) clat (usec): min=32, max=772894, avg=45510.75, stdev=34876.05 lat (usec): min=33, max=772895, avg=45519.87, stdev=34874.96 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10814], 10.00th=[ 16450], 20.00th=[ 22152], | 30.00th=[ 27395], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[149947], 99.50th=[166724], 99.90th=[254804], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 7, max= 103, per=24.89%, avg=47.30, stdev=17.48, samples=244 iops : min= 1, max= 25, avg=11.18, stdev= 4.41, samples=244 write: IOPS=12, BW=51.0KiB/s (52.2kB/s)(6348KiB/124454msec); 0 zone resets clat (usec): min=914, max=234912, avg=35534.92, stdev=36406.20 lat (usec): min=915, max=234913, avg=35539.24, stdev=36404.49 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1795], 20.00th=[ 3687], | 30.00th=[ 6849], 40.00th=[ 17433], 50.00th=[ 26870], 60.00th=[ 35390], | 70.00th=[ 45351], 80.00th=[ 62653], 90.00th=[ 83362], 95.00th=[106431], | 99.00th=[164627], 99.50th=[183501], 99.90th=[229639], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 125, per=25.36%, avg=50.46, stdev=21.92, samples=244 iops : min= 1, max= 31, avg=11.98, stdev= 5.53, samples=244 lat (usec) : 50=0.26%, 100=1.43%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.96%, 4=5.01%, 10=6.84%, 20=10.16%, 50=39.36% lat (msec) : 100=25.10%, 250=5.60%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.62%, ctx=6575, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178837: Tue Sep 8 23:22:44 2026 read: IOPS=12, BW=48.8KiB/s (50.0kB/s)(6028KiB/123426msec) clat (usec): min=31, max=450004, avg=45390.29, stdev=30915.76 lat (usec): min=32, max=450005, avg=45394.56, stdev=30915.78 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10028], 10.00th=[ 16909], 20.00th=[ 23200], | 30.00th=[ 27919], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[141558], 99.50th=[164627], 99.90th=[238027], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 15, max= 95, per=25.67%, avg=48.78, stdev=17.30, samples=241 iops : min= 3, max= 23, avg=11.55, stdev= 4.37, samples=241 write: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6260KiB/123426msec); 0 zone resets clat (usec): min=889, max=809961, avg=34834.18, stdev=38733.98 lat (usec): min=889, max=809965, avg=34837.05, stdev=38733.57 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1713], 20.00th=[ 3621], | 30.00th=[ 8356], 40.00th=[ 17433], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[141558], 99.50th=[156238], 99.90th=[254804], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 103, per=25.36%, avg=50.46, stdev=20.08, samples=242 iops : min= 1, max= 25, avg=11.97, stdev= 5.05, samples=242 lat (usec) : 50=0.46%, 100=1.50%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.18%, 4=4.43%, 10=6.09%, 20=10.25%, 50=40.53% lat (msec) : 100=25.49%, 250=4.75%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=4.89%, ctx=6514, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178839: Tue Sep 8 23:22:44 2026 read: IOPS=12, BW=48.1KiB/s (49.3kB/s)(6052KiB/125732msec) clat (usec): min=33, max=246936, avg=44746.87, stdev=30900.77 lat (usec): min=34, max=246938, avg=44750.99, stdev=30900.77 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 91], 10.00th=[ 15008], 20.00th=[ 21627], | 30.00th=[ 27657], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[156238], 99.50th=[185598], 99.90th=[235930], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 127, per=25.30%, avg=48.07, stdev=18.36, samples=246 iops : min= 1, max= 31, avg=11.37, stdev= 4.60, samples=246 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6236KiB/125732msec); 0 zone resets clat (usec): min=847, max=830447, avg=36934.71, stdev=42169.57 lat (usec): min=848, max=830449, avg=36936.86, stdev=42169.23 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1860], 20.00th=[ 3949], | 30.00th=[ 7635], 40.00th=[ 16909], 50.00th=[ 26870], 60.00th=[ 35914], | 70.00th=[ 46400], 80.00th=[ 64226], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[158335], 99.50th=[177210], 99.90th=[299893], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 133, per=24.86%, avg=49.48, stdev=21.34, samples=246 iops : min= 1, max= 33, avg=11.73, stdev= 5.37, samples=246 lat (usec) : 50=0.33%, 100=2.18%, 250=0.16%, 500=0.07%, 1000=0.23% lat (msec) : 2=5.40%, 4=4.69%, 10=7.13%, 20=10.03%, 50=38.70% lat (msec) : 100=25.07%, 250=5.96%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.68%, ctx=6512, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=191KiB/s (196kB/s), 47.7KiB/s-48.8KiB/s (48.9kB/s-50.0kB/s), io=23.4MiB (24.6MB), run=123426-125732msec WRITE: bw=200KiB/s (205kB/s), 49.6KiB/s-51.0KiB/s (50.8kB/s-52.2kB/s), io=24.6MiB (25.7MB), run=123426-125732msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178833: Tue Sep 8 23:23:22 2026 read: IOPS=9, BW=37.0KiB/s (37.9kB/s)(5992KiB/161761msec) clat (msec): min=5, max=793, avg=42.43, stdev=43.10 lat (msec): min=5, max=793, avg=42.44, stdev=43.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 92], 95.00th=[ 125], | 99.00th=[ 199], 99.50th=[ 211], 99.90th=[ 359], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 136, per=25.75%, avg=37.60, stdev=25.21, samples=311 iops : min= 1, max= 34, avg= 8.77, stdev= 6.35, samples=311 write: IOPS=9, BW=38.9KiB/s (39.9kB/s)(6296KiB/161761msec); 0 zone resets clat (msec): min=10, max=459, avg=62.14, stdev=45.70 lat (msec): min=10, max=459, avg=62.14, stdev=45.69 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 120], 95.00th=[ 146], | 99.00th=[ 239], 99.50th=[ 264], 99.90th=[ 414], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 128, per=25.33%, avg=38.76, stdev=24.07, samples=317 iops : min= 1, max= 32, avg= 9.05, stdev= 6.06, samples=317 lat (msec) : 10=2.18%, 20=15.66%, 50=45.96%, 100=23.80%, 250=11.95% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.05%, sys=1.66%, ctx=4740, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178836: Tue Sep 8 23:23:22 2026 read: IOPS=9, BW=36.3KiB/s (37.2kB/s)(5940KiB/163584msec) clat (msec): min=5, max=761, avg=43.53, stdev=46.09 lat (msec): min=5, max=761, avg=43.53, stdev=46.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 101], 95.00th=[ 134], | 99.00th=[ 218], 99.50th=[ 234], 99.90th=[ 351], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 144, per=25.14%, avg=36.70, stdev=25.90, samples=315 iops : min= 1, max= 36, avg= 8.52, stdev= 6.52, samples=315 write: IOPS=9, BW=38.8KiB/s (39.7kB/s)(6348KiB/163584msec); 0 zone resets clat (msec): min=12, max=445, avg=62.10, stdev=44.69 lat (msec): min=12, max=445, avg=62.10, stdev=44.69 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 92], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 222], 99.50th=[ 239], 99.90th=[ 321], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 118, per=25.26%, avg=38.65, stdev=24.43, samples=319 iops : min= 1, max= 29, avg= 9.03, stdev= 6.16, samples=319 lat (msec) : 10=2.83%, 20=14.78%, 50=46.88%, 100=21.97%, 250=13.12% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4817, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178838: Tue Sep 8 23:23:22 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6028KiB/162561msec) clat (msec): min=5, max=358, avg=43.54, stdev=41.33 lat (msec): min=5, max=358, avg=43.54, stdev=41.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 97], 95.00th=[ 131], | 99.00th=[ 207], 99.50th=[ 226], 99.90th=[ 309], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 159, per=25.57%, avg=37.33, stdev=25.44, samples=314 iops : min= 1, max= 39, avg= 8.69, stdev= 6.39, samples=314 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6260KiB/162561msec); 0 zone resets clat (msec): min=9, max=795, avg=61.69, stdev=46.93 lat (msec): min=9, max=795, avg=61.69, stdev=46.93 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 72], 80.00th=[ 92], 90.00th=[ 122], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 249], 99.90th=[ 401], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 126, per=25.08%, avg=38.38, stdev=24.44, samples=317 iops : min= 1, max= 31, avg= 8.96, stdev= 6.16, samples=317 lat (msec) : 10=2.41%, 20=15.46%, 50=46.16%, 100=22.59%, 250=13.02% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4713, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178840: Tue Sep 8 23:23:22 2026 read: IOPS=9, BW=37.1KiB/s (38.0kB/s)(6052KiB/162920msec) clat (msec): min=5, max=348, avg=42.94, stdev=41.01 lat (msec): min=5, max=348, avg=42.94, stdev=41.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 99], 95.00th=[ 127], | 99.00th=[ 207], 99.50th=[ 224], 99.90th=[ 305], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 136, per=26.30%, avg=38.40, stdev=26.53, samples=307 iops : min= 1, max= 34, avg= 8.96, stdev= 6.67, samples=307 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6236KiB/162920msec); 0 zone resets clat (msec): min=8, max=817, avg=62.59, stdev=49.13 lat (msec): min=8, max=817, avg=62.60, stdev=49.13 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 93], 90.00th=[ 123], 95.00th=[ 148], | 99.00th=[ 234], 99.50th=[ 271], 99.90th=[ 418], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 142, per=24.95%, avg=38.18, stdev=24.14, samples=318 iops : min= 1, max= 35, avg= 8.91, stdev= 6.10, samples=318 lat (msec) : 10=2.21%, 20=16.80%, 50=44.60%, 100=22.82%, 250=12.99% lat (msec) : 500=0.55%, 1000=0.03% cpu : usr=0.05%, sys=1.64%, ctx=4804, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (150kB/s), 36.3KiB/s-37.1KiB/s (37.2kB/s-38.0kB/s), io=23.4MiB (24.6MB), run=161761-163584msec WRITE: bw=154KiB/s (157kB/s), 38.3KiB/s-38.9KiB/s (39.2kB/s-39.9kB/s), io=24.6MiB (25.7MB), run=161761-163584msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178886: Tue Sep 8 23:24:01 2026 read: IOPS=12, BW=202KiB/s (206kB/s)(5920KiB/29369msec) clat (usec): min=47, max=257682, avg=42673.28, stdev=28978.79 lat (usec): min=48, max=257684, avg=42674.64, stdev=28978.86 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 81], 10.00th=[ 16909], 20.00th=[ 23462], | 30.00th=[ 28443], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[149947], 99.50th=[196084], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 383, per=25.17%, avg=201.88, stdev=68.22, samples=58 iops : min= 1, max= 23, avg=11.86, stdev= 4.34, samples=58 write: IOPS=13, BW=217KiB/s (222kB/s)(6368KiB/29369msec); 0 zone resets clat (usec): min=1490, max=157395, avg=33867.00, stdev=29630.74 lat (usec): min=1493, max=157397, avg=33891.93, stdev=29611.23 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2704], 10.00th=[ 3785], 20.00th=[ 6849], | 30.00th=[ 10814], 40.00th=[ 19530], 50.00th=[ 26346], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 57410], 90.00th=[ 77071], 95.00th=[ 90702], | 99.00th=[129500], 99.50th=[139461], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 63, max= 542, per=26.14%, avg=220.60, stdev=77.74, samples=57 iops : min= 3, max= 33, avg=13.04, stdev= 4.86, samples=57 lat (usec) : 50=0.13%, 100=2.60%, 250=0.13% lat (msec) : 2=1.95%, 4=4.30%, 10=8.85%, 20=10.42%, 50=44.27% lat (msec) : 100=23.57%, 250=3.65%, 500=0.13% cpu : usr=0.09%, sys=6.23%, ctx=1836, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178887: Tue Sep 8 23:24:01 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(5744KiB/29852msec) clat (usec): min=54, max=186652, avg=42754.45, stdev=25489.17 lat (usec): min=55, max=186653, avg=42755.71, stdev=25489.14 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 302], 10.00th=[ 17171], 20.00th=[ 23987], | 30.00th=[ 30016], 40.00th=[ 33424], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 50594], 80.00th=[ 59507], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[121111], 99.50th=[149947], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 30, max= 320, per=24.02%, avg=192.64, stdev=71.76, samples=59 iops : min= 1, max= 20, avg=11.27, stdev= 4.58, samples=59 write: IOPS=13, BW=219KiB/s (224kB/s)(6544KiB/29852msec); 0 zone resets clat (usec): min=1399, max=197756, avg=34907.38, stdev=33473.70 lat (usec): min=1400, max=197758, avg=34924.27, stdev=33477.14 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2540], 10.00th=[ 3589], 20.00th=[ 6063], | 30.00th=[ 9765], 40.00th=[ 19268], 50.00th=[ 25822], 60.00th=[ 34341], | 70.00th=[ 43254], 80.00th=[ 56886], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[149947], 99.50th=[160433], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 444, per=25.87%, avg=218.37, stdev=81.06, samples=59 iops : min= 1, max= 27, avg=12.90, stdev= 5.08, samples=59 lat (usec) : 100=1.30%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=1.69%, 4=5.21%, 10=9.90%, 20=8.07%, 50=45.18% lat (msec) : 100=22.92%, 250=4.56% cpu : usr=0.04%, sys=5.78%, ctx=1770, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178888: Tue Sep 8 23:24:01 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29826msec) clat (usec): min=49, max=160482, avg=40928.78, stdev=23786.12 lat (usec): min=50, max=160484, avg=40935.39, stdev=23786.12 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 16581], 20.00th=[ 23200], | 30.00th=[ 27132], 40.00th=[ 33162], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 58983], 90.00th=[ 71828], 95.00th=[ 82314], | 99.00th=[113771], 99.50th=[126354], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 63, max= 416, per=26.15%, avg=209.75, stdev=80.29, samples=59 iops : min= 3, max= 26, avg=12.36, stdev= 5.12, samples=59 write: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29826msec); 0 zone resets clat (usec): min=1467, max=242863, avg=36069.02, stdev=35590.16 lat (usec): min=1468, max=242866, avg=36089.44, stdev=35581.96 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2573], 10.00th=[ 3261], 20.00th=[ 6390], | 30.00th=[ 11207], 40.00th=[ 20317], 50.00th=[ 27657], 60.00th=[ 34341], | 70.00th=[ 43254], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[114820], | 99.00th=[162530], 99.50th=[187696], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 63, max= 351, per=23.84%, avg=201.19, stdev=64.91, samples=59 iops : min= 3, max= 21, avg=11.81, stdev= 4.06, samples=59 lat (usec) : 50=0.13%, 100=2.99%, 250=0.52%, 1000=0.13% lat (msec) : 2=1.17%, 4=5.73%, 10=7.29%, 20=8.72%, 50=43.62% lat (msec) : 100=25.91%, 250=3.78% cpu : usr=0.08%, sys=5.97%, ctx=1870, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178889: Tue Sep 8 23:24:01 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(6032KiB/28508msec) clat (usec): min=40, max=183510, avg=41738.35, stdev=28150.67 lat (usec): min=40, max=183511, avg=41740.84, stdev=28150.95 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 66], 10.00th=[ 202], 20.00th=[ 21627], | 30.00th=[ 27395], 40.00th=[ 32375], 50.00th=[ 37487], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[139461], 99.50th=[168821], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 350, per=26.14%, avg=209.68, stdev=64.61, samples=56 iops : min= 1, max= 21, avg=12.36, stdev= 4.11, samples=56 write: IOPS=13, BW=219KiB/s (225kB/s)(6256KiB/28508msec); 0 zone resets clat (usec): min=1498, max=213741, avg=32197.75, stdev=32320.23 lat (usec): min=1499, max=213744, avg=32208.91, stdev=32331.86 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2147], 10.00th=[ 3064], 20.00th=[ 5473], | 30.00th=[ 9372], 40.00th=[ 16188], 50.00th=[ 23200], 60.00th=[ 29492], | 70.00th=[ 40109], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[154141], 99.50th=[189793], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 63, max= 538, per=26.03%, avg=219.68, stdev=91.70, samples=56 iops : min= 3, max= 33, avg=13.00, stdev= 5.76, samples=56 lat (usec) : 50=0.65%, 100=3.65%, 250=0.65%, 500=0.13% lat (msec) : 2=2.21%, 4=5.34%, 10=8.59%, 20=10.68%, 50=41.28% lat (msec) : 100=23.31%, 250=3.52% cpu : usr=0.07%, sys=6.01%, ctx=1694, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=802KiB/s (822kB/s), 192KiB/s-212KiB/s (197kB/s-217kB/s), io=23.4MiB (24.5MB), run=28508-29852msec WRITE: bw=844KiB/s (864kB/s), 202KiB/s-219KiB/s (207kB/s-225kB/s), io=24.6MiB (25.8MB), run=28508-29852msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178882: Tue Sep 8 23:24:13 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(5920KiB/42168msec) clat (msec): min=6, max=200, avg=43.86, stdev=36.11 lat (msec): min=6, max=200, avg=43.86, stdev=36.11 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 130], | 99.00th=[ 176], 99.50th=[ 197], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 350, per=25.21%, avg=142.72, stdev=78.80, samples=81 iops : min= 1, max= 21, avg= 8.12, stdev= 5.01, samples=81 write: IOPS=9, BW=151KiB/s (155kB/s)(6368KiB/42168msec); 0 zone resets clat (msec): min=18, max=289, avg=65.02, stdev=39.42 lat (msec): min=18, max=289, avg=65.04, stdev=39.42 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 85], 90.00th=[ 122], 95.00th=[ 144], | 99.00th=[ 215], 99.50th=[ 239], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 383, per=25.26%, avg=150.28, stdev=74.47, samples=83 iops : min= 1, max= 23, avg= 8.60, stdev= 4.72, samples=83 lat (msec) : 10=0.13%, 20=10.68%, 50=48.57%, 100=27.60%, 250=12.89% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.84%, ctx=1177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178883: Tue Sep 8 23:24:13 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5744KiB/42282msec) clat (msec): min=7, max=245, avg=43.87, stdev=36.29 lat (msec): min=7, max=245, avg=43.87, stdev=36.29 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 124], | 99.00th=[ 171], 99.50th=[ 203], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 29, max= 413, per=24.31%, avg=137.60, stdev=85.49, samples=81 iops : min= 1, max= 25, avg= 7.80, stdev= 5.41, samples=81 write: IOPS=9, BW=155KiB/s (158kB/s)(6544KiB/42282msec); 0 zone resets clat (msec): min=17, max=308, avg=64.52, stdev=40.31 lat (msec): min=17, max=308, avg=64.52, stdev=40.31 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 73], 80.00th=[ 88], 90.00th=[ 116], 95.00th=[ 146], | 99.00th=[ 201], 99.50th=[ 249], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 383, per=25.97%, avg=154.51, stdev=76.36, samples=82 iops : min= 1, max= 23, avg= 8.87, stdev= 4.84, samples=82 lat (msec) : 10=0.78%, 20=10.42%, 50=47.66%, 100=29.17%, 250=11.72% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.84%, ctx=1127, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178884: Tue Sep 8 23:24:13 2026 read: IOPS=9, BW=148KiB/s (152kB/s)(6256KiB/42280msec) clat (msec): min=7, max=234, avg=41.33, stdev=33.02 lat (msec): min=7, max=234, avg=41.33, stdev=33.02 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 77], 95.00th=[ 115], | 99.00th=[ 165], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 442, per=26.16%, avg=148.05, stdev=89.07, samples=83 iops : min= 1, max= 27, avg= 8.46, stdev= 5.61, samples=83 write: IOPS=8, BW=143KiB/s (146kB/s)(6032KiB/42280msec); 0 zone resets clat (msec): min=17, max=283, avg=68.97, stdev=44.48 lat (msec): min=17, max=283, avg=68.98, stdev=44.48 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 101], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 381, per=23.58%, avg=140.29, stdev=66.09, samples=83 iops : min= 1, max= 23, avg= 7.98, stdev= 4.23, samples=83 lat (msec) : 10=0.52%, 20=10.81%, 50=50.65%, 100=24.87%, 250=12.76% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.92%, ctx=1112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178885: Tue Sep 8 23:24:13 2026 read: IOPS=8, BW=143KiB/s (147kB/s)(6032KiB/42087msec) clat (msec): min=6, max=235, avg=44.90, stdev=37.64 lat (msec): min=6, max=235, avg=44.90, stdev=37.64 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 91], 95.00th=[ 128], | 99.00th=[ 199], 99.50th=[ 215], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 30, max= 416, per=25.38%, avg=143.65, stdev=80.16, samples=82 iops : min= 1, max= 26, avg= 8.18, stdev= 5.04, samples=82 write: IOPS=9, BW=149KiB/s (152kB/s)(6256KiB/42087msec); 0 zone resets clat (msec): min=16, max=308, avg=64.04, stdev=39.76 lat (msec): min=16, max=308, avg=64.04, stdev=39.76 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 89], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 207], 99.50th=[ 288], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 352, per=24.95%, avg=148.45, stdev=75.80, samples=83 iops : min= 1, max= 22, avg= 8.48, stdev= 4.81, samples=83 lat (msec) : 10=0.65%, 20=10.94%, 50=49.09%, 100=27.60%, 250=11.46% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=1.99%, ctx=1208, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=566KiB/s (580kB/s), 136KiB/s-148KiB/s (139kB/s-152kB/s), io=23.4MiB (24.5MB), run=42087-42282msec WRITE: bw=596KiB/s (610kB/s), 143KiB/s-155KiB/s (146kB/s-158kB/s), io=24.6MiB (25.8MB), run=42087-42282msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178901: Tue Sep 8 23:24:28 2026 read: IOPS=1, BW=1272KiB/s (1302kB/s)(7168KiB/5637msec) clat (usec): min=534, max=1013.3k, avg=319861.58, stdev=367501.66 lat (usec): min=535, max=1013.3k, avg=319863.34, stdev=367501.86 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], | 20.00th=[ 660], 30.00th=[ 187696], 40.00th=[ 187696], | 50.00th=[ 206570], 60.00th=[ 217056], 70.00th=[ 217056], | 80.00th=[ 608175], 90.00th=[1010828], 95.00th=[1010828], | 99.00th=[1010828], 99.50th=[1010828], 99.90th=[1010828], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 1917, max= 2767, per=66.10%, avg=2163.60, stdev=341.82, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=0, BW=908KiB/s (930kB/s)(5120KiB/5637msec); 0 zone resets clat (msec): min=137, max=1713, avg=637.49, stdev=617.70 lat (msec): min=137, max=1713, avg=637.89, stdev=617.59 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1917, max= 2048, per=43.49%, avg=1993.25, stdev=63.47, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=9.23%, ctx=335, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178902: Tue Sep 8 23:24:28 2026 read: IOPS=0, BW=327KiB/s (335kB/s)(2048KiB/6256msec) clat (msec): min=2, max=1921, avg=961.81, stdev=1357.07 lat (msec): min=2, max=1921, avg=961.81, stdev=1357.07 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 1921], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1973, max= 2019, per=60.98%, avg=1996.00, stdev=32.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1637KiB/s (1676kB/s)(10.0MiB/6256msec); 0 zone resets clat (msec): min=96, max=683, avg=419.97, stdev=168.69 lat (msec): min=96, max=683, avg=420.98, stdev=169.16 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 207], | 30.00th=[ 351], 40.00th=[ 426], 50.00th=[ 430], 60.00th=[ 472], | 70.00th=[ 485], 80.00th=[ 493], 90.00th=[ 558], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1973, max= 3961, per=53.99%, avg=2474.57, stdev=806.37, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 4=8.33%, 100=8.33%, 250=8.33%, 500=50.00%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=12.61%, ctx=256, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178903: Tue Sep 8 23:24:28 2026 read: IOPS=1, BW=2025KiB/s (2074kB/s)(6144KiB/3034msec) clat (usec): min=577, max=505225, avg=166522.86, stdev=174033.43 lat (usec): min=578, max=505226, avg=166524.13, stdev=174033.69 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[103285], | 30.00th=[103285], 40.00th=[107480], 50.00th=[107480], 60.00th=[128451], | 70.00th=[156238], 80.00th=[156238], 90.00th=[505414], 95.00th=[505414], | 99.00th=[505414], 99.50th=[505414], 99.90th=[505414], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 2019, max= 4047, per=82.42%, avg=2697.67, stdev=1168.56, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=2025KiB/s (2074kB/s)(6144KiB/3034msec); 0 zone resets clat (msec): min=159, max=555, avg=334.61, stdev=176.98 lat (msec): min=159, max=555, avg=334.70, stdev=176.96 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 368], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2023, max= 4031, per=58.89%, avg=2699.00, stdev=1153.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=17.34%, ctx=160, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178904: Tue Sep 8 23:24:28 2026 read: IOPS=0, BW=979KiB/s (1003kB/s)(5120KiB/5228msec) clat (usec): min=530, max=607650, avg=218749.35, stdev=228615.66 lat (usec): min=531, max=607652, avg=218750.68, stdev=228615.64 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[145753], 40.00th=[145753], 50.00th=[162530], 60.00th=[162530], | 70.00th=[177210], 80.00th=[177210], 90.00th=[608175], 95.00th=[608175], | 99.00th=[608175], 99.50th=[608175], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1371KiB/s (1404kB/s)(7168KiB/5228msec); 0 zone resets clat (msec): min=174, max=1819, avg=536.05, stdev=583.55 lat (msec): min=174, max=1819, avg=536.13, stdev=583.55 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 188], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 284], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 575], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 1442, max= 3930, per=49.45%, avg=2266.20, stdev=960.43, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=10.37%, ctx=160, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3274KiB/s (3352kB/s), 327KiB/s-2025KiB/s (335kB/s-2074kB/s), io=20.0MiB (20.0MB), run=3034-6256msec WRITE: bw=4583KiB/s (4693kB/s), 908KiB/s-2025KiB/s (930kB/s-2074kB/s), io=28.0MiB (29.4MB), run=3034-6256msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178905: Tue Sep 8 23:24:29 2026 read: IOPS=1, BW=1138KiB/s (1165kB/s)(7168KiB/6301msec) clat (msec): min=108, max=1453, avg=361.40, stdev=488.71 lat (msec): min=108, max=1453, avg=361.41, stdev=488.71 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 111], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 157], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 334], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 2043, max= 4213, per=100.00%, avg=3405.67, stdev=1186.81, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=813KiB/s (832kB/s)(5120KiB/6301msec); 0 zone resets clat (msec): min=262, max=2056, avg=741.76, stdev=741.26 lat (msec): min=262, max=2056, avg=741.86, stdev=741.26 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 1684, max= 2043, per=47.17%, avg=1944.25, stdev=173.78, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.32%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178906: Tue Sep 8 23:24:29 2026 read: IOPS=0, BW=303KiB/s (310kB/s)(2048KiB/6769msec) clat (msec): min=87, max=2186, avg=1137.00, stdev=1483.71 lat (msec): min=87, max=2186, avg=1137.00, stdev=1483.71 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 88], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1684, max= 2043, per=63.30%, avg=1863.50, stdev=253.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1513KiB/s (1549kB/s)(10.0MiB/6769msec); 0 zone resets clat (msec): min=144, max=1460, avg=417.89, stdev=382.11 lat (msec): min=144, max=1460, avg=418.10, stdev=382.04 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 146], | 30.00th=[ 211], 40.00th=[ 284], 50.00th=[ 334], 60.00th=[ 342], | 70.00th=[ 376], 80.00th=[ 426], 90.00th=[ 460], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 2031, max= 4096, per=78.46%, avg=3234.00, stdev=1093.77, samples=5 iops : min= 1, max= 4, avg= 2.40, stdev= 1.34, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.65%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178907: Tue Sep 8 23:24:29 2026 read: IOPS=0, BW=883KiB/s (905kB/s)(6144KiB/6955msec) clat (msec): min=83, max=521, avg=235.00, stdev=164.57 lat (msec): min=83, max=521, avg=235.01, stdev=164.57 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 207], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2000, max= 4096, per=100.00%, avg=3378.33, stdev=1194.01, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=883KiB/s (905kB/s)(6144KiB/6955msec); 0 zone resets clat (msec): min=156, max=2341, avg=888.73, stdev=814.18 lat (msec): min=156, max=2341, avg=888.85, stdev=814.20 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 760], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1684, max= 4000, per=57.12%, avg=2354.60, stdev=931.95, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.09%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178908: Tue Sep 8 23:24:29 2026 read: IOPS=0, BW=743KiB/s (761kB/s)(5120KiB/6890msec) clat (msec): min=111, max=874, avg=313.83, stdev=324.57 lat (msec): min=111, max=874, avg=313.83, stdev=324.57 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 4039, max= 4087, per=100.00%, avg=4063.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1040KiB/s (1065kB/s)(7168KiB/6890msec); 0 zone resets clat (msec): min=158, max=1991, avg=685.11, stdev=737.58 lat (msec): min=158, max=1991, avg=685.41, stdev=737.80 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 163], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 418], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 1469], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1684, max= 4039, per=59.14%, avg=2437.75, stdev=1079.13, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33%, 2000=16.67% cpu : usr=0.03%, sys=3.15%, ctx=91, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2945KiB/s (3015kB/s), 303KiB/s-1138KiB/s (310kB/s-1165kB/s), io=20.0MiB (20.0MB), run=6301-6955msec WRITE: bw=4123KiB/s (4221kB/s), 813KiB/s-1513KiB/s (832kB/s-1549kB/s), io=28.0MiB (29.4MB), run=6301-6955msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178915: Tue Sep 8 23:24:44 2026 read: IOPS=0, BW=3226KiB/s (3303kB/s)(12.0MiB/3809msec) clat (msec): min=362, max=2705, avg=1265.55, stdev=1260.48 lat (msec): min=362, max=2705, avg=1265.55, stdev=1260.48 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 7406, max= 8110, per=100.00%, avg=7758.00, stdev=497.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.57%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178916: Tue Sep 8 23:24:44 2026 read: IOPS=0, BW=1211KiB/s (1240kB/s)(4096KiB/3382msec) clat (nsec): min=831339k, max=831339k, avg=831339430.00, stdev= 0.00 lat (nsec): min=831342k, max=831342k, avg=831342156.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2422KiB/s (2480kB/s)(8192KiB/3382msec); 0 zone resets clat (msec): min=1147, max=1233, avg=1190.94, stdev=60.80 lat (msec): min=1149, max=1234, avg=1191.95, stdev=59.93 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.43%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178917: Tue Sep 8 23:24:44 2026 write: IOPS=0, BW=2066KiB/s (2116kB/s)(12.0MiB/5947msec); 0 zone resets clat (msec): min=1174, max=2731, avg=1892.20, stdev=785.62 lat (msec): min=1174, max=2731, avg=1892.58, stdev=785.56 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1770], 50.00th=[ 1770], 60.00th=[ 1770], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 7757, max= 7984, per=100.00%, avg=7870.50, stdev=160.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.67%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178918: Tue Sep 8 23:24:44 2026 write: IOPS=0, BW=3015KiB/s (3087kB/s)(12.0MiB/4076msec); 0 zone resets clat (msec): min=612, max=2008, avg=1258.91, stdev=703.87 lat (msec): min=615, max=2008, avg=1260.39, stdev=702.33 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 7892, max= 8078, per=100.00%, avg=7985.00, stdev=131.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.89%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4301KiB/s (4405kB/s), 1211KiB/s-3226KiB/s (1240kB/s-3303kB/s), io=16.0MiB (16.8MB), run=3382-3809msec WRITE: bw=5510KiB/s (5642kB/s), 2066KiB/s-3015KiB/s (2116kB/s-3087kB/s), io=32.0MiB (33.6MB), run=3382-5947msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178920: Tue Sep 8 23:24:44 2026 read: IOPS=0, BW=2415KiB/s (2473kB/s)(12.0MiB/5089msec) clat (msec): min=1200, max=1938, avg=1555.52, stdev=369.40 lat (msec): min=1200, max=1938, avg=1555.52, stdev=369.40 clat percentiles (msec): | 1.00th=[ 1200], 5.00th=[ 1200], 10.00th=[ 1200], 20.00th=[ 1200], | 30.00th=[ 1200], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 7831, max= 8175, per=100.00%, avg=8003.00, stdev=243.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=4.32%, ctx=252, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178921: Tue Sep 8 23:24:44 2026 read: IOPS=0, BW=679KiB/s (695kB/s)(4096KiB/6033msec) clat (nsec): min=1598.7M, max=1598.7M, avg=1598654937.00, stdev= 0.00 lat (nsec): min=1598.7M, max=1598.7M, avg=1598657869.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1603], 5.00th=[ 1603], 10.00th=[ 1603], 20.00th=[ 1603], | 30.00th=[ 1603], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1358KiB/s (1390kB/s)(8192KiB/6033msec); 0 zone resets clat (msec): min=1701, max=2445, avg=2073.41, stdev=525.84 lat (msec): min=1701, max=2445, avg=2073.85, stdev=526.03 clat percentiles (msec): | 1.00th=[ 1703], 5.00th=[ 1703], 10.00th=[ 1703], 20.00th=[ 1703], | 30.00th=[ 1703], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 2433], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.10%, sys=3.35%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178922: Tue Sep 8 23:24:44 2026 write: IOPS=0, BW=1995KiB/s (2043kB/s)(12.0MiB/6158msec); 0 zone resets clat (msec): min=396, max=2803, avg=1954.84, stdev=1351.48 lat (msec): min=396, max=2806, avg=1956.13, stdev=1352.52 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 2668], 50.00th=[ 2668], 60.00th=[ 2668], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.03%, sys=0.76%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178923: Tue Sep 8 23:24:44 2026 write: IOPS=0, BW=2327KiB/s (2383kB/s)(12.0MiB/5280msec); 0 zone resets clat (msec): min=418, max=2459, avg=1731.05, stdev=1139.36 lat (msec): min=418, max=2459, avg=1731.44, stdev=1139.47 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 7699, max= 8159, per=100.00%, avg=7929.00, stdev=325.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.18%, ctx=38, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2716KiB/s (2781kB/s), 679KiB/s-2415KiB/s (695kB/s-2473kB/s), io=16.0MiB (16.8MB), run=5089-6033msec WRITE: bw=5321KiB/s (5449kB/s), 1358KiB/s-2327KiB/s (1390kB/s-2383kB/s), io=32.0MiB (33.6MB), run=5280-6158msec