== sanity test 398b: DIO and buffer IO race ============== 01:06:48 (1790744808) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.87455 s, 7.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144729: Wed Sep 30 01:09:24 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(5992KiB/128505msec) clat (usec): min=34, max=1061.2k, avg=42300.46, stdev=41523.57 lat (usec): min=35, max=1061.2k, avg=42303.92, stdev=41524.32 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 281], | 20.00th=[ 19006], 30.00th=[ 25297], 40.00th=[ 30016], | 50.00th=[ 35914], 60.00th=[ 42730], 70.00th=[ 51119], | 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[ 139461], 99.50th=[ 156238], 99.90th=[ 488637], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 5, max= 116, per=25.78%, avg=46.92, stdev=19.97, samples=249 iops : min= 1, max= 29, avg=11.10, stdev= 5.05, samples=249 write: IOPS=12, BW=48.0KiB/s (50.2kB/s)(6296KiB/128505msec); 0 zone resets clat (usec): min=883, max=502875, avg=41092.20, stdev=47203.21 lat (usec): min=884, max=502876, avg=41096.47, stdev=47204.24 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1565], 20.00th=[ 3523], | 30.00th=[ 7767], 40.00th=[ 15664], 50.00th=[ 27657], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[126354], | 99.00th=[183501], 99.50th=[233833], 99.90th=[467665], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 7, max= 134, per=25.82%, avg=49.06, stdev=22.90, samples=250 iops : min= 1, max= 33, avg=11.64, stdev= 5.76, samples=250 lat (usec) : 50=0.49%, 100=3.78%, 250=0.59%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.87%, 4=3.94%, 10=6.48%, 20=10.64%, 50=35.51% lat (msec) : 100=23.99%, 250=7.16%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.00%, ctx=6468, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144730: Wed Sep 30 01:09:24 2026 read: IOPS=11, BW=45.9KiB/s (46.0kB/s)(5940KiB/129489msec) clat (usec): min=30, max=326248, avg=41957.73, stdev=33372.82 lat (usec): min=30, max=326249, avg=41959.16, stdev=33372.89 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 725], 20.00th=[ 19006], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[212861], 99.90th=[270533], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 5, max= 111, per=25.35%, avg=46.14, stdev=20.62, samples=251 iops : min= 1, max= 27, avg=10.91, stdev= 5.21, samples=251 write: IOPS=12, BW=49.0KiB/s (50.2kB/s)(6348KiB/129489msec); 0 zone resets clat (usec): min=843, max=1026.3k, avg=42080.33, stdev=49115.08 lat (usec): min=843, max=1026.3k, avg=42085.01, stdev=49119.48 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1795], | 20.00th=[ 4490], 30.00th=[ 8848], 40.00th=[ 19792], | 50.00th=[ 30278], 60.00th=[ 42206], 70.00th=[ 55837], | 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[ 117965], | 99.00th=[ 175113], 99.50th=[ 219153], 99.90th=[ 480248], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 144, per=25.92%, avg=49.25, stdev=21.20, samples=251 iops : min= 1, max= 36, avg=11.69, stdev= 5.35, samples=251 lat (usec) : 50=0.42%, 100=3.74%, 250=0.52%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=5.79%, 4=3.58%, 10=7.29%, 20=9.38%, 50=36.52% lat (msec) : 100=25.26%, 250=7.00%, 500=0.16%, 2000=0.03% cpu : usr=0.07%, sys=4.83%, ctx=6538, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144732: Wed Sep 30 01:09:24 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6028KiB/131892msec) clat (usec): min=30, max=342352, avg=40029.31, stdev=31130.15 lat (usec): min=30, max=342353, avg=40032.35, stdev=31129.23 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 141], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[173016], 99.90th=[270533], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 143, per=25.22%, avg=45.90, stdev=22.64, samples=256 iops : min= 1, max= 35, avg=10.85, stdev= 5.71, samples=256 write: IOPS=11, BW=47.5KiB/s (48.6kB/s)(6260KiB/131892msec); 0 zone resets clat (usec): min=945, max=965238, avg=45397.32, stdev=54193.33 lat (usec): min=945, max=965241, avg=45400.64, stdev=54193.92 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1188], 10.00th=[ 1434], 20.00th=[ 3785], | 30.00th=[ 8455], 40.00th=[ 21890], 50.00th=[ 34341], 60.00th=[ 46400], | 70.00th=[ 60031], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[131597], | 99.00th=[202376], 99.50th=[240124], 99.90th=[792724], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 143, per=25.01%, avg=47.52, stdev=21.29, samples=257 iops : min= 1, max= 35, avg=11.25, stdev= 5.37, samples=257 lat (usec) : 50=0.72%, 100=3.84%, 250=0.59%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=6.93%, 4=3.84%, 10=5.66%, 20=9.21%, 50=35.81% lat (msec) : 100=25.85%, 250=7.00%, 500=0.26%, 1000=0.07% cpu : usr=0.06%, sys=4.79%, ctx=6618, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144734: Wed Sep 30 01:09:24 2026 read: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6052KiB/130833msec) clat (usec): min=31, max=1001.6k, avg=40049.97, stdev=38841.60 lat (usec): min=31, max=1001.6k, avg=40051.88, stdev=38841.31 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 478], | 20.00th=[ 18744], 30.00th=[ 23725], 40.00th=[ 28705], | 50.00th=[ 33817], 60.00th=[ 40109], 70.00th=[ 47973], | 80.00th=[ 57410], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[ 130548], 99.50th=[ 143655], 99.90th=[ 350225], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 158, per=25.62%, avg=46.63, stdev=21.62, samples=253 iops : min= 1, max= 39, avg=11.03, stdev= 5.43, samples=253 write: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6236KiB/130833msec); 0 zone resets clat (usec): min=955, max=651332, avg=44786.30, stdev=47195.29 lat (usec): min=956, max=651334, avg=44788.39, stdev=47195.22 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1762], 20.00th=[ 4686], | 30.00th=[ 9896], 40.00th=[ 22938], 50.00th=[ 33817], 60.00th=[ 44827], | 70.00th=[ 58459], 80.00th=[ 78119], 90.00th=[103285], 95.00th=[125305], | 99.00th=[202376], 99.50th=[246416], 99.90th=[329253], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 103, per=24.83%, avg=47.17, stdev=20.74, samples=257 iops : min= 1, max= 25, avg=11.16, stdev= 5.22, samples=257 lat (usec) : 50=0.68%, 100=3.78%, 250=0.46%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.79%, 4=3.48%, 10=6.32%, 20=9.28%, 50=38.31% lat (msec) : 100=24.41%, 250=7.00%, 500=0.26%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.74%, ctx=6584, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=182KiB/s (186kB/s), 45.7KiB/s-46.6KiB/s (46.8kB/s-47.7kB/s), io=23.4MiB (24.6MB), run=128505-131892msec WRITE: bw=191KiB/s (195kB/s), 47.5KiB/s-49.0KiB/s (48.6kB/s-50.2kB/s), io=24.6MiB (25.7MB), run=128505-131892msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144731: Wed Sep 30 01:12:01 2026 read: IOPS=5, BW=20.7KiB/s (21.2kB/s)(5992KiB/289074msec) clat (msec): min=6, max=1083, avg=39.19, stdev=48.62 lat (msec): min=6, max=1083, avg=39.19, stdev=48.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 79], 95.00th=[ 105], | 99.00th=[ 159], 99.50th=[ 215], 99.90th=[ 961], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 95, per=28.33%, avg=23.51, stdev=15.09, samples=492 iops : min= 1, max= 23, avg= 5.27, stdev= 3.81, samples=492 write: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6296KiB/289074msec); 0 zone resets clat (msec): min=43, max=650, avg=146.13, stdev=65.50 lat (msec): min=43, max=650, avg=146.13, stdev=65.50 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 134], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 190], 90.00th=[ 230], 95.00th=[ 266], | 99.00th=[ 368], 99.50th=[ 435], 99.90th=[ 634], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 56, per=25.17%, avg=21.64, stdev= 8.88, samples=560 iops : min= 1, max= 14, avg= 4.79, stdev= 2.26, samples=560 lat (msec) : 10=1.46%, 20=13.64%, 50=23.73%, 100=19.86%, 250=37.70% lat (msec) : 500=3.45%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5281, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144733: Wed Sep 30 01:12:01 2026 read: IOPS=5, BW=20.5KiB/s (21.0kB/s)(5940KiB/289180msec) clat (msec): min=6, max=1015, avg=39.24, stdev=49.44 lat (msec): min=6, max=1015, avg=39.24, stdev=49.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 77], 95.00th=[ 103], | 99.00th=[ 184], 99.50th=[ 259], 99.90th=[ 827], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 95, per=28.85%, avg=23.94, stdev=15.54, samples=479 iops : min= 1, max= 23, avg= 5.37, stdev= 3.93, samples=479 write: IOPS=5, BW=21.0KiB/s (22.5kB/s)(6348KiB/289180msec); 0 zone resets clat (msec): min=49, max=622, avg=145.24, stdev=64.11 lat (msec): min=49, max=622, avg=145.24, stdev=64.11 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 131], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 190], 90.00th=[ 230], 95.00th=[ 266], | 99.00th=[ 351], 99.50th=[ 418], 99.90th=[ 468], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 47, per=25.22%, avg=21.69, stdev= 9.16, samples=563 iops : min= 1, max= 11, avg= 4.80, stdev= 2.32, samples=563 lat (msec) : 10=1.99%, 20=14.58%, 50=21.29%, 100=21.00%, 250=37.60% lat (msec) : 500=3.42%, 750=0.07%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5279, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144735: Wed Sep 30 01:12:01 2026 read: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6028KiB/286264msec) clat (msec): min=6, max=504, avg=39.86, stdev=38.84 lat (msec): min=6, max=504, avg=39.87, stdev=38.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 81], 95.00th=[ 108], | 99.00th=[ 171], 99.50th=[ 268], 99.90th=[ 384], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 103, per=28.00%, avg=23.24, stdev=15.24, samples=500 iops : min= 1, max= 25, avg= 5.19, stdev= 3.83, samples=500 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6260KiB/286264msec); 0 zone resets clat (msec): min=28, max=1189, avg=144.23, stdev=69.38 lat (msec): min=28, max=1189, avg=144.24, stdev=69.38 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 188], 90.00th=[ 226], 95.00th=[ 262], | 99.00th=[ 347], 99.50th=[ 376], 99.90th=[ 1028], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 48, per=25.30%, avg=21.75, stdev= 9.01, samples=553 iops : min= 1, max= 12, avg= 4.81, stdev= 2.30, samples=553 lat (msec) : 10=1.79%, 20=13.25%, 50=23.08%, 100=20.77%, 250=37.63% lat (msec) : 500=3.39%, 750=0.03%, 2000=0.07% cpu : usr=0.04%, sys=1.11%, ctx=5205, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144736: Wed Sep 30 01:12:01 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6052KiB/284991msec) clat (msec): min=5, max=950, avg=38.48, stdev=40.82 lat (msec): min=5, max=950, avg=38.49, stdev=40.82 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 102], | 99.00th=[ 169], 99.50th=[ 194], 99.90th=[ 447], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 88, per=29.02%, avg=24.09, stdev=16.37, samples=485 iops : min= 1, max= 22, avg= 5.41, stdev= 4.11, samples=485 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6236KiB/284991msec); 0 zone resets clat (msec): min=37, max=1151, avg=145.20, stdev=69.27 lat (msec): min=37, max=1151, avg=145.20, stdev=69.27 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 131], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 188], 90.00th=[ 232], 95.00th=[ 264], | 99.00th=[ 355], 99.50th=[ 401], 99.90th=[ 651], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 48, per=24.96%, avg=21.46, stdev= 9.05, samples=558 iops : min= 1, max= 12, avg= 4.74, stdev= 2.30, samples=558 lat (msec) : 10=2.38%, 20=13.80%, 50=22.40%, 100=21.22%, 250=36.75% lat (msec) : 500=3.26%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5285, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=83.0KiB/s (85.0kB/s), 20.5KiB/s-21.2KiB/s (21.0kB/s-21.7kB/s), io=23.4MiB (24.6MB), run=284991-289180msec WRITE: bw=86.9KiB/s (89.0kB/s), 21.8KiB/s-21.0KiB/s (22.3kB/s-22.5kB/s), io=24.6MiB (25.7MB), run=284991-289180msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144798: Wed Sep 30 01:12:40 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5920KiB/28330msec) clat (usec): min=34, max=270345, avg=39023.84, stdev=35468.37 lat (usec): min=34, max=270346, avg=39025.56, stdev=35469.21 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 133], | 30.00th=[ 21627], 40.00th=[ 29230], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 47973], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[102237], | 99.00th=[152044], 99.50th=[208667], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 383, per=24.65%, avg=206.84, stdev=80.90, samples=55 iops : min= 3, max= 23, avg=12.16, stdev= 5.15, samples=55 write: IOPS=14, BW=225KiB/s (230kB/s)(6368KiB/28330msec); 0 zone resets clat (usec): min=1410, max=264901, avg=34637.96, stdev=37517.95 lat (usec): min=1410, max=264906, avg=34640.30, stdev=37518.22 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1795], 10.00th=[ 2573], 20.00th=[ 5342], | 30.00th=[ 7701], 40.00th=[ 12256], 50.00th=[ 22414], 60.00th=[ 31327], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[175113], 99.50th=[193987], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 32, max= 479, per=25.30%, avg=223.42, stdev=96.53, samples=55 iops : min= 2, max= 29, avg=13.22, stdev= 6.11, samples=55 lat (usec) : 50=1.95%, 100=6.77%, 250=2.08%, 500=0.26%, 750=0.13% lat (msec) : 2=3.91%, 4=4.17%, 10=10.42%, 20=8.46%, 50=35.29% lat (msec) : 100=20.83%, 250=5.47%, 500=0.26% cpu : usr=0.11%, sys=5.71%, ctx=1371, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144799: Wed Sep 30 01:12:40 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5744KiB/27982msec) clat (usec): min=38, max=169807, avg=41177.31, stdev=31838.72 lat (usec): min=38, max=169808, avg=41179.57, stdev=31839.40 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 445], | 30.00th=[ 24249], 40.00th=[ 30278], 50.00th=[ 40633], 60.00th=[ 45876], | 70.00th=[ 56886], 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[ 94897], | 99.00th=[135267], 99.50th=[166724], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 535, per=24.25%, avg=203.46, stdev=85.82, samples=54 iops : min= 1, max= 33, avg=11.94, stdev= 5.42, samples=54 write: IOPS=14, BW=234KiB/s (239kB/s)(6544KiB/27982msec); 0 zone resets clat (usec): min=1364, max=294886, avg=31624.74, stdev=35495.47 lat (usec): min=1366, max=294890, avg=31627.53, stdev=35495.30 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1729], 10.00th=[ 2008], 20.00th=[ 4424], | 30.00th=[ 7635], 40.00th=[ 11731], 50.00th=[ 17433], 60.00th=[ 26608], | 70.00th=[ 40633], 80.00th=[ 54264], 90.00th=[ 80217], 95.00th=[104334], | 99.00th=[139461], 99.50th=[158335], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 62, max= 542, per=25.70%, avg=226.94, stdev=96.60, samples=54 iops : min= 3, max= 33, avg=13.41, stdev= 6.06, samples=54 lat (usec) : 50=1.17%, 100=6.90%, 250=0.78%, 500=0.52%, 1000=0.13% lat (msec) : 2=5.47%, 4=4.17%, 10=10.55%, 20=10.55%, 50=31.12% lat (msec) : 100=23.96%, 250=4.56%, 500=0.13% cpu : usr=0.10%, sys=5.83%, ctx=1411, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144800: Wed Sep 30 01:12:40 2026 read: IOPS=13, BW=219KiB/s (225kB/s)(6256KiB/28524msec) clat (usec): min=32, max=227576, avg=40355.57, stdev=35131.52 lat (usec): min=32, max=227577, avg=40356.98, stdev=35131.55 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 109], | 30.00th=[ 20841], 40.00th=[ 28967], 50.00th=[ 35914], 60.00th=[ 43779], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[162530], 99.50th=[202376], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 61, max= 379, per=26.07%, avg=218.75, stdev=78.90, samples=56 iops : min= 3, max= 23, avg=12.89, stdev= 4.96, samples=56 write: IOPS=13, BW=211KiB/s (217kB/s)(6032KiB/28524msec); 0 zone resets clat (usec): min=1474, max=168945, avg=33063.54, stdev=34577.27 lat (usec): min=1476, max=168946, avg=33067.62, stdev=34576.31 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1762], 10.00th=[ 2540], 20.00th=[ 4424], | 30.00th=[ 7046], 40.00th=[ 11076], 50.00th=[ 19006], 60.00th=[ 31851], | 70.00th=[ 42730], 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[107480], | 99.00th=[141558], 99.50th=[154141], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 505, per=23.80%, avg=210.18, stdev=94.90, samples=56 iops : min= 1, max= 31, avg=12.36, stdev= 5.95, samples=56 lat (usec) : 50=1.17%, 100=8.72%, 250=0.91%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.91%, 4=5.34%, 10=10.16%, 20=8.85%, 50=31.12% lat (msec) : 100=23.05%, 250=6.38% cpu : usr=0.07%, sys=5.44%, ctx=1453, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144801: Wed Sep 30 01:12:40 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(6032KiB/27808msec) clat (usec): min=37, max=255214, avg=39184.76, stdev=37484.08 lat (usec): min=37, max=255214, avg=39196.19, stdev=37473.98 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 94], | 30.00th=[ 20317], 40.00th=[ 27919], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[113771], | 99.00th=[170918], 99.50th=[217056], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 509, per=25.69%, avg=215.56, stdev=97.52, samples=54 iops : min= 1, max= 31, avg=12.72, stdev= 6.12, samples=54 write: IOPS=14, BW=225KiB/s (230kB/s)(6256KiB/27808msec); 0 zone resets clat (usec): min=1240, max=255764, avg=32708.82, stdev=36237.31 lat (usec): min=1241, max=255767, avg=32712.92, stdev=36236.25 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1795], 10.00th=[ 2409], 20.00th=[ 4621], | 30.00th=[ 7177], 40.00th=[ 10159], 50.00th=[ 19530], 60.00th=[ 29230], | 70.00th=[ 43779], 80.00th=[ 58983], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[164627], 99.50th=[181404], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 63, max= 446, per=25.46%, avg=224.80, stdev=94.09, samples=54 iops : min= 3, max= 27, avg=13.28, stdev= 5.92, samples=54 lat (usec) : 50=1.69%, 100=8.98%, 250=1.82%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.17%, 4=5.47%, 10=10.81%, 20=7.16%, 50=32.03% lat (msec) : 100=22.14%, 250=5.21%, 500=0.26% cpu : usr=0.09%, sys=5.97%, ctx=1392, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=840KiB/s (860kB/s), 205KiB/s-219KiB/s (210kB/s-225kB/s), io=23.4MiB (24.5MB), run=27808-28524msec WRITE: bw=883KiB/s (905kB/s), 211KiB/s-234KiB/s (217kB/s-239kB/s), io=24.6MiB (25.8MB), run=27808-28524msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144804: Wed Sep 30 01:13:25 2026 read: IOPS=5, BW=83.0KiB/s (84.0kB/s)(5920KiB/71319msec) clat (msec): min=7, max=283, avg=40.22, stdev=36.42 lat (msec): min=7, max=283, avg=40.23, stdev=36.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 109], | 99.00th=[ 169], 99.50th=[ 257], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 286, per=26.99%, avg=89.32, stdev=55.86, samples=130 iops : min= 1, max= 17, avg= 4.78, stdev= 3.53, samples=130 write: IOPS=5, BW=89.3KiB/s (91.4kB/s)(6368KiB/71319msec); 0 zone resets clat (msec): min=49, max=425, avg=141.57, stdev=61.68 lat (msec): min=49, max=425, avg=141.57, stdev=61.68 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 74], 10.00th=[ 83], 20.00th=[ 93], | 30.00th=[ 103], 40.00th=[ 114], 50.00th=[ 129], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 215], 95.00th=[ 279], | 99.00th=[ 414], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 26, max= 159, per=25.84%, avg=89.93, stdev=36.79, samples=139 iops : min= 1, max= 9, avg= 4.81, stdev= 2.30, samples=139 lat (msec) : 10=1.30%, 20=12.89%, 50=22.92%, 100=22.14%, 250=36.98% lat (msec) : 500=3.78% cpu : usr=0.04%, sys=1.28%, ctx=1273, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144805: Wed Sep 30 01:13:25 2026 read: IOPS=4, BW=79.5KiB/s (81.4kB/s)(5744KiB/72253msec) clat (msec): min=7, max=349, avg=40.23, stdev=37.09 lat (msec): min=7, max=349, avg=40.23, stdev=37.09 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 109], | 99.00th=[ 182], 99.50th=[ 241], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 26, max= 350, per=28.08%, avg=92.96, stdev=61.09, samples=122 iops : min= 1, max= 21, avg= 5.01, stdev= 3.86, samples=122 write: IOPS=5, BW=90.6KiB/s (92.7kB/s)(6544KiB/72253msec); 0 zone resets clat (msec): min=46, max=512, avg=141.13, stdev=60.26 lat (msec): min=46, max=512, avg=141.13, stdev=60.26 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 105], 40.00th=[ 113], 50.00th=[ 124], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 224], 95.00th=[ 255], | 99.00th=[ 313], 99.50th=[ 317], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 26, max= 192, per=26.08%, avg=90.75, stdev=37.66, samples=142 iops : min= 1, max= 12, avg= 4.87, stdev= 2.43, samples=142 lat (msec) : 10=0.91%, 20=11.85%, 50=23.83%, 100=20.96%, 250=39.06% lat (msec) : 500=3.26%, 750=0.13% cpu : usr=0.06%, sys=1.23%, ctx=1268, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144806: Wed Sep 30 01:13:25 2026 read: IOPS=5, BW=90.3KiB/s (92.5kB/s)(6256KiB/69270msec) clat (msec): min=7, max=348, avg=38.15, stdev=38.33 lat (msec): min=7, max=348, avg=38.16, stdev=38.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 66], 95.00th=[ 103], | 99.00th=[ 218], 99.50th=[ 338], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 318, per=30.13%, avg=99.73, stdev=64.13, samples=124 iops : min= 1, max= 19, avg= 5.43, stdev= 4.07, samples=124 write: IOPS=5, BW=87.1KiB/s (89.2kB/s)(6032KiB/69270msec); 0 zone resets clat (msec): min=45, max=420, avg=144.03, stdev=63.06 lat (msec): min=45, max=420, avg=144.03, stdev=63.06 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 83], 20.00th=[ 95], | 30.00th=[ 109], 40.00th=[ 117], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 232], 95.00th=[ 305], | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 31, max= 160, per=25.57%, avg=88.99, stdev=33.92, samples=133 iops : min= 1, max= 10, avg= 4.74, stdev= 2.19, samples=133 lat (msec) : 10=0.78%, 20=13.15%, 50=27.99%, 100=17.97%, 250=36.20% lat (msec) : 500=3.91% cpu : usr=0.04%, sys=1.33%, ctx=1350, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144807: Wed Sep 30 01:13:25 2026 read: IOPS=5, BW=84.8KiB/s (86.8kB/s)(6032KiB/71150msec) clat (msec): min=7, max=242, avg=41.75, stdev=41.36 lat (msec): min=7, max=242, avg=41.77, stdev=41.40 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 53], 90.00th=[ 91], 95.00th=[ 136], | 99.00th=[ 215], 99.50th=[ 236], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 30, max= 287, per=29.03%, avg=96.10, stdev=64.83, samples=122 iops : min= 1, max= 17, avg= 5.19, stdev= 4.07, samples=122 write: IOPS=5, BW=87.9KiB/s (90.0kB/s)(6256KiB/71150msec); 0 zone resets clat (msec): min=52, max=434, avg=141.49, stdev=61.57 lat (msec): min=52, max=434, avg=141.50, stdev=61.58 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 105], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 144], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 275], | 99.00th=[ 388], 99.50th=[ 430], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 26, max= 160, per=25.44%, avg=88.53, stdev=37.63, samples=138 iops : min= 1, max= 10, avg= 4.72, stdev= 2.39, samples=138 lat (msec) : 10=0.26%, 20=14.58%, 50=23.83%, 100=19.14%, 250=39.06% lat (msec) : 500=3.12% cpu : usr=0.05%, sys=1.29%, ctx=1309, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=332KiB/s (339kB/s), 79.5KiB/s-90.3KiB/s (81.4kB/s-92.5kB/s), io=23.4MiB (24.5MB), run=69270-72253msec WRITE: bw=349KiB/s (357kB/s), 87.1KiB/s-90.6KiB/s (89.2kB/s-92.7kB/s), io=24.6MiB (25.8MB), run=69270-72253msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144828: Wed Sep 30 01:13:39 2026 read: IOPS=2, BW=2230KiB/s (2284kB/s)(7168KiB/3214msec) clat (msec): min=207, max=596, avg=303.81, stdev=134.93 lat (msec): min=207, max=596, avg=303.81, stdev=134.93 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 218], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 330], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1610, max= 3961, per=56.68%, avg=2374.25, stdev=1070.85, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1593KiB/s (1631kB/s)(5120KiB/3214msec); 0 zone resets clat (msec): min=198, max=256, avg=216.87, stdev=23.19 lat (msec): min=198, max=256, avg=216.96, stdev=23.20 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 211], 60.00th=[ 211], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1957, max= 4079, per=45.50%, avg=2668.33, stdev=1221.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=19.98%, ctx=189, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144829: Wed Sep 30 01:13:39 2026 read: IOPS=0, BW=419KiB/s (429kB/s)(2048KiB/4888msec) clat (msec): min=84, max=249, avg=167.04, stdev=117.19 lat (msec): min=84, max=249, avg=167.04, stdev=117.19 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 85], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 1612, max= 2048, per=43.69%, avg=1830.00, stdev=308.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2095KiB/s (2145kB/s)(10.0MiB/4888msec); 0 zone resets clat (msec): min=228, max=1056, avg=454.93, stdev=264.60 lat (msec): min=228, max=1057, avg=455.13, stdev=264.90 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 243], | 30.00th=[ 266], 40.00th=[ 326], 50.00th=[ 351], 60.00th=[ 355], | 70.00th=[ 414], 80.00th=[ 584], 90.00th=[ 735], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1612, max= 4096, per=42.99%, avg=2521.43, stdev=1032.90, samples=7 iops : min= 1, max= 4, avg= 1.86, stdev= 1.21, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=12.44%, ctx=140, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144830: Wed Sep 30 01:13:39 2026 read: IOPS=1, BW=1499KiB/s (1535kB/s)(6144KiB/4100msec) clat (usec): min=1590, max=345823, avg=191112.78, stdev=157659.85 lat (usec): min=1591, max=345825, avg=191114.05, stdev=157659.65 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1598], 10.00th=[ 1598], 20.00th=[ 5276], | 30.00th=[ 5276], 40.00th=[181404], 50.00th=[181404], 60.00th=[267387], | 70.00th=[346031], 80.00th=[346031], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 3961, max= 4079, per=95.97%, avg=4020.00, stdev=83.44, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1499KiB/s (1535kB/s)(6144KiB/4100msec); 0 zone resets clat (msec): min=124, max=1315, avg=491.78, stdev=442.84 lat (msec): min=124, max=1315, avg=491.88, stdev=442.85 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 363], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1980, max= 3961, per=42.75%, avg=2507.00, stdev=969.80, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 2=8.33%, 10=8.33%, 250=25.00%, 500=41.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=13.22%, ctx=238, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144831: Wed Sep 30 01:13:39 2026 read: IOPS=1, BW=1091KiB/s (1117kB/s)(5120KiB/4692msec) clat (usec): min=1647, max=562428, avg=229836.53, stdev=235502.96 lat (usec): min=1649, max=562430, avg=229837.84, stdev=235503.04 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1647], 10.00th=[ 1647], 20.00th=[ 1647], | 30.00th=[ 4686], 40.00th=[ 4686], 50.00th=[265290], 60.00th=[265290], | 70.00th=[312476], 80.00th=[312476], 90.00th=[566232], 95.00th=[566232], | 99.00th=[566232], 99.50th=[566232], 99.90th=[566232], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 4039, max= 4096, per=97.10%, avg=4067.50, stdev=40.31, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1528KiB/s (1564kB/s)(7168KiB/4692msec); 0 zone resets clat (msec): min=122, max=1156, avg=502.41, stdev=373.76 lat (msec): min=122, max=1157, avg=502.55, stdev=373.88 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 128], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 489], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 735], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1957, max= 4079, per=45.56%, avg=2672.00, stdev=1218.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 10=8.33%, 250=16.67%, 500=33.33%, 750=25.00% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=11.70%, ctx=114, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4190KiB/s (4290kB/s), 419KiB/s-2230KiB/s (429kB/s-2284kB/s), io=20.0MiB (20.0MB), run=3214-4888msec WRITE: bw=5866KiB/s (6007kB/s), 1499KiB/s-2095KiB/s (1535kB/s-2145kB/s), io=28.0MiB (29.4MB), run=3214-4888msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144823: Wed Sep 30 01:13:40 2026 read: IOPS=2, BW=2202KiB/s (2255kB/s)(7168KiB/3255msec) clat (msec): min=108, max=477, avg=251.21, stdev=150.62 lat (msec): min=108, max=477, avg=251.21, stdev=150.62 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 232], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 393], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1954, max= 6000, per=100.00%, avg=4013.67, stdev=2024.00, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1573KiB/s (1611kB/s)(5120KiB/3255msec); 0 zone resets clat (msec): min=209, max=408, avg=280.25, stdev=78.78 lat (msec): min=209, max=408, avg=280.33, stdev=78.79 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1910, max= 4079, per=49.39%, avg=2490.50, stdev=1059.95, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=50.00% cpu : usr=0.00%, sys=5.50%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144824: Wed Sep 30 01:13:40 2026 read: IOPS=0, BW=360KiB/s (369kB/s)(2048KiB/5685msec) clat (msec): min=122, max=496, avg=309.24, stdev=264.34 lat (msec): min=122, max=496, avg=309.25, stdev=264.34 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1319, max= 1996, per=46.02%, avg=1657.50, stdev=478.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1801KiB/s (1844kB/s)(10.0MiB/5685msec); 0 zone resets clat (msec): min=159, max=1101, avg=501.81, stdev=351.44 lat (msec): min=159, max=1102, avg=502.73, stdev=351.46 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 230], | 30.00th=[ 271], 40.00th=[ 305], 50.00th=[ 309], 60.00th=[ 338], | 70.00th=[ 443], 80.00th=[ 810], 90.00th=[ 1053], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1319, max= 4071, per=51.10%, avg=2576.83, stdev=1173.55, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=5.31%, ctx=129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144825: Wed Sep 30 01:13:40 2026 read: IOPS=1, BW=1219KiB/s (1248kB/s)(6144KiB/5040msec) clat (msec): min=85, max=625, avg=299.57, stdev=230.87 lat (msec): min=85, max=625, avg=299.57, stdev=230.87 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 426], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1910, max= 2039, per=55.15%, avg=1986.60, stdev=53.13, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1219KiB/s (1248kB/s)(6144KiB/5040msec); 0 zone resets clat (msec): min=252, max=793, avg=525.98, stdev=205.77 lat (msec): min=252, max=793, avg=526.29, stdev=205.66 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 518], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1910, max= 2039, per=39.71%, avg=2002.80, stdev=52.75, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=3.43%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144826: Wed Sep 30 01:13:40 2026 read: IOPS=1, BW=1304KiB/s (1336kB/s)(5120KiB/3925msec) clat (msec): min=135, max=388, avg=252.06, stdev=109.09 lat (msec): min=135, max=388, avg=252.06, stdev=109.09 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 3923, max= 4039, per=100.00%, avg=3981.00, stdev=82.02, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1826KiB/s (1870kB/s)(7168KiB/3925msec); 0 zone resets clat (msec): min=232, max=513, avg=372.99, stdev=118.27 lat (msec): min=232, max=513, avg=373.27, stdev=118.37 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 239], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 422], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 472], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1370, max= 4015, per=44.50%, avg=2244.33, stdev=905.70, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=5.35%, ctx=79, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3602KiB/s (3689kB/s), 360KiB/s-2202KiB/s (369kB/s-2255kB/s), io=20.0MiB (20.0MB), run=3255-5685msec WRITE: bw=5043KiB/s (5164kB/s), 1219KiB/s-1826KiB/s (1248kB/s-1870kB/s), io=28.0MiB (29.4MB), run=3255-5685msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Wed Sep 30 01:13:53 2026 read: IOPS=1, BW=4728KiB/s (4841kB/s)(12.0MiB/2599msec) clat (msec): min=690, max=962, avg=804.57, stdev=141.55 lat (msec): min=690, max=962, avg=804.57, stdev=141.55 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.70%, ctx=407, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Wed Sep 30 01:13:53 2026 read: IOPS=0, BW=1558KiB/s (1595kB/s)(4096KiB/2629msec) clat (nsec): min=982158k, max=982158k, avg=982157933.00, stdev= 0.00 lat (nsec): min=982160k, max=982160k, avg=982160375.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3116KiB/s (3191kB/s)(8192KiB/2629msec); 0 zone resets clat (msec): min=331, max=1175, avg=753.42, stdev=596.97 lat (msec): min=331, max=1176, avg=753.82, stdev=597.07 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8159, max= 8159, per=77.96%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=6.05%, ctx=133, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144841: Wed Sep 30 01:13:53 2026 write: IOPS=0, BW=3925KiB/s (4019kB/s)(12.0MiB/3131msec); 0 zone resets clat (msec): min=687, max=1234, avg=983.23, stdev=276.18 lat (msec): min=688, max=1234, avg=983.89, stdev=275.73 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8159, max= 8192, per=78.12%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.07%, ctx=78, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144842: Wed Sep 30 01:13:53 2026 write: IOPS=1, BW=4770KiB/s (4885kB/s)(12.0MiB/2576msec); 0 zone resets clat (msec): min=311, max=1856, avg=827.15, stdev=891.63 lat (msec): min=311, max=1859, avg=828.44, stdev=893.19 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min=11425, max=11425, per=100.00%, avg=11425.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=4.58%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6232KiB/s (6382kB/s), 1558KiB/s-4728KiB/s (1595kB/s-4841kB/s), io=16.0MiB (16.8MB), run=2599-2629msec WRITE: bw=10.2MiB/s (10.7MB/s), 3116KiB/s-4770KiB/s (3191kB/s-4885kB/s), io=32.0MiB (33.6MB), run=2576-3131msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144843: Wed Sep 30 01:13:53 2026 read: IOPS=0, BW=3590KiB/s (3676kB/s)(12.0MiB/3423msec) clat (msec): min=423, max=1583, avg=1104.79, stdev=605.71 lat (msec): min=423, max=1583, avg=1104.79, stdev=605.71 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.83%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144844: Wed Sep 30 01:13:53 2026 read: IOPS=0, BW=1259KiB/s (1289kB/s)(4096KiB/3254msec) clat (nsec): min=1698.2M, max=1698.2M, avg=1698176997.00, stdev= 0.00 lat (nsec): min=1698.2M, max=1698.2M, avg=1698179709.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1703], 5.00th=[ 1703], 10.00th=[ 1703], 20.00th=[ 1703], | 30.00th=[ 1703], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2518KiB/s (2578kB/s)(8192KiB/3254msec); 0 zone resets clat (msec): min=659, max=774, avg=717.27, stdev=81.46 lat (msec): min=660, max=775, avg=717.70, stdev=81.42 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7984, max= 7984, per=79.39%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.60%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144846: Wed Sep 30 01:13:53 2026 write: IOPS=0, BW=3772KiB/s (3862kB/s)(12.0MiB/3258msec); 0 zone resets clat (msec): min=438, max=1431, avg=1068.34, stdev=547.62 lat (msec): min=438, max=1432, avg=1068.80, stdev=547.76 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8047, max= 8094, per=80.25%, avg=8070.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.25%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144847: Wed Sep 30 01:13:53 2026 write: IOPS=1, BW=4435KiB/s (4541kB/s)(12.0MiB/2771msec); 0 zone resets clat (msec): min=337, max=1656, avg=831.08, stdev=719.62 lat (msec): min=337, max=1657, avg=832.93, stdev=718.54 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.44%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4786KiB/s (4901kB/s), 1259KiB/s-3590KiB/s (1289kB/s-3676kB/s), io=16.0MiB (16.8MB), run=3254-3423msec WRITE: bw=9.82MiB/s (10.3MB/s), 2518KiB/s-4435KiB/s (2578kB/s-4541kB/s), io=32.0MiB (33.6MB), run=2771-3258msec