== sanity test 398b: DIO and buffer IO race ============== 03:52:00 (1789458720) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.23412 s, 9.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146783: Tue Sep 15 03:54:10 2026 read: IOPS=13, BW=52.6KiB/s (53.9kB/s)(5992KiB/113926msec) clat (usec): min=33, max=429051, avg=35997.68, stdev=29495.22 lat (usec): min=34, max=429052, avg=36002.03, stdev=29494.37 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 74], 20.00th=[ 15401], | 30.00th=[ 20579], 40.00th=[ 25035], 50.00th=[ 30016], 60.00th=[ 35914], | 70.00th=[ 44303], 80.00th=[ 55837], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[117965], 99.50th=[156238], 99.90th=[208667], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 119, per=25.03%, avg=52.56, stdev=22.04, samples=223 iops : min= 1, max= 29, avg=12.49, stdev= 5.55, samples=223 write: IOPS=13, BW=55.3KiB/s (56.6kB/s)(6296KiB/113926msec); 0 zone resets clat (usec): min=856, max=873354, avg=37825.72, stdev=43761.43 lat (usec): min=857, max=873354, avg=37830.20, stdev=43764.97 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1565], 20.00th=[ 3720], | 30.00th=[ 7242], 40.00th=[ 16450], 50.00th=[ 27657], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 64750], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[164627], 99.50th=[187696], 99.90th=[254804], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 119, per=24.98%, avg=54.96, stdev=22.94, samples=224 iops : min= 1, max= 29, avg=13.09, stdev= 5.75, samples=224 lat (usec) : 50=0.91%, 100=4.52%, 250=0.55%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.10% lat (msec) : 2=6.97%, 4=3.97%, 10=7.52%, 20=11.39%, 50=36.91% lat (msec) : 100=22.07%, 250=4.75%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.98%, ctx=6550, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146784: Tue Sep 15 03:54:10 2026 read: IOPS=13, BW=52.7KiB/s (53.9kB/s)(5940KiB/112747msec) clat (usec): min=29, max=386199, avg=35574.71, stdev=30386.92 lat (usec): min=29, max=386201, avg=35578.72, stdev=30389.81 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 72], 20.00th=[ 14877], | 30.00th=[ 19792], 40.00th=[ 24511], 50.00th=[ 29230], 60.00th=[ 35914], | 70.00th=[ 44303], 80.00th=[ 53740], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[123208], 99.50th=[154141], 99.90th=[358613], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 135, per=25.23%, avg=52.98, stdev=23.35, samples=219 iops : min= 1, max= 33, avg=12.60, stdev= 5.86, samples=219 write: IOPS=14, BW=56.3KiB/s (57.7kB/s)(6348KiB/112747msec); 0 zone resets clat (usec): min=1006, max=881100, avg=37492.32, stdev=45115.76 lat (usec): min=1006, max=881102, avg=37494.71, stdev=45114.91 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1778], 20.00th=[ 3621], | 30.00th=[ 6718], 40.00th=[ 15795], 50.00th=[ 26084], 60.00th=[ 36439], | 70.00th=[ 49546], 80.00th=[ 64226], 90.00th=[ 88605], 95.00th=[113771], | 99.00th=[164627], 99.50th=[183501], 99.90th=[480248], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 150, per=25.41%, avg=55.91, stdev=23.78, samples=221 iops : min= 1, max= 37, avg=13.33, stdev= 5.99, samples=221 lat (usec) : 50=0.81%, 100=4.79%, 250=0.42%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=6.32%, 4=5.01%, 10=7.10%, 20=12.70%, 50=36.10% lat (msec) : 100=21.29%, 250=5.05%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=6.01%, ctx=6463, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146785: Tue Sep 15 03:54:10 2026 read: IOPS=13, BW=52.9KiB/s (54.2kB/s)(6028KiB/113948msec) clat (usec): min=31, max=884798, avg=35221.06, stdev=35774.42 lat (usec): min=31, max=884799, avg=35222.26, stdev=35774.50 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 67], 20.00th=[ 14746], | 30.00th=[ 19792], 40.00th=[ 23725], 50.00th=[ 28181], 60.00th=[ 33817], | 70.00th=[ 42730], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[127402], 99.50th=[158335], 99.90th=[261096], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 111, per=25.03%, avg=52.55, stdev=23.27, samples=224 iops : min= 1, max= 27, avg=12.49, stdev= 5.84, samples=224 write: IOPS=13, BW=54.9KiB/s (56.3kB/s)(6260KiB/113948msec); 0 zone resets clat (usec): min=977, max=343296, avg=38615.88, stdev=38080.77 lat (usec): min=978, max=343297, avg=38623.40, stdev=38079.99 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1811], 20.00th=[ 3982], | 30.00th=[ 7832], 40.00th=[ 19006], 50.00th=[ 30540], 60.00th=[ 40109], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[113771], | 99.00th=[152044], 99.50th=[177210], 99.90th=[256902], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 135, per=24.83%, avg=54.63, stdev=21.84, samples=224 iops : min= 1, max= 33, avg=13.00, stdev= 5.52, samples=224 lat (usec) : 50=1.30%, 100=4.59%, 250=0.33%, 500=0.16%, 750=0.16% lat (usec) : 1000=0.07% lat (msec) : 2=5.83%, 4=4.62%, 10=6.71%, 20=11.98%, 50=37.08% lat (msec) : 100=21.97%, 250=5.08%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.99%, ctx=6571, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146786: Tue Sep 15 03:54:10 2026 read: IOPS=13, BW=52.0KiB/s (54.3kB/s)(6052KiB/114205msec) clat (usec): min=32, max=275558, avg=34838.62, stdev=28277.66 lat (usec): min=32, max=275559, avg=34848.86, stdev=28287.92 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 67], 20.00th=[ 14353], | 30.00th=[ 19268], 40.00th=[ 23987], 50.00th=[ 29492], 60.00th=[ 35390], | 70.00th=[ 43779], 80.00th=[ 54264], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[117965], 99.50th=[141558], 99.90th=[235930], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 135, per=25.19%, avg=52.91, stdev=21.32, samples=222 iops : min= 1, max= 33, avg=12.58, stdev= 5.36, samples=222 write: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6236KiB/114205msec); 0 zone resets clat (usec): min=966, max=877764, avg=39159.52, stdev=45669.74 lat (usec): min=966, max=877764, avg=39160.88, stdev=45669.69 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1762], 20.00th=[ 4047], | 30.00th=[ 7504], 40.00th=[ 16581], 50.00th=[ 27132], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[160433], 99.50th=[208667], 99.90th=[312476], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 199, per=24.57%, avg=54.05, stdev=24.01, samples=224 iops : min= 1, max= 49, avg=12.87, stdev= 6.03, samples=224 lat (usec) : 50=1.37%, 100=4.56%, 250=0.68%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=5.83%, 4=4.36%, 10=7.29%, 20=12.83%, 50=35.71% lat (msec) : 100=21.29%, 250=5.50%, 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=5.69%, ctx=6633, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=210KiB/s (215kB/s), 52.6KiB/s-52.0KiB/s (53.9kB/s-54.3kB/s), io=23.4MiB (24.6MB), run=112747-114205msec WRITE: bw=220KiB/s (225kB/s), 54.6KiB/s-56.3KiB/s (55.9kB/s-57.7kB/s), io=24.6MiB (25.7MB), run=112747-114205msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146788: Tue Sep 15 03:56:14 2026 read: IOPS=6, BW=25.3KiB/s (25.9kB/s)(5992KiB/236875msec) clat (msec): min=4, max=876, avg=30.82, stdev=37.05 lat (msec): min=4, max=876, avg=30.83, stdev=37.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 70], 95.00th=[ 91], | 99.00th=[ 144], 99.50th=[ 167], 99.90th=[ 384], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 112, per=26.95%, avg=27.22, stdev=18.25, samples=426 iops : min= 1, max= 28, avg= 6.19, stdev= 4.60, samples=426 write: IOPS=6, BW=26.6KiB/s (27.2kB/s)(6296KiB/236875msec); 0 zone resets clat (msec): min=29, max=482, avg=121.07, stdev=55.41 lat (msec): min=29, max=482, avg=121.08, stdev=55.42 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 78], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 108], 60.00th=[ 121], | 70.00th=[ 138], 80.00th=[ 159], 90.00th=[ 197], 95.00th=[ 232], | 99.00th=[ 300], 99.50th=[ 342], 99.90th=[ 418], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 55, per=25.03%, avg=26.28, stdev=11.56, samples=463 iops : min= 1, max= 13, avg= 5.95, stdev= 2.95, samples=463 lat (msec) : 10=4.75%, 20=20.38%, 50=16.63%, 100=26.92%, 250=29.52% lat (msec) : 500=1.76%, 1000=0.03% cpu : usr=0.04%, sys=1.23%, ctx=5131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146789: Tue Sep 15 03:56:14 2026 read: IOPS=6, BW=25.0KiB/s (25.6kB/s)(5940KiB/237385msec) clat (msec): min=4, max=925, avg=30.93, stdev=40.47 lat (msec): min=4, max=925, avg=30.93, stdev=40.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 70], 95.00th=[ 96], | 99.00th=[ 159], 99.50th=[ 236], 99.90th=[ 368], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 103, per=27.12%, avg=27.39, stdev=17.89, samples=420 iops : min= 1, max= 25, avg= 6.23, stdev= 4.51, samples=420 write: IOPS=6, BW=26.7KiB/s (27.4kB/s)(6348KiB/237385msec); 0 zone resets clat (msec): min=40, max=487, avg=120.56, stdev=54.79 lat (msec): min=40, max=487, avg=120.57, stdev=54.79 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 108], 60.00th=[ 122], | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 194], 95.00th=[ 222], | 99.00th=[ 300], 99.50th=[ 330], 99.90th=[ 414], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 55, per=25.03%, avg=26.28, stdev=11.26, samples=466 iops : min= 1, max= 13, avg= 5.95, stdev= 2.88, samples=466 lat (msec) : 10=5.79%, 20=21.26%, 50=14.55%, 100=27.08%, 250=29.56% lat (msec) : 500=1.73%, 1000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5194, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146790: Tue Sep 15 03:56:14 2026 read: IOPS=6, BW=25.5KiB/s (26.1kB/s)(6028KiB/236714msec) clat (msec): min=4, max=432, avg=32.20, stdev=34.66 lat (msec): min=4, max=432, avg=32.20, stdev=34.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 73], 95.00th=[ 99], | 99.00th=[ 155], 99.50th=[ 224], 99.90th=[ 351], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 128, per=26.88%, avg=27.15, stdev=18.32, samples=430 iops : min= 1, max= 32, avg= 6.17, stdev= 4.62, samples=430 write: IOPS=6, BW=26.4KiB/s (27.1kB/s)(6260KiB/236714msec); 0 zone resets clat (msec): min=31, max=987, avg=120.18, stdev=58.26 lat (msec): min=31, max=987, avg=120.19, stdev=58.26 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 87], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 120], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 197], 95.00th=[ 220], | 99.00th=[ 296], 99.50th=[ 338], 99.90th=[ 414], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 56, per=24.90%, avg=26.15, stdev=11.71, samples=463 iops : min= 1, max= 14, avg= 5.92, stdev= 3.00, samples=463 lat (msec) : 10=4.82%, 20=19.82%, 50=17.22%, 100=27.77%, 250=28.78% lat (msec) : 500=1.56%, 1000=0.03% cpu : usr=0.05%, sys=1.24%, ctx=5228, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146791: Tue Sep 15 03:56:14 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6052KiB/236233msec) clat (msec): min=5, max=433, avg=30.76, stdev=32.79 lat (msec): min=5, max=433, avg=30.76, stdev=32.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 43], 90.00th=[ 71], 95.00th=[ 99], | 99.00th=[ 140], 99.50th=[ 159], 99.90th=[ 384], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 111, per=27.53%, avg=27.80, stdev=19.05, samples=422 iops : min= 1, max= 27, avg= 6.34, stdev= 4.80, samples=422 write: IOPS=6, BW=26.4KiB/s (27.0kB/s)(6236KiB/236233msec); 0 zone resets clat (msec): min=27, max=991, avg=121.60, stdev=59.47 lat (msec): min=27, max=991, avg=121.61, stdev=59.48 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 107], 60.00th=[ 121], | 70.00th=[ 138], 80.00th=[ 163], 90.00th=[ 199], 95.00th=[ 230], | 99.00th=[ 309], 99.50th=[ 359], 99.90th=[ 435], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 56, per=24.83%, avg=26.07, stdev=11.45, samples=462 iops : min= 1, max= 14, avg= 5.90, stdev= 2.93, samples=462 lat (msec) : 10=6.45%, 20=19.99%, 50=15.79%, 100=26.53%, 250=29.69% lat (msec) : 500=1.53%, 1000=0.03% cpu : usr=0.04%, sys=1.21%, ctx=5227, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=101KiB/s (104kB/s), 25.0KiB/s-25.6KiB/s (25.6kB/s-26.2kB/s), io=23.4MiB (24.6MB), run=236233-237385msec WRITE: bw=106KiB/s (108kB/s), 26.4KiB/s-26.7KiB/s (27.0kB/s-27.4kB/s), io=24.6MiB (25.7MB), run=236233-237385msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146845: Tue Sep 15 03:56:45 2026 read: IOPS=18, BW=293KiB/s (300kB/s)(5920KiB/20194msec) clat (usec): min=35, max=141557, avg=26623.25, stdev=23346.50 lat (usec): min=36, max=141558, avg=26627.20, stdev=23343.19 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 83], | 30.00th=[ 11863], 40.00th=[ 19792], 50.00th=[ 23462], 60.00th=[ 30540], | 70.00th=[ 35914], 80.00th=[ 46924], 90.00th=[ 58459], 95.00th=[ 65274], | 99.00th=[ 96994], 99.50th=[109577], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 127, max= 564, per=27.11%, avg=293.05, stdev=96.97, samples=40 iops : min= 7, max= 35, avg=17.57, stdev= 6.15, samples=40 write: IOPS=19, BW=315KiB/s (323kB/s)(6368KiB/20194msec); 0 zone resets clat (usec): min=1438, max=211617, avg=25759.75, stdev=28933.63 lat (usec): min=1440, max=211619, avg=25763.48, stdev=28932.79 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 2147], 20.00th=[ 3884], | 30.00th=[ 5800], 40.00th=[ 8586], 50.00th=[ 15008], 60.00th=[ 21103], | 70.00th=[ 30802], 80.00th=[ 45876], 90.00th=[ 65799], 95.00th=[ 82314], | 99.00th=[141558], 99.50th=[170918], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 95, max= 702, per=27.68%, avg=314.70, stdev=122.51, samples=40 iops : min= 5, max= 43, avg=18.95, stdev= 7.67, samples=40 lat (usec) : 50=1.43%, 100=9.64%, 250=1.17%, 750=0.65% lat (msec) : 2=4.43%, 4=6.51%, 10=11.46%, 20=13.67%, 50=33.72% lat (msec) : 100=15.76%, 250=1.56% cpu : usr=0.07%, sys=9.09%, ctx=1447, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146846: Tue Sep 15 03:56:45 2026 read: IOPS=16, BW=264KiB/s (270kB/s)(5744KiB/21783msec) clat (usec): min=28, max=169513, avg=28862.66, stdev=25013.34 lat (usec): min=29, max=169514, avg=28863.66, stdev=25013.33 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 88], | 30.00th=[ 15926], 40.00th=[ 22676], 50.00th=[ 27395], 60.00th=[ 32637], | 70.00th=[ 38011], 80.00th=[ 45351], 90.00th=[ 58983], 95.00th=[ 74974], | 99.00th=[107480], 99.50th=[117965], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 29, max= 479, per=24.43%, avg=264.05, stdev=102.70, samples=43 iops : min= 1, max= 29, avg=15.74, stdev= 6.44, samples=43 write: IOPS=18, BW=300KiB/s (308kB/s)(6544KiB/21783msec); 0 zone resets clat (usec): min=1305, max=180982, avg=27338.69, stdev=30463.37 lat (usec): min=1306, max=180983, avg=27362.84, stdev=30475.02 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1795], 10.00th=[ 2212], 20.00th=[ 3228], | 30.00th=[ 5407], 40.00th=[ 8717], 50.00th=[ 15795], 60.00th=[ 23725], | 70.00th=[ 32900], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[124257], 99.50th=[147850], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 89, max= 606, per=26.42%, avg=300.42, stdev=129.08, samples=43 iops : min= 5, max= 37, avg=18.02, stdev= 8.10, samples=43 lat (usec) : 50=1.04%, 100=8.98%, 250=1.30%, 500=0.52% lat (msec) : 2=4.43%, 4=8.59%, 10=10.42%, 20=10.81%, 50=35.16% lat (msec) : 100=16.54%, 250=2.21% cpu : usr=0.07%, sys=8.10%, ctx=1436, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146847: Tue Sep 15 03:56:45 2026 read: IOPS=17, BW=282KiB/s (289kB/s)(6256KiB/22150msec) clat (usec): min=32, max=167419, avg=28985.74, stdev=26542.14 lat (usec): min=32, max=167420, avg=28986.89, stdev=26541.99 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 98], | 30.00th=[ 15008], 40.00th=[ 21365], 50.00th=[ 26084], 60.00th=[ 32113], | 70.00th=[ 39060], 80.00th=[ 46400], 90.00th=[ 61080], 95.00th=[ 78119], | 99.00th=[131597], 99.50th=[149947], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 95, max= 539, per=26.92%, avg=291.02, stdev=105.64, samples=42 iops : min= 5, max= 33, avg=17.43, stdev= 6.63, samples=42 write: IOPS=17, BW=272KiB/s (279kB/s)(6032KiB/22150msec); 0 zone resets clat (usec): min=1384, max=253801, avg=28082.89, stdev=29740.64 lat (usec): min=1385, max=253803, avg=28084.84, stdev=29740.63 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1762], 10.00th=[ 2507], 20.00th=[ 4621], | 30.00th=[ 6980], 40.00th=[ 12256], 50.00th=[ 20055], 60.00th=[ 27395], | 70.00th=[ 35914], 80.00th=[ 46924], 90.00th=[ 66323], 95.00th=[ 81265], | 99.00th=[139461], 99.50th=[200279], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 59, max= 574, per=23.68%, avg=269.19, stdev=109.57, samples=43 iops : min= 3, max= 35, avg=16.07, stdev= 6.92, samples=43 lat (usec) : 50=1.82%, 100=8.72%, 250=1.82%, 500=0.65% lat (msec) : 2=4.04%, 4=5.60%, 10=8.20%, 20=13.41%, 50=38.80% lat (msec) : 100=15.10%, 250=1.69%, 500=0.13% cpu : usr=0.07%, sys=7.92%, ctx=1496, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146848: Tue Sep 15 03:56:45 2026 read: IOPS=17, BW=279KiB/s (286kB/s)(6032KiB/21611msec) clat (usec): min=34, max=180057, avg=27648.71, stdev=25651.29 lat (usec): min=34, max=180058, avg=27649.93, stdev=25651.21 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 79], | 30.00th=[ 12387], 40.00th=[ 19530], 50.00th=[ 24511], 60.00th=[ 31851], | 70.00th=[ 37487], 80.00th=[ 46400], 90.00th=[ 60556], 95.00th=[ 71828], | 99.00th=[101188], 99.50th=[162530], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 63, max= 542, per=26.43%, avg=285.71, stdev=103.39, samples=41 iops : min= 3, max= 33, avg=17.10, stdev= 6.43, samples=41 write: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21611msec); 0 zone resets clat (usec): min=1320, max=232567, avg=27864.45, stdev=33210.60 lat (usec): min=1322, max=232569, avg=27866.78, stdev=33210.29 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1696], 10.00th=[ 2180], 20.00th=[ 3621], | 30.00th=[ 5604], 40.00th=[ 10421], 50.00th=[ 15270], 60.00th=[ 24773], | 70.00th=[ 34866], 80.00th=[ 46400], 90.00th=[ 64750], 95.00th=[ 88605], | 99.00th=[158335], 99.50th=[219153], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 29, max= 573, per=25.52%, avg=290.19, stdev=116.46, samples=42 iops : min= 1, max= 35, avg=17.38, stdev= 7.32, samples=42 lat (usec) : 50=2.34%, 100=9.11%, 250=1.30%, 500=0.78%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=4.30%, 4=8.33%, 10=8.07%, 20=13.15%, 50=34.77% lat (msec) : 100=14.84%, 250=2.60% cpu : usr=0.08%, sys=7.84%, ctx=1456, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1081KiB/s (1107kB/s), 264KiB/s-293KiB/s (270kB/s-300kB/s), io=23.4MiB (24.5MB), run=20194-22150msec WRITE: bw=1138KiB/s (1165kB/s), 272KiB/s-315KiB/s (279kB/s-323kB/s), io=24.6MiB (25.8MB), run=20194-22150msec fio: pid=146843, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146841: Tue Sep 15 03:57:19 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(5920KiB/55503msec) clat (msec): min=6, max=249, avg=30.40, stdev=30.43 lat (msec): min=6, max=249, avg=30.40, stdev=30.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 58], 95.00th=[ 86], | 99.00th=[ 184], 99.50th=[ 211], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 30, max= 479, per=28.23%, avg=109.25, stdev=73.08, samples=107 iops : min= 1, max= 29, avg= 6.09, stdev= 4.66, samples=107 write: IOPS=7, BW=115KiB/s (117kB/s)(6368KiB/55503msec); 0 zone resets clat (msec): min=26, max=402, avg=110.61, stdev=50.22 lat (msec): min=26, max=402, avg=110.61, stdev=50.22 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 90], 50.00th=[ 99], 60.00th=[ 110], | 70.00th=[ 126], 80.00th=[ 142], 90.00th=[ 174], 95.00th=[ 205], | 99.00th=[ 305], 99.50th=[ 334], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 286, per=27.83%, avg=114.37, stdev=48.28, samples=110 iops : min= 1, max= 17, avg= 6.43, stdev= 3.09, samples=110 lat (msec) : 10=3.78%, 20=19.92%, 50=20.31%, 100=28.65%, 250=26.43% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.51%, ctx=1401, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146842: Tue Sep 15 03:57:19 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(5744KiB/55645msec) clat (msec): min=6, max=241, avg=30.94, stdev=29.39 lat (msec): min=6, max=241, avg=30.94, stdev=29.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 66], 95.00th=[ 95], | 99.00th=[ 144], 99.50th=[ 165], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 416, per=29.35%, avg=113.57, stdev=76.56, samples=99 iops : min= 1, max= 26, avg= 6.36, stdev= 4.85, samples=99 write: IOPS=7, BW=118KiB/s (120kB/s)(6544KiB/55645msec); 0 zone resets clat (msec): min=32, max=432, avg=108.76, stdev=51.06 lat (msec): min=32, max=432, avg=108.76, stdev=51.05 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 59], 20.00th=[ 70], | 30.00th=[ 79], 40.00th=[ 89], 50.00th=[ 97], 60.00th=[ 110], | 70.00th=[ 123], 80.00th=[ 140], 90.00th=[ 171], 95.00th=[ 209], | 99.00th=[ 279], 99.50th=[ 292], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 31, max= 286, per=28.39%, avg=116.67, stdev=45.47, samples=110 iops : min= 1, max= 17, avg= 6.57, stdev= 2.95, samples=110 lat (msec) : 10=5.21%, 20=16.54%, 50=21.09%, 100=29.56%, 250=26.17% lat (msec) : 500=1.43% cpu : usr=0.05%, sys=1.58%, ctx=1361, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146843: Tue Sep 15 03:57:19 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(3856KiB/37870msec) clat (msec): min=6, max=196, avg=32.95, stdev=26.53 lat (msec): min=6, max=196, avg=32.95, stdev=26.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 40], 80.00th=[ 49], 90.00th=[ 69], 95.00th=[ 82], | 99.00th=[ 129], 99.50th=[ 138], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 30, max= 318, per=27.37%, avg=105.93, stdev=75.87, samples=72 iops : min= 1, max= 19, avg= 5.83, stdev= 4.77, samples=72 write: IOPS=6, BW=98.9KiB/s (101kB/s)(3744KiB/37870msec); 0 zone resets clat (msec): min=39, max=303, avg=127.14, stdev=55.91 lat (msec): min=39, max=303, avg=127.15, stdev=55.91 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 126], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 209], 95.00th=[ 241], | 99.00th=[ 288], 99.50th=[ 300], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 223, per=23.89%, avg=98.20, stdev=40.61, samples=75 iops : min= 1, max= 13, avg= 5.35, stdev= 2.58, samples=75 lat (msec) : 10=3.15%, 20=17.23%, 50=22.48%, 100=24.37%, 250=30.46% lat (msec) : 500=2.10% cpu : usr=0.03%, sys=1.47%, ctx=766, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=242,234,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146844: Tue Sep 15 03:57:19 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54891msec) clat (msec): min=5, max=256, avg=31.10, stdev=31.62 lat (msec): min=5, max=256, avg=31.10, stdev=31.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 66], 95.00th=[ 84], | 99.00th=[ 194], 99.50th=[ 245], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 30, max= 383, per=29.60%, avg=114.56, stdev=73.60, samples=102 iops : min= 1, max= 23, avg= 6.44, stdev= 4.66, samples=102 write: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54891msec); 0 zone resets clat (msec): min=33, max=324, avg=109.84, stdev=47.21 lat (msec): min=33, max=324, avg=109.84, stdev=47.21 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 73], | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 100], 60.00th=[ 111], | 70.00th=[ 123], 80.00th=[ 140], 90.00th=[ 167], 95.00th=[ 215], | 99.00th=[ 271], 99.50th=[ 309], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 192, per=27.48%, avg=112.96, stdev=43.71, samples=108 iops : min= 1, max= 12, avg= 6.33, stdev= 2.83, samples=108 lat (msec) : 10=4.56%, 20=18.10%, 50=20.83%, 100=29.95%, 250=25.26% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.54%, ctx=1378, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=387KiB/s (397kB/s), 102KiB/s-110KiB/s (104kB/s-113kB/s), io=21.0MiB (22.1MB), run=37870-55645msec WRITE: bw=412KiB/s (422kB/s), 98.9KiB/s-118KiB/s (101kB/s-120kB/s), io=22.4MiB (23.5MB), run=37870-55645msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146863: Tue Sep 15 03:57:28 2026 read: IOPS=2, BW=2771KiB/s (2837kB/s)(7168KiB/2587msec) clat (msec): min=77, max=257, avg=148.76, stdev=64.87 lat (msec): min=77, max=257, avg=148.76, stdev=64.87 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 91], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 157], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 201], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1885, max= 6047, per=52.09%, avg=2974.75, stdev=2049.27, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1979KiB/s (2027kB/s)(5120KiB/2587msec); 0 zone resets clat (msec): min=203, max=508, avg=304.82, stdev=119.34 lat (msec): min=203, max=509, avg=305.44, stdev=119.29 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1885, max= 3849, per=32.42%, avg=2592.33, stdev=1091.17, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=7.81%, ctx=71, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146864: Tue Sep 15 03:57:28 2026 read: IOPS=0, BW=576KiB/s (590kB/s)(2048KiB/3556msec) clat (usec): min=56802, max=99357, avg=78079.62, stdev=30091.01 lat (usec): min=56804, max=99358, avg=78081.46, stdev=30090.40 clat percentiles (usec): | 1.00th=[56886], 5.00th=[56886], 10.00th=[56886], 20.00th=[56886], | 30.00th=[56886], 40.00th=[56886], 50.00th=[56886], 60.00th=[99091], | 70.00th=[99091], 80.00th=[99091], 90.00th=[99091], 95.00th=[99091], | 99.00th=[99091], 99.50th=[99091], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 1924, max= 1973, per=34.12%, avg=1948.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2880KiB/s (2949kB/s)(10.0MiB/3556msec); 0 zone resets clat (msec): min=113, max=613, avg=330.28, stdev=163.77 lat (msec): min=114, max=613, avg=330.37, stdev=163.77 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 153], | 30.00th=[ 169], 40.00th=[ 232], 50.00th=[ 296], 60.00th=[ 397], | 70.00th=[ 405], 80.00th=[ 443], 90.00th=[ 481], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1885, max= 4087, per=33.21%, avg=2655.17, stdev=1088.65, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=8.16%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146865: Tue Sep 15 03:57:28 2026 read: IOPS=1, BW=1713KiB/s (1754kB/s)(6144KiB/3586msec) clat (msec): min=57, max=523, avg=210.42, stdev=166.68 lat (msec): min=57, max=523, avg=210.42, stdev=166.68 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 174], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1885, max= 2031, per=34.39%, avg=1963.75, stdev=70.55, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1713KiB/s (1754kB/s)(6144KiB/3586msec); 0 zone resets clat (msec): min=147, max=759, avg=376.54, stdev=252.16 lat (msec): min=147, max=759, avg=376.64, stdev=252.16 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 489], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1885, max= 3900, per=32.14%, avg=2569.67, stdev=1152.27, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.06%, sys=8.28%, ctx=171, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146866: Tue Sep 15 03:57:28 2026 read: IOPS=1, BW=1733KiB/s (1775kB/s)(5120KiB/2954msec) clat (msec): min=101, max=258, avg=189.80, stdev=71.25 lat (msec): min=101, max=258, avg=189.81, stdev=71.25 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 259], 95.00th=[ 259], | 99.00th=[ 259], 99.50th=[ 259], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 3771, max= 3849, per=66.71%, avg=3810.00, stdev=55.15, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2427KiB/s (2485kB/s)(7168KiB/2954msec); 0 zone resets clat (msec): min=147, max=432, avg=277.29, stdev=106.39 lat (msec): min=147, max=433, avg=277.44, stdev=106.51 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 209], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 253], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 414], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1885, max= 4087, per=37.68%, avg=3012.50, stdev=1228.06, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=58.33%, 500=41.67% cpu : usr=0.03%, sys=6.43%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5711KiB/s (5848kB/s), 576KiB/s-2771KiB/s (590kB/s-2837kB/s), io=20.0MiB (20.0MB), run=2587-3586msec WRITE: bw=7996KiB/s (8187kB/s), 1713KiB/s-2880KiB/s (1754kB/s-2949kB/s), io=28.0MiB (29.4MB), run=2587-3586msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146868: Tue Sep 15 03:57:28 2026 read: IOPS=2, BW=2452KiB/s (2511kB/s)(7168KiB/2923msec) clat (usec): min=547, max=331755, avg=193205.44, stdev=102668.54 lat (usec): min=548, max=331756, avg=193206.87, stdev=102668.41 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[160433], | 30.00th=[181404], 40.00th=[181404], 50.00th=[185598], 60.00th=[244319], | 70.00th=[244319], 80.00th=[248513], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 1950, max= 4055, per=42.66%, avg=2521.00, stdev=1023.56, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1752KiB/s (1794kB/s)(5120KiB/2923msec); 0 zone resets clat (msec): min=150, max=493, avg=281.48, stdev=132.34 lat (msec): min=150, max=493, avg=281.58, stdev=132.37 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2048, max= 5796, per=47.40%, avg=3922.00, stdev=2650.24, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=22.21%, ctx=318, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146869: Tue Sep 15 03:57:28 2026 read: IOPS=0, BW=591KiB/s (605kB/s)(2048KiB/3465msec) clat (msec): min=229, max=326, avg=277.92, stdev=68.40 lat (msec): min=229, max=326, avg=277.92, stdev=68.41 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1928, max= 2031, per=33.49%, avg=1979.50, stdev=72.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2955KiB/s (3026kB/s)(10.0MiB/3465msec); 0 zone resets clat (msec): min=84, max=582, avg=282.99, stdev=178.96 lat (msec): min=84, max=582, avg=283.15, stdev=179.02 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 103], | 30.00th=[ 115], 40.00th=[ 184], 50.00th=[ 211], 60.00th=[ 222], | 70.00th=[ 418], 80.00th=[ 439], 90.00th=[ 472], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2031, max= 6083, per=42.98%, avg=3556.25, stdev=1935.84, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=22.95%, ctx=218, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146870: Tue Sep 15 03:57:28 2026 read: IOPS=2, BW=2148KiB/s (2200kB/s)(6144KiB/2860msec) clat (usec): min=446, max=290729, avg=121644.90, stdev=137670.27 lat (usec): min=447, max=290731, avg=121646.08, stdev=137670.28 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 457], | 30.00th=[ 457], 40.00th=[ 603], 50.00th=[ 603], 60.00th=[179307], | 70.00th=[258999], 80.00th=[258999], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 3864, max= 4063, per=67.06%, avg=3963.50, stdev=140.71, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2148KiB/s (2200kB/s)(6144KiB/2860msec); 0 zone resets clat (msec): min=138, max=893, avg=336.87, stdev=296.04 lat (msec): min=138, max=893, avg=336.93, stdev=296.03 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 259], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1932, max= 3893, per=31.72%, avg=2624.33, stdev=1100.23, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=22.14%, ctx=323, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146871: Tue Sep 15 03:57:28 2026 read: IOPS=1, BW=1590KiB/s (1628kB/s)(5120KiB/3220msec) clat (usec): min=965, max=411506, avg=107039.34, stdev=177225.69 lat (usec): min=967, max=411507, avg=107040.37, stdev=177225.52 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 963], 10.00th=[ 963], 20.00th=[ 963], | 30.00th=[ 1713], 40.00th=[ 1713], 50.00th=[ 4555], 60.00th=[ 4555], | 70.00th=[116917], 80.00th=[116917], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 2031, max= 5796, per=66.22%, avg=3913.50, stdev=2662.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2226KiB/s (2280kB/s)(7168KiB/3220msec); 0 zone resets clat (msec): min=167, max=802, avg=377.47, stdev=209.05 lat (msec): min=168, max=802, avg=377.54, stdev=209.03 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 205], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 342], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 426], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1838, max= 4063, per=36.29%, avg=3003.00, stdev=1226.98, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=25.00%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=20.50%, ctx=134, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5911KiB/s (6052kB/s), 591KiB/s-2452KiB/s (605kB/s-2511kB/s), io=20.0MiB (20.0MB), run=2860-3465msec WRITE: bw=8275KiB/s (8473kB/s), 1752KiB/s-2955KiB/s (1794kB/s-3026kB/s), io=28.0MiB (29.4MB), run=2860-3465msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146877: Tue Sep 15 03:57:39 2026 read: IOPS=1, BW=5139KiB/s (5263kB/s)(12.0MiB/2391msec) clat (msec): min=660, max=800, avg=725.77, stdev=70.13 lat (msec): min=660, max=800, avg=725.77, stdev=70.13 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7861, max= 8175, per=100.00%, avg=8018.00, stdev=222.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.29%, ctx=426, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146878: Tue Sep 15 03:57:39 2026 read: IOPS=0, BW=1585KiB/s (1623kB/s)(4096KiB/2585msec) clat (nsec): min=719557k, max=719557k, avg=719556788.00, stdev= 0.00 lat (nsec): min=719560k, max=719560k, avg=719559508.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3169KiB/s (3245kB/s)(8192KiB/2585msec); 0 zone resets clat (msec): min=665, max=1011, avg=838.71, stdev=244.47 lat (msec): min=666, max=1011, avg=839.25, stdev=244.19 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8175, max= 8175, per=71.33%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.89%, ctx=146, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146879: Tue Sep 15 03:57:39 2026 write: IOPS=1, BW=4298KiB/s (4401kB/s)(12.0MiB/2859msec); 0 zone resets clat (msec): min=576, max=1138, avg=887.11, stdev=285.48 lat (msec): min=576, max=1140, avg=887.98, stdev=286.17 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8062, max= 8126, per=70.62%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.18%, ctx=98, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146880: Tue Sep 15 03:57:39 2026 write: IOPS=1, BW=7847KiB/s (8035kB/s)(12.0MiB/1566msec); 0 zone resets clat (msec): min=274, max=808, avg=465.28, stdev=297.53 lat (msec): min=274, max=809, avg=465.82, stdev=297.98 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 5417, max= 8175, per=59.30%, avg=6796.00, stdev=1950.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.03%, ctx=137, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6338KiB/s (6490kB/s), 1585KiB/s-5139KiB/s (1623kB/s-5263kB/s), io=16.0MiB (16.8MB), run=2391-2585msec WRITE: bw=11.2MiB/s (11.7MB/s), 3169KiB/s-7847KiB/s (3245kB/s-8035kB/s), io=32.0MiB (33.6MB), run=1566-2859msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146882: Tue Sep 15 03:57:40 2026 read: IOPS=1, BW=4947KiB/s (5066kB/s)(12.0MiB/2484msec) clat (msec): min=292, max=1390, avg=827.34, stdev=549.87 lat (msec): min=292, max=1390, avg=827.34, stdev=549.87 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.95%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146883: Tue Sep 15 03:57:40 2026 read: IOPS=0, BW=1501KiB/s (1537kB/s)(4096KiB/2729msec) clat (nsec): min=966122k, max=966122k, avg=966121991.00, stdev= 0.00 lat (nsec): min=966124k, max=966124k, avg=966123928.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3002KiB/s (3074kB/s)(8192KiB/2729msec); 0 zone resets clat (msec): min=835, max=922, avg=879.03, stdev=60.85 lat (msec): min=836, max=924, avg=880.63, stdev=61.89 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8126, max= 8126, per=67.68%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=4.99%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146884: Tue Sep 15 03:57:40 2026 write: IOPS=1, BW=4549KiB/s (4659kB/s)(12.0MiB/2701msec); 0 zone resets clat (msec): min=263, max=1662, avg=899.32, stdev=708.40 lat (msec): min=263, max=1664, avg=900.08, stdev=709.04 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8126, max= 8175, per=67.88%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.15%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146885: Tue Sep 15 03:57:40 2026 write: IOPS=1, BW=5308KiB/s (5435kB/s)(12.0MiB/2315msec); 0 zone resets clat (msec): min=269, max=1746, avg=770.68, stdev=844.95 lat (msec): min=270, max=1747, avg=771.45, stdev=845.21 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 6627, max= 8126, per=61.43%, avg=7376.50, stdev=1059.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.09%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6004KiB/s (6148kB/s), 1501KiB/s-4947KiB/s (1537kB/s-5066kB/s), io=16.0MiB (16.8MB), run=2484-2729msec WRITE: bw=11.7MiB/s (12.3MB/s), 3002KiB/s-5308KiB/s (3074kB/s-5435kB/s), io=32.0MiB (33.6MB), run=2315-2729msec