== sanity test 398b: DIO and buffer IO race ============== 12:49:33 (1788540573) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.47199 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178953: Fri Sep 4 12:52:00 2026 read: IOPS=11, BW=47.0KiB/s (48.1kB/s)(5992KiB/127436msec) clat (usec): min=45, max=913744, avg=47640.54, stdev=37034.45 lat (usec): min=46, max=913745, avg=47642.92, stdev=37034.55 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 12387], 10.00th=[ 18482], 20.00th=[ 24511], | 30.00th=[ 30016], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 47973], | 70.00th=[ 55837], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[149947], 99.50th=[177210], 99.90th=[258999], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 15, max= 111, per=24.81%, avg=46.64, stdev=18.76, samples=250 iops : min= 3, max= 27, avg=11.00, stdev= 4.71, samples=250 write: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6296KiB/127436msec); 0 zone resets clat (usec): min=850, max=304477, avg=35349.50, stdev=36161.88 lat (usec): min=852, max=304479, avg=35354.21, stdev=36162.11 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1369], 10.00th=[ 1909], 20.00th=[ 4293], | 30.00th=[ 8979], 40.00th=[ 16909], 50.00th=[ 26346], 60.00th=[ 35914], | 70.00th=[ 45351], 80.00th=[ 58983], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[173016], 99.50th=[187696], 99.90th=[287310], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 134, per=24.88%, avg=49.02, stdev=21.67, samples=250 iops : min= 1, max= 33, avg=11.61, stdev= 5.47, samples=250 lat (usec) : 50=0.07%, 100=1.30%, 250=0.16%, 500=0.03%, 1000=0.13% lat (msec) : 2=5.24%, 4=4.46%, 10=6.77%, 20=9.54%, 50=40.62% lat (msec) : 100=26.43%, 250=5.08%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.13%, ctx=6791, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178954: Fri Sep 4 12:52:00 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5940KiB/126999msec) clat (usec): min=42, max=891524, avg=46856.67, stdev=38592.56 lat (usec): min=42, max=891525, avg=46859.75, stdev=38592.28 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 10683], 10.00th=[ 16909], 20.00th=[ 23462], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[100140], | 99.00th=[156238], 99.50th=[179307], 99.90th=[392168], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 103, per=24.71%, avg=46.45, stdev=19.25, samples=249 iops : min= 1, max= 25, avg=10.96, stdev= 4.88, samples=249 write: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6348KiB/126999msec); 0 zone resets clat (usec): min=920, max=248771, avg=35872.42, stdev=37804.74 lat (usec): min=921, max=248772, avg=35874.82, stdev=37804.60 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 1663], 20.00th=[ 3654], | 30.00th=[ 7242], 40.00th=[ 17171], 50.00th=[ 25035], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[112722], | 99.00th=[166724], 99.50th=[193987], 99.90th=[246416], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 126, per=25.28%, avg=49.81, stdev=23.10, samples=248 iops : min= 1, max= 31, avg=11.81, stdev= 5.83, samples=248 lat (usec) : 50=0.07%, 100=1.66%, 250=0.33%, 500=0.07%, 1000=0.07% lat (msec) : 2=6.51%, 4=4.49%, 10=6.74%, 20=9.96%, 50=38.41% lat (msec) : 100=25.55%, 250=6.05%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=4.83%, ctx=6525, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178955: Fri Sep 4 12:52:00 2026 read: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6028KiB/121708msec) clat (usec): min=38, max=921670, avg=45762.82, stdev=37689.84 lat (usec): min=38, max=921672, avg=45778.95, stdev=37678.05 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 11207], 10.00th=[ 16909], 20.00th=[ 22938], | 30.00th=[ 27657], 40.00th=[ 33162], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 64750], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[147850], 99.50th=[177210], 99.90th=[329253], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 103, per=26.15%, avg=49.17, stdev=19.14, samples=239 iops : min= 1, max= 25, avg=11.65, stdev= 4.82, samples=239 write: IOPS=12, BW=51.4KiB/s (52.7kB/s)(6260KiB/121708msec); 0 zone resets clat (usec): min=745, max=218014, avg=33387.19, stdev=34602.12 lat (usec): min=746, max=218018, avg=33397.63, stdev=34618.91 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1319], 10.00th=[ 1532], 20.00th=[ 3261], | 30.00th=[ 6456], 40.00th=[ 14615], 50.00th=[ 23987], 60.00th=[ 32375], | 70.00th=[ 44827], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[147850], 99.50th=[166724], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 119, per=25.94%, avg=51.10, stdev=21.51, samples=239 iops : min= 1, max= 29, avg=12.13, stdev= 5.42, samples=239 lat (usec) : 50=0.10%, 100=1.66%, 250=0.23%, 750=0.03%, 1000=0.26% lat (msec) : 2=6.77%, 4=4.72%, 10=6.87%, 20=9.83%, 50=39.06% lat (msec) : 100=25.36%, 250=5.05%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.98%, ctx=6465, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178956: Fri Sep 4 12:52:00 2026 read: IOPS=11, BW=47.5KiB/s (48.6kB/s)(6052KiB/127450msec) clat (usec): min=36, max=881115, avg=47126.62, stdev=36800.54 lat (usec): min=36, max=881116, avg=47132.07, stdev=36804.26 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 12387], 10.00th=[ 18482], 20.00th=[ 24249], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[143655], 99.50th=[158335], 99.90th=[337642], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 116, per=25.18%, avg=47.33, stdev=19.48, samples=249 iops : min= 1, max= 29, avg=11.18, stdev= 4.89, samples=249 write: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6236KiB/127450msec); 0 zone resets clat (usec): min=805, max=276873, avg=35698.60, stdev=37379.39 lat (usec): min=806, max=276874, avg=35708.55, stdev=37377.19 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1696], 20.00th=[ 3949], | 30.00th=[ 7504], 40.00th=[ 15795], 50.00th=[ 24773], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 61080], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[156238], 99.50th=[181404], 99.90th=[225444], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 119, per=24.65%, avg=48.55, stdev=19.89, samples=250 iops : min= 1, max= 29, avg=11.48, stdev= 5.00, samples=250 lat (usec) : 50=0.13%, 100=1.43%, 250=0.13%, 500=0.03%, 1000=0.13% lat (msec) : 2=5.73%, 4=4.49%, 10=7.06%, 20=9.51%, 50=40.17% lat (msec) : 100=24.77%, 250=6.32%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=4.77%, ctx=6633, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (193kB/s), 46.8KiB/s-49.5KiB/s (47.9kB/s-50.7kB/s), io=23.4MiB (24.6MB), run=121708-127450msec WRITE: bw=197KiB/s (202kB/s), 48.9KiB/s-51.4KiB/s (50.1kB/s-52.7kB/s), io=24.6MiB (25.7MB), run=121708-127450msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178958: Fri Sep 4 12:52:44 2026 read: IOPS=8, BW=35.3KiB/s (36.1kB/s)(5992KiB/169748msec) clat (msec): min=3, max=919, avg=45.43, stdev=46.42 lat (msec): min=3, max=919, avg=45.43, stdev=46.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 66], 90.00th=[ 97], 95.00th=[ 130], | 99.00th=[ 199], 99.50th=[ 247], 99.90th=[ 388], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 135, per=25.33%, avg=35.47, stdev=23.37, samples=328 iops : min= 1, max= 33, avg= 8.18, stdev= 5.88, samples=328 write: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6296KiB/169748msec); 0 zone resets clat (msec): min=12, max=492, avg=64.52, stdev=44.75 lat (msec): min=12, max=492, avg=64.53, stdev=44.75 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 74], 80.00th=[ 95], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 205], 99.50th=[ 262], 99.90th=[ 351], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 128, per=25.02%, avg=36.78, stdev=23.10, samples=332 iops : min= 1, max= 32, avg= 8.51, stdev= 5.81, samples=332 lat (msec) : 4=0.03%, 10=1.86%, 20=12.99%, 50=44.66%, 100=26.99% lat (msec) : 250=12.96%, 500=0.49%, 1000=0.03% cpu : usr=0.07%, sys=1.75%, ctx=4640, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178959: Fri Sep 4 12:52:44 2026 read: IOPS=8, BW=34.8KiB/s (35.6kB/s)(5940KiB/170681msec) clat (msec): min=5, max=884, avg=44.79, stdev=46.84 lat (msec): min=5, max=884, avg=44.80, stdev=46.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 97], 95.00th=[ 128], | 99.00th=[ 207], 99.50th=[ 253], 99.90th=[ 414], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 142, per=25.27%, avg=35.38, stdev=24.91, samples=326 iops : min= 1, max= 35, avg= 8.16, stdev= 6.26, samples=326 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6348KiB/170681msec); 0 zone resets clat (msec): min=10, max=436, avg=65.51, stdev=46.46 lat (msec): min=10, max=436, avg=65.51, stdev=46.47 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 78], 80.00th=[ 95], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 234], 99.50th=[ 292], 99.90th=[ 376], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 128, per=25.19%, avg=37.03, stdev=23.19, samples=333 iops : min= 1, max= 32, avg= 8.58, stdev= 5.85, samples=333 lat (msec) : 10=2.31%, 20=14.32%, 50=43.13%, 100=26.43%, 250=13.22% lat (msec) : 500=0.55%, 1000=0.03% cpu : usr=0.06%, sys=1.68%, ctx=4626, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178960: Fri Sep 4 12:52:44 2026 read: IOPS=8, BW=35.3KiB/s (36.1kB/s)(6028KiB/170913msec) clat (msec): min=6, max=417, avg=43.52, stdev=40.46 lat (msec): min=6, max=417, avg=43.52, stdev=40.46 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 96], 95.00th=[ 125], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 376], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 144, per=25.67%, avg=35.94, stdev=25.04, samples=325 iops : min= 1, max= 36, avg= 8.30, stdev= 6.31, samples=325 write: IOPS=9, BW=36.6KiB/s (37.5kB/s)(6260KiB/170913msec); 0 zone resets clat (msec): min=11, max=876, avg=67.19, stdev=52.53 lat (msec): min=11, max=876, avg=67.19, stdev=52.54 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 97], 90.00th=[ 129], 95.00th=[ 159], | 99.00th=[ 222], 99.50th=[ 288], 99.90th=[ 609], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 119, per=24.79%, avg=36.45, stdev=22.74, samples=332 iops : min= 1, max= 29, avg= 8.43, stdev= 5.73, samples=332 lat (msec) : 10=2.47%, 20=13.61%, 50=44.40%, 100=25.59%, 250=13.44% lat (msec) : 500=0.42%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=1.66%, ctx=4636, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178961: Fri Sep 4 12:52:44 2026 read: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6052KiB/170964msec) clat (msec): min=4, max=322, avg=45.17, stdev=40.78 lat (msec): min=4, max=322, avg=45.17, stdev=40.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 65], 90.00th=[ 100], 95.00th=[ 132], | 99.00th=[ 197], 99.50th=[ 213], 99.90th=[ 292], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 135, per=25.49%, avg=35.69, stdev=23.88, samples=327 iops : min= 1, max= 33, avg= 8.24, stdev= 6.01, samples=327 write: IOPS=9, BW=36.5KiB/s (37.3kB/s)(6236KiB/170964msec); 0 zone resets clat (msec): min=10, max=859, avg=65.71, stdev=49.79 lat (msec): min=10, max=859, avg=65.71, stdev=49.79 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 127], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 284], 99.90th=[ 443], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 132, per=24.67%, avg=36.26, stdev=23.33, samples=332 iops : min= 1, max= 33, avg= 8.38, stdev= 5.88, samples=332 lat (msec) : 10=2.47%, 20=14.00%, 50=43.23%, 100=26.82%, 250=12.99% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.06%, sys=1.69%, ctx=4590, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=140KiB/s (144kB/s), 34.8KiB/s-35.4KiB/s (35.6kB/s-36.2kB/s), io=23.4MiB (24.6MB), run=169748-170964msec WRITE: bw=147KiB/s (151kB/s), 36.5KiB/s-37.2KiB/s (37.3kB/s-38.1kB/s), io=24.6MiB (25.7MB), run=169748-170964msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179007: Fri Sep 4 12:53:35 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(5920KiB/38802msec) clat (usec): min=40, max=175007, avg=54644.16, stdev=33205.96 lat (usec): min=41, max=175008, avg=54649.43, stdev=33204.71 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 86], 10.00th=[ 19006], 20.00th=[ 28181], | 30.00th=[ 34866], 40.00th=[ 41681], 50.00th=[ 49546], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 78119], 90.00th=[ 96994], 95.00th=[113771], | 99.00th=[156238], 99.50th=[170918], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 288, per=24.65%, avg=152.08, stdev=62.87, samples=76 iops : min= 1, max= 18, avg= 8.68, stdev= 3.99, samples=76 write: IOPS=10, BW=164KiB/s (168kB/s)(6368KiB/38802msec); 0 zone resets clat (usec): min=1433, max=259270, avg=45737.46, stdev=44725.75 lat (usec): min=1436, max=259274, avg=45740.47, stdev=44725.82 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2212], 10.00th=[ 3654], 20.00th=[ 7701], | 30.00th=[ 14615], 40.00th=[ 23987], 50.00th=[ 36963], 60.00th=[ 45876], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[127402], | 99.00th=[214959], 99.50th=[246416], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 416, per=25.21%, avg=163.62, stdev=72.05, samples=76 iops : min= 1, max= 26, avg= 9.41, stdev= 4.60, samples=76 lat (usec) : 50=0.26%, 100=2.34%, 250=0.39%, 500=0.13% lat (msec) : 2=1.95%, 4=3.65%, 10=7.81%, 20=6.38%, 50=35.68% lat (msec) : 100=31.77%, 250=9.51%, 500=0.13% cpu : usr=0.08%, sys=4.38%, ctx=1734, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179009: Fri Sep 4 12:53:35 2026 read: IOPS=9, BW=156KiB/s (159kB/s)(5744KiB/36890msec) clat (usec): min=41, max=219556, avg=51551.34, stdev=32299.18 lat (usec): min=41, max=219558, avg=51553.25, stdev=32299.41 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 83], 10.00th=[ 17695], 20.00th=[ 28443], | 30.00th=[ 35390], 40.00th=[ 42206], 50.00th=[ 47973], 60.00th=[ 54264], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[164627], 99.50th=[198181], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 286, per=25.30%, avg=156.12, stdev=69.75, samples=72 iops : min= 1, max= 17, avg= 8.93, stdev= 4.42, samples=72 write: IOPS=11, BW=177KiB/s (182kB/s)(6544KiB/36890msec); 0 zone resets clat (usec): min=1308, max=242707, avg=44399.93, stdev=46221.58 lat (usec): min=1310, max=242710, avg=44413.37, stdev=46232.42 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2114], 10.00th=[ 2933], 20.00th=[ 6194], | 30.00th=[ 10290], 40.00th=[ 18482], 50.00th=[ 30802], 60.00th=[ 40109], | 70.00th=[ 57410], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[143655], | 99.00th=[183501], 99.50th=[219153], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 63, max= 466, per=27.21%, avg=176.61, stdev=81.59, samples=72 iops : min= 3, max= 29, avg=10.22, stdev= 5.18, samples=72 lat (usec) : 50=0.52%, 100=2.47%, 250=0.39% lat (msec) : 2=1.95%, 4=5.86%, 10=8.33%, 20=8.33%, 50=32.81% lat (msec) : 100=30.08%, 250=9.24% cpu : usr=0.07%, sys=4.62%, ctx=1723, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179011: Fri Sep 4 12:53:35 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(6256KiB/36565msec) clat (usec): min=55, max=231630, avg=51986.23, stdev=36547.14 lat (usec): min=56, max=231631, avg=51992.93, stdev=36544.07 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 78], 10.00th=[ 17433], 20.00th=[ 26608], | 30.00th=[ 33424], 40.00th=[ 41157], 50.00th=[ 45876], 60.00th=[ 51643], | 70.00th=[ 61604], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[109577], | 99.00th=[212861], 99.50th=[219153], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 42, max= 380, per=27.93%, avg=172.32, stdev=76.33, samples=71 iops : min= 2, max= 23, avg= 9.94, stdev= 4.81, samples=71 write: IOPS=10, BW=165KiB/s (169kB/s)(6032KiB/36565msec); 0 zone resets clat (usec): min=1199, max=247638, avg=42138.99, stdev=42088.36 lat (usec): min=1201, max=247640, avg=42160.32, stdev=42072.63 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2114], 10.00th=[ 2769], 20.00th=[ 6259], | 30.00th=[ 10945], 40.00th=[ 20055], 50.00th=[ 31327], 60.00th=[ 40633], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[128451], | 99.00th=[191890], 99.50th=[217056], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 341, per=25.49%, avg=165.44, stdev=76.57, samples=70 iops : min= 1, max= 21, avg= 9.51, stdev= 4.84, samples=70 lat (usec) : 100=3.52%, 250=0.78%, 750=0.13% lat (msec) : 2=1.82%, 4=5.21%, 10=6.51%, 20=7.42%, 50=36.98% lat (msec) : 100=29.56%, 250=8.07% cpu : usr=0.08%, sys=4.88%, ctx=1677, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179013: Fri Sep 4 12:53:35 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(6032KiB/37255msec) clat (usec): min=49, max=262268, avg=51589.57, stdev=35405.99 lat (usec): min=51, max=262270, avg=51591.69, stdev=35406.63 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 77], 10.00th=[ 7111], 20.00th=[ 25822], | 30.00th=[ 32900], 40.00th=[ 40633], 50.00th=[ 46924], 60.00th=[ 54264], | 70.00th=[ 63177], 80.00th=[ 73925], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[164627], 99.50th=[231736], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 380, per=26.61%, avg=164.18, stdev=68.24, samples=71 iops : min= 1, max= 23, avg= 9.42, stdev= 4.30, samples=71 write: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37255msec); 0 zone resets clat (usec): min=1317, max=264291, avg=44352.64, stdev=45660.88 lat (usec): min=1320, max=264417, avg=44359.07, stdev=45675.17 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2474], 10.00th=[ 3851], 20.00th=[ 6915], | 30.00th=[ 12780], 40.00th=[ 20317], 50.00th=[ 30278], 60.00th=[ 40633], | 70.00th=[ 54264], 80.00th=[ 74974], 90.00th=[105382], 95.00th=[139461], | 99.00th=[217056], 99.50th=[263193], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 348, per=26.01%, avg=168.83, stdev=78.25, samples=72 iops : min= 1, max= 21, avg= 9.72, stdev= 4.93, samples=72 lat (usec) : 50=0.13%, 100=3.78%, 250=0.26%, 750=0.26% lat (msec) : 2=1.43%, 4=4.43%, 10=8.07%, 20=8.20%, 50=34.77% lat (msec) : 100=28.91%, 250=9.38%, 500=0.39% cpu : usr=0.09%, sys=4.64%, ctx=1705, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=617KiB/s (632kB/s), 153KiB/s-171KiB/s (156kB/s-175kB/s), io=23.4MiB (24.5MB), run=36565-38802msec WRITE: bw=649KiB/s (665kB/s), 164KiB/s-177KiB/s (168kB/s-182kB/s), io=24.6MiB (25.8MB), run=36565-38802msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179006: Fri Sep 4 12:53:47 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5920KiB/48989msec) clat (msec): min=6, max=330, avg=48.08, stdev=42.49 lat (msec): min=6, max=330, avg=48.08, stdev=42.49 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 102], 95.00th=[ 127], | 99.00th=[ 234], 99.50th=[ 266], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 349, per=25.65%, avg=122.09, stdev=73.61, samples=93 iops : min= 1, max= 21, avg= 6.83, stdev= 4.68, samples=93 write: IOPS=8, BW=130KiB/s (133kB/s)(6368KiB/48989msec); 0 zone resets clat (msec): min=17, max=349, avg=78.13, stdev=54.89 lat (msec): min=17, max=349, avg=78.14, stdev=54.89 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 74], | 70.00th=[ 90], 80.00th=[ 111], 90.00th=[ 148], 95.00th=[ 197], | 99.00th=[ 284], 99.50th=[ 342], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 319, per=25.68%, avg=128.66, stdev=72.25, samples=96 iops : min= 1, max= 19, avg= 7.23, stdev= 4.56, samples=96 lat (msec) : 10=0.52%, 20=7.55%, 50=46.35%, 100=27.99%, 250=16.02% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.49%, ctx=1059, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179008: Fri Sep 4 12:53:47 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5744KiB/50232msec) clat (msec): min=7, max=301, avg=53.34, stdev=50.92 lat (msec): min=7, max=301, avg=53.34, stdev=50.92 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 77], 90.00th=[ 130], 95.00th=[ 165], | 99.00th=[ 279], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 415, per=25.07%, avg=119.34, stdev=81.18, samples=94 iops : min= 1, max= 25, avg= 6.65, stdev= 5.14, samples=94 write: IOPS=8, BW=130KiB/s (133kB/s)(6544KiB/50232msec); 0 zone resets clat (msec): min=15, max=386, avg=75.24, stdev=54.82 lat (msec): min=15, max=386, avg=75.24, stdev=54.82 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 71], | 70.00th=[ 84], 80.00th=[ 110], 90.00th=[ 138], 95.00th=[ 180], | 99.00th=[ 279], 99.50th=[ 351], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 31, max= 351, per=26.05%, avg=130.52, stdev=79.55, samples=98 iops : min= 1, max= 21, avg= 7.36, stdev= 5.03, samples=98 lat (msec) : 10=0.52%, 20=8.98%, 50=44.53%, 100=26.17%, 250=17.97% lat (msec) : 500=1.82% cpu : usr=0.07%, sys=1.53%, ctx=1150, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179010: Fri Sep 4 12:53:47 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/50040msec) clat (msec): min=8, max=265, avg=51.58, stdev=45.63 lat (msec): min=8, max=265, avg=51.58, stdev=45.63 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 56], 80.00th=[ 72], 90.00th=[ 116], 95.00th=[ 150], | 99.00th=[ 226], 99.50th=[ 262], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 445, per=26.32%, avg=125.27, stdev=91.02, samples=97 iops : min= 1, max= 27, avg= 7.03, stdev= 5.76, samples=97 write: IOPS=7, BW=121KiB/s (123kB/s)(6032KiB/50040msec); 0 zone resets clat (msec): min=16, max=371, avg=78.39, stdev=57.72 lat (msec): min=16, max=371, avg=78.40, stdev=57.72 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 72], | 70.00th=[ 91], 80.00th=[ 112], 90.00th=[ 159], 95.00th=[ 201], | 99.00th=[ 292], 99.50th=[ 334], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 320, per=24.21%, avg=121.32, stdev=71.05, samples=95 iops : min= 1, max= 20, avg= 6.77, stdev= 4.54, samples=95 lat (msec) : 10=0.52%, 20=10.42%, 50=43.62%, 100=26.69%, 250=17.06% lat (msec) : 500=1.69% cpu : usr=0.06%, sys=1.58%, ctx=1179, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179012: Fri Sep 4 12:53:47 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49978msec) clat (msec): min=7, max=310, avg=53.66, stdev=49.15 lat (msec): min=7, max=310, avg=53.66, stdev=49.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 61], 80.00th=[ 80], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 234], 99.50th=[ 300], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 413, per=26.45%, avg=125.92, stdev=82.29, samples=92 iops : min= 1, max= 25, avg= 7.08, stdev= 5.20, samples=92 write: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/49978msec); 0 zone resets clat (msec): min=12, max=347, avg=75.02, stdev=51.07 lat (msec): min=12, max=347, avg=75.02, stdev=51.07 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 111], 90.00th=[ 146], 95.00th=[ 182], | 99.00th=[ 230], 99.50th=[ 317], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 383, per=25.36%, avg=127.07, stdev=77.73, samples=95 iops : min= 1, max= 23, avg= 7.14, stdev= 4.91, samples=95 lat (msec) : 10=1.69%, 20=9.64%, 50=42.32%, 100=26.82%, 250=18.88% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.37%, ctx=1129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=477KiB/s (488kB/s), 114KiB/s-125KiB/s (117kB/s-128kB/s), io=23.4MiB (24.5MB), run=48989-50232msec WRITE: bw=502KiB/s (514kB/s), 121KiB/s-130KiB/s (123kB/s-133kB/s), io=24.6MiB (25.8MB), run=48989-50232msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179029: Fri Sep 4 12:54:05 2026 read: IOPS=1, BW=1173KiB/s (1201kB/s)(7168KiB/6111msec) clat (msec): min=102, max=2783, avg=693.71, stdev=977.72 lat (msec): min=102, max=2783, avg=693.71, stdev=977.72 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 176], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 211], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 1062], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 2035, max= 4039, per=87.30%, avg=2441.80, stdev=892.88, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=0, BW=838KiB/s (858kB/s)(5120KiB/6111msec); 0 zone resets clat (msec): min=168, max=292, avg=226.41, stdev=45.06 lat (msec): min=168, max=293, avg=226.52, stdev=45.12 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2035, max= 4079, per=86.58%, avg=3389.67, stdev=1173.24, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.10%, sys=9.30%, ctx=802, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179031: Fri Sep 4 12:54:05 2026 read: IOPS=0, BW=280KiB/s (286kB/s)(2048KiB/7322msec) clat (usec): min=1096, max=280988, avg=141042.70, stdev=197913.13 lat (usec): min=1098, max=280991, avg=141045.19, stdev=197914.41 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1090], 10.00th=[ 1090], 20.00th=[ 1090], | 30.00th=[ 1090], 40.00th=[ 1090], 50.00th=[ 1090], 60.00th=[278922], | 70.00th=[278922], 80.00th=[278922], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1517, max= 2048, per=63.73%, avg=1782.50, stdev=375.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1399KiB/s (1432kB/s)(10.0MiB/7322msec); 0 zone resets clat (msec): min=149, max=2837, avg=675.46, stdev=831.99 lat (msec): min=149, max=2837, avg=675.56, stdev=832.00 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 165], | 30.00th=[ 207], 40.00th=[ 230], 50.00th=[ 239], 60.00th=[ 368], | 70.00th=[ 493], 80.00th=[ 927], 90.00th=[ 1133], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2011, max= 4047, per=77.26%, avg=3024.67, stdev=1088.33, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 2=8.33%, 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.98%, ctx=108, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179033: Fri Sep 4 12:54:05 2026 read: IOPS=1, BW=1069KiB/s (1095kB/s)(6144KiB/5746msec) clat (usec): min=469, max=207653, avg=36477.57, stdev=83930.25 lat (usec): min=470, max=207653, avg=36478.85, stdev=83929.88 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 529], 50.00th=[ 529], 60.00th=[ 553], | 70.00th=[ 9241], 80.00th=[ 9241], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 4063, max= 6107, per=100.00%, avg=5085.00, stdev=1445.33, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1069KiB/s (1095kB/s)(6144KiB/5746msec); 0 zone resets clat (msec): min=103, max=4037, avg=865.34, stdev=1555.59 lat (msec): min=103, max=4038, avg=865.41, stdev=1555.64 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 271], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 1499, max= 4071, per=61.62%, avg=2412.25, stdev=1134.83, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=16.67%, 750=16.67% lat (msec) : 10=8.33%, 250=25.00%, 500=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=5.10%, ctx=63, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179034: Fri Sep 4 12:54:05 2026 read: IOPS=0, BW=849KiB/s (870kB/s)(5120KiB/6029msec) clat (usec): min=500, max=227545, avg=47446.62, stdev=100703.41 lat (usec): min=501, max=227546, avg=47447.91, stdev=100702.93 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[ 2638], 60.00th=[ 2638], | 70.00th=[ 5997], 80.00th=[ 5997], 90.00th=[227541], 95.00th=[227541], | 99.00th=[227541], 99.50th=[227541], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 2035, max= 6095, per=100.00%, avg=4065.00, stdev=2870.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1189KiB/s (1217kB/s)(7168KiB/6029msec); 0 zone resets clat (msec): min=80, max=3784, avg=803.37, stdev=1323.78 lat (msec): min=81, max=3784, avg=803.49, stdev=1323.79 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 132], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 401], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 498], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 1488, max= 4071, per=64.45%, avg=2523.33, stdev=1365.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 10=8.33%, 100=8.33%, 250=16.67%, 500=33.33% lat (msec) : >=2000=8.33% cpu : usr=0.07%, sys=5.51%, ctx=109, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2797KiB/s (2864kB/s), 280KiB/s-1173KiB/s (286kB/s-1201kB/s), io=20.0MiB (20.0MB), run=5746-7322msec WRITE: bw=3916KiB/s (4010kB/s), 838KiB/s-1399KiB/s (858kB/s-1432kB/s), io=28.0MiB (29.4MB), run=5746-7322msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179027: Fri Sep 4 12:54:06 2026 read: IOPS=1, BW=1219KiB/s (1248kB/s)(7168KiB/5881msec) clat (msec): min=93, max=2888, avg=650.50, stdev=1022.92 lat (msec): min=93, max=2888, avg=650.50, stdev=1022.92 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 142], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 194], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 877], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1878, max= 4039, per=86.18%, avg=2385.60, stdev=927.17, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=871KiB/s (891kB/s)(5120KiB/5881msec); 0 zone resets clat (msec): min=200, max=382, avg=250.80, stdev=76.02 lat (msec): min=200, max=382, avg=250.91, stdev=76.00 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1924, max= 4039, per=68.91%, avg=2670.33, stdev=1186.92, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.13%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179028: Fri Sep 4 12:54:06 2026 read: IOPS=0, BW=284KiB/s (291kB/s)(2048KiB/7207msec) clat (msec): min=107, max=125, avg=116.74, stdev=12.84 lat (msec): min=107, max=125, avg=116.74, stdev=12.84 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 126], | 70.00th=[ 126], 80.00th=[ 126], 90.00th=[ 126], 95.00th=[ 126], | 99.00th=[ 126], 99.50th=[ 126], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 1514, max= 2035, per=64.11%, avg=1774.50, stdev=368.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1421KiB/s (1455kB/s)(10.0MiB/7207msec); 0 zone resets clat (msec): min=93, max=2868, avg=669.85, stdev=862.88 lat (msec): min=93, max=2868, avg=669.95, stdev=862.88 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 101], | 30.00th=[ 161], 40.00th=[ 218], 50.00th=[ 268], 60.00th=[ 380], | 70.00th=[ 435], 80.00th=[ 860], 90.00th=[ 1318], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 4023, max= 4079, per=100.00%, avg=4053.00, stdev=26.43, samples=4 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.55%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179030: Fri Sep 4 12:54:06 2026 read: IOPS=0, BW=846KiB/s (866kB/s)(6144KiB/7266msec) clat (msec): min=80, max=412, avg=189.26, stdev=122.11 lat (msec): min=80, max=412, avg=189.26, stdev=122.11 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 178], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1924, max= 4079, per=90.98%, avg=2518.25, stdev=1041.81, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=846KiB/s (866kB/s)(6144KiB/7266msec); 0 zone resets clat (msec): min=150, max=3959, avg=990.73, stdev=1465.44 lat (msec): min=150, max=3959, avg=990.82, stdev=1465.45 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 468], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 1367, max= 2039, per=49.03%, avg=1899.80, stdev=297.96, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.64%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179032: Fri Sep 4 12:54:06 2026 read: IOPS=0, BW=692KiB/s (709kB/s)(5120KiB/7398msec) clat (msec): min=46, max=240, avg=135.48, stdev=83.76 lat (msec): min=46, max=240, avg=135.48, stdev=83.76 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 47], | 30.00th=[ 77], 40.00th=[ 77], 50.00th=[ 109], 60.00th=[ 109], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 2035, max= 6119, per=100.00%, avg=4077.00, stdev=2887.82, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=969KiB/s (992kB/s)(7168KiB/7398msec); 0 zone resets clat (msec): min=128, max=5095, avg=952.72, stdev=1830.62 lat (msec): min=128, max=5095, avg=952.84, stdev=1830.60 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 130], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 279], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 447], 90.00th=[ 5067], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 1484, max= 4096, per=75.39%, avg=2921.50, stdev=1360.53, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.64%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2768KiB/s (2835kB/s), 284KiB/s-1219KiB/s (291kB/s-1248kB/s), io=20.0MiB (20.0MB), run=5881-7398msec WRITE: bw=3876KiB/s (3969kB/s), 846KiB/s-1421KiB/s (866kB/s-1455kB/s), io=28.0MiB (29.4MB), run=5881-7398msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179042: Fri Sep 4 12:54:19 2026 read: IOPS=1, BW=7002KiB/s (7170kB/s)(12.0MiB/1755msec) clat (msec): min=448, max=607, avg=550.37, stdev=88.14 lat (msec): min=448, max=607, avg=550.37, stdev=88.14 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=19.03%, ctx=500, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179043: Fri Sep 4 12:54:19 2026 read: IOPS=0, BW=1967KiB/s (2015kB/s)(4096KiB/2082msec) clat (nsec): min=636560k, max=636560k, avg=636560115.00, stdev= 0.00 lat (nsec): min=636563k, max=636563k, avg=636563405.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3935KiB/s (4029kB/s)(8192KiB/2082msec); 0 zone resets clat (msec): min=260, max=1117, avg=688.99, stdev=606.13 lat (msec): min=261, max=1118, avg=689.78, stdev=606.34 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8175, max= 8175, per=56.41%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.58%, ctx=376, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179045: Fri Sep 4 12:54:19 2026 write: IOPS=1, BW=5435KiB/s (5565kB/s)(12.0MiB/2261msec); 0 zone resets clat (msec): min=467, max=926, avg=716.41, stdev=232.15 lat (msec): min=467, max=927, avg=717.03, stdev=232.17 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7801, max= 8175, per=55.12%, avg=7988.00, stdev=264.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=7.96%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179046: Fri Sep 4 12:54:19 2026 write: IOPS=1, BW=6653KiB/s (6813kB/s)(12.0MiB/1847msec); 0 zone resets clat (msec): min=217, max=1308, avg=589.61, stdev=622.38 lat (msec): min=218, max=1308, avg=589.91, stdev=622.39 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min=13044, max=13044, per=90.01%, avg=13044.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.66%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7869KiB/s (8058kB/s), 1967KiB/s-7002KiB/s (2015kB/s-7170kB/s), io=16.0MiB (16.8MB), run=1755-2082msec WRITE: bw=14.2MiB/s (14.8MB/s), 3935KiB/s-6653KiB/s (4029kB/s-6813kB/s), io=32.0MiB (33.6MB), run=1847-2261msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179044: Fri Sep 4 12:54:19 2026 read: IOPS=1, BW=4907KiB/s (5025kB/s)(12.0MiB/2504msec) clat (msec): min=235, max=1217, avg=819.32, stdev=516.93 lat (msec): min=235, max=1217, avg=819.32, stdev=516.93 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.00%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179047: Fri Sep 4 12:54:19 2026 read: IOPS=0, BW=2992KiB/s (3064kB/s)(4096KiB/1369msec) clat (nsec): min=247813k, max=247813k, avg=247813032.00, stdev= 0.00 lat (nsec): min=247816k, max=247816k, avg=247815795.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 5801, max= 5801, per=88.66%, avg=5801.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5984KiB/s (6128kB/s)(8192KiB/1369msec); 0 zone resets clat (msec): min=422, max=581, avg=502.07, stdev=112.10 lat (msec): min=423, max=581, avg=502.44, stdev=112.10 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8094, max= 8094, per=66.82%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=10.96%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179048: Fri Sep 4 12:54:19 2026 write: IOPS=1, BW=4543KiB/s (4652kB/s)(12.0MiB/2705msec); 0 zone resets clat (msec): min=238, max=1178, avg=861.89, stdev=540.06 lat (msec): min=238, max=1179, avg=862.34, stdev=540.03 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7772, max= 7772, per=64.16%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.07%, sys=4.22%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179049: Fri Sep 4 12:54:19 2026 write: IOPS=1, BW=6077KiB/s (6223kB/s)(12.0MiB/2022msec); 0 zone resets clat (msec): min=167, max=1461, avg=626.11, stdev=724.46 lat (msec): min=168, max=1461, avg=626.89, stdev=724.23 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8031, max= 8094, per=66.56%, avg=8062.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.89%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6543KiB/s (6700kB/s), 2992KiB/s-4907KiB/s (3064kB/s-5025kB/s), io=16.0MiB (16.8MB), run=1369-2504msec WRITE: bw=11.8MiB/s (12.4MB/s), 4543KiB/s-6077KiB/s (4652kB/s-6223kB/s), io=32.0MiB (33.6MB), run=1369-2705msec