== sanity test 398b: DIO and buffer IO race ============== 10:04:51 (1773237891) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.90423 s, 17.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156387: Wed Mar 11 10:06:06 2026 read: IOPS=22, BW=91.0KiB/s (94.2kB/s)(5992KiB/65157msec) clat (usec): min=88, max=605061, avg=23609.80, stdev=19137.67 lat (usec): min=88, max=605062, avg=23611.16, stdev=19137.60 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 8586], 10.00th=[ 10421], 20.00th=[ 13435], | 30.00th=[ 16319], 40.00th=[ 18744], 50.00th=[ 21365], 60.00th=[ 24511], | 70.00th=[ 27919], 80.00th=[ 31589], 90.00th=[ 38011], 95.00th=[ 44303], | 99.00th=[ 63177], 99.50th=[ 74974], 99.90th=[ 92799], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 6, max= 200, per=24.68%, avg=90.82, stdev=27.60, samples=129 iops : min= 1, max= 50, avg=22.23, stdev= 6.98, samples=129 write: IOPS=24, BW=96.6KiB/s (98.9kB/s)(6296KiB/65157msec); 0 zone resets clat (usec): min=665, max=94694, avg=18783.88, stdev=14202.24 lat (usec): min=667, max=94695, avg=18784.69, stdev=14202.28 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2671], 10.00th=[ 3589], 20.00th=[ 5735], | 30.00th=[ 8455], 40.00th=[12518], 50.00th=[16581], 60.00th=[19530], | 70.00th=[23462], 80.00th=[29754], 90.00th=[38536], 95.00th=[45876], | 99.00th=[65274], 99.50th=[72877], 99.90th=[84411], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 39, max= 215, per=24.88%, avg=95.79, stdev=32.29, samples=128 iops : min= 9, max= 53, avg=23.48, stdev= 8.08, samples=128 lat (usec) : 100=0.03%, 250=0.10%, 500=0.13%, 750=0.49%, 1000=0.52% lat (msec) : 2=0.85%, 4=4.92%, 10=14.32%, 20=32.06%, 50=43.59% lat (msec) : 100=2.96%, 750=0.03% cpu : usr=0.07%, sys=26.74%, ctx=9798, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156388: Wed Mar 11 10:06:06 2026 read: IOPS=22, BW=91.5KiB/s (93.7kB/s)(5940KiB/64888msec) clat (usec): min=84, max=72328, avg=23468.20, stdev=11670.81 lat (usec): min=84, max=72328, avg=23468.90, stdev=11670.89 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 8717], 10.00th=[11076], 20.00th=[13829], | 30.00th=[16450], 40.00th=[18744], 50.00th=[21627], 60.00th=[24511], | 70.00th=[27919], 80.00th=[32375], 90.00th=[39060], 95.00th=[44303], | 99.00th=[62129], 99.50th=[65799], 99.90th=[70779], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 6, max= 208, per=24.78%, avg=91.19, stdev=28.30, samples=129 iops : min= 1, max= 52, avg=22.33, stdev= 7.15, samples=129 write: IOPS=24, BW=97.8KiB/s (100kB/s)(6348KiB/64888msec); 0 zone resets clat (usec): min=657, max=608133, avg=18780.83, stdev=20398.16 lat (usec): min=658, max=608134, avg=18781.99, stdev=20398.53 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 2638], 10.00th=[ 3523], 20.00th=[ 5538], | 30.00th=[ 8094], 40.00th=[ 12125], 50.00th=[ 15926], 60.00th=[ 19268], | 70.00th=[ 23200], 80.00th=[ 29754], 90.00th=[ 38536], 95.00th=[ 45876], | 99.00th=[ 60031], 99.50th=[ 69731], 99.90th=[112722], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 47, max= 264, per=25.44%, avg=97.96, stdev=35.98, samples=128 iops : min= 11, max= 66, avg=24.02, stdev= 9.02, samples=128 lat (usec) : 100=0.07%, 250=0.03%, 500=0.29%, 750=0.36%, 1000=0.68% lat (msec) : 2=0.88%, 4=4.82%, 10=14.49%, 20=31.93%, 50=43.65% lat (msec) : 100=2.73%, 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=26.71%, ctx=9685, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156389: Wed Mar 11 10:06:06 2026 read: IOPS=23, BW=93.3KiB/s (95.5kB/s)(6028KiB/64619msec) clat (usec): min=144, max=100220, avg=22985.03, stdev=11769.86 lat (usec): min=144, max=100221, avg=22985.81, stdev=11769.90 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 8160], 10.00th=[ 10421], 20.00th=[ 13042], | 30.00th=[ 15926], 40.00th=[ 18220], 50.00th=[ 20841], 60.00th=[ 23987], | 70.00th=[ 28181], 80.00th=[ 32113], 90.00th=[ 38011], 95.00th=[ 44303], | 99.00th=[ 57934], 99.50th=[ 66847], 99.90th=[ 73925], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 23, max= 191, per=25.41%, avg=93.52, stdev=29.67, samples=127 iops : min= 5, max= 47, avg=22.91, stdev= 7.49, samples=127 write: IOPS=24, BW=96.9KiB/s (99.2kB/s)(6260KiB/64619msec); 0 zone resets clat (usec): min=722, max=600501, avg=19011.32, stdev=20082.83 lat (usec): min=723, max=600503, avg=19012.75, stdev=20083.17 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2737], 10.00th=[ 3785], 20.00th=[ 5800], | 30.00th=[ 8979], 40.00th=[ 12780], 50.00th=[ 16450], 60.00th=[ 19530], | 70.00th=[ 23462], 80.00th=[ 29492], 90.00th=[ 37487], 95.00th=[ 43779], | 99.00th=[ 59507], 99.50th=[ 68682], 99.90th=[120062], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 39, max= 208, per=25.21%, avg=97.04, stdev=29.42, samples=127 iops : min= 9, max= 52, avg=23.79, stdev= 7.39, samples=127 lat (usec) : 250=0.07%, 500=0.26%, 750=0.55%, 1000=0.68% lat (msec) : 2=0.85%, 4=4.36%, 10=13.70%, 20=33.43%, 50=43.29% lat (msec) : 100=2.70%, 250=0.07%, 750=0.03% cpu : usr=0.09%, sys=27.12%, ctx=9836, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156390: Wed Mar 11 10:06:06 2026 read: IOPS=23, BW=93.4KiB/s (95.6kB/s)(6052KiB/64819msec) clat (usec): min=160, max=579686, avg=23479.77, stdev=18701.32 lat (usec): min=161, max=579688, avg=23480.46, stdev=18701.36 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 8029], 10.00th=[ 10683], 20.00th=[ 13566], | 30.00th=[ 15795], 40.00th=[ 18220], 50.00th=[ 21103], 60.00th=[ 24511], | 70.00th=[ 28181], 80.00th=[ 32637], 90.00th=[ 38536], 95.00th=[ 44303], | 99.00th=[ 58459], 99.50th=[ 79168], 99.90th=[102237], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 6, max= 200, per=25.32%, avg=93.17, stdev=28.53, samples=129 iops : min= 1, max= 50, avg=22.82, stdev= 7.20, samples=129 write: IOPS=24, BW=96.2KiB/s (98.5kB/s)(6236KiB/64819msec); 0 zone resets clat (usec): min=711, max=97519, avg=18654.40, stdev=13709.00 lat (usec): min=712, max=97520, avg=18655.70, stdev=13709.07 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2769], 10.00th=[ 3654], 20.00th=[ 5735], | 30.00th=[ 8717], 40.00th=[12911], 50.00th=[16319], 60.00th=[19530], | 70.00th=[23200], 80.00th=[29230], 90.00th=[38011], 95.00th=[44827], | 99.00th=[61604], 99.50th=[66323], 99.90th=[71828], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 26, max= 240, per=24.91%, avg=95.92, stdev=32.84, samples=129 iops : min= 6, max= 60, avg=23.51, stdev= 8.25, samples=129 lat (usec) : 250=0.07%, 500=0.36%, 750=0.72%, 1000=0.52% lat (msec) : 2=1.04%, 4=4.30%, 10=13.77%, 20=33.14%, 50=43.65% lat (msec) : 100=2.38%, 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=26.73%, ctx=9893, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=369KiB/s (377kB/s), 91.5KiB/s-93.4KiB/s (93.7kB/s-95.6kB/s), io=23.4MiB (24.6MB), run=64619-65157msec WRITE: bw=386KiB/s (395kB/s), 96.2KiB/s-97.8KiB/s (98.5kB/s-100kB/s), io=24.6MiB (25.7MB), run=64619-65157msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156391: Wed Mar 11 10:06:12 2026 read: IOPS=20, BW=83.9KiB/s (85.9kB/s)(5992KiB/71443msec) clat (msec): min=2, max=610, avg=21.17, stdev=22.42 lat (msec): min=2, max=610, avg=21.17, stdev=22.42 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 45], 95.00th=[ 55], | 99.00th=[ 82], 99.50th=[ 85], 99.90th=[ 128], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 23, max= 328, per=25.05%, avg=83.93, stdev=62.51, samples=141 iops : min= 5, max= 82, avg=20.57, stdev=15.75, samples=141 write: IOPS=22, BW=88.1KiB/s (90.2kB/s)(6296KiB/71443msec); 0 zone resets clat (msec): min=4, max=134, avg=25.13, stdev=17.61 lat (msec): min=4, max=134, avg=25.13, stdev=17.61 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 79], 99.50th=[ 86], 99.90th=[ 104], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 23, max= 328, per=25.16%, avg=88.30, stdev=64.39, samples=141 iops : min= 5, max= 82, avg=21.67, stdev=16.23, samples=141 lat (msec) : 4=0.52%, 10=27.67%, 20=27.28%, 50=36.20%, 100=8.20% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.08%, sys=12.99%, ctx=6151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156392: Wed Mar 11 10:06:12 2026 read: IOPS=20, BW=83.1KiB/s (85.1kB/s)(5940KiB/71485msec) clat (msec): min=2, max=589, avg=20.79, stdev=21.65 lat (msec): min=2, max=589, avg=20.79, stdev=21.65 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 43], 95.00th=[ 54], | 99.00th=[ 78], 99.50th=[ 84], 99.90th=[ 101], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 15, max= 376, per=24.80%, avg=83.08, stdev=64.03, samples=141 iops : min= 3, max= 94, avg=20.36, stdev=16.12, samples=141 write: IOPS=22, BW=88.8KiB/s (90.9kB/s)(6348KiB/71485msec); 0 zone resets clat (msec): min=3, max=120, avg=25.47, stdev=18.27 lat (msec): min=3, max=120, avg=25.47, stdev=18.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 85], 99.50th=[ 95], 99.90th=[ 120], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 23, max= 328, per=25.22%, avg=88.53, stdev=63.37, samples=141 iops : min= 5, max= 82, avg=21.72, stdev=15.97, samples=141 lat (msec) : 4=0.78%, 10=27.83%, 20=26.01%, 50=36.91%, 100=8.30% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.08%, sys=12.96%, ctx=6160, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156393: Wed Mar 11 10:06:12 2026 read: IOPS=21, BW=84.5KiB/s (86.5kB/s)(6028KiB/71359msec) clat (msec): min=2, max=100, avg=20.43, stdev=15.59 lat (msec): min=2, max=100, avg=20.43, stdev=15.59 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 43], 95.00th=[ 53], | 99.00th=[ 70], 99.50th=[ 79], 99.90th=[ 92], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 24, max= 320, per=25.36%, avg=84.96, stdev=64.33, samples=141 iops : min= 6, max= 80, avg=20.83, stdev=16.20, samples=141 write: IOPS=21, BW=87.7KiB/s (89.8kB/s)(6260KiB/71359msec); 0 zone resets clat (msec): min=4, max=592, avg=25.80, stdev=22.80 lat (msec): min=4, max=592, avg=25.80, stdev=22.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 60], | 99.00th=[ 82], 99.50th=[ 95], 99.90th=[ 134], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 31, max= 336, per=25.12%, avg=88.18, stdev=61.98, samples=141 iops : min= 7, max= 84, avg=21.64, stdev=15.62, samples=141 lat (msec) : 4=0.72%, 10=26.95%, 20=27.44%, 50=36.98%, 100=7.68% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.09%, sys=13.02%, ctx=6111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156394: Wed Mar 11 10:06:12 2026 read: IOPS=21, BW=84.7KiB/s (86.7kB/s)(6052KiB/71459msec) clat (msec): min=2, max=123, avg=20.62, stdev=16.19 lat (msec): min=2, max=123, avg=20.62, stdev=16.19 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 75], 99.50th=[ 88], 99.90th=[ 117], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 15, max= 352, per=25.27%, avg=84.66, stdev=62.96, samples=141 iops : min= 3, max= 88, avg=20.76, stdev=15.85, samples=141 write: IOPS=21, BW=87.3KiB/s (89.4kB/s)(6236KiB/71459msec); 0 zone resets clat (msec): min=3, max=588, avg=25.71, stdev=22.70 lat (msec): min=3, max=588, avg=25.71, stdev=22.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 51], 95.00th=[ 59], | 99.00th=[ 82], 99.50th=[ 93], 99.90th=[ 109], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 23, max= 328, per=24.85%, avg=87.23, stdev=64.07, samples=141 iops : min= 5, max= 82, avg=21.40, stdev=16.14, samples=141 lat (msec) : 4=0.81%, 10=27.25%, 20=26.66%, 50=37.14%, 100=7.94% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.09%, sys=13.00%, ctx=6134, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=336KiB/s (344kB/s), 83.1KiB/s-84.7KiB/s (85.1kB/s-86.7kB/s), io=23.4MiB (24.6MB), run=71359-71485msec WRITE: bw=352KiB/s (360kB/s), 87.3KiB/s-88.8KiB/s (89.4kB/s-90.9kB/s), io=24.6MiB (25.7MB), run=71359-71485msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156415: Wed Mar 11 10:06:33 2026 read: IOPS=24, BW=398KiB/s (408kB/s)(5920KiB/14874msec) clat (usec): min=142, max=68566, avg=20473.37, stdev=11182.70 lat (usec): min=142, max=68567, avg=20473.93, stdev=11182.71 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 685], 10.00th=[10290], 20.00th=[12256], | 30.00th=[14222], 40.00th=[16581], 50.00th=[18482], 60.00th=[21103], | 70.00th=[23987], 80.00th=[27395], 90.00th=[34341], 95.00th=[38011], | 99.00th=[58459], 99.50th=[63177], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 253, max= 731, per=24.46%, avg=393.76, stdev=103.94, samples=29 iops : min= 15, max= 45, avg=24.14, stdev= 6.51, samples=29 write: IOPS=26, BW=428KiB/s (438kB/s)(6368KiB/14874msec); 0 zone resets clat (usec): min=1121, max=69775, avg=18278.00, stdev=12052.34 lat (usec): min=1123, max=69776, avg=18282.43, stdev=12051.68 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 4555], 10.00th=[ 5407], 20.00th=[ 8455], | 30.00th=[10683], 40.00th=[12911], 50.00th=[14877], 60.00th=[18220], | 70.00th=[21890], 80.00th=[27657], 90.00th=[35390], 95.00th=[40633], | 99.00th=[58459], 99.50th=[68682], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 223, max= 606, per=25.23%, avg=427.41, stdev=90.94, samples=29 iops : min= 13, max= 37, avg=26.24, stdev= 5.80, samples=29 lat (usec) : 250=0.13%, 500=1.30%, 750=1.04% lat (msec) : 2=0.65%, 4=1.04%, 10=14.71%, 20=41.80%, 50=36.98% lat (msec) : 100=2.34% cpu : usr=0.10%, sys=28.99%, ctx=2891, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156417: Wed Mar 11 10:06:33 2026 read: IOPS=25, BW=401KiB/s (410kB/s)(5744KiB/14338msec) clat (usec): min=235, max=76680, avg=19892.51, stdev=10561.33 lat (usec): min=235, max=76680, avg=19893.08, stdev=10561.38 clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 1037], 10.00th=[10290], 20.00th=[11994], | 30.00th=[14091], 40.00th=[16319], 50.00th=[17957], 60.00th=[20841], | 70.00th=[22938], 80.00th=[26084], 90.00th=[33162], 95.00th=[39584], | 99.00th=[53216], 99.50th=[67634], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 192, max= 670, per=24.91%, avg=401.04, stdev=108.25, samples=28 iops : min= 12, max= 41, avg=24.57, stdev= 6.87, samples=28 write: IOPS=28, BW=456KiB/s (467kB/s)(6544KiB/14338msec); 0 zone resets clat (usec): min=1037, max=54090, avg=17350.46, stdev=11416.07 lat (usec): min=1038, max=54091, avg=17351.72, stdev=11416.05 clat percentiles (usec): | 1.00th=[ 3163], 5.00th=[ 4293], 10.00th=[ 4883], 20.00th=[ 6587], | 30.00th=[ 9372], 40.00th=[12125], 50.00th=[14484], 60.00th=[17695], | 70.00th=[22414], 80.00th=[26870], 90.00th=[34341], 95.00th=[41157], | 99.00th=[46924], 99.50th=[51119], 99.90th=[54264], 99.95th=[54264], | 99.99th=[54264] bw ( KiB/s): min= 253, max= 731, per=26.93%, avg=456.25, stdev=114.30, samples=28 iops : min= 15, max= 45, avg=28.04, stdev= 7.21, samples=28 lat (usec) : 250=0.26%, 500=1.30%, 750=0.65% lat (msec) : 2=0.39%, 4=2.08%, 10=17.06%, 20=39.45%, 50=37.63% lat (msec) : 100=1.17% cpu : usr=0.08%, sys=29.18%, ctx=2823, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156418: Wed Mar 11 10:06:33 2026 read: IOPS=27, BW=433KiB/s (444kB/s)(6256KiB/14437msec) clat (usec): min=249, max=64181, avg=19818.01, stdev=10257.89 lat (usec): min=249, max=64182, avg=19818.61, stdev=10257.92 clat percentiles (usec): | 1.00th=[ 330], 5.00th=[ 586], 10.00th=[ 9896], 20.00th=[12256], | 30.00th=[14484], 40.00th=[16319], 50.00th=[18220], 60.00th=[20579], | 70.00th=[23200], 80.00th=[26608], 90.00th=[33817], 95.00th=[40109], | 99.00th=[50594], 99.50th=[53216], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 254, max= 640, per=26.98%, avg=434.39, stdev=95.42, samples=28 iops : min= 15, max= 40, avg=26.64, stdev= 6.16, samples=28 write: IOPS=26, BW=418KiB/s (428kB/s)(6032KiB/14437msec); 0 zone resets clat (usec): min=1141, max=87530, avg=17624.66, stdev=11989.51 lat (usec): min=1142, max=87531, avg=17625.79, stdev=11989.53 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 4490], 10.00th=[ 4948], 20.00th=[ 7046], | 30.00th=[ 9765], 40.00th=[11994], 50.00th=[14877], 60.00th=[17695], | 70.00th=[21627], 80.00th=[25822], 90.00th=[34341], 95.00th=[41157], | 99.00th=[54264], 99.50th=[59507], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 192, max= 672, per=24.29%, avg=411.39, stdev=122.38, samples=28 iops : min= 12, max= 42, avg=25.21, stdev= 7.69, samples=28 lat (usec) : 250=0.13%, 500=2.08%, 750=0.39% lat (msec) : 2=0.78%, 4=0.78%, 10=16.54%, 20=40.36%, 50=37.50% lat (msec) : 100=1.43% cpu : usr=0.07%, sys=28.57%, ctx=2853, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156419: Wed Mar 11 10:06:33 2026 read: IOPS=26, BW=425KiB/s (435kB/s)(6032KiB/14192msec) clat (usec): min=246, max=83044, avg=19249.77, stdev=11768.09 lat (usec): min=246, max=83046, avg=19250.34, stdev=11768.12 clat percentiles (usec): | 1.00th=[ 293], 5.00th=[ 429], 10.00th=[ 6652], 20.00th=[10945], | 30.00th=[13566], 40.00th=[15139], 50.00th=[17695], 60.00th=[20579], | 70.00th=[23200], 80.00th=[26608], 90.00th=[33817], 95.00th=[39584], | 99.00th=[53216], 99.50th=[78119], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 223, max= 702, per=26.44%, avg=425.64, stdev=113.93, samples=28 iops : min= 13, max= 43, avg=26.11, stdev= 7.17, samples=28 write: IOPS=27, BW=441KiB/s (451kB/s)(6256KiB/14192msec); 0 zone resets clat (usec): min=1274, max=80075, avg=17538.67, stdev=12308.90 lat (usec): min=1274, max=80077, avg=17539.79, stdev=12309.00 clat percentiles (usec): | 1.00th=[ 2311], 5.00th=[ 4293], 10.00th=[ 5080], 20.00th=[ 6783], | 30.00th=[ 9503], 40.00th=[12518], 50.00th=[14484], 60.00th=[17171], | 70.00th=[20841], 80.00th=[26608], 90.00th=[33424], 95.00th=[41157], | 99.00th=[60031], 99.50th=[69731], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 224, max= 640, per=26.10%, avg=442.14, stdev=110.50, samples=28 iops : min= 14, max= 40, avg=27.14, stdev= 7.00, samples=28 lat (usec) : 250=0.13%, 500=3.52%, 750=0.65%, 1000=0.26% lat (msec) : 2=0.26%, 4=1.69%, 10=17.84%, 20=37.76%, 50=35.68% lat (msec) : 100=2.21% cpu : usr=0.10%, sys=28.29%, ctx=2711, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1610KiB/s (1649kB/s), 398KiB/s-433KiB/s (408kB/s-444kB/s), io=23.4MiB (24.5MB), run=14192-14874msec WRITE: bw=1694KiB/s (1735kB/s), 418KiB/s-456KiB/s (428kB/s-467kB/s), io=24.6MiB (25.8MB), run=14192-14874msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156420: Wed Mar 11 10:06:35 2026 read: IOPS=21, BW=347KiB/s (355kB/s)(5920KiB/17075msec) clat (usec): min=3541, max=85551, avg=20045.46, stdev=14589.72 lat (usec): min=3541, max=85551, avg=20046.26, stdev=14589.72 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 6259], 10.00th=[ 7635], 20.00th=[ 9765], | 30.00th=[11207], 40.00th=[13042], 50.00th=[14484], 60.00th=[16909], | 70.00th=[22152], 80.00th=[27919], 90.00th=[42206], 95.00th=[51643], | 99.00th=[73925], 99.50th=[78119], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 128, max= 800, per=24.20%, avg=338.30, stdev=152.99, samples=33 iops : min= 8, max= 50, avg=20.73, stdev= 9.68, samples=33 write: IOPS=23, BW=373KiB/s (382kB/s)(6368KiB/17075msec); 0 zone resets clat (msec): min=4, max=101, avg=23.99, stdev=15.06 lat (msec): min=4, max=101, avg=24.00, stdev=15.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 54], | 99.00th=[ 81], 99.50th=[ 94], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 127, max= 960, per=25.22%, avg=370.67, stdev=169.85, samples=33 iops : min= 7, max= 60, avg=22.73, stdev=10.80, samples=33 lat (msec) : 4=0.26%, 10=15.89%, 20=41.80%, 50=36.46%, 100=5.47% lat (msec) : 250=0.13% cpu : usr=0.11%, sys=12.94%, ctx=1535, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156421: Wed Mar 11 10:06:35 2026 read: IOPS=20, BW=335KiB/s (344kB/s)(5744KiB/17122msec) clat (usec): min=2876, max=73587, avg=19680.46, stdev=13317.56 lat (usec): min=2877, max=73587, avg=19681.30, stdev=13317.57 clat percentiles (usec): | 1.00th=[ 3523], 5.00th=[ 6128], 10.00th=[ 7701], 20.00th=[ 9896], | 30.00th=[11600], 40.00th=[13173], 50.00th=[14484], 60.00th=[17433], | 70.00th=[22414], 80.00th=[29230], 90.00th=[39060], 95.00th=[47449], | 99.00th=[62653], 99.50th=[69731], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 128, max= 800, per=23.78%, avg=332.42, stdev=138.26, samples=33 iops : min= 8, max= 50, avg=20.36, stdev= 8.73, samples=33 write: IOPS=23, BW=382KiB/s (391kB/s)(6544KiB/17122msec); 0 zone resets clat (msec): min=4, max=100, avg=24.53, stdev=16.27 lat (msec): min=4, max=100, avg=24.54, stdev=16.27 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 49], 95.00th=[ 58], | 99.00th=[ 79], 99.50th=[ 88], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 159, max= 1184, per=25.37%, avg=372.91, stdev=197.74, samples=33 iops : min= 9, max= 74, avg=22.88, stdev=12.54, samples=33 lat (msec) : 4=0.65%, 10=16.02%, 20=41.80%, 50=34.64%, 100=6.77% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=12.59%, ctx=1435, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156422: Wed Mar 11 10:06:35 2026 read: IOPS=22, BW=367KiB/s (376kB/s)(6256KiB/17043msec) clat (usec): min=3178, max=86211, avg=19855.13, stdev=14453.64 lat (usec): min=3179, max=86212, avg=19855.92, stdev=14453.61 clat percentiles (usec): | 1.00th=[ 5342], 5.00th=[ 6259], 10.00th=[ 7308], 20.00th=[ 9503], | 30.00th=[11600], 40.00th=[13304], 50.00th=[14877], 60.00th=[16450], | 70.00th=[20317], 80.00th=[29230], 90.00th=[42730], 95.00th=[50594], | 99.00th=[70779], 99.50th=[78119], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 159, max= 1152, per=26.16%, avg=365.70, stdev=205.88, samples=33 iops : min= 9, max= 72, avg=22.42, stdev=13.00, samples=33 write: IOPS=22, BW=354KiB/s (362kB/s)(6032KiB/17043msec); 0 zone resets clat (usec): min=5882, max=90755, avg=24444.07, stdev=15264.49 lat (usec): min=5883, max=90757, avg=24445.57, stdev=15264.49 clat percentiles (usec): | 1.00th=[ 6325], 5.00th=[ 7963], 10.00th=[ 9241], 20.00th=[11994], | 30.00th=[14353], 40.00th=[16712], 50.00th=[20055], 60.00th=[23200], | 70.00th=[28705], 80.00th=[35914], 90.00th=[47973], 95.00th=[55837], | 99.00th=[73925], 99.50th=[83362], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 128, max= 896, per=23.63%, avg=347.36, stdev=159.75, samples=33 iops : min= 8, max= 56, avg=21.27, stdev=10.10, samples=33 lat (msec) : 4=0.13%, 10=17.58%, 20=42.06%, 50=32.94%, 100=7.29% cpu : usr=0.05%, sys=12.83%, ctx=1504, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156423: Wed Mar 11 10:06:35 2026 read: IOPS=22, BW=352KiB/s (361kB/s)(6032KiB/17132msec) clat (usec): min=2760, max=76096, avg=20166.89, stdev=14324.21 lat (usec): min=2761, max=76096, avg=20167.67, stdev=14324.22 clat percentiles (usec): | 1.00th=[ 3458], 5.00th=[ 6128], 10.00th=[ 7242], 20.00th=[ 9503], | 30.00th=[11207], 40.00th=[12518], 50.00th=[15270], 60.00th=[17957], | 70.00th=[22938], 80.00th=[29754], 90.00th=[42206], 95.00th=[50070], | 99.00th=[69731], 99.50th=[70779], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 127, max= 960, per=24.54%, avg=343.06, stdev=176.24, samples=33 iops : min= 7, max= 60, avg=21.03, stdev=11.16, samples=33 write: IOPS=22, BW=365KiB/s (374kB/s)(6256KiB/17132msec); 0 zone resets clat (usec): min=3768, max=94621, avg=24118.65, stdev=15505.92 lat (usec): min=3769, max=94623, avg=24120.09, stdev=15505.96 clat percentiles (usec): | 1.00th=[ 6063], 5.00th=[ 8455], 10.00th=[ 9110], 20.00th=[11600], | 30.00th=[13829], 40.00th=[16188], 50.00th=[19792], 60.00th=[22938], | 70.00th=[28181], 80.00th=[35390], 90.00th=[45876], 95.00th=[54789], | 99.00th=[81265], 99.50th=[91751], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 96, max= 800, per=24.29%, avg=357.00, stdev=160.41, samples=33 iops : min= 6, max= 50, avg=21.88, stdev=10.10, samples=33 lat (msec) : 4=0.78%, 10=16.80%, 20=39.97%, 50=36.07%, 100=6.38% cpu : usr=0.11%, sys=12.52%, ctx=1508, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1398KiB/s (1432kB/s), 335KiB/s-367KiB/s (344kB/s-376kB/s), io=23.4MiB (24.5MB), run=17043-17132msec WRITE: bw=1471KiB/s (1506kB/s), 354KiB/s-382KiB/s (362kB/s-391kB/s), io=24.6MiB (25.8MB), run=17043-17132msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156431: Wed Mar 11 10:06:45 2026 read: IOPS=1, BW=1878KiB/s (1923kB/s)(7168KiB/3817msec) clat (msec): min=50, max=1182, avg=269.50, stdev=420.61 lat (msec): min=50, max=1182, avg=269.50, stdev=420.61 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 54], | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 68], 60.00th=[ 84], | 70.00th=[ 84], 80.00th=[ 388], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1703, max= 4096, per=64.16%, avg=3248.33, stdev=1340.40, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1341KiB/s (1374kB/s)(5120KiB/3817msec); 0 zone resets clat (msec): min=67, max=821, avg=370.50, stdev=297.24 lat (msec): min=67, max=822, avg=370.56, stdev=297.24 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2000, max= 6144, per=57.45%, avg=4072.00, stdev=2930.25, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 100=50.00%, 250=8.33%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=16.25%, ctx=232, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156432: Wed Mar 11 10:06:45 2026 read: IOPS=0, BW=513KiB/s (525kB/s)(2048KiB/3994msec) clat (msec): min=71, max=125, avg=98.49, stdev=38.26 lat (msec): min=71, max=125, avg=98.50, stdev=38.26 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 72], 60.00th=[ 126], | 70.00th=[ 126], 80.00th=[ 126], 90.00th=[ 126], 95.00th=[ 126], | 99.00th=[ 126], 99.50th=[ 126], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 1700, max= 2000, per=36.54%, avg=1850.00, stdev=212.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2564KiB/s (2625kB/s)(10.0MiB/3994msec); 0 zone resets clat (msec): min=43, max=1123, avg=373.18, stdev=406.18 lat (msec): min=43, max=1123, avg=373.23, stdev=406.18 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 97], | 30.00th=[ 102], 40.00th=[ 136], 50.00th=[ 171], 60.00th=[ 201], | 70.00th=[ 376], 80.00th=[ 380], 90.00th=[ 1099], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1700, max= 6144, per=49.17%, avg=3485.00, stdev=2068.42, samples=4 iops : min= 1, max= 6, avg= 3.00, stdev= 2.45, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=16.67%, 2000=16.67% cpu : usr=0.00%, sys=12.45%, ctx=119, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156433: Wed Mar 11 10:06:45 2026 read: IOPS=1, BW=1519KiB/s (1555kB/s)(6144KiB/4045msec) clat (msec): min=38, max=344, avg=185.24, stdev=125.06 lat (msec): min=38, max=344, avg=185.24, stdev=125.06 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 255], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1973, max= 4096, per=53.12%, avg=2689.67, stdev=1218.00, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1519KiB/s (1555kB/s)(6144KiB/4045msec); 0 zone resets clat (msec): min=43, max=1247, avg=486.90, stdev=571.98 lat (msec): min=44, max=1247, avg=486.98, stdev=571.97 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 222], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1973, max= 3407, per=34.93%, avg=2476.00, stdev=807.14, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=16.67%, 100=16.67%, 250=25.00%, 500=25.00%, 2000=16.67% cpu : usr=0.02%, sys=13.58%, ctx=283, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156434: Wed Mar 11 10:06:45 2026 read: IOPS=2, BW=2280KiB/s (2334kB/s)(5120KiB/2246msec) clat (msec): min=62, max=270, avg=135.96, stdev=90.04 lat (msec): min=62, max=270, avg=135.96, stdev=90.04 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 93], 60.00th=[ 93], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 3946, max= 4000, per=78.47%, avg=3973.00, stdev=38.18, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3191KiB/s (3268kB/s)(7168KiB/2246msec); 0 zone resets clat (msec): min=53, max=654, avg=217.27, stdev=237.10 lat (msec): min=53, max=654, avg=217.34, stdev=237.09 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 62], | 30.00th=[ 74], 40.00th=[ 74], 50.00th=[ 91], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 447], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1973, max= 6000, per=47.34%, avg=3355.50, stdev=1881.16, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 100=58.33%, 250=16.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=14.74%, ctx=98, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5063KiB/s (5185kB/s), 513KiB/s-2280KiB/s (525kB/s-2334kB/s), io=20.0MiB (20.0MB), run=2246-4045msec WRITE: bw=7088KiB/s (7258kB/s), 1341KiB/s-3191KiB/s (1374kB/s-3268kB/s), io=28.0MiB (29.4MB), run=2246-4045msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156436: Wed Mar 11 10:06:45 2026 read: IOPS=2, BW=2733KiB/s (2798kB/s)(7168KiB/2623msec) clat (usec): min=670, max=902117, avg=212219.45, stdev=309304.71 lat (usec): min=672, max=902118, avg=212221.93, stdev=309304.38 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 49546], | 30.00th=[101188], 40.00th=[101188], 50.00th=[127402], 60.00th=[143655], | 70.00th=[143655], 80.00th=[160433], 90.00th=[901776], 95.00th=[901776], | 99.00th=[901776], 99.50th=[901776], 99.90th=[901776], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 1651, max= 6131, per=64.44%, avg=3276.67, stdev=2479.88, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1952KiB/s (1999kB/s)(5120KiB/2623msec); 0 zone resets clat (msec): min=92, max=493, avg=199.69, stdev=166.74 lat (msec): min=92, max=493, avg=199.74, stdev=166.75 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2043, max= 2043, per=28.70%, avg=2043.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=58.33%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=41.46%, ctx=1653, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156437: Wed Mar 11 10:06:45 2026 read: IOPS=0, BW=509KiB/s (521kB/s)(2048KiB/4027msec) clat (msec): min=33, max=157, avg=95.20, stdev=87.67 lat (msec): min=33, max=157, avg=95.20, stdev=87.67 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 34], | 30.00th=[ 34], 40.00th=[ 34], 50.00th=[ 34], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 157], 95.00th=[ 157], | 99.00th=[ 157], 99.50th=[ 157], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 1654, max= 2048, per=36.40%, avg=1851.00, stdev=278.60, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2543KiB/s (2604kB/s)(10.0MiB/4027msec); 0 zone resets clat (msec): min=49, max=1280, avg=375.96, stdev=446.49 lat (msec): min=49, max=1280, avg=376.03, stdev=446.51 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 88], | 30.00th=[ 92], 40.00th=[ 122], 50.00th=[ 144], 60.00th=[ 146], | 70.00th=[ 359], 80.00th=[ 372], 90.00th=[ 1099], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1654, max= 6144, per=41.26%, avg=2937.25, stdev=2144.02, samples=4 iops : min= 1, max= 6, avg= 2.50, stdev= 2.38, samples=4 lat (msec) : 50=16.67%, 100=16.67%, 250=33.33%, 500=16.67%, 2000=16.67% cpu : usr=0.02%, sys=30.65%, ctx=437, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156438: Wed Mar 11 10:06:45 2026 read: IOPS=1, BW=1726KiB/s (1767kB/s)(6144KiB/3560msec) clat (usec): min=794, max=231603, avg=133183.35, stdev=79560.53 lat (usec): min=794, max=231604, avg=133184.32, stdev=79560.59 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 91751], | 30.00th=[ 91751], 40.00th=[135267], 50.00th=[135267], 60.00th=[162530], | 70.00th=[175113], 80.00th=[175113], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 4096, max= 6144, per=100.00%, avg=5120.00, stdev=1448.15, samples=2 iops : min= 4, max= 6, avg= 5.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1726KiB/s (1767kB/s)(6144KiB/3560msec); 0 zone resets clat (msec): min=134, max=1155, avg=444.02, stdev=427.37 lat (msec): min=134, max=1155, avg=444.07, stdev=427.37 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 218], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2043, max= 3276, per=33.06%, avg=2353.75, stdev=614.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=66.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=32.54%, ctx=885, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156439: Wed Mar 11 10:06:45 2026 read: IOPS=1, BW=1441KiB/s (1476kB/s)(5120KiB/3552msec) clat (usec): min=795, max=803104, avg=217196.37, stdev=344515.73 lat (usec): min=796, max=803105, avg=217197.46, stdev=344515.63 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 799], 10.00th=[ 799], 20.00th=[ 799], | 30.00th=[ 898], 40.00th=[ 898], 50.00th=[ 26346], 60.00th=[ 26346], | 70.00th=[254804], 80.00th=[254804], 90.00th=[801113], 95.00th=[801113], | 99.00th=[801113], 99.50th=[801113], 99.90th=[801113], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 4096, max= 4096, per=80.55%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2018KiB/s (2066kB/s)(7168KiB/3552msec); 0 zone resets clat (msec): min=81, max=1201, avg=348.31, stdev=382.04 lat (msec): min=81, max=1201, avg=348.38, stdev=382.05 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 192], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 213], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 309], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1648, max= 4096, per=34.54%, avg=2458.75, stdev=1107.47, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 1000=16.67% lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=33.31%, ctx=962, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5086KiB/s (5208kB/s), 509KiB/s-2733KiB/s (521kB/s-2798kB/s), io=20.0MiB (20.0MB), run=2623-4027msec WRITE: bw=7120KiB/s (7291kB/s), 1726KiB/s-2543KiB/s (1767kB/s-2604kB/s), io=28.0MiB (29.4MB), run=2623-4027msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156445: Wed Mar 11 10:06:55 2026 read: IOPS=0, BW=3938KiB/s (4033kB/s)(12.0MiB/3120msec) clat (msec): min=644, max=1543, avg=983.89, stdev=488.54 lat (msec): min=644, max=1543, avg=983.89, stdev=488.54 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.55%, ctx=156, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156446: Wed Mar 11 10:06:55 2026 read: IOPS=0, BW=1260KiB/s (1291kB/s)(4096KiB/3250msec) clat (nsec): min=2050.3M, max=2050.3M, avg=2050326441.00, stdev= 0.00 lat (nsec): min=2050.3M, max=2050.3M, avg=2050327451.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2056], 5.00th=[ 2056], 10.00th=[ 2056], 20.00th=[ 2056], | 30.00th=[ 2056], 40.00th=[ 2056], 50.00th=[ 2056], 60.00th=[ 2056], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2521KiB/s (2581kB/s)(8192KiB/3250msec); 0 zone resets clat (msec): min=268, max=754, avg=511.63, stdev=344.09 lat (msec): min=268, max=755, avg=511.92, stdev=344.10 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8094, max= 8094, per=80.28%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=13.76%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156447: Wed Mar 11 10:06:55 2026 write: IOPS=1, BW=4556KiB/s (4666kB/s)(12.0MiB/2697msec); 0 zone resets clat (msec): min=739, max=947, avg=841.95, stdev=103.96 lat (msec): min=739, max=947, avg=842.28, stdev=103.90 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8159, max= 8192, per=81.09%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=16.43%, ctx=124, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156449: Wed Mar 11 10:06:55 2026 write: IOPS=1, BW=4588KiB/s (4699kB/s)(12.0MiB/2678msec); 0 zone resets clat (msec): min=483, max=1228, avg=835.44, stdev=374.48 lat (msec): min=483, max=1229, avg=835.70, stdev=374.54 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8094, max= 8159, per=80.60%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=16.36%, ctx=105, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5041KiB/s (5162kB/s), 1260KiB/s-3938KiB/s (1291kB/s-4033kB/s), io=16.0MiB (16.8MB), run=3120-3250msec WRITE: bw=9.85MiB/s (10.3MB/s), 2521KiB/s-4588KiB/s (2581kB/s-4699kB/s), io=32.0MiB (33.6MB), run=2678-3250msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156450: Wed Mar 11 10:06:55 2026 read: IOPS=1, BW=4658KiB/s (4770kB/s)(12.0MiB/2638msec) clat (msec): min=485, max=1437, avg=863.78, stdev=504.94 lat (msec): min=485, max=1437, avg=863.78, stdev=504.94 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=45.35%, ctx=2965, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156451: Wed Mar 11 10:06:55 2026 read: IOPS=0, BW=1447KiB/s (1482kB/s)(4096KiB/2831msec) clat (nsec): min=1435.1M, max=1435.1M, avg=1435074444.00, stdev= 0.00 lat (nsec): min=1435.1M, max=1435.1M, avg=1435075374.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2894KiB/s (2963kB/s)(8192KiB/2831msec); 0 zone resets clat (msec): min=542, max=825, avg=683.94, stdev=200.58 lat (msec): min=542, max=826, avg=684.27, stdev=200.53 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8192, max= 8192, per=78.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=22.23%, ctx=767, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156452: Wed Mar 11 10:06:55 2026 write: IOPS=0, BW=3925KiB/s (4019kB/s)(12.0MiB/3131msec); 0 zone resets clat (msec): min=134, max=2586, avg=1026.60, stdev=1355.26 lat (msec): min=134, max=2586, avg=1026.82, stdev=1355.30 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 8192, max= 8192, per=78.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=10.42%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156453: Wed Mar 11 10:06:55 2026 write: IOPS=1, BW=4277KiB/s (4380kB/s)(12.0MiB/2873msec); 0 zone resets clat (msec): min=169, max=1419, avg=935.80, stdev=671.29 lat (msec): min=169, max=1419, avg=936.09, stdev=671.30 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8159, max= 8192, per=78.12%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.07%, sys=14.87%, ctx=84, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5787KiB/s (5926kB/s), 1447KiB/s-4658KiB/s (1482kB/s-4770kB/s), io=16.0MiB (16.8MB), run=2638-2831msec WRITE: bw=10.2MiB/s (10.7MB/s), 2894KiB/s-4277KiB/s (2963kB/s-4380kB/s), io=32.0MiB (33.6MB), run=2831-3131msec