== sanity test 398b: DIO and buffer IO race ============== 13:31:09 (1772476269) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.70762 s, 18.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182605: Mon Mar 2 13:32:09 2026 read: IOPS=28, BW=115KiB/s (118kB/s)(5992KiB/52023msec) clat (usec): min=57, max=647270, avg=18833.72, stdev=19269.30 lat (usec): min=57, max=647270, avg=18834.30, stdev=19269.33 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 7177], 10.00th=[ 8455], 20.00th=[ 10552], | 30.00th=[ 12256], 40.00th=[ 14353], 50.00th=[ 16450], 60.00th=[ 18482], | 70.00th=[ 21103], 80.00th=[ 24511], 90.00th=[ 32637], 95.00th=[ 39060], | 99.00th=[ 53740], 99.50th=[ 61604], 99.90th=[ 85459], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 12, max= 184, per=24.95%, avg=114.77, stdev=35.42, samples=103 iops : min= 3, max= 46, avg=28.25, stdev= 8.89, samples=103 write: IOPS=30, BW=121KiB/s (124kB/s)(6296KiB/52023msec); 0 zone resets clat (usec): min=730, max=76340, avg=15055.99, stdev=10749.83 lat (usec): min=730, max=76341, avg=15057.52, stdev=10751.93 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2900], 10.00th=[ 3359], 20.00th=[ 5014], | 30.00th=[ 7832], 40.00th=[10290], 50.00th=[12649], 60.00th=[15533], | 70.00th=[18744], 80.00th=[23462], 90.00th=[29754], 95.00th=[35390], | 99.00th=[48497], 99.50th=[54264], 99.90th=[62653], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 32, max= 223, per=25.33%, avg=121.81, stdev=39.19, samples=102 iops : min= 8, max= 55, avg=30.01, stdev= 9.81, samples=102 lat (usec) : 100=0.49%, 250=0.85%, 500=0.03%, 750=0.07%, 1000=0.07% lat (msec) : 2=0.59%, 4=6.80%, 10=18.82%, 20=41.96%, 50=29.23% lat (msec) : 100=1.07%, 750=0.03% cpu : usr=0.08%, sys=26.52%, ctx=10143, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182606: Mon Mar 2 13:32:09 2026 read: IOPS=28, BW=114KiB/s (117kB/s)(5940KiB/51939msec) clat (usec): min=32, max=82426, avg=18499.53, stdev=10087.67 lat (usec): min=33, max=82427, avg=18500.17, stdev=10087.74 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 7570], 10.00th=[ 8848], 20.00th=[10683], | 30.00th=[12387], 40.00th=[14615], 50.00th=[16712], 60.00th=[18744], | 70.00th=[21103], 80.00th=[24773], 90.00th=[31065], 95.00th=[37487], | 99.00th=[55313], 99.50th=[59507], 99.90th=[73925], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 6, max= 183, per=24.80%, avg=114.08, stdev=35.24, samples=103 iops : min= 1, max= 45, avg=28.08, stdev= 8.89, samples=103 write: IOPS=30, BW=122KiB/s (125kB/s)(6348KiB/51939msec); 0 zone resets clat (usec): min=744, max=589868, avg=15349.83, stdev=18467.39 lat (usec): min=745, max=589868, avg=15350.71, stdev=18467.37 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 2638], 10.00th=[ 3195], 20.00th=[ 4817], | 30.00th=[ 7439], 40.00th=[ 10159], 50.00th=[ 12256], 60.00th=[ 14877], | 70.00th=[ 18482], 80.00th=[ 23462], 90.00th=[ 30016], 95.00th=[ 36439], | 99.00th=[ 55837], 99.50th=[ 61604], 99.90th=[101188], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 6, max= 224, per=25.32%, avg=121.77, stdev=43.55, samples=103 iops : min= 1, max= 56, avg=30.00, stdev=10.92, samples=103 lat (usec) : 50=0.03%, 100=0.39%, 250=0.75%, 750=0.03%, 1000=0.16% lat (msec) : 2=0.94%, 4=7.39%, 10=18.55%, 20=41.11%, 50=29.17% lat (msec) : 100=1.40%, 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=26.55%, ctx=10150, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182607: Mon Mar 2 13:32:09 2026 read: IOPS=29, BW=116KiB/s (119kB/s)(6028KiB/51888msec) clat (usec): min=45, max=75889, avg=18664.33, stdev=9849.07 lat (usec): min=46, max=75890, avg=18666.01, stdev=9849.26 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 7308], 10.00th=[ 8455], 20.00th=[10683], | 30.00th=[12780], 40.00th=[14877], 50.00th=[17433], 60.00th=[19268], | 70.00th=[21627], 80.00th=[25035], 90.00th=[31327], 95.00th=[36963], | 99.00th=[51643], 99.50th=[58459], 99.90th=[74974], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 39, max= 232, per=25.48%, avg=117.20, stdev=34.06, samples=102 iops : min= 9, max= 58, avg=28.85, stdev= 8.58, samples=102 write: IOPS=30, BW=121KiB/s (124kB/s)(6260KiB/51888msec); 0 zone resets clat (usec): min=654, max=607278, avg=15113.33, stdev=18506.85 lat (usec): min=654, max=607280, avg=15114.77, stdev=18506.68 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2737], 10.00th=[ 3261], 20.00th=[ 4621], | 30.00th=[ 7635], 40.00th=[ 10028], 50.00th=[ 12256], 60.00th=[ 15008], | 70.00th=[ 18220], 80.00th=[ 23200], 90.00th=[ 29492], 95.00th=[ 35914], | 99.00th=[ 51643], 99.50th=[ 56361], 99.90th=[ 71828], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 31, max= 239, per=25.30%, avg=121.72, stdev=40.02, samples=102 iops : min= 7, max= 59, avg=29.99, stdev=10.01, samples=102 lat (usec) : 50=0.07%, 100=0.23%, 250=0.68%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.20% lat (msec) : 2=0.72%, 4=7.58%, 10=18.85%, 20=40.30%, 50=30.08% lat (msec) : 100=1.11%, 750=0.03% cpu : usr=0.09%, sys=26.54%, ctx=10046, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182608: Mon Mar 2 13:32:09 2026 read: IOPS=28, BW=116KiB/s (119kB/s)(6052KiB/52176msec) clat (usec): min=64, max=77488, avg=18472.82, stdev=9831.61 lat (usec): min=64, max=77489, avg=18473.44, stdev=9831.69 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 7111], 10.00th=[ 8717], 20.00th=[10683], | 30.00th=[12780], 40.00th=[14877], 50.00th=[16909], 60.00th=[19006], | 70.00th=[21365], 80.00th=[24511], 90.00th=[31065], 95.00th=[36439], | 99.00th=[53740], 99.50th=[58459], 99.90th=[73925], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 55, max= 199, per=25.22%, avg=116.00, stdev=35.26, samples=102 iops : min= 13, max= 49, avg=28.56, stdev= 8.84, samples=102 write: IOPS=29, BW=120KiB/s (122kB/s)(6236KiB/52176msec); 0 zone resets clat (usec): min=702, max=612077, avg=15477.15, stdev=19066.90 lat (usec): min=702, max=612078, avg=15477.92, stdev=19066.95 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 2802], 10.00th=[ 3195], 20.00th=[ 4490], | 30.00th=[ 7373], 40.00th=[ 10028], 50.00th=[ 12518], 60.00th=[ 15270], | 70.00th=[ 18744], 80.00th=[ 23462], 90.00th=[ 30016], 95.00th=[ 38011], | 99.00th=[ 53216], 99.50th=[ 63177], 99.90th=[ 98042], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 39, max= 199, per=24.92%, avg=119.85, stdev=39.24, samples=102 iops : min= 9, max= 49, avg=29.52, stdev= 9.89, samples=102 lat (usec) : 100=0.36%, 250=0.68%, 500=0.07%, 750=0.07%, 1000=0.13% lat (msec) : 2=0.75%, 4=7.85%, 10=18.55%, 20=40.27%, 50=29.88% lat (msec) : 100=1.37%, 750=0.03% cpu : usr=0.10%, sys=26.38%, ctx=9992, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=460KiB/s (471kB/s), 114KiB/s-116KiB/s (117kB/s-119kB/s), io=23.4MiB (24.6MB), run=51888-52176msec WRITE: bw=482KiB/s (493kB/s), 120KiB/s-122KiB/s (122kB/s-125kB/s), io=24.6MiB (25.7MB), run=51888-52176msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182600: Mon Mar 2 13:32:15 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(5992KiB/58144msec) clat (msec): min=2, max=654, avg=17.52, stdev=21.27 lat (msec): min=2, max=654, avg=17.52, stdev=21.27 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 36], 95.00th=[ 46], | 99.00th=[ 67], 99.50th=[ 70], 99.90th=[ 87], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 31, max= 400, per=25.09%, avg=103.38, stdev=71.69, samples=114 iops : min= 7, max= 100, avg=25.50, stdev=18.06, samples=114 write: IOPS=27, BW=108KiB/s (111kB/s)(6296KiB/58144msec); 0 zone resets clat (msec): min=4, max=100, avg=20.15, stdev=13.74 lat (msec): min=4, max=100, avg=20.16, stdev=13.74 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 68], 99.50th=[ 79], 99.90th=[ 90], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 16, max= 384, per=25.09%, avg=108.15, stdev=74.08, samples=114 iops : min= 4, max= 96, avg=26.69, stdev=18.64, samples=114 lat (msec) : 4=1.14%, 10=32.29%, 20=30.27%, 50=32.78%, 100=3.45% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=14.76%, ctx=6531, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182601: Mon Mar 2 13:32:15 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(5940KiB/58218msec) clat (msec): min=2, max=602, avg=16.82, stdev=19.84 lat (msec): min=2, max=602, avg=16.82, stdev=19.84 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 35], 95.00th=[ 44], | 99.00th=[ 61], 99.50th=[ 67], 99.90th=[ 87], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 39, max= 392, per=24.80%, avg=102.18, stdev=73.19, samples=114 iops : min= 9, max= 98, avg=25.20, stdev=18.41, samples=114 write: IOPS=27, BW=109KiB/s (112kB/s)(6348KiB/58218msec); 0 zone resets clat (msec): min=4, max=123, avg=20.83, stdev=14.51 lat (msec): min=4, max=123, avg=20.84, stdev=14.51 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 50], | 99.00th=[ 70], 99.50th=[ 80], 99.90th=[ 91], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 23, max= 392, per=25.09%, avg=108.15, stdev=71.98, samples=114 iops : min= 5, max= 98, avg=26.69, stdev=18.13, samples=114 lat (msec) : 4=1.20%, 10=32.62%, 20=29.85%, 50=32.45%, 100=3.81% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=14.70%, ctx=6545, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182602: Mon Mar 2 13:32:15 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6028KiB/58060msec) clat (usec): min=2489, max=76379, avg=16427.65, stdev=12551.25 lat (usec): min=2489, max=76381, avg=16429.49, stdev=12553.00 clat percentiles (usec): | 1.00th=[ 3654], 5.00th=[ 4359], 10.00th=[ 4752], 20.00th=[ 5669], | 30.00th=[ 7701], 40.00th=[10159], 50.00th=[12649], 60.00th=[15795], | 70.00th=[19268], 80.00th=[25297], 90.00th=[34341], 95.00th=[43254], | 99.00th=[57410], 99.50th=[66323], 99.90th=[72877], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 24, max= 368, per=25.32%, avg=104.30, stdev=75.30, samples=114 iops : min= 6, max= 92, avg=25.73, stdev=18.93, samples=114 write: IOPS=26, BW=108KiB/s (110kB/s)(6260KiB/58060msec); 0 zone resets clat (msec): min=4, max=606, avg=21.16, stdev=20.50 lat (msec): min=4, max=606, avg=21.16, stdev=20.50 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 68], 99.50th=[ 82], 99.90th=[ 104], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 32, max= 384, per=25.05%, avg=107.95, stdev=71.04, samples=114 iops : min= 8, max= 96, avg=26.64, stdev=17.89, samples=114 lat (msec) : 4=1.07%, 10=32.81%, 20=29.62%, 50=33.27%, 100=3.12% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.09%, sys=14.80%, ctx=6600, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182603: Mon Mar 2 13:32:15 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6052KiB/58255msec) clat (usec): min=2403, max=93889, avg=16504.20, stdev=12869.45 lat (usec): min=2403, max=93891, avg=16504.84, stdev=12869.51 clat percentiles (usec): | 1.00th=[ 3294], 5.00th=[ 4293], 10.00th=[ 4752], 20.00th=[ 5604], | 30.00th=[ 7898], 40.00th=[10159], 50.00th=[12649], 60.00th=[15270], | 70.00th=[19006], 80.00th=[24773], 90.00th=[34341], 95.00th=[43779], | 99.00th=[57410], 99.50th=[66323], 99.90th=[90702], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 31, max= 384, per=25.30%, avg=104.24, stdev=72.80, samples=113 iops : min= 7, max= 96, avg=25.72, stdev=18.32, samples=113 write: IOPS=26, BW=107KiB/s (110kB/s)(6236KiB/58255msec); 0 zone resets clat (msec): min=4, max=608, avg=21.23, stdev=21.35 lat (msec): min=4, max=608, avg=21.23, stdev=21.35 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 77], 99.50th=[ 85], 99.90th=[ 114], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 392, per=24.64%, avg=106.19, stdev=74.18, samples=114 iops : min= 1, max= 98, avg=26.20, stdev=18.67, samples=114 lat (msec) : 4=1.50%, 10=33.07%, 20=29.75%, 50=32.00%, 100=3.55% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.12%, sys=14.80%, ctx=6606, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=412KiB/s (422kB/s), 102KiB/s-104KiB/s (104kB/s-106kB/s), io=23.4MiB (24.6MB), run=58060-58255msec WRITE: bw=432KiB/s (442kB/s), 107KiB/s-109KiB/s (110kB/s-112kB/s), io=24.6MiB (25.7MB), run=58060-58255msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182633: Mon Mar 2 13:32:35 2026 read: IOPS=26, BW=428KiB/s (439kB/s)(5920KiB/13822msec) clat (usec): min=48, max=59267, avg=19213.24, stdev=10539.25 lat (usec): min=49, max=59268, avg=19213.89, stdev=10539.30 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 131], 10.00th=[ 8979], 20.00th=[11469], | 30.00th=[13566], 40.00th=[15795], 50.00th=[17433], 60.00th=[19530], | 70.00th=[22414], 80.00th=[26346], 90.00th=[32900], 95.00th=[38536], | 99.00th=[53216], 99.50th=[55837], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 127, max= 702, per=24.89%, avg=421.89, stdev=130.23, samples=27 iops : min= 7, max= 43, avg=26.04, stdev= 8.13, samples=27 write: IOPS=28, BW=461KiB/s (472kB/s)(6368KiB/13822msec); 0 zone resets clat (usec): min=1813, max=66256, avg=16612.52, stdev=11034.46 lat (usec): min=1814, max=66257, avg=16613.91, stdev=11034.46 clat percentiles (usec): | 1.00th=[ 2999], 5.00th=[ 4490], 10.00th=[ 4948], 20.00th=[ 6783], | 30.00th=[ 9634], 40.00th=[11863], 50.00th=[14222], 60.00th=[16909], | 70.00th=[20055], 80.00th=[24511], 90.00th=[30016], 95.00th=[36963], | 99.00th=[56886], 99.50th=[65799], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 220, max= 702, per=25.67%, avg=457.78, stdev=115.68, samples=27 iops : min= 13, max= 43, avg=28.26, stdev= 7.30, samples=27 lat (usec) : 50=0.13%, 100=1.30%, 250=1.56%, 500=0.13% lat (msec) : 2=0.13%, 4=1.30%, 10=18.23%, 20=42.32%, 50=33.20% lat (msec) : 100=1.69% cpu : usr=0.11%, sys=28.09%, ctx=3144, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182634: Mon Mar 2 13:32:35 2026 read: IOPS=26, BW=423KiB/s (433kB/s)(5744KiB/13575msec) clat (usec): min=58, max=59961, avg=19045.66, stdev=10033.70 lat (usec): min=59, max=59961, avg=19046.36, stdev=10033.74 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 7308], 10.00th=[ 9765], 20.00th=[11469], | 30.00th=[13698], 40.00th=[15139], 50.00th=[17433], 60.00th=[19268], | 70.00th=[21627], 80.00th=[25297], 90.00th=[31065], 95.00th=[39060], | 99.00th=[51643], 99.50th=[56886], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 165, max= 672, per=25.17%, avg=426.58, stdev=121.69, samples=26 iops : min= 10, max= 42, avg=26.35, stdev= 7.65, samples=26 write: IOPS=30, BW=482KiB/s (494kB/s)(6544KiB/13575msec); 0 zone resets clat (usec): min=1313, max=61829, avg=16326.79, stdev=10900.62 lat (usec): min=1315, max=61830, avg=16329.10, stdev=10901.43 clat percentiles (usec): | 1.00th=[ 2966], 5.00th=[ 4424], 10.00th=[ 4817], 20.00th=[ 6456], | 30.00th=[ 9372], 40.00th=[11469], 50.00th=[13829], 60.00th=[16450], | 70.00th=[19530], 80.00th=[24249], 90.00th=[31589], 95.00th=[39584], | 99.00th=[49021], 99.50th=[50594], 99.90th=[61604], 99.95th=[61604], | 99.99th=[61604] bw ( KiB/s): min= 286, max= 704, per=26.81%, avg=478.08, stdev=112.88, samples=26 iops : min= 17, max= 44, avg=29.58, stdev= 7.15, samples=26 lat (usec) : 100=0.13%, 250=1.43%, 500=0.13% lat (msec) : 2=0.26%, 4=1.43%, 10=19.66%, 20=44.92%, 50=30.86% lat (msec) : 100=1.17% cpu : usr=0.10%, sys=28.83%, ctx=3029, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182635: Mon Mar 2 13:32:35 2026 read: IOPS=27, BW=443KiB/s (454kB/s)(6256KiB/14126msec) clat (usec): min=89, max=84315, avg=19617.15, stdev=10631.46 lat (usec): min=90, max=84316, avg=19617.86, stdev=10631.51 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 7832], 10.00th=[ 9765], 20.00th=[11469], | 30.00th=[13698], 40.00th=[15664], 50.00th=[17695], 60.00th=[19792], | 70.00th=[22152], 80.00th=[26084], 90.00th=[32113], 95.00th=[38536], | 99.00th=[57934], 99.50th=[63701], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 193, max= 672, per=26.25%, avg=445.00, stdev=125.37, samples=28 iops : min= 12, max= 42, avg=27.50, stdev= 7.80, samples=28 write: IOPS=26, BW=427KiB/s (437kB/s)(6032KiB/14126msec); 0 zone resets clat (usec): min=1728, max=76299, avg=17057.39, stdev=11928.22 lat (usec): min=1729, max=76300, avg=17059.48, stdev=11929.31 clat percentiles (usec): | 1.00th=[ 2966], 5.00th=[ 4359], 10.00th=[ 4883], 20.00th=[ 6390], | 30.00th=[ 9241], 40.00th=[11338], 50.00th=[13829], 60.00th=[17957], | 70.00th=[20579], 80.00th=[24773], 90.00th=[33817], 95.00th=[42206], | 99.00th=[56361], 99.50th=[67634], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 224, max= 896, per=23.85%, avg=425.18, stdev=163.44, samples=28 iops : min= 14, max= 56, avg=26.25, stdev=10.31, samples=28 lat (usec) : 100=0.39%, 250=0.91%, 500=0.13% lat (msec) : 2=0.26%, 4=1.43%, 10=20.18%, 20=41.02%, 50=33.72% lat (msec) : 100=1.95% cpu : usr=0.08%, sys=27.25%, ctx=3188, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182637: Mon Mar 2 13:32:35 2026 read: IOPS=28, BW=452KiB/s (463kB/s)(6032KiB/13336msec) clat (usec): min=94, max=70042, avg=18409.80, stdev=9587.38 lat (usec): min=94, max=70043, avg=18410.48, stdev=9587.45 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 131], 10.00th=[ 8717], 20.00th=[11731], | 30.00th=[13698], 40.00th=[15533], 50.00th=[17171], 60.00th=[19792], | 70.00th=[22152], 80.00th=[25560], 90.00th=[30016], 95.00th=[35390], | 99.00th=[44827], 99.50th=[57410], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 193, max= 606, per=26.67%, avg=452.08, stdev=113.84, samples=26 iops : min= 12, max= 37, avg=27.96, stdev= 7.03, samples=26 write: IOPS=29, BW=469KiB/s (480kB/s)(6256KiB/13336msec); 0 zone resets clat (usec): min=1523, max=54331, avg=16044.67, stdev=10154.08 lat (usec): min=1524, max=54334, avg=16045.86, stdev=10154.17 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 4359], 10.00th=[ 4883], 20.00th=[ 6980], | 30.00th=[ 9241], 40.00th=[11600], 50.00th=[13698], 60.00th=[16319], | 70.00th=[19268], 80.00th=[23725], 90.00th=[31065], 95.00th=[35914], | 99.00th=[50070], 99.50th=[51119], 99.90th=[54264], 99.95th=[54264], | 99.99th=[54264] bw ( KiB/s): min= 275, max= 736, per=26.44%, avg=471.35, stdev=113.72, samples=26 iops : min= 17, max= 46, avg=29.15, stdev= 7.14, samples=26 lat (usec) : 100=0.39%, 250=2.99% lat (msec) : 2=0.26%, 4=1.04%, 10=18.23%, 20=43.49%, 50=32.81% lat (msec) : 100=0.78% cpu : usr=0.04%, sys=29.21%, ctx=3125, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1696KiB/s (1736kB/s), 423KiB/s-452KiB/s (433kB/s-463kB/s), io=23.4MiB (24.5MB), run=13336-14126msec WRITE: bw=1784KiB/s (1827kB/s), 427KiB/s-482KiB/s (437kB/s-494kB/s), io=24.6MiB (25.8MB), run=13336-14126msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182636: Mon Mar 2 13:32:36 2026 read: IOPS=23, BW=382KiB/s (391kB/s)(5920KiB/15504msec) clat (usec): min=2508, max=93462, avg=17444.78, stdev=13256.64 lat (usec): min=2508, max=93462, avg=17445.32, stdev=13256.70 clat percentiles (usec): | 1.00th=[ 2638], 5.00th=[ 3916], 10.00th=[ 5342], 20.00th=[ 6652], | 30.00th=[ 8848], 40.00th=[11469], 50.00th=[12780], 60.00th=[15664], | 70.00th=[21890], 80.00th=[26084], 90.00th=[35914], 95.00th=[43779], | 99.00th=[61604], 99.50th=[78119], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 160, max= 1024, per=22.85%, avg=352.80, stdev=195.68, samples=30 iops : min= 10, max= 64, avg=21.70, stdev=12.35, samples=30 write: IOPS=25, BW=411KiB/s (421kB/s)(6368KiB/15504msec); 0 zone resets clat (usec): min=4148, max=85512, avg=22354.83, stdev=15689.14 lat (usec): min=4149, max=85514, avg=22356.08, stdev=15689.27 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5932], 10.00th=[ 7111], 20.00th=[ 8717], | 30.00th=[11076], 40.00th=[13960], 50.00th=[17695], 60.00th=[23200], | 70.00th=[28181], 80.00th=[34866], 90.00th=[43254], 95.00th=[52167], | 99.00th=[80217], 99.50th=[85459], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 139, max= 1120, per=23.68%, avg=384.87, stdev=216.57, samples=30 iops : min= 8, max= 70, avg=23.70, stdev=13.65, samples=30 lat (msec) : 4=2.47%, 10=26.82%, 20=31.90%, 50=34.51%, 100=4.30% cpu : usr=0.08%, sys=14.18%, ctx=1938, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182638: Mon Mar 2 13:32:36 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(5744KiB/15441msec) clat (usec): min=3332, max=65755, avg=17075.91, stdev=12698.51 lat (usec): min=3333, max=65756, avg=17076.58, stdev=12698.50 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 4817], 10.00th=[ 5538], 20.00th=[ 6980], | 30.00th=[ 9241], 40.00th=[10683], 50.00th=[12649], 60.00th=[15008], | 70.00th=[19268], 80.00th=[25822], 90.00th=[37487], 95.00th=[45351], | 99.00th=[57934], 99.50th=[58983], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 83, max= 1056, per=23.09%, avg=356.43, stdev=192.92, samples=30 iops : min= 5, max= 66, avg=21.93, stdev=12.13, samples=30 write: IOPS=26, BW=424KiB/s (434kB/s)(6544KiB/15441msec); 0 zone resets clat (usec): min=4190, max=77603, avg=22489.39, stdev=14927.35 lat (usec): min=4191, max=77604, avg=22490.72, stdev=14927.51 clat percentiles (usec): | 1.00th=[ 5669], 5.00th=[ 6587], 10.00th=[ 6980], 20.00th=[ 8455], | 30.00th=[11207], 40.00th=[15139], 50.00th=[19792], 60.00th=[23462], | 70.00th=[27395], 80.00th=[33817], 90.00th=[43779], 95.00th=[52167], | 99.00th=[68682], 99.50th=[76022], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 190, max= 1248, per=24.69%, avg=401.17, stdev=242.90, samples=30 iops : min= 11, max= 78, avg=24.73, stdev=15.34, samples=30 lat (msec) : 4=0.39%, 10=30.21%, 20=29.95%, 50=35.16%, 100=4.30% cpu : usr=0.10%, sys=14.45%, ctx=1767, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182639: Mon Mar 2 13:32:36 2026 read: IOPS=25, BW=409KiB/s (419kB/s)(6256KiB/15280msec) clat (usec): min=4241, max=69101, avg=15976.13, stdev=11057.67 lat (usec): min=4242, max=69102, avg=15976.73, stdev=11057.70 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5211], 10.00th=[ 5866], 20.00th=[ 7111], | 30.00th=[ 9110], 40.00th=[10290], 50.00th=[12387], 60.00th=[14746], | 70.00th=[17957], 80.00th=[23987], 90.00th=[31065], 95.00th=[39584], | 99.00th=[54789], 99.50th=[60031], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 159, max= 1344, per=26.23%, avg=405.03, stdev=256.81, samples=30 iops : min= 9, max= 84, avg=24.97, stdev=16.18, samples=30 write: IOPS=24, BW=395KiB/s (404kB/s)(6032KiB/15280msec); 0 zone resets clat (msec): min=5, max=103, avg=23.88, stdev=15.82 lat (msec): min=5, max=103, avg=23.88, stdev=15.82 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 78], 99.50th=[ 87], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 166, max= 960, per=23.67%, avg=384.70, stdev=193.45, samples=30 iops : min= 10, max= 60, avg=23.70, stdev=12.18, samples=30 lat (msec) : 10=29.43%, 20=33.07%, 50=33.33%, 100=4.04%, 250=0.13% cpu : usr=0.07%, sys=14.82%, ctx=1833, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182640: Mon Mar 2 13:32:36 2026 read: IOPS=24, BW=391KiB/s (400kB/s)(6032KiB/15434msec) clat (usec): min=3104, max=67880, avg=17322.40, stdev=12843.61 lat (usec): min=3104, max=67880, avg=17322.97, stdev=12843.64 clat percentiles (usec): | 1.00th=[ 3589], 5.00th=[ 4555], 10.00th=[ 5211], 20.00th=[ 6652], | 30.00th=[ 8717], 40.00th=[10552], 50.00th=[13566], 60.00th=[15795], | 70.00th=[20055], 80.00th=[28181], 90.00th=[35914], 95.00th=[43254], | 99.00th=[58459], 99.50th=[63701], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 111, max= 1216, per=23.91%, avg=369.13, stdev=235.99, samples=30 iops : min= 6, max= 76, avg=22.70, stdev=14.90, samples=30 write: IOPS=25, BW=405KiB/s (415kB/s)(6256KiB/15434msec); 0 zone resets clat (usec): min=4658, max=75361, avg=22384.91, stdev=14952.06 lat (usec): min=4659, max=75362, avg=22386.25, stdev=14952.23 clat percentiles (usec): | 1.00th=[ 5735], 5.00th=[ 6783], 10.00th=[ 7439], 20.00th=[ 8717], | 30.00th=[11600], 40.00th=[14746], 50.00th=[18482], 60.00th=[23200], | 70.00th=[28181], 80.00th=[33817], 90.00th=[41681], 95.00th=[53216], | 99.00th=[68682], 99.50th=[74974], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 160, max= 1152, per=23.87%, avg=387.93, stdev=214.46, samples=30 iops : min= 10, max= 72, avg=23.90, stdev=13.52, samples=30 lat (msec) : 4=1.04%, 10=30.21%, 20=30.34%, 50=34.24%, 100=4.17% cpu : usr=0.08%, sys=14.27%, ctx=1811, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1545KiB/s (1582kB/s), 372KiB/s-409KiB/s (381kB/s-419kB/s), io=23.4MiB (24.5MB), run=15280-15504msec WRITE: bw=1625KiB/s (1664kB/s), 395KiB/s-424KiB/s (404kB/s-434kB/s), io=24.6MiB (25.8MB), run=15280-15504msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182648: Mon Mar 2 13:32:44 2026 read: IOPS=3, BW=3535KiB/s (3619kB/s)(7168KiB/2028msec) clat (msec): min=102, max=147, avg=119.49, stdev=17.93 lat (msec): min=102, max=147, avg=119.49, stdev=17.93 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 113], 60.00th=[ 129], | 70.00th=[ 129], 80.00th=[ 138], 90.00th=[ 148], 95.00th=[ 148], | 99.00th=[ 148], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 2048, max= 6849, per=61.26%, avg=4448.50, stdev=3394.82, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2525KiB/s (2585kB/s)(5120KiB/2028msec); 0 zone resets clat (msec): min=131, max=331, avg=236.32, stdev=71.75 lat (msec): min=131, max=331, avg=236.38, stdev=71.75 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1712, max= 4063, per=25.65%, avg=2607.67, stdev=1271.50, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=83.33%, 500=16.67% cpu : usr=0.00%, sys=55.50%, ctx=1028, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182649: Mon Mar 2 13:32:44 2026 read: IOPS=0, BW=726KiB/s (744kB/s)(2048KiB/2820msec) clat (usec): min=478, max=784550, avg=392514.36, stdev=554422.90 lat (usec): min=478, max=784552, avg=392515.50, stdev=554423.40 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 478], 50.00th=[ 478], 60.00th=[784335], | 70.00th=[784335], 80.00th=[784335], 90.00th=[784335], 95.00th=[784335], | 99.00th=[784335], 99.50th=[784335], 99.90th=[784335], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 2048, max= 2048, per=28.20%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3631KiB/s (3718kB/s)(10.0MiB/2820msec); 0 zone resets clat (msec): min=103, max=535, avg=199.86, stdev=123.78 lat (msec): min=103, max=535, avg=199.92, stdev=123.78 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 133], | 30.00th=[ 138], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 184], 80.00th=[ 215], 90.00th=[ 226], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 2031, max= 8192, per=40.25%, avg=4091.75, stdev=2900.33, samples=4 iops : min= 1, max= 8, avg= 3.75, stdev= 3.10, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=75.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=47.00%, ctx=385, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182650: Mon Mar 2 13:32:44 2026 read: IOPS=3, BW=3089KiB/s (3163kB/s)(6144KiB/1989msec) clat (usec): min=398, max=169218, avg=79304.44, stdev=68294.66 lat (usec): min=398, max=169220, avg=79305.36, stdev=68294.82 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 482], | 30.00th=[ 482], 40.00th=[ 72877], 50.00th=[ 72877], 60.00th=[111674], | 70.00th=[120062], 80.00th=[120062], 90.00th=[168821], 95.00th=[168821], | 99.00th=[168821], 99.50th=[168821], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3089KiB/s (3163kB/s)(6144KiB/1989msec); 0 zone resets clat (msec): min=145, max=562, avg=248.23, stdev=157.55 lat (msec): min=145, max=562, avg=248.32, stdev=157.51 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 184], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2031, max= 4096, per=31.30%, avg=3182.00, stdev=1052.70, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (usec) : 500=16.67% lat (msec) : 100=8.33%, 250=66.67%, 750=8.33% cpu : usr=0.00%, sys=45.12%, ctx=721, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182651: Mon Mar 2 13:32:44 2026 read: IOPS=2, BW=3057KiB/s (3130kB/s)(5120KiB/1675msec) clat (usec): min=353, max=135131, avg=46693.79, stdev=64782.45 lat (usec): min=354, max=135132, avg=46694.50, stdev=64782.40 clat percentiles (usec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 408], 40.00th=[ 408], 50.00th=[ 482], 60.00th=[ 482], | 70.00th=[ 96994], 80.00th=[ 96994], 90.00th=[135267], 95.00th=[135267], | 99.00th=[135267], 99.50th=[135267], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=4, BW=4279KiB/s (4382kB/s)(7168KiB/1675msec); 0 zone resets clat (msec): min=101, max=339, avg=201.79, stdev=98.04 lat (msec): min=101, max=339, avg=201.84, stdev=98.06 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 110], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 163], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 326], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 3424, max= 6144, per=44.69%, avg=4543.67, stdev=1422.28, samples=3 iops : min= 3, max= 6, avg= 4.00, stdev= 1.73, samples=3 lat (usec) : 500=25.00% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67% cpu : usr=0.00%, sys=53.11%, ctx=216, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7262KiB/s (7437kB/s), 726KiB/s-3535KiB/s (744kB/s-3619kB/s), io=20.0MiB (20.0MB), run=1675-2820msec WRITE: bw=9.93MiB/s (10.4MB/s), 2525KiB/s-4279KiB/s (2585kB/s-4382kB/s), io=28.0MiB (29.4MB), run=1675-2820msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182653: Mon Mar 2 13:32:44 2026 read: IOPS=2, BW=2466KiB/s (2525kB/s)(7168KiB/2907msec) clat (msec): min=36, max=1000, avg=279.23, stdev=352.33 lat (msec): min=36, max=1000, avg=279.23, stdev=352.33 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 42], | 30.00th=[ 46], 40.00th=[ 46], 50.00th=[ 87], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 376], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1715, max= 4096, per=34.78%, avg=2441.25, stdev=1111.57, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1761KiB/s (1804kB/s)(5120KiB/2907msec); 0 zone resets clat (msec): min=56, max=356, avg=145.74, stdev=128.01 lat (msec): min=56, max=356, avg=145.80, stdev=128.02 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 59], 40.00th=[ 59], 50.00th=[ 79], 60.00th=[ 79], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2048, max= 2048, per=20.84%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 50=25.00%, 100=33.33%, 250=8.33%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=18.13%, ctx=138, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182654: Mon Mar 2 13:32:44 2026 read: IOPS=0, BW=706KiB/s (723kB/s)(2048KiB/2899msec) clat (msec): min=46, max=835, avg=441.00, stdev=557.92 lat (msec): min=46, max=835, avg=441.00, stdev=557.92 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 47], | 30.00th=[ 47], 40.00th=[ 47], 50.00th=[ 47], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1924, max= 2048, per=28.29%, avg=1986.00, stdev=87.68, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3532KiB/s (3617kB/s)(10.0MiB/2899msec); 0 zone resets clat (msec): min=43, max=367, avg=180.83, stdev=101.90 lat (msec): min=44, max=367, avg=180.89, stdev=101.90 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 64], | 30.00th=[ 129], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 150], | 70.00th=[ 236], 80.00th=[ 249], 90.00th=[ 288], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 3813, max= 6144, per=47.66%, avg=4684.33, stdev=1272.00, samples=3 iops : min= 3, max= 6, avg= 4.33, stdev= 1.53, samples=3 lat (msec) : 50=16.67%, 100=8.33%, 250=50.00%, 500=16.67%, 1000=8.33% cpu : usr=0.03%, sys=18.53%, ctx=127, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182655: Mon Mar 2 13:32:44 2026 read: IOPS=2, BW=2350KiB/s (2407kB/s)(6144KiB/2614msec) clat (msec): min=45, max=290, avg=127.92, stdev=98.51 lat (msec): min=45, max=290, avg=127.92, stdev=98.52 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 56], 50.00th=[ 56], 60.00th=[ 132], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1906, max= 4096, per=42.75%, avg=3001.00, stdev=1548.56, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2350KiB/s (2407kB/s)(6144KiB/2614msec); 0 zone resets clat (msec): min=63, max=866, avg=273.13, stdev=326.99 lat (msec): min=63, max=866, avg=273.19, stdev=326.98 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 67], | 30.00th=[ 67], 40.00th=[ 70], 50.00th=[ 70], 60.00th=[ 122], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1924, max= 3813, per=26.40%, avg=2595.00, stdev=1056.64, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=41.67%, 250=25.00%, 500=16.67%, 1000=8.33% cpu : usr=0.04%, sys=13.43%, ctx=163, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182656: Mon Mar 2 13:32:44 2026 read: IOPS=1, BW=1755KiB/s (1797kB/s)(5120KiB/2917msec) clat (msec): min=31, max=353, avg=120.87, stdev=131.85 lat (msec): min=31, max=353, avg=120.87, stdev=131.85 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 65], 60.00th=[ 65], | 70.00th=[ 94], 80.00th=[ 94], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 4096, max= 4096, per=58.35%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2457KiB/s (2516kB/s)(7168KiB/2917msec); 0 zone resets clat (msec): min=56, max=956, avg=315.29, stdev=300.98 lat (msec): min=56, max=956, avg=315.36, stdev=300.97 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 130], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 251], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 376], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1906, max= 4096, per=26.88%, avg=2642.00, stdev=1259.23, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=33.33%, 1000=8.33% cpu : usr=0.03%, sys=13.82%, ctx=106, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7021KiB/s (7189kB/s), 706KiB/s-2466KiB/s (723kB/s-2525kB/s), io=20.0MiB (20.0MB), run=2614-2917msec WRITE: bw=9829KiB/s (10.1MB/s), 1761KiB/s-3532KiB/s (1804kB/s-3617kB/s), io=28.0MiB (29.4MB), run=2614-2917msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182666: Mon Mar 2 13:32:52 2026 read: IOPS=2, BW=8463KiB/s (8666kB/s)(12.0MiB/1452msec) clat (msec): min=469, max=477, avg=473.58, stdev= 3.96 lat (msec): min=469, max=477, avg=473.58, stdev= 3.96 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7846, max= 8159, per=88.51%, avg=8002.50, stdev=221.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=49.76%, ctx=2883, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182667: Mon Mar 2 13:32:52 2026 read: IOPS=0, BW=2260KiB/s (2315kB/s)(4096KiB/1812msec) clat (nsec): min=459127k, max=459127k, avg=459126532.00, stdev= 0.00 lat (nsec): min=459129k, max=459129k, avg=459128779.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7892, max= 7892, per=87.29%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4521KiB/s (4629kB/s)(8192KiB/1812msec); 0 zone resets clat (msec): min=570, max=743, avg=656.64, stdev=122.14 lat (msec): min=570, max=743, avg=656.93, stdev=122.11 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7892, max= 7892, per=48.05%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=21.04%, ctx=1027, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182668: Mon Mar 2 13:32:52 2026 write: IOPS=1, BW=6159KiB/s (6307kB/s)(12.0MiB/1995msec); 0 zone resets clat (msec): min=129, max=1030, avg=652.33, stdev=467.35 lat (msec): min=130, max=1030, avg=652.63, stdev=467.41 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7861, max= 7861, per=47.86%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.10%, sys=10.63%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182669: Mon Mar 2 13:32:52 2026 write: IOPS=1, BW=6678KiB/s (6839kB/s)(12.0MiB/1840msec); 0 zone resets clat (msec): min=246, max=1142, avg=607.19, stdev=472.87 lat (msec): min=247, max=1142, avg=607.57, stdev=472.78 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7380, max= 7380, per=44.93%, avg=7380.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=22.24%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9042KiB/s (9259kB/s), 2260KiB/s-8463KiB/s (2315kB/s-8666kB/s), io=16.0MiB (16.8MB), run=1452-1812msec WRITE: bw=16.0MiB/s (16.8MB/s), 4521KiB/s-6678KiB/s (4629kB/s-6839kB/s), io=32.0MiB (33.6MB), run=1812-1995msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182661: Mon Mar 2 13:32:52 2026 read: IOPS=1, BW=7345KiB/s (7521kB/s)(12.0MiB/1673msec) clat (msec): min=484, max=663, avg=550.35, stdev=98.40 lat (msec): min=484, max=663, avg=550.36, stdev=98.40 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7301, max= 8192, per=100.00%, avg=7746.50, stdev=630.03, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=20.75%, ctx=109, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182662: Mon Mar 2 13:32:52 2026 read: IOPS=0, BW=1878KiB/s (1923kB/s)(4096KiB/2181msec) clat (nsec): min=746058k, max=746058k, avg=746057792.00, stdev= 0.00 lat (nsec): min=746061k, max=746061k, avg=746060637.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3756KiB/s (3846kB/s)(8192KiB/2181msec); 0 zone resets clat (msec): min=197, max=1185, avg=691.52, stdev=698.03 lat (msec): min=198, max=1185, avg=691.78, stdev=698.07 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8192, max= 8192, per=54.53%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.49%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182663: Mon Mar 2 13:32:52 2026 write: IOPS=3, BW=13.1MiB/s (13.7MB/s)(12.0MiB/916msec); 0 zone resets clat (msec): min=156, max=428, avg=302.30, stdev=137.06 lat (msec): min=156, max=428, avg=302.68, stdev=137.06 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7249, max= 7249, per=48.25%, avg=7249.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.11%, sys=29.84%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182664: Mon Mar 2 13:32:52 2026 write: IOPS=1, BW=7066KiB/s (7236kB/s)(12.0MiB/1739msec); 0 zone resets clat (msec): min=153, max=842, avg=570.29, stdev=366.76 lat (msec): min=153, max=842, avg=570.64, stdev=366.76 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7327, max= 8192, per=51.65%, avg=7759.50, stdev=611.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.86%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7512KiB/s (7692kB/s), 1878KiB/s-7345KiB/s (1923kB/s-7521kB/s), io=16.0MiB (16.8MB), run=1673-2181msec WRITE: bw=14.7MiB/s (15.4MB/s), 3756KiB/s-13.1MiB/s (3846kB/s-13.7MB/s), io=32.0MiB (33.6MB), run=916-2181msec