== sanity test 398b: DIO and buffer IO race ============== 08:18:34 (1775045914) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.15602 s, 23.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181625: Wed Apr 1 08:19:34 2026 read: IOPS=28, BW=113KiB/s (115kB/s)(5992KiB/53147msec) clat (usec): min=40, max=445812, avg=19409.55, stdev=15155.54 lat (usec): min=40, max=445812, avg=19410.22, stdev=15155.55 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 6980], 10.00th=[ 8455], 20.00th=[ 10683], | 30.00th=[ 12780], 40.00th=[ 15139], 50.00th=[ 17433], 60.00th=[ 19530], | 70.00th=[ 22676], 80.00th=[ 26084], 90.00th=[ 32375], 95.00th=[ 38536], | 99.00th=[ 54789], 99.50th=[ 59507], 99.90th=[ 85459], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 32, max= 208, per=24.93%, avg=112.43, stdev=35.47, samples=105 iops : min= 8, max= 52, avg=27.76, stdev= 8.89, samples=105 write: IOPS=29, BW=118KiB/s (121kB/s)(6296KiB/53147msec); 0 zone resets clat (usec): min=665, max=85974, avg=15196.63, stdev=12316.88 lat (usec): min=665, max=85975, avg=15197.32, stdev=12316.92 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 2278], 10.00th=[ 2769], 20.00th=[ 4293], | 30.00th=[ 6259], 40.00th=[ 9372], 50.00th=[11994], 60.00th=[15270], | 70.00th=[19530], 80.00th=[24511], 90.00th=[32637], 95.00th=[39060], | 99.00th=[54264], 99.50th=[60031], 99.90th=[83362], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 6, max= 200, per=25.02%, avg=118.10, stdev=39.30, samples=105 iops : min= 1, max= 50, avg=29.18, stdev= 9.89, samples=105 lat (usec) : 50=0.07%, 100=0.39%, 250=0.55%, 750=0.20%, 1000=0.39% lat (msec) : 2=1.24%, 4=7.91%, 10=19.56%, 20=36.10%, 50=31.77% lat (msec) : 100=1.79%, 500=0.03% cpu : usr=0.10%, sys=25.26%, ctx=9124, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181626: Wed Apr 1 08:19:34 2026 read: IOPS=28, BW=115KiB/s (117kB/s)(5940KiB/51843msec) clat (usec): min=43, max=82083, avg=18471.96, stdev=10065.67 lat (usec): min=44, max=82084, avg=18472.51, stdev=10065.66 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 6587], 10.00th=[ 8029], 20.00th=[10159], | 30.00th=[12518], 40.00th=[14615], 50.00th=[16712], 60.00th=[19268], | 70.00th=[22152], 80.00th=[25560], 90.00th=[31065], 95.00th=[37487], | 99.00th=[49021], 99.50th=[55313], 99.90th=[71828], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 13, max= 192, per=25.42%, avg=114.65, stdev=35.30, samples=103 iops : min= 3, max= 48, avg=28.32, stdev= 8.90, samples=103 write: IOPS=30, BW=122KiB/s (125kB/s)(6348KiB/51843msec); 0 zone resets clat (usec): min=694, max=441080, avg=15282.97, stdev=15812.14 lat (usec): min=695, max=441081, avg=15283.64, stdev=15812.16 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 2278], 10.00th=[ 2802], 20.00th=[ 4555], | 30.00th=[ 6849], 40.00th=[ 9896], 50.00th=[ 12125], 60.00th=[ 15270], | 70.00th=[ 18744], 80.00th=[ 24249], 90.00th=[ 31851], 95.00th=[ 38011], | 99.00th=[ 51119], 99.50th=[ 55313], 99.90th=[ 70779], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 32, max= 232, per=25.94%, avg=122.45, stdev=39.70, samples=103 iops : min= 8, max= 58, avg=30.27, stdev= 9.93, samples=103 lat (usec) : 50=0.03%, 100=0.46%, 250=0.59%, 750=0.13%, 1000=0.33% lat (msec) : 2=1.37%, 4=7.26%, 10=20.35%, 20=37.47%, 50=30.86% lat (msec) : 100=1.14%, 500=0.03% cpu : usr=0.08%, sys=25.63%, ctx=9059, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181627: Wed Apr 1 08:19:34 2026 read: IOPS=28, BW=115KiB/s (118kB/s)(6028KiB/52384msec) clat (usec): min=30, max=88130, avg=18642.95, stdev=10651.86 lat (usec): min=31, max=88131, avg=18643.57, stdev=10651.92 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 6521], 10.00th=[ 7963], 20.00th=[10159], | 30.00th=[12256], 40.00th=[14484], 50.00th=[16581], 60.00th=[19006], | 70.00th=[21627], 80.00th=[25822], 90.00th=[32113], 95.00th=[39060], | 99.00th=[53740], 99.50th=[65274], 99.90th=[85459], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 48, max= 208, per=25.74%, avg=116.09, stdev=33.02, samples=103 iops : min= 12, max= 52, avg=28.68, stdev= 8.31, samples=103 write: IOPS=29, BW=120KiB/s (122kB/s)(6260KiB/52384msec); 0 zone resets clat (usec): min=727, max=455618, avg=15429.92, stdev=16174.28 lat (usec): min=727, max=455619, avg=15430.66, stdev=16174.30 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 2311], 10.00th=[ 2769], 20.00th=[ 4490], | 30.00th=[ 7111], 40.00th=[ 9896], 50.00th=[ 12518], 60.00th=[ 15401], | 70.00th=[ 19268], 80.00th=[ 24249], 90.00th=[ 30802], 95.00th=[ 38536], | 99.00th=[ 51643], 99.50th=[ 58459], 99.90th=[ 93848], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 19, max= 216, per=25.29%, avg=119.37, stdev=40.23, samples=104 iops : min= 4, max= 54, avg=29.50, stdev=10.12, samples=104 lat (usec) : 50=0.20%, 100=0.23%, 250=0.75%, 750=0.03%, 1000=0.62% lat (msec) : 2=1.07%, 4=7.26%, 10=19.79%, 20=38.35%, 50=30.40% lat (msec) : 100=1.27%, 500=0.03% cpu : usr=0.10%, sys=25.33%, ctx=9075, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181628: Wed Apr 1 08:19:34 2026 read: IOPS=28, BW=114KiB/s (117kB/s)(6052KiB/53154msec) clat (usec): min=49, max=85318, avg=18544.99, stdev=9838.37 lat (usec): min=50, max=85319, avg=18545.57, stdev=9838.38 clat percentiles (usec): | 1.00th=[ 106], 5.00th=[ 6718], 10.00th=[ 8291], 20.00th=[10683], | 30.00th=[13042], 40.00th=[15008], 50.00th=[16712], 60.00th=[19006], | 70.00th=[21890], 80.00th=[25560], 90.00th=[31327], 95.00th=[37487], | 99.00th=[49021], 99.50th=[57410], 99.90th=[67634], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 26, max= 184, per=25.18%, avg=113.58, stdev=32.68, samples=105 iops : min= 6, max= 46, avg=28.05, stdev= 8.23, samples=105 write: IOPS=29, BW=117KiB/s (120kB/s)(6236KiB/53154msec); 0 zone resets clat (usec): min=714, max=446966, avg=16003.14, stdev=16342.16 lat (usec): min=714, max=446967, avg=16003.82, stdev=16342.17 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2311], 10.00th=[ 2900], 20.00th=[ 4555], | 30.00th=[ 7242], 40.00th=[ 10159], 50.00th=[ 13042], 60.00th=[ 16319], | 70.00th=[ 20055], 80.00th=[ 25297], 90.00th=[ 32637], 95.00th=[ 39584], | 99.00th=[ 53740], 99.50th=[ 58459], 99.90th=[ 81265], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 26, max= 199, per=24.84%, avg=117.23, stdev=36.40, samples=105 iops : min= 6, max= 49, avg=28.96, stdev= 9.17, samples=105 lat (usec) : 50=0.03%, 100=0.42%, 250=0.62%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.46% lat (msec) : 2=1.17%, 4=6.84%, 10=18.75%, 20=38.70%, 50=31.48% lat (msec) : 100=1.37%, 500=0.03% cpu : usr=0.08%, sys=25.18%, ctx=9141, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=452KiB/s (463kB/s), 113KiB/s-115KiB/s (115kB/s-118kB/s), io=23.4MiB (24.6MB), run=51843-53154msec WRITE: bw=473KiB/s (484kB/s), 117KiB/s-122KiB/s (120kB/s-125kB/s), io=24.6MiB (25.7MB), run=51843-53154msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181621: Wed Apr 1 08:19:41 2026 read: IOPS=24, BW=99.3KiB/s (102kB/s)(5992KiB/60353msec) clat (msec): min=2, max=448, avg=17.28, stdev=17.72 lat (msec): min=2, max=448, avg=17.28, stdev=17.72 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 48], | 99.00th=[ 63], 99.50th=[ 71], 99.90th=[ 115], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 19, max= 367, per=24.95%, avg=99.03, stdev=71.62, samples=120 iops : min= 4, max= 91, avg=24.42, stdev=18.01, samples=120 write: IOPS=26, BW=104KiB/s (107kB/s)(6296KiB/60353msec); 0 zone resets clat (msec): min=4, max=111, avg=21.79, stdev=16.03 lat (msec): min=4, max=111, avg=21.79, stdev=16.03 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 80], 99.50th=[ 87], 99.90th=[ 97], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 31, max= 344, per=25.26%, avg=104.82, stdev=71.90, samples=119 iops : min= 7, max= 86, avg=25.87, stdev=18.09, samples=119 lat (msec) : 4=1.43%, 10=33.85%, 20=28.87%, 50=31.25%, 100=4.49% lat (msec) : 250=0.07%, 500=0.03% cpu : usr=0.07%, sys=13.82%, ctx=6215, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181622: Wed Apr 1 08:19:41 2026 read: IOPS=24, BW=98.2KiB/s (101kB/s)(5940KiB/60465msec) clat (msec): min=2, max=446, avg=17.88, stdev=18.07 lat (msec): min=2, max=446, avg=17.89, stdev=18.07 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 66], 99.50th=[ 73], 99.90th=[ 89], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 6, max= 352, per=24.55%, avg=97.47, stdev=71.52, samples=120 iops : min= 1, max= 88, avg=24.03, stdev=18.00, samples=120 write: IOPS=26, BW=105KiB/s (108kB/s)(6348KiB/60465msec); 0 zone resets clat (msec): min=4, max=131, avg=21.26, stdev=15.36 lat (msec): min=4, max=131, avg=21.26, stdev=15.36 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 74], 99.50th=[ 83], 99.90th=[ 92], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 6, max= 352, per=24.98%, avg=103.65, stdev=73.02, samples=120 iops : min= 1, max= 88, avg=25.57, stdev=18.36, samples=120 lat (msec) : 4=1.92%, 10=33.37%, 20=27.31%, 50=32.58%, 100=4.75% lat (msec) : 250=0.03%, 500=0.03% cpu : usr=0.06%, sys=13.59%, ctx=6191, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181623: Wed Apr 1 08:19:41 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(6028KiB/59990msec) clat (usec): min=2891, max=89198, avg=17224.78, stdev=13873.49 lat (usec): min=2891, max=89198, avg=17225.44, stdev=13873.50 clat percentiles (usec): | 1.00th=[ 3523], 5.00th=[ 4293], 10.00th=[ 4948], 20.00th=[ 6390], | 30.00th=[ 8094], 40.00th=[10290], 50.00th=[12649], 60.00th=[15795], | 70.00th=[19530], 80.00th=[25822], 90.00th=[38011], 95.00th=[46400], | 99.00th=[65274], 99.50th=[73925], 99.90th=[84411], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 24, max= 375, per=25.42%, avg=100.90, stdev=71.87, samples=118 iops : min= 6, max= 93, avg=24.88, stdev=18.07, samples=118 write: IOPS=26, BW=104KiB/s (107kB/s)(6260KiB/59990msec); 0 zone resets clat (msec): min=4, max=453, avg=21.65, stdev=18.58 lat (msec): min=4, max=453, avg=21.65, stdev=18.58 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 52], | 99.00th=[ 75], 99.50th=[ 85], 99.90th=[ 132], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 13, max= 336, per=24.99%, avg=103.72, stdev=67.00, samples=119 iops : min= 3, max= 84, avg=25.59, stdev=16.84, samples=119 lat (msec) : 4=1.33%, 10=31.64%, 20=30.79%, 50=31.61%, 100=4.46% lat (msec) : 250=0.13%, 500=0.03% cpu : usr=0.06%, sys=13.95%, ctx=6222, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181624: Wed Apr 1 08:19:41 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(6052KiB/60316msec) clat (usec): min=3082, max=82003, avg=17594.10, stdev=13671.84 lat (usec): min=3083, max=82003, avg=17594.74, stdev=13671.89 clat percentiles (usec): | 1.00th=[ 3752], 5.00th=[ 4490], 10.00th=[ 5080], 20.00th=[ 6259], | 30.00th=[ 7701], 40.00th=[10159], 50.00th=[13304], 60.00th=[16581], | 70.00th=[20841], 80.00th=[27919], 90.00th=[37487], 95.00th=[45876], | 99.00th=[61604], 99.50th=[68682], 99.90th=[79168], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 24, max= 400, per=25.69%, avg=101.98, stdev=70.72, samples=118 iops : min= 6, max= 100, avg=25.15, stdev=17.77, samples=118 write: IOPS=25, BW=103KiB/s (106kB/s)(6236KiB/60316msec); 0 zone resets clat (msec): min=4, max=449, avg=21.51, stdev=18.35 lat (msec): min=4, max=449, avg=21.51, stdev=18.35 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 50], | 99.00th=[ 74], 99.50th=[ 83], 99.90th=[ 103], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 13, max= 359, per=24.86%, avg=103.18, stdev=71.17, samples=120 iops : min= 3, max= 89, avg=25.46, stdev=17.90, samples=120 lat (msec) : 4=0.88%, 10=33.17%, 20=27.96%, 50=33.98%, 100=3.91% lat (msec) : 250=0.07%, 500=0.03% cpu : usr=0.07%, sys=13.85%, ctx=6227, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=397KiB/s (407kB/s), 98.2KiB/s-100KiB/s (101kB/s-103kB/s), io=23.4MiB (24.6MB), run=59990-60465msec WRITE: bw=416KiB/s (426kB/s), 103KiB/s-105KiB/s (106kB/s-108kB/s), io=24.6MiB (25.7MB), run=59990-60465msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181657: Wed Apr 1 08:20:04 2026 read: IOPS=23, BW=374KiB/s (383kB/s)(5920KiB/15822msec) clat (usec): min=54, max=64831, avg=21113.30, stdev=11987.95 lat (usec): min=55, max=64832, avg=21113.92, stdev=11988.00 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 178], 10.00th=[ 9241], 20.00th=[11994], | 30.00th=[14353], 40.00th=[16581], 50.00th=[19006], 60.00th=[22414], | 70.00th=[25822], 80.00th=[29754], 90.00th=[36439], 95.00th=[43254], | 99.00th=[60031], 99.50th=[60556], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 159, max= 669, per=24.60%, avg=368.77, stdev=132.27, samples=31 iops : min= 9, max= 41, avg=22.55, stdev= 8.45, samples=31 write: IOPS=25, BW=402KiB/s (412kB/s)(6368KiB/15822msec); 0 zone resets clat (usec): min=1075, max=68726, avg=19820.76, stdev=12792.73 lat (usec): min=1076, max=68727, avg=19821.85, stdev=12792.82 clat percentiles (usec): | 1.00th=[ 2278], 5.00th=[ 3818], 10.00th=[ 4817], 20.00th=[ 8586], | 30.00th=[11469], 40.00th=[15139], 50.00th=[17695], 60.00th=[20317], | 70.00th=[23725], 80.00th=[28705], 90.00th=[38011], 95.00th=[45876], | 99.00th=[60031], 99.50th=[65799], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 160, max= 672, per=25.44%, avg=401.23, stdev=119.37, samples=31 iops : min= 10, max= 42, avg=24.58, stdev= 7.58, samples=31 lat (usec) : 100=1.04%, 250=2.08% lat (msec) : 2=0.26%, 4=2.99%, 10=12.76%, 20=37.37%, 50=40.76% lat (msec) : 100=2.73% cpu : usr=0.07%, sys=28.58%, ctx=2934, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181658: Wed Apr 1 08:20:04 2026 read: IOPS=22, BW=360KiB/s (369kB/s)(5744KiB/15961msec) clat (usec): min=40, max=76073, avg=21852.42, stdev=12218.25 lat (usec): min=40, max=76074, avg=21853.02, stdev=12218.29 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 215], 10.00th=[ 9110], 20.00th=[13173], | 30.00th=[15008], 40.00th=[17957], 50.00th=[20317], 60.00th=[22676], | 70.00th=[25560], 80.00th=[30802], 90.00th=[36963], 95.00th=[47449], | 99.00th=[56361], 99.50th=[66323], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 96, max= 640, per=23.96%, avg=359.23, stdev=128.16, samples=31 iops : min= 6, max= 40, avg=21.97, stdev= 8.02, samples=31 write: IOPS=25, BW=410KiB/s (420kB/s)(6544KiB/15961msec); 0 zone resets clat (usec): min=1078, max=88611, avg=19751.16, stdev=13794.04 lat (usec): min=1079, max=88613, avg=19752.31, stdev=13794.16 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 3720], 10.00th=[ 4555], 20.00th=[ 8291], | 30.00th=[10683], 40.00th=[13173], 50.00th=[16712], 60.00th=[20579], | 70.00th=[25297], 80.00th=[30016], 90.00th=[38011], 95.00th=[46924], | 99.00th=[60556], 99.50th=[67634], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 127, max= 768, per=25.60%, avg=403.68, stdev=127.66, samples=31 iops : min= 7, max= 48, avg=24.74, stdev= 8.20, samples=31 lat (usec) : 50=0.13%, 100=0.65%, 250=1.82% lat (msec) : 2=0.91%, 4=2.60%, 10=13.54%, 20=35.16%, 50=41.28% lat (msec) : 100=3.91% cpu : usr=0.06%, sys=27.94%, ctx=3122, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181659: Wed Apr 1 08:20:04 2026 read: IOPS=24, BW=392KiB/s (401kB/s)(6256KiB/15973msec) clat (usec): min=58, max=97578, avg=21439.37, stdev=12727.87 lat (usec): min=58, max=97580, avg=21440.10, stdev=12728.07 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 167], 10.00th=[ 7832], 20.00th=[10683], | 30.00th=[14222], 40.00th=[17433], 50.00th=[20055], 60.00th=[23200], | 70.00th=[26608], 80.00th=[31065], 90.00th=[37487], 95.00th=[44303], | 99.00th=[56886], 99.50th=[61080], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 191, max= 704, per=25.99%, avg=389.52, stdev=116.85, samples=31 iops : min= 11, max= 44, avg=23.84, stdev= 7.47, samples=31 write: IOPS=23, BW=378KiB/s (387kB/s)(6032KiB/15973msec); 0 zone resets clat (usec): min=1121, max=80182, avg=19891.62, stdev=13359.61 lat (usec): min=1122, max=80185, avg=19893.02, stdev=13360.02 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 4047], 10.00th=[ 5800], 20.00th=[ 8586], | 30.00th=[10683], 40.00th=[13304], 50.00th=[17695], 60.00th=[20841], | 70.00th=[24773], 80.00th=[30016], 90.00th=[36963], 95.00th=[45351], | 99.00th=[69731], 99.50th=[80217], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 128, max= 832, per=23.38%, avg=368.65, stdev=141.37, samples=31 iops : min= 8, max= 52, avg=22.55, stdev= 8.88, samples=31 lat (usec) : 100=1.17%, 250=2.73% lat (msec) : 2=0.26%, 4=1.95%, 10=15.89%, 20=31.12%, 50=44.53% lat (msec) : 100=2.34% cpu : usr=0.09%, sys=27.54%, ctx=2916, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181660: Wed Apr 1 08:20:04 2026 read: IOPS=24, BW=386KiB/s (395kB/s)(6032KiB/15625msec) clat (usec): min=69, max=64943, avg=21094.34, stdev=11616.62 lat (usec): min=70, max=64943, avg=21094.96, stdev=11616.65 clat percentiles (usec): | 1.00th=[ 83], 5.00th=[ 178], 10.00th=[ 8717], 20.00th=[11469], | 30.00th=[14091], 40.00th=[17433], 50.00th=[20055], 60.00th=[22676], | 70.00th=[25560], 80.00th=[30278], 90.00th=[37487], 95.00th=[42206], | 99.00th=[52691], 99.50th=[54264], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 183, max= 800, per=25.17%, avg=377.30, stdev=135.52, samples=30 iops : min= 11, max= 50, avg=23.07, stdev= 8.69, samples=30 write: IOPS=25, BW=400KiB/s (410kB/s)(6256KiB/15625msec); 0 zone resets clat (usec): min=1004, max=63903, avg=19314.76, stdev=13139.96 lat (usec): min=1004, max=63904, avg=19315.96, stdev=13139.99 clat percentiles (usec): | 1.00th=[ 2180], 5.00th=[ 3458], 10.00th=[ 4359], 20.00th=[ 7570], | 30.00th=[10290], 40.00th=[13304], 50.00th=[16712], 60.00th=[20317], | 70.00th=[24249], 80.00th=[30278], 90.00th=[36963], 95.00th=[44827], | 99.00th=[60556], 99.50th=[61080], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 192, max= 764, per=24.82%, avg=391.40, stdev=132.82, samples=30 iops : min= 12, max= 47, avg=23.97, stdev= 8.43, samples=30 lat (usec) : 100=1.04%, 250=2.08%, 500=0.13%, 750=0.13% lat (msec) : 2=0.26%, 4=4.17%, 10=14.19%, 20=32.29%, 50=43.23% lat (msec) : 100=2.47% cpu : usr=0.11%, sys=27.79%, ctx=2977, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1500KiB/s (1536kB/s), 360KiB/s-392KiB/s (369kB/s-401kB/s), io=23.4MiB (24.5MB), run=15625-15973msec WRITE: bw=1578KiB/s (1616kB/s), 378KiB/s-410KiB/s (387kB/s-420kB/s), io=24.6MiB (25.8MB), run=15625-15973msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181652: Wed Apr 1 08:20:06 2026 read: IOPS=20, BW=332KiB/s (339kB/s)(5920KiB/17858msec) clat (usec): min=5374, max=77039, avg=21139.24, stdev=14502.74 lat (usec): min=5375, max=77040, avg=21140.38, stdev=14502.46 clat percentiles (usec): | 1.00th=[ 5932], 5.00th=[ 6587], 10.00th=[ 7635], 20.00th=[ 9110], | 30.00th=[10552], 40.00th=[13042], 50.00th=[15926], 60.00th=[20579], | 70.00th=[25035], 80.00th=[32113], 90.00th=[44827], 95.00th=[51119], | 99.00th=[67634], 99.50th=[72877], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 158, max= 960, per=24.35%, avg=324.29, stdev=166.18, samples=35 iops : min= 9, max= 60, avg=19.77, stdev=10.50, samples=35 write: IOPS=22, BW=357KiB/s (365kB/s)(6368KiB/17858msec); 0 zone resets clat (msec): min=6, max=113, avg=25.11, stdev=14.94 lat (msec): min=6, max=113, avg=25.11, stdev=14.94 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 36], 90.00th=[ 47], 95.00th=[ 54], | 99.00th=[ 81], 99.50th=[ 92], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 94, max= 864, per=25.21%, avg=353.20, stdev=177.73, samples=35 iops : min= 5, max= 54, avg=21.57, stdev=11.26, samples=35 lat (msec) : 10=18.75%, 20=32.81%, 50=42.06%, 100=6.25%, 250=0.13% cpu : usr=0.10%, sys=14.77%, ctx=1727, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181653: Wed Apr 1 08:20:06 2026 read: IOPS=19, BW=320KiB/s (327kB/s)(5744KiB/17962msec) clat (usec): min=4000, max=93934, avg=20746.34, stdev=15157.35 lat (usec): min=4001, max=93934, avg=20747.18, stdev=15157.41 clat percentiles (usec): | 1.00th=[ 4883], 5.00th=[ 5997], 10.00th=[ 6980], 20.00th=[ 8848], | 30.00th=[10814], 40.00th=[13960], 50.00th=[16188], 60.00th=[18744], | 70.00th=[22938], 80.00th=[30016], 90.00th=[42206], 95.00th=[56886], | 99.00th=[71828], 99.50th=[77071], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 95, max= 832, per=23.53%, avg=313.40, stdev=158.60, samples=35 iops : min= 5, max= 52, avg=19.09, stdev=10.04, samples=35 write: IOPS=22, BW=364KiB/s (373kB/s)(6544KiB/17962msec); 0 zone resets clat (usec): min=6075, max=95592, avg=25571.86, stdev=15762.87 lat (usec): min=6077, max=95595, avg=25573.43, stdev=15762.94 clat percentiles (usec): | 1.00th=[ 7111], 5.00th=[ 8455], 10.00th=[ 9503], 20.00th=[11076], | 30.00th=[14091], 40.00th=[17433], 50.00th=[21365], 60.00th=[26084], | 70.00th=[31589], 80.00th=[38011], 90.00th=[49546], 95.00th=[55313], | 99.00th=[69731], 99.50th=[74974], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 190, max= 992, per=25.17%, avg=352.69, stdev=195.72, samples=35 iops : min= 11, max= 62, avg=21.54, stdev=12.39, samples=35 lat (msec) : 10=19.79%, 20=34.64%, 50=37.11%, 100=8.46% cpu : usr=0.09%, sys=14.32%, ctx=1805, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181654: Wed Apr 1 08:20:06 2026 read: IOPS=21, BW=348KiB/s (357kB/s)(6256KiB/17969msec) clat (usec): min=3085, max=85096, avg=21164.16, stdev=15975.38 lat (usec): min=3085, max=85097, avg=21164.86, stdev=15975.47 clat percentiles (usec): | 1.00th=[ 4621], 5.00th=[ 6194], 10.00th=[ 6915], 20.00th=[ 8717], | 30.00th=[10552], 40.00th=[11994], 50.00th=[15139], 60.00th=[18744], | 70.00th=[25035], 80.00th=[31327], 90.00th=[45351], 95.00th=[55313], | 99.00th=[74974], 99.50th=[84411], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 127, max= 1088, per=25.73%, avg=342.74, stdev=212.12, samples=35 iops : min= 7, max= 68, avg=20.91, stdev=13.44, samples=35 write: IOPS=20, BW=336KiB/s (344kB/s)(6032KiB/17969msec); 0 zone resets clat (usec): min=5355, max=92431, avg=25640.01, stdev=15864.85 lat (usec): min=5357, max=92433, avg=25641.82, stdev=15864.78 clat percentiles (usec): | 1.00th=[ 6456], 5.00th=[ 8225], 10.00th=[ 9372], 20.00th=[10814], | 30.00th=[13304], 40.00th=[16909], 50.00th=[22152], 60.00th=[27919], | 70.00th=[31327], 80.00th=[37487], 90.00th=[48497], 95.00th=[57934], | 99.00th=[71828], 99.50th=[82314], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 126, max= 896, per=22.96%, avg=321.63, stdev=165.38, samples=35 iops : min= 7, max= 56, avg=19.60, stdev=10.51, samples=35 lat (msec) : 4=0.13%, 10=20.44%, 20=32.68%, 50=38.54%, 100=8.20% cpu : usr=0.06%, sys=14.30%, ctx=1754, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181655: Wed Apr 1 08:20:06 2026 read: IOPS=20, BW=335KiB/s (344kB/s)(6032KiB/17981msec) clat (usec): min=3131, max=96763, avg=21444.94, stdev=16241.08 lat (usec): min=3132, max=96763, avg=21445.58, stdev=16241.13 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 6063], 10.00th=[ 7177], 20.00th=[ 8455], | 30.00th=[10159], 40.00th=[13042], 50.00th=[15664], 60.00th=[20317], | 70.00th=[24773], 80.00th=[32375], 90.00th=[46400], 95.00th=[57934], | 99.00th=[71828], 99.50th=[77071], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 992, per=24.27%, avg=323.23, stdev=193.62, samples=35 iops : min= 3, max= 62, avg=19.69, stdev=12.26, samples=35 write: IOPS=21, BW=348KiB/s (356kB/s)(6256KiB/17981msec); 0 zone resets clat (msec): min=6, max=116, avg=25.14, stdev=15.79 lat (msec): min=6, max=116, avg=25.14, stdev=15.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 37], 90.00th=[ 47], 95.00th=[ 53], | 99.00th=[ 75], 99.50th=[ 81], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 128, max= 832, per=24.12%, avg=337.89, stdev=166.86, samples=35 iops : min= 8, max= 52, avg=20.60, stdev=10.58, samples=35 lat (msec) : 4=0.52%, 10=21.61%, 20=31.25%, 50=39.19%, 100=7.29% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=14.29%, ctx=1752, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1332KiB/s (1364kB/s), 320KiB/s-348KiB/s (327kB/s-357kB/s), io=23.4MiB (24.5MB), run=17858-17981msec WRITE: bw=1401KiB/s (1435kB/s), 336KiB/s-364KiB/s (344kB/s-373kB/s), io=24.6MiB (25.8MB), run=17858-17981msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181668: Wed Apr 1 08:20:15 2026 read: IOPS=3, BW=4054KiB/s (4152kB/s)(7168KiB/1768msec) clat (msec): min=45, max=417, avg=125.02, stdev=130.99 lat (msec): min=45, max=417, avg=125.03, stdev=130.99 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 57], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 83], 60.00th=[ 84], | 70.00th=[ 84], 80.00th=[ 118], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2048, max= 4946, per=45.23%, avg=3656.67, stdev=1475.15, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2896KiB/s (2965kB/s)(5120KiB/1768msec); 0 zone resets clat (msec): min=54, max=526, avg=170.28, stdev=200.02 lat (msec): min=54, max=526, avg=170.35, stdev=200.02 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 55], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 95], 60.00th=[ 95], | 70.00th=[ 108], 80.00th=[ 108], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1648, max= 6144, per=34.42%, avg=3896.00, stdev=3179.15, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 50=8.33%, 100=58.33%, 250=16.67%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=19.02%, ctx=103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181669: Wed Apr 1 08:20:15 2026 read: IOPS=0, BW=844KiB/s (864kB/s)(2048KiB/2426msec) clat (usec): min=53875, max=71135, avg=62505.48, stdev=12204.78 lat (usec): min=53876, max=71137, avg=62507.05, stdev=12205.06 clat percentiles (usec): | 1.00th=[53740], 5.00th=[53740], 10.00th=[53740], 20.00th=[53740], | 30.00th=[53740], 40.00th=[53740], 50.00th=[53740], 60.00th=[70779], | 70.00th=[70779], 80.00th=[70779], 90.00th=[70779], 95.00th=[70779], | 99.00th=[70779], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 1651, max= 2048, per=22.88%, avg=1849.50, stdev=280.72, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=4, BW=4221KiB/s (4322kB/s)(10.0MiB/2426msec); 0 zone resets clat (msec): min=65, max=488, avg=227.17, stdev=150.53 lat (msec): min=66, max=488, avg=227.22, stdev=150.52 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 71], | 30.00th=[ 114], 40.00th=[ 153], 50.00th=[ 176], 60.00th=[ 194], | 70.00th=[ 268], 80.00th=[ 275], 90.00th=[ 468], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1651, max= 5965, per=30.39%, avg=3440.00, stdev=1995.34, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.83, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=18.93%, ctx=116, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181670: Wed Apr 1 08:20:15 2026 read: IOPS=2, BW=2426KiB/s (2484kB/s)(6144KiB/2533msec) clat (msec): min=27, max=217, avg=127.85, stdev=83.24 lat (msec): min=27, max=217, avg=127.85, stdev=83.24 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 28], 10.00th=[ 28], 20.00th=[ 42], | 30.00th=[ 42], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 176], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 1988, max= 2048, per=24.96%, avg=2018.00, stdev=42.43, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2426KiB/s (2484kB/s)(6144KiB/2533msec); 0 zone resets clat (msec): min=43, max=841, avg=290.12, stdev=331.01 lat (msec): min=43, max=841, avg=290.19, stdev=331.02 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 46], | 30.00th=[ 46], 40.00th=[ 46], 50.00th=[ 46], 60.00th=[ 230], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1988, max= 3297, per=21.59%, avg=2444.33, stdev=739.04, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=41.67%, 100=8.33%, 250=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=18.40%, ctx=151, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181671: Wed Apr 1 08:20:15 2026 read: IOPS=2, BW=2718KiB/s (2783kB/s)(5120KiB/1884msec) clat (msec): min=42, max=296, avg=183.82, stdev=127.20 lat (msec): min=42, max=296, avg=183.82, stdev=127.20 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 51], 40.00th=[ 51], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 3976, max= 4096, per=49.92%, avg=4036.00, stdev=84.85, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3805KiB/s (3896kB/s)(7168KiB/1884msec); 0 zone resets clat (msec): min=42, max=256, avg=136.18, stdev=84.88 lat (msec): min=42, max=256, avg=136.24, stdev=84.89 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 75], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 111], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 247], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 6606, max= 6606, per=58.36%, avg=6606.00, stdev= 0.00, samples=1 iops : min= 6, max= 6, avg= 6.00, stdev= 0.00, samples=1 lat (msec) : 50=16.67%, 100=25.00%, 250=33.33%, 500=25.00% cpu : usr=0.00%, sys=18.37%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8085KiB/s (8279kB/s), 844KiB/s-4054KiB/s (864kB/s-4152kB/s), io=20.0MiB (20.0MB), run=1768-2533msec WRITE: bw=11.1MiB/s (11.6MB/s), 2426KiB/s-4221KiB/s (2484kB/s-4322kB/s), io=28.0MiB (29.4MB), run=1768-2533msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181673: Wed Apr 1 08:20:15 2026 read: IOPS=3, BW=3391KiB/s (3472kB/s)(7168KiB/2114msec) clat (usec): min=473, max=301966, avg=123232.72, stdev=92974.59 lat (usec): min=475, max=301968, avg=123233.99, stdev=92974.55 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 79168], | 30.00th=[ 90702], 40.00th=[ 90702], 50.00th=[ 95945], 60.00th=[145753], | 70.00th=[145753], 80.00th=[147850], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 4007, max= 5197, per=54.27%, avg=4602.00, stdev=841.46, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2422KiB/s (2480kB/s)(5120KiB/2114msec); 0 zone resets clat (msec): min=88, max=661, avg=238.95, stdev=237.82 lat (msec): min=88, max=661, avg=239.01, stdev=237.81 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1732, max= 1732, per=14.59%, avg=1732.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (usec) : 500=8.33% lat (msec) : 100=33.33%, 250=41.67%, 500=8.33%, 750=8.33% cpu : usr=0.05%, sys=44.82%, ctx=880, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181674: Wed Apr 1 08:20:15 2026 read: IOPS=0, BW=848KiB/s (868kB/s)(2048KiB/2415msec) clat (usec): min=504, max=108790, avg=54647.63, stdev=76569.65 lat (usec): min=505, max=108792, avg=54648.87, stdev=76569.99 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[108528], | 70.00th=[108528], 80.00th=[108528], 90.00th=[108528], 95.00th=[108528], | 99.00th=[108528], 99.50th=[108528], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 1703, max= 1935, per=21.45%, avg=1819.00, stdev=164.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=4, BW=4240KiB/s (4342kB/s)(10.0MiB/2415msec); 0 zone resets clat (msec): min=62, max=451, avg=228.82, stdev=135.16 lat (msec): min=63, max=451, avg=228.88, stdev=135.14 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 97], | 30.00th=[ 130], 40.00th=[ 161], 50.00th=[ 178], 60.00th=[ 213], | 70.00th=[ 218], 80.00th=[ 384], 90.00th=[ 397], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1703, max= 4096, per=28.80%, avg=3419.25, stdev=1147.90, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=43.95%, ctx=457, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181675: Wed Apr 1 08:20:15 2026 read: IOPS=3, BW=3279KiB/s (3357kB/s)(6144KiB/1874msec) clat (usec): min=315, max=108254, avg=47466.53, stdev=46830.23 lat (usec): min=317, max=108255, avg=47467.60, stdev=46830.10 clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 318], 10.00th=[ 318], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 35390], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 99091], 80.00th=[ 99091], 90.00th=[108528], 95.00th=[108528], | 99.00th=[108528], 99.50th=[108528], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 4007, max= 5807, per=57.87%, avg=4907.00, stdev=1272.79, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=3, BW=3279KiB/s (3357kB/s)(6144KiB/1874msec); 0 zone resets clat (msec): min=103, max=447, avg=252.68, stdev=141.05 lat (msec): min=103, max=447, avg=252.75, stdev=141.05 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 264], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2003, max= 3871, per=26.30%, avg=3122.67, stdev=987.81, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=16.67%, 100=8.33%, 250=33.33%, 500=25.00% cpu : usr=0.05%, sys=42.93%, ctx=550, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181676: Wed Apr 1 08:20:15 2026 read: IOPS=2, BW=2538KiB/s (2599kB/s)(5120KiB/2017msec) clat (usec): min=475, max=152274, avg=73548.76, stdev=60042.82 lat (usec): min=476, max=152275, avg=73549.56, stdev=60042.78 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 39060], 40.00th=[ 39060], 50.00th=[ 62653], 60.00th=[ 62653], | 70.00th=[113771], 80.00th=[113771], 90.00th=[152044], 95.00th=[152044], | 99.00th=[152044], 99.50th=[152044], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 7742, max= 7742, per=91.30%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3554KiB/s (3639kB/s)(7168KiB/2017msec); 0 zone resets clat (msec): min=90, max=399, avg=232.36, stdev=124.93 lat (msec): min=90, max=399, avg=232.42, stdev=124.93 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 111], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 279], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 342], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1750, max= 6011, per=32.69%, avg=3880.50, stdev=3012.98, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=46.23%, ctx=586, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8480KiB/s (8684kB/s), 848KiB/s-3391KiB/s (868kB/s-3472kB/s), io=20.0MiB (20.0MB), run=1874-2415msec WRITE: bw=11.6MiB/s (12.2MB/s), 2422KiB/s-4240KiB/s (2480kB/s-4342kB/s), io=28.0MiB (29.4MB), run=1874-2415msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181681: Wed Apr 1 08:20:23 2026 read: IOPS=1, BW=7493KiB/s (7673kB/s)(12.0MiB/1640msec) clat (msec): min=337, max=874, avg=520.54, stdev=306.72 lat (msec): min=337, max=874, avg=520.54, stdev=306.72 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8192, max= 8192, per=82.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=43.69%, ctx=3046, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181682: Wed Apr 1 08:20:23 2026 read: IOPS=0, BW=2634KiB/s (2697kB/s)(4096KiB/1555msec) clat (nsec): min=868582k, max=868582k, avg=868581713.00, stdev= 0.00 lat (nsec): min=868584k, max=868584k, avg=868583966.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8192, max= 8192, per=82.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5268KiB/s (5395kB/s)(8192KiB/1555msec); 0 zone resets clat (msec): min=279, max=320, avg=300.13, stdev=29.16 lat (msec): min=279, max=320, avg=300.40, stdev=29.13 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 8192, max= 8192, per=49.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.47%, ctx=965, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181683: Wed Apr 1 08:20:23 2026 write: IOPS=1, BW=6181KiB/s (6329kB/s)(12.0MiB/1988msec); 0 zone resets clat (msec): min=344, max=848, avg=649.20, stdev=267.97 lat (msec): min=344, max=859, avg=652.84, stdev=271.82 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=49.70%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.05%, sys=12.83%, ctx=193, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181684: Wed Apr 1 08:20:23 2026 write: IOPS=1, BW=6324KiB/s (6476kB/s)(12.0MiB/1943msec); 0 zone resets clat (msec): min=102, max=1563, avg=596.09, stdev=838.03 lat (msec): min=102, max=1563, avg=596.33, stdev=838.04 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 123], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min=15875, max=15875, per=96.32%, avg=15875.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.84%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9990KiB/s (10.2MB/s), 2634KiB/s-7493KiB/s (2697kB/s-7673kB/s), io=16.0MiB (16.8MB), run=1555-1640msec WRITE: bw=16.1MiB/s (16.9MB/s), 5268KiB/s-6324KiB/s (5395kB/s-6476kB/s), io=32.0MiB (33.6MB), run=1555-1988msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181686: Wed Apr 1 08:20:23 2026 read: IOPS=1, BW=6722KiB/s (6883kB/s)(12.0MiB/1828msec) clat (msec): min=190, max=1355, avg=589.94, stdev=663.14 lat (msec): min=190, max=1355, avg=589.94, stdev=663.14 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8192, max= 8192, per=91.41%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.92%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181687: Wed Apr 1 08:20:23 2026 read: IOPS=0, BW=2323KiB/s (2379kB/s)(4096KiB/1763msec) clat (nsec): min=1030.7M, max=1030.7M, avg=1030659793.00, stdev= 0.00 lat (nsec): min=1030.7M, max=1030.7M, avg=1030660632.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8192, max= 8192, per=91.41%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4647KiB/s (4758kB/s)(8192KiB/1763msec); 0 zone resets clat (msec): min=330, max=381, avg=356.14, stdev=36.33 lat (msec): min=330, max=381, avg=356.38, stdev=36.17 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 8192, max= 8192, per=51.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.26%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181688: Wed Apr 1 08:20:23 2026 write: IOPS=1, BW=5925KiB/s (6067kB/s)(12.0MiB/2074msec); 0 zone resets clat (msec): min=123, max=1550, avg=657.20, stdev=778.65 lat (msec): min=123, max=1550, avg=657.53, stdev=778.56 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8192, max= 8192, per=51.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.77%, ctx=89, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181689: Wed Apr 1 08:20:23 2026 write: IOPS=1, BW=6012KiB/s (6156kB/s)(12.0MiB/2044msec); 0 zone resets clat (msec): min=93, max=1683, avg=662.02, stdev=886.67 lat (msec): min=93, max=1683, avg=662.29, stdev=886.69 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min=16000, max=16000, per=100.00%, avg=16000.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 250=33.33%, 2000=33.33% cpu : usr=0.10%, sys=10.18%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8963KiB/s (9178kB/s), 2323KiB/s-6722KiB/s (2379kB/s-6883kB/s), io=16.0MiB (16.8MB), run=1763-1828msec WRITE: bw=15.4MiB/s (16.2MB/s), 4647KiB/s-6012KiB/s (4758kB/s-6156kB/s), io=32.0MiB (33.6MB), run=1763-2074msec