== sanity test 398b: DIO and buffer IO race ============== 23:01:15 (1775876475) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.60358 s, 19.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182552: Fri Apr 10 23:02:15 2026 read: IOPS=29, BW=118KiB/s (121kB/s)(5992KiB/50858msec) clat (usec): min=37, max=581086, avg=18789.57, stdev=17616.13 lat (usec): min=37, max=581087, avg=18790.52, stdev=17616.13 clat percentiles (usec): | 1.00th=[ 84], 5.00th=[ 6980], 10.00th=[ 8455], 20.00th=[ 10421], | 30.00th=[ 12387], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 22152], 80.00th=[ 25560], 90.00th=[ 29754], 95.00th=[ 35390], | 99.00th=[ 54264], 99.50th=[ 62129], 99.90th=[ 85459], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 6, max= 224, per=24.94%, avg=117.71, stdev=30.16, samples=101 iops : min= 1, max= 56, avg=29.01, stdev= 7.58, samples=101 write: IOPS=30, BW=124KiB/s (127kB/s)(6296KiB/50858msec); 0 zone resets clat (usec): min=834, max=70737, avg=14302.66, stdev=11730.42 lat (usec): min=835, max=70738, avg=14304.44, stdev=11729.79 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1991], 10.00th=[ 2474], 20.00th=[ 3195], | 30.00th=[ 5276], 40.00th=[ 9503], 50.00th=[11731], 60.00th=[14615], | 70.00th=[18220], 80.00th=[23200], 90.00th=[30278], 95.00th=[38536], | 99.00th=[51643], 99.50th=[55837], 99.90th=[68682], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 40, max= 224, per=25.25%, avg=124.74, stdev=33.31, samples=100 iops : min= 10, max= 56, avg=30.77, stdev= 8.38, samples=100 lat (usec) : 50=0.03%, 100=0.72%, 250=0.42%, 1000=0.13% lat (msec) : 2=2.51%, 4=10.84%, 10=15.36%, 20=38.44%, 50=30.40% lat (msec) : 100=1.11%, 750=0.03% cpu : usr=0.14%, sys=19.63%, ctx=8430, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182553: Fri Apr 10 23:02:15 2026 read: IOPS=29, BW=117KiB/s (120kB/s)(5940KiB/50559msec) clat (usec): min=38, max=93377, avg=18240.08, stdev=9928.41 lat (usec): min=39, max=93378, avg=18241.34, stdev=9928.28 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 7046], 10.00th=[ 8586], 20.00th=[10421], | 30.00th=[12387], 40.00th=[14222], 50.00th=[16450], 60.00th=[19006], | 70.00th=[21365], 80.00th=[24511], 90.00th=[30278], 95.00th=[35390], | 99.00th=[50594], 99.50th=[58983], 99.90th=[70779], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 6, max= 175, per=24.79%, avg=116.99, stdev=26.90, samples=100 iops : min= 1, max= 43, avg=28.82, stdev= 6.73, samples=100 write: IOPS=31, BW=126KiB/s (129kB/s)(6348KiB/50559msec); 0 zone resets clat (usec): min=804, max=577708, avg=14661.27, stdev=18500.71 lat (usec): min=804, max=577708, avg=14662.36, stdev=18500.71 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1860], 10.00th=[ 2442], 20.00th=[ 3130], | 30.00th=[ 4817], 40.00th=[ 9110], 50.00th=[ 11863], 60.00th=[ 14746], | 70.00th=[ 18744], 80.00th=[ 22938], 90.00th=[ 30802], 95.00th=[ 37487], | 99.00th=[ 51119], 99.50th=[ 59507], 99.90th=[ 84411], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 71, max= 240, per=25.46%, avg=125.78, stdev=33.63, samples=99 iops : min= 17, max= 60, avg=31.02, stdev= 8.49, samples=99 lat (usec) : 50=0.10%, 100=0.55%, 250=0.59%, 500=0.07%, 1000=0.13% lat (msec) : 2=2.86%, 4=10.68%, 10=15.23%, 20=38.70%, 50=29.92% lat (msec) : 100=1.14%, 750=0.03% cpu : usr=0.15%, sys=19.55%, ctx=8300, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182554: Fri Apr 10 23:02:15 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6028KiB/49666msec) clat (usec): min=36, max=73423, avg=17749.73, stdev=9264.49 lat (usec): min=36, max=73424, avg=17750.65, stdev=9264.50 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 7570], 10.00th=[ 8717], 20.00th=[10159], | 30.00th=[11863], 40.00th=[13829], 50.00th=[16057], 60.00th=[18482], | 70.00th=[21103], 80.00th=[24249], 90.00th=[29492], 95.00th=[33817], | 99.00th=[47449], 99.50th=[55313], 99.90th=[71828], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 71, max= 200, per=25.92%, avg=122.34, stdev=27.90, samples=97 iops : min= 17, max= 50, avg=30.16, stdev= 7.04, samples=97 write: IOPS=31, BW=126KiB/s (129kB/s)(6260KiB/49666msec); 0 zone resets clat (usec): min=799, max=607586, avg=14507.95, stdev=18905.53 lat (usec): min=801, max=607587, avg=14510.08, stdev=18905.13 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1975], 10.00th=[ 2507], 20.00th=[ 3326], | 30.00th=[ 5538], 40.00th=[ 8979], 50.00th=[ 11469], 60.00th=[ 14353], | 70.00th=[ 17957], 80.00th=[ 23200], 90.00th=[ 29754], 95.00th=[ 36439], | 99.00th=[ 50070], 99.50th=[ 60556], 99.90th=[ 67634], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 63, max= 200, per=25.66%, avg=126.77, stdev=29.27, samples=97 iops : min= 15, max= 50, avg=31.28, stdev= 7.31, samples=97 lat (usec) : 50=0.07%, 100=0.49%, 250=0.46%, 500=0.07%, 1000=0.23% lat (msec) : 2=2.47%, 4=10.03%, 10=18.26%, 20=38.09%, 50=28.94% lat (msec) : 100=0.88%, 750=0.03% cpu : usr=0.14%, sys=19.82%, ctx=8257, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182555: Fri Apr 10 23:02:15 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6052KiB/49881msec) clat (usec): min=37, max=71241, avg=17511.02, stdev=8853.37 lat (usec): min=38, max=71241, avg=17512.20, stdev=8853.80 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 6980], 10.00th=[ 8586], 20.00th=[10683], | 30.00th=[12256], 40.00th=[13960], 50.00th=[16057], 60.00th=[18220], | 70.00th=[20579], 80.00th=[23987], 90.00th=[28181], 95.00th=[33424], | 99.00th=[45876], 99.50th=[54264], 99.90th=[59507], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 55, max= 176, per=25.91%, avg=122.32, stdev=25.11, samples=98 iops : min= 13, max= 44, avg=30.15, stdev= 6.32, samples=98 write: IOPS=31, BW=125KiB/s (128kB/s)(6236KiB/49881msec); 0 zone resets clat (usec): min=773, max=602850, avg=14870.23, stdev=19155.12 lat (usec): min=773, max=602853, avg=14871.39, stdev=19155.13 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1909], 10.00th=[ 2409], 20.00th=[ 3163], | 30.00th=[ 5211], 40.00th=[ 8979], 50.00th=[ 12125], 60.00th=[ 14877], | 70.00th=[ 18744], 80.00th=[ 24249], 90.00th=[ 31327], 95.00th=[ 37487], | 99.00th=[ 54264], 99.50th=[ 62653], 99.90th=[ 81265], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 56, max= 216, per=25.47%, avg=125.82, stdev=29.82, samples=98 iops : min= 14, max= 54, avg=31.03, stdev= 7.46, samples=98 lat (usec) : 50=0.03%, 100=0.59%, 250=0.75%, 750=0.03%, 1000=0.20% lat (msec) : 2=2.86%, 4=10.06%, 10=15.49%, 20=40.36%, 50=28.65% lat (msec) : 100=0.94%, 750=0.03% cpu : usr=0.14%, sys=19.83%, ctx=8272, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=472KiB/s (483kB/s), 117KiB/s-121KiB/s (120kB/s-124kB/s), io=23.4MiB (24.6MB), run=49666-50858msec WRITE: bw=494KiB/s (506kB/s), 124KiB/s-126KiB/s (127kB/s-129kB/s), io=24.6MiB (25.7MB), run=49666-50858msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182557: Fri Apr 10 23:02:28 2026 read: IOPS=23, BW=94.3KiB/s (96.6kB/s)(5992KiB/63545msec) clat (msec): min=3, max=585, avg=17.87, stdev=19.76 lat (msec): min=3, max=585, avg=17.88, stdev=19.76 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 65], 99.50th=[ 75], 99.90th=[ 99], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 280, per=25.12%, avg=94.70, stdev=51.23, samples=125 iops : min= 1, max= 70, avg=23.33, stdev=12.93, samples=125 write: IOPS=24, BW=99.1KiB/s (101kB/s)(6296KiB/63545msec); 0 zone resets clat (msec): min=5, max=102, avg=23.28, stdev=14.04 lat (msec): min=5, max=102, avg=23.28, stdev=14.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 50], | 99.00th=[ 75], 99.50th=[ 87], 99.90th=[ 101], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 31, max= 256, per=25.21%, avg=99.57, stdev=48.32, samples=125 iops : min= 7, max= 64, avg=24.54, stdev=12.19, samples=125 lat (msec) : 4=0.36%, 10=22.14%, 20=39.42%, 50=34.05%, 100=3.97% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=9.48%, ctx=5566, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182558: Fri Apr 10 23:02:28 2026 read: IOPS=23, BW=93.4KiB/s (95.6kB/s)(5940KiB/63630msec) clat (msec): min=3, max=608, avg=17.59, stdev=20.37 lat (msec): min=3, max=608, avg=17.59, stdev=20.37 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 65], 99.50th=[ 81], 99.90th=[ 97], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 31, max= 256, per=24.87%, avg=93.74, stdev=51.56, samples=125 iops : min= 7, max= 64, avg=23.09, stdev=12.98, samples=125 write: IOPS=24, BW=99.8KiB/s (102kB/s)(6348KiB/63630msec); 0 zone resets clat (msec): min=5, max=118, avg=23.55, stdev=14.59 lat (msec): min=5, max=118, avg=23.55, stdev=14.59 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 75], 99.50th=[ 80], 99.90th=[ 100], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 31, max= 296, per=25.30%, avg=99.94, stdev=49.14, samples=125 iops : min= 7, max= 74, avg=24.64, stdev=12.42, samples=125 lat (msec) : 4=0.46%, 10=22.56%, 20=40.04%, 50=31.97%, 100=4.92% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=9.62%, ctx=5566, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182559: Fri Apr 10 23:02:28 2026 read: IOPS=23, BW=95.0KiB/s (97.3kB/s)(6028KiB/63449msec) clat (usec): min=3233, max=98887, avg=17359.07, stdev=13105.82 lat (usec): min=3234, max=98888, avg=17360.24, stdev=13105.78 clat percentiles (usec): | 1.00th=[ 3982], 5.00th=[ 5342], 10.00th=[ 6128], 20.00th=[ 7635], | 30.00th=[ 9372], 40.00th=[11338], 50.00th=[13042], 60.00th=[15270], | 70.00th=[18482], 80.00th=[24773], 90.00th=[35914], 95.00th=[43779], | 99.00th=[64226], 99.50th=[76022], 99.90th=[90702], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 15, max= 304, per=25.36%, avg=95.60, stdev=50.09, samples=125 iops : min= 3, max= 76, avg=23.55, stdev=12.64, samples=125 write: IOPS=24, BW=98.7KiB/s (101kB/s)(6260KiB/63449msec); 0 zone resets clat (msec): min=5, max=679, avg=23.74, stdev=22.00 lat (msec): min=5, max=679, avg=23.74, stdev=22.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 77], 99.50th=[ 88], 99.90th=[ 124], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 31, max= 264, per=25.14%, avg=99.30, stdev=48.91, samples=125 iops : min= 7, max= 66, avg=24.48, stdev=12.34, samples=125 lat (msec) : 4=0.52%, 10=21.48%, 20=40.82%, 50=32.71%, 100=4.39% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=9.68%, ctx=5619, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182560: Fri Apr 10 23:02:28 2026 read: IOPS=23, BW=95.4KiB/s (97.7kB/s)(6052KiB/63446msec) clat (usec): min=3058, max=84493, avg=17285.81, stdev=13099.73 lat (usec): min=3059, max=84494, avg=17288.27, stdev=13099.69 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5276], 10.00th=[ 6128], 20.00th=[ 7504], | 30.00th=[ 9241], 40.00th=[10945], 50.00th=[12911], 60.00th=[15139], | 70.00th=[19006], 80.00th=[24511], 90.00th=[35914], 95.00th=[45876], | 99.00th=[63177], 99.50th=[71828], 99.90th=[83362], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 16, max= 296, per=25.48%, avg=96.05, stdev=51.49, samples=125 iops : min= 4, max= 74, avg=23.66, stdev=12.98, samples=125 write: IOPS=24, BW=98.3KiB/s (101kB/s)(6236KiB/63446msec); 0 zone resets clat (msec): min=5, max=644, avg=23.83, stdev=21.57 lat (msec): min=5, max=644, avg=23.83, stdev=21.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 54], | 99.00th=[ 75], 99.50th=[ 88], 99.90th=[ 100], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 23, max= 272, per=25.01%, avg=98.80, stdev=49.02, samples=125 iops : min= 5, max= 68, avg=24.35, stdev=12.39, samples=125 lat (msec) : 4=0.29%, 10=22.49%, 20=40.14%, 50=31.87%, 100=5.18% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=9.71%, ctx=5609, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=377KiB/s (386kB/s), 93.4KiB/s-95.4KiB/s (95.6kB/s-97.7kB/s), io=23.4MiB (24.6MB), run=63446-63630msec WRITE: bw=395KiB/s (405kB/s), 98.3KiB/s-99.8KiB/s (101kB/s-102kB/s), io=24.6MiB (25.7MB), run=63446-63630msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182586: Fri Apr 10 23:02:47 2026 read: IOPS=27, BW=445KiB/s (456kB/s)(5920KiB/13307msec) clat (usec): min=57, max=80102, avg=18251.81, stdev=10493.62 lat (usec): min=58, max=80103, avg=18253.09, stdev=10493.36 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 121], 10.00th=[ 8029], 20.00th=[10814], | 30.00th=[13042], 40.00th=[14746], 50.00th=[16909], 60.00th=[19268], | 70.00th=[22152], 80.00th=[25297], 90.00th=[30278], 95.00th=[35390], | 99.00th=[49021], 99.50th=[58459], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 287, max= 704, per=26.04%, avg=439.85, stdev=98.76, samples=26 iops : min= 17, max= 44, avg=27.19, stdev= 6.18, samples=26 write: IOPS=29, BW=479KiB/s (490kB/s)(6368KiB/13307msec); 0 zone resets clat (usec): min=1520, max=76041, avg=16349.06, stdev=11407.29 lat (usec): min=1522, max=76054, avg=16350.91, stdev=11407.46 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 3425], 10.00th=[ 4178], 20.00th=[ 5538], | 30.00th=[ 8356], 40.00th=[11076], 50.00th=[13435], 60.00th=[17171], | 70.00th=[21365], 80.00th=[26346], 90.00th=[32375], 95.00th=[36963], | 99.00th=[47449], 99.50th=[59507], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 319, max= 704, per=26.95%, avg=479.19, stdev=92.99, samples=26 iops : min= 19, max= 44, avg=29.65, stdev= 6.05, samples=26 lat (usec) : 100=1.30%, 250=2.60% lat (msec) : 2=1.04%, 4=3.65%, 10=16.15%, 20=39.84%, 50=34.77% lat (msec) : 100=0.65% cpu : usr=0.12%, sys=23.56%, ctx=2423, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182588: Fri Apr 10 23:02:47 2026 read: IOPS=25, BW=415KiB/s (425kB/s)(5744KiB/13839msec) clat (usec): min=76, max=51324, avg=19302.61, stdev=8839.27 lat (usec): min=77, max=51325, avg=19303.56, stdev=8839.27 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 7767], 10.00th=[ 9241], 20.00th=[12125], | 30.00th=[14222], 40.00th=[16450], 50.00th=[18744], 60.00th=[21103], | 70.00th=[23200], 80.00th=[26346], 90.00th=[30016], 95.00th=[33817], | 99.00th=[43779], 99.50th=[51119], 99.90th=[51119], 99.95th=[51119], | 99.99th=[51119] bw ( KiB/s): min= 223, max= 608, per=24.49%, avg=413.59, stdev=102.84, samples=27 iops : min= 13, max= 38, avg=25.56, stdev= 6.61, samples=27 write: IOPS=29, BW=473KiB/s (484kB/s)(6544KiB/13839msec); 0 zone resets clat (usec): min=1091, max=78222, avg=16667.86, stdev=12510.03 lat (usec): min=1092, max=78223, avg=16669.72, stdev=12510.04 clat percentiles (usec): | 1.00th=[ 2147], 5.00th=[ 3294], 10.00th=[ 3818], 20.00th=[ 5211], | 30.00th=[ 7963], 40.00th=[11076], 50.00th=[13435], 60.00th=[16581], | 70.00th=[21103], 80.00th=[26608], 90.00th=[33817], 95.00th=[41157], | 99.00th=[55837], 99.50th=[58983], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 288, max= 672, per=26.09%, avg=463.96, stdev=98.35, samples=27 iops : min= 18, max= 42, avg=28.74, stdev= 6.19, samples=27 lat (usec) : 100=0.78%, 250=1.17% lat (msec) : 2=0.26%, 4=5.73%, 10=16.67%, 20=37.37%, 50=36.46% lat (msec) : 100=1.56% cpu : usr=0.11%, sys=23.58%, ctx=2563, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182590: Fri Apr 10 23:02:47 2026 read: IOPS=27, BW=441KiB/s (452kB/s)(6256KiB/14173msec) clat (usec): min=52, max=56054, avg=18522.40, stdev=9509.19 lat (usec): min=53, max=56055, avg=18523.53, stdev=9509.17 clat percentiles (usec): | 1.00th=[ 79], 5.00th=[ 113], 10.00th=[ 8848], 20.00th=[11469], | 30.00th=[13829], 40.00th=[15533], 50.00th=[17695], 60.00th=[20055], | 70.00th=[22676], 80.00th=[25822], 90.00th=[29230], 95.00th=[35390], | 99.00th=[49021], 99.50th=[54264], 99.90th=[55837], 99.95th=[55837], | 99.99th=[55837] bw ( KiB/s): min= 160, max= 800, per=26.15%, avg=441.75, stdev=146.70, samples=28 iops : min= 10, max= 50, avg=27.32, stdev= 9.14, samples=28 write: IOPS=26, BW=426KiB/s (436kB/s)(6032KiB/14173msec); 0 zone resets clat (usec): min=1401, max=72768, avg=18119.21, stdev=12840.35 lat (usec): min=1403, max=72770, avg=18121.12, stdev=12840.34 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 3195], 10.00th=[ 4080], 20.00th=[ 6718], | 30.00th=[10814], 40.00th=[13042], 50.00th=[14746], 60.00th=[18220], | 70.00th=[22414], 80.00th=[27657], 90.00th=[36439], 95.00th=[43779], | 99.00th=[58983], 99.50th=[62129], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 288, max= 731, per=23.50%, avg=417.82, stdev=100.51, samples=28 iops : min= 18, max= 45, avg=25.82, stdev= 6.25, samples=28 lat (usec) : 100=1.95%, 250=1.56% lat (msec) : 2=0.52%, 4=4.04%, 10=12.63%, 20=41.93%, 50=35.55% lat (msec) : 100=1.82% cpu : usr=0.14%, sys=22.85%, ctx=2605, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182592: Fri Apr 10 23:02:47 2026 read: IOPS=28, BW=461KiB/s (472kB/s)(6032KiB/13092msec) clat (usec): min=67, max=69777, avg=18048.45, stdev=9697.30 lat (usec): min=69, max=69777, avg=18049.41, stdev=9697.30 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 121], 10.00th=[ 8848], 20.00th=[11731], | 30.00th=[13698], 40.00th=[15270], 50.00th=[16712], 60.00th=[19268], | 70.00th=[21365], 80.00th=[24511], 90.00th=[29230], 95.00th=[34341], | 99.00th=[49546], 99.50th=[62653], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 224, max= 640, per=27.24%, avg=460.08, stdev=96.95, samples=26 iops : min= 14, max= 40, avg=28.46, stdev= 6.03, samples=26 write: IOPS=29, BW=478KiB/s (489kB/s)(6256KiB/13092msec); 0 zone resets clat (usec): min=1219, max=55584, avg=15761.40, stdev=11596.83 lat (usec): min=1221, max=55585, avg=15763.28, stdev=11596.88 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3032], 10.00th=[ 3785], 20.00th=[ 5080], | 30.00th=[ 7242], 40.00th=[10290], 50.00th=[12518], 60.00th=[16909], | 70.00th=[20055], 80.00th=[24773], 90.00th=[32113], 95.00th=[39584], | 99.00th=[51119], 99.50th=[51643], 99.90th=[55837], 99.95th=[55837], | 99.99th=[55837] bw ( KiB/s): min= 256, max= 704, per=26.98%, avg=479.65, stdev=118.73, samples=26 iops : min= 16, max= 44, avg=29.69, stdev= 7.47, samples=26 lat (usec) : 100=1.43%, 250=1.95%, 500=0.13%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=5.08%, 10=17.19%, 20=40.36%, 50=31.64% lat (msec) : 100=1.17% cpu : usr=0.11%, sys=23.86%, ctx=2518, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1690KiB/s (1731kB/s), 415KiB/s-461KiB/s (425kB/s-472kB/s), io=23.4MiB (24.5MB), run=13092-14173msec WRITE: bw=1778KiB/s (1821kB/s), 426KiB/s-479KiB/s (436kB/s-490kB/s), io=24.6MiB (25.8MB), run=13092-14173msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182587: Fri Apr 10 23:02:50 2026 read: IOPS=22, BW=366KiB/s (375kB/s)(5920KiB/16174msec) clat (usec): min=4707, max=98988, avg=17895.61, stdev=14447.90 lat (usec): min=4708, max=98989, avg=17896.63, stdev=14447.81 clat percentiles (usec): | 1.00th=[ 5211], 5.00th=[ 6063], 10.00th=[ 6652], 20.00th=[ 7635], | 30.00th=[ 9372], 40.00th=[10814], 50.00th=[12518], 60.00th=[14615], | 70.00th=[17957], 80.00th=[25035], 90.00th=[37487], 95.00th=[49546], | 99.00th=[76022], 99.50th=[79168], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 127, max= 988, per=25.01%, avg=363.69, stdev=205.74, samples=32 iops : min= 7, max= 61, avg=22.41, stdev=12.88, samples=32 write: IOPS=24, BW=394KiB/s (403kB/s)(6368KiB/16174msec); 0 zone resets clat (usec): min=6140, max=90596, avg=23738.05, stdev=14849.56 lat (usec): min=6141, max=90598, avg=23740.53, stdev=14849.50 clat percentiles (usec): | 1.00th=[ 6980], 5.00th=[ 8455], 10.00th=[ 9503], 20.00th=[11863], | 30.00th=[13960], 40.00th=[15795], 50.00th=[18220], 60.00th=[22414], | 70.00th=[27657], 80.00th=[35390], 90.00th=[45351], 95.00th=[54264], | 99.00th=[73925], 99.50th=[84411], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 192, max= 960, per=25.68%, avg=392.87, stdev=192.68, samples=32 iops : min= 12, max= 60, avg=24.25, stdev=12.02, samples=32 lat (msec) : 10=23.57%, 20=40.36%, 50=30.34%, 100=5.73% cpu : usr=0.11%, sys=10.98%, ctx=1488, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182589: Fri Apr 10 23:02:50 2026 read: IOPS=21, BW=349KiB/s (357kB/s)(5744KiB/16465msec) clat (usec): min=4268, max=99230, avg=17716.67, stdev=12961.46 lat (usec): min=4269, max=99230, avg=17718.07, stdev=12962.46 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5604], 10.00th=[ 6128], 20.00th=[ 7963], | 30.00th=[ 9765], 40.00th=[11600], 50.00th=[13304], 60.00th=[15664], | 70.00th=[19792], 80.00th=[25822], 90.00th=[38536], 95.00th=[44303], | 99.00th=[57934], 99.50th=[67634], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 126, max= 832, per=23.59%, avg=343.06, stdev=189.48, samples=32 iops : min= 7, max= 52, avg=21.12, stdev=11.88, samples=32 write: IOPS=24, BW=397KiB/s (407kB/s)(6544KiB/16465msec); 0 zone resets clat (usec): min=6282, max=97477, avg=24394.37, stdev=15739.72 lat (usec): min=6284, max=97479, avg=24396.56, stdev=15739.60 clat percentiles (usec): | 1.00th=[ 7242], 5.00th=[ 8356], 10.00th=[ 9110], 20.00th=[10945], | 30.00th=[13304], 40.00th=[16319], 50.00th=[19006], 60.00th=[23987], | 70.00th=[30016], 80.00th=[37487], 90.00th=[44303], 95.00th=[55313], | 99.00th=[79168], 99.50th=[84411], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 223, max= 992, per=25.01%, avg=382.59, stdev=192.98, samples=32 iops : min= 13, max= 62, avg=23.59, stdev=12.04, samples=32 lat (msec) : 10=22.27%, 20=38.02%, 50=34.51%, 100=5.21% cpu : usr=0.09%, sys=10.73%, ctx=1419, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182591: Fri Apr 10 23:02:50 2026 read: IOPS=23, BW=383KiB/s (392kB/s)(6256KiB/16325msec) clat (usec): min=4426, max=81714, avg=19331.14, stdev=14353.15 lat (usec): min=4426, max=81715, avg=19332.56, stdev=14352.86 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 5407], 10.00th=[ 6456], 20.00th=[ 8160], | 30.00th=[ 9896], 40.00th=[11731], 50.00th=[14484], 60.00th=[17171], | 70.00th=[21365], 80.00th=[30802], 90.00th=[41681], 95.00th=[49546], | 99.00th=[63177], 99.50th=[78119], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 127, max= 1274, per=26.24%, avg=381.50, stdev=222.18, samples=32 iops : min= 7, max= 79, avg=23.53, stdev=13.91, samples=32 write: IOPS=23, BW=369KiB/s (378kB/s)(6032KiB/16325msec); 0 zone resets clat (usec): min=7109, max=83815, avg=23139.36, stdev=14162.32 lat (usec): min=7111, max=83816, avg=23141.45, stdev=14162.38 clat percentiles (usec): | 1.00th=[ 7177], 5.00th=[ 8455], 10.00th=[ 9503], 20.00th=[11207], | 30.00th=[13304], 40.00th=[15139], 50.00th=[18482], 60.00th=[22938], | 70.00th=[28181], 80.00th=[34866], 90.00th=[42206], 95.00th=[49021], | 99.00th=[68682], 99.50th=[80217], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 159, max= 896, per=23.70%, avg=362.59, stdev=183.16, samples=32 iops : min= 9, max= 56, avg=22.34, stdev=11.47, samples=32 lat (msec) : 10=21.61%, 20=39.45%, 50=34.24%, 100=4.69% cpu : usr=0.12%, sys=10.98%, ctx=1507, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182593: Fri Apr 10 23:02:50 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(6032KiB/16201msec) clat (usec): min=3447, max=83315, avg=18338.71, stdev=13958.21 lat (usec): min=3449, max=83316, avg=18339.73, stdev=13958.20 clat percentiles (usec): | 1.00th=[ 4883], 5.00th=[ 5735], 10.00th=[ 6652], 20.00th=[ 8160], | 30.00th=[10028], 40.00th=[11600], 50.00th=[13304], 60.00th=[15008], | 70.00th=[18482], 80.00th=[27395], 90.00th=[40109], 95.00th=[51119], | 99.00th=[62653], 99.50th=[81265], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 160, max= 1088, per=25.37%, avg=368.91, stdev=198.31, samples=32 iops : min= 10, max= 68, avg=22.75, stdev=12.35, samples=32 write: IOPS=24, BW=386KiB/s (395kB/s)(6256KiB/16201msec); 0 zone resets clat (usec): min=6597, max=86207, avg=23527.63, stdev=14281.33 lat (usec): min=6599, max=86209, avg=23529.52, stdev=14281.38 clat percentiles (usec): | 1.00th=[ 7111], 5.00th=[ 8094], 10.00th=[ 9372], 20.00th=[11469], | 30.00th=[14222], 40.00th=[16188], 50.00th=[19268], 60.00th=[23725], | 70.00th=[28181], 80.00th=[33424], 90.00th=[43779], 95.00th=[52691], | 99.00th=[69731], 99.50th=[84411], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 159, max= 1019, per=25.22%, avg=385.81, stdev=187.63, samples=32 iops : min= 9, max= 63, avg=23.78, stdev=11.76, samples=32 lat (msec) : 4=0.13%, 10=20.83%, 20=41.15%, 50=32.03%, 100=5.86% cpu : usr=0.11%, sys=11.20%, ctx=1508, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1455KiB/s (1490kB/s), 349KiB/s-383KiB/s (357kB/s-392kB/s), io=23.4MiB (24.5MB), run=16174-16465msec WRITE: bw=1531KiB/s (1567kB/s), 369KiB/s-397KiB/s (378kB/s-407kB/s), io=24.6MiB (25.8MB), run=16174-16465msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182605: Fri Apr 10 23:02:58 2026 read: IOPS=2, BW=2990KiB/s (3062kB/s)(7168KiB/2397msec) clat (msec): min=94, max=195, avg=137.74, stdev=39.28 lat (msec): min=94, max=195, avg=137.74, stdev=39.28 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 99], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 122], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 174], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 4039, max= 6119, per=61.11%, avg=5079.00, stdev=1470.78, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2136KiB/s (2187kB/s)(5120KiB/2397msec); 0 zone resets clat (msec): min=126, max=447, avg=286.27, stdev=155.14 lat (msec): min=126, max=447, avg=286.33, stdev=155.13 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2015, max= 2048, per=17.42%, avg=2027.33, stdev=18.01, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=41.97%, ctx=952, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182606: Fri Apr 10 23:02:58 2026 read: IOPS=0, BW=831KiB/s (851kB/s)(2048KiB/2464msec) clat (usec): min=615, max=191408, avg=96012.29, stdev=134910.76 lat (usec): min=617, max=191410, avg=96013.94, stdev=134911.12 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 619], 60.00th=[191890], | 70.00th=[191890], 80.00th=[191890], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 2015, max= 2048, per=24.44%, avg=2031.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=4, BW=4156KiB/s (4256kB/s)(10.0MiB/2464msec); 0 zone resets clat (msec): min=70, max=727, avg=226.35, stdev=200.30 lat (msec): min=70, max=728, avg=226.43, stdev=200.28 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 103], | 30.00th=[ 107], 40.00th=[ 132], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 215], 90.00th=[ 414], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2048, max= 4039, per=28.98%, avg=3372.67, stdev=1147.20, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33% cpu : usr=0.04%, sys=47.50%, ctx=269, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182607: Fri Apr 10 23:02:58 2026 read: IOPS=2, BW=2818KiB/s (2886kB/s)(6144KiB/2180msec) clat (msec): min=58, max=200, avg=148.34, stdev=48.93 lat (msec): min=58, max=200, avg=148.34, stdev=48.93 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 153], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 2015, max= 4096, per=40.71%, avg=3383.33, stdev=1185.35, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2818KiB/s (2886kB/s)(6144KiB/2180msec); 0 zone resets clat (msec): min=141, max=373, avg=214.66, stdev=84.88 lat (msec): min=141, max=373, avg=214.72, stdev=84.89 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 190], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2015, max= 4039, per=21.75%, avg=2530.25, stdev=1005.94, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=83.33%, 500=8.33% cpu : usr=0.00%, sys=50.34%, ctx=605, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182608: Fri Apr 10 23:02:58 2026 read: IOPS=2, BW=2747KiB/s (2813kB/s)(5120KiB/1864msec) clat (usec): min=426, max=136545, avg=53149.08, stdev=72160.15 lat (usec): min=426, max=136546, avg=53150.04, stdev=72160.15 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 429], 10.00th=[ 429], 20.00th=[ 429], | 30.00th=[ 437], 40.00th=[ 437], 50.00th=[ 644], 60.00th=[ 644], | 70.00th=[127402], 80.00th=[127402], 90.00th=[137364], 95.00th=[137364], | 99.00th=[137364], 99.50th=[137364], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 2048, max= 6131, per=49.21%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=3, BW=3845KiB/s (3938kB/s)(7168KiB/1864msec); 0 zone resets clat (msec): min=141, max=398, avg=228.08, stdev=86.49 lat (msec): min=141, max=398, avg=228.13, stdev=86.50 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 163], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 205], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 279], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2716, max= 4096, per=31.22%, avg=3633.00, stdev=794.16, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=53.03%, ctx=229, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8312KiB/s (8511kB/s), 831KiB/s-2990KiB/s (851kB/s-3062kB/s), io=20.0MiB (20.0MB), run=1864-2464msec WRITE: bw=11.4MiB/s (11.9MB/s), 2136KiB/s-4156KiB/s (2187kB/s-4256kB/s), io=28.0MiB (29.4MB), run=1864-2464msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182600: Fri Apr 10 23:02:58 2026 read: IOPS=3, BW=3693KiB/s (3782kB/s)(7168KiB/1941msec) clat (msec): min=51, max=397, avg=118.74, stdev=124.68 lat (msec): min=51, max=397, avg=118.74, stdev=124.68 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 54], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 75], 60.00th=[ 99], | 70.00th=[ 99], 80.00th=[ 100], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1996, max= 7148, per=58.65%, avg=4572.00, stdev=3643.01, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2638KiB/s (2701kB/s)(5120KiB/1941msec); 0 zone resets clat (msec): min=110, max=324, avg=209.28, stdev=94.86 lat (msec): min=110, max=324, avg=209.36, stdev=94.84 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1787, max= 2048, per=17.81%, avg=1943.67, stdev=138.15, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 100=50.00%, 250=25.00%, 500=25.00% cpu : usr=0.00%, sys=18.45%, ctx=133, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182601: Fri Apr 10 23:02:58 2026 read: IOPS=0, BW=780KiB/s (798kB/s)(2048KiB/2627msec) clat (usec): min=34621, max=85620, avg=60121.18, stdev=36061.68 lat (usec): min=34623, max=85621, avg=60122.42, stdev=36060.85 clat percentiles (usec): | 1.00th=[34866], 5.00th=[34866], 10.00th=[34866], 20.00th=[34866], | 30.00th=[34866], 40.00th=[34866], 50.00th=[34866], 60.00th=[85459], | 70.00th=[85459], 80.00th=[85459], 90.00th=[85459], 95.00th=[85459], | 99.00th=[85459], 99.50th=[85459], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 1759, max= 2048, per=24.42%, avg=1903.50, stdev=204.35, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3898KiB/s (3992kB/s)(10.0MiB/2627msec); 0 zone resets clat (msec): min=59, max=791, avg=249.23, stdev=228.59 lat (msec): min=59, max=791, avg=249.30, stdev=228.59 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 66], | 30.00th=[ 84], 40.00th=[ 89], 50.00th=[ 161], 60.00th=[ 192], | 70.00th=[ 275], 80.00th=[ 351], 90.00th=[ 426], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2048, max= 7037, per=39.46%, avg=4306.75, stdev=2054.90, samples=4 iops : min= 2, max= 6, avg= 3.50, stdev= 1.73, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=16.67%, 500=25.00%, 1000=8.33% cpu : usr=0.04%, sys=23.50%, ctx=147, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182602: Fri Apr 10 23:02:58 2026 read: IOPS=2, BW=2674KiB/s (2738kB/s)(6144KiB/2298msec) clat (msec): min=67, max=388, avg=200.15, stdev=131.26 lat (msec): min=67, max=388, avg=200.15, stdev=131.26 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 203], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2043, max= 4096, per=43.32%, avg=3377.00, stdev=1156.45, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2674KiB/s (2738kB/s)(6144KiB/2298msec); 0 zone resets clat (msec): min=45, max=313, avg=177.12, stdev=118.51 lat (msec): min=45, max=313, avg=177.19, stdev=118.52 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 70], | 30.00th=[ 70], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 257], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2043, max= 5287, per=34.90%, avg=3808.67, stdev=1640.98, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=41.67% cpu : usr=0.00%, sys=15.02%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182603: Fri Apr 10 23:02:58 2026 read: IOPS=2, BW=2416KiB/s (2474kB/s)(5120KiB/2119msec) clat (msec): min=50, max=238, avg=160.29, stdev=83.25 lat (msec): min=50, max=238, avg=160.29, stdev=83.25 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 51], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 3992, max= 4096, per=51.88%, avg=4044.00, stdev=73.54, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3383KiB/s (3464kB/s)(7168KiB/2119msec); 0 zone resets clat (msec): min=50, max=427, avg=179.60, stdev=147.02 lat (msec): min=50, max=427, avg=179.68, stdev=147.01 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 142], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 334], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1996, max= 5389, per=30.97%, avg=3380.00, stdev=1655.86, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 100=41.67%, 250=41.67%, 500=16.67% cpu : usr=0.00%, sys=13.74%, ctx=78, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7796KiB/s (7983kB/s), 780KiB/s-3693KiB/s (798kB/s-3782kB/s), io=20.0MiB (20.0MB), run=1941-2627msec WRITE: bw=10.7MiB/s (11.2MB/s), 2638KiB/s-3898KiB/s (2701kB/s-3992kB/s), io=28.0MiB (29.4MB), run=1941-2627msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182613: Fri Apr 10 23:03:06 2026 read: IOPS=2, BW=9.78MiB/s (10.3MB/s)(12.0MiB/1227msec) clat (msec): min=221, max=512, avg=333.60, stdev=156.35 lat (msec): min=221, max=512, avg=333.60, stdev=156.36 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=53.26%, ctx=2003, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182614: Fri Apr 10 23:03:06 2026 read: IOPS=0, BW=1785KiB/s (1828kB/s)(4096KiB/2295msec) clat (nsec): min=1734.7M, max=1734.7M, avg=1734715447.00, stdev= 0.00 lat (nsec): min=1734.7M, max=1734.7M, avg=1734717046.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1737], 5.00th=[ 1737], 10.00th=[ 1737], 20.00th=[ 1737], | 30.00th=[ 1737], 40.00th=[ 1737], 50.00th=[ 1737], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3569KiB/s (3655kB/s)(8192KiB/2295msec); 0 zone resets clat (msec): min=153, max=186, avg=169.96, stdev=22.76 lat (msec): min=154, max=186, avg=170.37, stdev=22.80 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 8192, max= 8192, per=60.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.04%, sys=27.16%, ctx=1190, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182615: Fri Apr 10 23:03:06 2026 write: IOPS=1, BW=5368KiB/s (5497kB/s)(12.0MiB/2289msec); 0 zone resets clat (msec): min=174, max=1505, avg=686.03, stdev=717.13 lat (msec): min=175, max=1506, avg=686.47, stdev=717.27 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8110, max= 8192, per=60.17%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.13%, sys=25.70%, ctx=196, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182616: Fri Apr 10 23:03:06 2026 write: IOPS=1, BW=5080KiB/s (5202kB/s)(12.0MiB/2419msec); 0 zone resets clat (msec): min=129, max=1903, avg=739.79, stdev=1008.57 lat (msec): min=130, max=1904, avg=740.35, stdev=1008.51 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min=11586, max=11586, per=85.53%, avg=11586.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.04%, sys=11.33%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7139KiB/s (7310kB/s), 1785KiB/s-9.78MiB/s (1828kB/s-10.3MB/s), io=16.0MiB (16.8MB), run=1227-2295msec WRITE: bw=13.2MiB/s (13.9MB/s), 3569KiB/s-5368KiB/s (3655kB/s-5497kB/s), io=32.0MiB (33.6MB), run=2289-2419msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182618: Fri Apr 10 23:03:07 2026 read: IOPS=1, BW=5606KiB/s (5740kB/s)(12.0MiB/2192msec) clat (msec): min=184, max=1815, avg=730.29, stdev=939.83 lat (msec): min=184, max=1815, avg=730.29, stdev=939.83 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.86%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182619: Fri Apr 10 23:03:07 2026 read: IOPS=0, BW=1859KiB/s (1904kB/s)(4096KiB/2203msec) clat (nsec): min=1708.2M, max=1708.2M, avg=1708198051.00, stdev= 0.00 lat (nsec): min=1708.2M, max=1708.2M, avg=1708199812.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1703], 5.00th=[ 1703], 10.00th=[ 1703], 20.00th=[ 1703], | 30.00th=[ 1703], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3719KiB/s (3808kB/s)(8192KiB/2203msec); 0 zone resets clat (msec): min=184, max=308, avg=246.18, stdev=87.82 lat (msec): min=184, max=308, avg=246.56, stdev=87.83 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 8192, max= 8192, per=61.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=10.31%, ctx=50, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182620: Fri Apr 10 23:03:07 2026 write: IOPS=1, BW=4997KiB/s (5117kB/s)(12.0MiB/2459msec); 0 zone resets clat (msec): min=73, max=2284, avg=812.01, stdev=1275.57 lat (msec): min=74, max=2285, avg=812.44, stdev=1275.73 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 78], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] lat (msec) : 100=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=8.06%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182621: Fri Apr 10 23:03:07 2026 write: IOPS=1, BW=5718KiB/s (5855kB/s)(12.0MiB/2149msec); 0 zone resets clat (msec): min=124, max=1884, avg=715.28, stdev=1012.84 lat (msec): min=125, max=1885, avg=715.75, stdev=1012.78 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 136], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min=11115, max=11115, per=83.41%, avg=11115.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.09%, sys=9.03%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7437KiB/s (7616kB/s), 1859KiB/s-5606KiB/s (1904kB/s-5740kB/s), io=16.0MiB (16.8MB), run=2192-2203msec WRITE: bw=13.0MiB/s (13.6MB/s), 3719KiB/s-5718KiB/s (3808kB/s-5855kB/s), io=32.0MiB (33.6MB), run=2149-2459msec