== sanity test 398b: DIO and buffer IO race ============== 14:24:34 (1782930274) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.20768 s, 15.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186708: Wed Jul 1 14:25:50 2026 read: IOPS=23, BW=92.5KiB/s (94.7kB/s)(5992KiB/64784msec) clat (usec): min=46, max=770814, avg=23408.86, stdev=22446.84 lat (usec): min=47, max=770815, avg=23409.67, stdev=22446.87 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 8586], 10.00th=[ 10683], 20.00th=[ 13698], | 30.00th=[ 16057], 40.00th=[ 18482], 50.00th=[ 20841], 60.00th=[ 23462], | 70.00th=[ 27132], 80.00th=[ 31851], 90.00th=[ 37487], 95.00th=[ 43254], | 99.00th=[ 59507], 99.50th=[ 68682], 99.90th=[ 79168], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 13, max= 184, per=25.21%, avg=92.52, stdev=30.39, samples=127 iops : min= 3, max= 46, avg=22.65, stdev= 7.68, samples=127 write: IOPS=24, BW=97.2KiB/s (99.5kB/s)(6296KiB/64784msec); 0 zone resets clat (usec): min=811, max=70486, avg=18631.87, stdev=13016.51 lat (usec): min=812, max=70487, avg=18634.82, stdev=13017.99 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3261], 10.00th=[ 4621], 20.00th=[ 6783], | 30.00th=[ 9765], 40.00th=[12649], 50.00th=[15926], 60.00th=[19530], | 70.00th=[23462], 80.00th=[28705], 90.00th=[37487], 95.00th=[44827], | 99.00th=[57934], 99.50th=[61604], 99.90th=[69731], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 31, max= 190, per=25.39%, avg=97.50, stdev=31.31, samples=126 iops : min= 7, max= 47, avg=23.90, stdev= 7.87, samples=126 lat (usec) : 50=0.03%, 100=0.20%, 250=0.59%, 500=0.03%, 1000=0.13% lat (msec) : 2=0.49%, 4=3.45%, 10=15.07%, 20=34.15%, 50=43.42% lat (msec) : 100=2.41%, 1000=0.03% cpu : usr=0.13%, sys=26.66%, ctx=10559, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186709: Wed Jul 1 14:25:50 2026 read: IOPS=22, BW=91.3KiB/s (93.5kB/s)(5940KiB/65065msec) clat (usec): min=88, max=765645, avg=23469.67, stdev=22454.55 lat (usec): min=88, max=765647, avg=23470.53, stdev=22454.59 clat percentiles (usec): | 1.00th=[ 200], 5.00th=[ 8848], 10.00th=[ 10814], 20.00th=[ 13698], | 30.00th=[ 16057], 40.00th=[ 18482], 50.00th=[ 20579], 60.00th=[ 23725], | 70.00th=[ 26870], 80.00th=[ 31327], 90.00th=[ 37487], 95.00th=[ 44303], | 99.00th=[ 62653], 99.50th=[ 67634], 99.90th=[ 92799], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 8, max= 160, per=24.95%, avg=91.56, stdev=29.35, samples=128 iops : min= 2, max= 40, avg=22.42, stdev= 7.40, samples=128 write: IOPS=24, BW=97.6KiB/s (99.9kB/s)(6348KiB/65065msec); 0 zone resets clat (usec): min=793, max=106198, avg=18797.03, stdev=13074.15 lat (usec): min=793, max=106199, avg=18798.01, stdev=13074.25 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 3130], 10.00th=[ 4293], 20.00th=[ 6915], | 30.00th=[ 10290], 40.00th=[ 13042], 50.00th=[ 16319], 60.00th=[ 19792], | 70.00th=[ 23725], 80.00th=[ 28967], 90.00th=[ 36963], 95.00th=[ 43254], | 99.00th=[ 56886], 99.50th=[ 67634], 99.90th=[ 76022], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 47, max= 255, per=25.62%, avg=98.39, stdev=35.92, samples=127 iops : min= 11, max= 63, avg=24.13, stdev= 9.04, samples=127 lat (usec) : 100=0.07%, 250=0.46%, 500=0.03%, 1000=0.33% lat (msec) : 2=0.52%, 4=4.07%, 10=13.22%, 20=35.32%, 50=43.59% lat (msec) : 100=2.34%, 250=0.03%, 1000=0.03% cpu : usr=0.10%, sys=26.50%, ctx=10629, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186710: Wed Jul 1 14:25:50 2026 read: IOPS=23, BW=92.3KiB/s (94.5kB/s)(6028KiB/65314msec) clat (usec): min=61, max=764812, avg=23543.52, stdev=22221.06 lat (usec): min=61, max=764812, avg=23544.88, stdev=22220.97 clat percentiles (usec): | 1.00th=[ 202], 5.00th=[ 8848], 10.00th=[ 10814], 20.00th=[ 13304], | 30.00th=[ 16057], 40.00th=[ 18482], 50.00th=[ 21365], 60.00th=[ 24249], | 70.00th=[ 27395], 80.00th=[ 31327], 90.00th=[ 38011], 95.00th=[ 43254], | 99.00th=[ 57410], 99.50th=[ 64750], 99.90th=[ 84411], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 47, max= 176, per=25.39%, avg=93.17, stdev=26.56, samples=127 iops : min= 11, max= 44, avg=22.82, stdev= 6.75, samples=127 write: IOPS=23, BW=95.8KiB/s (98.1kB/s)(6260KiB/65314msec); 0 zone resets clat (usec): min=780, max=77971, avg=18822.13, stdev=13118.07 lat (usec): min=781, max=77973, avg=18823.21, stdev=13118.10 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 3195], 10.00th=[ 4228], 20.00th=[ 6456], | 30.00th=[10028], 40.00th=[13042], 50.00th=[16188], 60.00th=[19530], | 70.00th=[23987], 80.00th=[29230], 90.00th=[36963], 95.00th=[43779], | 99.00th=[57410], 99.50th=[63177], 99.90th=[77071], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 20, max= 191, per=24.92%, avg=95.70, stdev=33.81, samples=128 iops : min= 5, max= 47, avg=23.46, stdev= 8.49, samples=128 lat (usec) : 100=0.07%, 250=0.62%, 500=0.07%, 1000=0.10% lat (msec) : 2=0.42%, 4=4.26%, 10=13.64%, 20=33.85%, 50=44.34% lat (msec) : 100=2.60%, 1000=0.03% cpu : usr=0.09%, sys=26.55%, ctx=10653, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186711: Wed Jul 1 14:25:50 2026 read: IOPS=23, BW=95.2KiB/s (97.5kB/s)(6052KiB/63593msec) clat (usec): min=47, max=72807, avg=22372.81, stdev=10655.65 lat (usec): min=48, max=72808, avg=22373.71, stdev=10655.75 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 8717], 10.00th=[10552], 20.00th=[13173], | 30.00th=[15533], 40.00th=[18220], 50.00th=[21103], 60.00th=[23987], | 70.00th=[27657], 80.00th=[31327], 90.00th=[35914], 95.00th=[40633], | 99.00th=[52691], 99.50th=[56361], 99.90th=[70779], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 32, max= 199, per=26.32%, avg=96.60, stdev=28.82, samples=124 iops : min= 8, max= 49, avg=23.68, stdev= 7.24, samples=124 write: IOPS=24, BW=98.1KiB/s (100kB/s)(6236KiB/63593msec); 0 zone resets clat (usec): min=735, max=745012, avg=18838.14, stdev=22318.57 lat (usec): min=736, max=745013, avg=18839.27, stdev=22318.63 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 37], 95.00th=[ 43], | 99.00th=[ 55], 99.50th=[ 60], 99.90th=[ 88], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8, max= 200, per=25.46%, avg=97.75, stdev=33.17, samples=126 iops : min= 2, max= 50, avg=23.98, stdev= 8.36, samples=126 lat (usec) : 50=0.03%, 100=0.26%, 250=0.68%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=0.29%, 4=3.81%, 10=14.39%, 20=34.90%, 50=43.62% lat (msec) : 100=1.73%, 750=0.03% cpu : usr=0.13%, sys=27.08%, ctx=10429, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=368KiB/s (376kB/s), 91.3KiB/s-95.2KiB/s (93.5kB/s-97.5kB/s), io=23.4MiB (24.6MB), run=63593-65314msec WRITE: bw=385KiB/s (394kB/s), 95.8KiB/s-98.1KiB/s (98.1kB/s-100kB/s), io=24.6MiB (25.7MB), run=63593-65314msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186713: Wed Jul 1 14:25:56 2026 read: IOPS=20, BW=83.9KiB/s (85.9kB/s)(5992KiB/71414msec) clat (msec): min=2, max=773, avg=21.53, stdev=24.81 lat (msec): min=2, max=773, avg=21.53, stdev=24.81 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 70], 99.50th=[ 77], 99.90th=[ 121], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 24, max= 335, per=25.05%, avg=84.16, stdev=56.79, samples=141 iops : min= 6, max= 83, avg=20.63, stdev=14.27, samples=141 write: IOPS=22, BW=88.2KiB/s (90.3kB/s)(6296KiB/71414msec); 0 zone resets clat (msec): min=3, max=108, avg=24.67, stdev=16.68 lat (msec): min=3, max=108, avg=24.67, stdev=16.68 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 47], 95.00th=[ 57], | 99.00th=[ 81], 99.50th=[ 89], 99.90th=[ 99], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 15, max= 368, per=25.26%, avg=88.91, stdev=60.11, samples=140 iops : min= 3, max= 92, avg=21.82, stdev=15.12, samples=140 lat (msec) : 4=1.07%, 10=23.27%, 20=29.43%, 50=39.10%, 100=7.03% lat (msec) : 250=0.07%, 1000=0.03% cpu : usr=0.09%, sys=15.04%, ctx=7092, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186714: Wed Jul 1 14:25:56 2026 read: IOPS=20, BW=83.4KiB/s (85.4kB/s)(5940KiB/71228msec) clat (msec): min=3, max=776, avg=20.72, stdev=24.20 lat (msec): min=3, max=776, avg=20.72, stdev=24.20 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 66], 99.50th=[ 72], 99.90th=[ 100], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8, max= 399, per=24.84%, avg=83.48, stdev=57.90, samples=140 iops : min= 2, max= 99, avg=20.46, stdev=14.54, samples=140 write: IOPS=22, BW=89.1KiB/s (91.3kB/s)(6348KiB/71228msec); 0 zone resets clat (msec): min=4, max=133, avg=25.30, stdev=16.63 lat (msec): min=4, max=133, avg=25.30, stdev=16.63 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 85], 99.50th=[ 89], 99.90th=[ 115], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 16, max= 312, per=25.28%, avg=88.98, stdev=55.71, samples=140 iops : min= 4, max= 78, avg=21.84, stdev=14.02, samples=140 lat (msec) : 4=0.62%, 10=22.17%, 20=29.79%, 50=40.66%, 100=6.67% lat (msec) : 250=0.07%, 1000=0.03% cpu : usr=0.10%, sys=15.21%, ctx=7130, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186715: Wed Jul 1 14:25:56 2026 read: IOPS=21, BW=84.6KiB/s (86.7kB/s)(6028KiB/71214msec) clat (usec): min=2690, max=95613, avg=20454.02, stdev=14696.18 lat (usec): min=2690, max=95614, avg=20454.79, stdev=14696.31 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 4948], 10.00th=[ 5735], 20.00th=[ 8029], | 30.00th=[11207], 40.00th=[13960], 50.00th=[16450], 60.00th=[19268], | 70.00th=[24249], 80.00th=[30016], 90.00th=[41681], 95.00th=[50594], | 99.00th=[67634], 99.50th=[76022], 99.90th=[92799], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 31, max= 367, per=25.39%, avg=85.31, stdev=58.54, samples=139 iops : min= 7, max= 91, avg=20.91, stdev=14.72, samples=139 write: IOPS=21, BW=87.9KiB/s (90.0kB/s)(6260KiB/71214msec); 0 zone resets clat (msec): min=4, max=755, avg=25.60, stdev=24.55 lat (msec): min=4, max=755, avg=25.61, stdev=24.55 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 47], 95.00th=[ 55], | 99.00th=[ 75], 99.50th=[ 89], 99.90th=[ 133], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 24, max= 328, per=24.92%, avg=87.71, stdev=55.13, samples=140 iops : min= 6, max= 82, avg=21.52, stdev=13.86, samples=140 lat (msec) : 4=0.46%, 10=22.27%, 20=30.86%, 50=40.07%, 100=6.25% lat (msec) : 250=0.07%, 1000=0.03% cpu : usr=0.08%, sys=15.32%, ctx=7123, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186716: Wed Jul 1 14:25:56 2026 read: IOPS=21, BW=84.9KiB/s (86.0kB/s)(6052KiB/71249msec) clat (msec): min=3, max=118, avg=20.58, stdev=15.05 lat (msec): min=3, max=118, avg=20.58, stdev=15.05 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 53], | 99.00th=[ 69], 99.50th=[ 78], 99.90th=[ 100], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 16, max= 344, per=25.32%, avg=85.06, stdev=55.05, samples=139 iops : min= 4, max= 86, avg=20.86, stdev=13.86, samples=139 write: IOPS=21, BW=87.5KiB/s (89.6kB/s)(6236KiB/71249msec); 0 zone resets clat (msec): min=4, max=748, avg=25.52, stdev=24.57 lat (msec): min=4, max=748, avg=25.52, stdev=24.57 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 38], 90.00th=[ 48], 95.00th=[ 56], | 99.00th=[ 81], 99.50th=[ 88], 99.90th=[ 114], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 24, max= 367, per=24.83%, avg=87.39, stdev=58.63, samples=140 iops : min= 6, max= 91, avg=21.44, stdev=14.72, samples=140 lat (msec) : 4=0.52%, 10=23.67%, 20=29.07%, 50=40.01%, 100=6.61% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=15.24%, ctx=6960, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=336KiB/s (344kB/s), 83.4KiB/s-84.9KiB/s (85.4kB/s-86.0kB/s), io=23.4MiB (24.6MB), run=71214-71414msec WRITE: bw=352KiB/s (360kB/s), 87.5KiB/s-89.1KiB/s (89.6kB/s-91.3kB/s), io=24.6MiB (25.7MB), run=71214-71414msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186742: Wed Jul 1 14:26:18 2026 read: IOPS=23, BW=369KiB/s (378kB/s)(5920KiB/16044msec) clat (usec): min=65, max=74116, avg=22049.81, stdev=12004.85 lat (usec): min=66, max=74118, avg=22050.53, stdev=12004.93 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 208], 10.00th=[10290], 20.00th=[13304], | 30.00th=[16057], 40.00th=[17957], 50.00th=[20055], 60.00th=[22938], | 70.00th=[25822], 80.00th=[30278], 90.00th=[36963], 95.00th=[43779], | 99.00th=[66323], 99.50th=[73925], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 159, max= 576, per=25.06%, avg=370.06, stdev=106.56, samples=31 iops : min= 9, max= 36, avg=22.45, stdev= 6.78, samples=31 write: IOPS=24, BW=397KiB/s (406kB/s)(6368KiB/16044msec); 0 zone resets clat (usec): min=1210, max=65244, avg=19724.01, stdev=12343.76 lat (usec): min=1211, max=65245, avg=19726.02, stdev=12343.09 clat percentiles (usec): | 1.00th=[ 3032], 5.00th=[ 4555], 10.00th=[ 5538], 20.00th=[ 8848], | 30.00th=[11469], 40.00th=[14091], 50.00th=[16909], 60.00th=[20841], | 70.00th=[25035], 80.00th=[30540], 90.00th=[35914], 95.00th=[42206], | 99.00th=[57410], 99.50th=[61604], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 256, max= 608, per=25.87%, avg=402.00, stdev=107.06, samples=31 iops : min= 16, max= 38, avg=24.45, stdev= 6.73, samples=31 lat (usec) : 100=0.26%, 250=2.34%, 500=0.13% lat (msec) : 2=0.13%, 4=1.17%, 10=13.02%, 20=36.59%, 50=43.75% lat (msec) : 100=2.60% cpu : usr=0.06%, sys=28.21%, ctx=3010, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186744: Wed Jul 1 14:26:18 2026 read: IOPS=22, BW=354KiB/s (363kB/s)(5744KiB/16209msec) clat (usec): min=50, max=70023, avg=23471.35, stdev=11153.75 lat (usec): min=50, max=70023, avg=23472.09, stdev=11153.85 clat percentiles (usec): | 1.00th=[ 126], 5.00th=[ 9241], 10.00th=[11207], 20.00th=[14353], | 30.00th=[16712], 40.00th=[19268], 50.00th=[21627], 60.00th=[24249], | 70.00th=[27919], 80.00th=[32637], 90.00th=[38011], 95.00th=[43254], | 99.00th=[60031], 99.50th=[64750], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 155, max= 606, per=23.95%, avg=353.75, stdev=103.37, samples=32 iops : min= 9, max= 37, avg=21.41, stdev= 6.55, samples=32 write: IOPS=25, BW=404KiB/s (413kB/s)(6544KiB/16209msec); 0 zone resets clat (usec): min=1802, max=67010, avg=18772.46, stdev=12209.63 lat (usec): min=1803, max=67012, avg=18773.83, stdev=12209.66 clat percentiles (usec): | 1.00th=[ 2474], 5.00th=[ 4146], 10.00th=[ 5211], 20.00th=[ 7963], | 30.00th=[10945], 40.00th=[13304], 50.00th=[16450], 60.00th=[19792], | 70.00th=[23200], 80.00th=[27657], 90.00th=[33817], 95.00th=[43254], | 99.00th=[58983], 99.50th=[59507], 99.90th=[66847], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 190, max= 576, per=25.95%, avg=403.31, stdev=113.01, samples=32 iops : min= 11, max= 36, avg=24.53, stdev= 7.22, samples=32 lat (usec) : 100=0.26%, 250=0.65% lat (msec) : 2=0.13%, 4=2.21%, 10=14.32%, 20=35.03%, 50=44.92% lat (msec) : 100=2.47% cpu : usr=0.10%, sys=28.33%, ctx=3072, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186746: Wed Jul 1 14:26:18 2026 read: IOPS=24, BW=386KiB/s (395kB/s)(6256KiB/16215msec) clat (usec): min=52, max=73037, avg=21848.94, stdev=12120.87 lat (usec): min=53, max=73038, avg=21849.80, stdev=12120.88 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 182], 10.00th=[10159], 20.00th=[12387], | 30.00th=[14877], 40.00th=[17695], 50.00th=[20317], 60.00th=[22414], | 70.00th=[26608], 80.00th=[30802], 90.00th=[35390], 95.00th=[45351], | 99.00th=[58983], 99.50th=[70779], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 186, max= 604, per=26.24%, avg=387.59, stdev=107.83, samples=32 iops : min= 11, max= 37, avg=23.53, stdev= 6.83, samples=32 write: IOPS=23, BW=372KiB/s (381kB/s)(6032KiB/16215msec); 0 zone resets clat (usec): min=1891, max=75285, avg=20021.83, stdev=12989.09 lat (usec): min=1893, max=75287, avg=20023.35, stdev=12989.18 clat percentiles (usec): | 1.00th=[ 3261], 5.00th=[ 4424], 10.00th=[ 5735], 20.00th=[ 8848], | 30.00th=[12125], 40.00th=[14353], 50.00th=[17171], 60.00th=[20579], | 70.00th=[24249], 80.00th=[28705], 90.00th=[38011], 95.00th=[47449], | 99.00th=[60031], 99.50th=[74974], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 159, max= 608, per=23.72%, avg=368.53, stdev=115.91, samples=32 iops : min= 9, max= 38, avg=22.34, stdev= 7.38, samples=32 lat (usec) : 100=0.78%, 250=2.08% lat (msec) : 2=0.13%, 4=1.17%, 10=11.98%, 20=37.24%, 50=43.36% lat (msec) : 100=3.26% cpu : usr=0.12%, sys=27.61%, ctx=3063, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186747: Wed Jul 1 14:26:18 2026 read: IOPS=23, BW=377KiB/s (386kB/s)(6032KiB/16006msec) clat (usec): min=77, max=79896, avg=22305.80, stdev=11921.80 lat (usec): min=77, max=79897, avg=22306.91, stdev=11922.23 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 545], 10.00th=[11076], 20.00th=[13698], | 30.00th=[15926], 40.00th=[17957], 50.00th=[19792], 60.00th=[23462], | 70.00th=[26608], 80.00th=[30278], 90.00th=[38011], 95.00th=[44303], | 99.00th=[61604], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 191, max= 604, per=25.69%, avg=379.48, stdev=116.58, samples=31 iops : min= 11, max= 37, avg=23.03, stdev= 7.42, samples=31 write: IOPS=24, BW=391KiB/s (400kB/s)(6256KiB/16006msec); 0 zone resets clat (usec): min=1315, max=73431, avg=19182.13, stdev=12719.56 lat (usec): min=1317, max=73433, avg=19183.67, stdev=12719.60 clat percentiles (usec): | 1.00th=[ 2868], 5.00th=[ 4424], 10.00th=[ 5735], 20.00th=[ 8586], | 30.00th=[11207], 40.00th=[13566], 50.00th=[16581], 60.00th=[19530], | 70.00th=[23462], 80.00th=[28181], 90.00th=[34866], 95.00th=[43254], | 99.00th=[65274], 99.50th=[71828], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 223, max= 672, per=25.27%, avg=392.74, stdev=121.49, samples=31 iops : min= 13, max= 42, avg=23.87, stdev= 7.67, samples=31 lat (usec) : 100=0.52%, 250=1.56%, 500=0.26%, 750=0.13% lat (msec) : 2=0.13%, 4=1.69%, 10=11.85%, 20=39.97%, 50=41.28% lat (msec) : 100=2.60% cpu : usr=0.11%, sys=28.08%, ctx=3106, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1477KiB/s (1513kB/s), 354KiB/s-386KiB/s (363kB/s-395kB/s), io=23.4MiB (24.5MB), run=16006-16215msec WRITE: bw=1554KiB/s (1591kB/s), 372KiB/s-404KiB/s (381kB/s-413kB/s), io=24.6MiB (25.8MB), run=16006-16215msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186740: Wed Jul 1 14:26:20 2026 read: IOPS=20, BW=327KiB/s (335kB/s)(5920KiB/18099msec) clat (usec): min=4577, max=74153, avg=21101.57, stdev=14404.74 lat (usec): min=4578, max=74154, avg=21102.25, stdev=14404.78 clat percentiles (usec): | 1.00th=[ 5211], 5.00th=[ 7373], 10.00th=[ 8455], 20.00th=[ 9896], | 30.00th=[11076], 40.00th=[13042], 50.00th=[16057], 60.00th=[19792], | 70.00th=[23987], 80.00th=[31327], 90.00th=[44827], 95.00th=[52167], | 99.00th=[69731], 99.50th=[72877], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 160, max= 928, per=24.80%, avg=326.11, stdev=169.52, samples=36 iops : min= 10, max= 58, avg=19.94, stdev=10.69, samples=36 write: IOPS=21, BW=352KiB/s (360kB/s)(6368KiB/18099msec); 0 zone resets clat (usec): min=6171, max=88365, avg=25626.78, stdev=14628.62 lat (usec): min=6173, max=88368, avg=25628.52, stdev=14628.76 clat percentiles (usec): | 1.00th=[ 6849], 5.00th=[ 8848], 10.00th=[10290], 20.00th=[12649], | 30.00th=[15401], 40.00th=[18220], 50.00th=[22938], 60.00th=[26870], | 70.00th=[30802], 80.00th=[36963], 90.00th=[47449], 95.00th=[53216], | 99.00th=[69731], 99.50th=[85459], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 155, max= 864, per=25.32%, avg=350.22, stdev=153.02, samples=36 iops : min= 9, max= 54, avg=21.44, stdev= 9.68, samples=36 lat (msec) : 10=14.71%, 20=36.85%, 50=41.54%, 100=6.90% cpu : usr=0.08%, sys=15.26%, ctx=1875, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186741: Wed Jul 1 14:26:20 2026 read: IOPS=19, BW=315KiB/s (323kB/s)(5744KiB/18214msec) clat (usec): min=2946, max=72932, avg=20888.48, stdev=14232.35 lat (usec): min=2946, max=72934, avg=20889.24, stdev=14232.37 clat percentiles (usec): | 1.00th=[ 3425], 5.00th=[ 6259], 10.00th=[ 8029], 20.00th=[ 9241], | 30.00th=[11338], 40.00th=[13435], 50.00th=[16057], 60.00th=[19792], | 70.00th=[23987], 80.00th=[32113], 90.00th=[43254], 95.00th=[50594], | 99.00th=[67634], 99.50th=[70779], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 62, max= 864, per=23.60%, avg=310.28, stdev=151.98, samples=36 iops : min= 3, max= 54, avg=18.94, stdev= 9.66, samples=36 write: IOPS=22, BW=359KiB/s (368kB/s)(6544KiB/18214msec); 0 zone resets clat (msec): min=4, max=117, avg=25.86, stdev=16.41 lat (msec): min=4, max=117, avg=25.87, stdev=16.41 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 77], 99.50th=[ 90], 99.90th=[ 117], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 160, max= 926, per=25.13%, avg=347.50, stdev=173.42, samples=36 iops : min= 10, max= 57, avg=21.28, stdev=10.90, samples=36 lat (msec) : 4=0.65%, 10=17.19%, 20=34.77%, 50=40.62%, 100=6.64% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=14.91%, ctx=1782, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186743: Wed Jul 1 14:26:20 2026 read: IOPS=21, BW=345KiB/s (353kB/s)(6256KiB/18152msec) clat (usec): min=4521, max=71045, avg=20352.72, stdev=13950.43 lat (usec): min=4522, max=71046, avg=20353.42, stdev=13950.42 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 6652], 10.00th=[ 8160], 20.00th=[10028], | 30.00th=[11338], 40.00th=[13042], 50.00th=[15139], 60.00th=[17957], | 70.00th=[22676], 80.00th=[29754], 90.00th=[41157], 95.00th=[51119], | 99.00th=[63177], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 127, max= 1088, per=26.16%, avg=343.94, stdev=197.46, samples=36 iops : min= 7, max= 68, avg=21.06, stdev=12.49, samples=36 write: IOPS=20, BW=332KiB/s (340kB/s)(6032KiB/18152msec); 0 zone resets clat (msec): min=5, max=118, avg=26.80, stdev=16.38 lat (msec): min=5, max=118, avg=26.80, stdev=16.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 51], 95.00th=[ 59], | 99.00th=[ 71], 99.50th=[ 84], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 160, max= 896, per=23.58%, avg=326.17, stdev=147.00, samples=36 iops : min= 10, max= 56, avg=19.94, stdev= 9.29, samples=36 lat (msec) : 10=14.84%, 20=39.84%, 50=37.76%, 100=7.42%, 250=0.13% cpu : usr=0.06%, sys=15.11%, ctx=1739, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186745: Wed Jul 1 14:26:20 2026 read: IOPS=20, BW=332KiB/s (340kB/s)(6032KiB/18185msec) clat (msec): min=3, max=106, avg=21.67, stdev=15.77 lat (msec): min=3, max=106, avg=21.67, stdev=15.77 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 48], 95.00th=[ 55], | 99.00th=[ 71], 99.50th=[ 72], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 95, max= 960, per=24.66%, avg=324.33, stdev=184.11, samples=36 iops : min= 5, max= 60, avg=19.83, stdev=11.63, samples=36 write: IOPS=21, BW=344KiB/s (352kB/s)(6256KiB/18185msec); 0 zone resets clat (usec): min=4752, max=83632, avg=25521.83, stdev=15206.58 lat (usec): min=4753, max=83633, avg=25523.43, stdev=15206.70 clat percentiles (usec): | 1.00th=[ 5932], 5.00th=[ 8586], 10.00th=[ 9896], 20.00th=[11600], | 30.00th=[14746], 40.00th=[17957], 50.00th=[21103], 60.00th=[26608], | 70.00th=[32375], 80.00th=[38011], 90.00th=[46924], 95.00th=[53740], | 99.00th=[73925], 99.50th=[82314], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 128, max= 864, per=24.48%, avg=338.61, stdev=151.38, samples=36 iops : min= 8, max= 54, avg=20.72, stdev= 9.58, samples=36 lat (msec) : 4=0.39%, 10=16.67%, 20=36.46%, 50=38.67%, 100=7.68% lat (msec) : 250=0.13% cpu : usr=0.09%, sys=14.93%, ctx=1815, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1315KiB/s (1347kB/s), 315KiB/s-345KiB/s (323kB/s-353kB/s), io=23.4MiB (24.5MB), run=18099-18214msec WRITE: bw=1384KiB/s (1417kB/s), 332KiB/s-359KiB/s (340kB/s-368kB/s), io=24.6MiB (25.8MB), run=18099-18214msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186755: Wed Jul 1 14:26:28 2026 read: IOPS=3, BW=3370KiB/s (3451kB/s)(7168KiB/2127msec) clat (usec): min=455, max=238203, avg=118380.08, stdev=76362.71 lat (usec): min=456, max=238204, avg=118381.31, stdev=76362.64 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 69731], | 30.00th=[ 85459], 40.00th=[ 85459], 50.00th=[122160], 60.00th=[143655], | 70.00th=[143655], 80.00th=[168821], 90.00th=[238027], 95.00th=[238027], | 99.00th=[238027], 99.50th=[238027], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 2000, max= 5128, per=44.52%, avg=3741.33, stdev=1593.87, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=2, BW=2407KiB/s (2465kB/s)(5120KiB/2127msec); 0 zone resets clat (msec): min=171, max=352, avg=257.71, stdev=79.73 lat (msec): min=171, max=352, avg=257.75, stdev=79.70 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1709, max= 6144, per=33.37%, avg=3926.50, stdev=3136.02, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (usec) : 500=8.33% lat (msec) : 100=16.67%, 250=58.33%, 500=16.67% cpu : usr=0.05%, sys=50.47%, ctx=797, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186756: Wed Jul 1 14:26:28 2026 read: IOPS=0, BW=840KiB/s (861kB/s)(2048KiB/2437msec) clat (usec): min=453, max=464290, avg=232372.06, stdev=327982.12 lat (usec): min=454, max=464292, avg=232373.69, stdev=327982.89 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 453], 40.00th=[ 453], 50.00th=[ 453], 60.00th=[463471], | 70.00th=[463471], 80.00th=[463471], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 1700, max= 2048, per=22.30%, avg=1874.00, stdev=246.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=4, BW=4202KiB/s (4303kB/s)(10.0MiB/2437msec); 0 zone resets clat (msec): min=128, max=322, avg=191.11, stdev=74.47 lat (msec): min=128, max=322, avg=191.16, stdev=74.48 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 136], 40.00th=[ 146], 50.00th=[ 157], 60.00th=[ 163], | 70.00th=[ 174], 80.00th=[ 251], 90.00th=[ 309], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 4096, max= 8000, per=51.68%, avg=6080.00, stdev=1952.79, samples=3 iops : min= 4, max= 7, avg= 5.67, stdev= 1.53, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=58.33%, 500=33.33% cpu : usr=0.04%, sys=53.86%, ctx=190, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186757: Wed Jul 1 14:26:28 2026 read: IOPS=2, BW=2974KiB/s (3045kB/s)(6144KiB/2066msec) clat (usec): min=321, max=96617, avg=16474.70, stdev=39261.64 lat (usec): min=322, max=96618, avg=16475.36, stdev=39261.82 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 322], 10.00th=[ 322], 20.00th=[ 412], | 30.00th=[ 412], 40.00th=[ 461], 50.00th=[ 461], 60.00th=[ 478], | 70.00th=[ 562], 80.00th=[ 562], 90.00th=[96994], 95.00th=[96994], | 99.00th=[96994], 99.50th=[96994], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 8192, max= 8192, per=97.49%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2974KiB/s (3045kB/s)(6144KiB/2066msec); 0 zone resets clat (msec): min=156, max=790, avg=320.31, stdev=238.15 lat (msec): min=156, max=790, avg=320.36, stdev=238.16 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 266], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 3419, max= 4096, per=31.94%, avg=3757.50, stdev=478.71, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 lat (usec) : 500=33.33%, 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=37.87%, ctx=140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186758: Wed Jul 1 14:26:28 2026 read: IOPS=2, BW=2573KiB/s (2635kB/s)(5120KiB/1990msec) clat (usec): min=430, max=217307, avg=75343.65, stdev=104657.63 lat (usec): min=431, max=217307, avg=75344.32, stdev=104657.32 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 433], | 30.00th=[ 449], 40.00th=[ 449], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[158335], 80.00th=[158335], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 4096, max= 4096, per=48.74%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3602KiB/s (3688kB/s)(7168KiB/1990msec); 0 zone resets clat (msec): min=144, max=355, avg=226.91, stdev=86.11 lat (msec): min=144, max=355, avg=226.96, stdev=86.11 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 180], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 338], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2048, max= 4096, per=27.06%, avg=3183.67, stdev=1042.11, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=55.35%, ctx=362, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8404KiB/s (8605kB/s), 840KiB/s-3370KiB/s (861kB/s-3451kB/s), io=20.0MiB (20.0MB), run=1990-2437msec WRITE: bw=11.5MiB/s (12.0MB/s), 2407KiB/s-4202KiB/s (2465kB/s-4303kB/s), io=28.0MiB (29.4MB), run=1990-2437msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186760: Wed Jul 1 14:26:28 2026 read: IOPS=2, BW=2689KiB/s (2753kB/s)(7168KiB/2666msec) clat (msec): min=41, max=815, avg=263.13, stdev=273.33 lat (msec): min=41, max=815, avg=263.13, stdev=273.33 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 53], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 136], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 380], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1665, max= 3930, per=32.33%, avg=2342.60, stdev=902.10, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1920KiB/s (1967kB/s)(5120KiB/2666msec); 0 zone resets clat (msec): min=45, max=326, avg=156.51, stdev=105.05 lat (msec): min=46, max=326, avg=156.57, stdev=105.04 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1965, max= 8192, per=50.06%, avg=5078.50, stdev=4403.15, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 lat (msec) : 50=16.67%, 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=20.30%, ctx=175, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186761: Wed Jul 1 14:26:28 2026 read: IOPS=0, BW=740KiB/s (758kB/s)(2048KiB/2768msec) clat (msec): min=120, max=523, avg=322.19, stdev=285.39 lat (msec): min=120, max=523, avg=322.19, stdev=285.39 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 121], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1662, max= 1965, per=25.03%, avg=1813.50, stdev=214.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3699KiB/s (3788kB/s)(10.0MiB/2768msec); 0 zone resets clat (msec): min=95, max=489, avg=207.07, stdev=149.17 lat (msec): min=95, max=489, avg=207.13, stdev=149.16 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 96], | 30.00th=[ 104], 40.00th=[ 113], 50.00th=[ 120], 60.00th=[ 161], | 70.00th=[ 180], 80.00th=[ 257], 90.00th=[ 460], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2043, max= 6144, per=39.85%, avg=4043.00, stdev=1676.02, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.06, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=15.72%, ctx=108, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186762: Wed Jul 1 14:26:28 2026 read: IOPS=2, BW=2242KiB/s (2295kB/s)(6144KiB/2741msec) clat (msec): min=22, max=328, avg=110.70, stdev=112.13 lat (msec): min=22, max=328, avg=110.71, stdev=112.13 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 50], | 30.00th=[ 50], 40.00th=[ 66], 50.00th=[ 66], 60.00th=[ 71], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1965, max= 6144, per=55.96%, avg=4054.50, stdev=2955.00, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2242KiB/s (2295kB/s)(6144KiB/2741msec); 0 zone resets clat (msec): min=55, max=887, avg=339.15, stdev=332.75 lat (msec): min=55, max=887, avg=339.22, stdev=332.74 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 65], | 30.00th=[ 65], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 309], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1965, max= 4096, per=33.34%, avg=3382.67, stdev=1227.74, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 50=16.67%, 100=33.33%, 250=16.67%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.04%, sys=14.67%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186763: Wed Jul 1 14:26:28 2026 read: IOPS=1, BW=1812KiB/s (1855kB/s)(5120KiB/2826msec) clat (msec): min=22, max=136, avg=57.33, stdev=45.51 lat (msec): min=22, max=136, avg=57.33, stdev=45.51 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 23], | 30.00th=[ 35], 40.00th=[ 35], 50.00th=[ 45], 60.00th=[ 45], | 70.00th=[ 49], 80.00th=[ 49], 90.00th=[ 138], 95.00th=[ 138], | 99.00th=[ 138], 99.50th=[ 138], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 6144, max= 6144, per=84.79%, avg=6144.00, stdev= 0.00, samples=1 iops : min= 6, max= 6, avg= 6.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2536KiB/s (2597kB/s)(7168KiB/2826msec); 0 zone resets clat (msec): min=18, max=1179, avg=356.35, stdev=423.25 lat (msec): min=18, max=1179, avg=356.42, stdev=423.28 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 19], 10.00th=[ 19], 20.00th=[ 36], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 174], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 535], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1654, max= 4096, per=25.35%, avg=2571.67, stdev=1329.24, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 20=8.33%, 50=41.67%, 100=8.33%, 250=16.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=14.23%, ctx=110, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7247KiB/s (7421kB/s), 740KiB/s-2689KiB/s (758kB/s-2753kB/s), io=20.0MiB (20.0MB), run=2666-2826msec WRITE: bw=9.91MiB/s (10.4MB/s), 1920KiB/s-3699KiB/s (1967kB/s-3788kB/s), io=28.0MiB (29.4MB), run=2666-2826msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186769: Wed Jul 1 14:26:37 2026 read: IOPS=1, BW=5573KiB/s (5707kB/s)(12.0MiB/2205msec) clat (msec): min=630, max=849, avg=719.22, stdev=115.36 lat (msec): min=630, max=849, avg=719.22, stdev=115.36 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7684, max= 7831, per=100.00%, avg=7757.50, stdev=103.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=48.64%, ctx=2189, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186770: Wed Jul 1 14:26:37 2026 read: IOPS=0, BW=1512KiB/s (1548kB/s)(4096KiB/2709msec) clat (nsec): min=681203k, max=681203k, avg=681203187.00, stdev= 0.00 lat (nsec): min=681207k, max=681207k, avg=681207115.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7684, max= 7684, per=100.00%, avg=7684.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3024KiB/s (3097kB/s)(8192KiB/2709msec); 0 zone resets clat (msec): min=388, max=1586, avg=987.76, stdev=847.08 lat (msec): min=389, max=1587, avg=988.03, stdev=847.10 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7831, max= 7831, per=64.75%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=24.52%, ctx=786, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186771: Wed Jul 1 14:26:37 2026 write: IOPS=1, BW=4553KiB/s (4662kB/s)(12.0MiB/2699msec); 0 zone resets clat (msec): min=350, max=1360, avg=882.21, stdev=507.29 lat (msec): min=350, max=1361, avg=882.58, stdev=507.32 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7684, max= 7876, per=64.32%, avg=7780.00, stdev=135.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=22.98%, ctx=136, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186772: Wed Jul 1 14:26:37 2026 write: IOPS=1, BW=5131KiB/s (5254kB/s)(12.0MiB/2395msec); 0 zone resets clat (msec): min=359, max=1552, avg=781.49, stdev=668.98 lat (msec): min=360, max=1553, avg=781.88, stdev=668.96 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7314, max= 7684, per=62.00%, avg=7499.00, stdev=261.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=18.96%, ctx=83, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6048KiB/s (6193kB/s), 1512KiB/s-5573KiB/s (1548kB/s-5707kB/s), io=16.0MiB (16.8MB), run=2205-2709msec WRITE: bw=11.8MiB/s (12.4MB/s), 3024KiB/s-5131KiB/s (3097kB/s-5254kB/s), io=32.0MiB (33.6MB), run=2395-2709msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186774: Wed Jul 1 14:26:38 2026 read: IOPS=0, BW=4009KiB/s (4105kB/s)(12.0MiB/3065msec) clat (msec): min=107, max=1757, avg=1009.22, stdev=835.53 lat (msec): min=107, max=1757, avg=1009.23, stdev=835.53 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.26%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186775: Wed Jul 1 14:26:38 2026 read: IOPS=0, BW=1542KiB/s (1579kB/s)(4096KiB/2656msec) clat (nsec): min=1077.2M, max=1077.2M, avg=1077201718.00, stdev= 0.00 lat (nsec): min=1077.2M, max=1077.2M, avg=1077203538.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3084KiB/s (3158kB/s)(8192KiB/2656msec); 0 zone resets clat (msec): min=260, max=1292, avg=776.16, stdev=729.59 lat (msec): min=260, max=1292, avg=776.37, stdev=729.52 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8192, max= 8192, per=74.43%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.04%, sys=14.09%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186776: Wed Jul 1 14:26:38 2026 write: IOPS=1, BW=4128KiB/s (4227kB/s)(12.0MiB/2977msec); 0 zone resets clat (msec): min=237, max=1355, avg=978.10, stdev=641.01 lat (msec): min=238, max=1355, avg=978.32, stdev=640.96 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8192, max= 8192, per=74.43%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.59%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186777: Wed Jul 1 14:26:38 2026 write: IOPS=1, BW=4913KiB/s (5031kB/s)(12.0MiB/2501msec); 0 zone resets clat (msec): min=618, max=972, avg=820.57, stdev=182.52 lat (msec): min=618, max=973, avg=820.83, stdev=182.58 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 5557, max= 8192, per=62.46%, avg=6874.50, stdev=1863.23, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=27.12%, ctx=271, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5346KiB/s (5474kB/s), 1542KiB/s-4009KiB/s (1579kB/s-4105kB/s), io=16.0MiB (16.8MB), run=2656-3065msec WRITE: bw=10.7MiB/s (11.3MB/s), 3084KiB/s-4913KiB/s (3158kB/s-5031kB/s), io=32.0MiB (33.6MB), run=2501-2977msec