== sanity test 398b: DIO and buffer IO race ============== 22:46:05 (1772423165) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.45209 s, 20.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147138: Sun Mar 1 22:47:01 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(5992KiB/47302msec) clat (usec): min=126, max=720560, avg=16702.73, stdev=20572.07 lat (usec): min=127, max=720562, avg=16703.40, stdev=20572.10 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 5604], 10.00th=[ 7570], 20.00th=[ 9372], | 30.00th=[ 10814], 40.00th=[ 12387], 50.00th=[ 14091], 60.00th=[ 16319], | 70.00th=[ 19006], 80.00th=[ 21890], 90.00th=[ 27657], 95.00th=[ 34341], | 99.00th=[ 52167], 99.50th=[ 59507], 99.90th=[ 76022], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 231, per=25.12%, avg=126.37, stdev=39.19, samples=94 iops : min= 1, max= 57, avg=31.16, stdev= 9.86, samples=94 write: IOPS=33, BW=133KiB/s (136kB/s)(6296KiB/47302msec); 0 zone resets clat (usec): min=677, max=84410, avg=14022.38, stdev=11509.37 lat (usec): min=677, max=84411, avg=14023.15, stdev=11509.43 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 2573], 10.00th=[ 3032], 20.00th=[ 3916], | 30.00th=[ 5669], 40.00th=[ 8848], 50.00th=[11207], 60.00th=[14091], | 70.00th=[17695], 80.00th=[21627], 90.00th=[28967], 95.00th=[35390], | 99.00th=[53740], 99.50th=[62129], 99.90th=[83362], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 39, max= 240, per=25.45%, avg=134.11, stdev=41.06, samples=93 iops : min= 9, max= 60, avg=33.10, stdev=10.33, samples=93 lat (usec) : 250=0.13%, 500=0.52%, 750=1.01%, 1000=0.68% lat (msec) : 2=1.11%, 4=9.57%, 10=21.32%, 20=40.53%, 50=23.76% lat (msec) : 100=1.33%, 750=0.03% cpu : usr=0.09%, sys=28.52%, ctx=9383, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147139: Sun Mar 1 22:47:01 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(5940KiB/46613msec) clat (usec): min=121, max=184976, avg=16137.72, stdev=10188.33 lat (usec): min=121, max=184976, avg=16138.41, stdev=10188.36 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 5735], 10.00th=[ 7570], 20.00th=[ 9372], | 30.00th=[ 10683], 40.00th=[ 12518], 50.00th=[ 14222], 60.00th=[ 16057], | 70.00th=[ 18744], 80.00th=[ 21890], 90.00th=[ 26870], 95.00th=[ 32637], | 99.00th=[ 47449], 99.50th=[ 57934], 99.90th=[ 83362], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 7, max= 224, per=25.24%, avg=126.97, stdev=37.71, samples=92 iops : min= 1, max= 56, avg=31.30, stdev= 9.46, samples=92 write: IOPS=34, BW=136KiB/s (139kB/s)(6348KiB/46613msec); 0 zone resets clat (usec): min=669, max=716946, avg=14131.57, stdev=20846.98 lat (usec): min=670, max=716946, avg=14132.34, stdev=20846.98 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 2507], 10.00th=[ 3032], 20.00th=[ 3818], | 30.00th=[ 5276], 40.00th=[ 8586], 50.00th=[ 11338], 60.00th=[ 13960], | 70.00th=[ 17171], 80.00th=[ 21627], 90.00th=[ 28967], 95.00th=[ 34866], | 99.00th=[ 50594], 99.50th=[ 64226], 99.90th=[ 81265], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 47, max= 280, per=25.90%, avg=136.52, stdev=43.99, samples=91 iops : min= 11, max= 70, avg=33.70, stdev=11.08, samples=91 lat (usec) : 250=0.23%, 500=0.42%, 750=0.81%, 1000=0.62% lat (msec) : 2=1.07%, 4=9.90%, 10=22.49%, 20=39.52%, 50=23.96% lat (msec) : 100=0.91%, 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=28.56%, ctx=9270, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147141: Sun Mar 1 22:47:01 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(6028KiB/47501msec) clat (usec): min=122, max=700336, avg=17133.97, stdev=20347.57 lat (usec): min=122, max=700336, avg=17134.65, stdev=20347.59 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 4948], 10.00th=[ 7504], 20.00th=[ 9241], | 30.00th=[ 11076], 40.00th=[ 12649], 50.00th=[ 14877], 60.00th=[ 17171], | 70.00th=[ 19792], 80.00th=[ 22938], 90.00th=[ 28443], 95.00th=[ 34866], | 99.00th=[ 54789], 99.50th=[ 66847], 99.90th=[ 90702], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 55, max= 216, per=25.31%, avg=127.32, stdev=38.77, samples=93 iops : min= 13, max= 54, avg=31.40, stdev= 9.73, samples=93 write: IOPS=32, BW=132KiB/s (135kB/s)(6260KiB/47501msec); 0 zone resets clat (usec): min=725, max=136163, avg=13721.97, stdev=11644.47 lat (usec): min=725, max=136164, avg=13722.79, stdev=11644.49 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 2474], 10.00th=[ 2933], 20.00th=[ 3916], | 30.00th=[ 6128], 40.00th=[ 8979], 50.00th=[ 11207], 60.00th=[ 13435], | 70.00th=[ 16909], 80.00th=[ 21627], 90.00th=[ 27132], 95.00th=[ 33424], | 99.00th=[ 54789], 99.50th=[ 66847], 99.90th=[104334], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 22, max= 224, per=24.72%, avg=130.27, stdev=40.96, samples=94 iops : min= 5, max= 56, avg=32.14, stdev=10.30, samples=94 lat (usec) : 250=0.13%, 500=0.68%, 750=1.17%, 1000=0.65% lat (msec) : 2=1.40%, 4=8.69%, 10=22.36%, 20=38.93%, 50=24.74% lat (msec) : 100=1.14%, 250=0.07%, 750=0.03% cpu : usr=0.12%, sys=28.11%, ctx=9378, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147143: Sun Mar 1 22:47:01 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(6052KiB/47684msec) clat (usec): min=156, max=70022, avg=16278.16, stdev=9418.83 lat (usec): min=157, max=70022, avg=16278.83, stdev=9418.88 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 3818], 10.00th=[ 7177], 20.00th=[ 9241], | 30.00th=[10814], 40.00th=[12518], 50.00th=[14746], 60.00th=[16909], | 70.00th=[19268], 80.00th=[22152], 90.00th=[27657], 95.00th=[33817], | 99.00th=[50070], 99.50th=[51643], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 55, max= 272, per=25.74%, avg=129.46, stdev=37.65, samples=93 iops : min= 13, max= 68, avg=31.95, stdev= 9.45, samples=93 write: IOPS=32, BW=131KiB/s (134kB/s)(6236KiB/47684msec); 0 zone resets clat (usec): min=677, max=729057, avg=14656.63, stdev=21325.23 lat (usec): min=678, max=729058, avg=14657.47, stdev=21325.25 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2540], 10.00th=[ 3064], 20.00th=[ 4080], | 30.00th=[ 6652], 40.00th=[ 9372], 50.00th=[ 11731], 60.00th=[ 14353], | 70.00th=[ 17695], 80.00th=[ 21627], 90.00th=[ 28705], 95.00th=[ 36963], | 99.00th=[ 53216], 99.50th=[ 60031], 99.90th=[ 88605], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 31, max= 304, per=25.05%, avg=132.00, stdev=42.94, samples=94 iops : min= 7, max= 76, avg=32.57, stdev=10.82, samples=94 lat (usec) : 250=0.13%, 500=0.65%, 750=1.20%, 1000=0.36% lat (msec) : 2=0.94%, 4=9.15%, 10=21.35%, 20=40.72%, 50=24.25% lat (msec) : 100=1.20%, 750=0.03% cpu : usr=0.11%, sys=28.34%, ctx=9266, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=504KiB/s (516kB/s), 127KiB/s-127KiB/s (130kB/s-130kB/s), io=23.4MiB (24.6MB), run=46613-47684msec WRITE: bw=527KiB/s (540kB/s), 131KiB/s-136KiB/s (134kB/s-139kB/s), io=24.6MiB (25.7MB), run=46613-47684msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147140: Sun Mar 1 22:47:21 2026 read: IOPS=22, BW=89.1KiB/s (91.2kB/s)(5992KiB/67287msec) clat (msec): min=2, max=725, avg=13.39, stdev=22.88 lat (msec): min=2, max=725, avg=13.39, stdev=22.88 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 7], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 39], | 99.00th=[ 75], 99.50th=[ 86], 99.90th=[ 136], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 15, max= 248, per=25.19%, avg=89.66, stdev=55.84, samples=133 iops : min= 3, max= 62, avg=22.22, stdev=14.09, samples=133 write: IOPS=23, BW=93.6KiB/s (95.8kB/s)(6296KiB/67287msec); 0 zone resets clat (msec): min=11, max=201, avg=29.89, stdev=16.93 lat (msec): min=11, max=201, avg=29.89, stdev=16.93 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 86], 99.50th=[ 106], 99.90th=[ 134], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 15, max= 200, per=25.23%, avg=94.11, stdev=51.27, samples=133 iops : min= 3, max= 50, avg=23.33, stdev=12.94, samples=133 lat (msec) : 4=9.41%, 10=18.75%, 20=28.55%, 50=36.36%, 100=6.58% lat (msec) : 250=0.33%, 750=0.03% cpu : usr=0.08%, sys=10.53%, ctx=6018, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147142: Sun Mar 1 22:47:21 2026 read: IOPS=22, BW=88.3KiB/s (90.4kB/s)(5940KiB/67308msec) clat (msec): min=2, max=702, avg=13.37, stdev=22.35 lat (msec): min=2, max=702, avg=13.37, stdev=22.35 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 11], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 30], 95.00th=[ 41], | 99.00th=[ 71], 99.50th=[ 80], 99.90th=[ 136], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8, max= 248, per=24.97%, avg=88.88, stdev=55.47, samples=133 iops : min= 2, max= 62, avg=22.02, stdev=13.97, samples=133 write: IOPS=23, BW=94.3KiB/s (96.6kB/s)(6348KiB/67308msec); 0 zone resets clat (msec): min=9, max=163, avg=29.78, stdev=16.37 lat (msec): min=9, max=163, avg=29.78, stdev=16.37 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 62], | 99.00th=[ 90], 99.50th=[ 102], 99.90th=[ 121], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 15, max= 200, per=25.39%, avg=94.71, stdev=50.52, samples=133 iops : min= 3, max= 50, avg=23.48, stdev=12.77, samples=133 lat (msec) : 4=9.60%, 10=17.81%, 20=28.91%, 50=36.75%, 100=6.61% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.09%, sys=10.43%, ctx=6003, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147144: Sun Mar 1 22:47:21 2026 read: IOPS=22, BW=89.6KiB/s (91.8kB/s)(6028KiB/67248msec) clat (usec): min=2345, max=94654, avg=12900.16, stdev=12583.80 lat (usec): min=2346, max=94655, avg=12900.78, stdev=12583.83 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 3163], 10.00th=[ 3458], 20.00th=[ 4113], | 30.00th=[ 4686], 40.00th=[ 5407], 50.00th=[ 7504], 60.00th=[11338], | 70.00th=[14746], 80.00th=[20579], 90.00th=[28967], 95.00th=[36963], | 99.00th=[60031], 99.50th=[77071], 99.90th=[92799], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 23, max= 224, per=25.35%, avg=90.26, stdev=52.48, samples=133 iops : min= 5, max= 56, avg=22.37, stdev=13.23, samples=133 write: IOPS=23, BW=93.1KiB/s (95.3kB/s)(6260KiB/67248msec); 0 zone resets clat (msec): min=11, max=715, avg=30.43, stdev=23.96 lat (msec): min=11, max=715, avg=30.43, stdev=23.96 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 51], 95.00th=[ 62], | 99.00th=[ 94], 99.50th=[ 101], 99.90th=[ 203], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 23, max= 200, per=25.12%, avg=93.69, stdev=50.88, samples=133 iops : min= 5, max= 50, avg=23.23, stdev=12.86, samples=133 lat (msec) : 4=8.92%, 10=18.68%, 20=27.86%, 50=38.02%, 100=6.28% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.07%, sys=10.51%, ctx=5944, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147145: Sun Mar 1 22:47:21 2026 read: IOPS=22, BW=90.2KiB/s (92.4kB/s)(6052KiB/67083msec) clat (msec): min=2, max=127, avg=12.91, stdev=13.09 lat (msec): min=2, max=127, avg=12.91, stdev=13.09 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 11], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 29], 95.00th=[ 39], | 99.00th=[ 65], 99.50th=[ 75], 99.90th=[ 102], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 16, max= 280, per=25.33%, avg=90.16, stdev=56.70, samples=132 iops : min= 4, max= 70, avg=22.34, stdev=14.30, samples=132 write: IOPS=23, BW=92.0KiB/s (95.2kB/s)(6236KiB/67083msec); 0 zone resets clat (msec): min=11, max=725, avg=30.38, stdev=24.28 lat (msec): min=11, max=725, avg=30.38, stdev=24.28 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 91], 99.50th=[ 106], 99.90th=[ 186], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 31, max= 200, per=24.98%, avg=93.19, stdev=50.69, samples=132 iops : min= 7, max= 50, avg=23.10, stdev=12.80, samples=132 lat (msec) : 4=9.70%, 10=18.26%, 20=28.84%, 50=36.43%, 100=6.45% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.08%, sys=10.52%, ctx=5956, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=357KiB/s (365kB/s), 88.3KiB/s-90.2KiB/s (90.4kB/s-92.4kB/s), io=23.4MiB (24.6MB), run=67083-67308msec WRITE: bw=374KiB/s (382kB/s), 92.0KiB/s-94.3KiB/s (95.2kB/s-96.6kB/s), io=24.6MiB (25.7MB), run=67083-67308msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147168: Sun Mar 1 22:47:38 2026 read: IOPS=33, BW=529KiB/s (541kB/s)(5920KiB/11201msec) clat (usec): min=127, max=52621, avg=15784.01, stdev=8757.98 lat (usec): min=127, max=52622, avg=15784.91, stdev=8758.29 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 594], 10.00th=[ 3884], 20.00th=[10159], | 30.00th=[11863], 40.00th=[13304], 50.00th=[15008], 60.00th=[17171], | 70.00th=[19268], 80.00th=[21103], 90.00th=[24511], 95.00th=[29492], | 99.00th=[47449], 99.50th=[50594], 99.90th=[52691], 99.95th=[52691], | 99.99th=[52691] bw ( KiB/s): min= 336, max= 733, per=25.71%, avg=526.09, stdev=97.86, samples=22 iops : min= 21, max= 45, avg=32.45, stdev= 6.15, samples=22 write: IOPS=35, BW=569KiB/s (582kB/s)(6368KiB/11201msec); 0 zone resets clat (usec): min=1315, max=46671, avg=13169.56, stdev=8681.22 lat (usec): min=1316, max=46672, avg=13184.40, stdev=8679.76 clat percentiles (usec): | 1.00th=[ 2638], 5.00th=[ 4015], 10.00th=[ 4359], 20.00th=[ 5014], | 30.00th=[ 6456], 40.00th=[ 9372], 50.00th=[11469], 60.00th=[13435], | 70.00th=[15795], 80.00th=[20055], 90.00th=[26346], 95.00th=[29230], | 99.00th=[38536], 99.50th=[44303], 99.90th=[46924], 99.95th=[46924], | 99.99th=[46924] bw ( KiB/s): min= 224, max= 830, per=26.43%, avg=568.95, stdev=163.77, samples=22 iops : min= 14, max= 51, avg=35.14, stdev=10.16, samples=22 lat (usec) : 250=0.26%, 500=0.78%, 750=2.99%, 1000=0.39% lat (msec) : 2=0.52%, 4=2.34%, 10=25.39%, 20=44.27%, 50=22.79% lat (msec) : 100=0.26% cpu : usr=0.11%, sys=31.76%, ctx=2718, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147169: Sun Mar 1 22:47:38 2026 read: IOPS=32, BW=515KiB/s (527kB/s)(5744KiB/11151msec) clat (usec): min=247, max=72255, avg=15984.20, stdev=9198.61 lat (usec): min=248, max=72255, avg=15984.70, stdev=9198.63 clat percentiles (usec): | 1.00th=[ 363], 5.00th=[ 578], 10.00th=[ 5211], 20.00th=[ 9634], | 30.00th=[11731], 40.00th=[13566], 50.00th=[15533], 60.00th=[17171], | 70.00th=[19006], 80.00th=[22152], 90.00th=[26084], 95.00th=[31327], | 99.00th=[50594], 99.50th=[52691], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 320, max= 638, per=25.05%, avg=512.50, stdev=93.71, samples=22 iops : min= 20, max= 39, avg=31.59, stdev= 5.92, samples=22 write: IOPS=36, BW=587KiB/s (601kB/s)(6544KiB/11151msec); 0 zone resets clat (usec): min=1799, max=48097, avg=13186.88, stdev=8572.42 lat (usec): min=1800, max=48099, avg=13187.91, stdev=8572.44 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 3720], 10.00th=[ 4178], 20.00th=[ 5080], | 30.00th=[ 6783], 40.00th=[ 9372], 50.00th=[11338], 60.00th=[13566], | 70.00th=[16581], 80.00th=[20055], 90.00th=[24511], 95.00th=[30016], | 99.00th=[39584], 99.50th=[41157], 99.90th=[47973], 99.95th=[47973], | 99.99th=[47973] bw ( KiB/s): min= 352, max= 894, per=27.23%, avg=586.18, stdev=140.15, samples=22 iops : min= 22, max= 55, avg=36.18, stdev= 8.74, samples=22 lat (usec) : 250=0.13%, 500=1.17%, 750=2.60%, 1000=0.26% lat (msec) : 2=0.26%, 4=3.78%, 10=24.22%, 20=44.66%, 50=22.40% lat (msec) : 100=0.52% cpu : usr=0.13%, sys=32.03%, ctx=2699, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147170: Sun Mar 1 22:47:38 2026 read: IOPS=33, BW=535KiB/s (547kB/s)(6256KiB/11703msec) clat (usec): min=344, max=56658, avg=15372.64, stdev=8810.78 lat (usec): min=344, max=56659, avg=15373.18, stdev=8810.79 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 578], 10.00th=[ 4621], 20.00th=[ 9503], | 30.00th=[11207], 40.00th=[12911], 50.00th=[14484], 60.00th=[16581], | 70.00th=[18744], 80.00th=[21627], 90.00th=[25297], 95.00th=[29230], | 99.00th=[52167], 99.50th=[54789], 99.90th=[56886], 99.95th=[56886], | 99.99th=[56886] bw ( KiB/s): min= 168, max= 992, per=25.94%, avg=530.70, stdev=170.03, samples=23 iops : min= 10, max= 62, avg=32.74, stdev=10.78, samples=23 write: IOPS=32, BW=515KiB/s (528kB/s)(6032KiB/11703msec); 0 zone resets clat (usec): min=902, max=85759, avg=14829.74, stdev=11126.30 lat (usec): min=902, max=85761, avg=14830.78, stdev=11126.32 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2835], 10.00th=[ 4228], 20.00th=[ 5669], | 30.00th=[ 8029], 40.00th=[10421], 50.00th=[12780], 60.00th=[15270], | 70.00th=[18220], 80.00th=[21365], 90.00th=[27657], 95.00th=[34866], | 99.00th=[60031], 99.50th=[66847], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 224, max= 896, per=23.47%, avg=505.39, stdev=152.75, samples=23 iops : min= 14, max= 56, avg=31.17, stdev= 9.56, samples=23 lat (usec) : 500=1.82%, 750=1.82%, 1000=0.26% lat (msec) : 2=1.30%, 4=3.39%, 10=21.35%, 20=44.27%, 50=24.22% lat (msec) : 100=1.56% cpu : usr=0.08%, sys=30.12%, ctx=2894, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147171: Sun Mar 1 22:47:38 2026 read: IOPS=34, BW=545KiB/s (558kB/s)(6032KiB/11063msec) clat (usec): min=250, max=70456, avg=14860.12, stdev=8980.61 lat (usec): min=251, max=70457, avg=14860.64, stdev=8980.62 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 523], 10.00th=[ 660], 20.00th=[ 9503], | 30.00th=[10945], 40.00th=[12649], 50.00th=[14484], 60.00th=[16188], | 70.00th=[18482], 80.00th=[21103], 90.00th=[25035], 95.00th=[28705], | 99.00th=[41681], 99.50th=[47449], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 336, max= 798, per=26.34%, avg=538.95, stdev=108.66, samples=21 iops : min= 21, max= 49, avg=33.24, stdev= 6.84, samples=21 write: IOPS=35, BW=565KiB/s (579kB/s)(6256KiB/11063msec); 0 zone resets clat (usec): min=2328, max=92360, avg=13720.37, stdev=10647.61 lat (usec): min=2329, max=92360, avg=13721.52, stdev=10647.60 clat percentiles (usec): | 1.00th=[ 3425], 5.00th=[ 4047], 10.00th=[ 4424], 20.00th=[ 5080], | 30.00th=[ 6652], 40.00th=[ 9110], 50.00th=[11076], 60.00th=[12911], | 70.00th=[15401], 80.00th=[20055], 90.00th=[27395], 95.00th=[32113], | 99.00th=[48497], 99.50th=[80217], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 364, max= 766, per=26.09%, avg=561.62, stdev=113.79, samples=21 iops : min= 22, max= 47, avg=34.62, stdev= 7.10, samples=21 lat (usec) : 500=2.08%, 750=4.04%, 1000=0.26% lat (msec) : 2=0.39%, 4=2.60%, 10=25.00%, 20=43.10%, 50=22.01% lat (msec) : 100=0.52% cpu : usr=0.09%, sys=31.39%, ctx=2631, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2047KiB/s (2096kB/s), 515KiB/s-545KiB/s (527kB/s-558kB/s), io=23.4MiB (24.5MB), run=11063-11703msec WRITE: bw=2153KiB/s (2205kB/s), 515KiB/s-587KiB/s (528kB/s-601kB/s), io=24.6MiB (25.8MB), run=11063-11703msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147172: Sun Mar 1 22:47:44 2026 read: IOPS=21, BW=340KiB/s (348kB/s)(5920KiB/17425msec) clat (usec): min=3417, max=76760, avg=16530.56, stdev=11419.81 lat (usec): min=3418, max=76761, avg=16531.16, stdev=11419.79 clat percentiles (usec): | 1.00th=[ 3720], 5.00th=[ 4621], 10.00th=[ 5473], 20.00th=[ 8094], | 30.00th=[10290], 40.00th=[11731], 50.00th=[13829], 60.00th=[16319], | 70.00th=[19006], 80.00th=[22676], 90.00th=[27919], 95.00th=[42206], | 99.00th=[64750], 99.50th=[71828], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 159, max= 640, per=24.58%, avg=333.26, stdev=125.93, samples=34 iops : min= 9, max= 40, avg=20.47, stdev= 8.09, samples=34 write: IOPS=22, BW=365KiB/s (374kB/s)(6368KiB/17425msec); 0 zone resets clat (usec): min=11989, max=88149, avg=28350.14, stdev=13136.23 lat (usec): min=11990, max=88151, avg=28351.48, stdev=13136.15 clat percentiles (usec): | 1.00th=[13042], 5.00th=[14746], 10.00th=[15926], 20.00th=[17957], | 30.00th=[20055], 40.00th=[21890], 50.00th=[24511], 60.00th=[27919], | 70.00th=[32113], 80.00th=[35914], 90.00th=[45351], 95.00th=[57410], | 99.00th=[72877], 99.50th=[84411], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 160, max= 704, per=25.42%, avg=362.71, stdev=135.04, samples=34 iops : min= 10, max= 44, avg=22.32, stdev= 8.64, samples=34 lat (msec) : 4=1.43%, 10=11.98%, 20=36.98%, 50=44.79%, 100=4.82% cpu : usr=0.07%, sys=13.33%, ctx=1820, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147173: Sun Mar 1 22:47:44 2026 read: IOPS=20, BW=325KiB/s (333kB/s)(5744KiB/17653msec) clat (usec): min=2451, max=69534, avg=15733.03, stdev=10871.59 lat (usec): min=2452, max=69535, avg=15733.58, stdev=10871.57 clat percentiles (usec): | 1.00th=[ 2999], 5.00th=[ 3982], 10.00th=[ 4817], 20.00th=[ 7570], | 30.00th=[ 9765], 40.00th=[11600], 50.00th=[13698], 60.00th=[15139], | 70.00th=[17695], 80.00th=[21365], 90.00th=[28181], 95.00th=[36963], | 99.00th=[57934], 99.50th=[68682], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 56, max= 704, per=23.87%, avg=323.74, stdev=152.99, samples=35 iops : min= 3, max= 44, avg=19.89, stdev= 9.82, samples=35 write: IOPS=23, BW=371KiB/s (380kB/s)(6544KiB/17653msec); 0 zone resets clat (msec): min=10, max=100, avg=29.09, stdev=14.42 lat (msec): min=10, max=100, avg=29.09, stdev=14.42 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 56], | 99.00th=[ 89], 99.50th=[ 100], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 192, max= 768, per=25.91%, avg=369.71, stdev=140.97, samples=35 iops : min= 12, max= 48, avg=22.77, stdev= 9.02, samples=35 lat (msec) : 4=2.47%, 10=11.85%, 20=37.50%, 50=42.19%, 100=5.86% lat (msec) : 250=0.13% cpu : usr=0.10%, sys=12.58%, ctx=1901, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147174: Sun Mar 1 22:47:44 2026 read: IOPS=22, BW=360KiB/s (369kB/s)(6256KiB/17383msec) clat (usec): min=3184, max=83007, avg=16019.91, stdev=11276.93 lat (usec): min=3184, max=83008, avg=16020.51, stdev=11276.91 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 4178], 10.00th=[ 4883], 20.00th=[ 7177], | 30.00th=[ 9634], 40.00th=[11338], 50.00th=[13435], 60.00th=[15664], | 70.00th=[18220], 80.00th=[21627], 90.00th=[28705], 95.00th=[40109], | 99.00th=[57934], 99.50th=[63177], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 126, max= 800, per=26.63%, avg=361.06, stdev=162.20, samples=34 iops : min= 7, max= 50, avg=22.21, stdev=10.34, samples=34 write: IOPS=21, BW=347KiB/s (355kB/s)(6032KiB/17383msec); 0 zone resets clat (msec): min=12, max=100, avg=29.31, stdev=14.26 lat (msec): min=12, max=100, avg=29.31, stdev=14.26 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 38], 90.00th=[ 49], 95.00th=[ 61], | 99.00th=[ 89], 99.50th=[ 99], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 159, max= 608, per=23.96%, avg=341.97, stdev=117.04, samples=34 iops : min= 9, max= 38, avg=21.00, stdev= 7.56, samples=34 lat (msec) : 4=1.95%, 10=14.06%, 20=34.24%, 50=43.88%, 100=5.73% lat (msec) : 250=0.13% cpu : usr=0.09%, sys=13.40%, ctx=1899, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147175: Sun Mar 1 22:47:44 2026 read: IOPS=21, BW=343KiB/s (351kB/s)(6032KiB/17579msec) clat (usec): min=2963, max=69521, avg=16634.56, stdev=11725.93 lat (usec): min=2964, max=69522, avg=16635.25, stdev=11725.95 clat percentiles (usec): | 1.00th=[ 3261], 5.00th=[ 4146], 10.00th=[ 5276], 20.00th=[ 8094], | 30.00th=[10290], 40.00th=[11863], 50.00th=[13829], 60.00th=[15926], | 70.00th=[17957], 80.00th=[20841], 90.00th=[35390], 95.00th=[43254], | 99.00th=[60556], 99.50th=[64750], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 127, max= 576, per=24.61%, avg=333.76, stdev=122.48, samples=34 iops : min= 7, max= 36, avg=20.50, stdev= 7.95, samples=34 write: IOPS=22, BW=356KiB/s (364kB/s)(6256KiB/17579msec); 0 zone resets clat (usec): min=11501, max=92428, avg=28795.36, stdev=13676.99 lat (usec): min=11503, max=92429, avg=28796.78, stdev=13676.88 clat percentiles (usec): | 1.00th=[12911], 5.00th=[15270], 10.00th=[16581], 20.00th=[17957], | 30.00th=[20055], 40.00th=[21890], 50.00th=[24773], 60.00th=[27657], | 70.00th=[32113], 80.00th=[36963], 90.00th=[47973], 95.00th=[54789], | 99.00th=[79168], 99.50th=[90702], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 190, max= 672, per=24.43%, avg=348.62, stdev=134.88, samples=34 iops : min= 11, max= 42, avg=21.44, stdev= 8.64, samples=34 lat (msec) : 4=1.69%, 10=12.50%, 20=39.06%, 50=41.67%, 100=5.08% cpu : usr=0.09%, sys=13.28%, ctx=2015, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1357KiB/s (1389kB/s), 325KiB/s-360KiB/s (333kB/s-369kB/s), io=23.4MiB (24.5MB), run=17383-17653msec WRITE: bw=1428KiB/s (1462kB/s), 347KiB/s-371KiB/s (355kB/s-380kB/s), io=24.6MiB (25.8MB), run=17383-17653msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147183: Sun Mar 1 22:47:53 2026 read: IOPS=2, BW=2458KiB/s (2517kB/s)(7168KiB/2916msec) clat (usec): min=995, max=895646, avg=198564.01, stdev=314478.20 lat (usec): min=996, max=895648, avg=198565.43, stdev=314478.61 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 996], 10.00th=[ 996], 20.00th=[ 45351], | 30.00th=[ 65274], 40.00th=[ 65274], 50.00th=[ 67634], 60.00th=[ 99091], | 70.00th=[ 99091], 80.00th=[214959], 90.00th=[893387], 95.00th=[893387], | 99.00th=[893387], 99.50th=[893387], 99.90th=[893387], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 2048, max= 5475, per=64.80%, avg=3873.00, stdev=1724.35, samples=3 iops : min= 2, max= 5, avg= 3.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1756KiB/s (1798kB/s)(5120KiB/2916msec); 0 zone resets clat (msec): min=208, max=442, avg=296.54, stdev=89.80 lat (msec): min=208, max=442, avg=296.59, stdev=89.80 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1825, max= 4096, per=31.66%, avg=2649.33, stdev=1256.91, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 1000=8.33% lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=39.28%, ctx=1189, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147184: Sun Mar 1 22:47:53 2026 read: IOPS=0, BW=598KiB/s (612kB/s)(2048KiB/3426msec) clat (usec): min=923, max=404960, avg=202941.83, stdev=285697.03 lat (usec): min=924, max=404962, avg=202943.21, stdev=285698.19 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], 20.00th=[ 922], | 30.00th=[ 922], 40.00th=[ 922], 50.00th=[ 922], 60.00th=[404751], | 70.00th=[404751], 80.00th=[404751], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 1712, max= 2027, per=31.28%, avg=1869.50, stdev=222.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2989KiB/s (3061kB/s)(10.0MiB/3426msec); 0 zone resets clat (msec): min=156, max=813, avg=298.40, stdev=204.10 lat (msec): min=156, max=813, avg=298.46, stdev=204.09 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 163], | 30.00th=[ 182], 40.00th=[ 199], 50.00th=[ 201], 60.00th=[ 226], | 70.00th=[ 243], 80.00th=[ 338], 90.00th=[ 464], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2048, max= 5475, per=46.83%, avg=3918.50, stdev=1410.86, samples=4 iops : min= 2, max= 5, avg= 3.50, stdev= 1.29, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=40.88%, ctx=402, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147185: Sun Mar 1 22:47:53 2026 read: IOPS=1, BW=1950KiB/s (1997kB/s)(6144KiB/3151msec) clat (usec): min=975, max=267698, avg=120548.20, stdev=118735.49 lat (usec): min=976, max=267698, avg=120549.16, stdev=118735.42 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 979], 10.00th=[ 979], 20.00th=[ 1696], | 30.00th=[ 1696], 40.00th=[ 51119], 50.00th=[ 51119], 60.00th=[164627], | 70.00th=[238027], 80.00th=[238027], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 2048, max= 4055, per=54.39%, avg=3251.00, stdev=1061.33, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1950KiB/s (1997kB/s)(6144KiB/3151msec); 0 zone resets clat (msec): min=138, max=1104, avg=400.06, stdev=368.88 lat (msec): min=138, max=1104, avg=400.12, stdev=368.88 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 300], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1825, max= 3430, per=27.87%, avg=2332.50, stdev=738.54, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=33.17%, ctx=278, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147186: Sun Mar 1 22:47:53 2026 read: IOPS=1, BW=1694KiB/s (1735kB/s)(5120KiB/3022msec) clat (usec): min=857, max=273103, avg=101132.64, stdev=126291.85 lat (usec): min=858, max=273104, avg=101133.57, stdev=126291.50 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[ 857], | 30.00th=[ 1029], 40.00th=[ 1029], 50.00th=[ 32375], 60.00th=[ 32375], | 70.00th=[198181], 80.00th=[198181], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 2048, max= 6083, per=68.02%, avg=4065.50, stdev=2853.18, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2372KiB/s (2429kB/s)(7168KiB/3022msec); 0 zone resets clat (msec): min=180, max=1059, avg=358.27, stdev=313.54 lat (msec): min=180, max=1059, avg=358.34, stdev=313.54 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 201], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 234], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 326], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1721, max= 3650, per=28.22%, avg=2361.50, stdev=871.90, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=33.98%, ctx=229, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5978KiB/s (6121kB/s), 598KiB/s-2458KiB/s (612kB/s-2517kB/s), io=20.0MiB (20.0MB), run=2916-3426msec WRITE: bw=8369KiB/s (8570kB/s), 1756KiB/s-2989KiB/s (1798kB/s-3061kB/s), io=28.0MiB (29.4MB), run=2916-3426msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147188: Sun Mar 1 22:47:53 2026 read: IOPS=1, BW=1982KiB/s (2030kB/s)(7168KiB/3616msec) clat (msec): min=18, max=916, avg=405.58, stdev=420.62 lat (msec): min=18, max=916, avg=405.58, stdev=420.62 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 19], 10.00th=[ 19], 20.00th=[ 37], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 129], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 894], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 2048, max= 4096, per=59.12%, avg=3348.00, stdev=1130.09, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1416KiB/s (1450kB/s)(5120KiB/3616msec); 0 zone resets clat (msec): min=50, max=243, avg=151.35, stdev=84.42 lat (msec): min=50, max=243, avg=151.41, stdev=84.43 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 51], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 118], 60.00th=[ 118], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 2031, max= 2031, per=25.61%, avg=2031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 20=8.33%, 50=8.33%, 100=8.33%, 250=50.00%, 750=8.33% lat (msec) : 1000=16.67% cpu : usr=0.03%, sys=7.83%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147189: Sun Mar 1 22:47:53 2026 read: IOPS=0, BW=573KiB/s (587kB/s)(2048KiB/3575msec) clat (msec): min=115, max=305, avg=210.61, stdev=134.60 lat (msec): min=115, max=305, avg=210.61, stdev=134.60 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1721, max= 1950, per=32.41%, avg=1835.50, stdev=161.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2864KiB/s (2933kB/s)(10.0MiB/3575msec); 0 zone resets clat (msec): min=64, max=1210, avg=304.06, stdev=343.51 lat (msec): min=64, max=1210, avg=304.13, stdev=343.50 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 72], | 30.00th=[ 87], 40.00th=[ 91], 50.00th=[ 220], 60.00th=[ 241], | 70.00th=[ 264], 80.00th=[ 347], 90.00th=[ 451], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1950, max= 6095, per=51.04%, avg=4047.00, stdev=2072.93, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=13.37%, ctx=141, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147190: Sun Mar 1 22:47:53 2026 read: IOPS=1, BW=1844KiB/s (1888kB/s)(6144KiB/3332msec) clat (msec): min=96, max=202, avg=142.76, stdev=44.65 lat (msec): min=96, max=202, avg=142.76, stdev=44.65 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 125], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 203], 95.00th=[ 203], | 99.00th=[ 203], 99.50th=[ 203], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 1950, max= 4096, per=59.50%, avg=3369.67, stdev=1229.58, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1844KiB/s (1888kB/s)(6144KiB/3332msec); 0 zone resets clat (msec): min=82, max=1256, avg=392.20, stdev=439.19 lat (msec): min=82, max=1256, avg=392.27, stdev=439.19 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 213], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1950, max= 3424, per=29.81%, avg=2363.25, stdev=708.46, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=66.67%, 500=8.33%, 2000=8.33% cpu : usr=0.03%, sys=14.41%, ctx=206, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147191: Sun Mar 1 22:47:53 2026 read: IOPS=1, BW=1461KiB/s (1496kB/s)(5120KiB/3504msec) clat (msec): min=43, max=588, avg=174.75, stdev=231.61 lat (msec): min=43, max=588, avg=174.75, stdev=231.61 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 44], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 82], 60.00th=[ 82], | 70.00th=[ 82], 80.00th=[ 82], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 3900, max= 4063, per=70.31%, avg=3981.50, stdev=115.26, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2046KiB/s (2095kB/s)(7168KiB/3504msec); 0 zone resets clat (msec): min=67, max=1200, avg=358.89, stdev=390.82 lat (msec): min=67, max=1200, avg=358.95, stdev=390.82 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 95], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 234], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 439], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1729, max= 2048, per=24.77%, avg=1964.00, stdev=156.87, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=16.67%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=15.39%, ctx=147, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5664KiB/s (5800kB/s), 573KiB/s-1982KiB/s (587kB/s-2030kB/s), io=20.0MiB (20.0MB), run=3332-3616msec WRITE: bw=7929KiB/s (8120kB/s), 1416KiB/s-2864KiB/s (1450kB/s-2933kB/s), io=28.0MiB (29.4MB), run=3332-3616msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147197: Sun Mar 1 22:48:01 2026 read: IOPS=2, BW=8325KiB/s (8525kB/s)(12.0MiB/1476msec) clat (msec): min=386, max=587, avg=487.18, stdev=100.10 lat (msec): min=386, max=587, avg=487.18, stdev=100.10 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7327, max= 7327, per=77.01%, avg=7327.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=54.44%, ctx=2314, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147198: Sun Mar 1 22:48:01 2026 read: IOPS=0, BW=2379KiB/s (2436kB/s)(4096KiB/1722msec) clat (nsec): min=500721k, max=500721k, avg=500720704.00, stdev= 0.00 lat (nsec): min=500722k, max=500722k, avg=500722199.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7098, max= 7098, per=74.61%, avg=7098.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4757KiB/s (4871kB/s)(8192KiB/1722msec); 0 zone resets clat (msec): min=208, max=993, avg=600.78, stdev=554.87 lat (msec): min=208, max=993, avg=601.03, stdev=554.88 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8126, max= 8126, per=42.70%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.33%, ctx=701, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147199: Sun Mar 1 22:48:01 2026 write: IOPS=1, BW=7254KiB/s (7428kB/s)(12.0MiB/1694msec); 0 zone resets clat (msec): min=136, max=895, avg=560.08, stdev=387.47 lat (msec): min=136, max=896, avg=560.44, stdev=387.45 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8126, max= 8192, per=42.88%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=19.73%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147200: Sun Mar 1 22:48:01 2026 write: IOPS=1, BW=7964KiB/s (8155kB/s)(12.0MiB/1543msec); 0 zone resets clat (msec): min=319, max=760, avg=510.63, stdev=225.95 lat (msec): min=319, max=760, avg=510.87, stdev=225.87 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7460, max= 8126, per=40.95%, avg=7793.00, stdev=470.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.29%, ctx=88, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9515KiB/s (9743kB/s), 2379KiB/s-8325KiB/s (2436kB/s-8525kB/s), io=16.0MiB (16.8MB), run=1476-1722msec WRITE: bw=18.6MiB/s (19.5MB/s), 4757KiB/s-7964KiB/s (4871kB/s-8155kB/s), io=32.0MiB (33.6MB), run=1543-1722msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147202: Sun Mar 1 22:48:02 2026 read: IOPS=1, BW=6324KiB/s (6476kB/s)(12.0MiB/1943msec) clat (msec): min=64, max=1046, avg=635.09, stdev=509.83 lat (msec): min=64, max=1046, avg=635.09, stdev=509.83 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 65], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8192, max= 8192, per=97.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.04%, ctx=40, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147203: Sun Mar 1 22:48:02 2026 read: IOPS=0, BW=2206KiB/s (2259kB/s)(4096KiB/1857msec) clat (nsec): min=546063k, max=546063k, avg=546063222.00, stdev= 0.00 lat (nsec): min=546066k, max=546066k, avg=546065646.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8192, max= 8192, per=97.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4411KiB/s (4517kB/s)(8192KiB/1857msec); 0 zone resets clat (msec): min=352, max=859, avg=606.42, stdev=358.53 lat (msec): min=353, max=860, avg=606.72, stdev=358.56 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8192, max= 8192, per=48.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.11%, sys=18.64%, ctx=166, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147204: Sun Mar 1 22:48:02 2026 write: IOPS=1, BW=6678KiB/s (6839kB/s)(12.0MiB/1840msec); 0 zone resets clat (msec): min=221, max=781, avg=576.05, stdev=308.19 lat (msec): min=221, max=781, avg=576.33, stdev=308.16 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8192, max= 8192, per=48.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.11%, sys=13.10%, ctx=58, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147205: Sun Mar 1 22:48:02 2026 write: IOPS=1, BW=6380KiB/s (6533kB/s)(12.0MiB/1926msec); 0 zone resets clat (msec): min=225, max=1271, avg=621.44, stdev=567.55 lat (msec): min=225, max=1271, avg=621.75, stdev=567.54 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7557, max= 7557, per=44.42%, avg=7557.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.16%, sys=20.73%, ctx=96, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8432KiB/s (8635kB/s), 2206KiB/s-6324KiB/s (2259kB/s-6476kB/s), io=16.0MiB (16.8MB), run=1857-1943msec WRITE: bw=16.6MiB/s (17.4MB/s), 4411KiB/s-6678KiB/s (4517kB/s-6839kB/s), io=32.0MiB (33.6MB), run=1840-1926msec