== sanity test 398b: DIO and buffer IO race ============== 14:34:59 (1780338899) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.27925 s, 9.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144680: Mon Jun 1 14:37:39 2026 read: IOPS=10, BW=43.2KiB/s (44.3kB/s)(5992KiB/138603msec) clat (usec): min=32, max=332338, avg=47533.40, stdev=35574.58 lat (usec): min=32, max=332340, avg=47534.99, stdev=35574.62 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 12518], 20.00th=[ 21365], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[110625], | 99.00th=[170918], 99.50th=[191890], 99.90th=[299893], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 119, per=25.30%, avg=43.26, stdev=18.08, samples=270 iops : min= 1, max= 29, avg=10.17, stdev= 4.54, samples=270 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6296KiB/138603msec); 0 zone resets clat (usec): min=943, max=809240, avg=42500.58, stdev=45960.60 lat (usec): min=944, max=809242, avg=42512.73, stdev=45966.13 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1303], 10.00th=[ 1680], 20.00th=[ 4686], | 30.00th=[ 9241], 40.00th=[ 20579], 50.00th=[ 31589], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[100140], 95.00th=[123208], | 99.00th=[173016], 99.50th=[204473], 99.90th=[341836], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 111, per=25.30%, avg=45.29, stdev=19.81, samples=271 iops : min= 1, max= 27, avg=10.68, stdev= 4.98, samples=271 lat (usec) : 50=0.59%, 100=3.09%, 250=0.16%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.83%, 4=3.61%, 10=6.71%, 20=8.53%, 50=34.77% lat (msec) : 100=27.99%, 250=8.20%, 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=4.47%, ctx=6455, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144682: Mon Jun 1 14:37:39 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5940KiB/139435msec) clat (usec): min=31, max=914774, avg=46318.22, stdev=42738.34 lat (usec): min=31, max=914776, avg=46321.20, stdev=42739.36 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 12256], 20.00th=[ 21890], | 30.00th=[ 28181], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[173016], 99.50th=[189793], 99.90th=[583009], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 96, per=25.01%, avg=42.76, stdev=19.14, samples=270 iops : min= 1, max= 24, avg=10.05, stdev= 4.84, samples=270 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6348KiB/139435msec); 0 zone resets clat (usec): min=948, max=359200, avg=44174.54, stdev=46885.67 lat (usec): min=950, max=359202, avg=44179.44, stdev=46883.91 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1270], 10.00th=[ 1434], 20.00th=[ 3982], | 30.00th=[ 7963], 40.00th=[ 18482], 50.00th=[ 32637], 60.00th=[ 44303], | 70.00th=[ 58983], 80.00th=[ 77071], 90.00th=[104334], 95.00th=[130548], | 99.00th=[202376], 99.50th=[246416], 99.90th=[346031], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 126, per=25.50%, avg=45.64, stdev=19.69, samples=270 iops : min= 1, max= 31, avg=10.77, stdev= 4.96, samples=270 lat (usec) : 50=0.62%, 100=3.26%, 250=0.29%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=7.00%, 4=3.39%, 10=6.64%, 20=8.04%, 50=34.08% lat (msec) : 100=28.16%, 250=7.91%, 500=0.29%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.35%, ctx=6225, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144685: Mon Jun 1 14:37:39 2026 read: IOPS=10, BW=43.0KiB/s (44.0kB/s)(6028KiB/140161msec) clat (usec): min=29, max=916230, avg=46256.53, stdev=43346.50 lat (usec): min=30, max=916232, avg=46259.08, stdev=43346.21 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 10814], 20.00th=[ 20841], | 30.00th=[ 26870], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[154141], 99.50th=[229639], 99.90th=[505414], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 120, per=25.14%, avg=42.98, stdev=19.85, samples=273 iops : min= 1, max= 30, avg=10.11, stdev= 5.03, samples=273 write: IOPS=11, BW=44.7KiB/s (45.7kB/s)(6260KiB/140161msec); 0 zone resets clat (usec): min=960, max=251756, avg=44674.86, stdev=43760.23 lat (usec): min=961, max=251757, avg=44676.94, stdev=43760.12 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1303], 10.00th=[ 1532], 20.00th=[ 4555], | 30.00th=[ 10945], 40.00th=[ 22938], 50.00th=[ 33424], 60.00th=[ 44827], | 70.00th=[ 59507], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[137364], | 99.00th=[179307], 99.50th=[198181], 99.90th=[233833], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 136, per=24.91%, avg=44.60, stdev=19.39, samples=273 iops : min= 1, max= 34, avg=10.51, stdev= 4.88, samples=273 lat (usec) : 50=0.59%, 100=3.61%, 250=0.23%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.32%, 4=3.32%, 10=5.14%, 20=8.72%, 50=35.81% lat (msec) : 100=27.51%, 250=8.37%, 500=0.13%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.54%, ctx=6430, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144686: Mon Jun 1 14:37:39 2026 read: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6052KiB/138324msec) clat (usec): min=33, max=463211, avg=45635.87, stdev=35266.69 lat (usec): min=33, max=463213, avg=45640.06, stdev=35271.95 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 11863], 20.00th=[ 21365], | 30.00th=[ 27132], 40.00th=[ 32375], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[175113], 99.50th=[198181], 99.90th=[312476], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 103, per=25.68%, avg=43.91, stdev=18.51, samples=268 iops : min= 1, max= 25, avg=10.34, stdev= 4.67, samples=268 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6236KiB/138324msec); 0 zone resets clat (usec): min=862, max=831887, avg=44074.39, stdev=49361.91 lat (usec): min=864, max=831889, avg=44079.31, stdev=49359.46 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1270], 10.00th=[ 1385], 20.00th=[ 4621], | 30.00th=[ 9765], 40.00th=[ 21365], 50.00th=[ 32113], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[137364], | 99.00th=[206570], 99.50th=[221250], 99.90th=[312476], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 110, per=24.99%, avg=44.73, stdev=19.53, samples=271 iops : min= 1, max= 27, avg=10.55, stdev= 4.94, samples=271 lat (usec) : 50=0.75%, 100=3.39%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=7.00%, 4=2.54%, 10=6.12%, 20=8.17%, 50=37.04% lat (msec) : 100=26.24%, 250=8.20%, 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=4.65%, ctx=6424, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.6KiB/s-43.8KiB/s (43.6kB/s-44.8kB/s), io=23.4MiB (24.6MB), run=138324-140161msec WRITE: bw=179KiB/s (184kB/s), 44.7KiB/s-45.5KiB/s (45.7kB/s-46.6kB/s), io=24.6MiB (25.7MB), run=138324-140161msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144681: Mon Jun 1 14:40:07 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(5992KiB/286408msec) clat (msec): min=4, max=1013, avg=43.99, stdev=46.48 lat (msec): min=4, max=1013, avg=43.99, stdev=46.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 83], 95.00th=[ 115], | 99.00th=[ 209], 99.50th=[ 288], 99.90th=[ 510], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 79, per=28.81%, avg=23.91, stdev=15.06, samples=483 iops : min= 1, max= 19, avg= 5.34, stdev= 3.80, samples=483 write: IOPS=5, BW=21.0KiB/s (22.5kB/s)(6296KiB/286408msec); 0 zone resets clat (msec): min=36, max=563, avg=139.78, stdev=76.03 lat (msec): min=36, max=563, avg=139.79, stdev=76.03 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 102], 50.00th=[ 114], 60.00th=[ 134], | 70.00th=[ 161], 80.00th=[ 197], 90.00th=[ 251], 95.00th=[ 292], | 99.00th=[ 393], 99.50th=[ 451], 99.90th=[ 506], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 56, per=25.16%, avg=21.89, stdev=10.94, samples=552 iops : min= 1, max= 14, avg= 4.83, stdev= 2.79, samples=552 lat (msec) : 10=1.79%, 20=9.02%, 50=26.30%, 100=28.29%, 250=29.20% lat (msec) : 500=5.27%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.29%, ctx=5818, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144683: Mon Jun 1 14:40:07 2026 read: IOPS=5, BW=20.7KiB/s (21.1kB/s)(5940KiB/287637msec) clat (msec): min=5, max=874, avg=44.64, stdev=43.91 lat (msec): min=5, max=874, avg=44.64, stdev=43.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 117], | 99.00th=[ 211], 99.50th=[ 245], 99.90th=[ 380], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 87, per=28.27%, avg=23.47, stdev=15.46, samples=488 iops : min= 1, max= 21, avg= 5.23, stdev= 3.91, samples=488 write: IOPS=5, BW=22.1KiB/s (22.6kB/s)(6348KiB/287637msec); 0 zone resets clat (msec): min=34, max=560, avg=139.20, stdev=79.52 lat (msec): min=34, max=560, avg=139.21, stdev=79.52 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 132], | 70.00th=[ 155], 80.00th=[ 190], 90.00th=[ 253], 95.00th=[ 305], | 99.00th=[ 409], 99.50th=[ 451], 99.90th=[ 550], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 69, per=25.18%, avg=21.91, stdev=11.33, samples=557 iops : min= 1, max= 17, avg= 4.84, stdev= 2.89, samples=557 lat (msec) : 10=1.79%, 20=9.41%, 50=25.68%, 100=27.60%, 250=29.98% lat (msec) : 500=5.37%, 750=0.13%, 1000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5808, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144684: Mon Jun 1 14:40:07 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6028KiB/284470msec) clat (msec): min=5, max=320, avg=44.03, stdev=37.79 lat (msec): min=5, max=320, avg=44.03, stdev=37.80 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 215], 99.50th=[ 251], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 110, per=28.67%, avg=23.80, stdev=16.70, samples=488 iops : min= 1, max= 27, avg= 5.31, stdev= 4.22, samples=488 write: IOPS=5, BW=22.0KiB/s (22.5kB/s)(6260KiB/284470msec); 0 zone resets clat (msec): min=36, max=938, avg=139.06, stdev=77.04 lat (msec): min=36, max=938, avg=139.06, stdev=77.04 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 133], | 70.00th=[ 161], 80.00th=[ 194], 90.00th=[ 243], 95.00th=[ 296], | 99.00th=[ 388], 99.50th=[ 435], 99.90th=[ 489], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 48, per=25.24%, avg=21.96, stdev=10.87, samples=547 iops : min= 1, max= 12, avg= 4.85, stdev= 2.77, samples=547 lat (msec) : 10=2.02%, 20=8.59%, 50=25.72%, 100=28.97%, 250=29.85% lat (msec) : 500=4.82%, 1000=0.03% cpu : usr=0.04%, sys=1.36%, ctx=5766, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144687: Mon Jun 1 14:40:07 2026 read: IOPS=5, BW=21.1KiB/s (21.7kB/s)(6052KiB/286217msec) clat (msec): min=5, max=510, avg=43.85, stdev=42.90 lat (msec): min=5, max=510, avg=43.85, stdev=42.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 118], | 99.00th=[ 245], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 87, per=29.37%, avg=24.38, stdev=16.19, samples=479 iops : min= 1, max= 21, avg= 5.46, stdev= 4.09, samples=479 write: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6236KiB/286217msec); 0 zone resets clat (msec): min=29, max=1105, avg=140.72, stdev=78.16 lat (msec): min=29, max=1105, avg=140.73, stdev=78.16 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 194], 90.00th=[ 251], 95.00th=[ 292], | 99.00th=[ 384], 99.50th=[ 405], 99.90th=[ 558], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 54, per=24.91%, avg=21.67, stdev=10.83, samples=553 iops : min= 1, max= 13, avg= 4.78, stdev= 2.77, samples=553 lat (msec) : 10=1.99%, 20=9.15%, 50=27.18%, 100=25.85%, 250=30.34% lat (msec) : 500=5.37%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=5877, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=83.5KiB/s (85.5kB/s), 20.7KiB/s-21.2KiB/s (21.1kB/s-21.7kB/s), io=23.4MiB (24.6MB), run=284470-287637msec WRITE: bw=87.4KiB/s (89.5kB/s), 21.8KiB/s-22.1KiB/s (22.3kB/s-22.6kB/s), io=24.6MiB (25.7MB), run=284470-287637msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144751: Mon Jun 1 14:40:46 2026 read: IOPS=13, BW=219KiB/s (225kB/s)(5920KiB/26975msec) clat (usec): min=37, max=374924, avg=38743.67, stdev=36751.20 lat (usec): min=38, max=374925, avg=38745.28, stdev=36751.17 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 4146], | 30.00th=[ 21365], 40.00th=[ 27132], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 56886], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[162530], 99.50th=[229639], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 30, max= 447, per=26.06%, avg=218.94, stdev=89.16, samples=53 iops : min= 1, max= 27, avg=12.96, stdev= 5.60, samples=53 write: IOPS=14, BW=236KiB/s (242kB/s)(6368KiB/26975msec); 0 zone resets clat (usec): min=1576, max=248029, avg=31014.58, stdev=35074.88 lat (usec): min=1577, max=248032, avg=31029.01, stdev=35068.41 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1827], 10.00th=[ 2376], 20.00th=[ 4490], | 30.00th=[ 6521], 40.00th=[ 11207], 50.00th=[ 19530], 60.00th=[ 27132], | 70.00th=[ 37487], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[105382], | 99.00th=[164627], 99.50th=[217056], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 63, max= 500, per=26.71%, avg=236.08, stdev=88.96, samples=53 iops : min= 3, max= 31, avg=14.06, stdev= 5.56, samples=53 lat (usec) : 50=1.04%, 100=6.77%, 250=0.91%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.30%, 4=5.34%, 10=11.07%, 20=9.64%, 50=35.68% lat (msec) : 100=19.66%, 250=5.08%, 500=0.13% cpu : usr=0.08%, sys=5.67%, ctx=1428, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144754: Mon Jun 1 14:40:46 2026 read: IOPS=12, BW=202KiB/s (206kB/s)(5744KiB/28504msec) clat (usec): min=40, max=169304, avg=40811.10, stdev=28816.38 lat (usec): min=41, max=169306, avg=40819.99, stdev=28827.61 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 20317], | 30.00th=[ 27919], 40.00th=[ 31589], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 88605], | 99.00th=[152044], 99.50th=[158335], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 30, max= 349, per=24.33%, avg=204.35, stdev=74.20, samples=55 iops : min= 1, max= 21, avg=12.04, stdev= 4.68, samples=55 write: IOPS=14, BW=230KiB/s (235kB/s)(6544KiB/28504msec); 0 zone resets clat (usec): min=1550, max=308262, avg=33050.19, stdev=41865.06 lat (usec): min=1552, max=308266, avg=33075.62, stdev=41865.15 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1893], 10.00th=[ 2769], 20.00th=[ 4948], | 30.00th=[ 7635], 40.00th=[ 12911], 50.00th=[ 19006], 60.00th=[ 25035], | 70.00th=[ 33817], 80.00th=[ 51119], 90.00th=[ 77071], 95.00th=[122160], | 99.00th=[198181], 99.50th=[212861], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 30, max= 509, per=25.95%, avg=229.36, stdev=109.24, samples=56 iops : min= 1, max= 31, avg=13.62, stdev= 6.90, samples=56 lat (usec) : 50=0.26%, 100=5.34%, 250=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.78%, 4=5.47%, 10=9.64%, 20=11.20%, 50=38.67% lat (msec) : 100=19.14%, 250=5.47%, 500=0.26% cpu : usr=0.08%, sys=5.79%, ctx=1524, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144755: Mon Jun 1 14:40:46 2026 read: IOPS=14, BW=229KiB/s (235kB/s)(6256KiB/27301msec) clat (usec): min=33, max=364476, avg=39531.11, stdev=39988.13 lat (usec): min=33, max=364478, avg=39532.57, stdev=39988.12 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 91], | 30.00th=[ 21365], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[101188], | 99.00th=[221250], 99.50th=[235930], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 63, max= 510, per=27.05%, avg=227.25, stdev=92.71, samples=53 iops : min= 3, max= 31, avg=13.51, stdev= 5.86, samples=53 write: IOPS=13, BW=221KiB/s (226kB/s)(6032KiB/27301msec); 0 zone resets clat (usec): min=1329, max=333361, avg=31272.80, stdev=36205.78 lat (usec): min=1331, max=333362, avg=31275.74, stdev=36205.50 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1811], 10.00th=[ 2278], 20.00th=[ 4424], | 30.00th=[ 7439], 40.00th=[ 12256], 50.00th=[ 21103], 60.00th=[ 29230], | 70.00th=[ 38536], 80.00th=[ 53740], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[179307], 99.50th=[261096], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 31, max= 447, per=24.51%, avg=216.64, stdev=85.42, samples=53 iops : min= 1, max= 27, avg=12.83, stdev= 5.41, samples=53 lat (usec) : 50=1.30%, 100=9.38%, 250=0.26%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.04%, 4=5.21%, 10=8.59%, 20=9.51%, 50=36.20% lat (msec) : 100=21.48%, 250=3.39%, 500=0.39% cpu : usr=0.09%, sys=5.58%, ctx=1405, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144756: Mon Jun 1 14:40:46 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(6032KiB/27640msec) clat (usec): min=31, max=239284, avg=40776.46, stdev=35750.36 lat (usec): min=31, max=239285, avg=40793.31, stdev=35759.38 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 13304], | 30.00th=[ 23462], 40.00th=[ 28967], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[107480], | 99.00th=[175113], 99.50th=[177210], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 574, per=26.68%, avg=224.08, stdev=96.20, samples=52 iops : min= 1, max= 35, avg=13.29, stdev= 6.05, samples=52 write: IOPS=14, BW=226KiB/s (232kB/s)(6256KiB/27640msec); 0 zone resets clat (usec): min=1165, max=268448, avg=30343.31, stdev=34839.29 lat (usec): min=1166, max=268453, avg=30345.65, stdev=34839.37 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1778], 10.00th=[ 2180], 20.00th=[ 4686], | 30.00th=[ 7439], 40.00th=[ 10683], 50.00th=[ 18482], 60.00th=[ 27395], | 70.00th=[ 36963], 80.00th=[ 51119], 90.00th=[ 71828], 95.00th=[ 95945], | 99.00th=[160433], 99.50th=[258999], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 93, max= 466, per=26.49%, avg=234.15, stdev=96.19, samples=52 iops : min= 5, max= 29, avg=13.92, stdev= 6.11, samples=52 lat (usec) : 50=0.52%, 100=7.29%, 250=0.52%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.17%, 4=4.82%, 10=11.20%, 20=9.38%, 50=35.55% lat (msec) : 100=21.09%, 250=4.95%, 500=0.26% cpu : usr=0.08%, sys=5.59%, ctx=1477, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=840KiB/s (860kB/s), 202KiB/s-229KiB/s (206kB/s-235kB/s), io=23.4MiB (24.5MB), run=26975-28504msec WRITE: bw=884KiB/s (905kB/s), 221KiB/s-236KiB/s (226kB/s-242kB/s), io=24.6MiB (25.8MB), run=26975-28504msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144749: Mon Jun 1 14:41:17 2026 read: IOPS=6, BW=99.8KiB/s (102kB/s)(5920KiB/59341msec) clat (msec): min=6, max=220, avg=34.30, stdev=33.55 lat (msec): min=6, max=220, avg=34.30, stdev=33.55 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 103], | 99.00th=[ 192], 99.50th=[ 218], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 30, max= 383, per=27.19%, avg=108.75, stdev=69.55, samples=107 iops : min= 1, max= 23, avg= 5.96, stdev= 4.36, samples=107 write: IOPS=6, BW=107KiB/s (110kB/s)(6368KiB/59341msec); 0 zone resets clat (msec): min=40, max=419, avg=116.49, stdev=64.27 lat (msec): min=40, max=419, avg=116.50, stdev=64.27 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 69], | 30.00th=[ 75], 40.00th=[ 83], 50.00th=[ 94], 60.00th=[ 110], | 70.00th=[ 132], 80.00th=[ 157], 90.00th=[ 207], 95.00th=[ 249], | 99.00th=[ 355], 99.50th=[ 418], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 22, max= 256, per=25.67%, avg=108.08, stdev=54.15, samples=116 iops : min= 1, max= 16, avg= 5.91, stdev= 3.45, samples=116 lat (msec) : 10=3.91%, 20=18.10%, 50=18.88%, 100=32.81%, 250=23.96% lat (msec) : 500=2.34% cpu : usr=0.04%, sys=1.42%, ctx=1275, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144750: Mon Jun 1 14:41:17 2026 read: IOPS=6, BW=96.2KiB/s (98.5kB/s)(5744KiB/59708msec) clat (msec): min=6, max=332, avg=34.48, stdev=36.82 lat (msec): min=6, max=332, avg=34.48, stdev=36.82 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 79], 95.00th=[ 115], | 99.00th=[ 188], 99.50th=[ 207], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 21, max= 351, per=27.18%, avg=108.74, stdev=69.02, samples=103 iops : min= 1, max= 21, avg= 5.97, stdev= 4.40, samples=103 write: IOPS=6, BW=110KiB/s (112kB/s)(6544KiB/59708msec); 0 zone resets clat (msec): min=42, max=576, avg=115.31, stdev=64.03 lat (msec): min=42, max=576, avg=115.31, stdev=64.03 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 70], | 30.00th=[ 81], 40.00th=[ 87], 50.00th=[ 99], 60.00th=[ 108], | 70.00th=[ 124], 80.00th=[ 148], 90.00th=[ 186], 95.00th=[ 247], | 99.00th=[ 338], 99.50th=[ 384], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 30, max= 223, per=26.38%, avg=111.05, stdev=51.02, samples=115 iops : min= 1, max= 13, avg= 6.10, stdev= 3.23, samples=115 lat (msec) : 10=2.86%, 20=18.49%, 50=18.62%, 100=32.16%, 250=25.13% lat (msec) : 500=2.47%, 750=0.26% cpu : usr=0.05%, sys=1.47%, ctx=1338, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144752: Mon Jun 1 14:41:17 2026 read: IOPS=6, BW=109KiB/s (112kB/s)(6256KiB/57336msec) clat (msec): min=6, max=208, avg=33.29, stdev=32.45 lat (msec): min=6, max=208, avg=33.29, stdev=32.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 70], 95.00th=[ 105], | 99.00th=[ 178], 99.50th=[ 209], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 377, per=29.44%, avg=117.75, stdev=76.96, samples=105 iops : min= 1, max= 23, avg= 6.52, stdev= 4.87, samples=105 write: IOPS=6, BW=105KiB/s (108kB/s)(6032KiB/57336msec); 0 zone resets clat (msec): min=34, max=452, avg=116.47, stdev=60.55 lat (msec): min=34, max=452, avg=116.47, stdev=60.54 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 80], 40.00th=[ 89], 50.00th=[ 97], 60.00th=[ 113], | 70.00th=[ 127], 80.00th=[ 157], 90.00th=[ 205], 95.00th=[ 234], | 99.00th=[ 321], 99.50th=[ 347], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 22, max= 223, per=25.18%, avg=106.00, stdev=49.82, samples=112 iops : min= 1, max= 13, avg= 5.79, stdev= 3.17, samples=112 lat (msec) : 10=4.17%, 20=18.88%, 50=20.05%, 100=30.99%, 250=23.83% lat (msec) : 500=2.08% cpu : usr=0.04%, sys=1.42%, ctx=1304, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144753: Mon Jun 1 14:41:17 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59774msec) clat (msec): min=5, max=317, avg=35.22, stdev=38.83 lat (msec): min=5, max=317, avg=35.23, stdev=38.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 83], 95.00th=[ 122], | 99.00th=[ 218], 99.50th=[ 264], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 318, per=27.05%, avg=108.21, stdev=74.32, samples=108 iops : min= 1, max= 19, avg= 5.92, stdev= 4.71, samples=108 write: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59774msec); 0 zone resets clat (msec): min=35, max=394, avg=118.01, stdev=63.14 lat (msec): min=35, max=394, avg=118.02, stdev=63.14 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 102], 60.00th=[ 113], | 70.00th=[ 128], 80.00th=[ 159], 90.00th=[ 199], 95.00th=[ 253], | 99.00th=[ 359], 99.50th=[ 384], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 21, max= 223, per=25.40%, avg=106.92, stdev=51.11, samples=114 iops : min= 1, max= 13, avg= 5.84, stdev= 3.25, samples=114 lat (msec) : 10=2.60%, 20=18.49%, 50=20.70%, 100=28.78%, 250=26.43% lat (msec) : 500=2.99% cpu : usr=0.05%, sys=1.46%, ctx=1336, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=401KiB/s (410kB/s), 96.2KiB/s-109KiB/s (98.5kB/s-112kB/s), io=23.4MiB (24.5MB), run=57336-59774msec WRITE: bw=422KiB/s (432kB/s), 105KiB/s-110KiB/s (107kB/s-112kB/s), io=24.6MiB (25.8MB), run=57336-59774msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144770: Mon Jun 1 14:41:31 2026 read: IOPS=2, BW=2650KiB/s (2714kB/s)(7168KiB/2705msec) clat (usec): min=449, max=760188, avg=241266.54, stdev=277369.63 lat (usec): min=450, max=760191, avg=241268.07, stdev=277370.02 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 519], | 30.00th=[ 1975], 40.00th=[ 1975], 50.00th=[258999], 60.00th=[304088], | 70.00th=[304088], 80.00th=[362808], 90.00th=[759170], 95.00th=[759170], | 99.00th=[759170], 99.50th=[759170], 99.90th=[759170], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 1910, max= 4015, per=66.03%, avg=2972.75, stdev=1152.26, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1893KiB/s (1938kB/s)(5120KiB/2705msec); 0 zone resets clat (msec): min=91, max=312, avg=174.49, stdev=85.26 lat (msec): min=91, max=312, avg=174.57, stdev=85.28 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1910, max= 3923, per=41.66%, avg=2625.33, stdev=1125.78, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=10.21%, ctx=157, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144771: Mon Jun 1 14:41:31 2026 read: IOPS=0, BW=450KiB/s (461kB/s)(2048KiB/4549msec) clat (usec): min=501, max=162628, avg=81564.63, stdev=114641.10 lat (usec): min=502, max=162630, avg=81566.45, stdev=114641.55 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[162530], | 70.00th=[162530], 80.00th=[162530], 90.00th=[162530], 95.00th=[162530], | 99.00th=[162530], 99.50th=[162530], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 1735, max= 1910, per=40.48%, avg=1822.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2251KiB/s (2305kB/s)(10.0MiB/4549msec); 0 zone resets clat (msec): min=247, max=832, avg=435.23, stdev=166.10 lat (msec): min=247, max=832, avg=436.19, stdev=165.67 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 317], | 30.00th=[ 351], 40.00th=[ 355], 50.00th=[ 368], 60.00th=[ 372], | 70.00th=[ 468], 80.00th=[ 506], 90.00th=[ 550], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1735, max= 2043, per=31.19%, avg=1965.62, stdev=103.20, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=8.95%, ctx=120, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144772: Mon Jun 1 14:41:31 2026 read: IOPS=2, BW=2341KiB/s (2398kB/s)(6144KiB/2624msec) clat (usec): min=514, max=307498, avg=99353.58, stdev=153155.69 lat (usec): min=515, max=307499, avg=99355.16, stdev=153155.90 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 578], 50.00th=[ 578], 60.00th=[ 717], | 70.00th=[287310], 80.00th=[287310], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 4087, max= 4087, per=90.78%, avg=4087.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2341KiB/s (2398kB/s)(6144KiB/2624msec); 0 zone resets clat (msec): min=93, max=559, avg=303.67, stdev=184.57 lat (msec): min=93, max=559, avg=303.72, stdev=184.57 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 313], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1753, max= 2043, per=30.80%, avg=1941.00, stdev=129.75, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=33.33% lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=8.88%, ctx=92, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144773: Mon Jun 1 14:41:31 2026 read: IOPS=1, BW=1998KiB/s (2046kB/s)(5120KiB/2563msec) clat (usec): min=725, max=241625, avg=126183.92, stdev=115279.14 lat (usec): min=727, max=241626, avg=126185.31, stdev=115278.93 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 725], 10.00th=[ 725], 20.00th=[ 725], | 30.00th=[ 2933], 40.00th=[ 2933], 50.00th=[189793], 60.00th=[189793], | 70.00th=[196084], 80.00th=[196084], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2797KiB/s (2864kB/s)(7168KiB/2563msec); 0 zone resets clat (msec): min=173, max=470, avg=266.89, stdev=115.81 lat (msec): min=173, max=470, avg=267.09, stdev=115.71 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 201], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 359], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1838, max= 4087, per=41.95%, avg=2644.00, stdev=1252.53, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=14.56%, ctx=133, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4502KiB/s (4610kB/s), 450KiB/s-2650KiB/s (461kB/s-2714kB/s), io=20.0MiB (20.0MB), run=2563-4549msec WRITE: bw=6303KiB/s (6454kB/s), 1893KiB/s-2797KiB/s (1938kB/s-2864kB/s), io=28.0MiB (29.4MB), run=2563-4549msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144775: Mon Jun 1 14:41:32 2026 read: IOPS=1, BW=1702KiB/s (1743kB/s)(7168KiB/4211msec) clat (msec): min=98, max=622, avg=270.56, stdev=217.71 lat (msec): min=98, max=622, avg=270.56, stdev=217.71 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 106], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 144], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 527], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2007, max= 4063, per=69.03%, avg=3038.00, stdev=1183.58, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1216KiB/s (1245kB/s)(5120KiB/4211msec); 0 zone resets clat (msec): min=243, max=472, avg=375.93, stdev=90.46 lat (msec): min=244, max=472, avg=376.17, stdev=90.20 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1969, max= 3849, per=42.39%, avg=2612.33, stdev=1071.28, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.02%, sys=3.54%, ctx=72, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144776: Mon Jun 1 14:41:32 2026 read: IOPS=0, BW=440KiB/s (451kB/s)(2048KiB/4653msec) clat (msec): min=162, max=477, avg=319.99, stdev=222.82 lat (msec): min=162, max=477, avg=319.99, stdev=222.82 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1359, max= 2019, per=38.38%, avg=1689.00, stdev=466.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2201KiB/s (2254kB/s)(10.0MiB/4653msec); 0 zone resets clat (msec): min=86, max=768, avg=382.69, stdev=225.69 lat (msec): min=86, max=768, avg=382.79, stdev=225.69 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 150], | 30.00th=[ 197], 40.00th=[ 275], 50.00th=[ 326], 60.00th=[ 372], | 70.00th=[ 405], 80.00th=[ 609], 90.00th=[ 642], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1892, max= 4063, per=44.76%, avg=2758.40, stdev=1096.80, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=2.99%, ctx=57, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144777: Mon Jun 1 14:41:32 2026 read: IOPS=1, BW=1514KiB/s (1551kB/s)(6144KiB/4057msec) clat (msec): min=93, max=348, avg=209.75, stdev=115.04 lat (msec): min=93, max=348, avg=209.75, stdev=115.04 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 197], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1917, max= 2043, per=45.24%, avg=1991.00, stdev=59.44, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1514KiB/s (1551kB/s)(6144KiB/4057msec); 0 zone resets clat (msec): min=258, max=753, avg=453.52, stdev=187.19 lat (msec): min=258, max=753, avg=453.62, stdev=187.20 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 439], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1917, max= 2043, per=32.30%, avg=1990.40, stdev=51.50, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.60%, ctx=65, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144778: Mon Jun 1 14:41:32 2026 read: IOPS=1, BW=1131KiB/s (1158kB/s)(5120KiB/4527msec) clat (msec): min=60, max=177, avg=116.65, stdev=42.31 lat (msec): min=60, max=177, avg=116.66, stdev=42.31 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 110], 60.00th=[ 110], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 178], 95.00th=[ 178], | 99.00th=[ 178], 99.50th=[ 178], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 1924, max= 6059, per=90.70%, avg=3991.50, stdev=2923.89, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1583KiB/s (1621kB/s)(7168KiB/4527msec); 0 zone resets clat (msec): min=138, max=850, avg=504.88, stdev=261.03 lat (msec): min=139, max=850, avg=504.97, stdev=261.02 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 271], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 510], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 776], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1892, max= 2031, per=32.09%, avg=1977.67, stdev=59.48, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=2.17%, ctx=68, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4401KiB/s (4507kB/s), 440KiB/s-1702KiB/s (451kB/s-1743kB/s), io=20.0MiB (20.0MB), run=4057-4653msec WRITE: bw=6162KiB/s (6310kB/s), 1216KiB/s-2201KiB/s (1245kB/s-2254kB/s), io=28.0MiB (29.4MB), run=4057-4653msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144784: Mon Jun 1 14:41:45 2026 read: IOPS=1, BW=4301KiB/s (4404kB/s)(12.0MiB/2857msec) clat (msec): min=721, max=1273, avg=952.09, stdev=286.75 lat (msec): min=721, max=1273, avg=952.09, stdev=286.75 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7922, max= 8159, per=100.00%, avg=8040.50, stdev=167.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.73%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144786: Mon Jun 1 14:41:45 2026 read: IOPS=0, BW=1326KiB/s (1357kB/s)(4096KiB/3090msec) clat (nsec): min=121953k, max=121953k, avg=121952913.00, stdev= 0.00 lat (nsec): min=121956k, max=121956k, avg=121956280.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 123], | 70.00th=[ 123], 80.00th=[ 123], 90.00th=[ 123], 95.00th=[ 123], | 99.00th=[ 123], 99.50th=[ 123], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 6564, max= 6564, per=100.00%, avg=6564.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2651KiB/s (2715kB/s)(8192KiB/3090msec); 0 zone resets clat (msec): min=684, max=2192, avg=1438.62, stdev=1065.85 lat (msec): min=685, max=2192, avg=1439.06, stdev=1065.56 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8110, max= 8110, per=76.48%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.53%, ctx=41, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144787: Mon Jun 1 14:41:45 2026 write: IOPS=1, BW=4955KiB/s (5074kB/s)(12.0MiB/2480msec); 0 zone resets clat (msec): min=513, max=1153, avg=815.55, stdev=321.25 lat (msec): min=514, max=1153, avg=816.37, stdev=321.29 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7501, max= 7922, per=72.72%, avg=7711.50, stdev=297.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.71%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144788: Mon Jun 1 14:41:45 2026 write: IOPS=1, BW=4853KiB/s (4970kB/s)(12.0MiB/2532msec); 0 zone resets clat (msec): min=357, max=1741, avg=837.05, stdev=783.88 lat (msec): min=358, max=1742, avg=839.04, stdev=782.72 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 7684, max= 8110, per=74.47%, avg=7897.00, stdev=301.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.66%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5302KiB/s (5430kB/s), 1326KiB/s-4301KiB/s (1357kB/s-4404kB/s), io=16.0MiB (16.8MB), run=2857-3090msec WRITE: bw=10.4MiB/s (10.9MB/s), 2651KiB/s-4955KiB/s (2715kB/s-5074kB/s), io=32.0MiB (33.6MB), run=2480-3090msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144790: Mon Jun 1 14:41:46 2026 read: IOPS=1, BW=5287KiB/s (5414kB/s)(12.0MiB/2324msec) clat (msec): min=722, max=862, avg=773.97, stdev=77.09 lat (msec): min=722, max=862, avg=773.97, stdev=77.09 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.78%, ctx=286, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144791: Mon Jun 1 14:41:46 2026 read: IOPS=0, BW=1446KiB/s (1481kB/s)(4096KiB/2833msec) clat (nsec): min=796829k, max=796829k, avg=796829120.00, stdev= 0.00 lat (nsec): min=796832k, max=796832k, avg=796831582.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2892KiB/s (2961kB/s)(8192KiB/2833msec); 0 zone resets clat (msec): min=706, max=1324, avg=1015.11, stdev=436.95 lat (msec): min=706, max=1324, avg=1015.55, stdev=436.99 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8175, max= 8175, per=84.05%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.11%, sys=3.53%, ctx=128, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144792: Mon Jun 1 14:41:46 2026 write: IOPS=0, BW=3647KiB/s (3735kB/s)(12.0MiB/3369msec); 0 zone resets clat (msec): min=280, max=2322, avg=1120.18, stdev=1067.91 lat (msec): min=281, max=2323, avg=1121.02, stdev=1068.39 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8015, max= 8015, per=82.41%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.24%, sys=3.80%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144793: Mon Jun 1 14:41:46 2026 write: IOPS=1, BW=4867KiB/s (4983kB/s)(12.0MiB/2525msec); 0 zone resets clat (msec): min=394, max=1231, avg=839.72, stdev=421.13 lat (msec): min=394, max=1232, avg=840.79, stdev=421.29 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8031, max= 8126, per=83.06%, avg=8078.50, stdev=67.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.37%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5783KiB/s (5922kB/s), 1446KiB/s-5287KiB/s (1481kB/s-5414kB/s), io=16.0MiB (16.8MB), run=2324-2833msec WRITE: bw=9726KiB/s (9960kB/s), 2892KiB/s-4867KiB/s (2961kB/s-4983kB/s), io=32.0MiB (33.6MB), run=2525-3369msec