== sanity test 398b: DIO and buffer IO race ============== 16:28:26 (1788467306) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.11304 s, 9.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178735: Thu Sep 3 16:30:22 2026 read: IOPS=14, BW=59.8KiB/s (61.3kB/s)(5992KiB/100162msec) clat (usec): min=40, max=904987, avg=36499.59, stdev=32327.90 lat (usec): min=40, max=904989, avg=36501.48, stdev=32327.70 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 10683], 10.00th=[ 14222], 20.00th=[ 19006], | 30.00th=[ 22938], 40.00th=[ 26608], 50.00th=[ 31851], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 50070], 90.00th=[ 62129], 95.00th=[ 73925], | 99.00th=[119014], 99.50th=[158335], 99.90th=[238027], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 119, per=25.24%, avg=59.82, stdev=21.83, samples=196 iops : min= 1, max= 29, avg=14.34, stdev= 5.49, samples=196 write: IOPS=15, BW=62.9KiB/s (64.4kB/s)(6296KiB/100162msec); 0 zone resets clat (usec): min=894, max=280832, avg=28615.26, stdev=29380.53 lat (usec): min=895, max=280833, avg=28621.07, stdev=29380.40 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1287], 10.00th=[ 1663], 20.00th=[ 3261], | 30.00th=[ 6325], 40.00th=[ 13698], 50.00th=[ 20841], 60.00th=[ 28181], | 70.00th=[ 36963], 80.00th=[ 49546], 90.00th=[ 67634], 95.00th=[ 85459], | 99.00th=[125305], 99.50th=[147850], 99.90th=[187696], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 15, max= 156, per=25.35%, avg=62.87, stdev=23.87, samples=196 iops : min= 3, max= 39, avg=15.10, stdev= 6.02, samples=196 lat (usec) : 50=0.13%, 100=1.60%, 250=0.13%, 500=0.03%, 1000=0.23% lat (msec) : 2=5.96%, 4=5.63%, 10=7.26%, 20=14.84%, 50=44.56% lat (msec) : 100=17.42%, 250=2.15%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.04%, ctx=6677, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178736: Thu Sep 3 16:30:22 2026 read: IOPS=14, BW=58.7KiB/s (60.1kB/s)(5940KiB/101242msec) clat (usec): min=40, max=203030, avg=37436.80, stdev=23329.21 lat (usec): min=40, max=203032, avg=37439.65, stdev=23329.03 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 11469], 10.00th=[ 15401], 20.00th=[ 20055], | 30.00th=[ 23725], 40.00th=[ 28181], 50.00th=[ 32637], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 52167], 90.00th=[ 64750], 95.00th=[ 80217], | 99.00th=[125305], 99.50th=[135267], 99.90th=[173016], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 111, per=24.54%, avg=58.17, stdev=21.52, samples=199 iops : min= 1, max= 27, avg=13.91, stdev= 5.41, samples=199 write: IOPS=15, BW=62.7KiB/s (64.2kB/s)(6348KiB/101242msec); 0 zone resets clat (usec): min=659, max=856852, avg=28482.15, stdev=34765.60 lat (usec): min=660, max=856854, avg=28491.86, stdev=34766.58 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1270], 10.00th=[ 1663], 20.00th=[ 3261], | 30.00th=[ 6063], 40.00th=[ 13173], 50.00th=[ 21103], 60.00th=[ 28181], | 70.00th=[ 36439], 80.00th=[ 49021], 90.00th=[ 66847], 95.00th=[ 82314], | 99.00th=[121111], 99.50th=[139461], 99.90th=[183501], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 165, per=25.13%, avg=62.32, stdev=24.22, samples=198 iops : min= 1, max= 41, avg=14.96, stdev= 6.08, samples=198 lat (usec) : 50=0.03%, 100=1.27%, 250=0.07%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=6.48%, 4=5.66%, 10=6.84%, 20=13.77%, 50=44.76% lat (msec) : 100=18.29%, 250=2.38%, 1000=0.03% cpu : usr=0.10%, sys=5.94%, ctx=6647, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178737: Thu Sep 3 16:30:22 2026 read: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6028KiB/100710msec) clat (usec): min=31, max=173076, avg=36206.45, stdev=22930.82 lat (usec): min=31, max=173077, avg=36208.03, stdev=22930.76 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 9372], 10.00th=[ 14615], 20.00th=[ 19006], | 30.00th=[ 22676], 40.00th=[ 26870], 50.00th=[ 31851], 60.00th=[ 36963], | 70.00th=[ 42730], 80.00th=[ 50594], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[119014], 99.50th=[127402], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 7, max= 125, per=25.23%, avg=59.80, stdev=20.71, samples=197 iops : min= 1, max= 31, avg=14.33, stdev= 5.21, samples=197 write: IOPS=15, BW=62.2KiB/s (63.7kB/s)(6260KiB/100710msec); 0 zone resets clat (usec): min=648, max=881463, avg=29208.75, stdev=37031.41 lat (usec): min=649, max=881466, avg=29211.48, stdev=37031.88 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1336], 10.00th=[ 1762], 20.00th=[ 3294], | 30.00th=[ 5932], 40.00th=[ 13829], 50.00th=[ 20841], 60.00th=[ 27919], | 70.00th=[ 36439], 80.00th=[ 48497], 90.00th=[ 67634], 95.00th=[ 85459], | 99.00th=[130548], 99.50th=[162530], 99.90th=[238027], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 123, per=24.99%, avg=61.98, stdev=23.88, samples=197 iops : min= 1, max= 30, avg=14.87, stdev= 5.99, samples=197 lat (usec) : 50=0.29%, 100=1.43%, 250=0.23%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=5.76%, 4=5.70%, 10=6.80%, 20=15.33%, 50=44.34% lat (msec) : 100=17.22%, 250=2.57%, 1000=0.03% cpu : usr=0.08%, sys=5.96%, ctx=6512, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178738: Thu Sep 3 16:30:22 2026 read: IOPS=15, BW=60.2KiB/s (61.6kB/s)(6052KiB/100590msec) clat (usec): min=45, max=294444, avg=36514.67, stdev=23963.38 lat (usec): min=45, max=294445, avg=36519.08, stdev=23962.67 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 9765], 10.00th=[ 14222], 20.00th=[ 18744], | 30.00th=[ 22938], 40.00th=[ 27132], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 51119], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[121111], 99.50th=[135267], 99.90th=[217056], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 15, max= 134, per=25.42%, avg=60.25, stdev=21.16, samples=197 iops : min= 3, max= 33, avg=14.45, stdev= 5.35, samples=197 write: IOPS=15, BW=61.0KiB/s (63.5kB/s)(6236KiB/100590msec); 0 zone resets clat (usec): min=751, max=830384, avg=28805.80, stdev=34576.62 lat (usec): min=752, max=830388, avg=28815.24, stdev=34582.30 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1270], 10.00th=[ 1663], 20.00th=[ 3097], | 30.00th=[ 6063], 40.00th=[ 14877], 50.00th=[ 21890], 60.00th=[ 28443], | 70.00th=[ 36963], 80.00th=[ 48497], 90.00th=[ 66323], 95.00th=[ 82314], | 99.00th=[119014], 99.50th=[137364], 99.90th=[187696], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 15, max= 175, per=25.02%, avg=62.06, stdev=23.47, samples=197 iops : min= 3, max= 43, avg=14.90, stdev= 5.88, samples=197 lat (usec) : 50=0.10%, 100=1.56%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=6.25%, 4=5.70%, 10=6.38%, 20=14.58%, 50=44.86% lat (msec) : 100=17.77%, 250=2.15%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.00%, ctx=6635, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=237KiB/s (243kB/s), 58.7KiB/s-60.2KiB/s (60.1kB/s-61.6kB/s), io=23.4MiB (24.6MB), run=100162-101242msec WRITE: bw=248KiB/s (254kB/s), 61.0KiB/s-62.9KiB/s (63.5kB/s-64.4kB/s), io=24.6MiB (25.7MB), run=100162-101242msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178730: Thu Sep 3 16:30:53 2026 read: IOPS=11, BW=45.2KiB/s (46.3kB/s)(5992KiB/132460msec) clat (msec): min=4, max=905, avg=35.59, stdev=38.96 lat (msec): min=4, max=905, avg=35.60, stdev=38.96 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 79], 95.00th=[ 104], | 99.00th=[ 161], 99.50th=[ 186], 99.90th=[ 255], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 175, per=25.22%, avg=45.39, stdev=31.35, samples=258 iops : min= 1, max= 43, avg=10.71, stdev= 7.87, samples=258 write: IOPS=11, BW=47.5KiB/s (48.7kB/s)(6296KiB/132460msec); 0 zone resets clat (msec): min=8, max=339, avg=49.98, stdev=34.95 lat (msec): min=8, max=339, avg=49.98, stdev=34.95 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 49], | 70.00th=[ 62], 80.00th=[ 74], 90.00th=[ 96], 95.00th=[ 116], | 99.00th=[ 165], 99.50th=[ 209], 99.90th=[ 247], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 147, per=25.05%, avg=47.35, stdev=30.10, samples=260 iops : min= 1, max= 36, avg=11.19, stdev= 7.56, samples=260 lat (msec) : 10=4.36%, 20=23.57%, 50=42.25%, 100=22.56%, 250=7.16% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=2.17%, ctx=4802, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178732: Thu Sep 3 16:30:53 2026 read: IOPS=11, BW=44.8KiB/s (45.8kB/s)(5940KiB/132717msec) clat (msec): min=4, max=808, avg=34.02, stdev=35.32 lat (msec): min=4, max=808, avg=34.02, stdev=35.32 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 77], 95.00th=[ 96], | 99.00th=[ 142], 99.50th=[ 169], 99.90th=[ 255], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 167, per=24.91%, avg=44.84, stdev=31.98, samples=258 iops : min= 1, max= 41, avg=10.56, stdev= 8.01, samples=258 write: IOPS=11, BW=47.8KiB/s (48.0kB/s)(6348KiB/132717msec); 0 zone resets clat (msec): min=9, max=333, avg=51.50, stdev=38.30 lat (msec): min=9, max=333, avg=51.50, stdev=38.30 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 77], 90.00th=[ 102], 95.00th=[ 127], | 99.00th=[ 186], 99.50th=[ 241], 99.90th=[ 296], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 151, per=25.15%, avg=47.54, stdev=29.36, samples=260 iops : min= 1, max= 37, avg=11.24, stdev= 7.40, samples=260 lat (msec) : 10=4.88%, 20=22.20%, 50=44.40%, 100=21.09%, 250=7.16% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.20%, ctx=4778, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178733: Thu Sep 3 16:30:53 2026 read: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6028KiB/132745msec) clat (msec): min=4, max=253, avg=35.52, stdev=31.23 lat (msec): min=4, max=253, avg=35.52, stdev=31.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 79], 95.00th=[ 100], | 99.00th=[ 155], 99.50th=[ 171], 99.90th=[ 215], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7, max= 183, per=25.30%, avg=45.54, stdev=29.64, samples=258 iops : min= 1, max= 45, avg=10.74, stdev= 7.43, samples=258 write: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6260KiB/132745msec); 0 zone resets clat (msec): min=9, max=837, avg=50.33, stdev=41.39 lat (msec): min=9, max=837, avg=50.33, stdev=41.39 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 74], 90.00th=[ 100], 95.00th=[ 122], | 99.00th=[ 178], 99.50th=[ 209], 99.90th=[ 334], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 144, per=24.69%, avg=46.66, stdev=30.39, samples=261 iops : min= 1, max= 36, avg=11.02, stdev= 7.63, samples=261 lat (msec) : 10=4.75%, 20=22.59%, 50=43.52%, 100=21.94%, 250=7.03% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=2.21%, ctx=4797, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178734: Thu Sep 3 16:30:53 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6052KiB/132465msec) clat (msec): min=5, max=246, avg=34.12, stdev=29.53 lat (msec): min=5, max=246, avg=34.12, stdev=29.53 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 74], 95.00th=[ 96], | 99.00th=[ 140], 99.50th=[ 171], 99.90th=[ 203], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 7, max= 159, per=25.61%, avg=46.09, stdev=31.50, samples=257 iops : min= 1, max= 39, avg=10.88, stdev= 7.90, samples=257 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6236KiB/132465msec); 0 zone resets clat (msec): min=8, max=819, avg=51.55, stdev=41.79 lat (msec): min=8, max=819, avg=51.55, stdev=41.79 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 49], | 70.00th=[ 61], 80.00th=[ 75], 90.00th=[ 99], 95.00th=[ 123], | 99.00th=[ 194], 99.50th=[ 224], 99.90th=[ 317], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 151, per=24.72%, avg=46.71, stdev=28.82, samples=261 iops : min= 1, max= 37, avg=11.03, stdev= 7.25, samples=261 lat (msec) : 10=4.85%, 20=22.17%, 50=43.75%, 100=22.23%, 250=6.77% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=2.34%, ctx=4900, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (185kB/s), 44.8KiB/s-45.7KiB/s (45.8kB/s-46.8kB/s), io=23.4MiB (24.6MB), run=132460-132745msec WRITE: bw=189KiB/s (194kB/s), 47.1KiB/s-47.8KiB/s (48.2kB/s-48.0kB/s), io=24.6MiB (25.7MB), run=132460-132745msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178786: Thu Sep 3 16:31:26 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(5920KiB/23800msec) clat (usec): min=37, max=122645, avg=34821.22, stdev=23791.82 lat (usec): min=38, max=122646, avg=34824.61, stdev=23790.03 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 75], 10.00th=[ 247], 20.00th=[ 17433], | 30.00th=[ 22152], 40.00th=[ 26346], 50.00th=[ 30278], 60.00th=[ 36439], | 70.00th=[ 44303], 80.00th=[ 49021], 90.00th=[ 66323], 95.00th=[ 79168], | 99.00th=[113771], 99.50th=[119014], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 90, max= 448, per=25.58%, avg=248.66, stdev=85.68, samples=47 iops : min= 5, max= 28, avg=14.91, stdev= 5.45, samples=47 write: IOPS=16, BW=268KiB/s (274kB/s)(6368KiB/23800msec); 0 zone resets clat (usec): min=1395, max=126702, avg=26492.76, stdev=24659.25 lat (usec): min=1397, max=126705, avg=26500.71, stdev=24656.96 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2180], 10.00th=[ 3097], 20.00th=[ 4621], | 30.00th=[ 6980], 40.00th=[ 11469], 50.00th=[ 20579], 60.00th=[ 27657], | 70.00th=[ 34341], 80.00th=[ 46400], 90.00th=[ 62129], 95.00th=[ 76022], | 99.00th=[111674], 99.50th=[114820], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 30, max= 510, per=26.26%, avg=268.36, stdev=99.25, samples=47 iops : min= 1, max= 31, avg=16.15, stdev= 6.27, samples=47 lat (usec) : 50=0.52%, 100=3.39%, 250=0.91%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.21%, 4=6.12%, 10=11.46%, 20=12.89%, 50=44.01% lat (msec) : 100=16.93%, 250=1.30% cpu : usr=0.13%, sys=8.13%, ctx=1837, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178787: Thu Sep 3 16:31:26 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(5744KiB/24527msec) clat (usec): min=55, max=164163, avg=36800.02, stdev=22779.80 lat (usec): min=56, max=164165, avg=36801.28, stdev=22779.76 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 133], 10.00th=[ 14877], 20.00th=[ 20841], | 30.00th=[ 24511], 40.00th=[ 28181], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 43779], 80.00th=[ 53216], 90.00th=[ 66323], 95.00th=[ 74974], | 99.00th=[122160], 99.50th=[160433], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 60, max= 416, per=24.08%, avg=234.10, stdev=76.20, samples=48 iops : min= 3, max= 26, avg=14.00, stdev= 4.77, samples=48 write: IOPS=16, BW=267KiB/s (273kB/s)(6544KiB/24527msec); 0 zone resets clat (usec): min=1121, max=134791, avg=27290.92, stdev=23940.10 lat (usec): min=1121, max=134794, avg=27295.08, stdev=23939.16 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2442], 10.00th=[ 3228], 20.00th=[ 5342], | 30.00th=[ 9110], 40.00th=[ 14484], 50.00th=[ 21627], 60.00th=[ 27395], | 70.00th=[ 36439], 80.00th=[ 46924], 90.00th=[ 61604], 95.00th=[ 74974], | 99.00th=[ 88605], 99.50th=[ 91751], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 31, max= 604, per=26.07%, avg=266.42, stdev=109.39, samples=48 iops : min= 1, max= 37, avg=16.02, stdev= 6.95, samples=48 lat (usec) : 100=1.95%, 250=0.78%, 750=0.13% lat (msec) : 2=1.69%, 4=5.73%, 10=9.64%, 20=13.67%, 50=46.88% lat (msec) : 100=18.62%, 250=0.91% cpu : usr=0.09%, sys=7.78%, ctx=1867, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178788: Thu Sep 3 16:31:26 2026 read: IOPS=15, BW=254KiB/s (260kB/s)(6256KiB/24639msec) clat (usec): min=34, max=157760, avg=36159.09, stdev=23764.30 lat (usec): min=35, max=157761, avg=36160.47, stdev=23764.46 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 114], 10.00th=[ 13698], 20.00th=[ 19792], | 30.00th=[ 23200], 40.00th=[ 27657], 50.00th=[ 31589], 60.00th=[ 35914], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 64226], 95.00th=[ 78119], | 99.00th=[126354], 99.50th=[139461], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 59, max= 510, per=26.20%, avg=254.65, stdev=82.64, samples=48 iops : min= 3, max= 31, avg=15.29, stdev= 5.23, samples=48 write: IOPS=15, BW=245KiB/s (251kB/s)(6032KiB/24639msec); 0 zone resets clat (usec): min=1701, max=246150, avg=27019.97, stdev=26465.14 lat (usec): min=1704, max=246153, avg=27022.31, stdev=26464.99 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2278], 10.00th=[ 3097], 20.00th=[ 5604], | 30.00th=[ 8848], 40.00th=[ 12256], 50.00th=[ 19792], 60.00th=[ 26608], | 70.00th=[ 35914], 80.00th=[ 45351], 90.00th=[ 60556], 95.00th=[ 77071], | 99.00th=[108528], 99.50th=[133694], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 89, max= 541, per=23.62%, avg=241.42, stdev=101.01, samples=48 iops : min= 5, max= 33, avg=14.46, stdev= 6.38, samples=48 lat (usec) : 50=0.26%, 100=1.95%, 250=0.78%, 500=0.39%, 750=0.26% lat (msec) : 2=1.95%, 4=5.21%, 10=9.51%, 20=14.97%, 50=46.09% lat (msec) : 100=16.67%, 250=1.95% cpu : usr=0.09%, sys=7.79%, ctx=1898, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178789: Thu Sep 3 16:31:26 2026 read: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24542msec) clat (usec): min=42, max=196762, avg=34156.32, stdev=23835.86 lat (usec): min=42, max=196763, avg=34157.77, stdev=23835.76 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 80], 10.00th=[ 204], 20.00th=[ 18220], | 30.00th=[ 22414], 40.00th=[ 27132], 50.00th=[ 31065], 60.00th=[ 34866], | 70.00th=[ 40633], 80.00th=[ 49021], 90.00th=[ 61080], 95.00th=[ 72877], | 99.00th=[119014], 99.50th=[154141], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 63, max= 413, per=25.59%, avg=248.72, stdev=80.98, samples=47 iops : min= 3, max= 25, avg=14.91, stdev= 5.14, samples=47 write: IOPS=15, BW=255KiB/s (261kB/s)(6256KiB/24542msec); 0 zone resets clat (usec): min=1302, max=177240, avg=28923.98, stdev=27303.09 lat (usec): min=1303, max=177242, avg=28931.21, stdev=27303.75 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2474], 10.00th=[ 3228], 20.00th=[ 5932], | 30.00th=[ 9634], 40.00th=[ 15270], 50.00th=[ 20841], 60.00th=[ 27132], | 70.00th=[ 34866], 80.00th=[ 48497], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[122160], 99.50th=[156238], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 92, max= 477, per=24.73%, avg=252.77, stdev=88.84, samples=48 iops : min= 5, max= 29, avg=15.17, stdev= 5.64, samples=48 lat (usec) : 50=0.26%, 100=2.99%, 250=1.82%, 500=0.13% lat (msec) : 2=1.30%, 4=5.73%, 10=8.85%, 20=15.23%, 50=44.66% lat (msec) : 100=17.06%, 250=1.95% cpu : usr=0.11%, sys=7.82%, ctx=1909, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=972KiB/s (995kB/s), 234KiB/s-254KiB/s (240kB/s-260kB/s), io=23.4MiB (24.5MB), run=23800-24639msec WRITE: bw=1023KiB/s (1047kB/s), 245KiB/s-268KiB/s (251kB/s-274kB/s), io=24.6MiB (25.8MB), run=23800-24639msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178782: Thu Sep 3 16:31:35 2026 read: IOPS=10, BW=175KiB/s (180kB/s)(5920KiB/33750msec) clat (msec): min=7, max=168, avg=35.88, stdev=30.23 lat (msec): min=7, max=168, avg=35.88, stdev=30.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 82], 95.00th=[ 105], | 99.00th=[ 140], 99.50th=[ 157], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 31, max= 573, per=24.92%, avg=175.16, stdev=101.90, samples=67 iops : min= 1, max= 35, avg=10.19, stdev= 6.38, samples=67 write: IOPS=11, BW=189KiB/s (193kB/s)(6368KiB/33750msec); 0 zone resets clat (msec): min=9, max=265, avg=51.28, stdev=34.86 lat (msec): min=9, max=265, avg=51.28, stdev=34.86 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 58], 80.00th=[ 70], 90.00th=[ 91], 95.00th=[ 121], | 99.00th=[ 218], 99.50th=[ 251], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 574, per=25.81%, avg=191.00, stdev=95.98, samples=66 iops : min= 1, max= 35, avg=11.18, stdev= 6.05, samples=66 lat (msec) : 10=2.21%, 20=20.05%, 50=48.57%, 100=22.53%, 250=6.38% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.53%, ctx=1215, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178783: Thu Sep 3 16:31:35 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/34049msec) clat (msec): min=5, max=209, avg=35.40, stdev=29.06 lat (msec): min=5, max=209, avg=35.40, stdev=29.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 81], 95.00th=[ 95], | 99.00th=[ 144], 99.50th=[ 146], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 29, max= 509, per=24.09%, avg=169.36, stdev=109.70, samples=66 iops : min= 1, max= 31, avg= 9.82, stdev= 6.94, samples=66 write: IOPS=12, BW=192KiB/s (197kB/s)(6544KiB/34049msec); 0 zone resets clat (msec): min=12, max=196, avg=51.40, stdev=32.99 lat (msec): min=12, max=196, avg=51.40, stdev=32.99 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 57], 80.00th=[ 75], 90.00th=[ 102], 95.00th=[ 114], | 99.00th=[ 171], 99.50th=[ 192], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 63, max= 447, per=25.61%, avg=189.52, stdev=92.95, samples=67 iops : min= 3, max= 27, avg=11.09, stdev= 5.85, samples=67 lat (msec) : 10=2.99%, 20=17.32%, 50=50.00%, 100=22.14%, 250=7.55% cpu : usr=0.08%, sys=2.41%, ctx=1185, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178784: Thu Sep 3 16:31:35 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(6256KiB/33364msec) clat (msec): min=6, max=210, avg=35.38, stdev=27.01 lat (msec): min=6, max=210, avg=35.39, stdev=27.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 72], 95.00th=[ 95], | 99.00th=[ 132], 99.50th=[ 146], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 479, per=27.16%, avg=190.95, stdev=97.26, samples=65 iops : min= 1, max= 29, avg=11.18, stdev= 6.13, samples=65 write: IOPS=11, BW=181KiB/s (185kB/s)(6032KiB/33364msec); 0 zone resets clat (msec): min=14, max=247, avg=50.99, stdev=33.08 lat (msec): min=14, max=247, avg=50.99, stdev=33.08 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 61], 80.00th=[ 71], 90.00th=[ 91], 95.00th=[ 104], | 99.00th=[ 194], 99.50th=[ 232], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 447, per=24.24%, avg=179.38, stdev=91.63, samples=66 iops : min= 1, max= 27, avg=10.45, stdev= 5.76, samples=66 lat (msec) : 10=1.82%, 20=17.84%, 50=51.69%, 100=23.70%, 250=4.95% cpu : usr=0.09%, sys=2.66%, ctx=1186, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178785: Thu Sep 3 16:31:35 2026 read: IOPS=11, BW=179KiB/s (184kB/s)(6032KiB/33629msec) clat (msec): min=6, max=194, avg=34.44, stdev=28.42 lat (msec): min=6, max=194, avg=34.44, stdev=28.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 102], | 99.00th=[ 140], 99.50th=[ 165], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 32, max= 505, per=25.64%, avg=180.28, stdev=97.45, samples=65 iops : min= 2, max= 31, avg=10.51, stdev= 6.16, samples=65 write: IOPS=11, BW=186KiB/s (190kB/s)(6256KiB/33629msec); 0 zone resets clat (msec): min=10, max=261, avg=52.11, stdev=32.90 lat (msec): min=10, max=261, avg=52.11, stdev=32.90 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 62], 80.00th=[ 73], 90.00th=[ 102], 95.00th=[ 117], | 99.00th=[ 157], 99.50th=[ 176], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 479, per=24.90%, avg=184.26, stdev=90.54, samples=66 iops : min= 1, max= 29, avg=10.76, stdev= 5.71, samples=66 lat (msec) : 10=2.08%, 20=19.53%, 50=49.35%, 100=21.35%, 250=7.55% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=2.58%, ctx=1191, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=703KiB/s (720kB/s), 169KiB/s-188KiB/s (173kB/s-192kB/s), io=23.4MiB (24.5MB), run=33364-34049msec WRITE: bw=740KiB/s (758kB/s), 181KiB/s-192KiB/s (185kB/s-197kB/s), io=24.6MiB (25.8MB), run=33364-34049msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178799: Thu Sep 3 16:31:48 2026 read: IOPS=2, BW=2157KiB/s (2209kB/s)(7168KiB/3323msec) clat (usec): min=1826, max=325726, avg=203641.41, stdev=101605.98 lat (usec): min=1828, max=325728, avg=203643.44, stdev=101606.05 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 1827], 10.00th=[ 1827], 20.00th=[175113], | 30.00th=[191890], 40.00th=[191890], 50.00th=[225444], 60.00th=[252707], | 70.00th=[252707], 80.00th=[254804], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 1932, max= 3650, per=47.29%, avg=2319.00, stdev=745.92, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1541KiB/s (1578kB/s)(5120KiB/3323msec); 0 zone resets clat (msec): min=207, max=751, avg=371.58, stdev=224.94 lat (msec): min=207, max=751, avg=371.68, stdev=224.94 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1935, max= 4079, per=39.10%, avg=2684.33, stdev=1208.94, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=41.67%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=17.31%, ctx=205, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178800: Thu Sep 3 16:31:48 2026 read: IOPS=0, BW=490KiB/s (502kB/s)(2048KiB/4176msec) clat (usec): min=599, max=209222, avg=104911.32, stdev=147518.69 lat (usec): min=601, max=209224, avg=104913.15, stdev=147518.72 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[ 603], 60.00th=[208667], | 70.00th=[208667], 80.00th=[208667], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 1903, max= 2039, per=40.19%, avg=1971.00, stdev=96.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2452KiB/s (2511kB/s)(10.0MiB/4176msec); 0 zone resets clat (msec): min=103, max=1043, avg=390.76, stdev=336.89 lat (msec): min=103, max=1043, avg=390.91, stdev=336.89 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 111], | 30.00th=[ 124], 40.00th=[ 194], 50.00th=[ 203], 60.00th=[ 266], | 70.00th=[ 363], 80.00th=[ 684], 90.00th=[ 827], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1932, max= 6119, per=52.33%, avg=3592.20, stdev=2181.94, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=17.53%, ctx=202, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178801: Thu Sep 3 16:31:48 2026 read: IOPS=1, BW=1584KiB/s (1622kB/s)(6144KiB/3880msec) clat (usec): min=667, max=368649, avg=152130.70, stdev=141970.56 lat (usec): min=668, max=368650, avg=152132.11, stdev=141970.41 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 1844], | 30.00th=[ 1844], 40.00th=[124257], 50.00th=[124257], 60.00th=[183501], | 70.00th=[233833], 80.00th=[233833], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 1946, max= 4079, per=68.68%, avg=3368.00, stdev=1231.49, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1584KiB/s (1622kB/s)(6144KiB/3880msec); 0 zone resets clat (msec): min=196, max=1092, avg=489.31, stdev=315.36 lat (msec): min=197, max=1092, avg=489.61, stdev=315.23 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 414], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1932, max= 3871, per=35.98%, avg=2470.25, stdev=935.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=14.90%, ctx=279, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178802: Thu Sep 3 16:31:48 2026 read: IOPS=1, BW=1479KiB/s (1514kB/s)(5120KiB/3462msec) clat (usec): min=624, max=451848, avg=208885.87, stdev=168340.29 lat (usec): min=625, max=451850, avg=208887.91, stdev=168341.02 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 627], | 30.00th=[121111], 40.00th=[121111], 50.00th=[204473], 60.00th=[204473], | 70.00th=[265290], 80.00th=[265290], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 1932, max= 6119, per=82.09%, avg=4025.50, stdev=2960.66, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2070KiB/s (2120kB/s)(7168KiB/3462msec); 0 zone resets clat (msec): min=173, max=670, avg=339.13, stdev=174.32 lat (msec): min=173, max=670, avg=339.22, stdev=174.33 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 192], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 288], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 451], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1932, max= 4079, per=43.86%, avg=3011.00, stdev=1233.25, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=18.75%, ctx=226, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4904KiB/s (5022kB/s), 490KiB/s-2157KiB/s (502kB/s-2209kB/s), io=20.0MiB (20.0MB), run=3323-4176msec WRITE: bw=6866KiB/s (7031kB/s), 1541KiB/s-2452KiB/s (1578kB/s-2511kB/s), io=28.0MiB (29.4MB), run=3323-4176msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178804: Thu Sep 3 16:31:49 2026 read: IOPS=1, BW=1764KiB/s (1806kB/s)(7168KiB/4064msec) clat (msec): min=86, max=881, avg=309.58, stdev=291.83 lat (msec): min=86, max=881, avg=309.58, stdev=291.83 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 105], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 161], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 510], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1741, max= 4000, per=66.83%, avg=2928.00, stdev=1200.36, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1260KiB/s (1290kB/s)(5120KiB/4064msec); 0 zone resets clat (msec): min=150, max=494, avg=366.64, stdev=133.73 lat (msec): min=150, max=494, avg=366.79, stdev=133.63 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2003, max= 4071, per=44.14%, avg=2707.33, stdev=1181.18, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=7.04%, ctx=90, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178805: Thu Sep 3 16:31:49 2026 read: IOPS=0, BW=469KiB/s (480kB/s)(2048KiB/4365msec) clat (msec): min=143, max=362, avg=253.16, stdev=155.13 lat (msec): min=143, max=362, avg=253.16, stdev=155.13 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1617, max= 2035, per=41.68%, avg=1826.00, stdev=295.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2346KiB/s (2402kB/s)(10.0MiB/4365msec); 0 zone resets clat (msec): min=123, max=1192, avg=374.43, stdev=354.86 lat (msec): min=123, max=1192, avg=375.13, stdev=354.66 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 144], 40.00th=[ 171], 50.00th=[ 197], 60.00th=[ 241], | 70.00th=[ 305], 80.00th=[ 451], 90.00th=[ 802], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 2048, max= 6011, per=65.81%, avg=4036.50, stdev=1618.30, samples=4 iops : min= 2, max= 5, avg= 3.25, stdev= 1.26, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.05%, sys=6.12%, ctx=141, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178806: Thu Sep 3 16:31:49 2026 read: IOPS=1, BW=1315KiB/s (1346kB/s)(6144KiB/4674msec) clat (msec): min=74, max=594, avg=222.46, stdev=205.33 lat (msec): min=74, max=594, avg=222.46, stdev=205.33 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 82], 60.00th=[ 184], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2023, max= 4087, per=58.17%, avg=2548.25, stdev=1025.88, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1315KiB/s (1346kB/s)(6144KiB/4674msec); 0 zone resets clat (msec): min=195, max=1190, avg=549.65, stdev=361.03 lat (msec): min=195, max=1190, avg=549.78, stdev=361.04 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 542], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1961, max= 4047, per=39.47%, avg=2420.80, stdev=909.80, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 100=25.00%, 250=16.67%, 500=25.00%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=6.21%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178807: Thu Sep 3 16:31:49 2026 read: IOPS=1, BW=1132KiB/s (1160kB/s)(5120KiB/4521msec) clat (msec): min=82, max=733, avg=315.75, stdev=258.54 lat (msec): min=82, max=733, avg=315.75, stdev=258.54 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2000, max= 4087, per=61.90%, avg=2711.67, stdev=1191.32, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1585KiB/s (1624kB/s)(7168KiB/4521msec); 0 zone resets clat (msec): min=83, max=943, avg=409.81, stdev=301.45 lat (msec): min=83, max=943, avg=409.93, stdev=301.46 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 167], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 405], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 584], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1703, max= 2043, per=31.66%, avg=1942.00, stdev=136.72, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=4.18%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4382KiB/s (4487kB/s), 469KiB/s-1764KiB/s (480kB/s-1806kB/s), io=20.0MiB (20.0MB), run=4064-4674msec WRITE: bw=6134KiB/s (6282kB/s), 1260KiB/s-2346KiB/s (1290kB/s-2402kB/s), io=28.0MiB (29.4MB), run=4064-4674msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178813: Thu Sep 3 16:32:03 2026 read: IOPS=1, BW=4949KiB/s (5068kB/s)(12.0MiB/2483msec) clat (msec): min=693, max=995, avg=815.57, stdev=159.31 lat (msec): min=693, max=995, avg=815.57, stdev=159.31 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.56%, ctx=396, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178814: Thu Sep 3 16:32:03 2026 read: IOPS=0, BW=1237KiB/s (1266kB/s)(4096KiB/3312msec) clat (nsec): min=993201k, max=993201k, avg=993201024.00, stdev= 0.00 lat (nsec): min=993204k, max=993204k, avg=993203752.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2473KiB/s (2533kB/s)(8192KiB/3312msec); 0 zone resets clat (msec): min=798, max=1400, avg=1099.44, stdev=425.74 lat (msec): min=798, max=1400, avg=1099.70, stdev=425.71 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8175, max= 8175, per=82.63%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.03%, sys=4.47%, ctx=117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178815: Thu Sep 3 16:32:03 2026 write: IOPS=1, BW=4221KiB/s (4323kB/s)(12.0MiB/2911msec); 0 zone resets clat (msec): min=229, max=1469, avg=934.24, stdev=637.52 lat (msec): min=229, max=1470, avg=934.54, stdev=637.47 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8126, max= 8126, per=82.14%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.57%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178816: Thu Sep 3 16:32:03 2026 write: IOPS=1, BW=4112KiB/s (4211kB/s)(12.0MiB/2988msec); 0 zone resets clat (msec): min=330, max=1955, avg=971.04, stdev=865.57 lat (msec): min=331, max=1956, avg=971.41, stdev=865.55 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min=16062, max=16062, per=100.00%, avg=16062.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.05%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4947KiB/s (5066kB/s), 1237KiB/s-4949KiB/s (1266kB/s-5068kB/s), io=16.0MiB (16.8MB), run=2483-3312msec WRITE: bw=9894KiB/s (10.1MB/s), 2473KiB/s-4221KiB/s (2533kB/s-4323kB/s), io=32.0MiB (33.6MB), run=2911-3312msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178818: Thu Sep 3 16:32:04 2026 read: IOPS=1, BW=4808KiB/s (4923kB/s)(12.0MiB/2556msec) clat (msec): min=293, max=1203, avg=850.85, stdev=487.95 lat (msec): min=293, max=1203, avg=850.85, stdev=487.95 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.23%, sys=3.41%, ctx=61, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178819: Thu Sep 3 16:32:04 2026 read: IOPS=0, BW=1541KiB/s (1578kB/s)(4096KiB/2658msec) clat (nsec): min=1752.7M, max=1752.7M, avg=1752684385.00, stdev= 0.00 lat (nsec): min=1752.7M, max=1752.7M, avg=1752686200.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1754], 5.00th=[ 1754], 10.00th=[ 1754], 20.00th=[ 1754], | 30.00th=[ 1754], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3082KiB/s (3156kB/s)(8192KiB/2658msec); 0 zone resets clat (msec): min=331, max=571, avg=451.55, stdev=169.65 lat (msec): min=331, max=571, avg=451.96, stdev=169.75 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7984, max= 7984, per=68.52%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.08%, sys=4.40%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178820: Thu Sep 3 16:32:04 2026 write: IOPS=1, BW=4370KiB/s (4475kB/s)(12.0MiB/2812msec); 0 zone resets clat (msec): min=268, max=1669, avg=933.91, stdev=703.01 lat (msec): min=268, max=1669, avg=935.26, stdev=702.94 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7984, max= 8143, per=69.20%, avg=8063.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.42%, ctx=28, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178821: Thu Sep 3 16:32:04 2026 write: IOPS=1, BW=4985KiB/s (5105kB/s)(12.0MiB/2465msec); 0 zone resets clat (msec): min=323, max=1347, avg=820.23, stdev=512.54 lat (msec): min=324, max=1348, avg=821.00, stdev=512.61 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7025, max= 8078, per=64.81%, avg=7551.50, stdev=744.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.52%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6164KiB/s (6312kB/s), 1541KiB/s-4808KiB/s (1578kB/s-4923kB/s), io=16.0MiB (16.8MB), run=2556-2658msec WRITE: bw=11.4MiB/s (11.9MB/s), 3082KiB/s-4985KiB/s (3156kB/s-5105kB/s), io=32.0MiB (33.6MB), run=2465-2812msec