== sanity test 398b: DIO and buffer IO race ============== 01:30:42 (1788845442) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.74345 s, 10.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178703: Tue Sep 8 01:32:45 2026 read: IOPS=14, BW=56.0KiB/s (58.3kB/s)(5992KiB/105204msec) clat (usec): min=41, max=932864, avg=39421.29, stdev=34640.35 lat (usec): min=41, max=932865, avg=39422.35, stdev=34640.37 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10290], 10.00th=[ 15401], 20.00th=[ 20317], | 30.00th=[ 24511], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 45351], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[143655], 99.50th=[177210], 99.90th=[223347], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 5, max= 117, per=25.07%, avg=56.91, stdev=20.41, samples=206 iops : min= 1, max= 29, avg=13.61, stdev= 5.15, samples=206 write: IOPS=14, BW=59.8KiB/s (61.3kB/s)(6296KiB/105204msec); 0 zone resets clat (usec): min=711, max=294783, avg=28981.86, stdev=31003.96 lat (usec): min=711, max=294784, avg=28988.98, stdev=30999.72 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1139], 10.00th=[ 1303], 20.00th=[ 2868], | 30.00th=[ 5735], 40.00th=[ 13435], 50.00th=[ 20317], 60.00th=[ 27395], | 70.00th=[ 35390], 80.00th=[ 50070], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[137364], 99.50th=[156238], 99.90th=[170918], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 15, max= 119, per=25.35%, avg=60.08, stdev=22.53, samples=205 iops : min= 3, max= 29, avg=14.40, stdev= 5.68, samples=205 lat (usec) : 50=0.36%, 100=1.53%, 250=0.07%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.46% lat (msec) : 2=7.98%, 4=4.17%, 10=6.45%, 20=13.67%, 50=43.16% lat (msec) : 100=19.21%, 250=2.80%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.72%, ctx=6218, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178704: Tue Sep 8 01:32:45 2026 read: IOPS=14, BW=58.5KiB/s (59.9kB/s)(5940KiB/101557msec) clat (usec): min=36, max=894301, avg=37372.00, stdev=33177.42 lat (usec): min=36, max=894304, avg=37377.68, stdev=33176.87 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 6783], 10.00th=[ 13960], 20.00th=[ 19006], | 30.00th=[ 23200], 40.00th=[ 27395], 50.00th=[ 31589], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 51643], 90.00th=[ 66323], 95.00th=[ 78119], | 99.00th=[135267], 99.50th=[158335], 99.90th=[221250], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 15, max= 120, per=26.02%, avg=59.06, stdev=22.23, samples=197 iops : min= 3, max= 30, avg=14.15, stdev= 5.60, samples=197 write: IOPS=15, BW=62.5KiB/s (64.0kB/s)(6348KiB/101557msec); 0 zone resets clat (usec): min=800, max=236569, avg=28698.27, stdev=31064.22 lat (usec): min=801, max=236571, avg=28706.72, stdev=31066.45 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 2573], | 30.00th=[ 5407], 40.00th=[ 11600], 50.00th=[ 19268], 60.00th=[ 27132], | 70.00th=[ 36963], 80.00th=[ 50070], 90.00th=[ 70779], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[152044], 99.90th=[189793], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 15, max= 143, per=26.43%, avg=62.63, stdev=25.20, samples=198 iops : min= 3, max= 35, avg=15.04, stdev= 6.34, samples=198 lat (usec) : 50=0.39%, 100=1.79%, 250=0.03%, 750=0.03%, 1000=0.36% lat (msec) : 2=8.63%, 4=4.20%, 10=6.77%, 20=14.94%, 50=42.15% lat (msec) : 100=17.58%, 250=3.09%, 1000=0.03% cpu : usr=0.10%, sys=5.90%, ctx=6259, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178705: Tue Sep 8 01:32:45 2026 read: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6028KiB/105587msec) clat (usec): min=36, max=255044, avg=39179.48, stdev=26685.78 lat (usec): min=36, max=255046, avg=39181.89, stdev=26686.45 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 8586], 10.00th=[ 14091], 20.00th=[ 19792], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 39584], | 70.00th=[ 45876], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 87557], | 99.00th=[131597], 99.50th=[164627], 99.90th=[206570], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 15, max= 142, per=25.22%, avg=57.25, stdev=20.50, samples=206 iops : min= 3, max= 35, avg=13.69, stdev= 5.17, samples=206 write: IOPS=14, BW=59.3KiB/s (60.7kB/s)(6260KiB/105587msec); 0 zone resets clat (usec): min=736, max=965821, avg=29420.47, stdev=38620.76 lat (usec): min=736, max=965822, avg=29426.75, stdev=38619.54 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1172], 10.00th=[ 1369], 20.00th=[ 3064], | 30.00th=[ 5997], 40.00th=[ 12125], 50.00th=[ 20317], 60.00th=[ 27395], | 70.00th=[ 36963], 80.00th=[ 50070], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[132645], 99.50th=[149947], 99.90th=[204473], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 119, per=25.08%, avg=59.44, stdev=23.78, samples=206 iops : min= 1, max= 29, avg=14.25, stdev= 6.00, samples=206 lat (usec) : 50=0.16%, 100=1.60%, 250=0.13%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=7.29%, 4=4.62%, 10=7.78%, 20=13.18%, 50=42.45% lat (msec) : 100=19.04%, 250=3.22%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.43%, ctx=6276, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178707: Tue Sep 8 01:32:45 2026 read: IOPS=14, BW=57.3KiB/s (58.7kB/s)(6052KiB/105651msec) clat (usec): min=32, max=215906, avg=37676.76, stdev=24210.66 lat (usec): min=32, max=215907, avg=37678.03, stdev=24210.79 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9110], 10.00th=[ 14877], 20.00th=[ 19530], | 30.00th=[ 24249], 40.00th=[ 27657], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 53216], 90.00th=[ 66847], 95.00th=[ 77071], | 99.00th=[124257], 99.50th=[158335], 99.90th=[183501], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 15, max= 119, per=25.32%, avg=57.47, stdev=20.96, samples=206 iops : min= 3, max= 29, avg=13.74, stdev= 5.27, samples=206 write: IOPS=14, BW=59.0KiB/s (60.4kB/s)(6236KiB/105651msec); 0 zone resets clat (usec): min=802, max=892284, avg=30874.86, stdev=38372.81 lat (usec): min=803, max=892285, avg=30876.32, stdev=38372.79 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1270], 20.00th=[ 2704], | 30.00th=[ 6456], 40.00th=[ 14222], 50.00th=[ 22152], 60.00th=[ 29754], | 70.00th=[ 38536], 80.00th=[ 52691], 90.00th=[ 71828], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[152044], 99.90th=[240124], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 142, per=24.82%, avg=58.83, stdev=23.48, samples=207 iops : min= 1, max= 35, avg=14.09, stdev= 5.90, samples=207 lat (usec) : 50=0.36%, 100=1.46%, 250=0.10%, 500=0.13%, 1000=0.36% lat (msec) : 2=7.85%, 4=4.07%, 10=5.83%, 20=13.80%, 50=43.16% lat (msec) : 100=19.73%, 250=3.12%, 1000=0.03% cpu : usr=0.08%, sys=5.51%, ctx=6298, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=227KiB/s (233kB/s), 56.0KiB/s-58.5KiB/s (58.3kB/s-59.9kB/s), io=23.4MiB (24.6MB), run=101557-105651msec WRITE: bw=238KiB/s (244kB/s), 59.0KiB/s-62.5KiB/s (60.4kB/s-64.0kB/s), io=24.6MiB (25.7MB), run=101557-105651msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178706: Tue Sep 8 01:33:24 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(5992KiB/143932msec) clat (msec): min=5, max=927, avg=37.68, stdev=40.09 lat (msec): min=5, max=927, avg=37.68, stdev=40.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 108], | 99.00th=[ 182], 99.50th=[ 199], 99.90th=[ 266], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 144, per=25.23%, avg=41.88, stdev=27.22, samples=280 iops : min= 1, max= 36, avg= 9.83, stdev= 6.86, samples=280 write: IOPS=10, BW=43.7KiB/s (44.8kB/s)(6296KiB/143932msec); 0 zone resets clat (msec): min=10, max=329, avg=55.29, stdev=36.85 lat (msec): min=10, max=329, avg=55.29, stdev=36.85 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 64], 80.00th=[ 81], 90.00th=[ 104], 95.00th=[ 127], | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 245], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 184, per=25.08%, avg=43.64, stdev=25.16, samples=282 iops : min= 1, max= 46, avg=10.28, stdev= 6.34, samples=282 lat (msec) : 10=2.47%, 20=18.13%, 50=47.56%, 100=23.08%, 250=8.66% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=1.89%, ctx=4771, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178708: Tue Sep 8 01:33:24 2026 read: IOPS=10, BW=41.2KiB/s (42.2kB/s)(5940KiB/144216msec) clat (msec): min=5, max=879, avg=37.71, stdev=39.13 lat (msec): min=5, max=879, avg=37.71, stdev=39.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 165], 99.50th=[ 186], 99.90th=[ 209], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 144, per=25.08%, avg=41.64, stdev=26.74, samples=278 iops : min= 1, max= 36, avg= 9.78, stdev= 6.75, samples=278 write: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6348KiB/144216msec); 0 zone resets clat (msec): min=8, max=347, avg=55.28, stdev=38.18 lat (msec): min=8, max=347, avg=55.28, stdev=38.18 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 80], 90.00th=[ 107], 95.00th=[ 131], | 99.00th=[ 201], 99.50th=[ 226], 99.90th=[ 300], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 160, per=25.09%, avg=43.66, stdev=25.96, samples=283 iops : min= 1, max= 40, avg=10.28, stdev= 6.54, samples=283 lat (msec) : 10=3.22%, 20=18.03%, 50=46.52%, 100=23.18%, 250=8.82% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=1.94%, ctx=4765, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178709: Tue Sep 8 01:33:24 2026 read: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6028KiB/144241msec) clat (msec): min=5, max=259, avg=37.41, stdev=33.82 lat (msec): min=5, max=259, avg=37.42, stdev=33.82 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 108], | 99.00th=[ 176], 99.50th=[ 201], 99.90th=[ 239], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 7, max= 168, per=25.14%, avg=41.74, stdev=26.39, samples=281 iops : min= 1, max= 42, avg= 9.80, stdev= 6.65, samples=281 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6260KiB/144241msec); 0 zone resets clat (msec): min=9, max=947, avg=55.87, stdev=45.11 lat (msec): min=9, max=947, avg=55.87, stdev=45.11 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 51], | 70.00th=[ 61], 80.00th=[ 79], 90.00th=[ 107], 95.00th=[ 131], | 99.00th=[ 209], 99.50th=[ 247], 99.90th=[ 334], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 136, per=24.78%, avg=43.11, stdev=25.90, samples=282 iops : min= 1, max= 34, avg=10.14, stdev= 6.53, samples=282 lat (msec) : 10=3.12%, 20=18.16%, 50=47.10%, 100=22.46%, 250=8.89% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=1.92%, ctx=4763, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178710: Tue Sep 8 01:33:24 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6052KiB/144445msec) clat (msec): min=5, max=255, avg=36.41, stdev=32.09 lat (msec): min=5, max=255, avg=36.41, stdev=32.09 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 75], 95.00th=[ 104], | 99.00th=[ 167], 99.50th=[ 186], 99.90th=[ 253], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 142, per=25.82%, avg=42.86, stdev=27.23, samples=276 iops : min= 1, max= 35, avg=10.09, stdev= 6.86, samples=276 write: IOPS=10, BW=43.2KiB/s (44.2kB/s)(6236KiB/144445msec); 0 zone resets clat (msec): min=8, max=999, avg=57.03, stdev=46.50 lat (msec): min=8, max=999, avg=57.03, stdev=46.50 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 64], 80.00th=[ 81], 90.00th=[ 107], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 234], 99.90th=[ 338], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 152, per=24.66%, avg=42.90, stdev=25.05, samples=284 iops : min= 1, max= 38, avg=10.09, stdev= 6.32, samples=284 lat (msec) : 10=3.06%, 20=17.97%, 50=47.56%, 100=22.66%, 250=8.46% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=1.93%, ctx=4785, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 41.2KiB/s-41.9KiB/s (42.2kB/s-42.9kB/s), io=23.4MiB (24.6MB), run=143932-144445msec WRITE: bw=174KiB/s (178kB/s), 43.2KiB/s-44.0KiB/s (44.2kB/s-45.1kB/s), io=24.6MiB (25.7MB), run=143932-144445msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178747: Tue Sep 8 01:34:06 2026 read: IOPS=11, BW=191KiB/s (195kB/s)(5920KiB/31071msec) clat (usec): min=39, max=270989, avg=44056.57, stdev=30878.46 lat (usec): min=39, max=270990, avg=44058.65, stdev=30878.27 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 8160], 20.00th=[ 21365], | 30.00th=[ 27657], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[132645], 99.50th=[168821], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 446, per=25.01%, avg=190.59, stdev=75.09, samples=61 iops : min= 3, max= 27, avg=11.10, stdev= 4.69, samples=61 write: IOPS=12, BW=205KiB/s (210kB/s)(6368KiB/31071msec); 0 zone resets clat (usec): min=1420, max=202314, avg=36886.36, stdev=36399.12 lat (usec): min=1422, max=202316, avg=36896.05, stdev=36398.79 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1811], 10.00th=[ 2245], 20.00th=[ 5014], | 30.00th=[ 10421], 40.00th=[ 17695], 50.00th=[ 26608], 60.00th=[ 35390], | 70.00th=[ 47973], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[170918], 99.50th=[191890], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 541, per=25.67%, avg=205.66, stdev=97.08, samples=61 iops : min= 1, max= 33, avg=12.05, stdev= 6.08, samples=61 lat (usec) : 50=0.39%, 100=3.78%, 250=0.13%, 500=0.13% lat (msec) : 2=4.30%, 4=4.69%, 10=6.25%, 20=10.81%, 50=37.76% lat (msec) : 100=26.43%, 250=5.21%, 500=0.13% cpu : usr=0.07%, sys=5.51%, ctx=1645, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178748: Tue Sep 8 01:34:06 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(5744KiB/31050msec) clat (usec): min=49, max=191842, avg=45375.79, stdev=27273.29 lat (usec): min=50, max=191843, avg=45377.10, stdev=27273.23 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 16909], 20.00th=[ 25035], | 30.00th=[ 30540], 40.00th=[ 36439], 50.00th=[ 41681], 60.00th=[ 46924], | 70.00th=[ 56886], 80.00th=[ 65799], 90.00th=[ 79168], 95.00th=[ 90702], | 99.00th=[129500], 99.50th=[175113], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 30, max= 318, per=24.25%, avg=184.77, stdev=66.09, samples=61 iops : min= 1, max= 19, avg=10.74, stdev= 4.17, samples=61 write: IOPS=13, BW=211KiB/s (216kB/s)(6544KiB/31050msec); 0 zone resets clat (usec): min=1244, max=166875, avg=35429.93, stdev=33168.65 lat (usec): min=1246, max=166877, avg=35432.04, stdev=33168.64 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1778], 10.00th=[ 2442], 20.00th=[ 5932], | 30.00th=[ 10945], 40.00th=[ 17957], 50.00th=[ 27657], 60.00th=[ 35390], | 70.00th=[ 44827], 80.00th=[ 61080], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[137364], 99.50th=[149947], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 63, max= 446, per=26.29%, avg=210.56, stdev=78.15, samples=61 iops : min= 3, max= 27, avg=12.38, stdev= 4.90, samples=61 lat (usec) : 50=0.13%, 100=3.26%, 250=0.13% lat (msec) : 2=4.17%, 4=3.78%, 10=7.55%, 20=9.38%, 50=40.36% lat (msec) : 100=26.82%, 250=4.43% cpu : usr=0.08%, sys=6.01%, ctx=1651, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178750: Tue Sep 8 01:34:06 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(6256KiB/31425msec) clat (usec): min=33, max=186478, avg=45421.01, stdev=30516.54 lat (usec): min=33, max=186479, avg=45422.25, stdev=30516.50 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 64], 10.00th=[ 11731], 20.00th=[ 22938], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[145753], 99.50th=[170918], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 62, max= 445, per=26.57%, avg=202.43, stdev=82.74, samples=61 iops : min= 3, max= 27, avg=11.85, stdev= 5.21, samples=61 write: IOPS=11, BW=192KiB/s (197kB/s)(6032KiB/31425msec); 0 zone resets clat (usec): min=1404, max=205095, avg=35372.84, stdev=33609.24 lat (usec): min=1406, max=205097, avg=35374.94, stdev=33609.30 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1827], 10.00th=[ 2966], 20.00th=[ 6259], | 30.00th=[ 12125], 40.00th=[ 20055], 50.00th=[ 27919], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 55313], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[154141], 99.50th=[185598], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 379, per=23.86%, avg=191.13, stdev=74.75, samples=62 iops : min= 1, max= 23, avg=11.13, stdev= 4.67, samples=62 lat (usec) : 50=0.65%, 100=3.26%, 250=0.13%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.26%, 4=3.78%, 10=5.99%, 20=10.03%, 50=42.32% lat (msec) : 100=24.61%, 250=5.47% cpu : usr=0.07%, sys=5.52%, ctx=1682, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178752: Tue Sep 8 01:34:06 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30153msec) clat (usec): min=45, max=209651, avg=43195.53, stdev=31101.10 lat (usec): min=46, max=209652, avg=43202.46, stdev=31108.76 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 85], 20.00th=[ 21627], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[156238], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 62, max= 413, per=26.36%, avg=200.88, stdev=77.24, samples=58 iops : min= 3, max= 25, avg=11.76, stdev= 4.89, samples=58 write: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30153msec); 0 zone resets clat (usec): min=1360, max=177674, avg=34544.14, stdev=33274.89 lat (usec): min=1363, max=177676, avg=34546.13, stdev=33274.93 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1762], 10.00th=[ 2311], 20.00th=[ 5276], | 30.00th=[ 9765], 40.00th=[ 16909], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[149947], 99.50th=[173016], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 62, max= 471, per=25.72%, avg=205.98, stdev=78.20, samples=59 iops : min= 3, max= 29, avg=12.08, stdev= 4.91, samples=59 lat (usec) : 50=0.26%, 100=4.82%, 250=0.13%, 500=0.26% lat (msec) : 2=3.91%, 4=4.69%, 10=7.42%, 20=8.85%, 50=39.58% lat (msec) : 100=25.78%, 250=4.30% cpu : usr=0.06%, sys=5.75%, ctx=1633, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=762KiB/s (780kB/s), 185KiB/s-200KiB/s (189kB/s-205kB/s), io=23.4MiB (24.5MB), run=30153-31425msec WRITE: bw=802KiB/s (821kB/s), 192KiB/s-211KiB/s (197kB/s-216kB/s), io=24.6MiB (25.8MB), run=30153-31425msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178749: Tue Sep 8 01:34:16 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5920KiB/41147msec) clat (msec): min=6, max=313, avg=42.42, stdev=36.14 lat (msec): min=6, max=313, avg=42.43, stdev=36.14 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 88], 95.00th=[ 115], | 99.00th=[ 180], 99.50th=[ 201], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 415, per=25.67%, avg=147.33, stdev=83.90, samples=79 iops : min= 1, max= 25, avg= 8.42, stdev= 5.31, samples=79 write: IOPS=9, BW=155KiB/s (158kB/s)(6368KiB/41147msec); 0 zone resets clat (msec): min=10, max=322, avg=63.23, stdev=40.71 lat (msec): min=10, max=322, avg=63.23, stdev=40.71 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 209], 99.50th=[ 232], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 416, per=25.93%, avg=156.60, stdev=84.66, samples=80 iops : min= 1, max= 26, avg= 9.00, stdev= 5.34, samples=80 lat (msec) : 10=1.30%, 20=12.89%, 50=45.83%, 100=28.91%, 250=10.81% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.75%, ctx=1163, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178751: Tue Sep 8 01:34:16 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5744KiB/41661msec) clat (msec): min=7, max=313, avg=43.99, stdev=38.04 lat (msec): min=7, max=313, avg=43.99, stdev=38.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 64], 90.00th=[ 95], 95.00th=[ 111], | 99.00th=[ 211], 99.50th=[ 222], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 383, per=24.22%, avg=139.05, stdev=89.28, samples=81 iops : min= 1, max= 23, avg= 7.90, stdev= 5.65, samples=81 write: IOPS=9, BW=157KiB/s (161kB/s)(6544KiB/41661msec); 0 zone resets clat (msec): min=11, max=242, avg=62.95, stdev=42.66 lat (msec): min=11, max=242, avg=62.96, stdev=42.66 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 74], 80.00th=[ 94], 90.00th=[ 127], 95.00th=[ 153], | 99.00th=[ 207], 99.50th=[ 236], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 29, max= 574, per=25.94%, avg=156.70, stdev=98.80, samples=82 iops : min= 1, max= 35, avg= 9.01, stdev= 6.24, samples=82 lat (msec) : 10=1.17%, 20=14.71%, 50=44.27%, 100=27.08%, 250=12.63% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.75%, ctx=1142, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178753: Tue Sep 8 01:34:16 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6256KiB/41303msec) clat (msec): min=6, max=259, avg=44.34, stdev=39.88 lat (msec): min=6, max=259, avg=44.34, stdev=39.88 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 129], | 99.00th=[ 213], 99.50th=[ 247], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 478, per=26.45%, avg=151.83, stdev=96.80, samples=81 iops : min= 1, max= 29, avg= 8.72, stdev= 6.10, samples=81 write: IOPS=9, BW=146KiB/s (150kB/s)(6032KiB/41303msec); 0 zone resets clat (msec): min=12, max=246, avg=62.85, stdev=40.86 lat (msec): min=12, max=246, avg=62.85, stdev=40.86 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 75], 80.00th=[ 93], 90.00th=[ 120], 95.00th=[ 150], | 99.00th=[ 188], 99.50th=[ 209], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 29, max= 416, per=24.23%, avg=146.34, stdev=81.23, samples=80 iops : min= 1, max= 26, avg= 8.36, stdev= 5.16, samples=80 lat (msec) : 10=1.17%, 20=12.76%, 50=48.57%, 100=25.00%, 250=12.37% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.75%, ctx=1166, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178754: Tue Sep 8 01:34:16 2026 read: IOPS=9, BW=146KiB/s (150kB/s)(6032KiB/41262msec) clat (msec): min=6, max=218, avg=44.99, stdev=39.83 lat (msec): min=6, max=218, avg=44.99, stdev=39.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 97], 95.00th=[ 131], | 99.00th=[ 203], 99.50th=[ 211], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 448, per=25.49%, avg=146.34, stdev=90.68, samples=80 iops : min= 1, max= 28, avg= 8.36, stdev= 5.72, samples=80 write: IOPS=9, BW=152KiB/s (155kB/s)(6256KiB/41262msec); 0 zone resets clat (msec): min=11, max=306, avg=61.29, stdev=41.25 lat (msec): min=11, max=306, avg=61.30, stdev=41.26 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 89], 90.00th=[ 115], 95.00th=[ 146], | 99.00th=[ 205], 99.50th=[ 234], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 416, per=24.96%, avg=150.74, stdev=88.73, samples=81 iops : min= 1, max= 26, avg= 8.64, stdev= 5.61, samples=81 lat (msec) : 10=1.30%, 20=13.93%, 50=45.57%, 100=26.69%, 250=12.37% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=1.76%, ctx=1205, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=575KiB/s (589kB/s), 138KiB/s-151KiB/s (141kB/s-155kB/s), io=23.4MiB (24.5MB), run=41147-41661msec WRITE: bw=605KiB/s (619kB/s), 146KiB/s-157KiB/s (150kB/s-161kB/s), io=24.6MiB (25.8MB), run=41147-41661msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178767: Tue Sep 8 01:34:33 2026 read: IOPS=1, BW=1297KiB/s (1329kB/s)(7168KiB/5525msec) clat (usec): min=475, max=411164, avg=210078.46, stdev=130446.62 lat (usec): min=477, max=411165, avg=210079.85, stdev=130446.61 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[123208], | 30.00th=[175113], 40.00th=[175113], 50.00th=[221250], 60.00th=[238027], | 70.00th=[238027], 80.00th=[299893], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 1595, max= 4079, per=82.89%, avg=2882.75, stdev=1323.46, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=927KiB/s (949kB/s)(5120KiB/5525msec); 0 zone resets clat (msec): min=280, max=2292, avg=751.35, stdev=870.64 lat (msec): min=280, max=2292, avg=751.41, stdev=870.63 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1889, max= 3730, per=52.45%, avg=2554.00, stdev=1021.35, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.89%, ctx=289, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178768: Tue Sep 8 01:34:33 2026 read: IOPS=0, BW=348KiB/s (356kB/s)(2048KiB/5888msec) clat (msec): min=187, max=340, avg=264.21, stdev=107.80 lat (msec): min=187, max=340, avg=264.22, stdev=107.80 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1501, max= 1889, per=48.73%, avg=1695.00, stdev=274.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1739KiB/s (1781kB/s)(10.0MiB/5888msec); 0 zone resets clat (msec): min=166, max=1306, avg=529.53, stdev=406.77 lat (msec): min=166, max=1306, avg=529.62, stdev=406.77 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 180], | 30.00th=[ 236], 40.00th=[ 317], 50.00th=[ 342], 60.00th=[ 355], | 70.00th=[ 584], 80.00th=[ 634], 90.00th=[ 1183], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1501, max= 4079, per=51.42%, avg=2503.57, stdev=1070.57, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=9.27%, ctx=132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178769: Tue Sep 8 01:34:34 2026 read: IOPS=1, BW=1589KiB/s (1627kB/s)(6144KiB/3867msec) clat (usec): min=485, max=271486, avg=165881.74, stdev=92935.01 lat (usec): min=486, max=271486, avg=165882.80, stdev=92934.84 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[156238], | 30.00th=[156238], 40.00th=[158335], 50.00th=[158335], 60.00th=[175113], | 70.00th=[233833], 80.00th=[233833], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1865, max= 3968, per=92.11%, avg=3203.67, stdev=1163.21, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1589KiB/s (1627kB/s)(6144KiB/3867msec); 0 zone resets clat (msec): min=175, max=858, avg=414.23, stdev=254.20 lat (msec): min=175, max=858, avg=414.32, stdev=254.21 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 409], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1442, max= 2043, per=38.63%, avg=1880.83, stdev=228.09, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=14.15%, ctx=215, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178770: Tue Sep 8 01:34:34 2026 read: IOPS=0, BW=901KiB/s (923kB/s)(5120KiB/5683msec) clat (usec): min=348, max=1604.8k, avg=362689.87, stdev=700102.72 lat (usec): min=348, max=1604.8k, avg=362690.90, stdev=700102.41 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], | 20.00th=[ 351], 30.00th=[ 506], 40.00th=[ 506], | 50.00th=[ 652], 60.00th=[ 652], 70.00th=[ 206570], | 80.00th=[ 206570], 90.00th=[1602225], 95.00th=[1602225], | 99.00th=[1602225], 99.50th=[1602225], 99.90th=[1602225], | 99.95th=[1602225], 99.99th=[1602225] bw ( KiB/s): min= 1889, max= 6035, per=100.00%, avg=3962.00, stdev=2931.66, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1261KiB/s (1292kB/s)(7168KiB/5683msec); 0 zone resets clat (msec): min=77, max=969, avg=504.68, stdev=289.66 lat (msec): min=77, max=969, avg=504.75, stdev=289.67 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 275], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 493], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 718], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1865, max= 2039, per=40.37%, avg=1965.83, stdev=71.40, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=8.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=8.80%, ctx=347, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3478KiB/s (3562kB/s), 348KiB/s-1589KiB/s (356kB/s-1627kB/s), io=20.0MiB (20.0MB), run=3867-5888msec WRITE: bw=4870KiB/s (4986kB/s), 927KiB/s-1739KiB/s (949kB/s-1781kB/s), io=28.0MiB (29.4MB), run=3867-5888msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178771: Tue Sep 8 01:34:34 2026 read: IOPS=1, BW=1461KiB/s (1496kB/s)(7168KiB/4906msec) clat (msec): min=100, max=573, avg=209.87, stdev=168.43 lat (msec): min=100, max=573, avg=209.88, stdev=168.43 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 111], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 133], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 228], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1418, max= 4096, per=93.10%, avg=2892.50, stdev=1402.65, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1044KiB/s (1069kB/s)(5120KiB/4906msec); 0 zone resets clat (msec): min=118, max=2117, avg=648.62, stdev=840.59 lat (msec): min=118, max=2117, avg=649.54, stdev=840.47 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 1969, max= 2048, per=46.23%, avg=2011.00, stdev=40.36, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=66.67%, 500=8.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.55%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178772: Tue Sep 8 01:34:34 2026 read: IOPS=0, BW=353KiB/s (361kB/s)(2048KiB/5806msec) clat (msec): min=79, max=238, avg=158.86, stdev=112.73 lat (msec): min=79, max=238, avg=158.86, stdev=112.73 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 80], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 1410, max= 1969, per=54.38%, avg=1689.50, stdev=395.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1764KiB/s (1806kB/s)(10.0MiB/5806msec); 0 zone resets clat (msec): min=113, max=1305, avg=544.32, stdev=415.96 lat (msec): min=113, max=1305, avg=544.43, stdev=415.95 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 123], | 30.00th=[ 284], 40.00th=[ 401], 50.00th=[ 460], 60.00th=[ 489], | 70.00th=[ 502], 80.00th=[ 510], 90.00th=[ 1267], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1969, max= 4087, per=55.70%, avg=2423.14, stdev=793.63, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.79, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=5.12%, ctx=122, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178773: Tue Sep 8 01:34:34 2026 read: IOPS=0, BW=970KiB/s (993kB/s)(6144KiB/6333msec) clat (msec): min=69, max=2095, avg=651.09, stdev=789.43 lat (msec): min=69, max=2095, avg=651.09, stdev=789.43 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 397], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 1984, max= 2048, per=65.00%, avg=2019.60, stdev=28.18, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=0, BW=970KiB/s (993kB/s)(6144KiB/6333msec); 0 zone resets clat (msec): min=67, max=924, avg=364.09, stdev=318.84 lat (msec): min=67, max=924, avg=369.43, stdev=322.81 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 234], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1984, max= 4031, per=63.25%, avg=2751.25, stdev=958.71, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.00%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178774: Tue Sep 8 01:34:34 2026 read: IOPS=0, BW=777KiB/s (795kB/s)(5120KiB/6591msec) clat (msec): min=103, max=2030, avg=696.11, stdev=762.83 lat (msec): min=103, max=2030, avg=696.11, stdev=762.83 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 2000, max= 2048, per=64.90%, avg=2016.50, stdev=21.98, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1088KiB/s (1114kB/s)(7168KiB/6591msec); 0 zone resets clat (msec): min=78, max=822, avg=417.86, stdev=343.38 lat (msec): min=78, max=822, avg=417.95, stdev=343.39 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 97], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 279], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 810], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1492, max= 2048, per=44.08%, avg=1917.40, stdev=239.29, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=25.00%, 750=16.67%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.88%, ctx=136, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3107KiB/s (3182kB/s), 353KiB/s-1461KiB/s (361kB/s-1496kB/s), io=20.0MiB (20.0MB), run=4906-6591msec WRITE: bw=4350KiB/s (4455kB/s), 970KiB/s-1764KiB/s (993kB/s-1806kB/s), io=28.0MiB (29.4MB), run=4906-6591msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178782: Tue Sep 8 01:34:51 2026 read: IOPS=1, BW=5036KiB/s (5157kB/s)(12.0MiB/2440msec) clat (msec): min=665, max=880, avg=775.12, stdev=107.94 lat (msec): min=665, max=880, avg=775.12, stdev=107.94 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7984, max= 8126, per=100.00%, avg=8055.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.41%, ctx=176, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178783: Tue Sep 8 01:34:51 2026 read: IOPS=0, BW=1100KiB/s (1126kB/s)(4096KiB/3725msec) clat (nsec): min=787174k, max=787174k, avg=787174212.00, stdev= 0.00 lat (nsec): min=787177k, max=787177k, avg=787177162.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2199KiB/s (2252kB/s)(8192KiB/3725msec); 0 zone resets clat (msec): min=1258, max=1547, avg=1402.96, stdev=204.91 lat (msec): min=1261, max=1549, avg=1405.34, stdev=204.11 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8143, max= 8143, per=92.58%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.93%, ctx=119, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178784: Tue Sep 8 01:34:51 2026 write: IOPS=0, BW=3573KiB/s (3659kB/s)(12.0MiB/3439msec); 0 zone resets clat (msec): min=289, max=2035, avg=1106.61, stdev=877.98 lat (msec): min=290, max=2035, avg=1107.48, stdev=877.85 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 7953, max= 8126, per=91.40%, avg=8039.50, stdev=122.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.41%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178785: Tue Sep 8 01:34:51 2026 write: IOPS=1, BW=4587KiB/s (4697kB/s)(12.0MiB/2679msec); 0 zone resets clat (msec): min=419, max=1356, avg=874.28, stdev=469.22 lat (msec): min=421, max=1357, avg=875.24, stdev=468.49 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 6907, max= 7984, per=84.65%, avg=7445.50, stdev=761.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.56%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4398KiB/s (4504kB/s), 1100KiB/s-5036KiB/s (1126kB/s-5157kB/s), io=16.0MiB (16.8MB), run=2440-3725msec WRITE: bw=8797KiB/s (9008kB/s), 2199KiB/s-4587KiB/s (2252kB/s-4697kB/s), io=32.0MiB (33.6MB), run=2679-3725msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178786: Tue Sep 8 01:34:51 2026 read: IOPS=0, BW=3437KiB/s (3520kB/s)(12.0MiB/3575msec) clat (msec): min=277, max=1847, avg=1126.44, stdev=792.92 lat (msec): min=277, max=1847, avg=1126.44, stdev=792.92 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=2.77%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178787: Tue Sep 8 01:34:51 2026 read: IOPS=0, BW=1100KiB/s (1127kB/s)(4096KiB/3723msec) clat (nsec): min=1659.0M, max=1659.0M, avg=1659977244.00, stdev= 0.00 lat (nsec): min=1659.0M, max=1659.0M, avg=1659979434.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1653], 5.00th=[ 1653], 10.00th=[ 1653], 20.00th=[ 1653], | 30.00th=[ 1653], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2200KiB/s (2253kB/s)(8192KiB/3723msec); 0 zone resets clat (msec): min=822, max=1065, avg=944.18, stdev=171.53 lat (msec): min=823, max=1065, avg=944.51, stdev=171.52 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7907, max= 7907, per=89.84%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.36%, ctx=43, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178788: Tue Sep 8 01:34:51 2026 write: IOPS=0, BW=3949KiB/s (4043kB/s)(12.0MiB/3112msec); 0 zone resets clat (msec): min=222, max=1477, avg=990.22, stdev=673.20 lat (msec): min=222, max=1477, avg=990.61, stdev=673.12 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7984, max= 7984, per=90.72%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.66%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178789: Tue Sep 8 01:34:51 2026 write: IOPS=1, BW=4129KiB/s (4228kB/s)(12.0MiB/2976msec); 0 zone resets clat (msec): min=286, max=1364, avg=972.85, stdev=596.15 lat (msec): min=287, max=1364, avg=973.12, stdev=596.09 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7984, max= 7984, per=90.72%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.10%, sys=3.90%, ctx=41, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4401KiB/s (4506kB/s), 1100KiB/s-3437KiB/s (1127kB/s-3520kB/s), io=16.0MiB (16.8MB), run=3575-3723msec WRITE: bw=8802KiB/s (9013kB/s), 2200KiB/s-4129KiB/s (2253kB/s-4228kB/s), io=32.0MiB (33.6MB), run=2976-3723msec