== sanity test 398b: DIO and buffer IO race ============== 10:44:00 (1789137840) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.72071 s, 5.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179602: Fri Sep 11 10:46:40 2026 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(5992KiB/132319msec) clat (usec): min=39, max=878834, avg=49646.88, stdev=38621.64 lat (usec): min=40, max=878835, avg=49655.33, stdev=38626.75 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10159], 10.00th=[ 17695], 20.00th=[ 25035], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[162530], 99.50th=[183501], 99.90th=[283116], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 104, per=25.38%, avg=45.18, stdev=18.56, samples=259 iops : min= 1, max= 26, avg=10.64, stdev= 4.68, samples=259 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6296KiB/132319msec); 0 zone resets clat (usec): min=764, max=315992, avg=36421.04, stdev=39395.05 lat (usec): min=764, max=315993, avg=36424.53, stdev=39393.84 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1336], 20.00th=[ 3556], | 30.00th=[ 6587], 40.00th=[ 13698], 50.00th=[ 24511], 60.00th=[ 34866], | 70.00th=[ 46924], 80.00th=[ 64750], 90.00th=[ 92799], 95.00th=[115868], | 99.00th=[166724], 99.50th=[181404], 99.90th=[312476], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 158, per=25.60%, avg=47.62, stdev=22.98, samples=258 iops : min= 1, max= 39, avg=11.26, stdev= 5.80, samples=258 lat (usec) : 50=0.23%, 100=1.86%, 250=0.07%, 750=0.03%, 1000=0.23% lat (msec) : 2=7.03%, 4=3.91%, 10=7.71%, 20=8.24%, 50=37.01% lat (msec) : 100=26.56%, 250=7.00%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=4.73%, ctx=6113, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179603: Fri Sep 11 10:46:40 2026 read: IOPS=11, BW=44.8KiB/s (45.9kB/s)(5940KiB/132498msec) clat (usec): min=36, max=326958, avg=48831.21, stdev=32375.81 lat (usec): min=36, max=326959, avg=48835.40, stdev=32378.43 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10028], 10.00th=[ 17957], 20.00th=[ 24249], | 30.00th=[ 30016], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 49546], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[107480], | 99.00th=[152044], 99.50th=[196084], 99.90th=[217056], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 6, max= 95, per=25.01%, avg=44.52, stdev=18.45, samples=260 iops : min= 1, max= 23, avg=10.48, stdev= 4.66, samples=260 write: IOPS=11, BW=47.9KiB/s (49.1kB/s)(6348KiB/132498msec); 0 zone resets clat (usec): min=791, max=891389, avg=37422.53, stdev=45791.04 lat (usec): min=792, max=891391, avg=37425.31, stdev=45792.43 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1352], 20.00th=[ 3261], | 30.00th=[ 6194], 40.00th=[ 13829], 50.00th=[ 24249], 60.00th=[ 35390], | 70.00th=[ 48497], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[115868], | 99.00th=[175113], 99.50th=[193987], 99.90th=[371196], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 111, per=25.59%, avg=47.59, stdev=20.72, samples=260 iops : min= 1, max= 27, avg=11.26, stdev= 5.24, samples=260 lat (usec) : 50=0.20%, 100=1.73%, 250=0.13%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=7.85%, 4=3.74%, 10=7.52%, 20=8.50%, 50=35.87% lat (msec) : 100=27.08%, 250=6.97%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=4.85%, ctx=6225, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179604: Fri Sep 11 10:46:40 2026 read: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6028KiB/134859msec) clat (usec): min=37, max=914105, avg=49576.94, stdev=41278.13 lat (usec): min=37, max=914106, avg=49584.87, stdev=41281.03 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9765], 10.00th=[ 17171], 20.00th=[ 23462], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[181404], 99.50th=[227541], 99.90th=[287310], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 6, max= 112, per=24.93%, avg=44.37, stdev=19.20, samples=265 iops : min= 1, max= 28, avg=10.45, stdev= 4.85, samples=265 write: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6260KiB/134859msec); 0 zone resets clat (usec): min=811, max=265866, avg=38069.22, stdev=39919.09 lat (usec): min=813, max=265868, avg=38071.81, stdev=39920.07 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1434], 20.00th=[ 3654], | 30.00th=[ 7177], 40.00th=[ 15664], 50.00th=[ 26608], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[173016], 99.50th=[193987], 99.90th=[244319], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 143, per=24.76%, avg=46.06, stdev=20.99, samples=265 iops : min= 1, max= 35, avg=10.88, stdev= 5.29, samples=265 lat (usec) : 50=0.23%, 100=1.76%, 250=0.07%, 500=0.03%, 1000=0.20% lat (msec) : 2=7.00%, 4=3.81%, 10=7.00%, 20=9.51%, 50=36.04% lat (msec) : 100=26.40%, 250=7.85%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=4.98%, ctx=6293, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179605: Fri Sep 11 10:46:40 2026 read: IOPS=11, BW=44.9KiB/s (45.9kB/s)(6052KiB/134888msec) clat (usec): min=34, max=293542, avg=48134.03, stdev=32504.59 lat (usec): min=35, max=293543, avg=48142.29, stdev=32502.10 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 8979], 10.00th=[ 17171], 20.00th=[ 24249], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[170918], 99.50th=[198181], 99.90th=[246416], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 95, per=25.13%, avg=44.72, stdev=17.11, samples=264 iops : min= 1, max= 23, avg=10.53, stdev= 4.34, samples=264 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6236KiB/134888msec); 0 zone resets clat (usec): min=709, max=896520, avg=39443.96, stdev=46387.42 lat (usec): min=710, max=896522, avg=39453.25, stdev=46401.77 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1369], 20.00th=[ 3392], | 30.00th=[ 7242], 40.00th=[ 17171], 50.00th=[ 27657], 60.00th=[ 38536], | 70.00th=[ 50594], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[123208], | 99.00th=[177210], 99.50th=[217056], 99.90th=[254804], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 119, per=24.75%, avg=46.03, stdev=19.83, samples=264 iops : min= 1, max= 29, avg=10.87, stdev= 5.01, samples=264 lat (usec) : 50=0.23%, 100=1.92%, 250=0.13%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=7.23%, 4=3.68%, 10=6.35%, 20=8.07%, 50=38.25% lat (msec) : 100=26.69%, 250=7.13%, 500=0.07%, 1000=0.03% cpu : usr=0.10%, sys=4.74%, ctx=6296, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=178KiB/s (182kB/s), 44.7KiB/s-45.3KiB/s (45.8kB/s-46.4kB/s), io=23.4MiB (24.6MB), run=132319-134888msec WRITE: bw=186KiB/s (191kB/s), 46.2KiB/s-47.9KiB/s (47.3kB/s-49.1kB/s), io=24.6MiB (25.7MB), run=132319-134888msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179606: Fri Sep 11 10:47:21 2026 read: IOPS=8, BW=34.2KiB/s (34.0kB/s)(5992KiB/175339msec) clat (msec): min=5, max=938, avg=45.89, stdev=49.62 lat (msec): min=5, max=938, avg=45.90, stdev=49.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 105], 95.00th=[ 146], | 99.00th=[ 220], 99.50th=[ 249], 99.90th=[ 347], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 135, per=25.45%, avg=34.61, stdev=25.19, samples=334 iops : min= 1, max= 33, avg= 7.98, stdev= 6.34, samples=334 write: IOPS=8, BW=35.9KiB/s (36.8kB/s)(6296KiB/175339msec); 0 zone resets clat (msec): min=11, max=344, avg=67.46, stdev=48.60 lat (msec): min=11, max=344, avg=67.47, stdev=48.60 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 103], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 234], 99.50th=[ 271], 99.90th=[ 300], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 159, per=25.46%, avg=36.16, stdev=25.07, samples=337 iops : min= 1, max= 39, avg= 8.36, stdev= 6.30, samples=337 lat (msec) : 10=2.44%, 20=15.85%, 50=42.35%, 100=23.40%, 250=15.27% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.06%, sys=1.59%, ctx=4718, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179607: Fri Sep 11 10:47:21 2026 read: IOPS=8, BW=33.8KiB/s (34.6kB/s)(5940KiB/175822msec) clat (msec): min=5, max=947, avg=45.11, stdev=48.35 lat (msec): min=5, max=947, avg=45.11, stdev=48.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 68], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 203], 99.50th=[ 226], 99.90th=[ 338], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 135, per=25.72%, avg=34.97, stdev=25.56, samples=328 iops : min= 1, max= 33, avg= 8.05, stdev= 6.43, samples=328 write: IOPS=9, BW=36.1KiB/s (36.0kB/s)(6348KiB/175822msec); 0 zone resets clat (msec): min=9, max=418, avg=68.26, stdev=50.78 lat (msec): min=9, max=418, avg=68.26, stdev=50.78 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 103], 90.00th=[ 134], 95.00th=[ 161], | 99.00th=[ 243], 99.50th=[ 313], 99.90th=[ 401], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 151, per=25.42%, avg=36.10, stdev=24.47, samples=339 iops : min= 1, max= 37, avg= 8.35, stdev= 6.14, samples=339 lat (msec) : 10=3.09%, 20=15.59%, 50=41.11%, 100=24.19%, 250=15.36% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.06%, sys=1.70%, ctx=4728, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179608: Fri Sep 11 10:47:21 2026 read: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6028KiB/175719msec) clat (msec): min=4, max=271, avg=45.97, stdev=43.39 lat (msec): min=4, max=271, avg=45.97, stdev=43.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 67], 90.00th=[ 105], 95.00th=[ 142], | 99.00th=[ 207], 99.50th=[ 234], 99.90th=[ 264], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 166, per=25.59%, avg=34.80, stdev=25.30, samples=335 iops : min= 1, max= 41, avg= 8.03, stdev= 6.37, samples=335 write: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6260KiB/175719msec); 0 zone resets clat (msec): min=8, max=1020, avg=67.73, stdev=56.40 lat (msec): min=8, max=1020, avg=67.73, stdev=56.40 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 63], | 70.00th=[ 81], 80.00th=[ 101], 90.00th=[ 133], 95.00th=[ 163], | 99.00th=[ 262], 99.50th=[ 305], 99.90th=[ 418], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 135, per=25.13%, avg=35.68, stdev=25.40, samples=339 iops : min= 1, max= 33, avg= 8.24, stdev= 6.38, samples=339 lat (msec) : 10=2.47%, 20=15.27%, 50=42.38%, 100=24.28%, 250=14.88% lat (msec) : 500=0.68%, 2000=0.03% cpu : usr=0.06%, sys=1.58%, ctx=4718, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179609: Fri Sep 11 10:47:21 2026 read: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6052KiB/176138msec) clat (msec): min=4, max=300, avg=44.55, stdev=42.97 lat (msec): min=4, max=300, avg=44.55, stdev=42.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 68], 90.00th=[ 107], 95.00th=[ 142], | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 279], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 136, per=26.14%, avg=35.55, stdev=26.71, samples=330 iops : min= 1, max= 34, avg= 8.21, stdev= 6.71, samples=330 write: IOPS=8, BW=35.4KiB/s (36.3kB/s)(6236KiB/176138msec); 0 zone resets clat (msec): min=10, max=969, avg=69.40, stdev=55.76 lat (msec): min=10, max=969, avg=69.40, stdev=55.76 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 104], 90.00th=[ 138], 95.00th=[ 171], | 99.00th=[ 262], 99.50th=[ 300], 99.90th=[ 347], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 143, per=25.17%, avg=35.75, stdev=24.60, samples=338 iops : min= 1, max= 35, avg= 8.26, stdev= 6.18, samples=338 lat (msec) : 10=2.77%, 20=16.86%, 50=40.76%, 100=23.27%, 250=15.59% lat (msec) : 500=0.72%, 1000=0.03% cpu : usr=0.06%, sys=1.56%, ctx=4777, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=136KiB/s (140kB/s), 33.8KiB/s-34.4KiB/s (34.6kB/s-35.2kB/s), io=23.4MiB (24.6MB), run=175339-176138msec WRITE: bw=143KiB/s (146kB/s), 35.4KiB/s-36.1KiB/s (36.3kB/s-36.0kB/s), io=24.6MiB (25.7MB), run=175339-176138msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179651: Fri Sep 11 10:48:05 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(5920KiB/32755msec) clat (usec): min=37, max=348568, avg=46250.08, stdev=33366.13 lat (usec): min=37, max=348569, avg=46251.36, stdev=33366.18 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 11076], 20.00th=[ 23725], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 64750], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[160433], 99.50th=[196084], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 30, max= 414, per=26.01%, avg=180.77, stdev=73.69, samples=64 iops : min= 1, max= 25, avg=10.52, stdev= 4.68, samples=64 write: IOPS=12, BW=194KiB/s (199kB/s)(6368KiB/32755msec); 0 zone resets clat (usec): min=1432, max=243546, avg=38907.02, stdev=39307.80 lat (usec): min=1435, max=243548, avg=38911.03, stdev=39306.54 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1811], 10.00th=[ 2900], 20.00th=[ 6456], | 30.00th=[ 10552], 40.00th=[ 20841], 50.00th=[ 28443], 60.00th=[ 37487], | 70.00th=[ 47449], 80.00th=[ 65799], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[189793], 99.50th=[221250], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 31, max= 500, per=26.54%, avg=193.98, stdev=81.00, samples=64 iops : min= 1, max= 31, avg=11.36, stdev= 5.14, samples=64 lat (usec) : 50=0.39%, 100=3.65%, 250=0.13%, 750=0.13% lat (msec) : 2=3.39%, 4=3.52%, 10=8.72%, 20=7.16%, 50=39.71% lat (msec) : 100=26.95%, 250=6.12%, 500=0.13% cpu : usr=0.06%, sys=5.04%, ctx=1604, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179652: Fri Sep 11 10:48:05 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5744KiB/34306msec) clat (usec): min=48, max=230896, avg=51506.60, stdev=35510.04 lat (usec): min=50, max=230897, avg=51508.02, stdev=35510.02 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 16909], 20.00th=[ 25560], | 30.00th=[ 31851], 40.00th=[ 39060], 50.00th=[ 44827], 60.00th=[ 50594], | 70.00th=[ 61080], 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[111674], | 99.00th=[181404], 99.50th=[185598], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 319, per=23.97%, avg=166.61, stdev=63.09, samples=67 iops : min= 1, max= 19, avg= 9.63, stdev= 3.99, samples=67 write: IOPS=11, BW=191KiB/s (195kB/s)(6544KiB/34306msec); 0 zone resets clat (usec): min=1322, max=199209, avg=38148.90, stdev=37309.06 lat (usec): min=1324, max=199213, avg=38165.49, stdev=37296.93 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1844], 10.00th=[ 2737], 20.00th=[ 7308], | 30.00th=[ 11338], 40.00th=[ 18220], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 49021], 80.00th=[ 67634], 90.00th=[ 90702], 95.00th=[110625], | 99.00th=[166724], 99.50th=[175113], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 60, max= 377, per=26.11%, avg=190.87, stdev=75.50, samples=67 iops : min= 3, max= 23, avg=11.15, stdev= 4.79, samples=67 lat (usec) : 50=0.13%, 100=2.99%, 250=0.39%, 1000=0.13% lat (msec) : 2=3.65%, 4=3.78%, 10=6.64%, 20=10.68%, 50=36.72% lat (msec) : 100=25.91%, 250=8.98% cpu : usr=0.07%, sys=5.19%, ctx=1655, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179653: Fri Sep 11 10:48:05 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(6256KiB/34436msec) clat (usec): min=32, max=283682, avg=48673.62, stdev=32114.06 lat (usec): min=32, max=283683, avg=48674.98, stdev=32114.02 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 78], 10.00th=[ 16450], 20.00th=[ 26084], | 30.00th=[ 32637], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 59507], 80.00th=[ 68682], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[152044], 99.50th=[212861], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 318, per=26.02%, avg=180.82, stdev=70.53, samples=67 iops : min= 1, max= 19, avg=10.51, stdev= 4.48, samples=67 write: IOPS=10, BW=175KiB/s (179kB/s)(6032KiB/34436msec); 0 zone resets clat (usec): min=1281, max=170457, avg=40282.39, stdev=37983.70 lat (usec): min=1282, max=170459, avg=40380.48, stdev=38039.66 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1762], 10.00th=[ 2311], 20.00th=[ 5407], | 30.00th=[ 11731], 40.00th=[ 19268], 50.00th=[ 29754], 60.00th=[ 40109], | 70.00th=[ 53740], 80.00th=[ 71828], 90.00th=[100140], 95.00th=[116917], | 99.00th=[158335], 99.50th=[166724], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 383, per=23.57%, avg=172.31, stdev=72.76, samples=67 iops : min= 1, max= 23, avg= 9.97, stdev= 4.58, samples=67 lat (usec) : 50=0.52%, 100=2.47%, 250=0.39%, 500=0.26%, 1000=0.26% lat (msec) : 2=4.30%, 4=3.65%, 10=5.60%, 20=9.11%, 50=36.20% lat (msec) : 100=29.69%, 250=7.42%, 500=0.13% cpu : usr=0.06%, sys=5.51%, ctx=1768, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179654: Fri Sep 11 10:48:05 2026 read: IOPS=11, BW=177KiB/s (182kB/s)(6032KiB/33986msec) clat (usec): min=47, max=288394, avg=50404.71, stdev=35702.62 lat (usec): min=48, max=288395, avg=50405.99, stdev=35702.59 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 15533], 20.00th=[ 27132], | 30.00th=[ 32637], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 51119], | 70.00th=[ 59507], 80.00th=[ 68682], 90.00th=[ 88605], 95.00th=[115868], | 99.00th=[185598], 99.50th=[208667], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 62, max= 318, per=25.65%, avg=178.28, stdev=66.08, samples=65 iops : min= 3, max= 19, avg=10.37, stdev= 4.16, samples=65 write: IOPS=11, BW=184KiB/s (188kB/s)(6256KiB/33986msec); 0 zone resets clat (usec): min=1204, max=183738, avg=38106.99, stdev=38291.26 lat (usec): min=1205, max=183740, avg=38110.95, stdev=38290.61 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1795], 10.00th=[ 2999], 20.00th=[ 6783], | 30.00th=[ 11338], 40.00th=[ 17171], 50.00th=[ 25822], 60.00th=[ 33817], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[158335], 99.50th=[175113], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 479, per=24.92%, avg=182.18, stdev=81.30, samples=66 iops : min= 1, max= 29, avg=10.61, stdev= 5.11, samples=66 lat (usec) : 50=0.26%, 100=3.26%, 250=0.39%, 1000=0.13% lat (msec) : 2=3.65%, 4=2.73%, 10=8.07%, 20=10.81%, 50=35.68% lat (msec) : 100=26.56%, 250=8.33%, 500=0.13% cpu : usr=0.08%, sys=5.44%, ctx=1657, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=696KiB/s (712kB/s), 167KiB/s-182KiB/s (171kB/s-186kB/s), io=23.4MiB (24.5MB), run=32755-34436msec WRITE: bw=732KiB/s (749kB/s), 175KiB/s-194KiB/s (179kB/s-199kB/s), io=24.6MiB (25.8MB), run=32755-34436msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179656: Fri Sep 11 10:48:17 2026 read: IOPS=8, BW=131KiB/s (135kB/s)(5920KiB/45060msec) clat (msec): min=7, max=232, avg=49.56, stdev=43.33 lat (msec): min=7, max=232, avg=49.56, stdev=43.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 72], 90.00th=[ 114], 95.00th=[ 148], | 99.00th=[ 215], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 415, per=24.93%, avg=131.12, stdev=84.82, samples=89 iops : min= 1, max= 25, avg= 7.38, stdev= 5.36, samples=89 write: IOPS=8, BW=141KiB/s (145kB/s)(6368KiB/45060msec); 0 zone resets clat (msec): min=13, max=258, avg=67.01, stdev=44.20 lat (msec): min=13, max=258, avg=67.01, stdev=44.20 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 101], 90.00th=[ 129], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 230], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 29, max= 414, per=25.74%, avg=142.60, stdev=89.17, samples=88 iops : min= 1, max= 25, avg= 8.09, stdev= 5.65, samples=88 lat (msec) : 10=1.04%, 20=12.24%, 50=44.01%, 100=25.39%, 250=17.19% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.69%, ctx=1231, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179657: Fri Sep 11 10:48:17 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5744KiB/45463msec) clat (msec): min=6, max=276, avg=47.69, stdev=41.91 lat (msec): min=6, max=276, avg=47.69, stdev=41.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 69], 90.00th=[ 107], 95.00th=[ 144], | 99.00th=[ 205], 99.50th=[ 228], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 410, per=24.57%, avg=129.23, stdev=87.56, samples=86 iops : min= 1, max= 25, avg= 7.26, stdev= 5.54, samples=86 write: IOPS=8, BW=144KiB/s (147kB/s)(6544KiB/45463msec); 0 zone resets clat (msec): min=13, max=365, avg=69.14, stdev=49.94 lat (msec): min=13, max=365, avg=69.17, stdev=49.96 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 66], | 70.00th=[ 83], 80.00th=[ 104], 90.00th=[ 138], 95.00th=[ 161], | 99.00th=[ 239], 99.50th=[ 257], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 30, max= 378, per=25.96%, avg=143.80, stdev=86.02, samples=88 iops : min= 1, max= 23, avg= 8.17, stdev= 5.40, samples=88 lat (msec) : 10=1.56%, 20=11.72%, 50=46.35%, 100=23.83%, 250=16.02% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.66%, ctx=1208, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179658: Fri Sep 11 10:48:17 2026 read: IOPS=8, BW=139KiB/s (143kB/s)(6256KiB/44882msec) clat (msec): min=7, max=264, avg=47.00, stdev=42.20 lat (msec): min=7, max=264, avg=47.01, stdev=42.22 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 68], 90.00th=[ 107], 95.00th=[ 144], | 99.00th=[ 201], 99.50th=[ 220], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 507, per=26.79%, avg=140.92, stdev=102.31, samples=87 iops : min= 1, max= 31, avg= 7.99, stdev= 6.45, samples=87 write: IOPS=8, BW=134KiB/s (138kB/s)(6032KiB/44882msec); 0 zone resets clat (msec): min=14, max=250, avg=70.20, stdev=47.25 lat (msec): min=14, max=250, avg=70.20, stdev=47.25 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 46], 50.00th=[ 57], 60.00th=[ 72], | 70.00th=[ 85], 80.00th=[ 104], 90.00th=[ 136], 95.00th=[ 174], | 99.00th=[ 226], 99.50th=[ 245], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 351, per=24.10%, avg=133.52, stdev=77.87, samples=87 iops : min= 1, max= 21, avg= 7.53, stdev= 4.94, samples=87 lat (msec) : 10=1.69%, 20=12.89%, 50=43.75%, 100=25.78%, 250=15.63% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.56%, ctx=1195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179659: Fri Sep 11 10:48:17 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(6032KiB/44996msec) clat (msec): min=7, max=232, avg=48.50, stdev=42.65 lat (msec): min=7, max=232, avg=48.50, stdev=42.65 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 74], 90.00th=[ 110], 95.00th=[ 148], | 99.00th=[ 218], 99.50th=[ 230], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 30, max= 416, per=26.40%, avg=138.85, stdev=88.17, samples=84 iops : min= 1, max= 26, avg= 7.85, stdev= 5.60, samples=84 write: IOPS=8, BW=139KiB/s (142kB/s)(6256KiB/44996msec); 0 zone resets clat (msec): min=15, max=334, avg=68.24, stdev=50.10 lat (msec): min=15, max=334, avg=68.24, stdev=50.10 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 81], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 247], 99.50th=[ 296], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 410, per=24.74%, avg=137.08, stdev=86.59, samples=88 iops : min= 1, max= 25, avg= 7.75, stdev= 5.47, samples=88 lat (msec) : 10=0.78%, 20=13.80%, 50=46.09%, 100=22.14%, 250=16.80% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.77%, ctx=1291, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=527KiB/s (539kB/s), 126KiB/s-139KiB/s (129kB/s-143kB/s), io=23.4MiB (24.5MB), run=44882-45463msec WRITE: bw=554KiB/s (568kB/s), 134KiB/s-144KiB/s (138kB/s-147kB/s), io=24.6MiB (25.8MB), run=44882-45463msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179678: Fri Sep 11 10:48:37 2026 read: IOPS=1, BW=1089KiB/s (1115kB/s)(7168KiB/6583msec) clat (usec): min=462, max=2174.9k, avg=748357.85, stdev=872837.73 lat (usec): min=463, max=2174.9k, avg=748359.25, stdev=872837.74 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], | 20.00th=[ 116917], 30.00th=[ 133694], 40.00th=[ 133694], | 50.00th=[ 139461], 60.00th=[1069548], 70.00th=[1069548], | 80.00th=[1602225], 90.00th=[2164261], 95.00th=[2164261], | 99.00th=[2164261], 99.50th=[2164261], 99.90th=[2164261], | 99.95th=[2164261], 99.99th=[2164261] bw ( KiB/s): min= 2023, max= 4096, per=94.77%, avg=2444.00, stdev=923.53, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=778KiB/s (796kB/s)(5120KiB/6583msec); 0 zone resets clat (msec): min=162, max=410, avg=256.39, stdev=101.88 lat (msec): min=162, max=410, avg=256.62, stdev=101.67 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2043, max= 6095, per=100.00%, avg=4069.00, stdev=2865.20, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=16.67%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.73%, ctx=949, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179679: Fri Sep 11 10:48:37 2026 read: IOPS=0, BW=258KiB/s (264kB/s)(2048KiB/7940msec) clat (msec): min=261, max=431, avg=346.79, stdev=120.48 lat (msec): min=261, max=431, avg=346.79, stdev=120.49 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1408, max= 2003, per=66.13%, avg=1705.50, stdev=420.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1290KiB/s (1321kB/s)(10.0MiB/7940msec); 0 zone resets clat (msec): min=120, max=3114, avg=698.38, stdev=996.61 lat (msec): min=121, max=3115, avg=700.73, stdev=995.41 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 178], | 30.00th=[ 199], 40.00th=[ 213], 50.00th=[ 234], 60.00th=[ 292], | 70.00th=[ 347], 80.00th=[ 401], 90.00th=[ 1888], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 2035, max= 6011, per=100.00%, avg=3623.00, stdev=1661.38, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=7.38%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179680: Fri Sep 11 10:48:37 2026 read: IOPS=0, BW=950KiB/s (973kB/s)(6144KiB/6466msec) clat (usec): min=648, max=214818, avg=97548.64, stdev=106886.54 lat (usec): min=649, max=214820, avg=97549.82, stdev=106886.58 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[ 1074], 50.00th=[ 1074], 60.00th=[170918], | 70.00th=[198181], 80.00th=[198181], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 2035, max= 4087, per=100.00%, avg=3403.00, stdev=1184.72, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=950KiB/s (973kB/s)(6144KiB/6466msec); 0 zone resets clat (msec): min=93, max=4465, avg=963.23, stdev=1719.12 lat (msec): min=93, max=4466, avg=963.46, stdev=1719.49 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 330], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 2043, max= 4071, per=76.14%, avg=2749.25, stdev=957.92, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=5.71%, ctx=154, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179681: Fri Sep 11 10:48:37 2026 read: IOPS=0, BW=742KiB/s (760kB/s)(5120KiB/6897msec) clat (usec): min=857, max=311041, avg=149459.88, stdev=144027.91 lat (usec): min=859, max=311042, avg=149461.23, stdev=144027.70 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[ 857], | 30.00th=[ 1123], 40.00th=[ 1123], 50.00th=[175113], 60.00th=[175113], | 70.00th=[258999], 80.00th=[258999], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2035, max= 6011, per=100.00%, avg=4023.00, stdev=2811.46, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1039KiB/s (1064kB/s)(7168KiB/6897msec); 0 zone resets clat (msec): min=74, max=4403, avg=860.03, stdev=1574.43 lat (msec): min=74, max=4405, avg=860.44, stdev=1575.08 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 97], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 230], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 584], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 2035, max= 4007, per=67.37%, avg=2432.60, stdev=880.13, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 100=16.67%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=5.02%, ctx=124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2579KiB/s (2641kB/s), 258KiB/s-1089KiB/s (264kB/s-1115kB/s), io=20.0MiB (20.0MB), run=6466-7940msec WRITE: bw=3611KiB/s (3698kB/s), 778KiB/s-1290KiB/s (796kB/s-1321kB/s), io=28.0MiB (29.4MB), run=6466-7940msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179673: Fri Sep 11 10:48:37 2026 read: IOPS=0, BW=864KiB/s (885kB/s)(7168KiB/8298msec) clat (msec): min=95, max=4546, avg=972.79, stdev=1608.14 lat (msec): min=95, max=4546, avg=972.79, stdev=1608.14 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 102], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 317], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 927], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 2035, max= 4007, per=100.00%, avg=3001.25, stdev=1108.87, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=0, BW=617KiB/s (632kB/s)(5120KiB/8298msec); 0 zone resets clat (msec): min=110, max=569, avg=254.52, stdev=188.47 lat (msec): min=110, max=569, avg=254.62, stdev=188.44 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1992, max= 6107, per=100.00%, avg=4049.50, stdev=2909.74, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.96%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179674: Fri Sep 11 10:48:37 2026 read: IOPS=0, BW=257KiB/s (263kB/s)(2048KiB/7975msec) clat (msec): min=186, max=266, avg=226.37, stdev=56.18 lat (msec): min=186, max=266, avg=226.37, stdev=56.18 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 1950, max= 2015, per=83.09%, avg=1982.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1284KiB/s (1315kB/s)(10.0MiB/7975msec); 0 zone resets clat (msec): min=117, max=3394, avg=745.67, stdev=1072.98 lat (msec): min=117, max=3394, avg=745.78, stdev=1072.98 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 176], | 30.00th=[ 245], 40.00th=[ 262], 50.00th=[ 284], 60.00th=[ 326], | 70.00th=[ 338], 80.00th=[ 372], 90.00th=[ 1938], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1950, max= 4087, per=96.68%, avg=3230.00, stdev=1137.58, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.57%, ctx=89, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179676: Fri Sep 11 10:48:37 2026 read: IOPS=0, BW=766KiB/s (784kB/s)(6144KiB/8024msec) clat (msec): min=77, max=647, avg=256.59, stdev=207.03 lat (msec): min=77, max=647, avg=256.59, stdev=207.03 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 209], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2003, max= 3984, per=100.00%, avg=3318.33, stdev=1139.14, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=766KiB/s (784kB/s)(6144KiB/8024msec); 0 zone resets clat (msec): min=178, max=4749, avg=1029.74, stdev=1824.03 lat (msec): min=178, max=4749, avg=1029.84, stdev=1824.03 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 300], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1389, max= 2043, per=56.64%, avg=1892.40, stdev=282.21, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.17%, ctx=75, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179677: Fri Sep 11 10:48:37 2026 read: IOPS=0, BW=597KiB/s (611kB/s)(5120KiB/8580msec) clat (msec): min=75, max=292, avg=191.33, stdev=91.51 lat (msec): min=75, max=292, avg=191.33, stdev=91.51 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 3968, max= 4007, per=100.00%, avg=3987.50, stdev=27.58, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=835KiB/s (855kB/s)(7168KiB/8580msec); 0 zone resets clat (msec): min=219, max=5402, avg=1059.02, stdev=1917.70 lat (msec): min=219, max=5402, avg=1059.17, stdev=1917.68 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 255], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 317], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 472], 90.00th=[ 5403], 95.00th=[ 5403], | 99.00th=[ 5403], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], | 99.99th=[ 5403] bw ( KiB/s): min= 1387, max= 4071, per=68.19%, avg=2278.20, stdev=1034.41, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=58.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.39%, ctx=99, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2387KiB/s (2444kB/s), 257KiB/s-864KiB/s (263kB/s-885kB/s), io=20.0MiB (20.0MB), run=7975-8580msec WRITE: bw=3342KiB/s (3422kB/s), 617KiB/s-1284KiB/s (632kB/s-1315kB/s), io=28.0MiB (29.4MB), run=7975-8580msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179690: Fri Sep 11 10:48:53 2026 read: IOPS=1, BW=6107KiB/s (6254kB/s)(12.0MiB/2012msec) clat (msec): min=396, max=1105, avg=647.63, stdev=397.17 lat (msec): min=396, max=1105, avg=647.63, stdev=397.17 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 6023, max= 7460, per=100.00%, avg=6741.50, stdev=1016.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.17%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179691: Fri Sep 11 10:48:53 2026 read: IOPS=0, BW=1252KiB/s (1282kB/s)(4096KiB/3272msec) clat (nsec): min=715081k, max=715081k, avg=715081206.00, stdev= 0.00 lat (nsec): min=717840k, max=717840k, avg=717840210.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7460, max= 7460, per=100.00%, avg=7460.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2504KiB/s (2564kB/s)(8192KiB/3272msec); 0 zone resets clat (msec): min=894, max=1522, avg=1208.70, stdev=444.37 lat (msec): min=894, max=1523, avg=1209.01, stdev=444.22 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8175, max= 8175, per=92.34%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.90%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Fri Sep 11 10:48:53 2026 write: IOPS=0, BW=3320KiB/s (3400kB/s)(12.0MiB/3701msec); 0 zone resets clat (msec): min=225, max=1855, avg=1147.52, stdev=835.81 lat (msec): min=225, max=1859, avg=1149.04, stdev=837.41 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8175, max= 8175, per=92.34%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.97%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179693: Fri Sep 11 10:48:53 2026 write: IOPS=1, BW=4217KiB/s (4318kB/s)(12.0MiB/2914msec); 0 zone resets clat (msec): min=478, max=1255, avg=937.40, stdev=407.46 lat (msec): min=478, max=1256, avg=938.61, stdev=407.78 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7460, max= 8031, per=87.49%, avg=7745.50, stdev=403.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.17%, sys=3.36%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5007KiB/s (5128kB/s), 1252KiB/s-6107KiB/s (1282kB/s-6254kB/s), io=16.0MiB (16.8MB), run=2012-3272msec WRITE: bw=8854KiB/s (9066kB/s), 2504KiB/s-4217KiB/s (2564kB/s-4318kB/s), io=32.0MiB (33.6MB), run=2914-3701msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179694: Fri Sep 11 10:48:54 2026 read: IOPS=1, BW=5013KiB/s (5134kB/s)(12.0MiB/2451msec) clat (msec): min=683, max=926, avg=797.47, stdev=122.04 lat (msec): min=683, max=926, avg=797.47, stdev=122.04 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8000, max= 8175, per=100.00%, avg=8087.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=12.61%, ctx=196, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179695: Fri Sep 11 10:48:54 2026 read: IOPS=0, BW=1389KiB/s (1423kB/s)(4096KiB/2948msec) clat (nsec): min=605106k, max=605106k, avg=605106382.00, stdev= 0.00 lat (nsec): min=605132k, max=605132k, avg=605131600.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2779KiB/s (2846kB/s)(8192KiB/2948msec); 0 zone resets clat (msec): min=830, max=1446, avg=1138.42, stdev=435.08 lat (msec): min=831, max=1447, avg=1139.19, stdev=435.38 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8062, max= 8062, per=90.59%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.26%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Fri Sep 11 10:48:54 2026 write: IOPS=0, BW=3337KiB/s (3417kB/s)(12.0MiB/3682msec); 0 zone resets clat (msec): min=226, max=1983, avg=1203.14, stdev=894.85 lat (msec): min=226, max=1983, avg=1203.54, stdev=894.87 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 7937, max= 8159, per=90.44%, avg=8048.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.27%, sys=2.69%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Fri Sep 11 10:48:54 2026 write: IOPS=1, BW=4653KiB/s (4764kB/s)(12.0MiB/2641msec); 0 zone resets clat (msec): min=556, max=1300, avg=858.26, stdev=391.29 lat (msec): min=556, max=1300, avg=859.52, stdev=390.80 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 6360, max= 8175, per=81.67%, avg=7267.50, stdev=1283.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.34%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5558KiB/s (5691kB/s), 1389KiB/s-5013KiB/s (1423kB/s-5134kB/s), io=16.0MiB (16.8MB), run=2451-2948msec WRITE: bw=8900KiB/s (9113kB/s), 2779KiB/s-4653KiB/s (2846kB/s-4764kB/s), io=32.0MiB (33.6MB), run=2641-3682msec