== sanity test 398b: DIO and buffer IO race ============== 13:14:39 (1788628479) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.78192 s, 6.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179222: Sat Sep 5 13:17:09 2026 read: IOPS=11, BW=47.4KiB/s (48.5kB/s)(5992KiB/126452msec) clat (usec): min=35, max=420039, avg=45306.28, stdev=31085.04 lat (usec): min=36, max=420040, avg=45310.67, stdev=31086.16 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 807], 10.00th=[ 15795], 20.00th=[ 22152], | 30.00th=[ 27395], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[ 95945], | 99.00th=[145753], 99.50th=[168821], 99.90th=[217056], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 7, max= 102, per=25.11%, avg=46.96, stdev=20.42, samples=248 iops : min= 1, max= 25, avg=11.10, stdev= 5.16, samples=248 write: IOPS=12, BW=49.8KiB/s (50.0kB/s)(6296KiB/126452msec); 0 zone resets clat (usec): min=786, max=694353, avg=36917.01, stdev=42257.19 lat (usec): min=788, max=694354, avg=36922.28, stdev=42257.01 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1172], 10.00th=[ 1270], 20.00th=[ 2900], | 30.00th=[ 7111], 40.00th=[ 17171], 50.00th=[ 25560], 60.00th=[ 35390], | 70.00th=[ 46924], 80.00th=[ 63701], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[168821], 99.50th=[193987], 99.90th=[283116], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 128, per=25.09%, avg=49.17, stdev=21.46, samples=249 iops : min= 1, max= 32, avg=11.65, stdev= 5.39, samples=249 lat (usec) : 50=0.42%, 100=1.82%, 250=0.13%, 500=0.03%, 1000=0.39% lat (msec) : 2=8.01%, 4=3.39%, 10=6.09%, 20=9.83%, 50=38.51% lat (msec) : 100=25.36%, 250=5.86%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=4.48%, ctx=6127, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179223: Sat Sep 5 13:17:09 2026 read: IOPS=11, BW=47.8KiB/s (48.9kB/s)(5940KiB/124376msec) clat (usec): min=43, max=267944, avg=46985.64, stdev=30106.29 lat (usec): min=44, max=267945, avg=46989.43, stdev=30109.08 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 12387], 10.00th=[ 18482], 20.00th=[ 24249], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 67634], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[158335], 99.50th=[177210], 99.90th=[225444], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 103, per=25.23%, avg=47.18, stdev=17.95, samples=245 iops : min= 1, max= 25, avg=11.14, stdev= 4.51, samples=245 write: IOPS=12, BW=51.0KiB/s (52.3kB/s)(6348KiB/124376msec); 0 zone resets clat (usec): min=711, max=836673, avg=34105.66, stdev=41676.76 lat (usec): min=712, max=836675, avg=34113.89, stdev=41674.84 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1188], 10.00th=[ 1336], 20.00th=[ 2966], | 30.00th=[ 6063], 40.00th=[ 13435], 50.00th=[ 23462], 60.00th=[ 32375], | 70.00th=[ 43779], 80.00th=[ 58983], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[166724], 99.50th=[202376], 99.90th=[240124], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 127, per=25.63%, avg=50.23, stdev=23.79, samples=245 iops : min= 1, max= 31, avg=11.92, stdev= 5.99, samples=245 lat (usec) : 50=0.10%, 100=1.37%, 250=0.07%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=7.62%, 4=4.20%, 10=7.03%, 20=9.31%, 50=38.96% lat (msec) : 100=25.16%, 250=5.70%, 500=0.03%, 1000=0.03% cpu : usr=0.06%, sys=4.41%, ctx=6078, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179224: Sat Sep 5 13:17:09 2026 read: IOPS=11, BW=47.9KiB/s (49.1kB/s)(6028KiB/125825msec) clat (usec): min=32, max=854704, avg=46982.45, stdev=37288.26 lat (usec): min=32, max=854705, avg=46988.67, stdev=37288.21 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11731], 10.00th=[ 16319], 20.00th=[ 22676], | 30.00th=[ 27657], 40.00th=[ 33817], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[ 99091], | 99.00th=[170918], 99.50th=[187696], 99.90th=[248513], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 111, per=25.32%, avg=47.35, stdev=20.38, samples=248 iops : min= 1, max= 27, avg=11.20, stdev= 5.15, samples=248 write: IOPS=12, BW=49.8KiB/s (50.9kB/s)(6260KiB/125825msec); 0 zone resets clat (usec): min=943, max=264676, avg=34864.56, stdev=37057.65 lat (usec): min=945, max=264678, avg=34867.56, stdev=37057.29 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 3064], | 30.00th=[ 6390], 40.00th=[ 14746], 50.00th=[ 25035], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 85459], 95.00th=[110625], | 99.00th=[162530], 99.50th=[173016], 99.90th=[244319], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 127, per=25.14%, avg=49.28, stdev=23.07, samples=247 iops : min= 1, max= 31, avg=11.69, stdev= 5.81, samples=247 lat (usec) : 50=0.29%, 100=1.46%, 250=0.16%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=7.58%, 4=4.20%, 10=6.71%, 20=9.64%, 50=37.76% lat (msec) : 100=26.46%, 250=5.47%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.54%, ctx=6194, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179225: Sat Sep 5 13:17:09 2026 read: IOPS=11, BW=47.3KiB/s (48.5kB/s)(6052KiB/127851msec) clat (usec): min=40, max=724275, avg=46210.03, stdev=35599.91 lat (usec): min=41, max=724277, avg=46213.60, stdev=35600.18 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 5997], 10.00th=[ 15926], 20.00th=[ 22414], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[143655], 99.50th=[198181], 99.90th=[287310], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 103, per=25.07%, avg=46.88, stdev=18.08, samples=251 iops : min= 1, max= 25, avg=11.08, stdev= 4.53, samples=251 write: IOPS=12, BW=48.8KiB/s (49.9kB/s)(6236KiB/127851msec); 0 zone resets clat (usec): min=675, max=308413, avg=36901.86, stdev=38494.39 lat (usec): min=676, max=308415, avg=36906.88, stdev=38497.11 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 2900], | 30.00th=[ 6718], 40.00th=[ 17171], 50.00th=[ 26608], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 64226], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[156238], 99.50th=[193987], 99.90th=[265290], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 135, per=24.53%, avg=48.07, stdev=22.34, samples=252 iops : min= 1, max= 33, avg=11.38, stdev= 5.63, samples=252 lat (usec) : 50=0.16%, 100=2.12%, 250=0.10%, 750=0.07%, 1000=0.16% lat (msec) : 2=7.81%, 4=3.91%, 10=5.57%, 20=9.44%, 50=38.18% lat (msec) : 100=26.43%, 250=5.79%, 500=0.23%, 750=0.03% cpu : usr=0.07%, sys=4.39%, ctx=6237, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (192kB/s), 47.3KiB/s-47.9KiB/s (48.5kB/s-49.1kB/s), io=23.4MiB (24.6MB), run=124376-127851msec WRITE: bw=197KiB/s (201kB/s), 48.8KiB/s-51.0KiB/s (49.9kB/s-52.3kB/s), io=24.6MiB (25.7MB), run=124376-127851msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179227: Sat Sep 5 13:17:52 2026 read: IOPS=8, BW=35.3KiB/s (36.1kB/s)(5992KiB/169735msec) clat (msec): min=5, max=872, avg=43.59, stdev=45.72 lat (msec): min=5, max=872, avg=43.60, stdev=45.72 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 94], 95.00th=[ 128], | 99.00th=[ 215], 99.50th=[ 234], 99.90th=[ 326], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 127, per=25.00%, avg=35.25, stdev=24.12, samples=328 iops : min= 1, max= 31, avg= 8.13, stdev= 6.07, samples=328 write: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6296KiB/169735msec); 0 zone resets clat (msec): min=11, max=388, avg=66.20, stdev=46.06 lat (msec): min=11, max=388, avg=66.21, stdev=46.06 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 97], 90.00th=[ 129], 95.00th=[ 150], | 99.00th=[ 234], 99.50th=[ 264], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 119, per=25.03%, avg=36.79, stdev=22.11, samples=331 iops : min= 1, max= 29, avg= 8.51, stdev= 5.56, samples=331 lat (msec) : 10=2.05%, 20=14.16%, 50=44.27%, 100=25.62%, 250=13.38% lat (msec) : 500=0.49%, 1000=0.03% cpu : usr=0.06%, sys=1.51%, ctx=4488, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179228: Sat Sep 5 13:17:52 2026 read: IOPS=8, BW=34.9KiB/s (35.7kB/s)(5940KiB/170261msec) clat (msec): min=4, max=787, avg=45.59, stdev=47.56 lat (msec): min=4, max=787, avg=45.59, stdev=47.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 100], 95.00th=[ 132], | 99.00th=[ 230], 99.50th=[ 275], 99.90th=[ 376], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 135, per=25.03%, avg=35.29, stdev=24.49, samples=325 iops : min= 1, max= 33, avg= 8.14, stdev= 6.17, samples=325 write: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6348KiB/170261msec); 0 zone resets clat (msec): min=11, max=323, avg=64.48, stdev=45.64 lat (msec): min=11, max=323, avg=64.48, stdev=45.64 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 93], 90.00th=[ 123], 95.00th=[ 157], | 99.00th=[ 226], 99.50th=[ 275], 99.90th=[ 317], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 151, per=25.21%, avg=37.05, stdev=22.59, samples=330 iops : min= 1, max= 37, avg= 8.57, stdev= 5.69, samples=330 lat (msec) : 10=2.02%, 20=14.23%, 50=44.50%, 100=25.46%, 250=13.09% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.06%, sys=1.51%, ctx=4667, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179229: Sat Sep 5 13:17:52 2026 read: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6028KiB/169225msec) clat (msec): min=5, max=377, avg=44.55, stdev=39.95 lat (msec): min=5, max=377, avg=44.55, stdev=39.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 68], 90.00th=[ 97], 95.00th=[ 128], | 99.00th=[ 184], 99.50th=[ 228], 99.90th=[ 342], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 126, per=25.36%, avg=35.76, stdev=22.73, samples=327 iops : min= 1, max= 31, avg= 8.26, stdev= 5.72, samples=327 write: IOPS=9, BW=36.0KiB/s (37.9kB/s)(6260KiB/169225msec); 0 zone resets clat (msec): min=7, max=787, avg=65.08, stdev=50.07 lat (msec): min=7, max=787, avg=65.08, stdev=50.07 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 125], 95.00th=[ 155], | 99.00th=[ 253], 99.50th=[ 288], 99.90th=[ 380], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 119, per=25.04%, avg=36.81, stdev=22.82, samples=330 iops : min= 1, max= 29, avg= 8.52, stdev= 5.74, samples=330 lat (msec) : 10=1.73%, 20=13.22%, 50=46.03%, 100=26.14%, 250=12.17% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.06%, sys=1.54%, ctx=4556, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179230: Sat Sep 5 13:17:52 2026 read: IOPS=8, BW=35.7KiB/s (36.6kB/s)(6052KiB/169373msec) clat (msec): min=4, max=354, avg=43.82, stdev=41.53 lat (msec): min=4, max=354, avg=43.82, stdev=41.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 127], | 99.00th=[ 207], 99.50th=[ 234], 99.90th=[ 347], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 125, per=25.93%, avg=36.56, stdev=23.05, samples=321 iops : min= 1, max= 31, avg= 8.47, stdev= 5.81, samples=321 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6236KiB/169373msec); 0 zone resets clat (msec): min=10, max=828, avg=66.01, stdev=49.84 lat (msec): min=10, max=828, avg=66.01, stdev=49.84 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 155], | 99.00th=[ 245], 99.50th=[ 279], 99.90th=[ 380], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 111, per=24.96%, avg=36.69, stdev=22.12, samples=329 iops : min= 1, max= 27, avg= 8.49, stdev= 5.57, samples=329 lat (msec) : 10=1.79%, 20=14.10%, 50=45.51%, 100=25.46%, 250=12.53% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.05%, sys=1.54%, ctx=4553, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=141KiB/s (144kB/s), 34.9KiB/s-35.7KiB/s (35.7kB/s-36.6kB/s), io=23.4MiB (24.6MB), run=169225-170261msec WRITE: bw=148KiB/s (151kB/s), 36.8KiB/s-37.3KiB/s (37.7kB/s-38.2kB/s), io=24.6MiB (25.7MB), run=169225-170261msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179273: Sat Sep 5 13:18:39 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(5920KiB/31719msec) clat (usec): min=41, max=199147, avg=45852.19, stdev=33360.18 lat (usec): min=41, max=199149, avg=45853.72, stdev=33359.93 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 21103], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47973], | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[137364], 99.50th=[168821], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 351, per=26.03%, avg=185.34, stdev=71.80, samples=62 iops : min= 1, max= 21, avg=10.82, stdev= 4.50, samples=62 write: IOPS=12, BW=201KiB/s (206kB/s)(6368KiB/31719msec); 0 zone resets clat (usec): min=1477, max=259072, avg=36281.74, stdev=38724.09 lat (usec): min=1479, max=259076, avg=36284.19, stdev=38724.20 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1778], 10.00th=[ 2212], 20.00th=[ 5276], | 30.00th=[ 9896], 40.00th=[ 15795], 50.00th=[ 25035], 60.00th=[ 32900], | 70.00th=[ 45876], 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[114820], | 99.00th=[160433], 99.50th=[231736], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 29, max= 414, per=26.78%, avg=200.84, stdev=86.82, samples=62 iops : min= 1, max= 25, avg=11.79, stdev= 5.47, samples=62 lat (usec) : 50=0.78%, 100=5.08%, 250=0.65% lat (msec) : 2=4.82%, 4=4.04%, 10=7.94%, 20=8.98%, 50=35.94% lat (msec) : 100=24.87%, 250=6.77%, 500=0.13% cpu : usr=0.07%, sys=5.09%, ctx=1563, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179274: Sat Sep 5 13:18:39 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(5744KiB/33428msec) clat (usec): min=38, max=278781, avg=48365.62, stdev=33250.12 lat (usec): min=38, max=278783, avg=48367.18, stdev=33250.18 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 137], 20.00th=[ 23200], | 30.00th=[ 31065], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 51119], | 70.00th=[ 61604], 80.00th=[ 71828], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[143655], 99.50th=[181404], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 62, max= 375, per=24.06%, avg=171.30, stdev=68.64, samples=66 iops : min= 3, max= 23, avg= 9.92, stdev= 4.36, samples=66 write: IOPS=12, BW=196KiB/s (200kB/s)(6544KiB/33428msec); 0 zone resets clat (usec): min=1275, max=206189, avg=39150.27, stdev=37505.12 lat (usec): min=1278, max=206192, avg=39152.53, stdev=37505.14 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1893], 10.00th=[ 3130], 20.00th=[ 6325], | 30.00th=[ 12518], 40.00th=[ 20055], 50.00th=[ 27657], 60.00th=[ 36439], | 70.00th=[ 47449], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[114820], | 99.00th=[162530], 99.50th=[168821], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 63, max= 349, per=25.94%, avg=194.55, stdev=77.72, samples=66 iops : min= 3, max= 21, avg=11.39, stdev= 4.87, samples=66 lat (usec) : 50=0.39%, 100=3.91%, 250=0.52% lat (msec) : 2=3.26%, 4=3.52%, 10=7.16%, 20=10.55%, 50=35.68% lat (msec) : 100=27.60%, 250=7.29%, 500=0.13% cpu : usr=0.07%, sys=4.83%, ctx=1607, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179275: Sat Sep 5 13:18:39 2026 read: IOPS=11, BW=189KiB/s (193kB/s)(6256KiB/33140msec) clat (usec): min=39, max=248919, avg=47967.44, stdev=33700.14 lat (usec): min=39, max=248921, avg=47968.86, stdev=33700.16 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 82], 20.00th=[ 23725], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 59507], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[105382], | 99.00th=[168821], 99.50th=[198181], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 29, max= 379, per=26.50%, avg=188.71, stdev=73.89, samples=65 iops : min= 1, max= 23, avg=11.02, stdev= 4.65, samples=65 write: IOPS=11, BW=182KiB/s (186kB/s)(6032KiB/33140msec); 0 zone resets clat (usec): min=1309, max=191852, avg=37459.25, stdev=35273.62 lat (usec): min=1312, max=191854, avg=37471.60, stdev=35280.06 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1811], 10.00th=[ 2343], 20.00th=[ 4948], | 30.00th=[ 11207], 40.00th=[ 17433], 50.00th=[ 28705], 60.00th=[ 39060], | 70.00th=[ 49546], 80.00th=[ 65274], 90.00th=[ 89654], 95.00th=[102237], | 99.00th=[158335], 99.50th=[168821], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 383, per=23.84%, avg=178.77, stdev=88.92, samples=65 iops : min= 1, max= 23, avg=10.40, stdev= 5.62, samples=65 lat (usec) : 50=0.39%, 100=4.95%, 250=0.13%, 500=0.39% lat (msec) : 2=4.30%, 4=4.04%, 10=5.86%, 20=8.46%, 50=36.59% lat (msec) : 100=28.78%, 250=6.12% cpu : usr=0.07%, sys=4.70%, ctx=1579, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179276: Sat Sep 5 13:18:39 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(6032KiB/33600msec) clat (usec): min=39, max=268774, avg=49078.65, stdev=39766.40 lat (usec): min=39, max=268776, avg=49080.60, stdev=39767.86 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 18482], | 30.00th=[ 28443], 40.00th=[ 35914], 50.00th=[ 44303], 60.00th=[ 51643], | 70.00th=[ 61604], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[119014], | 99.00th=[183501], 99.50th=[258999], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 61, max= 444, per=25.14%, avg=179.03, stdev=78.41, samples=65 iops : min= 3, max= 27, avg=10.40, stdev= 4.93, samples=65 write: IOPS=11, BW=186KiB/s (191kB/s)(6256KiB/33600msec); 0 zone resets clat (usec): min=1162, max=240078, avg=37620.51, stdev=40522.73 lat (usec): min=1163, max=240081, avg=37665.21, stdev=40494.00 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1745], 10.00th=[ 2040], 20.00th=[ 4752], | 30.00th=[ 8848], 40.00th=[ 15533], 50.00th=[ 25297], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 63177], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[204473], 99.50th=[217056], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 30, max= 412, per=24.38%, avg=182.86, stdev=88.39, samples=66 iops : min= 1, max= 25, avg=10.65, stdev= 5.57, samples=66 lat (usec) : 50=0.78%, 100=5.47%, 250=0.65%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.08%, 4=4.17%, 10=7.03%, 20=9.77%, 50=32.55% lat (msec) : 100=25.26%, 250=8.72%, 500=0.26% cpu : usr=0.06%, sys=4.49%, ctx=1556, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=713KiB/s (730kB/s), 172KiB/s-189KiB/s (176kB/s-193kB/s), io=23.4MiB (24.5MB), run=31719-33600msec WRITE: bw=750KiB/s (768kB/s), 182KiB/s-201KiB/s (186kB/s-206kB/s), io=24.6MiB (25.8MB), run=31719-33600msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179277: Sat Sep 5 13:18:50 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5920KiB/44793msec) clat (msec): min=7, max=329, avg=47.79, stdev=41.98 lat (msec): min=7, max=329, avg=47.79, stdev=41.98 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 69], 90.00th=[ 100], 95.00th=[ 127], | 99.00th=[ 215], 99.50th=[ 271], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 444, per=24.93%, avg=132.38, stdev=94.37, samples=87 iops : min= 1, max= 27, avg= 7.43, stdev= 5.90, samples=87 write: IOPS=8, BW=142KiB/s (146kB/s)(6368KiB/44793msec); 0 zone resets clat (msec): min=16, max=291, avg=67.46, stdev=47.52 lat (msec): min=16, max=291, avg=67.46, stdev=47.52 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 94], 90.00th=[ 133], 95.00th=[ 171], | 99.00th=[ 264], 99.50th=[ 275], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 447, per=25.56%, avg=142.90, stdev=90.62, samples=87 iops : min= 1, max= 27, avg= 8.09, stdev= 5.68, samples=87 lat (msec) : 10=1.43%, 20=13.02%, 50=41.93%, 100=29.56%, 250=13.28% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.59%, ctx=1121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179278: Sat Sep 5 13:18:50 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(5744KiB/45042msec) clat (msec): min=6, max=327, avg=46.64, stdev=42.91 lat (msec): min=6, max=327, avg=46.65, stdev=42.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 201], 99.50th=[ 207], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 474, per=25.37%, avg=134.72, stdev=92.17, samples=82 iops : min= 1, max= 29, avg= 7.57, stdev= 5.78, samples=82 write: IOPS=9, BW=145KiB/s (149kB/s)(6544KiB/45042msec); 0 zone resets clat (msec): min=15, max=365, avg=68.52, stdev=49.17 lat (msec): min=15, max=365, avg=68.52, stdev=49.17 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 106], 90.00th=[ 132], 95.00th=[ 165], | 99.00th=[ 239], 99.50th=[ 259], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 30, max= 574, per=25.77%, avg=144.05, stdev=99.85, samples=87 iops : min= 1, max= 35, avg= 8.16, stdev= 6.27, samples=87 lat (msec) : 10=2.34%, 20=13.28%, 50=44.01%, 100=23.70%, 250=16.15% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.51%, ctx=1137, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179279: Sat Sep 5 13:18:50 2026 read: IOPS=8, BW=141KiB/s (145kB/s)(6256KiB/44238msec) clat (msec): min=6, max=391, avg=46.50, stdev=45.63 lat (msec): min=6, max=391, avg=46.50, stdev=45.63 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 67], 90.00th=[ 101], 95.00th=[ 136], | 99.00th=[ 268], 99.50th=[ 275], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 510, per=26.95%, avg=143.09, stdev=104.90, samples=86 iops : min= 1, max= 31, avg= 8.10, stdev= 6.57, samples=86 write: IOPS=8, BW=136KiB/s (140kB/s)(6032KiB/44238msec); 0 zone resets clat (msec): min=13, max=277, avg=68.71, stdev=42.81 lat (msec): min=13, max=277, avg=68.72, stdev=42.81 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 69], | 70.00th=[ 85], 80.00th=[ 101], 90.00th=[ 133], 95.00th=[ 155], | 99.00th=[ 203], 99.50th=[ 239], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 442, per=24.71%, avg=138.15, stdev=83.53, samples=85 iops : min= 1, max= 27, avg= 7.79, stdev= 5.26, samples=85 lat (msec) : 10=1.82%, 20=13.67%, 50=42.71%, 100=26.56%, 250=14.58% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.52%, ctx=1180, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179280: Sat Sep 5 13:18:50 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6032KiB/44462msec) clat (msec): min=7, max=321, avg=47.35, stdev=43.27 lat (msec): min=7, max=321, avg=47.35, stdev=43.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 101], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 255], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 606, per=26.42%, avg=140.29, stdev=100.68, samples=83 iops : min= 1, max= 37, avg= 7.93, stdev= 6.31, samples=83 write: IOPS=8, BW=141KiB/s (144kB/s)(6256KiB/44462msec); 0 zone resets clat (msec): min=11, max=361, avg=67.25, stdev=49.73 lat (msec): min=11, max=361, avg=67.26, stdev=49.73 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 78], 80.00th=[ 94], 90.00th=[ 131], 95.00th=[ 163], | 99.00th=[ 279], 99.50th=[ 347], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 412, per=24.80%, avg=138.64, stdev=87.57, samples=87 iops : min= 1, max= 25, avg= 7.82, stdev= 5.49, samples=87 lat (msec) : 10=1.43%, 20=13.15%, 50=43.10%, 100=28.26%, 250=13.15% lat (msec) : 500=0.91% cpu : usr=0.07%, sys=1.63%, ctx=1223, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=532KiB/s (545kB/s), 128KiB/s-141KiB/s (131kB/s-145kB/s), io=23.4MiB (24.5MB), run=44238-45042msec WRITE: bw=559KiB/s (573kB/s), 136KiB/s-145KiB/s (140kB/s-149kB/s), io=24.6MiB (25.8MB), run=44238-45042msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179292: Sat Sep 5 13:19:09 2026 read: IOPS=1, BW=1291KiB/s (1322kB/s)(7168KiB/5554msec) clat (usec): min=836, max=2714.1k, avg=546833.84, stdev=964908.59 lat (usec): min=837, max=2714.1k, avg=546835.33, stdev=964908.52 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 840], 10.00th=[ 840], | 20.00th=[ 130548], 30.00th=[ 132645], 40.00th=[ 132645], | 50.00th=[ 185598], 60.00th=[ 223347], 70.00th=[ 223347], | 80.00th=[ 442500], 90.00th=[2701132], 95.00th=[2701132], | 99.00th=[2701132], 99.50th=[2701132], 99.90th=[2701132], | 99.95th=[2701132], 99.99th=[2701132] bw ( KiB/s): min= 1378, max= 4047, per=94.85%, avg=2704.25, stdev=1215.99, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=922KiB/s (944kB/s)(5120KiB/5554msec); 0 zone resets clat (msec): min=103, max=676, avg=328.66, stdev=242.41 lat (msec): min=103, max=676, avg=331.01, stdev=243.28 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2023, max= 5446, per=93.55%, avg=3734.50, stdev=2420.43, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.31%, ctx=646, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179293: Sat Sep 5 13:19:09 2026 read: IOPS=0, BW=285KiB/s (292kB/s)(2048KiB/7182msec) clat (msec): min=84, max=323, avg=204.05, stdev=168.58 lat (msec): min=84, max=323, avg=204.05, stdev=168.57 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 85], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1452, max= 1992, per=60.40%, avg=1722.00, stdev=381.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1426KiB/s (1460kB/s)(10.0MiB/7182msec); 0 zone resets clat (msec): min=105, max=3176, avg=668.14, stdev=924.66 lat (msec): min=105, max=3176, avg=668.77, stdev=924.43 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 234], | 30.00th=[ 239], 40.00th=[ 253], 50.00th=[ 288], 60.00th=[ 326], | 70.00th=[ 418], 80.00th=[ 542], 90.00th=[ 1116], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1992, max= 4079, per=71.62%, avg=2859.17, stdev=938.03, samples=6 iops : min= 1, max= 3, avg= 2.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=7.76%, ctx=167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179294: Sat Sep 5 13:19:09 2026 read: IOPS=0, BW=979KiB/s (1003kB/s)(6144KiB/6273msec) clat (usec): min=345, max=725308, avg=162510.34, stdev=286529.14 lat (usec): min=345, max=725310, avg=162511.61, stdev=286529.31 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1123], 50.00th=[ 1123], 60.00th=[ 45876], | 70.00th=[202376], 80.00th=[202376], 90.00th=[725615], 95.00th=[725615], | 99.00th=[725615], 99.50th=[725615], 99.90th=[725615], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 3631, max= 6144, per=100.00%, avg=4887.50, stdev=1776.96, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=0, BW=979KiB/s (1003kB/s)(6144KiB/6273msec); 0 zone resets clat (msec): min=183, max=3114, avg=872.57, stdev=1124.92 lat (msec): min=183, max=3115, avg=872.64, stdev=1124.93 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 472], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1530, max= 2048, per=47.45%, avg=1894.20, stdev=226.13, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=16.67%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.22%, ctx=123, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179295: Sat Sep 5 13:19:09 2026 read: IOPS=0, BW=923KiB/s (945kB/s)(5120KiB/5546msec) clat (usec): min=437, max=150658, avg=52793.10, stdev=71236.46 lat (usec): min=437, max=150659, avg=52794.21, stdev=71236.53 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 437], 10.00th=[ 437], 20.00th=[ 437], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 5014], 60.00th=[ 5014], | 70.00th=[107480], 80.00th=[107480], 90.00th=[149947], 95.00th=[149947], | 99.00th=[149947], 99.50th=[149947], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 7262, max= 7262, per=100.00%, avg=7262.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1292KiB/s (1323kB/s)(7168KiB/5546msec); 0 zone resets clat (msec): min=161, max=2733, avg=741.63, stdev=890.30 lat (msec): min=162, max=2733, avg=741.72, stdev=890.30 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 300], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 481], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 584], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1460, max= 5036, per=65.90%, avg=2630.75, stdev=1624.68, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.62%, ctx=139, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2852KiB/s (2920kB/s), 285KiB/s-1291KiB/s (292kB/s-1322kB/s), io=20.0MiB (20.0MB), run=5546-7182msec WRITE: bw=3992KiB/s (4088kB/s), 922KiB/s-1426KiB/s (944kB/s-1460kB/s), io=28.0MiB (29.4MB), run=5546-7182msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179297: Sat Sep 5 13:19:10 2026 read: IOPS=0, BW=945KiB/s (967kB/s)(7168KiB/7587msec) clat (msec): min=76, max=2583, avg=894.76, stdev=973.98 lat (msec): min=76, max=2583, avg=894.76, stdev=973.98 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 140], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 558], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 1871], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 2000, max= 4071, per=96.73%, avg=2533.25, stdev=1025.27, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=675KiB/s (691kB/s)(5120KiB/7587msec); 0 zone resets clat (msec): min=103, max=461, avg=261.36, stdev=142.39 lat (msec): min=103, max=461, avg=261.47, stdev=142.39 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2035, max= 3923, per=81.26%, avg=2979.00, stdev=1335.02, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.17%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179298: Sat Sep 5 13:19:10 2026 read: IOPS=0, BW=267KiB/s (273kB/s)(2048KiB/7670msec) clat (msec): min=131, max=531, avg=331.30, stdev=282.86 lat (msec): min=131, max=531, avg=331.30, stdev=282.86 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2023, max= 2035, per=77.47%, avg=2029.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1335KiB/s (1367kB/s)(10.0MiB/7670msec); 0 zone resets clat (msec): min=136, max=3427, avg=690.43, stdev=1000.36 lat (msec): min=136, max=3427, avg=690.53, stdev=1000.37 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 205], | 30.00th=[ 207], 40.00th=[ 215], 50.00th=[ 230], 60.00th=[ 347], | 70.00th=[ 393], 80.00th=[ 751], 90.00th=[ 995], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 2023, max= 5885, per=87.56%, avg=3209.80, stdev=1736.89, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=2.88%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179299: Sat Sep 5 13:19:10 2026 read: IOPS=0, BW=915KiB/s (937kB/s)(6144KiB/6715msec) clat (msec): min=110, max=498, avg=290.05, stdev=173.55 lat (msec): min=110, max=498, avg=290.05, stdev=173.55 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 401], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2000, max= 4079, per=96.84%, avg=2536.25, stdev=1028.62, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=915KiB/s (937kB/s)(6144KiB/6715msec); 0 zone resets clat (msec): min=74, max=3439, avg=828.05, stdev=1297.80 lat (msec): min=74, max=3439, avg=828.16, stdev=1297.81 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 338], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 2000, max= 4047, per=68.99%, avg=2529.25, stdev=1011.97, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.10%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179300: Sat Sep 5 13:19:10 2026 read: IOPS=0, BW=655KiB/s (671kB/s)(5120KiB/7819msec) clat (msec): min=70, max=707, avg=379.26, stdev=247.57 lat (msec): min=70, max=707, avg=379.27, stdev=247.57 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1961, max= 2039, per=77.03%, avg=2017.50, stdev=37.71, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=917KiB/s (939kB/s)(7168KiB/7819msec); 0 zone resets clat (msec): min=130, max=3325, avg=827.06, stdev=1137.18 lat (msec): min=130, max=3325, avg=827.33, stdev=1137.16 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 192], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 300], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 902], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 2023, max= 4055, per=66.38%, avg=2433.40, stdev=906.52, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.56%, ctx=94, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2619KiB/s (2682kB/s), 267KiB/s-945KiB/s (273kB/s-967kB/s), io=20.0MiB (20.0MB), run=6715-7819msec WRITE: bw=3667KiB/s (3755kB/s), 675KiB/s-1335KiB/s (691kB/s-1367kB/s), io=28.0MiB (29.4MB), run=6715-7819msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179312: Sat Sep 5 13:19:26 2026 read: IOPS=1, BW=5606KiB/s (5740kB/s)(12.0MiB/2192msec) clat (msec): min=538, max=1005, avg=711.99, stdev=255.47 lat (msec): min=538, max=1005, avg=712.00, stdev=255.47 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7816, max= 8143, per=100.00%, avg=7979.50, stdev=231.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.58%, ctx=195, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179314: Sat Sep 5 13:19:26 2026 read: IOPS=0, BW=1465KiB/s (1500kB/s)(4096KiB/2796msec) clat (nsec): min=721806k, max=721806k, avg=721806428.00, stdev= 0.00 lat (nsec): min=721809k, max=721809k, avg=721808619.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2930KiB/s (3000kB/s)(8192KiB/2796msec); 0 zone resets clat (msec): min=384, max=1617, avg=1001.01, stdev=871.49 lat (msec): min=385, max=1617, avg=1001.42, stdev=871.43 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8126, max= 8126, per=87.20%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=7.33%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179315: Sat Sep 5 13:19:26 2026 write: IOPS=0, BW=3788KiB/s (3879kB/s)(12.0MiB/3244msec); 0 zone resets clat (msec): min=396, max=1706, avg=1058.88, stdev=655.10 lat (msec): min=396, max=1706, avg=1059.29, stdev=655.15 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8126, max= 8143, per=87.29%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.37%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179316: Sat Sep 5 13:19:26 2026 write: IOPS=0, BW=3495KiB/s (3579kB/s)(12.0MiB/3516msec); 0 zone resets clat (msec): min=334, max=2426, avg=1159.39, stdev=1113.70 lat (msec): min=334, max=2426, avg=1160.67, stdev=1113.24 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8031, max= 8031, per=86.18%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.19%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5860KiB/s (6000kB/s), 1465KiB/s-5606KiB/s (1500kB/s-5740kB/s), io=16.0MiB (16.8MB), run=2192-2796msec WRITE: bw=9320KiB/s (9543kB/s), 2930KiB/s-3788KiB/s (3000kB/s-3879kB/s), io=32.0MiB (33.6MB), run=2796-3516msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179309: Sat Sep 5 13:19:26 2026 read: IOPS=1, BW=4713KiB/s (4827kB/s)(12.0MiB/2607msec) clat (msec): min=317, max=1364, avg=849.78, stdev=523.64 lat (msec): min=317, max=1364, avg=849.78, stdev=523.64 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=3.18%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179310: Sat Sep 5 13:19:26 2026 read: IOPS=0, BW=1261KiB/s (1292kB/s)(4096KiB/3247msec) clat (nsec): min=1273.3M, max=1273.3M, avg=1273322428.00, stdev= 0.00 lat (nsec): min=1273.3M, max=1273.3M, avg=1273324734.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7801, max= 7801, per=100.00%, avg=7801.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2523KiB/s (2583kB/s)(8192KiB/3247msec); 0 zone resets clat (msec): min=502, max=1372, avg=937.72, stdev=614.99 lat (msec): min=503, max=1374, avg=938.75, stdev=615.73 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8175, max= 8175, per=81.01%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.71%, ctx=36, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179311: Sat Sep 5 13:19:26 2026 write: IOPS=1, BW=7341KiB/s (7517kB/s)(12.0MiB/1674msec); 0 zone resets clat (msec): min=301, max=652, avg=528.72, stdev=196.66 lat (msec): min=302, max=652, avg=529.22, stdev=196.76 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8143, max= 8143, per=80.70%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=4.78%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179313: Sat Sep 5 13:19:26 2026 write: IOPS=1, BW=5785KiB/s (5924kB/s)(12.0MiB/2124msec); 0 zone resets clat (msec): min=347, max=1335, avg=687.69, stdev=561.41 lat (msec): min=348, max=1336, avg=688.38, stdev=561.19 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7968, max= 8110, per=79.67%, avg=8039.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.14%, sys=4.95%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5046KiB/s (5167kB/s), 1261KiB/s-4713KiB/s (1292kB/s-4827kB/s), io=16.0MiB (16.8MB), run=2607-3247msec WRITE: bw=9.85MiB/s (10.3MB/s), 2523KiB/s-7341KiB/s (2583kB/s-7517kB/s), io=32.0MiB (33.6MB), run=1674-3247msec