== sanity test 398b: DIO and buffer IO race ============== 02:18:51 (1788848331) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.15403 s, 9.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180006: Tue Sep 8 02:21:22 2026 read: IOPS=11, BW=47.0KiB/s (48.2kB/s)(5992KiB/127380msec) clat (usec): min=35, max=267715, avg=46458.16, stdev=29206.99 lat (usec): min=36, max=267775, avg=46459.34, stdev=29207.28 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 11994], 10.00th=[ 17171], 20.00th=[ 23462], | 30.00th=[ 29230], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 66323], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[145753], 99.50th=[156238], 99.90th=[198181], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 134, per=25.78%, avg=46.67, stdev=17.25, samples=250 iops : min= 1, max= 33, avg=10.99, stdev= 4.34, samples=250 write: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6296KiB/127380msec); 0 zone resets clat (usec): min=974, max=928977, avg=36471.35, stdev=45087.58 lat (usec): min=974, max=928978, avg=36473.03, stdev=45087.45 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 3163], | 30.00th=[ 6783], 40.00th=[ 14484], 50.00th=[ 25035], 60.00th=[ 33817], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[177210], 99.50th=[206570], 99.90th=[283116], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 111, per=26.13%, avg=49.39, stdev=20.87, samples=248 iops : min= 1, max= 27, avg=11.67, stdev= 5.26, samples=248 lat (usec) : 50=0.39%, 100=1.53%, 250=0.13%, 1000=0.10% lat (msec) : 2=7.75%, 4=4.20%, 10=6.05%, 20=9.83%, 50=37.14% lat (msec) : 100=26.82%, 250=5.92%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=4.28%, ctx=6192, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180007: Tue Sep 8 02:21:22 2026 read: IOPS=11, BW=45.6KiB/s (46.7kB/s)(5940KiB/130132msec) clat (usec): min=33, max=1035.1k, avg=48281.33, stdev=40589.21 lat (usec): min=33, max=1035.1k, avg=48282.48, stdev=40589.23 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12780], 10.00th=[ 18482], | 20.00th=[ 23725], 30.00th=[ 29230], 40.00th=[ 34866], | 50.00th=[ 40633], 60.00th=[ 47973], 70.00th=[ 56886], | 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[ 102237], | 99.00th=[ 177210], 99.50th=[ 196084], 99.90th=[ 341836], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 111, per=25.11%, avg=45.45, stdev=18.26, samples=255 iops : min= 1, max= 27, avg=10.68, stdev= 4.60, samples=255 write: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6348KiB/130132msec); 0 zone resets clat (usec): min=978, max=324891, avg=36527.97, stdev=38185.90 lat (usec): min=978, max=324893, avg=36529.42, stdev=38185.90 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1352], 20.00th=[ 3163], | 30.00th=[ 6783], 40.00th=[ 17171], 50.00th=[ 26346], 60.00th=[ 36439], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[117965], | 99.00th=[160433], 99.50th=[177210], 99.90th=[212861], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 173, per=25.84%, avg=48.84, stdev=23.52, samples=254 iops : min= 1, max= 43, avg=11.54, stdev= 5.91, samples=254 lat (usec) : 50=0.36%, 100=1.40%, 250=0.03%, 750=0.03%, 1000=0.03% lat (msec) : 2=7.06%, 4=4.88%, 10=6.05%, 20=8.20%, 50=39.42% lat (msec) : 100=25.91%, 250=6.51%, 500=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.13%, ctx=6328, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180008: Tue Sep 8 02:21:22 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6028KiB/132354msec) clat (usec): min=36, max=232447, avg=47192.09, stdev=31123.64 lat (usec): min=37, max=232449, avg=47194.98, stdev=31122.75 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10028], 10.00th=[ 16909], 20.00th=[ 23462], | 30.00th=[ 28967], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[101188], | 99.00th=[156238], 99.50th=[183501], 99.90th=[227541], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 119, per=25.27%, avg=45.74, stdev=19.71, samples=257 iops : min= 1, max= 29, avg=10.76, stdev= 4.96, samples=257 write: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6260KiB/132354msec); 0 zone resets clat (usec): min=878, max=1052.3k, avg=38866.37, stdev=46938.27 lat (usec): min=879, max=1052.3k, avg=38867.92, stdev=46938.27 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1434], | 20.00th=[ 3818], 30.00th=[ 8225], 40.00th=[ 18220], | 50.00th=[ 28181], 60.00th=[ 37487], 70.00th=[ 49021], | 80.00th=[ 64750], 90.00th=[ 92799], 95.00th=[ 111674], | 99.00th=[ 181404], 99.50th=[ 196084], 99.90th=[ 235930], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 127, per=24.89%, avg=47.05, stdev=19.57, samples=259 iops : min= 1, max= 31, avg=11.09, stdev= 4.93, samples=259 lat (usec) : 50=0.23%, 100=1.89%, 250=0.07%, 1000=0.13% lat (msec) : 2=6.45%, 4=4.00%, 10=6.32%, 20=8.92%, 50=38.70% lat (msec) : 100=26.79%, 250=6.48%, 2000=0.03% cpu : usr=0.07%, sys=4.13%, ctx=6173, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180009: Tue Sep 8 02:21:22 2026 read: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6052KiB/127092msec) clat (usec): min=39, max=1045.0k, avg=47124.34, stdev=40809.85 lat (usec): min=40, max=1045.0k, avg=47126.36, stdev=40809.41 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 7439], 10.00th=[ 16909], | 20.00th=[ 23462], 30.00th=[ 28705], 40.00th=[ 33817], | 50.00th=[ 39584], 60.00th=[ 46400], 70.00th=[ 55837], | 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[ 103285], | 99.00th=[ 152044], 99.50th=[ 193987], 99.90th=[ 362808], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 7, max= 109, per=26.32%, avg=47.64, stdev=18.34, samples=248 iops : min= 1, max= 27, avg=11.24, stdev= 4.62, samples=248 write: IOPS=12, BW=49.1KiB/s (50.2kB/s)(6236KiB/127092msec); 0 zone resets clat (usec): min=893, max=288171, avg=35507.48, stdev=38014.71 lat (usec): min=894, max=288173, avg=35508.94, stdev=38014.78 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1434], 20.00th=[ 3851], | 30.00th=[ 6783], 40.00th=[ 14484], 50.00th=[ 25297], 60.00th=[ 35914], | 70.00th=[ 46400], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[108528], | 99.00th=[164627], 99.50th=[191890], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 119, per=26.00%, avg=49.15, stdev=20.63, samples=248 iops : min= 1, max= 29, avg=11.61, stdev= 5.18, samples=248 lat (usec) : 50=0.16%, 100=2.15%, 250=0.03%, 750=0.03%, 1000=0.10% lat (msec) : 2=6.51%, 4=3.87%, 10=8.07%, 20=8.56%, 50=39.39% lat (msec) : 100=25.16%, 250=5.76%, 500=0.16%, 2000=0.03% cpu : usr=0.07%, sys=4.40%, ctx=6257, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (186kB/s), 45.5KiB/s-47.6KiB/s (46.6kB/s-48.8kB/s), io=23.4MiB (24.6MB), run=127092-132354msec WRITE: bw=190KiB/s (195kB/s), 47.3KiB/s-49.4KiB/s (48.4kB/s-50.6kB/s), io=24.6MiB (25.7MB), run=127092-132354msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180002: Tue Sep 8 02:22:03 2026 read: IOPS=8, BW=34.8KiB/s (35.6kB/s)(5992KiB/172325msec) clat (msec): min=5, max=1093, avg=44.47, stdev=50.57 lat (msec): min=5, max=1093, avg=44.47, stdev=50.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 99], 95.00th=[ 131], | 99.00th=[ 222], 99.50th=[ 253], 99.90th=[ 447], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 151, per=25.79%, avg=35.59, stdev=24.73, samples=327 iops : min= 1, max= 37, avg= 8.20, stdev= 6.23, samples=327 write: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6296KiB/172325msec); 0 zone resets clat (msec): min=12, max=417, avg=66.90, stdev=46.98 lat (msec): min=12, max=417, avg=66.91, stdev=46.98 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 100], 90.00th=[ 131], 95.00th=[ 161], | 99.00th=[ 243], 99.50th=[ 266], 99.90th=[ 334], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 120, per=25.14%, avg=36.45, stdev=22.78, samples=335 iops : min= 1, max= 30, avg= 8.42, stdev= 5.75, samples=335 lat (msec) : 10=2.02%, 20=14.26%, 50=44.73%, 100=24.58%, 250=13.74% lat (msec) : 500=0.65%, 2000=0.03% cpu : usr=0.06%, sys=1.58%, ctx=4694, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180003: Tue Sep 8 02:22:03 2026 read: IOPS=8, BW=34.7KiB/s (35.5kB/s)(5940KiB/171333msec) clat (msec): min=4, max=1016, avg=42.34, stdev=47.86 lat (msec): min=4, max=1016, avg=42.34, stdev=47.86 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 85], 95.00th=[ 122], | 99.00th=[ 215], 99.50th=[ 264], 99.90th=[ 435], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 127, per=25.56%, avg=35.27, stdev=25.39, samples=327 iops : min= 1, max= 31, avg= 8.12, stdev= 6.38, samples=327 write: IOPS=9, BW=37.0KiB/s (37.9kB/s)(6348KiB/171333msec); 0 zone resets clat (msec): min=9, max=379, avg=68.07, stdev=46.71 lat (msec): min=9, max=379, avg=68.07, stdev=46.71 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 101], 90.00th=[ 134], 95.00th=[ 163], | 99.00th=[ 226], 99.50th=[ 264], 99.90th=[ 363], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 103, per=25.71%, avg=37.28, stdev=21.79, samples=331 iops : min= 1, max= 25, avg= 8.62, stdev= 5.50, samples=331 lat (msec) : 10=2.44%, 20=13.61%, 50=44.73%, 100=25.42%, 250=13.22% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.04%, sys=1.47%, ctx=4595, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180004: Tue Sep 8 02:22:03 2026 read: IOPS=8, BW=34.8KiB/s (35.7kB/s)(6028KiB/173041msec) clat (msec): min=6, max=324, avg=45.38, stdev=42.43 lat (msec): min=6, max=324, avg=45.38, stdev=42.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 134], | 99.00th=[ 211], 99.50th=[ 232], 99.90th=[ 300], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 136, per=25.35%, avg=34.99, stdev=23.58, samples=333 iops : min= 1, max= 34, avg= 8.05, stdev= 5.94, samples=333 write: IOPS=9, BW=36.2KiB/s (37.0kB/s)(6260KiB/173041msec); 0 zone resets clat (msec): min=11, max=1019, avg=66.60, stdev=52.27 lat (msec): min=11, max=1019, avg=66.61, stdev=52.27 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 96], 90.00th=[ 126], 95.00th=[ 161], | 99.00th=[ 234], 99.50th=[ 284], 99.90th=[ 397], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 119, per=24.88%, avg=36.08, stdev=22.60, samples=335 iops : min= 1, max= 29, avg= 8.32, stdev= 5.70, samples=335 lat (msec) : 10=1.66%, 20=14.13%, 50=44.89%, 100=24.84%, 250=13.90% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.04%, sys=1.45%, ctx=4517, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180005: Tue Sep 8 02:22:03 2026 read: IOPS=8, BW=35.3KiB/s (36.2kB/s)(6052KiB/171415msec) clat (msec): min=5, max=406, avg=43.05, stdev=39.33 lat (msec): min=5, max=406, avg=43.05, stdev=39.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 93], 95.00th=[ 128], | 99.00th=[ 180], 99.50th=[ 226], 99.90th=[ 313], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 142, per=26.61%, avg=36.72, stdev=24.36, samples=320 iops : min= 1, max= 35, avg= 8.49, stdev= 6.13, samples=320 write: IOPS=9, BW=36.4KiB/s (37.3kB/s)(6236KiB/171415msec); 0 zone resets clat (msec): min=10, max=1003, avg=67.91, stdev=52.68 lat (msec): min=10, max=1003, avg=67.91, stdev=52.68 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 100], 90.00th=[ 132], 95.00th=[ 159], | 99.00th=[ 234], 99.50th=[ 271], 99.90th=[ 426], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 103, per=25.03%, avg=36.29, stdev=22.27, samples=333 iops : min= 1, max= 25, avg= 8.38, stdev= 5.62, samples=333 lat (msec) : 10=2.18%, 20=13.74%, 50=44.56%, 100=25.42%, 250=13.67% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.05%, sys=1.46%, ctx=4527, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=139KiB/s (142kB/s), 34.7KiB/s-35.3KiB/s (35.5kB/s-36.2kB/s), io=23.4MiB (24.6MB), run=171333-173041msec WRITE: bw=145KiB/s (149kB/s), 36.2KiB/s-37.0KiB/s (37.0kB/s-37.9kB/s), io=24.6MiB (25.7MB), run=171333-173041msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180060: Tue Sep 8 02:22:53 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(5920KiB/37985msec) clat (usec): min=50, max=308065, avg=54596.56, stdev=48058.52 lat (usec): min=51, max=308067, avg=54598.20, stdev=48058.39 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 14746], 20.00th=[ 23462], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 58983], 80.00th=[ 77071], 90.00th=[114820], 95.00th=[156238], | 99.00th=[261096], 99.50th=[287310], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 380, per=25.23%, avg=154.91, stdev=80.29, samples=74 iops : min= 1, max= 23, avg= 8.88, stdev= 5.01, samples=74 write: IOPS=10, BW=168KiB/s (172kB/s)(6368KiB/37985msec); 0 zone resets clat (usec): min=1422, max=322878, avg=44599.95, stdev=45808.32 lat (usec): min=1424, max=322880, avg=44601.91, stdev=45808.30 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2073], 10.00th=[ 2900], 20.00th=[ 7373], | 30.00th=[ 13960], 40.00th=[ 22414], 50.00th=[ 32113], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 76022], 90.00th=[103285], 95.00th=[135267], | 99.00th=[210764], 99.50th=[261096], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 30, max= 506, per=25.91%, avg=167.38, stdev=98.62, samples=74 iops : min= 1, max= 31, avg= 9.68, stdev= 6.19, samples=74 lat (usec) : 100=3.12%, 250=0.39%, 500=0.13%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.60%, 4=4.30%, 10=5.60%, 20=10.81%, 50=37.37% lat (msec) : 100=23.83%, 250=10.81%, 500=0.78% cpu : usr=0.05%, sys=4.30%, ctx=1691, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180061: Tue Sep 8 02:22:53 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(5744KiB/37683msec) clat (usec): min=41, max=385478, avg=55504.84, stdev=44026.71 lat (usec): min=41, max=385479, avg=55506.40, stdev=44026.63 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 16188], 20.00th=[ 25035], | 30.00th=[ 32113], 40.00th=[ 39584], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 65799], 80.00th=[ 84411], 90.00th=[108528], 95.00th=[137364], | 99.00th=[212861], 99.50th=[295699], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 30, max= 351, per=25.17%, avg=154.57, stdev=84.57, samples=72 iops : min= 1, max= 21, avg= 8.86, stdev= 5.28, samples=72 write: IOPS=10, BW=174KiB/s (178kB/s)(6544KiB/37683msec); 0 zone resets clat (usec): min=1270, max=336899, avg=43283.15, stdev=50598.20 lat (usec): min=1272, max=336902, avg=43293.02, stdev=50632.08 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1762], 10.00th=[ 2802], 20.00th=[ 5932], | 30.00th=[ 9634], 40.00th=[ 16450], 50.00th=[ 27132], 60.00th=[ 35390], | 70.00th=[ 50070], 80.00th=[ 71828], 90.00th=[112722], 95.00th=[143655], | 99.00th=[219153], 99.50th=[274727], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 27, max= 414, per=26.77%, avg=172.96, stdev=98.06, samples=73 iops : min= 1, max= 25, avg=10.01, stdev= 6.14, samples=73 lat (usec) : 50=0.39%, 100=3.39%, 250=0.13%, 500=0.13% lat (msec) : 2=3.91%, 4=3.65%, 10=9.38%, 20=8.98%, 50=33.59% lat (msec) : 100=24.48%, 250=11.20%, 500=0.78% cpu : usr=0.05%, sys=4.38%, ctx=1624, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180062: Tue Sep 8 02:22:53 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6256KiB/38996msec) clat (usec): min=41, max=389965, avg=52787.81, stdev=43744.53 lat (usec): min=42, max=389966, avg=52789.00, stdev=43744.56 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 62], 10.00th=[ 10552], 20.00th=[ 23200], | 30.00th=[ 30802], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 50594], | 70.00th=[ 63701], 80.00th=[ 78119], 90.00th=[105382], 95.00th=[127402], | 99.00th=[227541], 99.50th=[270533], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 478, per=26.10%, avg=160.22, stdev=98.43, samples=76 iops : min= 1, max= 29, avg= 9.24, stdev= 6.15, samples=76 write: IOPS=9, BW=155KiB/s (158kB/s)(6032KiB/38996msec); 0 zone resets clat (usec): min=1427, max=325705, avg=48594.76, stdev=52617.59 lat (usec): min=1428, max=325707, avg=48603.26, stdev=52612.30 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1860], 10.00th=[ 2606], 20.00th=[ 5145], | 30.00th=[ 12649], 40.00th=[ 21627], 50.00th=[ 33162], 60.00th=[ 43254], | 70.00th=[ 60556], 80.00th=[ 79168], 90.00th=[119014], 95.00th=[147850], | 99.00th=[238027], 99.50th=[299893], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 539, per=24.25%, avg=156.64, stdev=101.95, samples=74 iops : min= 1, max= 33, avg= 8.97, stdev= 6.40, samples=74 lat (usec) : 50=0.26%, 100=4.17%, 250=0.26%, 500=0.26% lat (msec) : 2=2.86%, 4=4.43%, 10=6.12%, 20=8.98%, 50=33.85% lat (msec) : 100=26.56%, 250=11.59%, 500=0.65% cpu : usr=0.05%, sys=4.27%, ctx=1706, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180063: Tue Sep 8 02:22:53 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6032KiB/36584msec) clat (usec): min=46, max=364707, avg=55880.12, stdev=47068.36 lat (usec): min=47, max=364709, avg=55881.31, stdev=47068.35 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 14746], 20.00th=[ 23200], | 30.00th=[ 30540], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 61604], 80.00th=[ 82314], 90.00th=[113771], 95.00th=[145753], | 99.00th=[242222], 99.50th=[320865], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 30, max= 414, per=26.88%, avg=165.06, stdev=86.31, samples=70 iops : min= 1, max= 25, avg= 9.54, stdev= 5.41, samples=70 write: IOPS=10, BW=171KiB/s (175kB/s)(6256KiB/36584msec); 0 zone resets clat (usec): min=1567, max=358164, avg=39553.62, stdev=47675.99 lat (usec): min=1568, max=358165, avg=39571.28, stdev=47665.97 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1844], 10.00th=[ 2573], 20.00th=[ 5276], | 30.00th=[ 9110], 40.00th=[ 15795], 50.00th=[ 24773], 60.00th=[ 32375], | 70.00th=[ 40633], 80.00th=[ 62653], 90.00th=[ 99091], 95.00th=[137364], | 99.00th=[225444], 99.50th=[283116], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 410, per=26.60%, avg=171.84, stdev=96.16, samples=70 iops : min= 1, max= 25, avg= 9.96, stdev= 6.03, samples=70 lat (usec) : 50=0.26%, 100=2.86%, 250=0.13%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.12%, 4=4.69%, 10=8.59%, 20=10.29%, 50=35.42% lat (msec) : 100=23.18%, 250=10.55%, 500=0.65% cpu : usr=0.06%, sys=4.21%, ctx=1635, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=614KiB/s (629kB/s), 152KiB/s-165KiB/s (156kB/s-169kB/s), io=23.4MiB (24.5MB), run=36584-38996msec WRITE: bw=646KiB/s (662kB/s), 155KiB/s-174KiB/s (158kB/s-178kB/s), io=24.6MiB (25.8MB), run=36584-38996msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180055: Tue Sep 8 02:23:07 2026 read: IOPS=6, BW=112KiB/s (114kB/s)(5920KiB/52963msec) clat (msec): min=7, max=376, avg=60.12, stdev=52.55 lat (msec): min=7, max=376, avg=60.12, stdev=52.55 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 64], 80.00th=[ 82], 90.00th=[ 120], 95.00th=[ 163], | 99.00th=[ 292], 99.50th=[ 368], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 320, per=25.84%, avg=116.04, stdev=65.91, samples=99 iops : min= 1, max= 20, avg= 6.44, stdev= 4.21, samples=99 write: IOPS=7, BW=120KiB/s (123kB/s)(6368KiB/52963msec); 0 zone resets clat (msec): min=13, max=409, avg=76.65, stdev=63.40 lat (msec): min=13, max=409, avg=76.66, stdev=63.40 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 65], | 70.00th=[ 82], 80.00th=[ 102], 90.00th=[ 144], 95.00th=[ 228], | 99.00th=[ 372], 99.50th=[ 380], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 31, max= 318, per=26.31%, avg=124.43, stdev=70.31, samples=100 iops : min= 1, max= 19, avg= 6.96, stdev= 4.46, samples=100 lat (msec) : 10=0.39%, 20=6.12%, 50=42.71%, 100=33.59%, 250=14.45% lat (msec) : 500=2.73% cpu : usr=0.03%, sys=1.30%, ctx=1134, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180056: Tue Sep 8 02:23:07 2026 read: IOPS=6, BW=108KiB/s (110kB/s)(5744KiB/53251msec) clat (msec): min=7, max=402, avg=55.92, stdev=50.77 lat (msec): min=8, max=402, avg=55.92, stdev=50.77 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 75], 90.00th=[ 123], 95.00th=[ 163], | 99.00th=[ 241], 99.50th=[ 330], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 29, max= 382, per=25.71%, avg=115.46, stdev=75.10, samples=98 iops : min= 1, max= 23, avg= 6.40, stdev= 4.75, samples=98 write: IOPS=7, BW=123KiB/s (126kB/s)(6544KiB/53251msec); 0 zone resets clat (msec): min=16, max=427, avg=80.63, stdev=64.27 lat (msec): min=16, max=427, avg=80.65, stdev=64.27 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 89], 80.00th=[ 120], 90.00th=[ 153], 95.00th=[ 197], | 99.00th=[ 355], 99.50th=[ 388], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 29, max= 349, per=25.89%, avg=122.46, stdev=71.36, samples=105 iops : min= 1, max= 21, avg= 6.84, stdev= 4.53, samples=105 lat (msec) : 10=0.39%, 20=7.16%, 50=43.49%, 100=28.26%, 250=18.75% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.38%, ctx=1148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180057: Tue Sep 8 02:23:07 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/52931msec) clat (msec): min=7, max=449, avg=58.76, stdev=59.46 lat (msec): min=7, max=449, avg=58.77, stdev=59.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 58], 80.00th=[ 73], 90.00th=[ 124], 95.00th=[ 182], | 99.00th=[ 326], 99.50th=[ 372], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 30, max= 415, per=27.36%, avg=122.86, stdev=83.82, samples=100 iops : min= 1, max= 25, avg= 6.87, stdev= 5.33, samples=100 write: IOPS=7, BW=114KiB/s (117kB/s)(6032KiB/52931msec); 0 zone resets clat (msec): min=17, max=378, avg=79.24, stdev=58.97 lat (msec): min=17, max=378, avg=79.25, stdev=58.97 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 61], 60.00th=[ 70], | 70.00th=[ 85], 80.00th=[ 113], 90.00th=[ 165], 95.00th=[ 205], | 99.00th=[ 305], 99.50th=[ 368], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 283, per=25.35%, avg=119.91, stdev=64.71, samples=98 iops : min= 1, max= 17, avg= 6.67, stdev= 4.11, samples=98 lat (msec) : 10=1.30%, 20=7.55%, 50=42.32%, 100=30.08%, 250=16.54% lat (msec) : 500=2.21% cpu : usr=0.04%, sys=1.34%, ctx=1204, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180058: Tue Sep 8 02:23:07 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/51962msec) clat (msec): min=8, max=416, avg=57.44, stdev=52.87 lat (msec): min=8, max=416, avg=57.44, stdev=52.87 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 62], 80.00th=[ 73], 90.00th=[ 115], 95.00th=[ 165], | 99.00th=[ 275], 99.50th=[ 338], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 31, max= 380, per=26.43%, avg=118.67, stdev=76.01, samples=99 iops : min= 1, max= 23, avg= 6.60, stdev= 4.82, samples=99 write: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/51962msec); 0 zone resets clat (msec): min=17, max=391, avg=77.03, stdev=60.61 lat (msec): min=17, max=391, avg=77.03, stdev=60.61 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 109], 90.00th=[ 161], 95.00th=[ 205], | 99.00th=[ 300], 99.50th=[ 368], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 349, per=26.58%, avg=125.71, stdev=76.38, samples=98 iops : min= 1, max= 21, avg= 7.04, stdev= 4.82, samples=98 lat (msec) : 10=0.26%, 20=7.42%, 50=45.05%, 100=29.43%, 250=15.36% lat (msec) : 500=2.47% cpu : usr=0.06%, sys=1.44%, ctx=1173, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=450KiB/s (461kB/s), 108KiB/s-118KiB/s (110kB/s-121kB/s), io=23.4MiB (24.5MB), run=51962-53251msec WRITE: bw=473KiB/s (485kB/s), 114KiB/s-123KiB/s (117kB/s-126kB/s), io=24.6MiB (25.8MB), run=51962-53251msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180076: Tue Sep 8 02:23:22 2026 read: IOPS=1, BW=2045KiB/s (2094kB/s)(7168KiB/3505msec) clat (usec): min=545, max=616618, avg=269874.55, stdev=200664.14 lat (usec): min=546, max=616619, avg=269876.01, stdev=200664.05 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[131597], | 30.00th=[139461], 40.00th=[139461], 50.00th=[316670], 60.00th=[333448], | 70.00th=[333448], 80.00th=[350225], 90.00th=[616563], 95.00th=[616563], | 99.00th=[616563], 99.50th=[616563], 99.90th=[616563], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 1514, max= 4079, per=50.04%, avg=2253.00, stdev=1037.19, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1461KiB/s (1496kB/s)(5120KiB/3505msec); 0 zone resets clat (msec): min=136, max=457, avg=310.28, stdev=119.08 lat (msec): min=136, max=458, avg=310.38, stdev=119.10 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1753, max= 4096, per=41.23%, avg=2598.33, stdev=1300.60, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=15.55%, ctx=225, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180077: Tue Sep 8 02:23:22 2026 read: IOPS=0, BW=450KiB/s (461kB/s)(2048KiB/4549msec) clat (msec): min=2, max=218, avg=110.15, stdev=152.79 lat (msec): min=2, max=218, avg=110.15, stdev=152.79 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1537, max= 1753, per=36.54%, avg=1645.00, stdev=152.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2251KiB/s (2305kB/s)(10.0MiB/4549msec); 0 zone resets clat (msec): min=153, max=810, avg=389.58, stdev=240.94 lat (msec): min=153, max=810, avg=389.67, stdev=240.94 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 188], 40.00th=[ 251], 50.00th=[ 271], 60.00th=[ 284], | 70.00th=[ 498], 80.00th=[ 584], 90.00th=[ 701], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1753, max= 6059, per=56.17%, avg=3539.80, stdev=1735.96, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.48, samples=5 lat (msec) : 4=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=15.24%, ctx=200, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180078: Tue Sep 8 02:23:22 2026 read: IOPS=1, BW=1681KiB/s (1722kB/s)(6144KiB/3654msec) clat (usec): min=430, max=185509, avg=85304.89, stdev=93775.81 lat (usec): min=431, max=185510, avg=85306.04, stdev=93775.97 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 1172], 50.00th=[ 1172], 60.00th=[143655], | 70.00th=[179307], 80.00th=[179307], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 1753, max= 4096, per=72.52%, avg=3265.00, stdev=1311.58, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1681KiB/s (1722kB/s)(6144KiB/3654msec); 0 zone resets clat (msec): min=193, max=1112, avg=477.07, stdev=335.42 lat (msec): min=193, max=1112, avg=477.12, stdev=335.40 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 393], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1528, max= 2048, per=29.64%, avg=1868.20, stdev=224.44, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.95%, ctx=212, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180079: Tue Sep 8 02:23:22 2026 read: IOPS=1, BW=1540KiB/s (1577kB/s)(5120KiB/3324msec) clat (usec): min=560, max=319788, avg=136649.58, stdev=144249.23 lat (usec): min=561, max=319789, avg=136650.90, stdev=144249.18 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 1991], 40.00th=[ 1991], 50.00th=[112722], 60.00th=[112722], | 70.00th=[248513], 80.00th=[248513], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 1973, max= 6144, per=90.15%, avg=4058.50, stdev=2949.34, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2156KiB/s (2208kB/s)(7168KiB/3324msec); 0 zone resets clat (msec): min=205, max=668, avg=355.86, stdev=153.15 lat (msec): min=205, max=672, avg=356.44, stdev=154.38 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 259], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 342], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 405], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1501, max= 2048, per=29.78%, avg=1876.67, stdev=212.70, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=15.59%, ctx=135, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4502KiB/s (4610kB/s), 450KiB/s-2045KiB/s (461kB/s-2094kB/s), io=20.0MiB (20.0MB), run=3324-4549msec WRITE: bw=6303KiB/s (6454kB/s), 1461KiB/s-2251KiB/s (1496kB/s-2305kB/s), io=28.0MiB (29.4MB), run=3324-4549msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180081: Tue Sep 8 02:23:22 2026 read: IOPS=1, BW=1828KiB/s (1872kB/s)(7168KiB/3922msec) clat (msec): min=77, max=871, avg=287.94, stdev=277.88 lat (msec): min=77, max=871, avg=287.94, stdev=277.88 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 106], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 355], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1381, max= 4071, per=67.81%, avg=2842.00, stdev=1344.16, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1305KiB/s (1337kB/s)(5120KiB/3922msec); 0 zone resets clat (msec): min=119, max=568, avg=366.11, stdev=177.28 lat (msec): min=119, max=568, avg=366.19, stdev=177.29 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1765, max= 4047, per=41.64%, avg=2443.25, stdev=1074.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.81%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180082: Tue Sep 8 02:23:22 2026 read: IOPS=0, BW=419KiB/s (429kB/s)(2048KiB/4886msec) clat (msec): min=87, max=766, avg=426.89, stdev=480.07 lat (msec): min=87, max=766, avg=426.89, stdev=480.07 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 88], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2023, max= 2031, per=48.37%, avg=2027.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2096KiB/s (2146kB/s)(10.0MiB/4886msec); 0 zone resets clat (msec): min=173, max=700, avg=367.43, stdev=176.93 lat (msec): min=174, max=700, avg=367.53, stdev=176.92 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 178], | 30.00th=[ 213], 40.00th=[ 279], 50.00th=[ 321], 60.00th=[ 338], | 70.00th=[ 384], 80.00th=[ 523], 90.00th=[ 567], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1765, max= 4096, per=51.26%, avg=3008.17, stdev=1180.01, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=6.41%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180083: Tue Sep 8 02:23:22 2026 read: IOPS=1, BW=1393KiB/s (1426kB/s)(6144KiB/4411msec) clat (msec): min=54, max=216, avg=154.19, stdev=60.74 lat (msec): min=54, max=216, avg=154.19, stdev=60.74 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 180], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 2023, max= 4079, per=76.62%, avg=3211.00, stdev=1064.70, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1393KiB/s (1426kB/s)(6144KiB/4411msec); 0 zone resets clat (msec): min=107, max=800, avg=522.24, stdev=297.28 lat (msec): min=107, max=800, avg=522.54, stdev=297.50 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 659], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1765, max= 4079, per=40.67%, avg=2386.60, stdev=953.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 750=16.67%, 1000=16.67% cpu : usr=0.02%, sys=4.44%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180084: Tue Sep 8 02:23:22 2026 read: IOPS=1, BW=1068KiB/s (1093kB/s)(5120KiB/4795msec) clat (msec): min=44, max=513, avg=215.66, stdev=195.71 lat (msec): min=44, max=513, avg=215.66, stdev=195.71 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 48], 40.00th=[ 48], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2015, max= 4079, per=64.56%, avg=2705.67, stdev=1189.35, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1495KiB/s (1531kB/s)(7168KiB/4795msec); 0 zone resets clat (msec): min=71, max=1162, avg=482.10, stdev=384.89 lat (msec): min=71, max=1162, avg=482.20, stdev=384.90 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 180], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 426], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 751], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1946, max= 4031, per=45.49%, avg=2669.33, stdev=1180.00, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=16.67%, 100=8.33%, 250=25.00%, 500=16.67%, 750=25.00% lat (msec) : 2000=8.33% cpu : usr=0.06%, sys=4.96%, ctx=97, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4192KiB/s (4292kB/s), 419KiB/s-1828KiB/s (429kB/s-1872kB/s), io=20.0MiB (20.0MB), run=3922-4886msec WRITE: bw=5868KiB/s (6009kB/s), 1305KiB/s-2096KiB/s (1337kB/s-2146kB/s), io=28.0MiB (29.4MB), run=3922-4886msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180093: Tue Sep 8 02:23:37 2026 read: IOPS=1, BW=5018KiB/s (5138kB/s)(12.0MiB/2449msec) clat (msec): min=705, max=888, avg=784.85, stdev=93.67 lat (msec): min=705, max=888, avg=784.85, stdev=93.67 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.93%, ctx=317, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180094: Tue Sep 8 02:23:37 2026 read: IOPS=0, BW=1200KiB/s (1229kB/s)(4096KiB/3414msec) clat (nsec): min=868778k, max=868778k, avg=868777937.00, stdev= 0.00 lat (nsec): min=868779k, max=868779k, avg=868779485.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2400KiB/s (2457kB/s)(8192KiB/3414msec); 0 zone resets clat (msec): min=455, max=2018, avg=1236.81, stdev=1105.12 lat (msec): min=455, max=2019, avg=1237.80, stdev=1105.96 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 2022], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8175, max= 8175, per=85.17%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.15%, sys=5.51%, ctx=144, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180096: Tue Sep 8 02:23:37 2026 write: IOPS=1, BW=4132KiB/s (4231kB/s)(12.0MiB/2974msec); 0 zone resets clat (msec): min=550, max=1365, avg=940.68, stdev=408.63 lat (msec): min=551, max=1366, avg=941.46, stdev=408.60 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8126, max= 8175, per=84.92%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.90%, ctx=57, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180098: Tue Sep 8 02:23:37 2026 write: IOPS=1, BW=5086KiB/s (5208kB/s)(12.0MiB/2416msec); 0 zone resets clat (msec): min=475, max=1001, avg=762.34, stdev=266.05 lat (msec): min=475, max=1002, avg=763.18, stdev=266.78 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8078, max= 8159, per=84.59%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=5.51%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4799KiB/s (4914kB/s), 1200KiB/s-5018KiB/s (1229kB/s-5138kB/s), io=16.0MiB (16.8MB), run=2449-3414msec WRITE: bw=9598KiB/s (9828kB/s), 2400KiB/s-5086KiB/s (2457kB/s-5208kB/s), io=32.0MiB (33.6MB), run=2416-3414msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180095: Tue Sep 8 02:23:37 2026 read: IOPS=1, BW=4830KiB/s (4946kB/s)(12.0MiB/2544msec) clat (msec): min=660, max=930, avg=831.79, stdev=149.32 lat (msec): min=660, max=930, avg=831.79, stdev=149.32 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7742, max= 8126, per=100.00%, avg=7934.00, stdev=271.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.21%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180097: Tue Sep 8 02:23:37 2026 read: IOPS=0, BW=1363KiB/s (1395kB/s)(4096KiB/3006msec) clat (nsec): min=562825k, max=562825k, avg=562825008.00, stdev= 0.00 lat (nsec): min=562828k, max=562828k, avg=562827612.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 5760, max= 5760, per=100.00%, avg=5760.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2725KiB/s (2791kB/s)(8192KiB/3006msec); 0 zone resets clat (msec): min=1143, max=1155, avg=1149.62, stdev= 8.74 lat (msec): min=1143, max=1156, avg=1150.04, stdev= 8.70 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7742, max= 7742, per=74.43%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.27%, sys=2.33%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180099: Tue Sep 8 02:23:37 2026 write: IOPS=0, BW=3901KiB/s (3995kB/s)(12.0MiB/3150msec); 0 zone resets clat (msec): min=320, max=1529, avg=1003.14, stdev=619.65 lat (msec): min=321, max=1530, avg=1003.70, stdev=619.33 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8159, max= 8175, per=78.51%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.30%, ctx=46, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180100: Tue Sep 8 02:23:37 2026 write: IOPS=1, BW=5573KiB/s (5707kB/s)(12.0MiB/2205msec); 0 zone resets clat (msec): min=391, max=1242, avg=693.24, stdev=476.65 lat (msec): min=392, max=1243, avg=693.60, stdev=476.77 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 6977, max= 8047, per=72.22%, avg=7512.00, stdev=756.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.27%, sys=3.99%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5450KiB/s (5581kB/s), 1363KiB/s-4830KiB/s (1395kB/s-4946kB/s), io=16.0MiB (16.8MB), run=2544-3006msec WRITE: bw=10.2MiB/s (10.7MB/s), 2725KiB/s-5573KiB/s (2791kB/s-5707kB/s), io=32.0MiB (33.6MB), run=2205-3150msec