== sanity test 398b: DIO and buffer IO race ============== 06:32:48 (1788517968) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.67547 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179171: Fri Sep 4 06:35:09 2026 read: IOPS=12, BW=49.2KiB/s (50.4kB/s)(5992KiB/121807msec) clat (usec): min=31, max=1346.0k, avg=45487.21, stdev=44189.86 lat (usec): min=31, max=1346.0k, avg=45488.67, stdev=44189.83 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11338], 10.00th=[ 16450], | 20.00th=[ 22414], 30.00th=[ 27919], 40.00th=[ 33424], | 50.00th=[ 39584], 60.00th=[ 45876], 70.00th=[ 52691], | 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[ 143655], 99.50th=[ 179307], 99.90th=[ 244319], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 117, per=25.03%, avg=48.81, stdev=19.93, samples=239 iops : min= 1, max= 29, avg=11.56, stdev= 4.99, samples=239 write: IOPS=12, BW=51.7KiB/s (52.9kB/s)(6296KiB/121807msec); 0 zone resets clat (usec): min=900, max=314380, avg=33733.89, stdev=35193.31 lat (usec): min=902, max=314382, avg=33736.95, stdev=35192.48 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1139], 10.00th=[ 1270], 20.00th=[ 3097], | 30.00th=[ 5866], 40.00th=[ 15008], 50.00th=[ 24249], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 60031], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[145753], 99.50th=[170918], 99.90th=[212861], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 143, per=25.15%, avg=51.30, stdev=21.91, samples=239 iops : min= 1, max= 35, avg=12.18, stdev= 5.52, samples=239 lat (usec) : 50=0.29%, 100=1.60%, 250=0.13%, 750=0.03%, 1000=0.16% lat (msec) : 2=7.42%, 4=4.30%, 10=6.58%, 20=10.06%, 50=39.42% lat (msec) : 100=25.13%, 250=4.82%, 500=0.03%, 2000=0.03% cpu : usr=0.05%, sys=4.49%, ctx=6219, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179172: Fri Sep 4 06:35:09 2026 read: IOPS=12, BW=48.8KiB/s (49.9kB/s)(5940KiB/121791msec) clat (usec): min=42, max=1349.1k, avg=46713.46, stdev=45371.01 lat (usec): min=42, max=1349.1k, avg=46715.32, stdev=45370.77 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 12387], 10.00th=[ 17171], | 20.00th=[ 23462], 30.00th=[ 28705], 40.00th=[ 33817], | 50.00th=[ 40109], 60.00th=[ 46924], 70.00th=[ 54264], | 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[ 158335], 99.50th=[ 191890], 99.90th=[ 320865], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 111, per=24.86%, avg=48.48, stdev=19.86, samples=239 iops : min= 1, max= 27, avg=11.47, stdev= 5.01, samples=239 write: IOPS=13, BW=52.1KiB/s (53.4kB/s)(6348KiB/121791msec); 0 zone resets clat (usec): min=911, max=187507, avg=32643.08, stdev=33014.81 lat (usec): min=912, max=187508, avg=32646.43, stdev=33017.87 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 3064], | 30.00th=[ 6063], 40.00th=[ 13566], 50.00th=[ 23987], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[129500], 99.50th=[145753], 99.90th=[177210], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7, max= 159, per=25.49%, avg=52.01, stdev=22.47, samples=238 iops : min= 1, max= 39, avg=12.35, stdev= 5.66, samples=238 lat (usec) : 50=0.33%, 100=1.40%, 250=0.03%, 500=0.07%, 1000=0.10% lat (msec) : 2=7.88%, 4=4.49%, 10=6.84%, 20=9.44%, 50=39.26% lat (msec) : 100=25.29%, 250=4.79%, 500=0.07%, 2000=0.03% cpu : usr=0.06%, sys=4.59%, ctx=6274, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179173: Fri Sep 4 06:35:09 2026 read: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6028KiB/122724msec) clat (usec): min=29, max=1309.2k, avg=44981.78, stdev=43234.36 lat (usec): min=30, max=1309.2k, avg=44983.04, stdev=43234.38 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9372], 10.00th=[ 16057], | 20.00th=[ 21627], 30.00th=[ 27132], 40.00th=[ 32637], | 50.00th=[ 39060], 60.00th=[ 45351], 70.00th=[ 53740], | 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[ 137364], 99.50th=[ 154141], 99.90th=[ 299893], | 99.95th=[1317012], 99.99th=[1317012] bw ( KiB/s): min= 7, max= 103, per=25.14%, avg=49.03, stdev=18.91, samples=240 iops : min= 1, max= 25, avg=11.61, stdev= 4.76, samples=240 write: IOPS=12, BW=51.0KiB/s (52.2kB/s)(6260KiB/122724msec); 0 zone resets clat (usec): min=922, max=230299, avg=34734.87, stdev=35472.62 lat (usec): min=923, max=230300, avg=34741.76, stdev=35470.15 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1450], 20.00th=[ 3589], | 30.00th=[ 7373], 40.00th=[ 15795], 50.00th=[ 25035], 60.00th=[ 34341], | 70.00th=[ 44827], 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[145753], 99.50th=[177210], 99.90th=[200279], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 127, per=24.80%, avg=50.60, stdev=21.77, samples=241 iops : min= 1, max= 31, avg=12.01, stdev= 5.50, samples=241 lat (usec) : 50=0.49%, 100=1.69%, 250=0.07%, 500=0.03%, 1000=0.13% lat (msec) : 2=6.67%, 4=3.94%, 10=6.71%, 20=11.23%, 50=38.35% lat (msec) : 100=25.23%, 250=5.40%, 500=0.03%, 2000=0.03% cpu : usr=0.06%, sys=4.51%, ctx=6207, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179174: Fri Sep 4 06:35:09 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6052KiB/121815msec) clat (usec): min=31, max=1281.8k, avg=44825.54, stdev=42771.19 lat (usec): min=31, max=1281.8k, avg=44835.87, stdev=42775.26 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 9372], 10.00th=[ 16188], | 20.00th=[ 21890], 30.00th=[ 27132], 40.00th=[ 32113], | 50.00th=[ 38011], 60.00th=[ 45351], 70.00th=[ 53740], | 80.00th=[ 64750], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[ 139461], 99.50th=[ 164627], 99.90th=[ 299893], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 7, max= 103, per=25.30%, avg=49.34, stdev=19.13, samples=239 iops : min= 1, max= 25, avg=11.68, stdev= 4.81, samples=239 write: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6236KiB/121815msec); 0 zone resets clat (usec): min=925, max=217934, avg=34238.83, stdev=35034.57 lat (usec): min=926, max=217935, avg=34246.94, stdev=35031.61 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1401], 20.00th=[ 3359], | 30.00th=[ 6915], 40.00th=[ 15270], 50.00th=[ 25560], 60.00th=[ 32900], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[145753], 99.50th=[170918], 99.90th=[210764], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 119, per=25.03%, avg=51.05, stdev=22.22, samples=238 iops : min= 1, max= 29, avg=12.11, stdev= 5.59, samples=238 lat (usec) : 50=0.59%, 100=1.66%, 250=0.03%, 750=0.07%, 1000=0.16% lat (msec) : 2=6.97%, 4=4.13%, 10=6.87%, 20=9.77%, 50=39.49% lat (msec) : 100=25.72%, 250=4.49%, 500=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.58%, ctx=6171, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=196KiB/s (200kB/s), 48.8KiB/s-49.7KiB/s (49.9kB/s-50.9kB/s), io=23.4MiB (24.6MB), run=121791-122724msec WRITE: bw=205KiB/s (210kB/s), 51.0KiB/s-52.1KiB/s (52.2kB/s-53.4kB/s), io=24.6MiB (25.7MB), run=121791-122724msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179176: Fri Sep 4 06:35:50 2026 read: IOPS=9, BW=37.0KiB/s (37.9kB/s)(5992KiB/161908msec) clat (msec): min=4, max=994, avg=41.59, stdev=43.90 lat (msec): min=4, max=994, avg=41.60, stdev=43.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 89], 95.00th=[ 121], | 99.00th=[ 176], 99.50th=[ 203], 99.90th=[ 284], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 142, per=25.64%, avg=37.68, stdev=24.69, samples=307 iops : min= 1, max= 35, avg= 8.75, stdev= 6.21, samples=307 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6296KiB/161908msec); 0 zone resets clat (msec): min=9, max=353, avg=63.18, stdev=44.99 lat (msec): min=9, max=353, avg=63.18, stdev=44.99 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 125], 95.00th=[ 153], | 99.00th=[ 222], 99.50th=[ 271], 99.90th=[ 351], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=38.41, stdev=23.31, samples=317 iops : min= 1, max= 29, avg= 8.92, stdev= 5.85, samples=317 lat (msec) : 10=2.25%, 20=14.78%, 50=46.94%, 100=23.05%, 250=12.57% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.05%, sys=1.64%, ctx=4760, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179177: Fri Sep 4 06:35:50 2026 read: IOPS=9, BW=36.4KiB/s (37.3kB/s)(5940KiB/162984msec) clat (msec): min=5, max=1381, avg=43.02, stdev=52.17 lat (msec): min=5, max=1381, avg=43.03, stdev=52.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 188], 99.50th=[ 213], 99.90th=[ 300], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 119, per=25.19%, avg=37.03, stdev=24.51, samples=312 iops : min= 1, max= 29, avg= 8.59, stdev= 6.16, samples=312 write: IOPS=9, BW=38.9KiB/s (39.9kB/s)(6348KiB/162984msec); 0 zone resets clat (msec): min=8, max=345, avg=62.38, stdev=43.16 lat (msec): min=8, max=345, avg=62.38, stdev=43.16 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 243], 99.90th=[ 330], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 119, per=25.32%, avg=38.99, stdev=23.28, samples=317 iops : min= 1, max= 29, avg= 9.07, stdev= 5.85, samples=317 lat (msec) : 10=2.02%, 20=15.66%, 50=45.05%, 100=24.80%, 250=12.11% lat (msec) : 500=0.33%, 2000=0.03% cpu : usr=0.06%, sys=1.57%, ctx=4590, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179178: Fri Sep 4 06:35:50 2026 read: IOPS=9, BW=36.0KiB/s (37.9kB/s)(6028KiB/163059msec) clat (msec): min=5, max=252, avg=41.87, stdev=36.60 lat (msec): min=5, max=252, avg=41.87, stdev=36.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 95], 95.00th=[ 122], | 99.00th=[ 174], 99.50th=[ 190], 99.90th=[ 251], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7, max= 134, per=25.31%, avg=37.20, stdev=24.55, samples=315 iops : min= 1, max= 33, avg= 8.63, stdev= 6.18, samples=315 write: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6260KiB/163059msec); 0 zone resets clat (msec): min=11, max=1320, avg=63.75, stdev=53.58 lat (msec): min=11, max=1320, avg=63.75, stdev=53.58 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 121], 95.00th=[ 150], | 99.00th=[ 226], 99.50th=[ 247], 99.90th=[ 359], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 119, per=24.85%, avg=38.26, stdev=23.58, samples=318 iops : min= 1, max= 29, avg= 8.89, stdev= 5.92, samples=318 lat (msec) : 10=2.05%, 20=14.65%, 50=45.67%, 100=25.00%, 250=12.34% lat (msec) : 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=1.63%, ctx=4740, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179179: Fri Sep 4 06:35:50 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6052KiB/162784msec) clat (msec): min=5, max=303, avg=42.06, stdev=38.31 lat (msec): min=5, max=303, avg=42.06, stdev=38.31 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 64], 90.00th=[ 96], 95.00th=[ 125], | 99.00th=[ 180], 99.50th=[ 220], 99.90th=[ 271], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 119, per=25.68%, avg=37.74, stdev=25.28, samples=311 iops : min= 1, max= 29, avg= 8.76, stdev= 6.35, samples=311 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6236KiB/162784msec); 0 zone resets clat (msec): min=12, max=1325, avg=63.50, stdev=54.08 lat (msec): min=12, max=1325, avg=63.50, stdev=54.08 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 251], 99.90th=[ 347], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 111, per=24.71%, avg=38.05, stdev=23.15, samples=317 iops : min= 1, max= 27, avg= 8.84, stdev= 5.82, samples=317 lat (msec) : 10=2.34%, 20=15.63%, 50=45.25%, 100=23.27%, 250=13.09% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.05%, sys=1.60%, ctx=4645, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (151kB/s), 36.4KiB/s-37.2KiB/s (37.3kB/s-38.1kB/s), io=23.4MiB (24.6MB), run=161908-163059msec WRITE: bw=154KiB/s (158kB/s), 38.3KiB/s-38.9KiB/s (39.2kB/s-39.9kB/s), io=24.6MiB (25.7MB), run=161908-163059msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179225: Fri Sep 4 06:36:36 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5920KiB/34168msec) clat (usec): min=39, max=185856, avg=47150.77, stdev=33695.24 lat (usec): min=39, max=185858, avg=47152.01, stdev=33695.23 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 75], 20.00th=[ 23200], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[168821], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 379, per=24.43%, avg=171.26, stdev=71.71, samples=66 iops : min= 1, max= 23, avg= 9.95, stdev= 4.52, samples=66 write: IOPS=11, BW=186KiB/s (191kB/s)(6368KiB/34168msec); 0 zone resets clat (usec): min=1424, max=214505, avg=41913.29, stdev=42476.84 lat (usec): min=1425, max=214507, avg=41916.13, stdev=42476.13 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1860], 10.00th=[ 2704], 20.00th=[ 5276], | 30.00th=[ 9634], 40.00th=[ 17957], 50.00th=[ 29492], 60.00th=[ 39584], | 70.00th=[ 53740], 80.00th=[ 74974], 90.00th=[100140], 95.00th=[129500], | 99.00th=[187696], 99.50th=[200279], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 62, max= 447, per=25.25%, avg=186.08, stdev=73.11, samples=66 iops : min= 3, max= 27, avg=10.86, stdev= 4.54, samples=66 lat (usec) : 50=0.78%, 100=4.56%, 250=0.13% lat (msec) : 2=2.86%, 4=5.47%, 10=7.68%, 20=8.07%, 50=35.42% lat (msec) : 100=26.30%, 250=8.72% cpu : usr=0.05%, sys=4.36%, ctx=1553, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179226: Fri Sep 4 06:36:36 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5744KiB/33154msec) clat (usec): min=39, max=153089, avg=49877.86, stdev=31333.59 lat (usec): min=39, max=153091, avg=49879.71, stdev=31333.34 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 16319], 20.00th=[ 24249], | 30.00th=[ 30278], 40.00th=[ 38536], 50.00th=[ 46400], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[135267], 99.50th=[145753], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 43, max= 352, per=25.08%, avg=175.81, stdev=58.59, samples=63 iops : min= 2, max= 22, avg=10.24, stdev= 3.68, samples=63 write: IOPS=12, BW=197KiB/s (202kB/s)(6544KiB/33154msec); 0 zone resets clat (usec): min=1468, max=197659, avg=37175.12, stdev=37583.90 lat (usec): min=1468, max=197660, avg=37178.67, stdev=37582.79 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1811], 10.00th=[ 2999], 20.00th=[ 5407], | 30.00th=[ 9503], 40.00th=[ 16450], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 47449], 80.00th=[ 64226], 90.00th=[ 84411], 95.00th=[119014], | 99.00th=[160433], 99.50th=[170918], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 436, per=26.29%, avg=193.78, stdev=81.19, samples=64 iops : min= 1, max= 27, avg=11.36, stdev= 5.18, samples=64 lat (usec) : 50=0.39%, 100=2.99%, 250=0.39%, 500=0.26% lat (msec) : 2=3.65%, 4=3.65%, 10=9.24%, 20=9.38%, 50=34.77% lat (msec) : 100=27.60%, 250=7.68% cpu : usr=0.07%, sys=5.21%, ctx=1661, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179227: Fri Sep 4 06:36:36 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6256KiB/33844msec) clat (usec): min=28, max=174832, avg=46080.43, stdev=29778.47 lat (usec): min=28, max=174833, avg=46082.64, stdev=29777.11 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 58], 10.00th=[ 97], 20.00th=[ 24773], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[145753], 99.50th=[154141], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 384, per=26.48%, avg=185.64, stdev=80.31, samples=66 iops : min= 1, max= 24, avg=10.85, stdev= 5.08, samples=66 write: IOPS=11, BW=178KiB/s (183kB/s)(6032KiB/33844msec); 0 zone resets clat (usec): min=1373, max=181925, avg=41786.77, stdev=38430.83 lat (usec): min=1375, max=181926, avg=41834.73, stdev=38464.21 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1844], 10.00th=[ 3228], 20.00th=[ 6128], | 30.00th=[ 11469], 40.00th=[ 20579], 50.00th=[ 33424], 60.00th=[ 44303], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[156238], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 442, per=23.92%, avg=176.30, stdev=73.37, samples=66 iops : min= 1, max= 27, avg=10.27, stdev= 4.65, samples=66 lat (usec) : 50=0.39%, 100=5.08%, 250=0.26% lat (msec) : 2=2.99%, 4=2.99%, 10=7.81%, 20=7.29%, 50=35.68% lat (msec) : 100=30.86%, 250=6.64% cpu : usr=0.06%, sys=4.52%, ctx=1641, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179228: Fri Sep 4 06:36:36 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(6032KiB/32564msec) clat (usec): min=38, max=194187, avg=46410.18, stdev=32922.48 lat (usec): min=38, max=194188, avg=46411.51, stdev=32922.59 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 83], 20.00th=[ 20579], | 30.00th=[ 28705], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[166724], 99.50th=[181404], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 415, per=26.29%, avg=184.27, stdev=83.52, samples=63 iops : min= 1, max= 25, avg=10.78, stdev= 5.31, samples=63 write: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32564msec); 0 zone resets clat (usec): min=1392, max=237482, avg=38413.02, stdev=37363.46 lat (usec): min=1394, max=237484, avg=38414.98, stdev=37363.44 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1729], 10.00th=[ 2311], 20.00th=[ 7046], | 30.00th=[ 11731], 40.00th=[ 18482], 50.00th=[ 26870], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 66847], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[166724], 99.50th=[214959], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 95, max= 379, per=26.11%, avg=192.44, stdev=61.68, samples=63 iops : min= 5, max= 23, avg=11.29, stdev= 3.92, samples=63 lat (usec) : 50=0.65%, 100=4.95%, 250=0.65%, 500=0.13% lat (msec) : 2=4.17%, 4=3.78%, 10=6.12%, 20=9.77%, 50=34.64% lat (msec) : 100=28.65%, 250=6.51% cpu : usr=0.04%, sys=4.75%, ctx=1563, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=701KiB/s (718kB/s), 173KiB/s-185KiB/s (177kB/s-190kB/s), io=23.4MiB (24.5MB), run=32564-34168msec WRITE: bw=738KiB/s (755kB/s), 178KiB/s-197KiB/s (183kB/s-202kB/s), io=24.6MiB (25.8MB), run=32564-34168msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179219: Fri Sep 4 06:36:48 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5920KiB/46467msec) clat (msec): min=8, max=211, avg=47.88, stdev=40.64 lat (msec): min=8, max=211, avg=47.88, stdev=40.64 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 69], 90.00th=[ 108], 95.00th=[ 142], | 99.00th=[ 190], 99.50th=[ 207], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 407, per=24.82%, avg=127.84, stdev=80.99, samples=89 iops : min= 1, max= 25, avg= 7.17, stdev= 5.14, samples=89 write: IOPS=8, BW=137KiB/s (140kB/s)(6368KiB/46467msec); 0 zone resets clat (msec): min=10, max=290, avg=72.10, stdev=47.66 lat (msec): min=10, max=290, avg=72.10, stdev=47.66 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 69], | 70.00th=[ 87], 80.00th=[ 104], 90.00th=[ 140], 95.00th=[ 171], | 99.00th=[ 257], 99.50th=[ 279], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 348, per=25.08%, avg=135.91, stdev=73.89, samples=91 iops : min= 1, max= 21, avg= 7.67, stdev= 4.65, samples=91 lat (msec) : 10=0.78%, 20=10.29%, 50=46.61%, 100=25.26%, 250=16.54% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.41%, ctx=1100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179220: Fri Sep 4 06:36:48 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(5744KiB/45839msec) clat (msec): min=7, max=222, avg=46.50, stdev=38.33 lat (msec): min=7, max=222, avg=46.50, stdev=38.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 63], 90.00th=[ 104], 95.00th=[ 144], | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 479, per=24.37%, avg=125.49, stdev=83.31, samples=89 iops : min= 1, max= 29, avg= 7.01, stdev= 5.25, samples=89 write: IOPS=8, BW=143KiB/s (146kB/s)(6544KiB/45839msec); 0 zone resets clat (msec): min=16, max=257, avg=70.85, stdev=46.09 lat (msec): min=16, max=257, avg=70.85, stdev=46.09 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 82], 80.00th=[ 100], 90.00th=[ 136], 95.00th=[ 163], | 99.00th=[ 224], 99.50th=[ 247], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 30, max= 410, per=26.05%, avg=141.17, stdev=80.91, samples=90 iops : min= 1, max= 25, avg= 8.01, stdev= 5.12, samples=90 lat (msec) : 10=0.78%, 20=10.29%, 50=44.53%, 100=28.78%, 250=15.36% lat (msec) : 500=0.26% cpu : usr=0.03%, sys=1.53%, ctx=1159, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179221: Fri Sep 4 06:36:48 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/46089msec) clat (msec): min=6, max=270, avg=49.15, stdev=45.15 lat (msec): min=6, max=270, avg=49.15, stdev=45.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 116], 95.00th=[ 144], | 99.00th=[ 247], 99.50th=[ 264], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 412, per=26.62%, avg=137.09, stdev=91.12, samples=90 iops : min= 1, max= 25, avg= 7.74, stdev= 5.74, samples=90 write: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/46089msec); 0 zone resets clat (msec): min=11, max=264, avg=70.70, stdev=44.78 lat (msec): min=11, max=264, avg=70.70, stdev=44.78 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 55], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 106], 90.00th=[ 138], 95.00th=[ 157], | 99.00th=[ 222], 99.50th=[ 228], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 343, per=24.25%, avg=131.41, stdev=74.05, samples=90 iops : min= 1, max= 21, avg= 7.39, stdev= 4.67, samples=90 lat (msec) : 10=1.17%, 20=12.24%, 50=43.10%, 100=25.91%, 250=17.06% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.57%, ctx=1172, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179222: Fri Sep 4 06:36:48 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(6032KiB/46309msec) clat (msec): min=6, max=243, avg=50.78, stdev=41.31 lat (msec): min=6, max=243, avg=50.78, stdev=41.31 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 83], 90.00th=[ 117], 95.00th=[ 140], | 99.00th=[ 180], 99.50th=[ 192], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 416, per=25.83%, avg=133.05, stdev=82.73, samples=88 iops : min= 1, max= 26, avg= 7.48, stdev= 5.21, samples=88 write: IOPS=8, BW=135KiB/s (138kB/s)(6256KiB/46309msec); 0 zone resets clat (msec): min=14, max=281, avg=68.98, stdev=44.74 lat (msec): min=14, max=281, avg=68.98, stdev=44.74 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 67], | 70.00th=[ 81], 80.00th=[ 100], 90.00th=[ 127], 95.00th=[ 155], | 99.00th=[ 220], 99.50th=[ 253], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 470, per=24.76%, avg=134.18, stdev=84.08, samples=91 iops : min= 1, max= 29, avg= 7.56, stdev= 5.33, samples=91 lat (msec) : 10=0.78%, 20=9.77%, 50=44.92%, 100=27.73%, 250=16.54% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.56%, ctx=1220, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=515KiB/s (528kB/s), 125KiB/s-136KiB/s (128kB/s-139kB/s), io=23.4MiB (24.5MB), run=45839-46467msec WRITE: bw=542KiB/s (555kB/s), 131KiB/s-143KiB/s (134kB/s-146kB/s), io=24.6MiB (25.8MB), run=45839-46467msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179240: Fri Sep 4 06:37:03 2026 read: IOPS=2, BW=2118KiB/s (2168kB/s)(7168KiB/3385msec) clat (usec): min=491, max=276812, avg=167744.70, stdev=92067.50 lat (usec): min=493, max=276813, avg=167746.24, stdev=92067.55 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[108528], | 30.00th=[149947], 40.00th=[149947], 50.00th=[189793], 60.00th=[212861], | 70.00th=[212861], 80.00th=[235930], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 2015, max= 4219, per=63.09%, avg=2574.00, stdev=1096.74, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1513KiB/s (1549kB/s)(5120KiB/3385msec); 0 zone resets clat (msec): min=214, max=778, avg=432.51, stdev=219.70 lat (msec): min=214, max=778, avg=432.58, stdev=219.71 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2019, max= 2043, per=35.56%, avg=2031.00, stdev=13.86, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=15.40%, ctx=152, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179241: Fri Sep 4 06:37:03 2026 read: IOPS=0, BW=408KiB/s (418kB/s)(2048KiB/5019msec) clat (usec): min=635, max=463323, avg=231979.67, stdev=327169.41 lat (usec): min=637, max=463325, avg=231981.42, stdev=327170.33 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[ 635], 50.00th=[ 635], 60.00th=[463471], | 70.00th=[463471], 80.00th=[463471], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 1444, max= 2019, per=42.44%, avg=1731.50, stdev=406.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2040KiB/s (2089kB/s)(10.0MiB/5019msec); 0 zone resets clat (msec): min=221, max=764, avg=441.75, stdev=171.49 lat (msec): min=221, max=764, avg=441.94, stdev=171.42 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 241], | 30.00th=[ 334], 40.00th=[ 384], 50.00th=[ 401], 60.00th=[ 418], | 70.00th=[ 464], 80.00th=[ 542], 90.00th=[ 651], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2015, max= 4039, per=45.52%, avg=2600.14, stdev=977.54, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.04%, sys=16.62%, ctx=186, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179242: Fri Sep 4 06:37:03 2026 read: IOPS=1, BW=1964KiB/s (2011kB/s)(6144KiB/3128msec) clat (usec): min=497, max=278493, avg=153113.26, stdev=126870.30 lat (usec): min=499, max=278494, avg=153114.44, stdev=126869.95 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[147850], 50.00th=[147850], 60.00th=[221250], | 70.00th=[270533], 80.00th=[270533], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2019, max= 4031, per=62.11%, avg=2534.00, stdev=998.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1964KiB/s (2011kB/s)(6144KiB/3128msec); 0 zone resets clat (msec): min=159, max=650, avg=348.95, stdev=163.56 lat (msec): min=159, max=650, avg=349.14, stdev=163.50 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 347], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2015, max= 2809, per=39.00%, avg=2227.50, stdev=387.89, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=16.92%, ctx=182, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179243: Fri Sep 4 06:37:03 2026 read: IOPS=1, BW=1636KiB/s (1676kB/s)(5120KiB/3129msec) clat (usec): min=627, max=325604, avg=85256.17, stdev=140336.80 lat (usec): min=628, max=325604, avg=85257.21, stdev=140336.46 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 627], | 30.00th=[ 1205], 40.00th=[ 1205], 50.00th=[ 3523], 60.00th=[ 3523], | 70.00th=[ 94897], 80.00th=[ 94897], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2291KiB/s (2346kB/s)(7168KiB/3129msec); 0 zone resets clat (msec): min=159, max=622, avg=352.29, stdev=147.28 lat (msec): min=159, max=622, avg=352.35, stdev=147.28 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 271], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 300], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 426], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1477, max= 4031, per=41.89%, avg=2392.50, stdev=1123.16, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=8.33%, 500=50.00% lat (msec) : 750=8.33% cpu : usr=0.00%, sys=14.64%, ctx=150, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4080KiB/s (4178kB/s), 408KiB/s-2118KiB/s (418kB/s-2168kB/s), io=20.0MiB (20.0MB), run=3128-5019msec WRITE: bw=5713KiB/s (5850kB/s), 1513KiB/s-2291KiB/s (1549kB/s-2346kB/s), io=28.0MiB (29.4MB), run=3128-5019msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179245: Fri Sep 4 06:37:03 2026 read: IOPS=1, BW=1653KiB/s (1693kB/s)(7168KiB/4336msec) clat (msec): min=72, max=811, avg=296.07, stdev=314.44 lat (msec): min=72, max=811, avg=296.07, stdev=314.44 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 105], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 134], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 693], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2007, max= 4047, per=67.49%, avg=2940.00, stdev=1078.41, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1181KiB/s (1209kB/s)(5120KiB/4336msec); 0 zone resets clat (msec): min=258, max=865, avg=418.11, stdev=254.37 lat (msec): min=259, max=865, avg=418.29, stdev=254.32 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1841, max= 4087, per=43.37%, avg=2645.00, stdev=1251.56, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=7.27%, ctx=107, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179246: Fri Sep 4 06:37:03 2026 read: IOPS=0, BW=436KiB/s (446kB/s)(2048KiB/4701msec) clat (msec): min=123, max=155, avg=139.62, stdev=22.77 lat (msec): min=123, max=155, avg=139.62, stdev=22.77 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 157], 95.00th=[ 157], | 99.00th=[ 157], 99.50th=[ 157], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 1404, max= 2039, per=39.52%, avg=1721.50, stdev=449.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2178KiB/s (2231kB/s)(10.0MiB/4701msec); 0 zone resets clat (msec): min=173, max=758, avg=418.94, stdev=194.47 lat (msec): min=173, max=758, avg=419.09, stdev=194.41 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 180], | 30.00th=[ 255], 40.00th=[ 305], 50.00th=[ 384], 60.00th=[ 451], | 70.00th=[ 527], 80.00th=[ 550], 90.00th=[ 609], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1851, max= 4079, per=43.62%, avg=2660.17, stdev=1050.65, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=8.40%, ctx=178, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179247: Fri Sep 4 06:37:03 2026 read: IOPS=1, BW=1479KiB/s (1515kB/s)(6144KiB/4154msec) clat (msec): min=76, max=713, avg=350.57, stdev=251.49 lat (msec): min=76, max=713, avg=350.57, stdev=251.49 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 372], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2031, max= 4079, per=58.45%, avg=2546.00, stdev=1022.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1479KiB/s (1515kB/s)(6144KiB/4154msec); 0 zone resets clat (msec): min=121, max=538, avg=315.44, stdev=148.38 lat (msec): min=121, max=538, avg=315.72, stdev=148.41 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 317], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1551, max= 2039, per=30.99%, avg=1889.80, stdev=204.06, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=25.00% cpu : usr=0.00%, sys=4.65%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179248: Fri Sep 4 06:37:03 2026 read: IOPS=1, BW=1349KiB/s (1382kB/s)(5120KiB/3794msec) clat (msec): min=88, max=532, avg=204.09, stdev=185.09 lat (msec): min=88, max=532, avg=204.09, stdev=185.09 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 136], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 3946, max= 4079, per=92.11%, avg=4012.50, stdev=94.05, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1889KiB/s (1935kB/s)(7168KiB/3794msec); 0 zone resets clat (msec): min=99, max=608, avg=374.66, stdev=198.33 lat (msec): min=99, max=608, avg=374.78, stdev=198.30 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 211], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 439], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 592], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2031, max= 3703, per=42.46%, avg=2589.67, stdev=964.18, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=6.96%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4357KiB/s (4461kB/s), 436KiB/s-1653KiB/s (446kB/s-1693kB/s), io=20.0MiB (20.0MB), run=3794-4701msec WRITE: bw=6099KiB/s (6246kB/s), 1181KiB/s-2178KiB/s (1209kB/s-2231kB/s), io=28.0MiB (29.4MB), run=3794-4701msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179255: Fri Sep 4 06:37:17 2026 read: IOPS=1, BW=6038KiB/s (6183kB/s)(12.0MiB/2035msec) clat (msec): min=622, max=667, avg=651.16, stdev=24.84 lat (msec): min=622, max=667, avg=651.17, stdev=24.84 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 5760, max= 8159, per=97.83%, avg=6959.50, stdev=1696.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=16.86%, ctx=326, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179256: Fri Sep 4 06:37:17 2026 read: IOPS=0, BW=1779KiB/s (1821kB/s)(4096KiB/2303msec) clat (nsec): min=734469k, max=734469k, avg=734468854.00, stdev= 0.00 lat (nsec): min=734472k, max=734472k, avg=734472099.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3557KiB/s (3642kB/s)(8192KiB/2303msec); 0 zone resets clat (msec): min=312, max=1204, avg=758.41, stdev=630.66 lat (msec): min=313, max=1204, avg=759.10, stdev=630.19 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8126, max= 8126, per=73.36%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.65%, ctx=100, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179257: Fri Sep 4 06:37:17 2026 write: IOPS=1, BW=4154KiB/s (4254kB/s)(12.0MiB/2958msec); 0 zone resets clat (msec): min=245, max=2151, avg=976.16, stdev=1028.23 lat (msec): min=245, max=2152, avg=977.02, stdev=1028.04 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8031, max= 8031, per=72.50%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.58%, ctx=106, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179259: Fri Sep 4 06:37:17 2026 write: IOPS=1, BW=4865KiB/s (4981kB/s)(12.0MiB/2526msec); 0 zone resets clat (msec): min=565, max=1282, avg=826.17, stdev=396.31 lat (msec): min=565, max=1282, avg=826.60, stdev=396.36 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 5649, max= 8159, per=62.33%, avg=6904.00, stdev=1774.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=5.19%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7114KiB/s (7285kB/s), 1779KiB/s-6038KiB/s (1821kB/s-6183kB/s), io=16.0MiB (16.8MB), run=2035-2303msec WRITE: bw=10.8MiB/s (11.3MB/s), 3557KiB/s-4865KiB/s (3642kB/s-4981kB/s), io=32.0MiB (33.6MB), run=2303-2958msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179258: Fri Sep 4 06:37:17 2026 read: IOPS=1, BW=5505KiB/s (5638kB/s)(12.0MiB/2232msec) clat (msec): min=314, max=982, avg=721.63, stdev=356.99 lat (msec): min=314, max=982, avg=721.63, stdev=356.99 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.65%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179260: Fri Sep 4 06:37:17 2026 read: IOPS=0, BW=1444KiB/s (1479kB/s)(4096KiB/2836msec) clat (nsec): min=1270.7M, max=1270.7M, avg=1270713004.00, stdev= 0.00 lat (nsec): min=1270.7M, max=1270.7M, avg=1270715225.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2889KiB/s (2958kB/s)(8192KiB/2836msec); 0 zone resets clat (msec): min=447, max=1016, avg=732.06, stdev=402.15 lat (msec): min=450, max=1016, avg=733.92, stdev=400.18 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8159, max= 8159, per=70.62%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.30%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179261: Fri Sep 4 06:37:17 2026 write: IOPS=1, BW=4927KiB/s (5045kB/s)(12.0MiB/2494msec); 0 zone resets clat (msec): min=352, max=1566, avg=793.21, stdev=672.02 lat (msec): min=352, max=1567, avg=793.64, stdev=672.01 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8094, max= 8143, per=70.27%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.33%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179262: Fri Sep 4 06:37:17 2026 write: IOPS=1, BW=4785KiB/s (4900kB/s)(12.0MiB/2568msec); 0 zone resets clat (msec): min=802, max=854, avg=823.85, stdev=27.15 lat (msec): min=802, max=855, avg=824.66, stdev=27.78 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8078, max= 8094, per=69.98%, avg=8086.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=5.03%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5777KiB/s (5916kB/s), 1444KiB/s-5505KiB/s (1479kB/s-5638kB/s), io=16.0MiB (16.8MB), run=2232-2836msec WRITE: bw=11.3MiB/s (11.8MB/s), 2889KiB/s-4927KiB/s (2958kB/s-5045kB/s), io=32.0MiB (33.6MB), run=2494-2836msec