== sanity test 398b: DIO and buffer IO race ============== 13:15:08 (1789060508) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.2191 s, 9.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179172: Thu Sep 10 13:17:29 2026 read: IOPS=11, BW=47.9KiB/s (49.1kB/s)(5992KiB/125092msec) clat (usec): min=49, max=253803, avg=45371.59, stdev=30740.68 lat (usec): min=49, max=253804, avg=45378.46, stdev=30747.02 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 11207], 10.00th=[ 16319], 20.00th=[ 22152], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[158335], 99.50th=[170918], 99.90th=[217056], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 103, per=24.96%, avg=47.68, stdev=18.91, samples=245 iops : min= 1, max= 25, avg=11.26, stdev= 4.77, samples=245 write: IOPS=12, BW=50.3KiB/s (51.5kB/s)(6296KiB/125092msec); 0 zone resets clat (usec): min=1024, max=850110, avg=36025.22, stdev=42143.37 lat (usec): min=1024, max=850111, avg=36028.96, stdev=42144.14 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1319], 10.00th=[ 1942], 20.00th=[ 4113], | 30.00th=[ 8586], 40.00th=[ 16712], 50.00th=[ 25035], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[110625], | 99.00th=[164627], 99.50th=[175113], 99.90th=[233833], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 135, per=25.16%, avg=50.32, stdev=23.31, samples=244 iops : min= 1, max= 33, avg=11.92, stdev= 5.85, samples=244 lat (usec) : 50=0.03%, 100=1.46%, 250=0.26%, 500=0.10% lat (msec) : 2=5.34%, 4=4.56%, 10=6.97%, 20=11.56%, 50=39.71% lat (msec) : 100=23.54%, 250=6.41%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.45%, ctx=6687, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179173: Thu Sep 10 13:17:29 2026 read: IOPS=12, BW=48.9KiB/s (50.0kB/s)(5940KiB/121538msec) clat (usec): min=42, max=329145, avg=46275.90, stdev=31492.99 lat (usec): min=43, max=329147, avg=46279.61, stdev=31492.37 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 12125], 10.00th=[ 16581], 20.00th=[ 22938], | 30.00th=[ 28705], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 54789], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[154141], 99.50th=[187696], 99.90th=[304088], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 104, per=25.45%, avg=48.60, stdev=19.87, samples=239 iops : min= 1, max= 26, avg=11.49, stdev= 5.01, samples=239 write: IOPS=13, BW=52.2KiB/s (53.5kB/s)(6348KiB/121538msec); 0 zone resets clat (usec): min=961, max=893888, avg=33031.66, stdev=41862.80 lat (usec): min=962, max=893889, avg=33034.39, stdev=41862.72 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1860], 20.00th=[ 3654], | 30.00th=[ 6652], 40.00th=[ 13173], 50.00th=[ 22414], 60.00th=[ 30802], | 70.00th=[ 41157], 80.00th=[ 54789], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[168821], 99.50th=[189793], 99.90th=[329253], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 136, per=26.00%, avg=52.00, stdev=24.33, samples=238 iops : min= 1, max= 34, avg=12.35, stdev= 6.11, samples=238 lat (usec) : 50=0.07%, 100=1.43%, 250=0.10%, 500=0.10%, 1000=0.13% lat (msec) : 2=5.66%, 4=5.31%, 10=8.17%, 20=10.38%, 50=39.36% lat (msec) : 100=24.12%, 250=5.01%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=5.30%, ctx=6531, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179174: Thu Sep 10 13:17:29 2026 read: IOPS=12, BW=48.7KiB/s (49.8kB/s)(6028KiB/123839msec) clat (usec): min=34, max=382195, avg=44715.30, stdev=30283.93 lat (usec): min=34, max=382197, avg=44716.64, stdev=30283.97 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 10421], 10.00th=[ 16581], 20.00th=[ 22414], | 30.00th=[ 27657], 40.00th=[ 32375], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[145753], 99.50th=[156238], 99.90th=[254804], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 111, per=25.31%, avg=48.33, stdev=20.97, samples=243 iops : min= 1, max= 27, avg=11.43, stdev= 5.26, samples=243 write: IOPS=12, BW=50.5KiB/s (51.8kB/s)(6260KiB/123839msec); 0 zone resets clat (usec): min=965, max=910419, avg=35817.39, stdev=42996.39 lat (usec): min=966, max=910420, avg=35819.12, stdev=42996.43 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 1729], 20.00th=[ 4080], | 30.00th=[ 7767], 40.00th=[ 15795], 50.00th=[ 24773], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[108528], | 99.00th=[170918], 99.50th=[185598], 99.90th=[235930], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 141, per=25.12%, avg=50.24, stdev=22.64, samples=242 iops : min= 1, max= 35, avg=11.92, stdev= 5.71, samples=242 lat (usec) : 50=0.10%, 100=1.60%, 250=0.36%, 500=0.07%, 1000=0.10% lat (msec) : 2=5.83%, 4=4.20%, 10=7.16%, 20=10.74%, 50=39.39% lat (msec) : 100=24.61%, 250=5.76%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.53%, ctx=6770, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179175: Thu Sep 10 13:17:29 2026 read: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6052KiB/124951msec) clat (usec): min=42, max=847278, avg=45555.46, stdev=37286.56 lat (usec): min=43, max=847279, avg=45557.72, stdev=37286.55 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 8848], 10.00th=[ 16319], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[149947], 99.50th=[187696], 99.90th=[283116], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 112, per=25.20%, avg=48.13, stdev=19.95, samples=246 iops : min= 1, max= 28, avg=11.37, stdev= 5.01, samples=246 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6236KiB/124951msec); 0 zone resets clat (usec): min=1023, max=243279, avg=35627.73, stdev=36606.41 lat (usec): min=1023, max=243281, avg=35629.74, stdev=36606.15 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1401], 10.00th=[ 2147], 20.00th=[ 4293], | 30.00th=[ 8291], 40.00th=[ 17171], 50.00th=[ 25297], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 60031], 90.00th=[ 82314], 95.00th=[112722], | 99.00th=[162530], 99.50th=[187696], 99.90th=[233833], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 133, per=24.98%, avg=49.95, stdev=22.77, samples=244 iops : min= 1, max= 33, avg=11.84, stdev= 5.73, samples=244 lat (usec) : 50=0.10%, 100=1.82%, 250=0.07%, 500=0.07%, 1000=0.07% lat (msec) : 2=4.69%, 4=4.98%, 10=7.58%, 20=10.32%, 50=39.78% lat (msec) : 100=24.45%, 250=5.99%, 500=0.07%, 1000=0.03% cpu : usr=0.10%, sys=5.39%, ctx=6768, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=192KiB/s (197kB/s), 47.9KiB/s-48.9KiB/s (49.1kB/s-50.0kB/s), io=23.4MiB (24.6MB), run=121538-125092msec WRITE: bw=201KiB/s (206kB/s), 49.9KiB/s-52.2KiB/s (51.1kB/s-53.5kB/s), io=24.6MiB (25.7MB), run=121538-125092msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179167: Thu Sep 10 13:18:08 2026 read: IOPS=9, BW=37.1KiB/s (38.0kB/s)(5992KiB/161391msec) clat (msec): min=4, max=933, avg=41.61, stdev=45.17 lat (msec): min=4, max=933, avg=41.61, stdev=45.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 121], | 99.00th=[ 205], 99.50th=[ 251], 99.90th=[ 309], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 143, per=25.98%, avg=37.93, stdev=25.78, samples=306 iops : min= 1, max= 35, avg= 8.81, stdev= 6.48, samples=306 write: IOPS=9, BW=39.0KiB/s (39.9kB/s)(6296KiB/161391msec); 0 zone resets clat (msec): min=9, max=462, avg=62.68, stdev=46.74 lat (msec): min=9, max=462, avg=62.68, stdev=46.74 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 123], 95.00th=[ 146], | 99.00th=[ 232], 99.50th=[ 292], 99.90th=[ 456], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 127, per=25.59%, avg=39.15, stdev=24.44, samples=312 iops : min= 1, max= 31, avg= 9.12, stdev= 6.16, samples=312 lat (msec) : 10=2.08%, 20=16.70%, 50=45.08%, 100=24.09%, 250=11.49% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.07%, sys=1.84%, ctx=4815, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179168: Thu Sep 10 13:18:08 2026 read: IOPS=9, BW=36.3KiB/s (37.2kB/s)(5940KiB/163488msec) clat (msec): min=5, max=881, avg=43.39, stdev=47.59 lat (msec): min=5, max=881, avg=43.40, stdev=47.59 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 62], 90.00th=[ 101], 95.00th=[ 131], | 99.00th=[ 209], 99.50th=[ 253], 99.90th=[ 376], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 127, per=25.48%, avg=37.21, stdev=25.96, samples=311 iops : min= 1, max= 31, avg= 8.63, stdev= 6.54, samples=311 write: IOPS=9, BW=38.8KiB/s (39.8kB/s)(6348KiB/163488msec); 0 zone resets clat (msec): min=8, max=513, avg=62.15, stdev=47.71 lat (msec): min=8, max=513, avg=62.15, stdev=47.71 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 122], 95.00th=[ 153], | 99.00th=[ 228], 99.50th=[ 288], 99.90th=[ 468], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7, max= 119, per=25.51%, avg=39.03, stdev=25.54, samples=317 iops : min= 1, max= 29, avg= 9.09, stdev= 6.43, samples=317 lat (msec) : 10=2.57%, 20=16.50%, 50=45.61%, 100=22.14%, 250=12.50% lat (msec) : 500=0.62%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=1.86%, ctx=4925, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179169: Thu Sep 10 13:18:08 2026 read: IOPS=9, BW=37.0KiB/s (37.9kB/s)(6028KiB/162773msec) clat (msec): min=5, max=376, avg=43.06, stdev=41.93 lat (msec): min=5, max=376, avg=43.06, stdev=41.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 207], 99.50th=[ 245], 99.90th=[ 338], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 135, per=25.53%, avg=37.27, stdev=25.28, samples=314 iops : min= 1, max= 33, avg= 8.65, stdev= 6.36, samples=314 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6260KiB/162773msec); 0 zone resets clat (msec): min=8, max=893, avg=62.25, stdev=50.55 lat (msec): min=8, max=893, avg=62.26, stdev=50.55 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 232], 99.50th=[ 288], 99.90th=[ 409], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 111, per=25.19%, avg=38.53, stdev=24.45, samples=315 iops : min= 1, max= 27, avg= 8.96, stdev= 6.16, samples=315 lat (msec) : 10=2.34%, 20=14.81%, 50=47.62%, 100=22.62%, 250=12.04% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.06%, sys=1.84%, ctx=4795, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179171: Thu Sep 10 13:18:08 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6052KiB/162158msec) clat (msec): min=5, max=359, avg=41.34, stdev=39.84 lat (msec): min=5, max=359, avg=41.34, stdev=39.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 94], 95.00th=[ 123], | 99.00th=[ 207], 99.50th=[ 251], 99.90th=[ 284], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 158, per=26.41%, avg=38.56, stdev=26.07, samples=305 iops : min= 1, max= 39, avg= 8.98, stdev= 6.56, samples=305 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6236KiB/162158msec); 0 zone resets clat (msec): min=11, max=867, avg=63.61, stdev=50.81 lat (msec): min=11, max=867, avg=63.62, stdev=50.81 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 93], 90.00th=[ 126], 95.00th=[ 161], | 99.00th=[ 230], 99.50th=[ 268], 99.90th=[ 376], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 135, per=25.14%, avg=38.46, stdev=24.40, samples=315 iops : min= 1, max= 33, avg= 8.94, stdev= 6.15, samples=315 lat (msec) : 10=2.51%, 20=16.47%, 50=45.54%, 100=22.56%, 250=12.37% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.06%, sys=1.91%, ctx=4825, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (150kB/s), 36.3KiB/s-37.3KiB/s (37.2kB/s-38.2kB/s), io=23.4MiB (24.6MB), run=161391-163488msec WRITE: bw=154KiB/s (157kB/s), 38.5KiB/s-39.0KiB/s (39.4kB/s-39.9kB/s), io=24.6MiB (25.7MB), run=161391-163488msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179214: Thu Sep 10 13:18:55 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5920KiB/37398msec) clat (usec): min=32, max=271165, avg=51758.63, stdev=36406.70 lat (usec): min=33, max=271167, avg=51761.21, stdev=36406.43 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 85], 10.00th=[ 17433], 20.00th=[ 25035], | 30.00th=[ 31851], 40.00th=[ 38011], 50.00th=[ 43779], 60.00th=[ 52167], | 70.00th=[ 62129], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[126354], | 99.00th=[158335], 99.50th=[227541], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 441, per=24.54%, avg=157.08, stdev=83.79, samples=73 iops : min= 1, max= 27, avg= 9.01, stdev= 5.30, samples=73 write: IOPS=10, BW=170KiB/s (174kB/s)(6368KiB/37398msec); 0 zone resets clat (usec): min=1576, max=304322, avg=45413.46, stdev=45826.13 lat (usec): min=1579, max=304324, avg=45417.25, stdev=45825.43 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2376], 10.00th=[ 3359], 20.00th=[ 6652], | 30.00th=[ 14484], 40.00th=[ 24249], 50.00th=[ 32375], 60.00th=[ 40109], | 70.00th=[ 56361], 80.00th=[ 77071], 90.00th=[109577], 95.00th=[135267], | 99.00th=[233833], 99.50th=[295699], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 542, per=25.65%, avg=172.64, stdev=85.21, samples=72 iops : min= 1, max= 33, avg= 9.99, stdev= 5.35, samples=72 lat (usec) : 50=0.39%, 100=2.21%, 250=0.65%, 750=0.13% lat (msec) : 2=1.82%, 4=4.82%, 10=5.73%, 20=9.51%, 50=37.63% lat (msec) : 100=26.82%, 250=9.77%, 500=0.52% cpu : usr=0.07%, sys=5.88%, ctx=1834, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179215: Thu Sep 10 13:18:55 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(5744KiB/35815msec) clat (usec): min=44, max=177021, avg=50646.26, stdev=33178.53 lat (usec): min=45, max=177023, avg=50648.08, stdev=33178.71 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 78], 10.00th=[ 13829], 20.00th=[ 25035], | 30.00th=[ 31589], 40.00th=[ 39584], 50.00th=[ 47449], 60.00th=[ 53740], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[168821], 99.50th=[175113], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 63, max= 312, per=25.32%, avg=162.03, stdev=56.02, samples=69 iops : min= 3, max= 19, avg= 9.32, stdev= 3.53, samples=69 write: IOPS=11, BW=183KiB/s (187kB/s)(6544KiB/35815msec); 0 zone resets clat (usec): min=1521, max=233622, avg=42619.39, stdev=41864.39 lat (usec): min=1523, max=233625, avg=42628.64, stdev=41874.96 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2278], 10.00th=[ 4113], 20.00th=[ 6587], | 30.00th=[ 13042], 40.00th=[ 21627], 50.00th=[ 32375], 60.00th=[ 43254], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[126354], | 99.00th=[191890], 99.50th=[225444], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 383, per=26.98%, avg=181.57, stdev=82.83, samples=70 iops : min= 1, max= 23, avg=10.56, stdev= 5.20, samples=70 lat (usec) : 50=0.39%, 100=3.39%, 250=0.26% lat (msec) : 2=2.08%, 4=2.99%, 10=9.64%, 20=8.20%, 50=33.85% lat (msec) : 100=30.34%, 250=8.85% cpu : usr=0.07%, sys=5.46%, ctx=1748, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179216: Thu Sep 10 13:18:55 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36769msec) clat (usec): min=39, max=258865, avg=52525.85, stdev=38453.06 lat (usec): min=40, max=258867, avg=52527.56, stdev=38453.06 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 77], 10.00th=[ 4621], 20.00th=[ 23987], | 30.00th=[ 31065], 40.00th=[ 38536], 50.00th=[ 45876], 60.00th=[ 53740], | 70.00th=[ 65274], 80.00th=[ 78119], 90.00th=[104334], 95.00th=[117965], | 99.00th=[189793], 99.50th=[200279], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 384, per=26.33%, avg=168.54, stdev=73.38, samples=72 iops : min= 1, max= 24, avg= 9.74, stdev= 4.67, samples=72 write: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36769msec); 0 zone resets clat (usec): min=1421, max=272973, avg=42867.21, stdev=45130.95 lat (usec): min=1424, max=272975, avg=42872.30, stdev=45130.45 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2311], 10.00th=[ 3785], 20.00th=[ 6652], | 30.00th=[ 11338], 40.00th=[ 20055], 50.00th=[ 31851], 60.00th=[ 40633], | 70.00th=[ 53740], 80.00th=[ 68682], 90.00th=[ 98042], 95.00th=[125305], | 99.00th=[246416], 99.50th=[270533], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 542, per=24.20%, avg=162.86, stdev=83.20, samples=71 iops : min= 1, max= 33, avg= 9.38, stdev= 5.24, samples=71 lat (usec) : 50=0.26%, 100=3.52%, 250=0.91%, 500=0.13% lat (msec) : 2=1.17%, 4=4.43%, 10=8.72%, 20=8.59%, 50=33.98% lat (msec) : 100=27.86%, 250=9.90%, 500=0.52% cpu : usr=0.10%, sys=5.35%, ctx=1783, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179217: Thu Sep 10 13:18:55 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(6032KiB/35866msec) clat (usec): min=42, max=298751, avg=52391.22, stdev=42630.82 lat (usec): min=43, max=298752, avg=52393.17, stdev=42630.53 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 92], 20.00th=[ 25297], | 30.00th=[ 33424], 40.00th=[ 40109], 50.00th=[ 45351], 60.00th=[ 54789], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[278922], 99.50th=[291505], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 30, max= 287, per=25.94%, avg=166.01, stdev=64.57, samples=70 iops : min= 1, max= 17, avg= 9.57, stdev= 4.05, samples=70 write: IOPS=10, BW=174KiB/s (179kB/s)(6256KiB/35866msec); 0 zone resets clat (usec): min=1699, max=317175, avg=40821.31, stdev=43388.43 lat (usec): min=1702, max=317175, avg=40824.27, stdev=43388.54 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2278], 10.00th=[ 3884], 20.00th=[ 6718], | 30.00th=[ 11338], 40.00th=[ 17433], 50.00th=[ 28967], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[122160], | 99.00th=[223347], 99.50th=[283116], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 349, per=25.52%, avg=171.74, stdev=76.72, samples=70 iops : min= 1, max= 21, avg= 9.93, stdev= 4.82, samples=70 lat (usec) : 50=0.39%, 100=4.69%, 250=0.39%, 750=0.13% lat (msec) : 2=1.69%, 4=4.04%, 10=9.11%, 20=9.24%, 50=34.11% lat (msec) : 100=28.26%, 250=7.03%, 500=0.91% cpu : usr=0.07%, sys=5.44%, ctx=1743, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=640KiB/s (656kB/s), 158KiB/s-170KiB/s (162kB/s-174kB/s), io=23.4MiB (24.5MB), run=35815-37398msec WRITE: bw=674KiB/s (690kB/s), 164KiB/s-183KiB/s (168kB/s-187kB/s), io=24.6MiB (25.8MB), run=35815-37398msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179219: Thu Sep 10 13:19:07 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(5920KiB/49233msec) clat (msec): min=7, max=236, avg=50.35, stdev=40.21 lat (msec): min=7, max=236, avg=50.36, stdev=40.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 56], 80.00th=[ 73], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 188], 99.50th=[ 220], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 30, max= 416, per=26.03%, avg=126.49, stdev=79.58, samples=92 iops : min= 1, max= 26, avg= 7.12, stdev= 5.05, samples=92 write: IOPS=8, BW=129KiB/s (132kB/s)(6368KiB/49233msec); 0 zone resets clat (msec): min=10, max=341, avg=76.71, stdev=53.97 lat (msec): min=10, max=341, avg=76.72, stdev=53.97 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 72], | 70.00th=[ 86], 80.00th=[ 107], 90.00th=[ 148], 95.00th=[ 186], | 99.00th=[ 288], 99.50th=[ 317], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 318, per=25.50%, avg=130.28, stdev=70.68, samples=96 iops : min= 1, max= 19, avg= 7.35, stdev= 4.51, samples=96 lat (msec) : 10=0.78%, 20=7.94%, 50=44.53%, 100=29.82%, 250=15.89% lat (msec) : 500=1.04% cpu : usr=0.06%, sys=1.79%, ctx=1226, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179220: Thu Sep 10 13:19:07 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5744KiB/49082msec) clat (msec): min=8, max=487, avg=52.61, stdev=48.89 lat (msec): min=8, max=487, avg=52.61, stdev=48.89 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 79], 90.00th=[ 114], 95.00th=[ 146], | 99.00th=[ 220], 99.50th=[ 268], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 24, max= 382, per=25.39%, avg=123.38, stdev=79.35, samples=90 iops : min= 1, max= 23, avg= 6.91, stdev= 5.04, samples=90 write: IOPS=8, BW=133KiB/s (137kB/s)(6544KiB/49082msec); 0 zone resets clat (msec): min=12, max=402, avg=73.69, stdev=51.27 lat (msec): min=12, max=402, avg=73.70, stdev=51.27 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 87], 80.00th=[ 105], 90.00th=[ 138], 95.00th=[ 171], | 99.00th=[ 245], 99.50th=[ 264], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 347, per=26.34%, avg=134.57, stdev=72.11, samples=94 iops : min= 1, max= 21, avg= 7.62, stdev= 4.57, samples=94 lat (msec) : 10=0.39%, 20=8.59%, 50=45.05%, 100=27.99%, 250=17.19% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=1.69%, ctx=1151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179221: Thu Sep 10 13:19:07 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(6256KiB/48029msec) clat (msec): min=8, max=491, avg=49.98, stdev=46.75 lat (msec): min=8, max=491, avg=49.98, stdev=46.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 63], 90.00th=[ 108], 95.00th=[ 144], | 99.00th=[ 228], 99.50th=[ 275], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 414, per=27.45%, avg=133.40, stdev=88.72, samples=92 iops : min= 1, max= 25, avg= 7.55, stdev= 5.63, samples=92 write: IOPS=7, BW=126KiB/s (129kB/s)(6032KiB/48029msec); 0 zone resets clat (msec): min=13, max=399, avg=75.36, stdev=51.22 lat (msec): min=13, max=399, avg=75.36, stdev=51.22 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 74], | 70.00th=[ 93], 80.00th=[ 110], 90.00th=[ 138], 95.00th=[ 174], | 99.00th=[ 262], 99.50th=[ 326], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 30, max= 382, per=24.51%, avg=125.26, stdev=72.32, samples=93 iops : min= 1, max= 23, avg= 7.02, stdev= 4.58, samples=93 lat (msec) : 10=0.65%, 20=8.07%, 50=47.79%, 100=25.91%, 250=16.80% lat (msec) : 500=0.78% cpu : usr=0.07%, sys=1.76%, ctx=1222, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179222: Thu Sep 10 13:19:07 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(6032KiB/48926msec) clat (msec): min=7, max=279, avg=51.43, stdev=42.34 lat (msec): min=7, max=279, avg=51.44, stdev=42.34 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 77], 90.00th=[ 110], 95.00th=[ 150], | 99.00th=[ 192], 99.50th=[ 213], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 352, per=25.83%, avg=125.55, stdev=77.82, samples=93 iops : min= 1, max= 22, avg= 7.04, stdev= 4.96, samples=93 write: IOPS=7, BW=128KiB/s (131kB/s)(6256KiB/48926msec); 0 zone resets clat (msec): min=15, max=388, avg=75.37, stdev=55.90 lat (msec): min=15, max=388, avg=75.38, stdev=55.89 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 63], | 70.00th=[ 79], 80.00th=[ 109], 90.00th=[ 153], 95.00th=[ 190], | 99.00th=[ 288], 99.50th=[ 334], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 30, max= 382, per=24.97%, avg=127.57, stdev=74.40, samples=96 iops : min= 1, max= 23, avg= 7.18, stdev= 4.70, samples=96 lat (msec) : 10=0.52%, 20=8.33%, 50=46.22%, 100=27.21%, 250=16.54% lat (msec) : 500=1.17% cpu : usr=0.07%, sys=1.71%, ctx=1228, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=487KiB/s (498kB/s), 117KiB/s-130KiB/s (120kB/s-133kB/s), io=23.4MiB (24.5MB), run=48029-49233msec WRITE: bw=512KiB/s (524kB/s), 126KiB/s-133KiB/s (129kB/s-137kB/s), io=24.6MiB (25.8MB), run=48029-49233msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179246: Thu Sep 10 13:19:20 2026 read: IOPS=1, BW=1868KiB/s (1912kB/s)(7168KiB/3838msec) clat (msec): min=110, max=434, avg=247.36, stdev=119.71 lat (msec): min=110, max=434, avg=247.36, stdev=119.71 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 165], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 197], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 388], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2027, max= 4087, per=77.49%, avg=3367.67, stdev=1162.08, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1334KiB/s (1366kB/s)(5120KiB/3838msec); 0 zone resets clat (msec): min=236, max=869, avg=409.77, stdev=260.86 lat (msec): min=236, max=869, avg=409.87, stdev=260.91 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1946, max= 2043, per=33.14%, avg=2016.40, stdev=40.00, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=50.00%, 1000=8.33% cpu : usr=0.00%, sys=20.46%, ctx=296, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179248: Thu Sep 10 13:19:20 2026 read: IOPS=0, BW=435KiB/s (445kB/s)(2048KiB/4712msec) clat (msec): min=198, max=321, avg=260.40, stdev=87.12 lat (msec): min=198, max=322, avg=260.40, stdev=87.12 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1376, max= 1946, per=38.22%, avg=1661.00, stdev=403.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2173KiB/s (2225kB/s)(10.0MiB/4712msec); 0 zone resets clat (msec): min=155, max=628, avg=395.44, stdev=169.32 lat (msec): min=155, max=628, avg=395.56, stdev=169.30 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 186], | 30.00th=[ 230], 40.00th=[ 268], 50.00th=[ 460], 60.00th=[ 468], | 70.00th=[ 506], 80.00th=[ 510], 90.00th=[ 550], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2011, max= 4096, per=50.21%, avg=3054.50, stdev=1131.44, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.04%, sys=19.57%, ctx=213, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179250: Thu Sep 10 13:19:20 2026 read: IOPS=1, BW=1486KiB/s (1522kB/s)(6144KiB/4135msec) clat (usec): min=589, max=423535, avg=171606.39, stdev=158687.36 lat (usec): min=591, max=423537, avg=171607.79, stdev=158687.38 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 49546], | 30.00th=[ 49546], 40.00th=[ 79168], 50.00th=[ 79168], 60.00th=[217056], | 70.00th=[258999], 80.00th=[258999], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 2027, max= 4096, per=78.31%, avg=3403.33, stdev=1191.95, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1486KiB/s (1522kB/s)(6144KiB/4135msec); 0 zone resets clat (msec): min=178, max=832, avg=493.65, stdev=210.80 lat (msec): min=179, max=832, avg=493.88, stdev=210.60 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 510], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1361, max= 2048, per=30.98%, avg=1885.00, stdev=295.80, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=16.67%, 500=33.33%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=17.97%, ctx=190, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179251: Thu Sep 10 13:19:20 2026 read: IOPS=1, BW=1142KiB/s (1170kB/s)(5120KiB/4482msec) clat (usec): min=749, max=569918, avg=233668.09, stdev=226284.31 lat (usec): min=754, max=569920, avg=233670.33, stdev=226283.86 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[ 750], | 30.00th=[ 93848], 40.00th=[ 93848], 50.00th=[158335], 60.00th=[158335], | 70.00th=[346031], 80.00th=[346031], 90.00th=[566232], 95.00th=[566232], | 99.00th=[566232], 99.50th=[566232], 99.90th=[566232], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 1946, max= 4055, per=61.67%, avg=2680.00, stdev=1191.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1599KiB/s (1638kB/s)(7168KiB/4482msec); 0 zone resets clat (msec): min=175, max=788, avg=441.61, stdev=235.03 lat (msec): min=175, max=789, avg=441.88, stdev=235.00 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 211], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 418], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 693], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1946, max= 4087, per=49.65%, avg=3020.75, stdev=1194.99, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=16.29%, ctx=197, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4346KiB/s (4451kB/s), 435KiB/s-1868KiB/s (445kB/s-1912kB/s), io=20.0MiB (20.0MB), run=3838-4712msec WRITE: bw=6085KiB/s (6231kB/s), 1334KiB/s-2173KiB/s (1366kB/s-2225kB/s), io=28.0MiB (29.4MB), run=3838-4712msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179244: Thu Sep 10 13:19:21 2026 read: IOPS=2, BW=2120KiB/s (2171kB/s)(7168KiB/3381msec) clat (msec): min=90, max=673, avg=259.66, stdev=200.21 lat (msec): min=90, max=673, avg=259.66, stdev=200.21 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 99], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 253], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 288], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1980, max= 5896, per=98.95%, avg=3948.00, stdev=1958.08, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1514KiB/s (1551kB/s)(5120KiB/3381msec); 0 zone resets clat (msec): min=102, max=717, avg=304.07, stdev=243.71 lat (msec): min=102, max=717, avg=304.18, stdev=243.71 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1935, max= 2015, per=35.44%, avg=1979.60, stdev=31.64, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=6.75%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179245: Thu Sep 10 13:19:21 2026 read: IOPS=0, BW=406KiB/s (416kB/s)(2048KiB/5045msec) clat (msec): min=211, max=443, avg=327.24, stdev=163.89 lat (msec): min=211, max=443, avg=327.24, stdev=163.89 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1361, max= 2035, per=42.56%, avg=1698.00, stdev=476.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2030KiB/s (2078kB/s)(10.0MiB/5045msec); 0 zone resets clat (msec): min=88, max=771, avg=420.91, stdev=255.22 lat (msec): min=88, max=772, avg=421.15, stdev=255.38 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 153], | 30.00th=[ 176], 40.00th=[ 205], 50.00th=[ 372], 60.00th=[ 527], | 70.00th=[ 550], 80.00th=[ 667], 90.00th=[ 709], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1875, max= 4071, per=47.91%, avg=2676.33, stdev=1069.57, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=33.33%, 1000=8.33% cpu : usr=0.02%, sys=5.79%, ctx=164, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179247: Thu Sep 10 13:19:21 2026 read: IOPS=1, BW=1267KiB/s (1298kB/s)(6144KiB/4848msec) clat (msec): min=68, max=1135, avg=347.84, stdev=415.94 lat (msec): min=68, max=1135, avg=347.84, stdev=415.94 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 159], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1875, max= 4071, per=62.53%, avg=2495.00, stdev=1052.80, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1267KiB/s (1298kB/s)(6144KiB/4848msec); 0 zone resets clat (msec): min=124, max=710, avg=432.35, stdev=197.52 lat (msec): min=124, max=710, avg=432.49, stdev=197.54 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 489], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1359, max= 4039, per=40.47%, avg=2260.60, stdev=1030.16, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=7.67%, ctx=144, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179249: Thu Sep 10 13:19:21 2026 read: IOPS=0, BW=998KiB/s (1022kB/s)(5120KiB/5132msec) clat (msec): min=62, max=413, avg=247.92, stdev=148.03 lat (msec): min=62, max=413, avg=247.92, stdev=148.03 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2035, max= 6107, per=100.00%, avg=4071.00, stdev=2879.34, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1397KiB/s (1430kB/s)(7168KiB/5132msec); 0 zone resets clat (msec): min=185, max=935, avg=522.66, stdev=303.65 lat (msec): min=185, max=936, avg=522.81, stdev=303.60 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 230], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 418], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 802], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1875, max= 2043, per=35.69%, avg=1993.40, stdev=67.21, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 1000=25.00% cpu : usr=0.02%, sys=6.55%, ctx=137, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3991KiB/s (4086kB/s), 406KiB/s-2120KiB/s (416kB/s-2171kB/s), io=20.0MiB (20.0MB), run=3381-5132msec WRITE: bw=5587KiB/s (5721kB/s), 1267KiB/s-2030KiB/s (1298kB/s-2078kB/s), io=28.0MiB (29.4MB), run=3381-5132msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179261: Thu Sep 10 13:19:34 2026 read: IOPS=1, BW=4923KiB/s (5041kB/s)(12.0MiB/2496msec) clat (msec): min=732, max=855, avg=787.18, stdev=62.58 lat (msec): min=732, max=855, avg=787.18, stdev=62.58 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.20%, ctx=435, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179263: Thu Sep 10 13:19:34 2026 read: IOPS=0, BW=1231KiB/s (1261kB/s)(4096KiB/3327msec) clat (nsec): min=631749k, max=631749k, avg=631748798.00, stdev= 0.00 lat (nsec): min=631751k, max=631751k, avg=631750626.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2462KiB/s (2521kB/s)(8192KiB/3327msec); 0 zone resets clat (msec): min=465, max=2003, avg=1234.18, stdev=1087.75 lat (msec): min=465, max=2003, avg=1234.66, stdev=1087.81 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 2005], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8175, max= 8175, per=83.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.54%, ctx=116, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179264: Thu Sep 10 13:19:34 2026 write: IOPS=0, BW=3873KiB/s (3966kB/s)(12.0MiB/3173msec); 0 zone resets clat (msec): min=188, max=1765, avg=1024.90, stdev=792.60 lat (msec): min=190, max=1765, avg=1025.63, stdev=792.01 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8094, max= 8094, per=82.18%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.91%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179265: Thu Sep 10 13:19:34 2026 write: IOPS=1, BW=4175KiB/s (4276kB/s)(12.0MiB/2943msec); 0 zone resets clat (msec): min=202, max=2050, avg=926.79, stdev=986.88 lat (msec): min=204, max=2051, avg=928.11, stdev=986.45 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8126, max= 8126, per=82.51%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.32%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4925KiB/s (5043kB/s), 1231KiB/s-4923KiB/s (1261kB/s-5041kB/s), io=16.0MiB (16.8MB), run=2496-3327msec WRITE: bw=9849KiB/s (10.1MB/s), 2462KiB/s-4175KiB/s (2521kB/s-4276kB/s), io=32.0MiB (33.6MB), run=2943-3327msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179258: Thu Sep 10 13:19:34 2026 read: IOPS=1, BW=4882KiB/s (4999kB/s)(12.0MiB/2517msec) clat (msec): min=232, max=1755, avg=815.64, stdev=821.48 lat (msec): min=232, max=1755, avg=815.64, stdev=821.47 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 6574, max= 8159, per=100.00%, avg=7366.50, stdev=1120.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.05%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179259: Thu Sep 10 13:19:34 2026 read: IOPS=0, BW=1462KiB/s (1497kB/s)(4096KiB/2802msec) clat (nsec): min=620649k, max=620649k, avg=620649231.00, stdev= 0.00 lat (nsec): min=620673k, max=620673k, avg=620673213.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2924KiB/s (2994kB/s)(8192KiB/2802msec); 0 zone resets clat (msec): min=957, max=1170, avg=1063.89, stdev=150.82 lat (msec): min=958, max=1174, avg=1066.30, stdev=153.05 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7876, max= 7876, per=82.88%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.00%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179260: Thu Sep 10 13:19:34 2026 write: IOPS=0, BW=3564KiB/s (3649kB/s)(12.0MiB/3448msec); 0 zone resets clat (msec): min=220, max=1974, avg=1134.99, stdev=879.29 lat (msec): min=220, max=1974, avg=1135.80, stdev=879.34 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 7876, max= 7876, per=82.88%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.80%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179262: Thu Sep 10 13:19:34 2026 write: IOPS=1, BW=4359KiB/s (4464kB/s)(12.0MiB/2819msec); 0 zone resets clat (msec): min=254, max=1579, avg=912.78, stdev=662.85 lat (msec): min=254, max=1581, avg=913.96, stdev=663.58 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 6736, max= 8110, per=78.11%, avg=7423.00, stdev=971.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.65%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5847KiB/s (5988kB/s), 1462KiB/s-4882KiB/s (1497kB/s-4999kB/s), io=16.0MiB (16.8MB), run=2517-2802msec WRITE: bw=9503KiB/s (9732kB/s), 2924KiB/s-4359KiB/s (2994kB/s-4464kB/s), io=32.0MiB (33.6MB), run=2802-3448msec