== sanity test 398b: DIO and buffer IO race ============== 02:02:25 (1786341745) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.88294 s, 17.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Mon Aug 10 02:03:39 2026 read: IOPS=23, BW=93.5KiB/s (95.8kB/s)(5992KiB/64069msec) clat (usec): min=27, max=637780, avg=20837.46, stdev=21120.14 lat (usec): min=28, max=637781, avg=20838.54, stdev=21120.26 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 89], 10.00th=[ 7439], 20.00th=[ 10683], | 30.00th=[ 13173], 40.00th=[ 15270], 50.00th=[ 17957], 60.00th=[ 21365], | 70.00th=[ 25035], 80.00th=[ 29492], 90.00th=[ 36439], 95.00th=[ 42730], | 99.00th=[ 62653], 99.50th=[ 78119], 99.90th=[183501], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 6, max= 160, per=25.01%, avg=93.28, stdev=29.98, samples=127 iops : min= 1, max= 40, avg=22.78, stdev= 7.58, samples=127 write: IOPS=24, BW=98.3KiB/s (101kB/s)(6296KiB/64069msec); 0 zone resets clat (usec): min=737, max=168121, avg=20687.77, stdev=19288.30 lat (usec): min=738, max=168123, avg=20689.65, stdev=19287.89 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1401], 10.00th=[ 2024], 20.00th=[ 3589], | 30.00th=[ 6456], 40.00th=[ 11994], 50.00th=[ 16450], 60.00th=[ 20841], | 70.00th=[ 26608], 80.00th=[ 34341], 90.00th=[ 44827], 95.00th=[ 55837], | 99.00th=[ 79168], 99.50th=[104334], 99.90th=[166724], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 182, per=25.31%, avg=98.71, stdev=30.87, samples=126 iops : min= 7, max= 45, avg=24.14, stdev= 7.76, samples=126 lat (usec) : 50=0.68%, 100=2.21%, 250=0.65%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.39% lat (msec) : 2=4.69%, 4=6.32%, 10=11.59%, 20=30.73%, 50=37.83% lat (msec) : 100=4.26%, 250=0.36%, 750=0.03% cpu : usr=0.10%, sys=12.50%, ctx=7537, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Mon Aug 10 02:03:39 2026 read: IOPS=23, BW=92.4KiB/s (94.6kB/s)(5940KiB/64315msec) clat (usec): min=36, max=112972, avg=20562.73, stdev=12977.57 lat (usec): min=36, max=112973, avg=20565.47, stdev=12980.06 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 100], 10.00th=[ 8029], 20.00th=[ 10945], | 30.00th=[ 13173], 40.00th=[ 15533], 50.00th=[ 18220], 60.00th=[ 21365], | 70.00th=[ 25560], 80.00th=[ 29754], 90.00th=[ 35914], 95.00th=[ 43254], | 99.00th=[ 61080], 99.50th=[ 77071], 99.90th=[103285], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 6, max= 167, per=24.59%, avg=91.72, stdev=29.66, samples=127 iops : min= 1, max= 41, avg=22.39, stdev= 7.43, samples=127 write: IOPS=24, BW=98.7KiB/s (101kB/s)(6348KiB/64315msec); 0 zone resets clat (usec): min=817, max=631223, avg=21097.89, stdev=25952.81 lat (usec): min=818, max=631225, avg=21099.84, stdev=25952.59 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1369], 10.00th=[ 1909], 20.00th=[ 3261], | 30.00th=[ 5800], 40.00th=[ 11731], 50.00th=[ 15795], 60.00th=[ 20841], | 70.00th=[ 26608], 80.00th=[ 34341], 90.00th=[ 44827], 95.00th=[ 55837], | 99.00th=[ 93848], 99.50th=[132645], 99.90th=[238027], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 39, max= 192, per=25.21%, avg=98.33, stdev=29.10, samples=126 iops : min= 9, max= 48, avg=24.05, stdev= 7.30, samples=126 lat (usec) : 50=0.59%, 100=1.86%, 250=0.55%, 500=0.03%, 1000=0.36% lat (msec) : 2=5.27%, 4=6.90%, 10=11.65%, 20=30.18%, 50=37.66% lat (msec) : 100=4.36%, 250=0.55%, 750=0.03% cpu : usr=0.12%, sys=12.82%, ctx=7507, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145074: Mon Aug 10 02:03:39 2026 read: IOPS=23, BW=95.5KiB/s (97.8kB/s)(6028KiB/63140msec) clat (usec): min=24, max=299874, avg=20421.46, stdev=15540.37 lat (usec): min=24, max=299876, avg=20422.89, stdev=15540.47 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 86], 10.00th=[ 7832], 20.00th=[ 10814], | 30.00th=[ 12780], 40.00th=[ 15139], 50.00th=[ 17695], 60.00th=[ 20579], | 70.00th=[ 23725], 80.00th=[ 29230], 90.00th=[ 35390], 95.00th=[ 44303], | 99.00th=[ 69731], 99.50th=[ 89654], 99.90th=[115868], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 23, max= 176, per=25.65%, avg=95.69, stdev=29.40, samples=124 iops : min= 5, max= 44, avg=23.39, stdev= 7.36, samples=124 write: IOPS=24, BW=99.1KiB/s (102kB/s)(6260KiB/63140msec); 0 zone resets clat (usec): min=760, max=631079, avg=20489.72, stdev=24168.13 lat (usec): min=761, max=631079, avg=20491.16, stdev=24168.13 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1352], 10.00th=[ 1942], 20.00th=[ 3195], | 30.00th=[ 5866], 40.00th=[ 11600], 50.00th=[ 16057], 60.00th=[ 20579], | 70.00th=[ 26346], 80.00th=[ 33817], 90.00th=[ 44827], 95.00th=[ 52691], | 99.00th=[ 80217], 99.50th=[105382], 99.90th=[196084], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 13, max= 176, per=25.25%, avg=98.47, stdev=27.63, samples=125 iops : min= 3, max= 44, avg=24.09, stdev= 6.94, samples=125 lat (usec) : 50=0.59%, 100=2.21%, 250=0.91%, 500=0.03%, 1000=0.36% lat (msec) : 2=5.08%, 4=6.93%, 10=11.17%, 20=30.96%, 50=36.91% lat (msec) : 100=4.43%, 250=0.36%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=12.70%, ctx=7430, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145075: Mon Aug 10 02:03:39 2026 read: IOPS=23, BW=94.1KiB/s (96.4kB/s)(6052KiB/64284msec) clat (usec): min=34, max=203865, avg=20865.54, stdev=15158.83 lat (usec): min=35, max=203867, avg=20868.81, stdev=15160.92 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 91], 10.00th=[ 8029], 20.00th=[ 11076], | 30.00th=[ 13042], 40.00th=[ 15270], 50.00th=[ 17695], 60.00th=[ 20841], | 70.00th=[ 25035], 80.00th=[ 30278], 90.00th=[ 36963], 95.00th=[ 44303], | 99.00th=[ 72877], 99.50th=[ 78119], 99.90th=[158335], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 15, max= 167, per=25.44%, avg=94.88, stdev=28.66, samples=125 iops : min= 3, max= 41, avg=23.18, stdev= 7.23, samples=125 write: IOPS=24, BW=97.0KiB/s (99.3kB/s)(6236KiB/64284msec); 0 zone resets clat (usec): min=635, max=819433, avg=20800.39, stdev=28173.41 lat (usec): min=636, max=819436, avg=20802.29, stdev=28173.39 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1532], 10.00th=[ 2089], 20.00th=[ 3490], | 30.00th=[ 5932], 40.00th=[ 10814], 50.00th=[ 15664], 60.00th=[ 20317], | 70.00th=[ 26084], 80.00th=[ 33817], 90.00th=[ 44827], 95.00th=[ 57410], | 99.00th=[ 89654], 99.50th=[109577], 99.90th=[193987], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 198, per=24.91%, avg=97.17, stdev=30.70, samples=126 iops : min= 1, max= 49, avg=23.76, stdev= 7.74, samples=126 lat (usec) : 50=0.55%, 100=2.18%, 250=0.88%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.23% lat (msec) : 2=4.17%, 4=7.10%, 10=12.08%, 20=31.18%, 50=35.94% lat (msec) : 100=4.98%, 250=0.49%, 1000=0.03% cpu : usr=0.11%, sys=12.38%, ctx=7472, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=373KiB/s (382kB/s), 92.4KiB/s-95.5KiB/s (94.6kB/s-97.8kB/s), io=23.4MiB (24.6MB), run=63140-64315msec WRITE: bw=391KiB/s (400kB/s), 97.0KiB/s-99.1KiB/s (99.3kB/s-102kB/s), io=24.6MiB (25.7MB), run=63140-64315msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145077: Mon Aug 10 02:04:46 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(5992KiB/130909msec) clat (msec): min=3, max=647, avg=18.08, stdev=23.11 lat (msec): min=3, max=647, avg=18.08, stdev=23.11 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 38], 95.00th=[ 50], | 99.00th=[ 90], 99.50th=[ 96], 99.90th=[ 157], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 119, per=25.19%, avg=46.09, stdev=24.56, samples=256 iops : min= 1, max= 29, avg=11.08, stdev= 6.17, samples=256 write: IOPS=12, BW=48.1KiB/s (49.2kB/s)(6296KiB/130909msec); 0 zone resets clat (msec): min=22, max=318, avg=65.81, stdev=26.07 lat (msec): min=22, max=318, avg=65.81, stdev=26.07 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 62], 60.00th=[ 67], | 70.00th=[ 73], 80.00th=[ 83], 90.00th=[ 97], 95.00th=[ 113], | 99.00th=[ 150], 99.50th=[ 167], 99.90th=[ 257], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 88, per=25.05%, avg=47.84, stdev=16.15, samples=259 iops : min= 1, max= 22, avg=11.51, stdev= 4.08, samples=259 lat (msec) : 4=0.03%, 10=18.20%, 20=18.72%, 50=24.32%, 100=33.92% lat (msec) : 250=4.72%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=2.92%, ctx=5388, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145078: Mon Aug 10 02:04:46 2026 read: IOPS=11, BW=45.6KiB/s (46.7kB/s)(5940KiB/130324msec) clat (msec): min=4, max=720, avg=18.11, stdev=24.43 lat (msec): min=4, max=720, avg=18.12, stdev=24.43 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 49], | 99.00th=[ 83], 99.50th=[ 107], 99.90th=[ 192], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 127, per=25.18%, avg=46.07, stdev=25.58, samples=254 iops : min= 1, max= 31, avg=11.07, stdev= 6.45, samples=254 write: IOPS=12, BW=48.7KiB/s (49.9kB/s)(6348KiB/130324msec); 0 zone resets clat (msec): min=19, max=292, avg=65.01, stdev=26.94 lat (msec): min=19, max=292, avg=65.01, stdev=26.94 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 50], 40.00th=[ 55], 50.00th=[ 60], 60.00th=[ 66], | 70.00th=[ 73], 80.00th=[ 82], 90.00th=[ 99], 95.00th=[ 114], | 99.00th=[ 150], 99.50th=[ 192], 99.90th=[ 262], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 15, max= 88, per=25.37%, avg=48.46, stdev=16.24, samples=258 iops : min= 3, max= 22, avg=11.67, stdev= 4.11, samples=258 lat (msec) : 10=17.81%, 20=18.72%, 50=25.75%, 100=32.78%, 250=4.82% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.07%, sys=2.89%, ctx=5371, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145079: Mon Aug 10 02:04:46 2026 read: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6028KiB/131101msec) clat (msec): min=4, max=192, avg=18.63, stdev=17.48 lat (msec): min=4, max=192, avg=18.64, stdev=17.48 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 53], | 99.00th=[ 88], 99.50th=[ 108], 99.90th=[ 157], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 7, max= 127, per=25.30%, avg=46.30, stdev=23.98, samples=256 iops : min= 1, max= 31, avg=11.13, stdev= 6.03, samples=256 write: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6260KiB/131101msec); 0 zone resets clat (msec): min=24, max=745, avg=65.66, stdev=31.16 lat (msec): min=24, max=745, avg=65.66, stdev=31.16 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 36], 10.00th=[ 41], 20.00th=[ 46], | 30.00th=[ 51], 40.00th=[ 56], 50.00th=[ 61], 60.00th=[ 66], | 70.00th=[ 72], 80.00th=[ 81], 90.00th=[ 96], 95.00th=[ 112], | 99.00th=[ 159], 99.50th=[ 201], 99.90th=[ 288], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 80, per=24.84%, avg=47.44, stdev=16.53, samples=259 iops : min= 1, max= 20, avg=11.41, stdev= 4.20, samples=259 lat (msec) : 10=17.09%, 20=18.98%, 50=25.03%, 100=34.38%, 250=4.46% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.05%, sys=2.91%, ctx=5407, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145080: Mon Aug 10 02:04:46 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6052KiB/130209msec) clat (msec): min=4, max=233, avg=17.74, stdev=16.65 lat (msec): min=4, max=233, avg=17.74, stdev=16.65 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 48], | 99.00th=[ 88], 99.50th=[ 107], 99.90th=[ 159], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 7, max= 159, per=25.80%, avg=47.21, stdev=25.52, samples=253 iops : min= 1, max= 39, avg=11.36, stdev= 6.40, samples=253 write: IOPS=11, BW=47.9KiB/s (49.0kB/s)(6236KiB/130209msec); 0 zone resets clat (msec): min=26, max=808, avg=66.16, stdev=32.73 lat (msec): min=26, max=808, avg=66.16, stdev=32.73 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 50], 40.00th=[ 55], 50.00th=[ 61], 60.00th=[ 67], | 70.00th=[ 74], 80.00th=[ 85], 90.00th=[ 99], 95.00th=[ 113], | 99.00th=[ 148], 99.50th=[ 182], 99.90th=[ 317], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 15, max= 80, per=24.96%, avg=47.68, stdev=15.96, samples=258 iops : min= 3, max= 20, avg=11.47, stdev= 4.04, samples=258 lat (msec) : 10=18.03%, 20=19.47%, 50=25.55%, 100=32.06%, 250=4.75% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=2.93%, ctx=5329, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=183KiB/s (188kB/s), 45.6KiB/s-46.5KiB/s (46.7kB/s-47.6kB/s), io=23.4MiB (24.6MB), run=130209-131101msec WRITE: bw=192KiB/s (196kB/s), 47.7KiB/s-48.7KiB/s (48.9kB/s-49.9kB/s), io=24.6MiB (25.7MB), run=130209-131101msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145113: Mon Aug 10 02:05:07 2026 read: IOPS=23, BW=373KiB/s (382kB/s)(5920KiB/15870msec) clat (usec): min=32, max=147921, avg=20015.59, stdev=17753.28 lat (usec): min=33, max=147922, avg=20016.70, stdev=17753.27 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 106], | 30.00th=[ 10683], 40.00th=[ 15401], 50.00th=[ 18482], 60.00th=[ 23462], | 70.00th=[ 25822], 80.00th=[ 31589], 90.00th=[ 42206], 95.00th=[ 50594], | 99.00th=[ 73925], 99.50th=[ 81265], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 194, max= 672, per=24.47%, avg=362.87, stdev=93.09, samples=31 iops : min= 12, max= 42, avg=22.06, stdev= 5.89, samples=31 write: IOPS=25, BW=401KiB/s (411kB/s)(6368KiB/15870msec); 0 zone resets clat (usec): min=1173, max=142158, avg=20699.44, stdev=20032.33 lat (usec): min=1175, max=142160, avg=20701.34, stdev=20032.36 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1926], 10.00th=[ 2573], 20.00th=[ 4228], | 30.00th=[ 5800], 40.00th=[ 9241], 50.00th=[ 15139], 60.00th=[ 20055], | 70.00th=[ 26608], 80.00th=[ 36439], 90.00th=[ 47973], 95.00th=[ 58983], | 99.00th=[ 99091], 99.50th=[104334], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 96, max= 670, per=25.29%, avg=394.58, stdev=146.86, samples=31 iops : min= 6, max= 41, avg=24.06, stdev= 9.14, samples=31 lat (usec) : 50=1.69%, 100=7.55%, 250=2.34%, 500=0.26%, 750=0.26% lat (msec) : 2=3.12%, 4=7.42%, 10=12.24%, 20=22.01%, 50=36.33% lat (msec) : 100=6.25%, 250=0.52% cpu : usr=0.13%, sys=12.25%, ctx=1689, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145114: Mon Aug 10 02:05:07 2026 read: IOPS=22, BW=356KiB/s (364kB/s)(5744KiB/16145msec) clat (usec): min=38, max=79025, avg=21255.41, stdev=15827.97 lat (usec): min=39, max=79026, avg=21256.84, stdev=15827.82 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 71], 20.00th=[ 141], | 30.00th=[12911], 40.00th=[17433], 50.00th=[21103], 60.00th=[25035], | 70.00th=[28967], 80.00th=[32900], 90.00th=[41157], 95.00th=[51119], | 99.00th=[64750], 99.50th=[70779], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 55, max= 604, per=24.67%, avg=365.80, stdev=121.11, samples=30 iops : min= 3, max= 37, avg=22.27, stdev= 7.52, samples=30 write: IOPS=25, BW=405KiB/s (415kB/s)(6544KiB/16145msec); 0 zone resets clat (usec): min=1192, max=186983, avg=20375.36, stdev=22333.69 lat (usec): min=1193, max=186983, avg=20379.71, stdev=22334.76 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2040], 10.00th=[ 2638], 20.00th=[ 4047], | 30.00th=[ 5866], 40.00th=[ 8291], 50.00th=[ 13173], 60.00th=[ 19268], | 70.00th=[ 25297], 80.00th=[ 32375], 90.00th=[ 46924], 95.00th=[ 62653], | 99.00th=[108528], 99.50th=[128451], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 138, max= 702, per=25.63%, avg=399.90, stdev=117.46, samples=31 iops : min= 8, max= 43, avg=24.39, stdev= 7.42, samples=31 lat (usec) : 50=1.30%, 100=6.12%, 250=2.34%, 500=0.26%, 750=0.26% lat (msec) : 2=2.73%, 4=7.55%, 10=14.45%, 20=19.79%, 50=38.54% lat (msec) : 100=5.99%, 250=0.65% cpu : usr=0.12%, sys=12.57%, ctx=1673, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145116: Mon Aug 10 02:05:07 2026 read: IOPS=25, BW=407KiB/s (416kB/s)(6256KiB/15385msec) clat (usec): min=24, max=145998, avg=22007.86, stdev=17749.81 lat (usec): min=24, max=146000, avg=22009.06, stdev=17749.88 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 611], | 30.00th=[ 14091], 40.00th=[ 17695], 50.00th=[ 20055], 60.00th=[ 24249], | 70.00th=[ 27395], 80.00th=[ 34341], 90.00th=[ 42730], 95.00th=[ 49546], | 99.00th=[ 76022], 99.50th=[125305], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 220, max= 698, per=27.39%, avg=406.17, stdev=125.96, samples=30 iops : min= 13, max= 43, avg=24.80, stdev= 7.92, samples=30 write: IOPS=24, BW=392KiB/s (401kB/s)(6032KiB/15385msec); 0 zone resets clat (usec): min=1275, max=105607, avg=17797.13, stdev=17515.34 lat (usec): min=1276, max=105608, avg=17799.65, stdev=17515.21 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1876], 10.00th=[ 2278], 20.00th=[ 3621], | 30.00th=[ 4948], 40.00th=[ 6849], 50.00th=[ 11863], 60.00th=[ 16712], | 70.00th=[ 22152], 80.00th=[ 31327], 90.00th=[ 43779], 95.00th=[ 51643], | 99.00th=[ 79168], 99.50th=[ 84411], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 160, max= 640, per=24.80%, avg=386.83, stdev=117.64, samples=30 iops : min= 10, max= 40, avg=23.60, stdev= 7.40, samples=30 lat (usec) : 50=1.30%, 100=6.25%, 250=1.95%, 500=0.52%, 750=0.26% lat (msec) : 2=2.47%, 4=8.59%, 10=12.89%, 20=23.83%, 50=36.59% lat (msec) : 100=4.82%, 250=0.52% cpu : usr=0.09%, sys=12.83%, ctx=1703, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145118: Mon Aug 10 02:05:07 2026 read: IOPS=24, BW=388KiB/s (397kB/s)(6032KiB/15557msec) clat (usec): min=18, max=128533, avg=19795.26, stdev=17758.01 lat (usec): min=19, max=128534, avg=19796.29, stdev=17758.00 clat percentiles (usec): | 1.00th=[ 28], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 85], | 30.00th=[ 10028], 40.00th=[ 14746], 50.00th=[ 18744], 60.00th=[ 22676], | 70.00th=[ 26870], 80.00th=[ 33162], 90.00th=[ 42206], 95.00th=[ 49546], | 99.00th=[ 81265], 99.50th=[ 86508], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 190, max= 768, per=25.63%, avg=380.10, stdev=141.25, samples=30 iops : min= 11, max= 48, avg=23.17, stdev= 8.92, samples=30 write: IOPS=25, BW=402KiB/s (412kB/s)(6256KiB/15557msec); 0 zone resets clat (usec): min=1244, max=215662, avg=20383.12, stdev=22917.96 lat (usec): min=1246, max=215665, avg=20385.49, stdev=22917.85 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2180], 10.00th=[ 2769], 20.00th=[ 4015], | 30.00th=[ 5538], 40.00th=[ 7767], 50.00th=[ 12911], 60.00th=[ 19006], | 70.00th=[ 26346], 80.00th=[ 35390], 90.00th=[ 46400], 95.00th=[ 57410], | 99.00th=[104334], 99.50th=[200279], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 221, max= 704, per=25.51%, avg=397.90, stdev=126.22, samples=30 iops : min= 13, max= 44, avg=24.27, stdev= 7.90, samples=30 lat (usec) : 20=0.13%, 50=2.21%, 100=8.85%, 250=2.34%, 500=0.52% lat (usec) : 750=0.13% lat (msec) : 2=1.82%, 4=8.33%, 10=13.15%, 20=20.31%, 50=35.68% lat (msec) : 100=5.86%, 250=0.65% cpu : usr=0.10%, sys=12.19%, ctx=1582, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1484KiB/s (1519kB/s), 356KiB/s-407KiB/s (364kB/s-416kB/s), io=23.4MiB (24.5MB), run=15385-16145msec WRITE: bw=1561KiB/s (1598kB/s), 392KiB/s-405KiB/s (401kB/s-415kB/s), io=24.6MiB (25.8MB), run=15385-16145msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145115: Mon Aug 10 02:05:27 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5920KiB/35340msec) clat (msec): min=5, max=181, avg=23.77, stdev=21.70 lat (msec): min=5, max=181, avg=23.78, stdev=21.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 47], 95.00th=[ 67], | 99.00th=[ 122], 99.50th=[ 140], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 31, max= 478, per=24.94%, avg=167.10, stdev=95.76, samples=70 iops : min= 1, max= 29, avg= 9.90, stdev= 6.13, samples=70 write: IOPS=11, BW=180KiB/s (185kB/s)(6368KiB/35340msec); 0 zone resets clat (msec): min=25, max=235, avg=66.27, stdev=33.37 lat (msec): min=25, max=235, avg=66.28, stdev=33.38 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 42], | 30.00th=[ 46], 40.00th=[ 52], 50.00th=[ 57], 60.00th=[ 63], | 70.00th=[ 72], 80.00th=[ 86], 90.00th=[ 112], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 197], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 30, max= 320, per=25.47%, avg=179.57, stdev=77.56, samples=70 iops : min= 1, max= 20, avg=10.67, stdev= 5.03, samples=70 lat (msec) : 10=8.59%, 20=21.22%, 50=33.33%, 100=28.26%, 250=8.59% cpu : usr=0.08%, sys=3.30%, ctx=1586, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145117: Mon Aug 10 02:05:27 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(5744KiB/35736msec) clat (msec): min=4, max=142, avg=24.08, stdev=21.39 lat (msec): min=4, max=142, avg=24.08, stdev=21.39 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 50], 95.00th=[ 75], | 99.00th=[ 107], 99.50th=[ 129], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 440, per=24.33%, avg=163.04, stdev=93.84, samples=70 iops : min= 1, max= 27, avg= 9.64, stdev= 5.97, samples=70 write: IOPS=11, BW=183KiB/s (188kB/s)(6544KiB/35736msec); 0 zone resets clat (msec): min=24, max=215, avg=66.11, stdev=34.45 lat (msec): min=24, max=215, avg=66.11, stdev=34.45 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 41], | 30.00th=[ 46], 40.00th=[ 52], 50.00th=[ 58], 60.00th=[ 63], | 70.00th=[ 72], 80.00th=[ 85], 90.00th=[ 108], 95.00th=[ 142], | 99.00th=[ 203], 99.50th=[ 213], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 62, max= 352, per=25.92%, avg=182.75, stdev=80.89, samples=71 iops : min= 3, max= 22, avg=10.89, stdev= 5.24, samples=71 lat (msec) : 10=7.55%, 20=20.70%, 50=34.24%, 100=30.21%, 250=7.29% cpu : usr=0.07%, sys=3.24%, ctx=1636, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145119: Mon Aug 10 02:05:27 2026 read: IOPS=11, BW=180KiB/s (185kB/s)(6256KiB/34682msec) clat (msec): min=5, max=177, avg=22.21, stdev=21.61 lat (msec): min=5, max=177, avg=22.21, stdev=21.61 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 66], | 99.00th=[ 123], 99.50th=[ 138], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 31, max= 512, per=27.99%, avg=187.55, stdev=119.90, samples=66 iops : min= 1, max= 32, avg=11.17, stdev= 7.65, samples=66 write: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34682msec); 0 zone resets clat (msec): min=23, max=225, avg=68.56, stdev=35.77 lat (msec): min=23, max=225, avg=68.56, stdev=35.77 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 43], | 30.00th=[ 47], 40.00th=[ 52], 50.00th=[ 59], 60.00th=[ 65], | 70.00th=[ 73], 80.00th=[ 90], 90.00th=[ 117], 95.00th=[ 142], | 99.00th=[ 207], 99.50th=[ 224], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 59, max= 320, per=24.41%, avg=172.12, stdev=76.18, samples=68 iops : min= 3, max= 20, avg=10.19, stdev= 4.88, samples=68 lat (msec) : 10=11.59%, 20=20.31%, 50=33.20%, 100=26.04%, 250=8.85% cpu : usr=0.03%, sys=3.33%, ctx=1568, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145120: Mon Aug 10 02:05:27 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(6032KiB/35171msec) clat (msec): min=5, max=220, avg=22.90, stdev=23.11 lat (msec): min=5, max=220, avg=22.90, stdev=23.11 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 47], 95.00th=[ 67], | 99.00th=[ 129], 99.50th=[ 184], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 416, per=25.78%, avg=172.71, stdev=98.88, samples=68 iops : min= 1, max= 26, avg=10.24, stdev= 6.30, samples=68 write: IOPS=11, BW=178KiB/s (182kB/s)(6256KiB/35171msec); 0 zone resets clat (msec): min=25, max=239, avg=67.40, stdev=33.70 lat (msec): min=25, max=239, avg=67.40, stdev=33.71 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 37], 20.00th=[ 43], | 30.00th=[ 48], 40.00th=[ 52], 50.00th=[ 57], 60.00th=[ 65], | 70.00th=[ 71], 80.00th=[ 85], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 180], 99.50th=[ 230], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 60, max= 318, per=25.11%, avg=177.03, stdev=75.72, samples=69 iops : min= 3, max= 19, avg=10.51, stdev= 4.91, samples=69 lat (msec) : 10=8.85%, 20=23.44%, 50=30.60%, 100=29.56%, 250=7.55% cpu : usr=0.10%, sys=3.17%, ctx=1540, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=670KiB/s (686kB/s), 161KiB/s-180KiB/s (165kB/s-185kB/s), io=23.4MiB (24.5MB), run=34682-35736msec WRITE: bw=705KiB/s (722kB/s), 174KiB/s-183KiB/s (178kB/s-188kB/s), io=24.6MiB (25.8MB), run=34682-35736msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145132: Mon Aug 10 02:05:35 2026 read: IOPS=3, BW=3134KiB/s (3209kB/s)(7168KiB/2287msec) clat (usec): min=558, max=409549, avg=197642.76, stdev=140398.70 lat (usec): min=560, max=409550, avg=197644.00, stdev=140398.49 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[107480], | 30.00th=[139461], 40.00th=[139461], 50.00th=[166724], 60.00th=[214959], | 70.00th=[214959], 80.00th=[346031], 90.00th=[408945], 95.00th=[408945], | 99.00th=[408945], 99.50th=[408945], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 2003, max= 4096, per=45.03%, avg=2917.25, stdev=1066.05, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=2, BW=2239KiB/s (2292kB/s)(5120KiB/2287msec); 0 zone resets clat (msec): min=99, max=260, avg=153.32, stdev=65.16 lat (msec): min=99, max=260, avg=153.42, stdev=65.16 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 2003, max= 4055, per=29.79%, avg=2702.00, stdev=1171.95, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=34.30%, ctx=532, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145133: Mon Aug 10 02:05:35 2026 read: IOPS=0, BW=656KiB/s (672kB/s)(2048KiB/3120msec) clat (usec): min=538, max=94013, avg=47276.11, stdev=66096.43 lat (usec): min=540, max=94015, avg=47277.88, stdev=66097.01 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 537], 60.00th=[93848], | 70.00th=[93848], 80.00th=[93848], 90.00th=[93848], 95.00th=[93848], | 99.00th=[93848], 99.50th=[93848], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 1729, max= 2027, per=28.99%, avg=1878.00, stdev=210.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3282KiB/s (3361kB/s)(10.0MiB/3120msec); 0 zone resets clat (msec): min=94, max=592, avg=300.63, stdev=140.16 lat (msec): min=94, max=592, avg=300.72, stdev=140.17 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 153], | 30.00th=[ 211], 40.00th=[ 245], 50.00th=[ 292], 60.00th=[ 305], | 70.00th=[ 351], 80.00th=[ 376], 90.00th=[ 393], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1729, max= 4055, per=30.62%, avg=2777.40, stdev=1151.89, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 0.84, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.06%, sys=29.75%, ctx=418, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145134: Mon Aug 10 02:05:35 2026 read: IOPS=1, BW=1944KiB/s (1990kB/s)(6144KiB/3161msec) clat (msec): min=99, max=196, avg=164.66, stdev=35.83 lat (msec): min=99, max=196, avg=164.66, stdev=35.83 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1988, max= 4096, per=39.21%, avg=2539.75, stdev=1037.80, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1944KiB/s (1990kB/s)(6144KiB/3161msec); 0 zone resets clat (msec): min=240, max=612, avg=333.33, stdev=138.83 lat (msec): min=240, max=612, avg=333.41, stdev=138.83 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 284], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1771, max= 2048, per=21.84%, avg=1980.83, stdev=105.57, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=28.22%, ctx=779, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145135: Mon Aug 10 02:05:35 2026 read: IOPS=1, BW=1880KiB/s (1925kB/s)(5120KiB/2723msec) clat (usec): min=507, max=221885, avg=109088.97, stdev=79371.43 lat (usec): min=509, max=221886, avg=109090.33, stdev=79371.41 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 87557], 40.00th=[ 87557], 50.00th=[112722], 60.00th=[112722], | 70.00th=[123208], 80.00th=[123208], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2632KiB/s (2696kB/s)(7168KiB/2723msec); 0 zone resets clat (msec): min=170, max=443, avg=302.72, stdev=110.62 lat (msec): min=170, max=443, avg=302.85, stdev=110.51 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 211], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 253], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 422], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2003, max= 3611, per=25.88%, avg=2347.40, stdev=706.62, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=32.26%, ctx=355, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6479KiB/s (6634kB/s), 656KiB/s-3134KiB/s (672kB/s-3209kB/s), io=20.0MiB (20.0MB), run=2287-3161msec WRITE: bw=9071KiB/s (9288kB/s), 1944KiB/s-3282KiB/s (1990kB/s-3361kB/s), io=28.0MiB (29.4MB), run=2287-3161msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145137: Mon Aug 10 02:05:35 2026 read: IOPS=2, BW=2278KiB/s (2332kB/s)(7168KiB/3147msec) clat (msec): min=117, max=501, avg=257.02, stdev=157.10 lat (msec): min=117, max=501, avg=257.02, stdev=157.10 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 134], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 393], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1928, max= 4071, per=50.71%, avg=3007.75, stdev=1179.06, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1627KiB/s (1666kB/s)(5120KiB/3147msec); 0 zone resets clat (msec): min=149, max=365, avg=245.86, stdev=96.98 lat (msec): min=150, max=365, avg=245.99, stdev=96.96 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1928, max= 4071, per=30.23%, avg=2509.75, stdev=1041.99, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=11.19%, ctx=195, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145138: Mon Aug 10 02:05:35 2026 read: IOPS=0, BW=624KiB/s (639kB/s)(2048KiB/3282msec) clat (msec): min=154, max=320, avg=237.62, stdev=117.63 lat (msec): min=154, max=320, avg=237.62, stdev=117.63 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1783, max= 1928, per=31.28%, avg=1855.50, stdev=102.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3120KiB/s (3195kB/s)(10.0MiB/3282msec); 0 zone resets clat (msec): min=95, max=477, avg=270.63, stdev=110.40 lat (msec): min=95, max=477, avg=270.71, stdev=110.39 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 132], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 245], 60.00th=[ 275], | 70.00th=[ 309], 80.00th=[ 342], 90.00th=[ 359], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1928, max= 4096, per=38.81%, avg=3222.80, stdev=1134.54, samples=5 iops : min= 1, max= 4, avg= 2.40, stdev= 1.34, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=10.54%, ctx=172, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145139: Mon Aug 10 02:05:35 2026 read: IOPS=2, BW=2176KiB/s (2229kB/s)(6144KiB/2823msec) clat (msec): min=92, max=189, avg=140.90, stdev=31.78 lat (msec): min=92, max=189, avg=140.90, stdev=31.78 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 1928, max= 4071, per=42.26%, avg=2506.50, stdev=1043.93, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=2, BW=2176KiB/s (2229kB/s)(6144KiB/2823msec); 0 zone resets clat (msec): min=193, max=569, avg=324.34, stdev=132.58 lat (msec): min=194, max=569, avg=324.44, stdev=132.62 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 317], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1992, max= 3506, per=28.81%, avg=2392.00, stdev=742.94, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.11%, sys=11.69%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145140: Mon Aug 10 02:05:35 2026 read: IOPS=1, BW=1483KiB/s (1518kB/s)(5120KiB/3453msec) clat (msec): min=38, max=360, avg=218.11, stdev=124.68 lat (msec): min=38, max=360, avg=218.12, stdev=124.70 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 39], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2048, max= 4071, per=51.58%, avg=3059.50, stdev=1430.48, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2076KiB/s (2126kB/s)(7168KiB/3453msec); 0 zone resets clat (msec): min=64, max=709, avg=326.92, stdev=274.83 lat (msec): min=64, max=709, avg=327.01, stdev=274.82 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 73], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 262], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 634], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1928, max= 2035, per=24.06%, avg=1997.50, stdev=50.57, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=7.50%, ctx=139, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5931KiB/s (6073kB/s), 624KiB/s-2278KiB/s (639kB/s-2332kB/s), io=20.0MiB (20.0MB), run=2823-3453msec WRITE: bw=8304KiB/s (8503kB/s), 1627KiB/s-3120KiB/s (1666kB/s-3195kB/s), io=28.0MiB (29.4MB), run=2823-3453msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145146: Mon Aug 10 02:05:42 2026 read: IOPS=3, BW=14.9MiB/s (15.6MB/s)(12.0MiB/808msec) clat (msec): min=107, max=473, avg=242.81, stdev=201.13 lat (msec): min=107, max=473, avg=242.81, stdev=201.13 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min=11538, max=11538, per=100.00%, avg=11538.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=24.78%, ctx=93, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145147: Mon Aug 10 02:05:42 2026 read: IOPS=0, BW=2124KiB/s (2175kB/s)(4096KiB/1928msec) clat (nsec): min=651134k, max=651134k, avg=651134366.00, stdev= 0.00 lat (nsec): min=651136k, max=651136k, avg=651136263.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8126, max= 8126, per=95.63%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4249KiB/s (4351kB/s)(8192KiB/1928msec); 0 zone resets clat (msec): min=476, max=745, avg=611.07, stdev=190.21 lat (msec): min=476, max=745, avg=611.47, stdev=190.22 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8126, max= 8126, per=48.53%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=9.76%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145148: Mon Aug 10 02:05:42 2026 write: IOPS=1, BW=6279KiB/s (6430kB/s)(12.0MiB/1957msec); 0 zone resets clat (msec): min=251, max=976, avg=642.85, stdev=365.86 lat (msec): min=252, max=977, avg=643.15, stdev=365.85 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8126, max= 8126, per=48.53%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.29%, ctx=83, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145149: Mon Aug 10 02:05:42 2026 write: IOPS=2, BW=8666KiB/s (8874kB/s)(12.0MiB/1418msec); 0 zone resets clat (msec): min=173, max=842, avg=459.63, stdev=344.76 lat (msec): min=173, max=842, avg=459.97, stdev=344.71 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min=12190, max=12190, per=72.81%, avg=12190.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.96%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8498KiB/s (8702kB/s), 2124KiB/s-14.9MiB/s (2175kB/s-15.6MB/s), io=16.0MiB (16.8MB), run=808-1928msec WRITE: bw=16.4MiB/s (17.1MB/s), 4249KiB/s-8666KiB/s (4351kB/s-8874kB/s), io=32.0MiB (33.6MB), run=1418-1957msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145150: Mon Aug 10 02:05:42 2026 read: IOPS=1, BW=7341KiB/s (7517kB/s)(12.0MiB/1674msec) clat (msec): min=465, max=630, avg=521.75, stdev=94.34 lat (msec): min=465, max=630, avg=521.75, stdev=94.34 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 5910, max= 5910, per=60.39%, avg=5910.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=29.77%, ctx=676, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145151: Mon Aug 10 02:05:42 2026 read: IOPS=0, BW=2994KiB/s (3066kB/s)(4096KiB/1368msec) clat (nsec): min=437749k, max=437749k, avg=437748807.00, stdev= 0.00 lat (nsec): min=437751k, max=437751k, avg=437751417.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 5979, max= 5979, per=61.09%, avg=5979.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5988KiB/s (6132kB/s)(8192KiB/1368msec); 0 zone resets clat (msec): min=346, max=453, avg=399.71, stdev=75.60 lat (msec): min=346, max=453, avg=400.02, stdev=75.60 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 8143, max= 8143, per=56.19%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=26.12%, ctx=590, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145152: Mon Aug 10 02:05:42 2026 write: IOPS=1, BW=5435KiB/s (5565kB/s)(12.0MiB/2261msec); 0 zone resets clat (msec): min=179, max=1203, avg=744.67, stdev=520.22 lat (msec): min=180, max=1204, avg=745.15, stdev=520.13 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8192, max= 8192, per=56.53%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=5.84%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145153: Mon Aug 10 02:05:42 2026 write: IOPS=1, BW=7642KiB/s (7825kB/s)(12.0MiB/1608msec); 0 zone resets clat (msec): min=202, max=868, avg=497.71, stdev=339.71 lat (msec): min=202, max=869, avg=498.05, stdev=339.75 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 5970, max= 8143, per=48.69%, avg=7056.50, stdev=1536.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=11.76%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9787KiB/s (10.0MB/s), 2994KiB/s-7341KiB/s (3066kB/s-7517kB/s), io=16.0MiB (16.8MB), run=1368-1674msec WRITE: bw=14.2MiB/s (14.8MB/s), 5435KiB/s-7642KiB/s (5565kB/s-7825kB/s), io=32.0MiB (33.6MB), run=1368-2261msec