== sanity test 398b: DIO and buffer IO race ============== 06:22:36 (1788258156) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.92099 s, 8.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179753: Tue Sep 1 06:24:55 2026 read: IOPS=12, BW=49.3KiB/s (50.4kB/s)(5992KiB/121640msec) clat (usec): min=35, max=208861, avg=43047.77, stdev=27945.58 lat (usec): min=35, max=208861, avg=43050.63, stdev=27946.66 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 10421], 10.00th=[ 16450], 20.00th=[ 22152], | 30.00th=[ 26870], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 90702], | 99.00th=[154141], 99.50th=[168821], 99.90th=[202376], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 7, max= 118, per=24.83%, avg=48.92, stdev=18.60, samples=240 iops : min= 1, max= 29, avg=11.60, stdev= 4.69, samples=240 write: IOPS=12, BW=51.8KiB/s (53.0kB/s)(6296KiB/121640msec); 0 zone resets clat (usec): min=910, max=872430, avg=36028.59, stdev=40111.10 lat (usec): min=912, max=872432, avg=36031.84, stdev=40111.14 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1336], 10.00th=[ 1909], 20.00th=[ 4424], | 30.00th=[ 8586], 40.00th=[ 19268], 50.00th=[ 27395], 60.00th=[ 35390], | 70.00th=[ 46924], 80.00th=[ 61604], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[143655], 99.50th=[168821], 99.90th=[242222], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 118, per=25.08%, avg=51.66, stdev=20.72, samples=239 iops : min= 1, max= 29, avg=12.28, stdev= 5.18, samples=239 lat (usec) : 50=0.03%, 100=1.79%, 250=0.26%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.44%, 4=4.07%, 10=6.80%, 20=10.29%, 50=41.63% lat (msec) : 100=25.00%, 250=4.49%, 1000=0.03% cpu : usr=0.08%, sys=5.77%, ctx=6815, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179754: Tue Sep 1 06:24:55 2026 read: IOPS=12, BW=49.5KiB/s (50.7kB/s)(5940KiB/119997msec) clat (usec): min=41, max=322520, avg=44046.56, stdev=27944.56 lat (usec): min=42, max=322521, avg=44049.76, stdev=27942.94 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 13304], 10.00th=[ 18220], 20.00th=[ 23987], | 30.00th=[ 28181], 40.00th=[ 33162], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 61080], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[135267], 99.50th=[160433], 99.90th=[278922], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 96, per=24.93%, avg=49.11, stdev=18.12, samples=236 iops : min= 1, max= 24, avg=11.63, stdev= 4.55, samples=236 write: IOPS=13, BW=52.9KiB/s (54.2kB/s)(6348KiB/119997msec); 0 zone resets clat (usec): min=1036, max=762448, avg=34086.19, stdev=38041.55 lat (usec): min=1038, max=762450, avg=34097.98, stdev=38045.34 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1844], 20.00th=[ 4047], | 30.00th=[ 7701], 40.00th=[ 15139], 50.00th=[ 24511], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[139461], 99.50th=[156238], 99.90th=[248513], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 120, per=25.56%, avg=52.65, stdev=21.57, samples=235 iops : min= 1, max= 30, avg=12.52, stdev= 5.43, samples=235 lat (usec) : 50=0.03%, 100=1.40%, 250=0.13%, 500=0.10%, 1000=0.03% lat (msec) : 2=6.05%, 4=4.20%, 10=7.55%, 20=10.19%, 50=40.85% lat (msec) : 100=25.23%, 250=4.10%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=5.73%, ctx=6776, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179755: Tue Sep 1 06:24:55 2026 read: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6028KiB/121798msec) clat (usec): min=34, max=893408, avg=44529.09, stdev=36628.26 lat (usec): min=34, max=893409, avg=44531.61, stdev=36627.92 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 306], 10.00th=[ 15795], 20.00th=[ 22152], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 53216], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[177210], 99.90th=[312476], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 15, max= 142, per=24.94%, avg=49.13, stdev=18.71, samples=240 iops : min= 3, max= 35, avg=11.64, stdev= 4.73, samples=240 write: IOPS=12, BW=51.4KiB/s (52.6kB/s)(6260KiB/121798msec); 0 zone resets clat (usec): min=1010, max=218796, avg=34689.87, stdev=34267.62 lat (usec): min=1011, max=218797, avg=34691.84, stdev=34267.60 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1975], 20.00th=[ 4228], | 30.00th=[ 7898], 40.00th=[ 17171], 50.00th=[ 25822], 60.00th=[ 35390], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[149947], 99.50th=[156238], 99.90th=[214959], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 157, per=24.86%, avg=51.22, stdev=21.05, samples=239 iops : min= 1, max= 39, avg=12.17, stdev= 5.30, samples=239 lat (usec) : 50=0.23%, 100=1.82%, 250=0.39%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.31%, 4=4.52%, 10=7.42%, 20=10.16%, 50=40.36% lat (msec) : 100=24.97%, 250=4.59%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.47%, ctx=6660, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179756: Tue Sep 1 06:24:55 2026 read: IOPS=12, BW=50.6KiB/s (51.9kB/s)(6052KiB/119498msec) clat (usec): min=35, max=913428, avg=43797.59, stdev=36842.03 lat (usec): min=36, max=913429, avg=43801.85, stdev=36842.65 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 11469], 10.00th=[ 17171], 20.00th=[ 22152], | 30.00th=[ 26346], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[147850], 99.50th=[177210], 99.90th=[270533], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 103, per=25.62%, avg=50.47, stdev=17.99, samples=234 iops : min= 1, max= 25, avg=11.98, stdev= 4.51, samples=234 write: IOPS=13, BW=52.2KiB/s (53.4kB/s)(6236KiB/119498msec); 0 zone resets clat (usec): min=1029, max=297393, avg=33865.91, stdev=34675.82 lat (usec): min=1029, max=297394, avg=33869.45, stdev=34676.19 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1319], 10.00th=[ 1762], 20.00th=[ 3523], | 30.00th=[ 6587], 40.00th=[ 15008], 50.00th=[ 25035], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 59507], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[147850], 99.50th=[158335], 99.90th=[210764], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 144, per=25.23%, avg=51.98, stdev=22.08, samples=234 iops : min= 1, max= 36, avg=12.35, stdev= 5.55, samples=234 lat (usec) : 50=0.16%, 100=1.43%, 250=0.23%, 500=0.07%, 750=0.03% lat (msec) : 2=5.66%, 4=5.47%, 10=7.26%, 20=9.60%, 50=41.31% lat (msec) : 100=24.32%, 250=4.30%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=5.57%, ctx=6607, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=197KiB/s (202kB/s), 49.3KiB/s-50.6KiB/s (50.4kB/s-51.9kB/s), io=23.4MiB (24.6MB), run=119498-121798msec WRITE: bw=206KiB/s (211kB/s), 51.4KiB/s-52.9KiB/s (52.6kB/s-54.2kB/s), io=24.6MiB (25.7MB), run=119498-121798msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179749: Tue Sep 1 06:25:37 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(5992KiB/161616msec) clat (msec): min=5, max=820, avg=41.27, stdev=40.53 lat (msec): min=5, max=820, avg=41.28, stdev=40.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 92], 95.00th=[ 118], | 99.00th=[ 171], 99.50th=[ 201], 99.90th=[ 296], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 135, per=25.30%, avg=37.19, stdev=25.05, samples=313 iops : min= 1, max= 33, avg= 8.63, stdev= 6.30, samples=313 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6296KiB/161616msec); 0 zone resets clat (msec): min=11, max=376, avg=63.16, stdev=43.46 lat (msec): min=11, max=376, avg=63.16, stdev=43.46 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 120], 95.00th=[ 146], | 99.00th=[ 205], 99.50th=[ 279], 99.90th=[ 359], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 111, per=25.20%, avg=38.81, stdev=22.79, samples=315 iops : min= 1, max= 27, avg= 9.04, stdev= 5.74, samples=315 lat (msec) : 10=1.99%, 20=14.19%, 50=46.97%, 100=24.64%, 250=11.82% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=1.88%, ctx=4790, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179750: Tue Sep 1 06:25:37 2026 read: IOPS=9, BW=36.4KiB/s (37.3kB/s)(5940KiB/162988msec) clat (msec): min=5, max=917, avg=42.34, stdev=44.41 lat (msec): min=5, max=917, avg=42.34, stdev=44.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 60], 90.00th=[ 92], 95.00th=[ 129], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 300], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 133, per=25.26%, avg=37.13, stdev=25.24, samples=311 iops : min= 1, max= 33, avg= 8.62, stdev= 6.34, samples=311 write: IOPS=9, BW=38.9KiB/s (39.9kB/s)(6348KiB/162988msec); 0 zone resets clat (msec): min=12, max=362, avg=62.81, stdev=42.19 lat (msec): min=12, max=362, avg=62.82, stdev=42.19 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 121], 95.00th=[ 140], | 99.00th=[ 201], 99.50th=[ 251], 99.90th=[ 359], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 119, per=25.24%, avg=38.87, stdev=23.02, samples=317 iops : min= 1, max= 29, avg= 9.05, stdev= 5.79, samples=317 lat (msec) : 10=1.95%, 20=14.84%, 50=46.29%, 100=24.09%, 250=12.43% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=1.88%, ctx=4852, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179751: Tue Sep 1 06:25:37 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6028KiB/161652msec) clat (msec): min=5, max=294, avg=41.88, stdev=37.92 lat (msec): min=5, max=294, avg=41.89, stdev=37.92 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 96], 95.00th=[ 127], | 99.00th=[ 176], 99.50th=[ 218], 99.90th=[ 271], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 143, per=25.37%, avg=37.29, stdev=24.13, samples=314 iops : min= 1, max= 35, avg= 8.66, stdev= 6.08, samples=314 write: IOPS=9, BW=38.7KiB/s (39.7kB/s)(6260KiB/161652msec); 0 zone resets clat (msec): min=10, max=947, avg=62.73, stdev=46.39 lat (msec): min=10, max=947, avg=62.74, stdev=46.39 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 120], 95.00th=[ 144], | 99.00th=[ 205], 99.50th=[ 226], 99.90th=[ 288], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 135, per=25.21%, avg=38.82, stdev=22.84, samples=313 iops : min= 1, max= 33, avg= 9.04, stdev= 5.74, samples=313 lat (msec) : 10=1.56%, 20=14.52%, 50=47.56%, 100=23.80%, 250=12.27% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=1.89%, ctx=4701, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179752: Tue Sep 1 06:25:37 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6052KiB/162709msec) clat (msec): min=5, max=296, avg=41.69, stdev=37.79 lat (msec): min=5, max=296, avg=41.69, stdev=37.79 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 95], 95.00th=[ 125], | 99.00th=[ 182], 99.50th=[ 226], 99.90th=[ 268], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 151, per=25.71%, avg=37.79, stdev=24.36, samples=310 iops : min= 1, max= 37, avg= 8.78, stdev= 6.13, samples=310 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6236KiB/162709msec); 0 zone resets clat (msec): min=12, max=925, avg=63.65, stdev=46.96 lat (msec): min=12, max=925, avg=63.66, stdev=46.96 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 146], | 99.00th=[ 205], 99.50th=[ 232], 99.90th=[ 317], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 127, per=24.73%, avg=38.09, stdev=22.75, samples=317 iops : min= 1, max= 31, avg= 8.86, stdev= 5.73, samples=317 lat (msec) : 10=1.76%, 20=15.27%, 50=45.83%, 100=24.38%, 250=12.43% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=1.86%, ctx=4777, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (151kB/s), 36.4KiB/s-37.3KiB/s (37.3kB/s-38.2kB/s), io=23.4MiB (24.6MB), run=161616-162988msec WRITE: bw=154KiB/s (158kB/s), 38.3KiB/s-38.0KiB/s (39.2kB/s-39.9kB/s), io=24.6MiB (25.7MB), run=161616-162988msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179793: Tue Sep 1 06:26:27 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(5920KiB/38789msec) clat (usec): min=44, max=265418, avg=55471.32, stdev=38455.59 lat (usec): min=45, max=265419, avg=55472.77, stdev=38455.61 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 60], 10.00th=[ 363], 20.00th=[ 25035], | 30.00th=[ 33424], 40.00th=[ 42730], 50.00th=[ 50594], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 81265], 90.00th=[103285], 95.00th=[121111], | 99.00th=[185598], 99.50th=[219153], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 407, per=25.26%, avg=150.80, stdev=67.36, samples=76 iops : min= 1, max= 25, avg= 8.61, stdev= 4.28, samples=76 write: IOPS=10, BW=164KiB/s (168kB/s)(6368KiB/38789msec); 0 zone resets clat (usec): min=1292, max=270886, avg=45584.74, stdev=43886.43 lat (usec): min=1293, max=270888, avg=45592.46, stdev=43887.17 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1795], 10.00th=[ 2999], 20.00th=[ 6587], | 30.00th=[ 13304], 40.00th=[ 24773], 50.00th=[ 32637], 60.00th=[ 43779], | 70.00th=[ 58983], 80.00th=[ 80217], 90.00th=[111674], 95.00th=[135267], | 99.00th=[191890], 99.50th=[198181], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 402, per=26.35%, avg=165.49, stdev=74.42, samples=75 iops : min= 1, max= 25, avg= 9.53, stdev= 4.73, samples=75 lat (usec) : 50=0.26%, 100=4.17%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=3.52%, 4=3.91%, 10=7.16%, 20=6.77%, 50=30.73% lat (msec) : 100=31.51%, 250=11.20%, 500=0.26% cpu : usr=0.05%, sys=4.75%, ctx=1591, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179794: Tue Sep 1 06:26:27 2026 read: IOPS=8, BW=143KiB/s (147kB/s)(5744KiB/40088msec) clat (usec): min=43, max=336927, avg=58862.71, stdev=41420.81 lat (usec): min=43, max=336929, avg=58867.32, stdev=41423.37 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 14746], 20.00th=[ 27919], | 30.00th=[ 35390], 40.00th=[ 42730], 50.00th=[ 51643], 60.00th=[ 61080], | 70.00th=[ 72877], 80.00th=[ 87557], 90.00th=[109577], 95.00th=[137364], | 99.00th=[185598], 99.50th=[233833], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 30, max= 285, per=23.76%, avg=141.82, stdev=59.12, samples=78 iops : min= 1, max= 17, avg= 8.04, stdev= 3.75, samples=78 write: IOPS=10, BW=163KiB/s (167kB/s)(6544KiB/40088msec); 0 zone resets clat (usec): min=1330, max=217296, avg=45865.95, stdev=43785.69 lat (usec): min=1332, max=217299, avg=45882.04, stdev=43799.62 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1844], 10.00th=[ 3326], 20.00th=[ 6980], | 30.00th=[ 13829], 40.00th=[ 24249], 50.00th=[ 33817], 60.00th=[ 43254], | 70.00th=[ 56886], 80.00th=[ 78119], 90.00th=[110625], 95.00th=[132645], | 99.00th=[181404], 99.50th=[206570], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 346, per=25.72%, avg=161.54, stdev=68.59, samples=78 iops : min= 1, max= 21, avg= 9.28, stdev= 4.33, samples=78 lat (usec) : 50=0.26%, 100=3.12%, 250=0.39%, 500=0.26%, 750=0.26% lat (msec) : 2=2.99%, 4=2.99%, 10=7.16%, 20=7.16%, 50=32.16% lat (msec) : 100=30.99%, 250=12.11%, 500=0.13% cpu : usr=0.03%, sys=4.44%, ctx=1577, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179795: Tue Sep 1 06:26:27 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6256KiB/39037msec) clat (usec): min=43, max=349945, avg=57303.61, stdev=40636.19 lat (usec): min=44, max=349946, avg=57305.09, stdev=40636.22 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 725], 20.00th=[ 29492], | 30.00th=[ 36963], 40.00th=[ 44303], 50.00th=[ 51119], 60.00th=[ 61080], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[102237], 95.00th=[120062], | 99.00th=[196084], 99.50th=[242222], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 349, per=26.90%, avg=160.59, stdev=64.94, samples=76 iops : min= 1, max= 21, avg= 9.22, stdev= 4.07, samples=76 write: IOPS=9, BW=155KiB/s (158kB/s)(6032KiB/39037msec); 0 zone resets clat (usec): min=1424, max=320863, avg=43738.84, stdev=45442.49 lat (usec): min=1425, max=320866, avg=43742.60, stdev=45442.12 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1893], 10.00th=[ 3490], 20.00th=[ 6194], | 30.00th=[ 11863], 40.00th=[ 19792], 50.00th=[ 30278], 60.00th=[ 41681], | 70.00th=[ 52691], 80.00th=[ 73925], 90.00th=[108528], 95.00th=[139461], | 99.00th=[189793], 99.50th=[229639], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 318, per=24.84%, avg=156.01, stdev=71.37, samples=74 iops : min= 1, max= 19, avg= 8.92, stdev= 4.52, samples=74 lat (usec) : 50=0.39%, 100=4.43%, 250=0.13%, 750=0.26% lat (msec) : 2=3.52%, 4=2.60%, 10=7.16%, 20=7.55%, 50=32.03% lat (msec) : 100=31.12%, 250=10.55%, 500=0.26% cpu : usr=0.06%, sys=4.74%, ctx=1611, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179796: Tue Sep 1 06:26:27 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(6032KiB/38238msec) clat (usec): min=42, max=269080, avg=54344.62, stdev=41153.18 lat (usec): min=43, max=269082, avg=54346.24, stdev=41153.18 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 24773], | 30.00th=[ 34341], 40.00th=[ 41157], 50.00th=[ 47449], 60.00th=[ 55313], | 70.00th=[ 68682], 80.00th=[ 81265], 90.00th=[101188], 95.00th=[122160], | 99.00th=[202376], 99.50th=[242222], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 345, per=27.00%, avg=161.19, stdev=68.99, samples=73 iops : min= 1, max= 21, avg= 9.26, stdev= 4.33, samples=73 write: IOPS=10, BW=164KiB/s (168kB/s)(6256KiB/38238msec); 0 zone resets clat (usec): min=1339, max=304345, avg=45000.28, stdev=45822.96 lat (usec): min=1340, max=304346, avg=45009.48, stdev=45829.26 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1795], 10.00th=[ 2769], 20.00th=[ 6652], | 30.00th=[ 12780], 40.00th=[ 19268], 50.00th=[ 28967], 60.00th=[ 44827], | 70.00th=[ 58983], 80.00th=[ 73925], 90.00th=[108528], 95.00th=[141558], | 99.00th=[185598], 99.50th=[238027], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 316, per=26.14%, avg=164.17, stdev=68.57, samples=75 iops : min= 1, max= 19, avg= 9.44, stdev= 4.33, samples=75 lat (usec) : 50=0.26%, 100=6.25%, 250=0.26%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.78%, 4=2.60%, 10=6.77%, 20=8.72%, 50=28.78% lat (msec) : 100=30.21%, 250=11.59%, 500=0.26% cpu : usr=0.07%, sys=4.84%, ctx=1603, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=597KiB/s (612kB/s), 143KiB/s-160KiB/s (147kB/s-164kB/s), io=23.4MiB (24.5MB), run=38238-40088msec WRITE: bw=629KiB/s (644kB/s), 155KiB/s-164KiB/s (158kB/s-168kB/s), io=24.6MiB (25.8MB), run=38238-40088msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179798: Tue Sep 1 06:26:40 2026 read: IOPS=7, BW=115KiB/s (118kB/s)(5920KiB/51435msec) clat (msec): min=6, max=334, avg=51.80, stdev=46.77 lat (msec): min=6, max=334, avg=51.81, stdev=46.77 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 45], | 70.00th=[ 59], 80.00th=[ 73], 90.00th=[ 112], 95.00th=[ 155], | 99.00th=[ 247], 99.50th=[ 309], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 479, per=25.59%, avg=116.71, stdev=87.20, samples=99 iops : min= 1, max= 29, avg= 6.48, stdev= 5.51, samples=99 write: IOPS=7, BW=124KiB/s (127kB/s)(6368KiB/51435msec); 0 zone resets clat (msec): min=16, max=425, avg=80.97, stdev=59.23 lat (msec): min=16, max=425, avg=80.98, stdev=59.24 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 61], 60.00th=[ 80], | 70.00th=[ 99], 80.00th=[ 118], 90.00th=[ 153], 95.00th=[ 220], | 99.00th=[ 284], 99.50th=[ 376], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 31, max= 383, per=26.30%, avg=126.22, stdev=80.17, samples=99 iops : min= 1, max= 23, avg= 7.08, stdev= 5.07, samples=99 lat (msec) : 10=1.04%, 20=10.16%, 50=41.28%, 100=26.17%, 250=20.18% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.40%, ctx=1136, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179799: Tue Sep 1 06:26:40 2026 read: IOPS=6, BW=109KiB/s (112kB/s)(5744KiB/52473msec) clat (msec): min=8, max=404, avg=53.81, stdev=53.12 lat (msec): min=8, max=404, avg=53.81, stdev=53.12 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 58], 80.00th=[ 81], 90.00th=[ 124], 95.00th=[ 159], | 99.00th=[ 288], 99.50th=[ 347], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 23, max= 447, per=25.04%, avg=114.16, stdev=88.72, samples=98 iops : min= 1, max= 27, avg= 6.33, stdev= 5.62, samples=98 write: IOPS=7, BW=125KiB/s (128kB/s)(6544KiB/52473msec); 0 zone resets clat (msec): min=13, max=375, avg=81.00, stdev=58.14 lat (msec): min=13, max=375, avg=81.00, stdev=58.14 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 61], 60.00th=[ 77], | 70.00th=[ 99], 80.00th=[ 127], 90.00th=[ 161], 95.00th=[ 203], | 99.00th=[ 266], 99.50th=[ 288], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 384, per=26.13%, avg=125.41, stdev=83.96, samples=102 iops : min= 1, max= 24, avg= 7.05, stdev= 5.35, samples=102 lat (msec) : 10=0.39%, 20=10.42%, 50=42.19%, 100=25.78%, 250=19.66% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.33%, ctx=1165, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179800: Tue Sep 1 06:26:40 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(6256KiB/51396msec) clat (msec): min=7, max=399, avg=53.83, stdev=53.76 lat (msec): min=7, max=399, avg=53.83, stdev=53.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 56], 80.00th=[ 82], 90.00th=[ 116], 95.00th=[ 161], | 99.00th=[ 305], 99.50th=[ 384], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 30, max= 447, per=26.96%, avg=122.93, stdev=94.51, samples=100 iops : min= 1, max= 27, avg= 6.87, stdev= 5.99, samples=100 write: IOPS=7, BW=117KiB/s (120kB/s)(6032KiB/51396msec); 0 zone resets clat (msec): min=15, max=288, avg=80.37, stdev=56.04 lat (msec): min=15, max=288, avg=80.38, stdev=56.05 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 73], | 70.00th=[ 94], 80.00th=[ 122], 90.00th=[ 171], 95.00th=[ 207], | 99.00th=[ 249], 99.50th=[ 284], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 380, per=24.63%, avg=118.22, stdev=79.53, samples=100 iops : min= 1, max= 23, avg= 6.57, stdev= 5.01, samples=100 lat (msec) : 10=0.78%, 20=9.90%, 50=44.01%, 100=25.65%, 250=18.62% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.34%, ctx=1156, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179801: Tue Sep 1 06:26:40 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/52088msec) clat (msec): min=7, max=274, avg=56.90, stdev=52.06 lat (msec): min=7, max=274, avg=56.90, stdev=52.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 46], | 70.00th=[ 60], 80.00th=[ 91], 90.00th=[ 140], 95.00th=[ 178], | 99.00th=[ 230], 99.50th=[ 268], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 415, per=26.18%, avg=119.40, stdev=86.50, samples=98 iops : min= 1, max= 25, avg= 6.65, stdev= 5.50, samples=98 write: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52088msec); 0 zone resets clat (msec): min=13, max=426, avg=78.28, stdev=58.39 lat (msec): min=13, max=426, avg=78.29, stdev=58.39 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 46], 50.00th=[ 59], 60.00th=[ 74], | 70.00th=[ 90], 80.00th=[ 115], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 330], 99.50th=[ 376], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 351, per=26.00%, avg=124.79, stdev=83.21, samples=98 iops : min= 1, max= 21, avg= 7.00, stdev= 5.26, samples=98 lat (msec) : 10=0.52%, 20=11.59%, 50=41.02%, 100=25.65%, 250=20.05% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.44%, ctx=1139, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=456KiB/s (467kB/s), 109KiB/s-122KiB/s (112kB/s-125kB/s), io=23.4MiB (24.5MB), run=51396-52473msec WRITE: bw=480KiB/s (492kB/s), 117KiB/s-125KiB/s (120kB/s-128kB/s), io=24.6MiB (25.8MB), run=51396-52473msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179815: Tue Sep 1 06:26:57 2026 read: IOPS=1, BW=1688KiB/s (1728kB/s)(7168KiB/4247msec) clat (msec): min=53, max=253, avg=188.79, stdev=68.58 lat (msec): min=53, max=253, avg=188.79, stdev=68.58 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 157], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 201], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 253], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 2027, max= 4087, per=87.26%, avg=2976.50, stdev=1093.30, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1206KiB/s (1234kB/s)(5120KiB/4247msec); 0 zone resets clat (msec): min=170, max=2023, avg=577.79, stdev=809.06 lat (msec): min=170, max=2023, avg=577.89, stdev=809.08 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 1946, max= 4096, per=52.93%, avg=2528.00, stdev=1046.20, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=13.38%, ctx=172, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179816: Tue Sep 1 06:26:57 2026 read: IOPS=0, BW=341KiB/s (349kB/s)(2048KiB/6003msec) clat (usec): min=576, max=2133.9k, avg=1067239.26, stdev=1508489.05 lat (usec): min=577, max=2133.9k, avg=1067240.23, stdev=1508489.05 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], | 20.00th=[ 578], 30.00th=[ 578], 40.00th=[ 578], | 50.00th=[ 578], 60.00th=[2139096], 70.00th=[2139096], | 80.00th=[2139096], 90.00th=[2139096], 95.00th=[2139096], | 99.00th=[2139096], 99.50th=[2139096], 99.90th=[2139096], | 99.95th=[2139096], 99.99th=[2139096] bw ( KiB/s): min= 2043, max= 2048, per=59.97%, avg=2045.50, stdev= 3.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1706KiB/s (1747kB/s)(10.0MiB/6003msec); 0 zone resets clat (msec): min=185, max=1027, avg=352.02, stdev=248.17 lat (msec): min=185, max=1027, avg=352.11, stdev=248.16 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 194], | 30.00th=[ 236], 40.00th=[ 251], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 300], 80.00th=[ 380], 90.00th=[ 414], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1921, max= 6107, per=76.50%, avg=3653.60, stdev=1731.36, samples=5 iops : min= 1, max= 5, avg= 3.20, stdev= 1.64, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=15.01%, ctx=458, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179817: Tue Sep 1 06:26:57 2026 read: IOPS=2, BW=2060KiB/s (2109kB/s)(6144KiB/2983msec) clat (msec): min=4, max=956, avg=245.41, stdev=355.96 lat (msec): min=4, max=956, avg=245.41, stdev=355.96 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 26], | 30.00th=[ 26], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 161], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2048, max= 4096, per=99.67%, avg=3399.67, stdev=1170.76, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2060KiB/s (2109kB/s)(6144KiB/2983msec); 0 zone resets clat (msec): min=128, max=389, avg=238.23, stdev=86.95 lat (msec): min=128, max=389, avg=238.72, stdev=87.14 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 241], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2027, max= 2760, per=46.50%, avg=2220.75, stdev=359.64, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (msec) : 10=8.33%, 50=8.33%, 250=58.33%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=17.91%, ctx=253, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179818: Tue Sep 1 06:26:57 2026 read: IOPS=0, BW=972KiB/s (995kB/s)(5120KiB/5268msec) clat (usec): min=547, max=325367, avg=162543.49, stdev=155697.22 lat (usec): min=548, max=325369, avg=162544.62, stdev=155697.23 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[ 996], 40.00th=[ 996], 50.00th=[191890], 60.00th=[191890], | 70.00th=[295699], 80.00th=[295699], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 3849, max= 4096, per=100.00%, avg=3972.50, stdev=174.66, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1361KiB/s (1393kB/s)(7168KiB/5268msec); 0 zone resets clat (msec): min=91, max=2617, avg=618.22, stdev=887.67 lat (msec): min=91, max=2617, avg=618.32, stdev=887.65 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 247], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 309], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 422], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1418, max= 2048, per=39.21%, avg=1872.60, stdev=259.47, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=11.07%, ctx=151, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3412KiB/s (3494kB/s), 341KiB/s-2060KiB/s (349kB/s-2109kB/s), io=20.0MiB (20.0MB), run=2983-6003msec WRITE: bw=4776KiB/s (4891kB/s), 1206KiB/s-2060KiB/s (1234kB/s-2109kB/s), io=28.0MiB (29.4MB), run=2983-6003msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179820: Tue Sep 1 06:26:57 2026 read: IOPS=1, BW=1210KiB/s (1239kB/s)(7168KiB/5926msec) clat (msec): min=104, max=449, avg=246.20, stdev=144.88 lat (msec): min=104, max=449, avg=246.24, stdev=144.84 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 125], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 197], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 422], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1865, max= 4055, per=90.48%, avg=2987.50, stdev=1206.81, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=864KiB/s (885kB/s)(5120KiB/5926msec); 0 zone resets clat (msec): min=220, max=2139, avg=824.77, stdev=790.84 lat (msec): min=221, max=2139, avg=824.86, stdev=790.84 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 2003, max= 2043, per=43.74%, avg=2022.00, stdev=16.45, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.71%, ctx=101, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179821: Tue Sep 1 06:26:57 2026 read: IOPS=0, BW=330KiB/s (338kB/s)(2048KiB/6202msec) clat (msec): min=170, max=2427, avg=1298.87, stdev=1596.12 lat (msec): min=170, max=2427, avg=1298.87, stdev=1596.12 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 2433], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 2019, max= 2023, per=61.21%, avg=2021.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1651KiB/s (1691kB/s)(10.0MiB/6202msec); 0 zone resets clat (msec): min=123, max=796, avg=332.27, stdev=200.90 lat (msec): min=123, max=797, avg=332.39, stdev=200.91 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 127], | 30.00th=[ 171], 40.00th=[ 264], 50.00th=[ 288], 60.00th=[ 292], | 70.00th=[ 393], 80.00th=[ 409], 90.00th=[ 464], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2003, max= 6071, per=65.64%, avg=3034.33, stdev=1693.93, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.49%, ctx=124, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179822: Tue Sep 1 06:26:57 2026 read: IOPS=1, BW=1055KiB/s (1080kB/s)(6144KiB/5824msec) clat (msec): min=78, max=436, avg=236.40, stdev=158.90 lat (msec): min=78, max=436, avg=236.40, stdev=158.90 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 259], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 2011, max= 4071, per=100.00%, avg=3340.00, stdev=1152.87, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1055KiB/s (1080kB/s)(6144KiB/5824msec); 0 zone resets clat (msec): min=146, max=2138, avg=634.27, stdev=744.21 lat (msec): min=146, max=2138, avg=634.42, stdev=744.20 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 422], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 2011, max= 2048, per=43.94%, avg=2031.17, stdev=14.97, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 100=16.67%, 250=16.67%, 500=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.22%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179823: Tue Sep 1 06:26:57 2026 read: IOPS=0, BW=828KiB/s (847kB/s)(5120KiB/6187msec) clat (msec): min=79, max=807, avg=282.55, stdev=302.18 lat (msec): min=79, max=807, avg=282.55, stdev=302.18 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2003, max= 4047, per=81.42%, avg=2688.33, stdev=1176.66, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1159KiB/s (1186kB/s)(7168KiB/6187msec); 0 zone resets clat (msec): min=100, max=2663, avg=664.48, stdev=899.34 lat (msec): min=100, max=2663, avg=664.66, stdev=899.28 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 108], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 388], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 558], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 2003, max= 6071, per=61.27%, avg=2832.60, stdev=1810.38, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.05%, sys=4.98%, ctx=139, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3302KiB/s (3381kB/s), 330KiB/s-1210KiB/s (338kB/s-1239kB/s), io=20.0MiB (20.0MB), run=5824-6202msec WRITE: bw=4623KiB/s (4734kB/s), 864KiB/s-1651KiB/s (885kB/s-1691kB/s), io=28.0MiB (29.4MB), run=5824-6202msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179830: Tue Sep 1 06:27:11 2026 read: IOPS=0, BW=3442KiB/s (3525kB/s)(12.0MiB/3570msec) clat (msec): min=915, max=1619, avg=1155.27, stdev=402.30 lat (msec): min=915, max=1619, avg=1155.27, stdev=402.30 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7968, max= 8175, per=100.00%, avg=8071.50, stdev=146.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.63%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179831: Tue Sep 1 06:27:11 2026 read: IOPS=0, BW=1389KiB/s (1422kB/s)(4096KiB/2949msec) clat (nsec): min=217960k, max=217960k, avg=217960086.00, stdev= 0.00 lat (nsec): min=217962k, max=217962k, avg=217962126.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 6330, max= 6330, per=100.00%, avg=6330.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2778KiB/s (2845kB/s)(8192KiB/2949msec); 0 zone resets clat (msec): min=1070, max=1610, avg=1340.83, stdev=381.75 lat (msec): min=1073, max=1611, avg=1342.29, stdev=380.18 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8175, max= 8175, per=82.36%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.53%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179832: Tue Sep 1 06:27:11 2026 write: IOPS=0, BW=3811KiB/s (3903kB/s)(12.0MiB/3224msec); 0 zone resets clat (msec): min=755, max=1431, avg=1047.08, stdev=347.50 lat (msec): min=756, max=1432, avg=1047.55, stdev=347.64 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8015, max= 8015, per=80.75%, avg=8015.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.09%, ctx=68, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179833: Tue Sep 1 06:27:11 2026 write: IOPS=0, BW=3723KiB/s (3812kB/s)(12.0MiB/3301msec); 0 zone resets clat (msec): min=367, max=1947, avg=1072.70, stdev=803.81 lat (msec): min=367, max=1948, avg=1073.12, stdev=803.93 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8015, max= 8015, per=80.75%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=3.58%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4589KiB/s (4700kB/s), 1389KiB/s-3442KiB/s (1422kB/s-3525kB/s), io=16.0MiB (16.8MB), run=2949-3570msec WRITE: bw=9927KiB/s (10.2MB/s), 2778KiB/s-3811KiB/s (2845kB/s-3903kB/s), io=32.0MiB (33.6MB), run=2949-3301msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179834: Tue Sep 1 06:27:12 2026 read: IOPS=1, BW=5408KiB/s (5538kB/s)(12.0MiB/2272msec) clat (msec): min=645, max=800, avg=726.55, stdev=78.07 lat (msec): min=645, max=800, avg=726.55, stdev=78.07 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 5490, max= 7953, per=100.00%, avg=6721.50, stdev=1741.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=12.55%, ctx=316, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179835: Tue Sep 1 06:27:12 2026 read: IOPS=0, BW=1033KiB/s (1058kB/s)(4096KiB/3966msec) clat (nsec): min=725791k, max=725791k, avg=725791437.00, stdev= 0.00 lat (nsec): min=725795k, max=725795k, avg=725794960.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2066KiB/s (2115kB/s)(8192KiB/3966msec); 0 zone resets clat (msec): min=1118, max=2009, avg=1563.87, stdev=630.39 lat (msec): min=1123, max=2009, avg=1566.74, stdev=626.73 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 2005], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 7984, max= 7984, per=96.64%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.41%, ctx=137, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179836: Tue Sep 1 06:27:12 2026 write: IOPS=0, BW=3193KiB/s (3270kB/s)(12.0MiB/3848msec); 0 zone resets clat (msec): min=652, max=1840, avg=1261.28, stdev=594.82 lat (msec): min=652, max=1841, avg=1262.00, stdev=595.14 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8062, max= 8110, per=97.87%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.57%, ctx=32, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179837: Tue Sep 1 06:27:12 2026 write: IOPS=0, BW=3279KiB/s (3358kB/s)(12.0MiB/3747msec); 0 zone resets clat (msec): min=344, max=2322, avg=1222.85, stdev=1007.76 lat (msec): min=344, max=2323, avg=1223.19, stdev=1007.72 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8047, max= 8062, per=97.49%, avg=8054.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.68%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4131KiB/s (4230kB/s), 1033KiB/s-5408KiB/s (1058kB/s-5538kB/s), io=16.0MiB (16.8MB), run=2272-3966msec WRITE: bw=8262KiB/s (8461kB/s), 2066KiB/s-3279KiB/s (2115kB/s-3358kB/s), io=32.0MiB (33.6MB), run=3747-3966msec