== sanity test 398b: DIO and buffer IO race ============== 03:11:39 (1761289899) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.87333 s, 13.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183141: Fri Oct 24 03:13:14 2025 read: IOPS=18, BW=72.6KiB/s (74.4kB/s)(5992KiB/82511msec) clat (usec): min=119, max=177750, avg=30629.62, stdev=17896.62 lat (usec): min=120, max=177751, avg=30630.77, stdev=17896.59 clat percentiles (usec): | 1.00th=[ 169], 5.00th=[ 9372], 10.00th=[ 12649], 20.00th=[ 16581], | 30.00th=[ 19792], 40.00th=[ 23462], 50.00th=[ 27657], 60.00th=[ 32375], | 70.00th=[ 37487], 80.00th=[ 43254], 90.00th=[ 52167], 95.00th=[ 60556], | 99.00th=[ 85459], 99.50th=[101188], 99.90th=[162530], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 15, max= 134, per=24.71%, avg=71.90, stdev=21.10, samples=163 iops : min= 3, max= 33, avg=17.35, stdev= 5.32, samples=163 write: IOPS=19, BW=76.3KiB/s (78.1kB/s)(6296KiB/82511msec); 0 zone resets clat (usec): min=898, max=657893, avg=23078.58, stdev=27135.25 lat (usec): min=898, max=657894, avg=23084.52, stdev=27133.62 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1139], 10.00th=[ 1319], 20.00th=[ 2573], | 30.00th=[ 5604], 40.00th=[ 12780], 50.00th=[ 17957], 60.00th=[ 23200], | 70.00th=[ 29754], 80.00th=[ 38011], 90.00th=[ 52691], 95.00th=[ 64226], | 99.00th=[ 98042], 99.50th=[110625], 99.90th=[177210], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 189, per=25.02%, avg=76.07, stdev=27.23, samples=162 iops : min= 1, max= 47, avg=18.40, stdev= 6.85, samples=162 lat (usec) : 250=1.17%, 500=0.65%, 750=0.03%, 1000=0.29% lat (msec) : 2=8.07%, 4=4.88%, 10=6.51%, 20=20.83%, 50=45.70% lat (msec) : 100=11.13%, 250=0.68%, 750=0.03% cpu : usr=0.10%, sys=8.76%, ctx=6692, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183142: Fri Oct 24 03:13:14 2025 read: IOPS=18, BW=73.6KiB/s (75.4kB/s)(5940KiB/80701msec) clat (usec): min=134, max=206038, avg=30133.85, stdev=18575.01 lat (usec): min=135, max=206038, avg=30134.94, stdev=18575.01 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 8586], 10.00th=[ 12780], 20.00th=[ 16581], | 30.00th=[ 19530], 40.00th=[ 22414], 50.00th=[ 26608], 60.00th=[ 31065], | 70.00th=[ 35914], 80.00th=[ 42206], 90.00th=[ 52167], 95.00th=[ 61604], | 99.00th=[ 94897], 99.50th=[108528], 99.90th=[162530], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 7, max= 135, per=25.12%, avg=73.09, stdev=24.31, samples=159 iops : min= 1, max= 33, avg=17.64, stdev= 6.07, samples=159 write: IOPS=19, BW=78.7KiB/s (80.5kB/s)(6348KiB/80701msec); 0 zone resets clat (usec): min=850, max=676781, avg=22462.04, stdev=26967.15 lat (usec): min=851, max=676782, avg=22463.57, stdev=26967.47 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1123], 10.00th=[ 1237], 20.00th=[ 2311], | 30.00th=[ 4883], 40.00th=[ 11731], 50.00th=[ 17433], 60.00th=[ 22676], | 70.00th=[ 28443], 80.00th=[ 38011], 90.00th=[ 52167], 95.00th=[ 65274], | 99.00th=[ 92799], 99.50th=[ 99091], 99.90th=[143655], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 151, per=25.61%, avg=77.87, stdev=26.24, samples=159 iops : min= 1, max= 37, avg=18.84, stdev= 6.61, samples=159 lat (usec) : 250=1.30%, 500=0.62%, 750=0.03%, 1000=0.46% lat (msec) : 2=9.18%, 4=4.69%, 10=6.32%, 20=21.16%, 50=44.73% lat (msec) : 100=11.00%, 250=0.49%, 750=0.03% cpu : usr=0.10%, sys=8.60%, ctx=6642, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183143: Fri Oct 24 03:13:14 2025 read: IOPS=18, BW=74.4KiB/s (76.1kB/s)(6028KiB/81069msec) clat (usec): min=124, max=200387, avg=29476.27, stdev=18050.30 lat (usec): min=125, max=200389, avg=29479.83, stdev=18051.14 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 7046], 10.00th=[ 12256], 20.00th=[ 16188], | 30.00th=[ 19530], 40.00th=[ 22676], 50.00th=[ 25822], 60.00th=[ 30278], | 70.00th=[ 35390], 80.00th=[ 41681], 90.00th=[ 51119], 95.00th=[ 59507], | 99.00th=[ 86508], 99.50th=[102237], 99.90th=[164627], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 15, max= 127, per=25.61%, avg=74.52, stdev=20.59, samples=158 iops : min= 3, max= 31, avg=18.01, stdev= 5.16, samples=158 write: IOPS=19, BW=77.2KiB/s (79.1kB/s)(6260KiB/81069msec); 0 zone resets clat (usec): min=967, max=732950, avg=23221.11, stdev=28700.64 lat (usec): min=968, max=732952, avg=23227.85, stdev=28703.95 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1352], 20.00th=[ 2638], | 30.00th=[ 5211], 40.00th=[ 11469], 50.00th=[ 17695], 60.00th=[ 22938], | 70.00th=[ 29754], 80.00th=[ 39584], 90.00th=[ 54789], 95.00th=[ 65799], | 99.00th=[ 88605], 99.50th=[ 95945], 99.90th=[274727], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 151, per=25.26%, avg=76.79, stdev=25.96, samples=159 iops : min= 1, max= 37, avg=18.57, stdev= 6.52, samples=159 lat (usec) : 250=1.82%, 500=0.36%, 750=0.07%, 1000=0.07% lat (msec) : 2=7.91%, 4=5.57%, 10=7.03%, 20=20.61%, 50=44.69% lat (msec) : 100=11.43%, 250=0.39%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=8.50%, ctx=6581, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183144: Fri Oct 24 03:13:14 2025 read: IOPS=18, BW=73.7KiB/s (75.4kB/s)(6052KiB/82140msec) clat (usec): min=122, max=127461, avg=30454.61, stdev=18038.09 lat (usec): min=122, max=127462, avg=30455.89, stdev=18038.07 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 7177], 10.00th=[ 12649], 20.00th=[ 16450], | 30.00th=[ 19792], 40.00th=[ 22676], 50.00th=[ 26608], 60.00th=[ 31327], | 70.00th=[ 36439], 80.00th=[ 43254], 90.00th=[ 54789], 95.00th=[ 63701], | 99.00th=[ 90702], 99.50th=[ 99091], 99.90th=[122160], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 15, max= 118, per=25.15%, avg=73.19, stdev=20.13, samples=161 iops : min= 3, max= 29, avg=17.68, stdev= 5.08, samples=161 write: IOPS=18, BW=75.9KiB/s (77.7kB/s)(6236KiB/82140msec); 0 zone resets clat (usec): min=901, max=690814, avg=22938.13, stdev=27917.30 lat (usec): min=902, max=690814, avg=22939.55, stdev=27917.33 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 2376], | 30.00th=[ 4817], 40.00th=[ 10683], 50.00th=[ 16909], 60.00th=[ 22938], | 70.00th=[ 29754], 80.00th=[ 40109], 90.00th=[ 53740], 95.00th=[ 65274], | 99.00th=[ 95945], 99.50th=[110625], 99.90th=[156238], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 159, per=24.74%, avg=75.22, stdev=26.80, samples=162 iops : min= 1, max= 39, avg=18.18, stdev= 6.74, samples=162 lat (usec) : 250=1.50%, 500=0.42%, 750=0.03%, 1000=0.36% lat (msec) : 2=8.59%, 4=5.24%, 10=6.80%, 20=19.82%, 50=44.63% lat (msec) : 100=11.95%, 250=0.62%, 750=0.03% cpu : usr=0.11%, sys=8.69%, ctx=6707, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=291KiB/s (298kB/s), 72.6KiB/s-74.4KiB/s (74.4kB/s-76.1kB/s), io=23.4MiB (24.6MB), run=80701-82511msec WRITE: bw=305KiB/s (312kB/s), 75.9KiB/s-78.7KiB/s (77.7kB/s-80.5kB/s), io=24.6MiB (25.7MB), run=80701-82511msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183145: Fri Oct 24 03:13:45 2025 read: IOPS=13, BW=52.9KiB/s (54.2kB/s)(5992KiB/113301msec) clat (msec): min=5, max=736, avg=29.70, stdev=30.84 lat (msec): min=5, max=736, avg=29.70, stdev=30.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 63], 95.00th=[ 85], | 99.00th=[ 124], 99.50th=[ 136], 99.90th=[ 222], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 159, per=25.03%, avg=52.81, stdev=30.46, samples=222 iops : min= 1, max= 39, avg=12.55, stdev= 7.66, samples=222 write: IOPS=13, BW=55.6KiB/s (56.9kB/s)(6296KiB/113301msec); 0 zone resets clat (msec): min=9, max=207, avg=43.54, stdev=27.08 lat (msec): min=9, max=207, avg=43.54, stdev=27.08 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 63], 90.00th=[ 82], 95.00th=[ 97], | 99.00th=[ 142], 99.50th=[ 161], 99.90th=[ 199], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 7, max= 141, per=24.96%, avg=55.17, stdev=29.91, samples=223 iops : min= 1, max= 35, avg=13.14, stdev= 7.53, samples=223 lat (msec) : 10=4.43%, 20=27.57%, 50=44.89%, 100=19.66%, 250=3.42% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=2.99%, ctx=4962, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183146: Fri Oct 24 03:13:45 2025 read: IOPS=13, BW=52.5KiB/s (53.7kB/s)(5940KiB/113204msec) clat (msec): min=5, max=700, avg=29.02, stdev=29.70 lat (msec): min=5, max=700, avg=29.02, stdev=29.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 61], 95.00th=[ 82], | 99.00th=[ 126], 99.50th=[ 142], 99.90th=[ 190], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 159, per=24.84%, avg=52.41, stdev=31.73, samples=222 iops : min= 1, max= 39, avg=12.44, stdev= 7.96, samples=222 write: IOPS=14, BW=56.1KiB/s (57.4kB/s)(6348KiB/113204msec); 0 zone resets clat (msec): min=7, max=278, avg=44.00, stdev=27.95 lat (msec): min=7, max=278, avg=44.01, stdev=27.95 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 64], 90.00th=[ 82], 95.00th=[ 100], | 99.00th=[ 138], 99.50th=[ 167], 99.90th=[ 230], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 135, per=25.21%, avg=55.72, stdev=29.06, samples=223 iops : min= 1, max= 33, avg=13.27, stdev= 7.33, samples=223 lat (msec) : 10=4.59%, 20=25.91%, 50=47.14%, 100=18.65%, 250=3.65% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.04%, ctx=4958, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183147: Fri Oct 24 03:13:45 2025 read: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6028KiB/113726msec) clat (msec): min=4, max=189, avg=29.10, stdev=23.82 lat (msec): min=4, max=189, avg=29.10, stdev=23.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 61], 95.00th=[ 77], | 99.00th=[ 123], 99.50th=[ 140], 99.90th=[ 161], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 7, max= 174, per=25.05%, avg=52.87, stdev=31.18, samples=223 iops : min= 1, max= 43, avg=12.57, stdev= 7.86, samples=223 write: IOPS=13, BW=55.0KiB/s (56.4kB/s)(6260KiB/113726msec); 0 zone resets clat (msec): min=8, max=721, avg=44.49, stdev=32.91 lat (msec): min=8, max=721, avg=44.49, stdev=32.91 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 84], 95.00th=[ 97], | 99.00th=[ 142], 99.50th=[ 169], 99.90th=[ 279], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 151, per=24.87%, avg=54.96, stdev=29.87, samples=223 iops : min= 1, max= 37, avg=13.09, stdev= 7.52, samples=223 lat (msec) : 10=5.57%, 20=24.87%, 50=46.91%, 100=19.73%, 250=2.86% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.02%, ctx=5025, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183148: Fri Oct 24 03:13:45 2025 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6052KiB/112518msec) clat (msec): min=5, max=217, avg=28.70, stdev=25.33 lat (msec): min=5, max=217, avg=28.70, stdev=25.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 61], 95.00th=[ 84], | 99.00th=[ 130], 99.50th=[ 146], 99.90th=[ 188], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 7, max= 158, per=25.56%, avg=53.93, stdev=31.30, samples=219 iops : min= 1, max= 39, avg=12.83, stdev= 7.87, samples=219 write: IOPS=13, BW=55.4KiB/s (56.8kB/s)(6236KiB/112518msec); 0 zone resets clat (msec): min=9, max=706, avg=44.15, stdev=31.68 lat (msec): min=9, max=706, avg=44.15, stdev=31.68 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 63], 90.00th=[ 81], 95.00th=[ 96], | 99.00th=[ 136], 99.50th=[ 167], 99.90th=[ 234], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8, max= 143, per=24.91%, avg=55.04, stdev=29.03, samples=221 iops : min= 2, max= 35, avg=13.10, stdev= 7.30, samples=221 lat (msec) : 10=4.95%, 20=27.15%, 50=45.77%, 100=18.78%, 250=3.32% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=2.98%, ctx=4961, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=211KiB/s (216kB/s), 52.5KiB/s-53.8KiB/s (53.7kB/s-55.1kB/s), io=23.4MiB (24.6MB), run=112518-113726msec WRITE: bw=221KiB/s (226kB/s), 55.0KiB/s-56.1KiB/s (56.4kB/s-57.4kB/s), io=24.6MiB (25.7MB), run=112518-113726msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183185: Fri Oct 24 03:14:18 2025 read: IOPS=15, BW=246KiB/s (252kB/s)(5920KiB/24033msec) clat (usec): min=101, max=141890, avg=33462.35, stdev=23081.93 lat (usec): min=101, max=141891, avg=33472.58, stdev=23077.05 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 210], 10.00th=[ 1385], 20.00th=[ 17433], | 30.00th=[ 21627], 40.00th=[ 25297], 50.00th=[ 30016], 60.00th=[ 34866], | 70.00th=[ 40109], 80.00th=[ 47449], 90.00th=[ 60556], 95.00th=[ 79168], | 99.00th=[123208], 99.50th=[135267], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 93, max= 382, per=24.35%, avg=241.60, stdev=70.49, samples=47 iops : min= 5, max= 23, avg=14.30, stdev= 4.42, samples=47 write: IOPS=16, BW=265KiB/s (271kB/s)(6368KiB/24033msec); 0 zone resets clat (usec): min=1360, max=133462, avg=29198.88, stdev=25983.46 lat (usec): min=1362, max=133463, avg=29201.74, stdev=25982.83 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1860], 10.00th=[ 2737], 20.00th=[ 4752], | 30.00th=[ 9110], 40.00th=[ 16581], 50.00th=[ 23725], 60.00th=[ 30016], | 70.00th=[ 39060], 80.00th=[ 49546], 90.00th=[ 68682], 95.00th=[ 77071], | 99.00th=[117965], 99.50th=[124257], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 125, max= 446, per=25.18%, avg=262.83, stdev=82.29, samples=47 iops : min= 7, max= 27, avg=15.64, stdev= 5.18, samples=47 lat (usec) : 250=2.86%, 500=1.69%, 750=0.13% lat (msec) : 2=3.39%, 4=4.82%, 10=8.59%, 20=14.06%, 50=45.70% lat (msec) : 100=16.93%, 250=1.82% cpu : usr=0.10%, sys=9.36%, ctx=1823, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183186: Fri Oct 24 03:14:18 2025 read: IOPS=15, BW=240KiB/s (246kB/s)(5744KiB/23899msec) clat (usec): min=114, max=181146, avg=35742.62, stdev=23796.98 lat (usec): min=115, max=181148, avg=35744.06, stdev=23796.87 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 192], 10.00th=[ 3064], 20.00th=[ 18220], | 30.00th=[ 23200], 40.00th=[ 28181], 50.00th=[ 33162], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 51119], 90.00th=[ 65799], 95.00th=[ 80217], | 99.00th=[113771], 99.50th=[137364], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 95, max= 411, per=24.19%, avg=239.96, stdev=76.18, samples=47 iops : min= 5, max= 25, avg=14.19, stdev= 4.78, samples=47 write: IOPS=17, BW=274KiB/s (280kB/s)(6544KiB/23899msec); 0 zone resets clat (usec): min=1385, max=170429, avg=26904.57, stdev=25516.36 lat (usec): min=1385, max=170432, avg=26913.28, stdev=25513.24 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1827], 10.00th=[ 2180], 20.00th=[ 4555], | 30.00th=[ 8717], 40.00th=[ 14222], 50.00th=[ 20317], 60.00th=[ 26608], | 70.00th=[ 33817], 80.00th=[ 43779], 90.00th=[ 62129], 95.00th=[ 77071], | 99.00th=[111674], 99.50th=[119014], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 62, max= 475, per=26.17%, avg=273.19, stdev=80.13, samples=47 iops : min= 3, max= 29, avg=16.28, stdev= 5.03, samples=47 lat (usec) : 250=3.26%, 500=1.30% lat (msec) : 2=4.17%, 4=5.34%, 10=8.20%, 20=14.84%, 50=44.14% lat (msec) : 100=16.93%, 250=1.82% cpu : usr=0.10%, sys=9.62%, ctx=1866, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183187: Fri Oct 24 03:14:18 2025 read: IOPS=16, BW=259KiB/s (266kB/s)(6256KiB/24127msec) clat (usec): min=113, max=238562, avg=34893.97, stdev=24859.97 lat (usec): min=114, max=238563, avg=34895.93, stdev=24859.24 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 180], 10.00th=[ 1549], 20.00th=[ 18220], | 30.00th=[ 22414], 40.00th=[ 27657], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 42730], 80.00th=[ 49021], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[124257], 99.50th=[147850], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 63, max= 476, per=26.07%, avg=258.62, stdev=90.67, samples=47 iops : min= 3, max= 29, avg=15.36, stdev= 5.71, samples=47 write: IOPS=15, BW=250KiB/s (256kB/s)(6032KiB/24127msec); 0 zone resets clat (usec): min=1412, max=166052, avg=27731.56, stdev=26167.97 lat (usec): min=1413, max=166056, avg=27734.06, stdev=26167.78 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1795], 10.00th=[ 2507], 20.00th=[ 5145], | 30.00th=[ 8848], 40.00th=[ 15795], 50.00th=[ 20841], 60.00th=[ 27657], | 70.00th=[ 35390], 80.00th=[ 44827], 90.00th=[ 61080], 95.00th=[ 78119], | 99.00th=[124257], 99.50th=[156238], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 93, max= 414, per=23.53%, avg=245.64, stdev=82.22, samples=47 iops : min= 5, max= 25, avg=14.55, stdev= 5.19, samples=47 lat (usec) : 250=3.52%, 500=0.91%, 750=0.39% lat (msec) : 2=3.65%, 4=4.69%, 10=7.94%, 20=15.49%, 50=46.22% lat (msec) : 100=15.23%, 250=1.95% cpu : usr=0.10%, sys=9.42%, ctx=1877, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183188: Fri Oct 24 03:14:18 2025 read: IOPS=16, BW=256KiB/s (262kB/s)(6032KiB/23562msec) clat (usec): min=100, max=149982, avg=33092.80, stdev=24685.55 lat (usec): min=100, max=149983, avg=33104.30, stdev=24677.91 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 167], 10.00th=[ 260], 20.00th=[ 16057], | 30.00th=[ 20841], 40.00th=[ 24773], 50.00th=[ 30278], 60.00th=[ 34866], | 70.00th=[ 40109], 80.00th=[ 48497], 90.00th=[ 62653], 95.00th=[ 77071], | 99.00th=[122160], 99.50th=[130548], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 95, max= 446, per=25.65%, avg=254.48, stdev=76.78, samples=46 iops : min= 5, max= 27, avg=15.11, stdev= 4.84, samples=46 write: IOPS=16, BW=266KiB/s (272kB/s)(6256KiB/23562msec); 0 zone resets clat (usec): min=1452, max=135888, avg=28242.91, stdev=26397.75 lat (usec): min=1454, max=135890, avg=28245.18, stdev=26397.64 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1778], 10.00th=[ 2147], 20.00th=[ 4948], | 30.00th=[ 8455], 40.00th=[ 14353], 50.00th=[ 20841], 60.00th=[ 27657], | 70.00th=[ 37487], 80.00th=[ 47973], 90.00th=[ 62653], 95.00th=[ 79168], | 99.00th=[117965], 99.50th=[121111], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 93, max= 447, per=25.57%, avg=267.00, stdev=98.25, samples=46 iops : min= 5, max= 27, avg=15.89, stdev= 6.16, samples=46 lat (usec) : 250=4.69%, 500=1.95%, 750=0.13%, 1000=0.13% lat (msec) : 2=4.43%, 4=4.56%, 10=8.07%, 20=14.71%, 50=42.71% lat (msec) : 100=16.02%, 250=2.60% cpu : usr=0.11%, sys=9.55%, ctx=1780, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=993KiB/s (1017kB/s), 240KiB/s-259KiB/s (246kB/s-266kB/s), io=23.4MiB (24.5MB), run=23562-24127msec WRITE: bw=1044KiB/s (1070kB/s), 250KiB/s-274KiB/s (256kB/s-280kB/s), io=24.6MiB (25.8MB), run=23562-24127msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183180: Fri Oct 24 03:14:28 2025 read: IOPS=10, BW=171KiB/s (175kB/s)(5920KiB/34619msec) clat (msec): min=6, max=263, avg=35.06, stdev=29.73 lat (msec): min=6, max=263, avg=35.06, stdev=29.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 74], 95.00th=[ 88], | 99.00th=[ 144], 99.50th=[ 211], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 541, per=24.42%, avg=167.76, stdev=97.65, samples=68 iops : min= 1, max= 33, avg= 9.72, stdev= 6.16, samples=68 write: IOPS=11, BW=184KiB/s (188kB/s)(6368KiB/34619msec); 0 zone resets clat (msec): min=12, max=328, avg=54.07, stdev=37.70 lat (msec): min=12, max=328, avg=54.08, stdev=37.70 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 103], 95.00th=[ 129], | 99.00th=[ 194], 99.50th=[ 264], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 384, per=25.21%, avg=182.29, stdev=93.07, samples=68 iops : min= 1, max= 24, avg=10.63, stdev= 5.91, samples=68 lat (msec) : 10=1.82%, 20=18.23%, 50=49.87%, 100=23.05%, 250=6.64% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=2.98%, ctx=1238, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183181: Fri Oct 24 03:14:28 2025 read: IOPS=10, BW=165KiB/s (169kB/s)(5744KiB/34828msec) clat (msec): min=4, max=334, avg=34.34, stdev=30.50 lat (msec): min=4, max=334, avg=34.34, stdev=30.50 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 65], 95.00th=[ 81], | 99.00th=[ 126], 99.50th=[ 292], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 478, per=24.34%, avg=167.24, stdev=87.28, samples=68 iops : min= 1, max= 29, avg= 9.69, stdev= 5.51, samples=68 write: IOPS=11, BW=188KiB/s (192kB/s)(6544KiB/34828msec); 0 zone resets clat (msec): min=10, max=328, avg=54.82, stdev=36.15 lat (msec): min=10, max=328, avg=54.83, stdev=36.15 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 61], 80.00th=[ 74], 90.00th=[ 103], 95.00th=[ 127], | 99.00th=[ 178], 99.50th=[ 184], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 415, per=25.86%, avg=186.94, stdev=80.17, samples=69 iops : min= 1, max= 25, avg=10.93, stdev= 5.06, samples=69 lat (msec) : 10=1.17%, 20=18.23%, 50=49.48%, 100=24.74%, 250=5.99% lat (msec) : 500=0.39% cpu : usr=0.08%, sys=3.08%, ctx=1319, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183182: Fri Oct 24 03:14:28 2025 read: IOPS=11, BW=180KiB/s (184kB/s)(6256KiB/34814msec) clat (msec): min=7, max=157, avg=35.40, stdev=26.66 lat (msec): min=7, max=157, avg=35.40, stdev=26.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 54], 90.00th=[ 74], 95.00th=[ 91], | 99.00th=[ 138], 99.50th=[ 146], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 31, max= 479, per=26.26%, avg=180.40, stdev=103.94, samples=68 iops : min= 1, max= 29, avg=10.51, stdev= 6.56, samples=68 write: IOPS=10, BW=173KiB/s (177kB/s)(6032KiB/34814msec); 0 zone resets clat (msec): min=9, max=270, avg=55.26, stdev=34.28 lat (msec): min=9, max=270, avg=55.26, stdev=34.28 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 79], 90.00th=[ 97], 95.00th=[ 120], | 99.00th=[ 184], 99.50th=[ 209], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 63, max= 448, per=23.66%, avg=171.03, stdev=77.09, samples=68 iops : min= 3, max= 28, avg= 9.93, stdev= 4.92, samples=68 lat (msec) : 10=1.95%, 20=17.97%, 50=47.40%, 100=26.17%, 250=6.38% lat (msec) : 500=0.13% cpu : usr=0.03%, sys=2.94%, ctx=1269, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183183: Fri Oct 24 03:14:28 2025 read: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34722msec) clat (msec): min=5, max=331, avg=38.29, stdev=34.81 lat (msec): min=5, max=331, avg=38.29, stdev=34.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 105], | 99.00th=[ 159], 99.50th=[ 275], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 446, per=24.97%, avg=171.53, stdev=91.86, samples=68 iops : min= 1, max= 27, avg= 9.96, stdev= 5.82, samples=68 write: IOPS=11, BW=180KiB/s (184kB/s)(6256KiB/34722msec); 0 zone resets clat (msec): min=11, max=205, avg=51.39, stdev=29.98 lat (msec): min=11, max=205, avg=51.39, stdev=29.98 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 50], | 70.00th=[ 59], 80.00th=[ 67], 90.00th=[ 92], 95.00th=[ 113], | 99.00th=[ 161], 99.50th=[ 176], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 382, per=24.62%, avg=178.03, stdev=79.95, samples=68 iops : min= 1, max= 23, avg=10.37, stdev= 5.03, samples=68 lat (msec) : 10=1.43%, 20=15.89%, 50=53.52%, 100=22.27%, 250=6.64% lat (msec) : 500=0.26% cpu : usr=0.08%, sys=3.20%, ctx=1351, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=688KiB/s (704kB/s), 165KiB/s-180KiB/s (169kB/s-184kB/s), io=23.4MiB (24.5MB), run=34619-34828msec WRITE: bw=724KiB/s (741kB/s), 173KiB/s-188KiB/s (177kB/s-192kB/s), io=24.6MiB (25.8MB), run=34619-34828msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183201: Fri Oct 24 03:14:41 2025 read: IOPS=1, BW=1295KiB/s (1326kB/s)(7168KiB/5535msec) clat (usec): min=665, max=2581.6k, avg=467844.85, stdev=935866.55 lat (usec): min=667, max=2581.6k, avg=467846.83, stdev=935867.32 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], | 20.00th=[ 1926], 30.00th=[ 147850], 40.00th=[ 147850], | 50.00th=[ 147850], 60.00th=[ 177210], 70.00th=[ 177210], | 80.00th=[ 217056], 90.00th=[2566915], 95.00th=[2566915], | 99.00th=[2566915], 99.50th=[2566915], 99.90th=[2566915], | 99.95th=[2566915], 99.99th=[2566915] bw ( KiB/s): min= 1992, max= 4071, per=89.22%, avg=3035.25, stdev=1177.73, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=925KiB/s (947kB/s)(5120KiB/5535msec); 0 zone resets clat (msec): min=205, max=821, avg=432.75, stdev=233.75 lat (msec): min=205, max=821, avg=432.83, stdev=233.76 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2035, max= 3984, per=56.39%, avg=2686.00, stdev=1124.10, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=15.97%, ctx=773, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183202: Fri Oct 24 03:14:41 2025 read: IOPS=0, BW=340KiB/s (348kB/s)(2048KiB/6019msec) clat (msec): min=166, max=207, avg=187.31, stdev=28.89 lat (msec): min=166, max=207, avg=187.32, stdev=28.89 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 209], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 209], 95.00th=[ 209], | 99.00th=[ 209], 99.50th=[ 209], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 1903, max= 1992, per=57.25%, avg=1947.50, stdev=62.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1701KiB/s (1742kB/s)(10.0MiB/6019msec); 0 zone resets clat (msec): min=127, max=2942, avg=561.93, stdev=858.81 lat (msec): min=128, max=2942, avg=562.06, stdev=858.82 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 165], | 30.00th=[ 182], 40.00th=[ 220], 50.00th=[ 228], 60.00th=[ 251], | 70.00th=[ 309], 80.00th=[ 397], 90.00th=[ 810], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2048, max= 4079, per=74.44%, avg=3545.50, stdev=999.26, samples=4 iops : min= 2, max= 3, avg= 2.75, stdev= 0.50, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=14.91%, ctx=252, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183203: Fri Oct 24 03:14:41 2025 read: IOPS=1, BW=1160KiB/s (1188kB/s)(6144KiB/5297msec) clat (usec): min=582, max=388279, avg=96185.17, stdev=158788.66 lat (usec): min=585, max=388281, avg=96187.14, stdev=158788.17 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 1319], | 30.00th=[ 1319], 40.00th=[ 1811], 50.00th=[ 1811], 60.00th=[ 9896], | 70.00th=[175113], 80.00th=[175113], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 1855, max= 6119, per=97.65%, avg=3322.00, stdev=2423.24, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1160KiB/s (1188kB/s)(6144KiB/5297msec); 0 zone resets clat (msec): min=126, max=3053, avg=772.42, stdev=1122.30 lat (msec): min=126, max=3053, avg=772.51, stdev=1122.30 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 397], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1855, max= 4079, per=68.82%, avg=3278.00, stdev=1235.60, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 10=8.33%, 250=16.67%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=13.86%, ctx=336, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183204: Fri Oct 24 03:14:41 2025 read: IOPS=0, BW=923KiB/s (945kB/s)(5120KiB/5548msec) clat (usec): min=715, max=305266, avg=74905.36, stdev=131911.96 lat (usec): min=715, max=305268, avg=74906.76, stdev=131911.95 clat percentiles (usec): | 1.00th=[ 717], 5.00th=[ 717], 10.00th=[ 717], 20.00th=[ 717], | 30.00th=[ 799], 40.00th=[ 799], 50.00th=[ 906], 60.00th=[ 906], | 70.00th=[ 66847], 80.00th=[ 66847], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2039, max= 5565, per=100.00%, avg=3802.00, stdev=2493.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1292KiB/s (1323kB/s)(7168KiB/5548msec); 0 zone resets clat (msec): min=258, max=2709, avg=725.26, stdev=891.22 lat (msec): min=258, max=2710, avg=726.11, stdev=890.93 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 284], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 347], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 751], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1855, max= 4071, per=52.26%, avg=2489.25, stdev=1057.38, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=16.67% lat (msec) : 100=8.33%, 500=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=13.54%, ctx=302, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3403KiB/s (3484kB/s), 340KiB/s-1295KiB/s (348kB/s-1326kB/s), io=20.0MiB (20.0MB), run=5297-6019msec WRITE: bw=4764KiB/s (4878kB/s), 925KiB/s-1701KiB/s (947kB/s-1742kB/s), io=28.0MiB (29.4MB), run=5297-6019msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183206: Fri Oct 24 03:14:42 2025 read: IOPS=1, BW=1056KiB/s (1082kB/s)(7168KiB/6785msec) clat (msec): min=60, max=2540, avg=821.47, stdev=938.52 lat (msec): min=60, max=2540, avg=821.48, stdev=938.51 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 64], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 443], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1519], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2023, max= 2039, per=67.30%, avg=2031.00, stdev= 8.00, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=755KiB/s (773kB/s)(5120KiB/6785msec); 0 zone resets clat (msec): min=72, max=513, avg=181.49, stdev=188.98 lat (msec): min=72, max=513, avg=182.47, stdev=188.87 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 74], 40.00th=[ 74], 50.00th=[ 89], 60.00th=[ 89], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2031, max= 4047, per=71.93%, avg=3039.00, stdev=1425.53, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=41.67%, 250=16.67%, 500=8.33%, 750=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.42%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183207: Fri Oct 24 03:14:42 2025 read: IOPS=0, BW=319KiB/s (327kB/s)(2048KiB/6418msec) clat (msec): min=104, max=140, avg=122.41, stdev=25.12 lat (msec): min=104, max=140, avg=122.41, stdev=25.12 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 140], 95.00th=[ 140], | 99.00th=[ 140], 99.50th=[ 140], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 1805, max= 2023, per=63.42%, avg=1914.00, stdev=154.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1596KiB/s (1634kB/s)(10.0MiB/6418msec); 0 zone resets clat (msec): min=155, max=3334, avg=611.31, stdev=973.11 lat (msec): min=155, max=3334, avg=611.41, stdev=973.11 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 163], | 30.00th=[ 213], 40.00th=[ 234], 50.00th=[ 243], 60.00th=[ 247], | 70.00th=[ 275], 80.00th=[ 550], 90.00th=[ 701], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 2039, max= 4071, per=76.98%, avg=3252.60, stdev=1106.07, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=66.67%, 500=8.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.49%, ctx=267, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183208: Fri Oct 24 03:14:42 2025 read: IOPS=0, BW=952KiB/s (974kB/s)(6144KiB/6457msec) clat (msec): min=84, max=515, avg=282.92, stdev=189.03 lat (msec): min=84, max=515, avg=282.92, stdev=189.03 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 279], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2035, max= 4063, per=89.87%, avg=2712.33, stdev=1169.71, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=952KiB/s (974kB/s)(6144KiB/6457msec); 0 zone resets clat (msec): min=110, max=3398, avg=760.90, stdev=1297.80 lat (msec): min=110, max=3398, avg=760.99, stdev=1297.80 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 355], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1828, max= 2039, per=47.15%, avg=1992.00, stdev=91.92, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.84%, ctx=306, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183209: Fri Oct 24 03:14:42 2025 read: IOPS=0, BW=776KiB/s (794kB/s)(5120KiB/6602msec) clat (msec): min=57, max=580, avg=253.24, stdev=220.28 lat (msec): min=57, max=580, avg=253.24, stdev=220.28 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2023, max= 4063, per=89.56%, avg=2703.00, stdev=1177.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1086KiB/s (1112kB/s)(7168KiB/6602msec); 0 zone resets clat (msec): min=133, max=3226, avg=737.15, stdev=1115.70 lat (msec): min=133, max=3226, avg=737.33, stdev=1115.69 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 134], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 359], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 667], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 2023, max= 6071, per=67.25%, avg=2841.40, stdev=1805.41, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.53%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3018KiB/s (3091kB/s), 319KiB/s-1056KiB/s (327kB/s-1082kB/s), io=20.0MiB (20.0MB), run=6418-6785msec WRITE: bw=4226KiB/s (4327kB/s), 755KiB/s-1596KiB/s (773kB/s-1634kB/s), io=28.0MiB (29.4MB), run=6418-6785msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183216: Fri Oct 24 03:14:56 2025 read: IOPS=0, BW=2042KiB/s (2091kB/s)(12.0MiB/6017msec) clat (msec): min=558, max=4850, avg=1996.54, stdev=2471.64 lat (msec): min=558, max=4850, avg=1996.54, stdev=2471.64 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.05%, sys=9.54%, ctx=986, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183217: Fri Oct 24 03:14:56 2025 read: IOPS=0, BW=1100KiB/s (1127kB/s)(4096KiB/3722msec) clat (nsec): min=3011.1M, max=3011.1M, avg=3011101750.00, stdev= 0.00 lat (nsec): min=3011.1M, max=3011.1M, avg=3011102811.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3004], 5.00th=[ 3004], 10.00th=[ 3004], 20.00th=[ 3004], | 30.00th=[ 3004], 40.00th=[ 3004], 50.00th=[ 3004], 60.00th=[ 3004], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2201KiB/s (2254kB/s)(8192KiB/3722msec); 0 zone resets clat (msec): min=262, max=369, avg=315.89, stdev=75.27 lat (msec): min=263, max=369, avg=316.35, stdev=75.30 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=10.19%, ctx=864, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183218: Fri Oct 24 03:14:56 2025 write: IOPS=0, BW=3427KiB/s (3509kB/s)(12.0MiB/3586msec); 0 zone resets clat (msec): min=167, max=2848, avg=1184.71, stdev=1452.77 lat (msec): min=167, max=2849, avg=1185.63, stdev=1452.69 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.35%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183219: Fri Oct 24 03:14:56 2025 write: IOPS=0, BW=1946KiB/s (1993kB/s)(12.0MiB/6314msec); 0 zone resets clat (msec): min=391, max=3074, avg=2096.67, stdev=1481.63 lat (msec): min=392, max=3074, avg=2097.12, stdev=1481.63 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 2836], 50.00th=[ 2836], 60.00th=[ 2836], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.05%, sys=2.60%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2723KiB/s (2788kB/s), 1100KiB/s-2042KiB/s (1127kB/s-2091kB/s), io=16.0MiB (16.8MB), run=3722-6017msec WRITE: bw=5190KiB/s (5314kB/s), 1946KiB/s-3427KiB/s (1993kB/s-3509kB/s), io=32.0MiB (33.6MB), run=3586-6314msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183221: Fri Oct 24 03:14:56 2025 read: IOPS=0, BW=2140KiB/s (2192kB/s)(12.0MiB/5741msec) clat (msec): min=280, max=4883, avg=1913.13, stdev=2576.21 lat (msec): min=280, max=4883, avg=1913.13, stdev=2576.21 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8062, max= 8143, per=100.00%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.46%, ctx=105, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183222: Fri Oct 24 03:14:56 2025 read: IOPS=0, BW=713KiB/s (730kB/s)(4096KiB/5742msec) clat (nsec): min=4586.9M, max=4586.9M, avg=4586942027.00, stdev= 0.00 lat (nsec): min=4586.9M, max=4586.9M, avg=4586944616.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4597], 5.00th=[ 4597], 10.00th=[ 4597], 20.00th=[ 4597], | 30.00th=[ 4597], 40.00th=[ 4597], 50.00th=[ 4597], 60.00th=[ 4597], | 70.00th=[ 4597], 80.00th=[ 4597], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1427KiB/s (1461kB/s)(8192KiB/5742msec); 0 zone resets clat (msec): min=414, max=732, avg=573.55, stdev=225.28 lat (msec): min=414, max=733, avg=574.34, stdev=225.73 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.89%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183223: Fri Oct 24 03:14:56 2025 write: IOPS=0, BW=1983KiB/s (2030kB/s)(12.0MiB/6197msec); 0 zone resets clat (msec): min=168, max=5792, avg=2062.87, stdev=3230.43 lat (msec): min=169, max=5793, avg=2063.42, stdev=3230.38 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 5805], 80.00th=[ 5805], 90.00th=[ 5805], 95.00th=[ 5805], | 99.00th=[ 5805], 99.50th=[ 5805], 99.90th=[ 5805], 99.95th=[ 5805], | 99.99th=[ 5805] lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.95%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183224: Fri Oct 24 03:14:56 2025 write: IOPS=0, BW=1996KiB/s (2044kB/s)(12.0MiB/6156msec); 0 zone resets clat (msec): min=329, max=2922, avg=2050.69, stdev=1490.57 lat (msec): min=330, max=2924, avg=2051.40, stdev=1490.73 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 2903], 50.00th=[ 2903], 60.00th=[ 2903], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8015, max= 8159, per=100.00%, avg=8087.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.97%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2853KiB/s (2922kB/s), 713KiB/s-2140KiB/s (730kB/s-2192kB/s), io=16.0MiB (16.8MB), run=5741-5742msec WRITE: bw=5288KiB/s (5415kB/s), 1427KiB/s-1996KiB/s (1461kB/s-2044kB/s), io=32.0MiB (33.6MB), run=5742-6197msec