== sanity test 398b: DIO and buffer IO race ============== 04:15:00 (1788509700) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.62606 s, 10.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145350: Fri Sep 4 04:17:27 2026 read: IOPS=11, BW=46.7KiB/s (47.8kB/s)(5992KiB/128314msec) clat (usec): min=34, max=332941, avg=41720.27, stdev=33138.70 lat (usec): min=34, max=332942, avg=41722.12, stdev=33139.77 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 281], 20.00th=[ 18482], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[145753], 99.50th=[202376], 99.90th=[329253], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 128, per=25.02%, avg=46.54, stdev=20.02, samples=251 iops : min= 1, max= 32, avg=11.00, stdev= 5.06, samples=251 write: IOPS=12, BW=49.1KiB/s (50.2kB/s)(6296KiB/128314msec); 0 zone resets clat (usec): min=958, max=487031, avg=41709.80, stdev=42392.60 lat (usec): min=958, max=487032, avg=41719.40, stdev=42405.29 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1254], 10.00th=[ 1745], 20.00th=[ 4490], | 30.00th=[ 8717], 40.00th=[ 21103], 50.00th=[ 32375], 60.00th=[ 44303], | 70.00th=[ 55313], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[115868], | 99.00th=[168821], 99.50th=[193987], 99.90th=[421528], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 7, max= 103, per=24.86%, avg=48.47, stdev=19.39, samples=253 iops : min= 1, max= 25, avg=11.48, stdev= 4.89, samples=253 lat (usec) : 50=0.36%, 100=3.81%, 250=0.65%, 500=0.23%, 750=0.26% lat (usec) : 1000=0.20% lat (msec) : 2=5.53%, 4=3.97%, 10=6.84%, 20=9.38%, 50=35.84% lat (msec) : 100=26.53%, 250=6.18%, 500=0.23% cpu : usr=0.09%, sys=5.35%, ctx=6649, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145351: Fri Sep 4 04:17:27 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5940KiB/126871msec) clat (usec): min=34, max=260972, avg=39906.09, stdev=29838.71 lat (usec): min=34, max=260972, avg=39913.98, stdev=29839.56 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 88], 20.00th=[ 18220], | 30.00th=[ 23462], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[131597], 99.50th=[154141], 99.90th=[225444], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 6, max= 126, per=24.93%, avg=46.37, stdev=20.74, samples=250 iops : min= 1, max= 31, avg=10.94, stdev= 5.23, samples=250 write: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6348KiB/126871msec); 0 zone resets clat (usec): min=937, max=485730, avg=42487.01, stdev=43665.47 lat (usec): min=938, max=485731, avg=42489.81, stdev=43665.81 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1303], 10.00th=[ 2040], 20.00th=[ 4686], | 30.00th=[ 8455], 40.00th=[ 18744], 50.00th=[ 32375], 60.00th=[ 44303], | 70.00th=[ 57934], 80.00th=[ 73925], 90.00th=[ 98042], 95.00th=[123208], | 99.00th=[175113], 99.50th=[219153], 99.90th=[362808], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 7, max= 119, per=25.45%, avg=49.62, stdev=21.73, samples=249 iops : min= 1, max= 29, avg=11.77, stdev= 5.46, samples=249 lat (usec) : 50=0.59%, 100=4.59%, 250=0.55%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=5.01%, 4=4.13%, 10=7.68%, 20=9.21%, 50=35.25% lat (msec) : 100=25.94%, 250=6.51%, 500=0.13% cpu : usr=0.08%, sys=5.34%, ctx=6668, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145352: Fri Sep 4 04:17:27 2026 read: IOPS=11, BW=46.9KiB/s (47.0kB/s)(6028KiB/128640msec) clat (usec): min=28, max=324158, avg=40309.05, stdev=31971.82 lat (usec): min=29, max=324160, avg=40314.34, stdev=31974.77 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 123], 20.00th=[ 17957], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[187696], 99.90th=[270533], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 120, per=24.97%, avg=46.44, stdev=20.83, samples=253 iops : min= 1, max= 30, avg=10.96, stdev= 5.27, samples=253 write: IOPS=12, BW=48.7KiB/s (49.8kB/s)(6260KiB/128640msec); 0 zone resets clat (usec): min=943, max=359902, avg=43282.16, stdev=44604.31 lat (usec): min=943, max=359903, avg=43288.28, stdev=44602.09 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 2073], 20.00th=[ 4686], | 30.00th=[ 8455], 40.00th=[ 19268], 50.00th=[ 32637], 60.00th=[ 43779], | 70.00th=[ 58459], 80.00th=[ 74974], 90.00th=[101188], 95.00th=[126354], | 99.00th=[185598], 99.50th=[240124], 99.90th=[341836], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 127, per=24.71%, avg=48.19, stdev=20.33, samples=253 iops : min= 1, max= 31, avg=11.40, stdev= 5.12, samples=253 lat (usec) : 50=0.68%, 100=3.81%, 250=0.72%, 500=0.07%, 1000=0.16% lat (msec) : 2=5.01%, 4=4.69%, 10=7.36%, 20=9.64%, 50=35.29% lat (msec) : 100=25.33%, 250=6.93%, 500=0.33% cpu : usr=0.08%, sys=5.25%, ctx=6717, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145353: Fri Sep 4 04:17:27 2026 read: IOPS=11, BW=46.0KiB/s (48.1kB/s)(6052KiB/128792msec) clat (usec): min=34, max=434397, avg=41215.11, stdev=34270.83 lat (usec): min=34, max=434397, avg=41216.78, stdev=34270.87 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 115], 20.00th=[ 17433], | 30.00th=[ 23462], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 41681], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[193987], 99.90th=[291505], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 111, per=25.16%, avg=46.81, stdev=20.21, samples=252 iops : min= 1, max= 27, avg=11.05, stdev= 5.07, samples=252 write: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6236KiB/128792msec); 0 zone resets clat (usec): min=898, max=444572, avg=42493.43, stdev=43642.32 lat (usec): min=900, max=444574, avg=42502.62, stdev=43639.91 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1303], 10.00th=[ 2114], 20.00th=[ 5342], | 30.00th=[ 9765], 40.00th=[ 20317], 50.00th=[ 32900], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[121111], | 99.00th=[187696], 99.50th=[219153], 99.90th=[367002], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 125, per=24.77%, avg=48.29, stdev=21.17, samples=251 iops : min= 1, max= 31, avg=11.43, stdev= 5.32, samples=251 lat (usec) : 50=0.78%, 100=3.74%, 250=1.07%, 500=0.29%, 750=0.20% lat (usec) : 1000=0.16% lat (msec) : 2=4.72%, 4=3.65%, 10=7.65%, 20=9.90%, 50=35.09% lat (msec) : 100=25.55%, 250=6.90%, 500=0.29% cpu : usr=0.09%, sys=5.28%, ctx=6572, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (191kB/s), 46.7KiB/s-46.0KiB/s (47.8kB/s-48.1kB/s), io=23.4MiB (24.6MB), run=126871-128792msec WRITE: bw=195KiB/s (200kB/s), 48.4KiB/s-50.0KiB/s (49.6kB/s-51.2kB/s), io=24.6MiB (25.7MB), run=126871-128792msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145345: Fri Sep 4 04:19:32 2026 read: IOPS=5, BW=23.6KiB/s (24.1kB/s)(5992KiB/254372msec) clat (msec): min=5, max=607, avg=37.37, stdev=43.21 lat (msec): min=5, max=607, avg=37.38, stdev=43.22 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 201], 99.50th=[ 259], 99.90th=[ 584], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 88, per=27.56%, avg=25.91, stdev=17.89, samples=447 iops : min= 1, max= 22, avg= 5.86, stdev= 4.52, samples=447 write: IOPS=6, BW=24.8KiB/s (25.3kB/s)(6296KiB/254372msec); 0 zone resets clat (msec): min=36, max=505, avg=125.79, stdev=64.64 lat (msec): min=36, max=505, avg=125.79, stdev=64.64 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 109], 60.00th=[ 124], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 213], 95.00th=[ 255], | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 456], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 71, per=25.11%, avg=24.61, stdev=11.89, samples=493 iops : min= 1, max= 17, avg= 5.53, stdev= 3.03, samples=493 lat (msec) : 10=3.68%, 20=15.27%, 50=21.61%, 100=27.67%, 250=28.78% lat (msec) : 500=2.86%, 750=0.13% cpu : usr=0.04%, sys=1.30%, ctx=5371, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145346: Fri Sep 4 04:19:32 2026 read: IOPS=5, BW=23.3KiB/s (23.9kB/s)(5940KiB/254440msec) clat (msec): min=4, max=873, avg=36.81, stdev=43.51 lat (msec): min=4, max=873, avg=36.82, stdev=43.51 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 74], 95.00th=[ 106], | 99.00th=[ 192], 99.50th=[ 228], 99.90th=[ 514], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 104, per=28.17%, avg=26.48, stdev=16.90, samples=435 iops : min= 1, max= 26, avg= 6.00, stdev= 4.26, samples=435 write: IOPS=6, BW=24.9KiB/s (25.5kB/s)(6348KiB/254440msec); 0 zone resets clat (msec): min=38, max=554, avg=125.64, stdev=64.90 lat (msec): min=38, max=554, avg=125.64, stdev=64.90 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 86], 40.00th=[ 96], 50.00th=[ 108], 60.00th=[ 124], | 70.00th=[ 142], 80.00th=[ 171], 90.00th=[ 215], 95.00th=[ 249], | 99.00th=[ 326], 99.50th=[ 405], 99.90th=[ 550], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 63, per=25.13%, avg=24.63, stdev=11.90, samples=498 iops : min= 1, max= 15, avg= 5.53, stdev= 3.04, samples=498 lat (msec) : 10=3.16%, 20=15.79%, 50=21.61%, 100=27.86%, 250=28.84% lat (msec) : 500=2.54%, 750=0.16%, 1000=0.03% cpu : usr=0.04%, sys=1.31%, ctx=5299, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145347: Fri Sep 4 04:19:32 2026 read: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6028KiB/253365msec) clat (msec): min=5, max=461, avg=37.04, stdev=38.23 lat (msec): min=5, max=461, avg=37.04, stdev=38.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 80], 95.00th=[ 107], | 99.00th=[ 180], 99.50th=[ 271], 99.90th=[ 414], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 95, per=27.71%, avg=26.05, stdev=17.30, samples=447 iops : min= 1, max= 23, avg= 5.89, stdev= 4.35, samples=447 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6260KiB/253365msec); 0 zone resets clat (msec): min=34, max=991, avg=126.00, stdev=68.78 lat (msec): min=34, max=991, avg=126.00, stdev=68.78 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 108], 60.00th=[ 124], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 209], 95.00th=[ 245], | 99.00th=[ 359], 99.50th=[ 435], 99.90th=[ 558], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 56, per=24.91%, avg=24.41, stdev=12.00, samples=494 iops : min= 1, max= 14, avg= 5.48, stdev= 3.06, samples=494 lat (msec) : 10=2.51%, 20=15.14%, 50=23.18%, 100=27.80%, 250=28.58% lat (msec) : 500=2.70%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.33%, ctx=5291, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145348: Fri Sep 4 04:19:32 2026 read: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6052KiB/254177msec) clat (msec): min=6, max=584, avg=37.63, stdev=39.90 lat (msec): min=6, max=584, avg=37.63, stdev=39.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 190], 99.50th=[ 253], 99.90th=[ 409], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 96, per=27.77%, avg=26.10, stdev=17.76, samples=449 iops : min= 1, max= 24, avg= 5.91, stdev= 4.49, samples=449 write: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6236KiB/254177msec); 0 zone resets clat (msec): min=37, max=982, avg=126.27, stdev=67.01 lat (msec): min=37, max=982, avg=126.28, stdev=67.01 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 108], 60.00th=[ 123], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 213], 95.00th=[ 253], | 99.00th=[ 351], 99.50th=[ 380], 99.90th=[ 514], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 55, per=24.69%, avg=24.20, stdev=11.83, samples=497 iops : min= 1, max= 13, avg= 5.43, stdev= 3.00, samples=497 lat (msec) : 10=2.44%, 20=15.27%, 50=22.49%, 100=28.42%, 250=28.48% lat (msec) : 500=2.80%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.30%, ctx=5572, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=94.4KiB/s (96.6kB/s), 23.3KiB/s-23.8KiB/s (23.9kB/s-24.4kB/s), io=23.4MiB (24.6MB), run=253365-254440msec WRITE: bw=98.8KiB/s (101kB/s), 24.5KiB/s-24.9KiB/s (25.1kB/s-25.5kB/s), io=24.6MiB (25.7MB), run=253365-254440msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145423: Fri Sep 4 04:20:05 2026 read: IOPS=15, BW=243KiB/s (249kB/s)(5920KiB/24385msec) clat (usec): min=32, max=134176, avg=31997.72, stdev=26636.64 lat (usec): min=33, max=134177, avg=31998.82, stdev=26636.46 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 85], | 30.00th=[ 16057], 40.00th=[ 25035], 50.00th=[ 30540], 60.00th=[ 36439], | 70.00th=[ 44303], 80.00th=[ 52691], 90.00th=[ 67634], 95.00th=[ 77071], | 99.00th=[103285], 99.50th=[124257], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 63, max= 410, per=25.88%, avg=242.48, stdev=76.02, samples=48 iops : min= 3, max= 25, avg=14.37, stdev= 4.81, samples=48 write: IOPS=16, BW=261KiB/s (267kB/s)(6368KiB/24385msec); 0 zone resets clat (usec): min=1359, max=232097, avg=30976.25, stdev=34207.91 lat (usec): min=1361, max=232098, avg=30978.24, stdev=34207.86 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1942], 10.00th=[ 2606], 20.00th=[ 4424], | 30.00th=[ 6587], 40.00th=[ 10290], 50.00th=[ 17957], 60.00th=[ 26346], | 70.00th=[ 39060], 80.00th=[ 54264], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[187696], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 54, max= 478, per=26.57%, avg=261.98, stdev=97.42, samples=48 iops : min= 3, max= 29, avg=15.60, stdev= 6.13, samples=48 lat (usec) : 50=1.69%, 100=8.98%, 250=1.17%, 500=0.26%, 750=0.13% lat (msec) : 2=3.12%, 4=5.73%, 10=11.98%, 20=10.55%, 50=33.33% lat (msec) : 100=20.05%, 250=2.99% cpu : usr=0.08%, sys=6.24%, ctx=1417, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145424: Fri Sep 4 04:20:05 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(5744KiB/24502msec) clat (usec): min=36, max=294545, avg=33562.74, stdev=33357.47 lat (usec): min=36, max=294546, avg=33564.00, stdev=33357.50 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 102], | 30.00th=[ 20055], 40.00th=[ 25560], 50.00th=[ 30540], 60.00th=[ 36439], | 70.00th=[ 42730], 80.00th=[ 51643], 90.00th=[ 68682], 95.00th=[ 80217], | 99.00th=[156238], 99.50th=[233833], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 28, max= 444, per=25.00%, avg=234.23, stdev=95.32, samples=48 iops : min= 1, max= 27, avg=13.85, stdev= 5.99, samples=48 write: IOPS=16, BW=267KiB/s (273kB/s)(6544KiB/24502msec); 0 zone resets clat (usec): min=1187, max=246956, avg=30209.67, stdev=32676.04 lat (usec): min=1188, max=246958, avg=30211.47, stdev=32676.17 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1827], 10.00th=[ 2507], 20.00th=[ 4555], | 30.00th=[ 7177], 40.00th=[ 10945], 50.00th=[ 18744], 60.00th=[ 27919], | 70.00th=[ 39060], 80.00th=[ 53740], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[130548], 99.50th=[154141], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 84, max= 446, per=27.02%, avg=266.46, stdev=90.31, samples=48 iops : min= 5, max= 27, avg=15.90, stdev= 5.67, samples=48 lat (usec) : 50=1.69%, 100=7.55%, 250=2.47% lat (msec) : 2=4.30%, 4=5.34%, 10=11.20%, 20=9.11%, 50=36.07% lat (msec) : 100=19.66%, 250=2.47%, 500=0.13% cpu : usr=0.08%, sys=6.58%, ctx=1412, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145425: Fri Sep 4 04:20:05 2026 read: IOPS=15, BW=245KiB/s (251kB/s)(6256KiB/25546msec) clat (usec): min=32, max=139785, avg=32484.94, stdev=27724.99 lat (usec): min=33, max=139785, avg=32486.69, stdev=27725.17 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 85], | 30.00th=[ 16319], 40.00th=[ 24511], 50.00th=[ 30802], 60.00th=[ 36963], | 70.00th=[ 45351], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[113771], 99.50th=[131597], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 63, max= 415, per=26.64%, avg=249.65, stdev=79.57, samples=49 iops : min= 3, max= 25, avg=14.82, stdev= 5.00, samples=49 write: IOPS=14, BW=236KiB/s (242kB/s)(6032KiB/25546msec); 0 zone resets clat (usec): min=1236, max=275767, avg=33555.91, stdev=37520.23 lat (usec): min=1238, max=275770, avg=33562.02, stdev=37517.50 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2024], 10.00th=[ 2737], 20.00th=[ 4490], | 30.00th=[ 7308], 40.00th=[ 10159], 50.00th=[ 19268], 60.00th=[ 32375], | 70.00th=[ 41157], 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[108528], | 99.00th=[162530], 99.50th=[231736], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 55, max= 378, per=23.57%, avg=232.36, stdev=88.87, samples=50 iops : min= 3, max= 23, avg=13.74, stdev= 5.59, samples=50 lat (usec) : 50=1.43%, 100=10.68%, 250=0.91%, 500=0.26%, 750=0.26% lat (msec) : 2=2.86%, 4=6.25%, 10=10.81%, 20=7.94%, 50=33.98% lat (msec) : 100=20.57%, 250=3.91%, 500=0.13% cpu : usr=0.09%, sys=6.05%, ctx=1468, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145426: Fri Sep 4 04:20:05 2026 read: IOPS=15, BW=242KiB/s (247kB/s)(6032KiB/24967msec) clat (usec): min=35, max=165027, avg=32128.10, stdev=30176.47 lat (usec): min=35, max=165027, avg=32129.41, stdev=30176.26 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 79], | 30.00th=[ 3097], 40.00th=[ 22938], 50.00th=[ 30016], 60.00th=[ 36439], | 70.00th=[ 42730], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[143655], 99.50th=[162530], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 31, max= 475, per=25.59%, avg=239.80, stdev=106.84, samples=49 iops : min= 1, max= 29, avg=14.20, stdev= 6.71, samples=49 write: IOPS=15, BW=251KiB/s (257kB/s)(6256KiB/24967msec); 0 zone resets clat (usec): min=1361, max=189349, avg=32298.96, stdev=35859.22 lat (usec): min=1363, max=189352, avg=32300.73, stdev=35859.24 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1795], 10.00th=[ 2073], 20.00th=[ 3621], | 30.00th=[ 5997], 40.00th=[ 8717], 50.00th=[ 17957], 60.00th=[ 29230], | 70.00th=[ 41157], 80.00th=[ 61080], 90.00th=[ 84411], 95.00th=[107480], | 99.00th=[164627], 99.50th=[168821], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 570, per=25.42%, avg=250.61, stdev=100.66, samples=49 iops : min= 3, max= 35, avg=14.88, stdev= 6.34, samples=49 lat (usec) : 50=0.91%, 100=10.29%, 250=2.21%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.95%, 4=7.16%, 10=9.64%, 20=7.42%, 50=32.81% lat (msec) : 100=19.14%, 250=4.69% cpu : usr=0.09%, sys=6.28%, ctx=1397, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=938KiB/s (960kB/s), 234KiB/s-245KiB/s (240kB/s-251kB/s), io=23.4MiB (24.5MB), run=24385-25546msec WRITE: bw=986KiB/s (1010kB/s), 236KiB/s-267KiB/s (242kB/s-273kB/s), io=24.6MiB (25.8MB), run=24385-25546msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145418: Fri Sep 4 04:20:47 2026 read: IOPS=5, BW=88.1KiB/s (90.2kB/s)(5920KiB/67198msec) clat (msec): min=7, max=294, avg=35.73, stdev=30.89 lat (msec): min=7, max=294, avg=35.73, stdev=30.89 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 102], | 99.00th=[ 150], 99.50th=[ 171], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 416, per=27.34%, avg=96.51, stdev=68.03, samples=121 iops : min= 1, max= 26, avg= 5.31, stdev= 4.36, samples=121 write: IOPS=5, BW=94.8KiB/s (97.0kB/s)(6368KiB/67198msec); 0 zone resets clat (msec): min=36, max=368, avg=135.21, stdev=53.56 lat (msec): min=36, max=368, avg=135.21, stdev=53.56 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 112], 50.00th=[ 125], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 178], 90.00th=[ 213], 95.00th=[ 249], | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 160, per=25.64%, avg=95.11, stdev=35.46, samples=132 iops : min= 1, max= 10, avg= 5.20, stdev= 2.26, samples=132 lat (msec) : 10=1.04%, 20=14.97%, 50=23.44%, 100=21.22%, 250=36.85% lat (msec) : 500=2.47% cpu : usr=0.05%, sys=1.26%, ctx=1244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145419: Fri Sep 4 04:20:47 2026 read: IOPS=5, BW=84.7KiB/s (86.7kB/s)(5744KiB/67808msec) clat (msec): min=6, max=201, avg=35.37, stdev=30.49 lat (msec): min=6, max=201, avg=35.38, stdev=30.49 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 95], | 99.00th=[ 176], 99.50th=[ 186], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 27, max= 255, per=27.65%, avg=97.59, stdev=60.00, samples=115 iops : min= 1, max= 15, avg= 5.36, stdev= 3.75, samples=115 write: IOPS=6, BW=96.5KiB/s (98.8kB/s)(6544KiB/67808msec); 0 zone resets clat (msec): min=46, max=368, avg=134.29, stdev=56.88 lat (msec): min=46, max=368, avg=134.30, stdev=56.88 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 90], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 211], 95.00th=[ 247], | 99.00th=[ 330], 99.50th=[ 338], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 192, per=25.81%, avg=95.77, stdev=37.51, samples=134 iops : min= 1, max= 12, avg= 5.25, stdev= 2.44, samples=134 lat (msec) : 10=2.08%, 20=14.71%, 50=21.35%, 100=23.70%, 250=35.81% lat (msec) : 500=2.34% cpu : usr=0.04%, sys=1.26%, ctx=1265, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145420: Fri Sep 4 04:20:47 2026 read: IOPS=5, BW=93.0KiB/s (96.2kB/s)(6256KiB/66580msec) clat (msec): min=6, max=209, avg=34.80, stdev=28.91 lat (msec): min=6, max=209, avg=34.80, stdev=28.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 67], 95.00th=[ 95], | 99.00th=[ 157], 99.50th=[ 207], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 345, per=28.73%, avg=101.43, stdev=70.00, samples=122 iops : min= 1, max= 21, avg= 5.60, stdev= 4.42, samples=122 write: IOPS=5, BW=90.6KiB/s (92.8kB/s)(6032KiB/66580msec); 0 zone resets clat (msec): min=44, max=391, avg=139.81, stdev=56.74 lat (msec): min=44, max=391, avg=139.81, stdev=56.74 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 117], 50.00th=[ 127], 60.00th=[ 144], | 70.00th=[ 155], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 249], | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 27, max= 223, per=24.25%, avg=89.96, stdev=34.89, samples=131 iops : min= 1, max= 13, avg= 4.88, stdev= 2.23, samples=131 lat (msec) : 10=1.43%, 20=14.58%, 50=26.30%, 100=18.10%, 250=37.24% lat (msec) : 500=2.34% cpu : usr=0.03%, sys=1.23%, ctx=1329, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145421: Fri Sep 4 04:20:47 2026 read: IOPS=5, BW=90.5KiB/s (92.7kB/s)(6032KiB/66636msec) clat (msec): min=7, max=300, avg=35.61, stdev=31.50 lat (msec): min=7, max=300, avg=35.61, stdev=31.50 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 107], | 99.00th=[ 150], 99.50th=[ 165], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 287, per=27.06%, avg=95.53, stdev=55.51, samples=124 iops : min= 1, max= 17, avg= 5.21, stdev= 3.49, samples=124 write: IOPS=5, BW=93.9KiB/s (96.1kB/s)(6256KiB/66636msec); 0 zone resets clat (msec): min=44, max=387, avg=135.99, stdev=51.97 lat (msec): min=44, max=387, avg=135.99, stdev=51.97 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 95], | 30.00th=[ 108], 40.00th=[ 116], 50.00th=[ 128], 60.00th=[ 136], | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 199], 95.00th=[ 243], | 99.00th=[ 305], 99.50th=[ 342], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 31, max= 192, per=25.22%, avg=93.55, stdev=34.74, samples=132 iops : min= 1, max= 12, avg= 5.11, stdev= 2.26, samples=132 lat (msec) : 10=0.78%, 20=15.76%, 50=24.22%, 100=17.84%, 250=39.32% lat (msec) : 500=2.08% cpu : usr=0.03%, sys=1.22%, ctx=1236, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=353KiB/s (362kB/s), 84.7KiB/s-93.0KiB/s (86.7kB/s-96.2kB/s), io=23.4MiB (24.5MB), run=66580-67808msec WRITE: bw=372KiB/s (381kB/s), 90.6KiB/s-96.5KiB/s (92.8kB/s-98.8kB/s), io=24.6MiB (25.8MB), run=66580-67808msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145442: Fri Sep 4 04:21:02 2026 read: IOPS=2, BW=2075KiB/s (2125kB/s)(7168KiB/3454msec) clat (msec): min=66, max=246, avg=128.63, stdev=57.59 lat (msec): min=66, max=246, avg=128.63, stdev=57.59 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 101], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 117], 60.00th=[ 118], | 70.00th=[ 118], 80.00th=[ 150], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 2035, max= 6023, per=93.38%, avg=3991.00, stdev=1995.09, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1482KiB/s (1518kB/s)(5120KiB/3454msec); 0 zone resets clat (msec): min=320, max=728, avg=496.74, stdev=199.32 lat (msec): min=320, max=728, avg=496.99, stdev=199.22 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1957, max= 3984, per=44.43%, avg=2658.67, stdev=1148.43, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=5.79%, ctx=76, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145443: Fri Sep 4 04:21:02 2026 read: IOPS=0, BW=427KiB/s (438kB/s)(2048KiB/4791msec) clat (msec): min=93, max=106, avg=99.94, stdev= 9.71 lat (msec): min=93, max=106, avg=99.95, stdev= 9.71 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 93], 60.00th=[ 107], | 70.00th=[ 107], 80.00th=[ 107], 90.00th=[ 107], 95.00th=[ 107], | 99.00th=[ 107], 99.50th=[ 107], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 2011, max= 2048, per=47.48%, avg=2029.50, stdev=26.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2137KiB/s (2189kB/s)(10.0MiB/4791msec); 0 zone resets clat (msec): min=133, max=987, avg=456.74, stdev=245.68 lat (msec): min=133, max=987, avg=456.86, stdev=245.66 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 236], | 30.00th=[ 266], 40.00th=[ 292], 50.00th=[ 435], 60.00th=[ 518], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 617], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1957, max= 4071, per=43.22%, avg=2586.00, stdev=1003.94, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=33.33%, 1000=8.33% cpu : usr=0.02%, sys=4.78%, ctx=90, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145444: Fri Sep 4 04:21:02 2026 read: IOPS=1, BW=1295KiB/s (1326kB/s)(6144KiB/4745msec) clat (msec): min=83, max=530, avg=257.91, stdev=167.01 lat (msec): min=83, max=530, avg=257.91, stdev=167.01 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 247], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1950, max= 2043, per=47.07%, avg=2011.75, stdev=42.98, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1295KiB/s (1326kB/s)(6144KiB/4745msec); 0 zone resets clat (msec): min=238, max=1139, avg=528.23, stdev=373.97 lat (msec): min=238, max=1139, avg=528.35, stdev=373.91 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 359], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1950, max= 2860, per=38.02%, avg=2275.00, stdev=507.67, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=4.03%, ctx=76, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145445: Fri Sep 4 04:21:02 2026 read: IOPS=1, BW=1219KiB/s (1248kB/s)(5120KiB/4201msec) clat (msec): min=110, max=842, avg=354.52, stdev=298.71 lat (msec): min=110, max=842, avg=354.53, stdev=298.71 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 4063, max= 4087, per=95.34%, avg=4075.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1706KiB/s (1747kB/s)(7168KiB/4201msec); 0 zone resets clat (msec): min=184, max=592, avg=343.94, stdev=136.24 lat (msec): min=185, max=592, avg=344.11, stdev=136.22 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 213], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 418], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1943, max= 4031, per=45.17%, avg=2703.00, stdev=990.36, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.95%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4275KiB/s (4377kB/s), 427KiB/s-2075KiB/s (438kB/s-2125kB/s), io=20.0MiB (20.0MB), run=3454-4791msec WRITE: bw=5985KiB/s (6128kB/s), 1295KiB/s-2137KiB/s (1326kB/s-2189kB/s), io=28.0MiB (29.4MB), run=3454-4791msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145447: Fri Sep 4 04:21:02 2026 read: IOPS=2, BW=2216KiB/s (2269kB/s)(7168KiB/3235msec) clat (usec): min=967, max=398741, avg=205532.64, stdev=140596.41 lat (usec): min=968, max=398742, avg=205533.89, stdev=140596.44 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 971], 10.00th=[ 971], 20.00th=[139461], | 30.00th=[143655], 40.00th=[143655], 50.00th=[164627], 60.00th=[212861], | 70.00th=[212861], 80.00th=[379585], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 2035, max= 4260, per=63.25%, avg=2779.33, stdev=1282.30, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1583KiB/s (1621kB/s)(5120KiB/3235msec); 0 zone resets clat (msec): min=220, max=654, avg=356.77, stdev=175.43 lat (msec): min=220, max=654, avg=357.23, stdev=175.40 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1992, max= 3864, per=42.76%, avg=2630.33, stdev=1068.60, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=15.62%, ctx=187, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145448: Fri Sep 4 04:21:02 2026 read: IOPS=0, BW=439KiB/s (450kB/s)(2048KiB/4660msec) clat (usec): min=1111, max=217044, avg=109077.95, stdev=152687.40 lat (usec): min=1114, max=217046, avg=109080.41, stdev=152687.26 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1106], 10.00th=[ 1106], 20.00th=[ 1106], | 30.00th=[ 1106], 40.00th=[ 1106], 50.00th=[ 1106], 60.00th=[217056], | 70.00th=[217056], 80.00th=[217056], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 1389, max= 1992, per=38.47%, avg=1690.50, stdev=426.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2197KiB/s (2250kB/s)(10.0MiB/4660msec); 0 zone resets clat (msec): min=138, max=957, avg=442.39, stdev=254.93 lat (msec): min=138, max=957, avg=442.50, stdev=254.94 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 220], | 30.00th=[ 239], 40.00th=[ 247], 50.00th=[ 363], 60.00th=[ 414], | 70.00th=[ 592], 80.00th=[ 625], 90.00th=[ 634], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1899, max= 4087, per=43.41%, avg=2670.67, stdev=1092.02, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 2=8.33%, 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=14.72%, ctx=177, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145449: Fri Sep 4 04:21:02 2026 read: IOPS=1, BW=2015KiB/s (2063kB/s)(6144KiB/3049msec) clat (usec): min=496, max=269008, avg=69877.46, stdev=111501.81 lat (usec): min=496, max=269008, avg=69878.71, stdev=111501.69 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 816], 50.00th=[ 816], 60.00th=[ 10421], | 70.00th=[137364], 80.00th=[137364], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1932, max= 4087, per=60.77%, avg=2670.33, stdev=1227.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=2015KiB/s (2063kB/s)(6144KiB/3049msec); 0 zone resets clat (msec): min=150, max=1020, avg=437.50, stdev=325.68 lat (msec): min=150, max=1020, avg=437.57, stdev=325.68 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 342], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1932, max= 2771, per=35.51%, avg=2184.50, stdev=393.62, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 20=8.33%, 250=25.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.07%, sys=14.86%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145450: Fri Sep 4 04:21:02 2026 read: IOPS=1, BW=1268KiB/s (1298kB/s)(5120KiB/4038msec) clat (usec): min=736, max=663110, avg=245515.76, stdev=275612.83 lat (usec): min=738, max=663111, avg=245517.31, stdev=275612.82 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 734], | 30.00th=[ 1483], 40.00th=[ 1483], 50.00th=[219153], 60.00th=[219153], | 70.00th=[341836], 80.00th=[341836], 90.00th=[666895], 95.00th=[666895], | 99.00th=[666895], 99.50th=[666895], 99.90th=[666895], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 3961, max= 3984, per=90.41%, avg=3972.50, stdev=16.26, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1775KiB/s (1818kB/s)(7168KiB/4038msec); 0 zone resets clat (msec): min=191, max=593, avg=400.77, stdev=150.02 lat (msec): min=191, max=593, avg=400.89, stdev=149.98 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 255], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 393], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 575], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1393, max= 4071, per=38.22%, avg=2351.50, stdev=1179.74, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=41.67%, 750=25.00% cpu : usr=0.02%, sys=13.75%, ctx=199, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4395KiB/s (4500kB/s), 439KiB/s-2216KiB/s (450kB/s-2269kB/s), io=20.0MiB (20.0MB), run=3049-4660msec WRITE: bw=6153KiB/s (6300kB/s), 1583KiB/s-2197KiB/s (1621kB/s-2250kB/s), io=28.0MiB (29.4MB), run=3049-4660msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145461: Fri Sep 4 04:21:15 2026 read: IOPS=1, BW=4787KiB/s (4902kB/s)(12.0MiB/2567msec) clat (msec): min=728, max=945, avg=825.63, stdev=110.20 lat (msec): min=728, max=945, avg=825.63, stdev=110.20 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.96%, ctx=388, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145462: Fri Sep 4 04:21:15 2026 read: IOPS=0, BW=1262KiB/s (1292kB/s)(4096KiB/3246msec) clat (nsec): min=657478k, max=657478k, avg=657477559.00, stdev= 0.00 lat (nsec): min=657480k, max=657480k, avg=657479544.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2524KiB/s (2584kB/s)(8192KiB/3246msec); 0 zone resets clat (msec): min=972, max=1504, avg=1238.12, stdev=376.10 lat (msec): min=972, max=1504, avg=1238.53, stdev=376.17 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8000, max= 8000, per=79.74%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.42%, ctx=194, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145463: Fri Sep 4 04:21:15 2026 write: IOPS=0, BW=3796KiB/s (3887kB/s)(12.0MiB/3237msec); 0 zone resets clat (msec): min=743, max=1247, avg=1059.13, stdev=275.39 lat (msec): min=743, max=1249, avg=1060.32, stdev=275.77 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8175, max= 8192, per=81.57%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.01%, ctx=52, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145464: Fri Sep 4 04:21:15 2026 write: IOPS=0, BW=3762KiB/s (3853kB/s)(12.0MiB/3266msec); 0 zone resets clat (msec): min=346, max=1516, avg=1048.03, stdev=618.78 lat (msec): min=346, max=1517, avg=1049.05, stdev=619.45 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8175, max= 8175, per=81.48%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.12%, sys=4.53%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5047KiB/s (5169kB/s), 1262KiB/s-4787KiB/s (1292kB/s-4902kB/s), io=16.0MiB (16.8MB), run=2567-3246msec WRITE: bw=9.80MiB/s (10.3MB/s), 2524KiB/s-3796KiB/s (2584kB/s-3887kB/s), io=32.0MiB (33.6MB), run=3237-3266msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145456: Fri Sep 4 04:21:16 2026 read: IOPS=0, BW=3717KiB/s (3806kB/s)(12.0MiB/3306msec) clat (msec): min=913, max=1178, avg=1054.18, stdev=133.09 lat (msec): min=913, max=1178, avg=1054.18, stdev=133.09 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.51%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145457: Fri Sep 4 04:21:16 2026 read: IOPS=0, BW=2291KiB/s (2346kB/s)(4096KiB/1788msec) clat (nsec): min=229991k, max=229991k, avg=229990716.00, stdev= 0.00 lat (nsec): min=229994k, max=229994k, avg=229994307.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 5550, max= 5550, per=100.00%, avg=5550.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4582KiB/s (4692kB/s)(8192KiB/1788msec); 0 zone resets clat (msec): min=662, max=799, avg=730.96, stdev=96.37 lat (msec): min=663, max=800, avg=731.59, stdev=96.85 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.28%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145458: Fri Sep 4 04:21:16 2026 write: IOPS=0, BW=3021KiB/s (3093kB/s)(12.0MiB/4068msec); 0 zone resets clat (msec): min=298, max=2999, avg=1314.58, stdev=1469.46 lat (msec): min=299, max=3001, avg=1315.56, stdev=1470.44 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 8000, max= 8126, per=100.00%, avg=8063.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.10%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145460: Fri Sep 4 04:21:16 2026 write: IOPS=1, BW=6015KiB/s (6159kB/s)(12.0MiB/2043msec); 0 zone resets clat (msec): min=336, max=982, avg=631.81, stdev=326.31 lat (msec): min=337, max=982, avg=632.29, stdev=326.14 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7585, max= 8192, per=97.93%, avg=7888.50, stdev=429.21, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=9.70%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4956KiB/s (5075kB/s), 2291KiB/s-3717KiB/s (2346kB/s-3806kB/s), io=16.0MiB (16.8MB), run=1788-3306msec WRITE: bw=8055KiB/s (8248kB/s), 3021KiB/s-6015KiB/s (3093kB/s-6159kB/s), io=32.0MiB (33.6MB), run=1788-4068msec