== sanity test 398b: DIO and buffer IO race ============== 19:36:26 (1787700986) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.10133 s, 9.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145677: Tue Aug 25 19:38:26 2026 read: IOPS=14, BW=58.5KiB/s (59.9kB/s)(5992KiB/102400msec) clat (usec): min=39, max=177083, avg=32978.41, stdev=23535.57 lat (usec): min=39, max=177085, avg=32979.85, stdev=23535.49 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 8586], 20.00th=[ 16319], | 30.00th=[ 19792], 40.00th=[ 23987], 50.00th=[ 28443], 60.00th=[ 33424], | 70.00th=[ 39584], 80.00th=[ 48497], 90.00th=[ 63177], 95.00th=[ 76022], | 99.00th=[116917], 99.50th=[135267], 99.90th=[170918], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 7, max= 127, per=25.25%, avg=58.32, stdev=23.08, samples=201 iops : min= 1, max= 31, avg=13.94, stdev= 5.80, samples=201 write: IOPS=15, BW=61.5KiB/s (62.0kB/s)(6296KiB/102400msec); 0 zone resets clat (usec): min=920, max=919129, avg=33421.34, stdev=41813.50 lat (usec): min=921, max=919131, avg=33423.10, stdev=41813.15 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1729], 20.00th=[ 3556], | 30.00th=[ 6783], 40.00th=[ 15795], 50.00th=[ 24773], 60.00th=[ 33162], | 70.00th=[ 42730], 80.00th=[ 55313], 90.00th=[ 74974], 95.00th=[ 99091], | 99.00th=[154141], 99.50th=[191890], 99.90th=[396362], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 126, per=25.45%, avg=61.60, stdev=24.01, samples=200 iops : min= 1, max= 31, avg=14.75, stdev= 6.03, samples=200 lat (usec) : 50=0.59%, 100=3.16%, 250=0.36%, 500=0.16%, 750=0.16% lat (usec) : 1000=0.20% lat (msec) : 2=5.86%, 4=5.50%, 10=7.19%, 20=14.68%, 50=41.50% lat (msec) : 100=17.45%, 250=3.06%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.78%, ctx=6650, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145680: Tue Aug 25 19:38:26 2026 read: IOPS=14, BW=57.2KiB/s (58.6kB/s)(5940KiB/103782msec) clat (usec): min=31, max=258740, avg=34017.16, stdev=24785.85 lat (usec): min=31, max=258741, avg=34020.48, stdev=24785.91 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 10290], 20.00th=[ 16581], | 30.00th=[ 20579], 40.00th=[ 24773], 50.00th=[ 28967], 60.00th=[ 34341], | 70.00th=[ 41157], 80.00th=[ 50070], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[122160], 99.50th=[139461], 99.90th=[210764], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 125, per=24.53%, avg=56.67, stdev=22.69, samples=204 iops : min= 1, max= 31, avg=13.51, stdev= 5.71, samples=204 write: IOPS=15, BW=61.2KiB/s (62.6kB/s)(6348KiB/103782msec); 0 zone resets clat (usec): min=958, max=905753, avg=33308.27, stdev=40540.88 lat (usec): min=959, max=905754, avg=33311.99, stdev=40541.30 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1614], 20.00th=[ 3163], | 30.00th=[ 6587], 40.00th=[ 16581], 50.00th=[ 24249], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 55837], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[149947], 99.50th=[170918], 99.90th=[362808], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 191, per=24.94%, avg=60.35, stdev=25.05, samples=204 iops : min= 1, max= 47, avg=14.44, stdev= 6.28, samples=204 lat (usec) : 50=0.52%, 100=3.19%, 250=0.26%, 1000=0.16% lat (msec) : 2=6.84%, 4=5.18%, 10=6.48%, 20=14.06%, 50=41.31% lat (msec) : 100=19.01%, 250=2.90%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.67%, ctx=6693, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145682: Tue Aug 25 19:38:26 2026 read: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6028KiB/103138msec) clat (usec): min=35, max=927656, avg=34569.21, stdev=34333.08 lat (usec): min=36, max=927657, avg=34572.37, stdev=34332.78 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 9241], 20.00th=[ 16319], | 30.00th=[ 20317], 40.00th=[ 24511], 50.00th=[ 28705], 60.00th=[ 34341], | 70.00th=[ 40633], 80.00th=[ 50594], 90.00th=[ 64226], 95.00th=[ 76022], | 99.00th=[117965], 99.50th=[168821], 99.90th=[238027], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 119, per=25.13%, avg=58.05, stdev=23.13, samples=203 iops : min= 1, max= 29, avg=13.87, stdev= 5.81, samples=203 write: IOPS=15, BW=60.7KiB/s (62.2kB/s)(6260KiB/103138msec); 0 zone resets clat (usec): min=953, max=378547, avg=32350.57, stdev=33711.42 lat (usec): min=954, max=378549, avg=32354.49, stdev=33711.63 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1680], 20.00th=[ 3490], | 30.00th=[ 6980], 40.00th=[ 16188], 50.00th=[ 24511], 60.00th=[ 32375], | 70.00th=[ 41157], 80.00th=[ 55313], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[164627], 99.90th=[291505], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 135, per=24.89%, avg=60.23, stdev=23.72, samples=203 iops : min= 1, max= 33, avg=14.41, stdev= 5.95, samples=203 lat (usec) : 50=0.94%, 100=2.80%, 250=0.39%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.83%, 4=5.11%, 10=6.93%, 20=14.36%, 50=41.50% lat (msec) : 100=18.85%, 250=2.93%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.84%, ctx=6715, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145683: Tue Aug 25 19:38:26 2026 read: IOPS=14, BW=58.9KiB/s (60.3kB/s)(6052KiB/102719msec) clat (usec): min=27, max=440702, avg=33273.99, stdev=26822.92 lat (usec): min=27, max=440703, avg=33275.22, stdev=26823.03 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 125], 20.00th=[ 15926], | 30.00th=[ 20317], 40.00th=[ 24249], 50.00th=[ 28181], 60.00th=[ 33817], | 70.00th=[ 39584], 80.00th=[ 47973], 90.00th=[ 62653], 95.00th=[ 74974], | 99.00th=[119014], 99.50th=[152044], 99.90th=[196084], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 149, per=25.65%, avg=59.25, stdev=22.81, samples=200 iops : min= 1, max= 37, avg=14.17, stdev= 5.74, samples=200 write: IOPS=15, BW=60.7KiB/s (62.2kB/s)(6236KiB/102719msec); 0 zone resets clat (usec): min=952, max=1017.5k, avg=33336.19, stdev=42783.33 lat (usec): min=953, max=1017.5k, avg=33339.60, stdev=42783.58 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1188], 10.00th=[ 1729], | 20.00th=[ 3425], 30.00th=[ 6587], 40.00th=[ 15401], | 50.00th=[ 25035], 60.00th=[ 33817], 70.00th=[ 42730], | 80.00th=[ 55313], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[ 162530], 99.50th=[ 198181], 99.90th=[ 383779], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 15, max= 142, per=25.03%, avg=60.58, stdev=22.27, samples=201 iops : min= 3, max= 35, avg=14.50, stdev= 5.59, samples=201 lat (usec) : 50=1.07%, 100=3.68%, 250=0.42%, 500=0.13%, 1000=0.07% lat (msec) : 2=6.02%, 4=5.47%, 10=6.51%, 20=13.31%, 50=42.02% lat (msec) : 100=18.07%, 250=3.09%, 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=5.72%, ctx=6572, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=231KiB/s (237kB/s), 57.2KiB/s-58.9KiB/s (58.6kB/s-60.3kB/s), io=23.4MiB (24.6MB), run=102400-103782msec WRITE: bw=242KiB/s (248kB/s), 60.7KiB/s-61.5KiB/s (62.2kB/s-62.0kB/s), io=24.6MiB (25.7MB), run=102400-103782msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145676: Tue Aug 25 19:40:17 2026 read: IOPS=6, BW=27.0KiB/s (28.7kB/s)(5992KiB/214144msec) clat (msec): min=4, max=942, avg=27.97, stdev=38.72 lat (msec): min=4, max=942, avg=27.97, stdev=38.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 59], 95.00th=[ 85], | 99.00th=[ 159], 99.50th=[ 197], 99.90th=[ 372], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 95, per=26.78%, avg=30.00, stdev=18.95, samples=389 iops : min= 1, max= 23, avg= 6.91, stdev= 4.81, samples=389 write: IOPS=7, BW=29.4KiB/s (30.1kB/s)(6296KiB/214144msec); 0 zone resets clat (msec): min=31, max=490, avg=109.20, stdev=52.41 lat (msec): min=31, max=490, avg=109.20, stdev=52.41 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 71], | 30.00th=[ 79], 40.00th=[ 86], 50.00th=[ 96], 60.00th=[ 108], | 70.00th=[ 122], 80.00th=[ 140], 90.00th=[ 176], 95.00th=[ 213], | 99.00th=[ 284], 99.50th=[ 342], 99.90th=[ 468], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 64, per=24.90%, avg=29.14, stdev=12.58, samples=420 iops : min= 1, max= 16, avg= 6.69, stdev= 3.22, samples=420 lat (msec) : 10=7.71%, 20=21.26%, 50=15.56%, 100=30.31%, 250=23.96% lat (msec) : 500=1.17%, 1000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5302, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145678: Tue Aug 25 19:40:17 2026 read: IOPS=6, BW=27.8KiB/s (28.5kB/s)(5940KiB/213686msec) clat (msec): min=4, max=946, avg=27.49, stdev=38.34 lat (msec): min=4, max=946, avg=27.50, stdev=38.34 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 60], 95.00th=[ 83], | 99.00th=[ 153], 99.50th=[ 226], 99.90th=[ 317], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 128, per=27.03%, avg=30.27, stdev=20.04, samples=382 iops : min= 1, max= 32, avg= 6.97, stdev= 5.05, samples=382 write: IOPS=7, BW=29.7KiB/s (30.4kB/s)(6348KiB/213686msec); 0 zone resets clat (msec): min=28, max=463, avg=108.68, stdev=50.83 lat (msec): min=28, max=463, avg=108.68, stdev=50.83 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 80], 40.00th=[ 87], 50.00th=[ 95], 60.00th=[ 107], | 70.00th=[ 120], 80.00th=[ 140], 90.00th=[ 176], 95.00th=[ 209], | 99.00th=[ 284], 99.50th=[ 342], 99.90th=[ 422], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 56, per=25.05%, avg=29.31, stdev=12.38, samples=421 iops : min= 1, max= 14, avg= 6.73, stdev= 3.16, samples=421 lat (msec) : 10=8.27%, 20=21.19%, 50=14.39%, 100=31.58%, 250=23.34% lat (msec) : 500=1.20%, 1000=0.03% cpu : usr=0.05%, sys=1.26%, ctx=5279, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145679: Tue Aug 25 19:40:17 2026 read: IOPS=7, BW=28.2KiB/s (28.9kB/s)(6028KiB/213426msec) clat (msec): min=4, max=341, avg=28.27, stdev=29.90 lat (msec): min=4, max=341, avg=28.27, stdev=29.90 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 39], 90.00th=[ 63], 95.00th=[ 87], | 99.00th=[ 140], 99.50th=[ 180], 99.90th=[ 284], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 120, per=26.65%, avg=29.85, stdev=20.31, samples=392 iops : min= 1, max= 30, avg= 6.87, stdev= 5.14, samples=392 write: IOPS=7, BW=29.3KiB/s (30.0kB/s)(6260KiB/213426msec); 0 zone resets clat (msec): min=24, max=989, avg=108.89, stdev=55.07 lat (msec): min=24, max=989, avg=108.89, stdev=55.07 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 69], | 30.00th=[ 79], 40.00th=[ 86], 50.00th=[ 96], 60.00th=[ 108], | 70.00th=[ 123], 80.00th=[ 142], 90.00th=[ 174], 95.00th=[ 205], | 99.00th=[ 292], 99.50th=[ 326], 99.90th=[ 422], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 63, per=24.75%, avg=28.96, stdev=12.80, samples=419 iops : min= 1, max= 15, avg= 6.64, stdev= 3.27, samples=419 lat (msec) : 10=8.40%, 20=19.04%, 50=16.80%, 100=30.44%, 250=24.15% lat (msec) : 500=1.14%, 1000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=5178, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145681: Tue Aug 25 19:40:17 2026 read: IOPS=7, BW=28.5KiB/s (29.2kB/s)(6052KiB/212412msec) clat (msec): min=5, max=373, avg=27.55, stdev=29.69 lat (msec): min=5, max=373, avg=27.55, stdev=29.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 37], 90.00th=[ 61], 95.00th=[ 87], | 99.00th=[ 142], 99.50th=[ 174], 99.90th=[ 300], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 119, per=27.17%, avg=30.43, stdev=19.85, samples=387 iops : min= 1, max= 29, avg= 7.01, stdev= 5.01, samples=387 write: IOPS=7, BW=29.4KiB/s (30.1kB/s)(6236KiB/212412msec); 0 zone resets clat (msec): min=37, max=1003, avg=109.27, stdev=54.69 lat (msec): min=37, max=1003, avg=109.27, stdev=54.69 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 70], | 30.00th=[ 80], 40.00th=[ 88], 50.00th=[ 97], 60.00th=[ 108], | 70.00th=[ 121], 80.00th=[ 140], 90.00th=[ 174], 95.00th=[ 211], | 99.00th=[ 292], 99.50th=[ 326], 99.90th=[ 397], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 64, per=24.68%, avg=28.88, stdev=12.47, samples=419 iops : min= 1, max= 16, avg= 6.62, stdev= 3.19, samples=419 lat (msec) : 10=7.39%, 20=22.14%, 50=14.75%, 100=30.01%, 250=24.74% lat (msec) : 500=0.94%, 2000=0.03% cpu : usr=0.04%, sys=1.24%, ctx=5174, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=112KiB/s (115kB/s), 27.8KiB/s-28.5KiB/s (28.5kB/s-29.2kB/s), io=23.4MiB (24.6MB), run=212412-214144msec WRITE: bw=117KiB/s (120kB/s), 29.3KiB/s-29.7KiB/s (30.0kB/s-30.4kB/s), io=24.6MiB (25.7MB), run=212412-214144msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145727: Tue Aug 25 19:40:49 2026 read: IOPS=16, BW=258KiB/s (265kB/s)(5920KiB/22904msec) clat (usec): min=31, max=229436, avg=31862.25, stdev=28038.14 lat (usec): min=31, max=229437, avg=31863.28, stdev=28038.13 clat percentiles (usec): | 1.00th=[ 35], 5.00th=[ 54], 10.00th=[ 58], 20.00th=[ 78], | 30.00th=[ 17171], 40.00th=[ 25035], 50.00th=[ 28967], 60.00th=[ 34341], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 64750], 95.00th=[ 73925], | 99.00th=[106431], 99.50th=[173016], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 114, max= 606, per=24.74%, avg=258.51, stdev=101.52, samples=45 iops : min= 7, max= 37, avg=15.49, stdev= 6.37, samples=45 write: IOPS=17, BW=278KiB/s (285kB/s)(6368KiB/22904msec); 0 zone resets clat (usec): min=1404, max=149610, avg=27386.48, stdev=27529.86 lat (usec): min=1406, max=149611, avg=27388.57, stdev=27529.99 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1844], 10.00th=[ 2638], 20.00th=[ 4293], | 30.00th=[ 6325], 40.00th=[ 9503], 50.00th=[ 19006], 60.00th=[ 27919], | 70.00th=[ 35914], 80.00th=[ 47973], 90.00th=[ 65274], 95.00th=[ 82314], | 99.00th=[132645], 99.50th=[147850], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 28, max= 542, per=25.35%, avg=278.82, stdev=106.78, samples=45 iops : min= 1, max= 33, avg=16.73, stdev= 6.78, samples=45 lat (usec) : 50=1.43%, 100=9.24%, 250=0.65%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.73%, 4=6.90%, 10=11.33%, 20=9.77%, 50=38.15% lat (msec) : 100=17.97%, 250=1.56% cpu : usr=0.09%, sys=6.23%, ctx=1468, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145728: Tue Aug 25 19:40:49 2026 read: IOPS=15, BW=253KiB/s (259kB/s)(5744KiB/22734msec) clat (usec): min=38, max=198934, avg=30596.71, stdev=27017.11 lat (usec): min=39, max=198934, avg=30598.37, stdev=27016.71 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 112], | 30.00th=[ 17433], 40.00th=[ 22938], 50.00th=[ 27919], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 46400], 90.00th=[ 59507], 95.00th=[ 80217], | 99.00th=[130548], 99.50th=[164627], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 57, max= 476, per=24.21%, avg=253.00, stdev=81.79, samples=44 iops : min= 3, max= 29, avg=15.09, stdev= 5.18, samples=44 write: IOPS=17, BW=288KiB/s (295kB/s)(6544KiB/22734msec); 0 zone resets clat (usec): min=1318, max=211417, avg=28530.36, stdev=30104.63 lat (usec): min=1320, max=211437, avg=28547.38, stdev=30096.84 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1762], 10.00th=[ 2507], 20.00th=[ 4490], | 30.00th=[ 7177], 40.00th=[ 10945], 50.00th=[ 18482], 60.00th=[ 26870], | 70.00th=[ 37487], 80.00th=[ 48497], 90.00th=[ 70779], 95.00th=[ 81265], | 99.00th=[126354], 99.50th=[175113], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 570, per=25.89%, avg=284.80, stdev=105.40, samples=44 iops : min= 1, max= 35, avg=17.11, stdev= 6.65, samples=44 lat (usec) : 50=0.52%, 100=8.72%, 250=0.65%, 500=0.26%, 750=0.26% lat (msec) : 2=3.52%, 4=6.64%, 10=10.94%, 20=11.46%, 50=38.93% lat (msec) : 100=15.89%, 250=2.21% cpu : usr=0.06%, sys=6.33%, ctx=1448, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145729: Tue Aug 25 19:40:49 2026 read: IOPS=17, BW=278KiB/s (284kB/s)(6256KiB/22534msec) clat (usec): min=36, max=197172, avg=30732.70, stdev=26029.25 lat (usec): min=36, max=197174, avg=30734.48, stdev=26029.49 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 83], | 30.00th=[ 18482], 40.00th=[ 22676], 50.00th=[ 28181], 60.00th=[ 33817], | 70.00th=[ 41157], 80.00th=[ 49021], 90.00th=[ 63177], 95.00th=[ 74974], | 99.00th=[119014], 99.50th=[127402], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 63, max= 479, per=26.78%, avg=279.82, stdev=81.06, samples=44 iops : min= 3, max= 29, avg=16.82, stdev= 5.05, samples=44 write: IOPS=16, BW=268KiB/s (274kB/s)(6032KiB/22534msec); 0 zone resets clat (usec): min=1363, max=210555, avg=27565.17, stdev=30590.71 lat (usec): min=1365, max=210556, avg=27567.03, stdev=30590.68 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1663], 10.00th=[ 1844], 20.00th=[ 3752], | 30.00th=[ 5735], 40.00th=[ 9372], 50.00th=[ 16188], 60.00th=[ 26084], | 70.00th=[ 34341], 80.00th=[ 48497], 90.00th=[ 66323], 95.00th=[ 85459], | 99.00th=[143655], 99.50th=[198181], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 92, max= 447, per=24.17%, avg=265.82, stdev=101.73, samples=44 iops : min= 5, max= 27, avg=15.95, stdev= 6.39, samples=44 lat (usec) : 50=1.04%, 100=9.77%, 250=0.78%, 500=0.13%, 750=0.13% lat (msec) : 2=5.60%, 4=5.47%, 10=10.03%, 20=10.03%, 50=38.28% lat (msec) : 100=16.67%, 250=2.08% cpu : usr=0.11%, sys=6.32%, ctx=1446, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145730: Tue Aug 25 19:40:49 2026 read: IOPS=16, BW=270KiB/s (276kB/s)(6032KiB/22372msec) clat (usec): min=26, max=130205, avg=29661.54, stdev=24198.24 lat (usec): min=26, max=130206, avg=29662.78, stdev=24198.19 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 83], | 30.00th=[ 17171], 40.00th=[ 23987], 50.00th=[ 30016], 60.00th=[ 34341], | 70.00th=[ 39060], 80.00th=[ 47449], 90.00th=[ 60031], 95.00th=[ 69731], | 99.00th=[115868], 99.50th=[128451], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 31, max= 542, per=25.57%, avg=267.18, stdev=96.97, samples=44 iops : min= 1, max= 33, avg=16.02, stdev= 6.06, samples=44 write: IOPS=17, BW=280KiB/s (286kB/s)(6256KiB/22372msec); 0 zone resets clat (usec): min=1344, max=146976, avg=28211.18, stdev=28621.90 lat (usec): min=1346, max=146978, avg=28216.80, stdev=28619.85 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1729], 10.00th=[ 2212], 20.00th=[ 4424], | 30.00th=[ 6849], 40.00th=[ 10290], 50.00th=[ 16909], 60.00th=[ 26084], | 70.00th=[ 39060], 80.00th=[ 51643], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[115868], 99.50th=[139461], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 115, max= 512, per=25.39%, avg=279.27, stdev=88.64, samples=44 iops : min= 7, max= 32, avg=16.80, stdev= 5.57, samples=44 lat (usec) : 50=1.95%, 100=9.24%, 250=0.91%, 500=0.26%, 750=0.13% lat (msec) : 2=4.56%, 4=4.95%, 10=11.33%, 20=9.90%, 50=37.11% lat (msec) : 100=17.84%, 250=1.82% cpu : usr=0.08%, sys=6.31%, ctx=1459, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1046KiB/s (1071kB/s), 253KiB/s-278KiB/s (259kB/s-284kB/s), io=23.4MiB (24.5MB), run=22372-22904msec WRITE: bw=1100KiB/s (1127kB/s), 268KiB/s-288KiB/s (274kB/s-295kB/s), io=24.6MiB (25.8MB), run=22372-22904msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145732: Tue Aug 25 19:41:21 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(5920KiB/53797msec) clat (msec): min=7, max=258, avg=33.48, stdev=31.59 lat (msec): min=7, max=258, avg=33.48, stdev=31.59 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 61], 95.00th=[ 94], | 99.00th=[ 184], 99.50th=[ 194], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 319, per=25.70%, avg=113.32, stdev=64.57, samples=102 iops : min= 1, max= 19, avg= 6.37, stdev= 4.12, samples=102 write: IOPS=7, BW=118KiB/s (121kB/s)(6368KiB/53797msec); 0 zone resets clat (msec): min=39, max=319, avg=103.37, stdev=46.01 lat (msec): min=39, max=319, avg=103.37, stdev=46.01 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 68], | 30.00th=[ 75], 40.00th=[ 85], 50.00th=[ 92], 60.00th=[ 101], | 70.00th=[ 111], 80.00th=[ 130], 90.00th=[ 169], 95.00th=[ 197], | 99.00th=[ 275], 99.50th=[ 309], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 192, per=25.65%, avg=119.03, stdev=47.19, samples=105 iops : min= 1, max= 12, avg= 6.72, stdev= 3.12, samples=105 lat (msec) : 10=2.86%, 20=15.36%, 50=24.61%, 100=34.11%, 250=22.40% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.51%, ctx=1432, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145733: Tue Aug 25 19:41:21 2026 read: IOPS=6, BW=106KiB/s (108kB/s)(5744KiB/54239msec) clat (msec): min=6, max=193, avg=31.87, stdev=30.33 lat (msec): min=6, max=193, avg=31.87, stdev=30.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 69], 95.00th=[ 109], | 99.00th=[ 155], 99.50th=[ 186], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 26, max= 377, per=26.84%, avg=118.38, stdev=72.34, samples=95 iops : min= 1, max= 23, avg= 6.71, stdev= 4.66, samples=95 write: IOPS=7, BW=121KiB/s (124kB/s)(6544KiB/54239msec); 0 zone resets clat (msec): min=37, max=340, avg=104.43, stdev=48.98 lat (msec): min=37, max=340, avg=104.44, stdev=48.98 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 67], | 30.00th=[ 74], 40.00th=[ 82], 50.00th=[ 90], 60.00th=[ 100], | 70.00th=[ 115], 80.00th=[ 140], 90.00th=[ 178], 95.00th=[ 205], | 99.00th=[ 266], 99.50th=[ 279], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 26, max= 223, per=25.85%, avg=119.96, stdev=51.89, samples=107 iops : min= 1, max= 13, avg= 6.79, stdev= 3.37, samples=107 lat (msec) : 10=4.04%, 20=18.49%, 50=19.27%, 100=34.38%, 250=23.05% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.43%, ctx=1257, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145734: Tue Aug 25 19:41:21 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(6256KiB/51393msec) clat (msec): min=4, max=257, avg=31.39, stdev=31.08 lat (msec): min=4, max=257, avg=31.39, stdev=31.08 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 101], | 99.00th=[ 159], 99.50th=[ 194], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 445, per=29.83%, avg=131.54, stdev=88.11, samples=94 iops : min= 1, max= 27, avg= 7.50, stdev= 5.58, samples=94 write: IOPS=7, BW=117KiB/s (120kB/s)(6032KiB/51393msec); 0 zone resets clat (msec): min=37, max=337, avg=102.95, stdev=48.51 lat (msec): min=37, max=337, avg=102.96, stdev=48.50 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 89], 60.00th=[ 101], | 70.00th=[ 114], 80.00th=[ 132], 90.00th=[ 163], 95.00th=[ 205], | 99.00th=[ 275], 99.50th=[ 317], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 26, max= 224, per=25.16%, avg=116.73, stdev=47.57, samples=101 iops : min= 1, max= 14, avg= 6.56, stdev= 3.14, samples=101 lat (msec) : 10=4.69%, 20=19.14%, 50=21.61%, 100=31.90%, 250=21.61% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.63%, ctx=1422, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145735: Tue Aug 25 19:41:21 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(6032KiB/53169msec) clat (msec): min=5, max=198, avg=31.43, stdev=27.62 lat (msec): min=5, max=198, avg=31.43, stdev=27.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 65], 95.00th=[ 91], | 99.00th=[ 157], 99.50th=[ 171], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 352, per=27.95%, avg=123.28, stdev=72.82, samples=96 iops : min= 1, max= 22, avg= 7.00, stdev= 4.67, samples=96 write: IOPS=7, BW=118KiB/s (120kB/s)(6256KiB/53169msec); 0 zone resets clat (msec): min=41, max=321, avg=104.49, stdev=47.69 lat (msec): min=41, max=321, avg=104.49, stdev=47.69 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 70], | 30.00th=[ 75], 40.00th=[ 81], 50.00th=[ 91], 60.00th=[ 101], | 70.00th=[ 114], 80.00th=[ 136], 90.00th=[ 178], 95.00th=[ 205], | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 192, per=25.62%, avg=118.88, stdev=48.59, samples=104 iops : min= 1, max= 12, avg= 6.72, stdev= 3.19, samples=104 lat (msec) : 10=3.26%, 20=17.71%, 50=22.66%, 100=34.24%, 250=21.35% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.41%, ctx=1400, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=442KiB/s (452kB/s), 106KiB/s-122KiB/s (108kB/s-125kB/s), io=23.4MiB (24.5MB), run=51393-54239msec WRITE: bw=465KiB/s (476kB/s), 117KiB/s-121KiB/s (120kB/s-124kB/s), io=24.6MiB (25.8MB), run=51393-54239msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145752: Tue Aug 25 19:41:35 2026 read: IOPS=1, BW=1740KiB/s (1782kB/s)(7168KiB/4119msec) clat (msec): min=119, max=600, avg=228.68, stdev=174.17 lat (msec): min=119, max=600, avg=228.68, stdev=174.17 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 129], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 142], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 292], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1410, max= 4055, per=71.82%, avg=2872.25, stdev=1345.95, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1243KiB/s (1273kB/s)(5120KiB/4119msec); 0 zone resets clat (msec): min=277, max=683, avg=490.28, stdev=170.46 lat (msec): min=277, max=683, avg=491.01, stdev=170.96 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1950, max= 2048, per=35.98%, avg=2014.00, stdev=43.63, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=5.32%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145753: Tue Aug 25 19:41:35 2026 read: IOPS=0, BW=400KiB/s (410kB/s)(2048KiB/5121msec) clat (msec): min=134, max=152, avg=143.60, stdev=12.45 lat (msec): min=134, max=152, avg=143.60, stdev=12.45 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 1404, max= 2039, per=43.05%, avg=1721.50, stdev=449.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2000KiB/s (2048kB/s)(10.0MiB/5121msec); 0 zone resets clat (msec): min=180, max=1834, avg=476.22, stdev=494.94 lat (msec): min=180, max=1834, avg=476.92, stdev=495.04 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 190], | 30.00th=[ 203], 40.00th=[ 271], 50.00th=[ 288], 60.00th=[ 321], | 70.00th=[ 409], 80.00th=[ 506], 90.00th=[ 567], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1404, max= 4087, per=39.76%, avg=2226.00, stdev=852.55, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.82%, ctx=146, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145754: Tue Aug 25 19:41:35 2026 read: IOPS=1, BW=1201KiB/s (1230kB/s)(6144KiB/5116msec) clat (msec): min=75, max=1241, avg=366.24, stdev=435.07 lat (msec): min=75, max=1241, avg=366.24, stdev=435.07 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 226], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2043, max= 4079, per=84.17%, avg=3366.00, stdev=1146.91, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1201KiB/s (1230kB/s)(6144KiB/5116msec); 0 zone resets clat (msec): min=178, max=714, avg=476.59, stdev=204.09 lat (msec): min=178, max=714, avg=476.67, stdev=204.07 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 498], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1422, max= 2043, per=34.12%, avg=1910.00, stdev=272.88, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=4.05%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145755: Tue Aug 25 19:41:35 2026 read: IOPS=1, BW=1414KiB/s (1448kB/s)(5120KiB/3620msec) clat (msec): min=97, max=329, avg=208.00, stdev=83.55 lat (msec): min=97, max=329, avg=208.01, stdev=83.55 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 3976, max= 4055, per=100.00%, avg=4015.50, stdev=55.86, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1980KiB/s (2028kB/s)(7168KiB/3620msec); 0 zone resets clat (msec): min=168, max=572, avg=365.76, stdev=155.05 lat (msec): min=169, max=572, avg=365.85, stdev=155.02 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 239], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 309], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 542], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1950, max= 2775, per=38.62%, avg=2162.00, stdev=344.36, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=4.42%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3999KiB/s (4095kB/s), 400KiB/s-1740KiB/s (410kB/s-1782kB/s), io=20.0MiB (20.0MB), run=3620-5121msec WRITE: bw=5599KiB/s (5733kB/s), 1201KiB/s-2000KiB/s (1230kB/s-2048kB/s), io=28.0MiB (29.4MB), run=3620-5121msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145757: Tue Aug 25 19:41:35 2026 read: IOPS=2, BW=2675KiB/s (2739kB/s)(7168KiB/2680msec) clat (msec): min=5, max=272, avg=185.36, stdev=85.72 lat (msec): min=5, max=272, avg=185.36, stdev=85.72 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 167], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 220], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2035, max= 4063, per=69.65%, avg=2914.75, stdev=1035.42, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1910KiB/s (1956kB/s)(5120KiB/2680msec); 0 zone resets clat (msec): min=115, max=389, avg=275.05, stdev=109.81 lat (msec): min=115, max=390, avg=275.58, stdev=109.54 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2035, max= 6119, per=69.59%, avg=4077.00, stdev=2887.82, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 10=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.07%, sys=22.25%, ctx=239, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145758: Tue Aug 25 19:41:35 2026 read: IOPS=0, BW=419KiB/s (429kB/s)(2048KiB/4893msec) clat (usec): min=498, max=230449, avg=115474.22, stdev=162599.78 lat (usec): min=499, max=230451, avg=115475.43, stdev=162600.72 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[229639], | 70.00th=[229639], 80.00th=[229639], 90.00th=[229639], 95.00th=[229639], | 99.00th=[229639], 99.50th=[229639], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 1939, max= 2048, per=47.63%, avg=1993.50, stdev=77.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2093KiB/s (2143kB/s)(10.0MiB/4893msec); 0 zone resets clat (msec): min=172, max=1923, avg=465.53, stdev=520.84 lat (msec): min=172, max=1923, avg=465.83, stdev=520.81 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 218], | 30.00th=[ 230], 40.00th=[ 257], 50.00th=[ 262], 60.00th=[ 313], | 70.00th=[ 422], 80.00th=[ 426], 90.00th=[ 435], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1868, max= 4047, per=39.05%, avg=2288.00, stdev=778.62, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.79, samples=7 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=50.00%, 2000=8.33% cpu : usr=0.04%, sys=13.23%, ctx=206, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145759: Tue Aug 25 19:41:35 2026 read: IOPS=1, BW=1853KiB/s (1898kB/s)(6144KiB/3315msec) clat (usec): min=536, max=738253, avg=204228.68, stdev=296261.70 lat (usec): min=537, max=738254, avg=204229.87, stdev=296261.75 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 1565], | 30.00th=[ 1565], 40.00th=[ 17695], 50.00th=[ 17695], 60.00th=[102237], | 70.00th=[367002], 80.00th=[367002], 90.00th=[742392], 95.00th=[742392], | 99.00th=[742392], 99.50th=[742392], 99.90th=[742392], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 2043, max= 4063, per=78.40%, avg=3281.00, stdev=1084.46, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1853KiB/s (1898kB/s)(6144KiB/3315msec); 0 zone resets clat (msec): min=123, max=741, avg=347.19, stdev=234.33 lat (msec): min=123, max=741, avg=347.25, stdev=234.34 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 317], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1815, max= 3737, per=39.79%, avg=2331.40, stdev=791.51, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 20=8.33%, 250=33.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=14.82%, ctx=170, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145760: Tue Aug 25 19:41:35 2026 read: IOPS=1, BW=1501KiB/s (1537kB/s)(5120KiB/3411msec) clat (usec): min=521, max=233076, avg=116939.01, stdev=115569.29 lat (usec): min=522, max=233077, avg=116940.35, stdev=115569.22 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 1156], 40.00th=[ 1156], 50.00th=[119014], 60.00th=[119014], | 70.00th=[231736], 80.00th=[231736], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 2043, max= 5605, per=91.37%, avg=3824.00, stdev=2518.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2101KiB/s (2152kB/s)(7168KiB/3411msec); 0 zone resets clat (msec): min=105, max=682, avg=401.86, stdev=245.25 lat (msec): min=105, max=682, avg=401.92, stdev=245.25 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 201], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 317], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 676], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1841, max= 2043, per=33.54%, avg=1965.20, stdev=101.54, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=8.33%, 750=25.00% cpu : usr=0.06%, sys=14.08%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4186KiB/s (4286kB/s), 419KiB/s-2675KiB/s (429kB/s-2739kB/s), io=20.0MiB (20.0MB), run=2680-4893msec WRITE: bw=5860KiB/s (6000kB/s), 1853KiB/s-2101KiB/s (1898kB/s-2152kB/s), io=28.0MiB (29.4MB), run=2680-4893msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145767: Tue Aug 25 19:41:48 2026 read: IOPS=1, BW=5044KiB/s (5165kB/s)(12.0MiB/2436msec) clat (msec): min=736, max=860, avg=786.99, stdev=65.03 lat (msec): min=736, max=860, avg=786.99, stdev=65.03 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=17.04%, ctx=444, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145768: Tue Aug 25 19:41:48 2026 read: IOPS=0, BW=1740KiB/s (1782kB/s)(4096KiB/2354msec) clat (nsec): min=779818k, max=779818k, avg=779817616.00, stdev= 0.00 lat (nsec): min=779819k, max=779819k, avg=779818846.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3480KiB/s (3564kB/s)(8192KiB/2354msec); 0 zone resets clat (msec): min=610, max=878, avg=744.43, stdev=189.90 lat (msec): min=610, max=879, avg=744.86, stdev=190.08 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8143, max= 8143, per=86.39%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=11.39%, ctx=194, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145769: Tue Aug 25 19:41:48 2026 write: IOPS=0, BW=3535KiB/s (3620kB/s)(12.0MiB/3476msec); 0 zone resets clat (msec): min=430, max=2394, avg=1139.74, stdev=1089.68 lat (msec): min=431, max=2395, avg=1140.64, stdev=1089.41 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8110, max= 8175, per=86.38%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=3.86%, ctx=63, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145770: Tue Aug 25 19:41:48 2026 write: IOPS=1, BW=4322KiB/s (4426kB/s)(12.0MiB/2843msec); 0 zone resets clat (msec): min=368, max=1669, avg=894.24, stdev=685.43 lat (msec): min=368, max=1669, avg=894.68, stdev=685.42 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8143, max= 8143, per=86.39%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.63%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6726KiB/s (6887kB/s), 1740KiB/s-5044KiB/s (1782kB/s-5165kB/s), io=16.0MiB (16.8MB), run=2354-2436msec WRITE: bw=9427KiB/s (9653kB/s), 3480KiB/s-4322KiB/s (3564kB/s-4426kB/s), io=32.0MiB (33.6MB), run=2354-3476msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145771: Tue Aug 25 19:41:48 2026 read: IOPS=1, BW=4364KiB/s (4468kB/s)(12.0MiB/2816msec) clat (msec): min=498, max=1408, avg=924.42, stdev=457.85 lat (msec): min=498, max=1408, avg=924.42, stdev=457.85 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7876, max= 8126, per=100.00%, avg=8001.00, stdev=176.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.69%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145772: Tue Aug 25 19:41:48 2026 read: IOPS=0, BW=1380KiB/s (1413kB/s)(4096KiB/2969msec) clat (nsec): min=755455k, max=755455k, avg=755454577.00, stdev= 0.00 lat (nsec): min=755461k, max=755461k, avg=755461039.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2759KiB/s (2825kB/s)(8192KiB/2969msec); 0 zone resets clat (msec): min=577, max=1615, avg=1096.24, stdev=734.07 lat (msec): min=577, max=1615, avg=1096.57, stdev=734.09 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7876, max= 7876, per=83.26%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.53%, ctx=91, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145773: Tue Aug 25 19:41:48 2026 write: IOPS=0, BW=3547KiB/s (3632kB/s)(12.0MiB/3464msec); 0 zone resets clat (msec): min=266, max=2614, avg=1145.97, stdev=1280.31 lat (msec): min=267, max=2615, avg=1146.47, stdev=1280.50 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 8078, max= 8078, per=85.40%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.55%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145774: Tue Aug 25 19:41:48 2026 write: IOPS=0, BW=4014KiB/s (4111kB/s)(12.0MiB/3061msec); 0 zone resets clat (msec): min=771, max=1366, avg=989.08, stdev=327.92 lat (msec): min=771, max=1366, avg=989.86, stdev=327.61 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8126, max= 8143, per=86.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.73%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5518KiB/s (5651kB/s), 1380KiB/s-4364KiB/s (1413kB/s-4468kB/s), io=16.0MiB (16.8MB), run=2816-2969msec WRITE: bw=9460KiB/s (9687kB/s), 2759KiB/s-4014KiB/s (2825kB/s-4111kB/s), io=32.0MiB (33.6MB), run=2969-3464msec