== sanity test 398b: DIO and buffer IO race ============== 13:46:21 (1788543981) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.3075 s, 9.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145753: Fri Sep 4 13:48:43 2026 read: IOPS=12, BW=48.1KiB/s (49.3kB/s)(5992KiB/124496msec) clat (usec): min=33, max=319782, avg=39065.59, stdev=30168.54 lat (usec): min=34, max=319783, avg=39068.51, stdev=30168.99 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 99], 20.00th=[ 18482], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 32900], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[137364], 99.50th=[173016], 99.90th=[252707], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 119, per=25.28%, avg=47.78, stdev=20.69, samples=245 iops : min= 1, max= 29, avg=11.31, stdev= 5.20, samples=245 write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6296KiB/124496msec); 0 zone resets clat (usec): min=872, max=684120, avg=41665.01, stdev=44373.87 lat (usec): min=873, max=684121, avg=41666.75, stdev=44374.13 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1729], 20.00th=[ 3916], | 30.00th=[ 8848], 40.00th=[ 19530], 50.00th=[ 31589], 60.00th=[ 41681], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[117965], | 99.00th=[175113], 99.50th=[198181], 99.90th=[316670], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 111, per=25.47%, avg=50.42, stdev=20.57, samples=244 iops : min= 1, max= 27, avg=11.96, stdev= 5.19, samples=244 lat (usec) : 50=0.65%, 100=4.26%, 250=0.62%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.39% lat (msec) : 2=5.60%, 4=4.59%, 10=6.38%, 20=9.15%, 50=37.04% lat (msec) : 100=25.00%, 250=6.05%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.31%, ctx=6477, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145754: Fri Sep 4 13:48:43 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(5940KiB/123771msec) clat (usec): min=32, max=515304, avg=39675.11, stdev=31602.39 lat (usec): min=32, max=515306, avg=39681.57, stdev=31605.84 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 83], 20.00th=[ 18220], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[120062], 99.50th=[152044], 99.90th=[291505], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 7, max= 103, per=25.23%, avg=47.68, stdev=19.73, samples=242 iops : min= 1, max= 25, avg=11.28, stdev= 4.97, samples=242 write: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6348KiB/123771msec); 0 zone resets clat (usec): min=897, max=679836, avg=40580.81, stdev=46889.33 lat (usec): min=898, max=679839, avg=40585.55, stdev=46889.32 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1631], 20.00th=[ 4015], | 30.00th=[ 8029], 40.00th=[ 16909], 50.00th=[ 28967], 60.00th=[ 39584], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[183501], 99.50th=[227541], 99.90th=[522191], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 127, per=25.50%, avg=50.49, stdev=18.75, samples=244 iops : min= 1, max= 31, avg=11.99, stdev= 4.71, samples=244 lat (usec) : 50=0.55%, 100=4.69%, 250=0.52%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.25%, 4=3.91%, 10=7.26%, 20=9.57%, 50=35.51% lat (msec) : 100=25.23%, 250=5.89%, 500=0.16%, 750=0.10% cpu : usr=0.07%, sys=5.47%, ctx=6505, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145755: Fri Sep 4 13:48:43 2026 read: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6028KiB/126592msec) clat (usec): min=30, max=293402, avg=38900.76, stdev=31250.76 lat (usec): min=30, max=293403, avg=38903.05, stdev=31250.64 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 71], 20.00th=[ 16712], | 30.00th=[ 21890], 40.00th=[ 26870], 50.00th=[ 32900], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 89654], | 99.00th=[130548], 99.50th=[196084], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 117, per=25.34%, avg=47.89, stdev=21.31, samples=246 iops : min= 1, max= 29, avg=11.33, stdev= 5.35, samples=246 write: IOPS=12, BW=49.5KiB/s (50.6kB/s)(6260KiB/126592msec); 0 zone resets clat (usec): min=896, max=871755, avg=43147.47, stdev=50833.22 lat (usec): min=897, max=871757, avg=43152.81, stdev=50839.79 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1582], 20.00th=[ 4228], | 30.00th=[ 8848], 40.00th=[ 20055], 50.00th=[ 31327], 60.00th=[ 43254], | 70.00th=[ 56361], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[126354], | 99.00th=[200279], 99.50th=[242222], 99.90th=[566232], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 141, per=25.06%, avg=49.63, stdev=20.49, samples=246 iops : min= 1, max= 35, avg=11.78, stdev= 5.19, samples=246 lat (usec) : 50=0.85%, 100=5.24%, 250=0.39%, 500=0.23%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=6.18%, 4=3.55%, 10=6.58%, 20=9.70%, 50=35.25% lat (msec) : 100=25.36%, 250=6.18%, 500=0.23%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.33%, ctx=6545, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145756: Fri Sep 4 13:48:43 2026 read: IOPS=12, BW=48.0KiB/s (50.2kB/s)(6052KiB/123558msec) clat (usec): min=31, max=708845, avg=39142.28, stdev=36516.48 lat (usec): min=31, max=708848, avg=39146.22, stdev=36516.70 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 92], 20.00th=[ 17957], | 30.00th=[ 22938], 40.00th=[ 27132], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 58983], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[129500], 99.50th=[187696], 99.90th=[522191], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 119, per=25.87%, avg=48.89, stdev=21.18, samples=242 iops : min= 1, max= 29, avg=11.57, stdev= 5.32, samples=242 write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6236KiB/123558msec); 0 zone resets clat (usec): min=937, max=481345, avg=40989.80, stdev=42594.06 lat (usec): min=938, max=481347, avg=40992.88, stdev=42593.56 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1663], 20.00th=[ 3851], | 30.00th=[ 7832], 40.00th=[ 18220], 50.00th=[ 30540], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[175113], 99.50th=[202376], 99.90th=[333448], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 142, per=25.33%, avg=50.15, stdev=20.31, samples=243 iops : min= 1, max= 35, avg=11.90, stdev= 5.11, samples=243 lat (usec) : 50=1.07%, 100=4.10%, 250=0.59%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.02%, 4=4.56%, 10=6.58%, 20=9.51%, 50=36.95% lat (msec) : 100=24.22%, 250=5.89%, 500=0.13%, 750=0.07% cpu : usr=0.09%, sys=5.12%, ctx=6392, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (194kB/s), 47.6KiB/s-48.0KiB/s (48.8kB/s-50.2kB/s), io=23.4MiB (24.6MB), run=123558-126592msec WRITE: bw=199KiB/s (203kB/s), 49.5KiB/s-51.3KiB/s (50.6kB/s-52.5kB/s), io=24.6MiB (25.7MB), run=123558-126592msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145757: Fri Sep 4 13:50:58 2026 read: IOPS=5, BW=22.0KiB/s (23.5kB/s)(5992KiB/260598msec) clat (msec): min=5, max=985, avg=37.35, stdev=43.51 lat (msec): min=5, max=985, avg=37.36, stdev=43.51 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 74], 95.00th=[ 100], | 99.00th=[ 180], 99.50th=[ 255], 99.90th=[ 451], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 103, per=27.83%, avg=25.33, stdev=17.40, samples=458 iops : min= 1, max= 25, avg= 5.72, stdev= 4.38, samples=458 write: IOPS=6, BW=24.2KiB/s (24.7kB/s)(6296KiB/260598msec); 0 zone resets clat (msec): min=36, max=619, avg=129.83, stdev=64.03 lat (msec): min=36, max=619, avg=129.83, stdev=64.03 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 113], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 257], | 99.00th=[ 338], 99.50th=[ 397], 99.90th=[ 514], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 55, per=24.77%, avg=23.78, stdev=10.87, samples=511 iops : min= 1, max= 13, avg= 5.33, stdev= 2.77, samples=511 lat (msec) : 10=2.93%, 20=13.77%, 50=22.56%, 100=27.67%, 250=29.95% lat (msec) : 500=3.03%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=5383, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145758: Fri Sep 4 13:50:58 2026 read: IOPS=5, BW=22.7KiB/s (23.3kB/s)(5940KiB/261226msec) clat (msec): min=5, max=656, avg=37.30, stdev=35.18 lat (msec): min=5, max=656, avg=37.30, stdev=35.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 100], | 99.00th=[ 153], 99.50th=[ 184], 99.90th=[ 363], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 80, per=28.42%, avg=25.86, stdev=16.43, samples=444 iops : min= 1, max= 20, avg= 5.85, stdev= 4.15, samples=444 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6348KiB/261226msec); 0 zone resets clat (msec): min=31, max=488, avg=129.47, stdev=64.08 lat (msec): min=31, max=488, avg=129.47, stdev=64.08 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 110], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 178], 90.00th=[ 222], 95.00th=[ 262], | 99.00th=[ 334], 99.50th=[ 401], 99.90th=[ 485], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 56, per=25.12%, avg=24.11, stdev=11.29, samples=508 iops : min= 1, max= 14, avg= 5.41, stdev= 2.89, samples=508 lat (msec) : 10=2.28%, 20=13.51%, 50=23.34%, 100=28.22%, 250=29.39% lat (msec) : 500=3.22%, 750=0.03% cpu : usr=0.05%, sys=1.28%, ctx=5578, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145759: Fri Sep 4 13:50:58 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(6028KiB/257837msec) clat (msec): min=5, max=454, avg=36.73, stdev=33.60 lat (msec): min=5, max=454, avg=36.73, stdev=33.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 74], 95.00th=[ 99], | 99.00th=[ 153], 99.50th=[ 232], 99.90th=[ 368], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 95, per=27.86%, avg=25.35, stdev=16.61, samples=460 iops : min= 1, max= 23, avg= 5.73, stdev= 4.17, samples=460 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6260KiB/257837msec); 0 zone resets clat (msec): min=40, max=873, avg=129.21, stdev=68.18 lat (msec): min=40, max=873, avg=129.21, stdev=68.18 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 110], 60.00th=[ 124], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 257], | 99.00th=[ 347], 99.50th=[ 380], 99.90th=[ 617], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 48, per=24.94%, avg=23.94, stdev=11.33, samples=504 iops : min= 1, max= 12, avg= 5.37, stdev= 2.90, samples=504 lat (msec) : 10=2.15%, 20=14.06%, 50=23.08%, 100=28.61%, 250=28.97% lat (msec) : 500=2.99%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5400, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145760: Fri Sep 4 13:50:58 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(6052KiB/259084msec) clat (msec): min=6, max=340, avg=36.62, stdev=32.70 lat (msec): min=6, max=340, avg=36.62, stdev=32.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 103], | 99.00th=[ 165], 99.50th=[ 192], 99.90th=[ 288], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 110, per=28.83%, avg=26.24, stdev=17.00, samples=447 iops : min= 1, max= 27, avg= 5.94, stdev= 4.31, samples=447 write: IOPS=6, BW=24.1KiB/s (24.6kB/s)(6236KiB/259084msec); 0 zone resets clat (msec): min=38, max=708, avg=130.40, stdev=67.52 lat (msec): min=38, max=708, avg=130.40, stdev=67.52 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 125], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 222], 95.00th=[ 262], | 99.00th=[ 342], 99.50th=[ 405], 99.90th=[ 625], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 48, per=24.89%, avg=23.90, stdev=10.89, samples=504 iops : min= 1, max= 12, avg= 5.36, stdev= 2.79, samples=504 lat (msec) : 10=2.18%, 20=14.75%, 50=23.63%, 100=26.69%, 250=29.49% lat (msec) : 500=3.09%, 750=0.16% cpu : usr=0.05%, sys=1.29%, ctx=5515, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=91.9KiB/s (94.1kB/s), 22.7KiB/s-23.4KiB/s (23.3kB/s-23.9kB/s), io=23.4MiB (24.6MB), run=257837-261226msec WRITE: bw=96.2KiB/s (98.5kB/s), 24.1KiB/s-24.3KiB/s (24.6kB/s-24.9kB/s), io=24.6MiB (25.7MB), run=257837-261226msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145823: Fri Sep 4 13:51:35 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5920KiB/27881msec) clat (usec): min=35, max=213753, avg=38303.19, stdev=33881.25 lat (usec): min=35, max=213753, avg=38317.10, stdev=33884.67 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 70], | 30.00th=[ 19530], 40.00th=[ 29492], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[166724], 99.50th=[189793], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 63, max= 508, per=26.07%, avg=212.20, stdev=91.68, samples=54 iops : min= 3, max= 31, avg=12.54, stdev= 5.76, samples=54 write: IOPS=14, BW=228KiB/s (234kB/s)(6368KiB/27881msec); 0 zone resets clat (usec): min=1387, max=232134, avg=34199.15, stdev=39941.18 lat (usec): min=1388, max=232136, avg=34201.30, stdev=39941.28 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1631], 10.00th=[ 1991], 20.00th=[ 3818], | 30.00th=[ 6587], 40.00th=[ 9896], 50.00th=[ 16581], 60.00th=[ 30016], | 70.00th=[ 41681], 80.00th=[ 60031], 90.00th=[ 94897], 95.00th=[110625], | 99.00th=[181404], 99.50th=[217056], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 93, max= 512, per=26.81%, avg=229.78, stdev=92.68, samples=54 iops : min= 5, max= 32, avg=13.63, stdev= 5.87, samples=54 lat (usec) : 50=1.43%, 100=9.11%, 250=1.17%, 500=0.39%, 750=0.13% lat (msec) : 2=5.47%, 4=5.60%, 10=10.03%, 20=8.07%, 50=30.60% lat (msec) : 100=22.14%, 250=5.86% cpu : usr=0.08%, sys=5.32%, ctx=1439, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145825: Fri Sep 4 13:51:35 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5744KiB/29390msec) clat (usec): min=39, max=218861, avg=40345.89, stdev=33341.51 lat (usec): min=39, max=218862, avg=40346.96, stdev=33341.52 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 192], | 30.00th=[ 25297], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 63701], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[158335], 99.50th=[198181], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 29, max= 381, per=24.31%, avg=197.89, stdev=86.53, samples=56 iops : min= 1, max= 23, avg=11.63, stdev= 5.49, samples=56 write: IOPS=13, BW=223KiB/s (228kB/s)(6544KiB/29390msec); 0 zone resets clat (usec): min=1359, max=345069, avg=35703.81, stdev=42608.91 lat (usec): min=1361, max=345071, avg=35712.72, stdev=42605.05 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1631], 10.00th=[ 2474], 20.00th=[ 4686], | 30.00th=[ 7308], 40.00th=[ 10421], 50.00th=[ 20579], 60.00th=[ 30278], | 70.00th=[ 44303], 80.00th=[ 61604], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[187696], 99.50th=[206570], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 59, max= 411, per=25.83%, avg=221.35, stdev=86.44, samples=57 iops : min= 3, max= 25, avg=13.11, stdev= 5.48, samples=57 lat (usec) : 50=0.91%, 100=7.42%, 250=1.04%, 500=0.26%, 1000=0.26% lat (msec) : 2=4.17%, 4=5.73%, 10=11.20%, 20=7.29%, 50=32.94% lat (msec) : 100=22.40%, 250=6.25%, 500=0.13% cpu : usr=0.07%, sys=5.24%, ctx=1437, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145826: Fri Sep 4 13:51:35 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29098msec) clat (usec): min=37, max=245412, avg=40861.81, stdev=37364.97 lat (usec): min=37, max=245412, avg=40867.86, stdev=37367.42 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 103], | 30.00th=[ 22938], 40.00th=[ 30540], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[189793], 99.50th=[212861], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 59, max= 448, per=26.52%, avg=215.88, stdev=99.33, samples=57 iops : min= 3, max= 28, avg=12.75, stdev= 6.34, samples=57 write: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29098msec); 0 zone resets clat (usec): min=1417, max=186284, avg=34097.02, stdev=37004.84 lat (usec): min=1419, max=186285, avg=34098.97, stdev=37004.76 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 2212], 20.00th=[ 4146], | 30.00th=[ 6652], 40.00th=[ 11731], 50.00th=[ 20579], 60.00th=[ 30540], | 70.00th=[ 43254], 80.00th=[ 60556], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[162530], 99.50th=[170918], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 60, max= 570, per=23.94%, avg=205.19, stdev=91.47, samples=57 iops : min= 3, max= 35, avg=12.07, stdev= 5.79, samples=57 lat (usec) : 50=1.43%, 100=8.72%, 250=1.17%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=4.04%, 4=5.60%, 10=8.72%, 20=7.94%, 50=32.16% lat (msec) : 100=23.31%, 250=6.38% cpu : usr=0.08%, sys=5.38%, ctx=1466, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145828: Fri Sep 4 13:51:35 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(6032KiB/29031msec) clat (usec): min=36, max=240366, avg=39893.54, stdev=37630.24 lat (usec): min=36, max=240367, avg=39929.81, stdev=37661.85 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 83], | 30.00th=[ 21627], 40.00th=[ 30016], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 53216], 80.00th=[ 63701], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[206570], 99.50th=[231736], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 91, max= 508, per=25.82%, avg=210.14, stdev=84.49, samples=56 iops : min= 5, max= 31, avg=12.39, stdev= 5.33, samples=56 write: IOPS=13, BW=215KiB/s (221kB/s)(6256KiB/29031msec); 0 zone resets clat (usec): min=1348, max=206130, avg=34784.94, stdev=38436.83 lat (usec): min=1350, max=206133, avg=34787.18, stdev=38436.66 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1713], 10.00th=[ 2180], 20.00th=[ 4883], | 30.00th=[ 7111], 40.00th=[ 10290], 50.00th=[ 18744], 60.00th=[ 31327], | 70.00th=[ 45876], 80.00th=[ 63701], 90.00th=[ 89654], 95.00th=[117965], | 99.00th=[154141], 99.50th=[177210], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 29, max= 447, per=25.09%, avg=214.98, stdev=90.51, samples=57 iops : min= 1, max= 27, avg=12.70, stdev= 5.75, samples=57 lat (usec) : 50=1.04%, 100=9.51%, 250=1.43%, 500=0.26%, 750=0.13% lat (msec) : 2=5.08%, 4=3.65%, 10=12.11%, 20=7.03%, 50=29.56% lat (msec) : 100=23.83%, 250=6.38% cpu : usr=0.04%, sys=5.02%, ctx=1351, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=815KiB/s (835kB/s), 195KiB/s-215KiB/s (200kB/s-220kB/s), io=23.4MiB (24.5MB), run=27881-29390msec WRITE: bw=857KiB/s (878kB/s), 207KiB/s-228KiB/s (212kB/s-234kB/s), io=24.6MiB (25.8MB), run=27881-29390msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145821: Fri Sep 4 13:52:11 2026 read: IOPS=5, BW=92.2KiB/s (94.4kB/s)(5920KiB/64227msec) clat (msec): min=6, max=272, avg=37.38, stdev=36.37 lat (msec): min=6, max=272, avg=37.38, stdev=36.37 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 73], 95.00th=[ 103], | 99.00th=[ 207], 99.50th=[ 259], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 320, per=28.35%, avg=104.88, stdev=60.01, samples=111 iops : min= 1, max= 20, avg= 5.82, stdev= 3.85, samples=111 write: IOPS=6, BW=99.1KiB/s (102kB/s)(6368KiB/64227msec); 0 zone resets clat (msec): min=36, max=457, avg=126.10, stdev=71.48 lat (msec): min=36, max=457, avg=126.10, stdev=71.48 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 71], | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 103], 60.00th=[ 115], | 70.00th=[ 138], 80.00th=[ 174], 90.00th=[ 222], 95.00th=[ 284], | 99.00th=[ 380], 99.50th=[ 409], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 28, max= 223, per=25.43%, avg=98.94, stdev=51.10, samples=127 iops : min= 1, max= 13, avg= 5.43, stdev= 3.27, samples=127 lat (msec) : 10=1.69%, 20=14.58%, 50=23.18%, 100=30.99%, 250=25.78% lat (msec) : 500=3.78% cpu : usr=0.04%, sys=1.51%, ctx=1455, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145822: Fri Sep 4 13:52:11 2026 read: IOPS=5, BW=88.8KiB/s (90.9kB/s)(5744KiB/64685msec) clat (msec): min=6, max=221, avg=40.17, stdev=38.15 lat (msec): min=6, max=221, avg=40.17, stdev=38.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 57], 90.00th=[ 97], 95.00th=[ 126], | 99.00th=[ 182], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 29, max= 320, per=28.19%, avg=104.30, stdev=67.17, samples=109 iops : min= 1, max= 20, avg= 5.78, stdev= 4.27, samples=109 write: IOPS=6, BW=101KiB/s (104kB/s)(6544KiB/64685msec); 0 zone resets clat (msec): min=43, max=444, avg=122.22, stdev=64.82 lat (msec): min=43, max=444, avg=122.23, stdev=64.82 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 83], 40.00th=[ 90], 50.00th=[ 101], 60.00th=[ 113], | 70.00th=[ 132], 80.00th=[ 161], 90.00th=[ 220], 95.00th=[ 266], | 99.00th=[ 334], 99.50th=[ 351], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 30, max= 224, per=26.56%, avg=103.30, stdev=49.21, samples=125 iops : min= 1, max= 14, avg= 5.70, stdev= 3.15, samples=125 lat (msec) : 10=1.56%, 20=14.84%, 50=20.31%, 100=32.29%, 250=27.73% lat (msec) : 500=3.26% cpu : usr=0.05%, sys=1.37%, ctx=1428, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145824: Fri Sep 4 13:52:11 2026 read: IOPS=6, BW=99.4KiB/s (102kB/s)(6256KiB/62913msec) clat (msec): min=5, max=283, avg=37.06, stdev=39.95 lat (msec): min=5, max=283, avg=37.06, stdev=39.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 122], | 99.00th=[ 228], 99.50th=[ 253], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 446, per=29.61%, avg=109.56, stdev=78.66, samples=113 iops : min= 1, max= 27, avg= 6.10, stdev= 4.96, samples=113 write: IOPS=5, BW=95.9KiB/s (98.2kB/s)(6032KiB/62913msec); 0 zone resets clat (msec): min=41, max=438, avg=128.24, stdev=75.09 lat (msec): min=41, max=438, avg=128.25, stdev=75.09 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 66], 20.00th=[ 74], | 30.00th=[ 87], 40.00th=[ 95], 50.00th=[ 105], 60.00th=[ 118], | 70.00th=[ 131], 80.00th=[ 159], 90.00th=[ 251], 95.00th=[ 305], | 99.00th=[ 401], 99.50th=[ 430], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 30, max= 192, per=24.87%, avg=96.73, stdev=47.76, samples=122 iops : min= 1, max= 12, avg= 5.29, stdev= 3.07, samples=122 lat (msec) : 10=2.47%, 20=17.97%, 50=22.53%, 100=26.95%, 250=24.87% lat (msec) : 500=5.21% cpu : usr=0.04%, sys=1.41%, ctx=1389, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145827: Fri Sep 4 13:52:11 2026 read: IOPS=5, BW=93.3KiB/s (95.5kB/s)(6032KiB/64670msec) clat (msec): min=6, max=303, avg=39.10, stdev=41.77 lat (msec): min=6, max=303, avg=39.10, stdev=41.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 86], 95.00th=[ 123], | 99.00th=[ 226], 99.50th=[ 251], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 383, per=28.75%, avg=106.36, stdev=68.47, samples=111 iops : min= 1, max= 23, avg= 5.92, stdev= 4.36, samples=111 write: IOPS=6, BW=96.7KiB/s (99.1kB/s)(6256KiB/64670msec); 0 zone resets clat (msec): min=33, max=526, avg=126.88, stdev=74.80 lat (msec): min=33, max=526, avg=126.88, stdev=74.80 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 85], 40.00th=[ 92], 50.00th=[ 102], 60.00th=[ 115], | 70.00th=[ 129], 80.00th=[ 155], 90.00th=[ 228], 95.00th=[ 309], | 99.00th=[ 401], 99.50th=[ 443], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 29, max= 192, per=25.88%, avg=100.67, stdev=48.75, samples=123 iops : min= 1, max= 12, avg= 5.53, stdev= 3.13, samples=123 lat (msec) : 10=2.47%, 20=16.15%, 50=21.35%, 100=29.30%, 250=26.17% lat (msec) : 500=4.43%, 750=0.13% cpu : usr=0.04%, sys=1.44%, ctx=1388, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=370KiB/s (379kB/s), 88.8KiB/s-99.4KiB/s (90.9kB/s-102kB/s), io=23.4MiB (24.5MB), run=62913-64685msec WRITE: bw=390KiB/s (399kB/s), 95.9KiB/s-101KiB/s (98.2kB/s-104kB/s), io=24.6MiB (25.8MB), run=62913-64685msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145845: Fri Sep 4 13:52:27 2026 read: IOPS=1, BW=1769KiB/s (1811kB/s)(7168KiB/4053msec) clat (msec): min=207, max=372, avg=315.98, stdev=63.96 lat (msec): min=207, max=372, avg=315.98, stdev=63.96 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 251], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 351], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 363], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1675, max= 4055, per=76.92%, avg=2361.40, stdev=958.96, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1263KiB/s (1294kB/s)(5120KiB/4053msec); 0 zone resets clat (msec): min=171, max=464, avg=339.28, stdev=122.84 lat (msec): min=171, max=464, avg=339.35, stdev=122.84 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1996, max= 2043, per=46.95%, avg=2018.25, stdev=22.38, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=16.67%, 500=83.33% cpu : usr=0.02%, sys=11.70%, ctx=188, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145846: Fri Sep 4 13:52:27 2026 read: IOPS=0, BW=307KiB/s (314kB/s)(2048KiB/6669msec) clat (usec): min=597, max=396601, avg=198599.15, stdev=280016.96 lat (usec): min=598, max=396603, avg=198601.08, stdev=280018.16 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 594], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 594], 60.00th=[396362], | 70.00th=[396362], 80.00th=[396362], 90.00th=[396362], 95.00th=[396362], | 99.00th=[396362], 99.50th=[396362], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 1835, max= 2019, per=62.77%, avg=1927.00, stdev=130.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1535KiB/s (1572kB/s)(10.0MiB/6669msec); 0 zone resets clat (msec): min=198, max=1302, avg=611.82, stdev=359.53 lat (msec): min=198, max=1302, avg=612.76, stdev=358.98 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 228], | 30.00th=[ 384], 40.00th=[ 405], 50.00th=[ 422], 60.00th=[ 600], | 70.00th=[ 684], 80.00th=[ 902], 90.00th=[ 995], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 2003, max= 4039, per=60.11%, avg=2584.00, stdev=960.01, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=8.37%, ctx=120, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145847: Fri Sep 4 13:52:27 2026 read: IOPS=1, BW=1146KiB/s (1174kB/s)(6144KiB/5360msec) clat (usec): min=480, max=605276, avg=294044.37, stdev=258928.30 lat (usec): min=481, max=605277, avg=294045.32, stdev=258928.28 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[291505], 50.00th=[291505], 60.00th=[316670], | 70.00th=[549454], 80.00th=[549454], 90.00th=[608175], 95.00th=[608175], | 99.00th=[608175], 99.50th=[608175], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 1980, max= 3992, per=81.58%, avg=2504.50, stdev=992.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1146KiB/s (1174kB/s)(6144KiB/5360msec); 0 zone resets clat (msec): min=220, max=1329, avg=590.37, stdev=456.44 lat (msec): min=220, max=1329, avg=590.43, stdev=456.43 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1560, max= 2043, per=45.10%, avg=1938.67, stdev=186.75, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.96%, ctx=141, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145848: Fri Sep 4 13:52:27 2026 read: IOPS=1, BW=1075KiB/s (1101kB/s)(5120KiB/4762msec) clat (usec): min=1942, max=594780, avg=329760.00, stdev=211669.70 lat (usec): min=1944, max=594781, avg=329761.46, stdev=211669.67 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 1942], 10.00th=[ 1942], 20.00th=[ 1942], | 30.00th=[341836], 40.00th=[341836], 50.00th=[354419], 60.00th=[354419], | 70.00th=[358613], 80.00th=[358613], 90.00th=[591397], 95.00th=[591397], | 99.00th=[591397], 99.50th=[591397], 99.90th=[591397], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 2003, max= 3992, per=87.27%, avg=2679.33, stdev=1136.98, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1505KiB/s (1541kB/s)(7168KiB/4762msec); 0 zone resets clat (msec): min=175, max=814, avg=428.92, stdev=234.10 lat (msec): min=176, max=814, avg=429.47, stdev=234.01 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 245], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 351], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 667], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1738, max= 4063, per=64.53%, avg=2774.00, stdev=1157.53, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 2=8.33%, 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=10.23%, ctx=170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3071KiB/s (3145kB/s), 307KiB/s-1769KiB/s (314kB/s-1811kB/s), io=20.0MiB (20.0MB), run=4053-6669msec WRITE: bw=4299KiB/s (4402kB/s), 1146KiB/s-1535KiB/s (1174kB/s-1572kB/s), io=28.0MiB (29.4MB), run=4053-6669msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145849: Fri Sep 4 13:52:27 2026 read: IOPS=1, BW=1238KiB/s (1267kB/s)(7168KiB/5792msec) clat (msec): min=184, max=909, avg=429.20, stdev=247.87 lat (msec): min=184, max=909, avg=429.20, stdev=247.87 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 249], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 376], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 558], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1607, max= 2043, per=63.66%, avg=1948.50, stdev=168.49, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=884KiB/s (905kB/s)(5120KiB/5792msec); 0 zone resets clat (msec): min=225, max=835, avg=523.38, stdev=238.46 lat (msec): min=225, max=835, avg=523.49, stdev=238.41 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1921, max= 4000, per=58.25%, avg=2496.75, stdev=1003.59, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=16.67% cpu : usr=0.03%, sys=2.49%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145850: Fri Sep 4 13:52:27 2026 read: IOPS=0, BW=315KiB/s (323kB/s)(2048KiB/6495msec) clat (msec): min=138, max=425, avg=282.45, stdev=202.91 lat (msec): min=138, max=425, avg=282.45, stdev=202.91 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1539, max= 1921, per=56.52%, avg=1730.00, stdev=270.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1577KiB/s (1614kB/s)(10.0MiB/6495msec); 0 zone resets clat (msec): min=204, max=1044, avg=585.62, stdev=274.45 lat (msec): min=204, max=1045, avg=585.72, stdev=274.46 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 313], | 30.00th=[ 326], 40.00th=[ 447], 50.00th=[ 518], 60.00th=[ 575], | 70.00th=[ 793], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 2019, max= 4087, per=60.56%, avg=2595.43, stdev=971.66, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=25.00%, 2000=8.33% cpu : usr=0.00%, sys=2.06%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145851: Fri Sep 4 13:52:27 2026 read: IOPS=0, BW=990KiB/s (1014kB/s)(6144KiB/6203msec) clat (msec): min=154, max=572, avg=292.03, stdev=151.92 lat (msec): min=154, max=572, avg=292.03, stdev=151.92 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 292], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1921, max= 4047, per=81.47%, avg=2493.75, stdev=1036.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=990KiB/s (1014kB/s)(6144KiB/6203msec); 0 zone resets clat (msec): min=266, max=1905, avg=706.60, stdev=621.55 lat (msec): min=266, max=1905, avg=706.69, stdev=621.56 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 485], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 1984, max= 4039, per=56.41%, avg=2417.80, stdev=906.56, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.05%, sys=2.27%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145852: Fri Sep 4 13:52:27 2026 read: IOPS=0, BW=765KiB/s (784kB/s)(5120KiB/6689msec) clat (msec): min=76, max=435, avg=205.99, stdev=144.91 lat (msec): min=76, max=435, avg=205.99, stdev=144.91 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2023, max= 6071, per=100.00%, avg=4047.00, stdev=2862.37, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1072KiB/s (1097kB/s)(7168KiB/6689msec); 0 zone resets clat (msec): min=175, max=1760, avg=734.01, stdev=616.81 lat (msec): min=175, max=1760, avg=734.59, stdev=616.47 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 207], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 592], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 1418], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1921, max= 2043, per=46.51%, avg=1993.40, stdev=46.07, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=2.78%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3062KiB/s (3135kB/s), 315KiB/s-1238KiB/s (323kB/s-1267kB/s), io=20.0MiB (20.0MB), run=5792-6689msec WRITE: bw=4286KiB/s (4389kB/s), 884KiB/s-1577KiB/s (905kB/s-1614kB/s), io=28.0MiB (29.4MB), run=5792-6689msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145859: Fri Sep 4 13:52:42 2026 read: IOPS=0, BW=3832KiB/s (3924kB/s)(12.0MiB/3207msec) clat (msec): min=301, max=1590, avg=1042.92, stdev=666.22 lat (msec): min=301, max=1590, avg=1042.92, stdev=666.22 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7816, max= 8143, per=100.00%, avg=7979.50, stdev=231.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.65%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145860: Fri Sep 4 13:52:42 2026 read: IOPS=0, BW=2329KiB/s (2384kB/s)(4096KiB/1759msec) clat (nsec): min=270054k, max=270054k, avg=270053936.00, stdev= 0.00 lat (nsec): min=270056k, max=270056k, avg=270056218.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 6262, max= 6262, per=100.00%, avg=6262.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4657KiB/s (4769kB/s)(8192KiB/1759msec); 0 zone resets clat (msec): min=539, max=820, avg=680.23, stdev=198.36 lat (msec): min=543, max=820, avg=682.17, stdev=196.15 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7641, max= 7641, per=59.09%, avg=7641.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=4.95%, ctx=32, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145861: Fri Sep 4 13:52:42 2026 write: IOPS=1, BW=6350KiB/s (6503kB/s)(12.0MiB/1935msec); 0 zone resets clat (msec): min=423, max=706, avg=609.38, stdev=161.04 lat (msec): min=424, max=708, avg=610.16, stdev=161.30 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7641, max= 8094, per=60.84%, avg=7867.50, stdev=320.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=5.69%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145862: Fri Sep 4 13:52:42 2026 write: IOPS=1, BW=4849KiB/s (4966kB/s)(12.0MiB/2534msec); 0 zone resets clat (msec): min=415, max=1583, avg=807.09, stdev=672.71 lat (msec): min=416, max=1589, avg=809.22, stdev=675.78 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 6420, max= 7641, per=54.37%, avg=7030.50, stdev=863.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.24%, sys=5.13%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5109KiB/s (5231kB/s), 2329KiB/s-3832KiB/s (2384kB/s-3924kB/s), io=16.0MiB (16.8MB), run=1759-3207msec WRITE: bw=12.6MiB/s (13.2MB/s), 4657KiB/s-6350KiB/s (4769kB/s-6503kB/s), io=32.0MiB (33.6MB), run=1759-2534msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145864: Fri Sep 4 13:52:42 2026 read: IOPS=1, BW=5209KiB/s (5334kB/s)(12.0MiB/2359msec) clat (msec): min=574, max=902, avg=785.71, stdev=182.95 lat (msec): min=574, max=902, avg=785.71, stdev=182.95 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7861, max= 8094, per=100.00%, avg=7977.50, stdev=164.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.93%, ctx=256, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145865: Fri Sep 4 13:52:42 2026 read: IOPS=0, BW=1619KiB/s (1658kB/s)(4096KiB/2530msec) clat (nsec): min=767180k, max=767180k, avg=767179729.00, stdev= 0.00 lat (nsec): min=767182k, max=767182k, avg=767181822.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3238KiB/s (3316kB/s)(8192KiB/2530msec); 0 zone resets clat (msec): min=727, max=1033, avg=880.47, stdev=215.90 lat (msec): min=728, max=1033, avg=880.77, stdev=215.74 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7876, max= 7876, per=70.88%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.36%, sys=4.82%, ctx=147, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145866: Fri Sep 4 13:52:42 2026 write: IOPS=1, BW=4167KiB/s (4267kB/s)(12.0MiB/2949msec); 0 zone resets clat (msec): min=184, max=2079, avg=981.40, stdev=982.81 lat (msec): min=184, max=2080, avg=981.99, stdev=983.18 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 8126, max= 8126, per=73.13%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.27%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145867: Fri Sep 4 13:52:42 2026 write: IOPS=1, BW=5101KiB/s (5223kB/s)(12.0MiB/2409msec); 0 zone resets clat (msec): min=478, max=1217, avg=802.33, stdev=378.17 lat (msec): min=478, max=1218, avg=802.60, stdev=378.22 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 5527, max= 8126, per=61.44%, avg=6826.50, stdev=1837.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.85%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6476KiB/s (6631kB/s), 1619KiB/s-5209KiB/s (1658kB/s-5334kB/s), io=16.0MiB (16.8MB), run=2359-2530msec WRITE: bw=10.9MiB/s (11.4MB/s), 3238KiB/s-5101KiB/s (3316kB/s-5223kB/s), io=32.0MiB (33.6MB), run=2409-2949msec