== sanity test 398b: DIO and buffer IO race ============== 11:33:24 (1788363204) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.17144 s, 15.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147509: Wed Sep 2 11:34:36 2026 read: IOPS=24, BW=98.4KiB/s (101kB/s)(5992KiB/60885msec) clat (usec): min=31, max=653902, avg=20730.14, stdev=21388.74 lat (usec): min=31, max=653903, avg=20733.12, stdev=21389.46 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 104], 10.00th=[ 8586], 20.00th=[ 11338], | 30.00th=[ 13042], 40.00th=[ 15270], 50.00th=[ 17695], 60.00th=[ 20579], | 70.00th=[ 24511], 80.00th=[ 28967], 90.00th=[ 35914], 95.00th=[ 42730], | 99.00th=[ 63701], 99.50th=[ 87557], 99.90th=[162530], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 6, max= 168, per=25.26%, avg=98.25, stdev=27.11, samples=121 iops : min= 1, max= 42, avg=24.08, stdev= 6.82, samples=121 write: IOPS=25, BW=103KiB/s (106kB/s)(6296KiB/60885msec); 0 zone resets clat (usec): min=1031, max=170382, avg=18780.12, stdev=17411.33 lat (usec): min=1033, max=170384, avg=18784.63, stdev=17409.73 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1844], 10.00th=[ 2442], 20.00th=[ 3654], | 30.00th=[ 5604], 40.00th=[ 10159], 50.00th=[ 14877], 60.00th=[ 19268], | 70.00th=[ 24249], 80.00th=[ 31327], 90.00th=[ 41681], 95.00th=[ 51119], | 99.00th=[ 72877], 99.50th=[ 84411], 99.90th=[164627], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 40, max= 184, per=25.54%, avg=103.97, stdev=30.50, samples=120 iops : min= 10, max= 46, avg=25.53, stdev= 7.62, samples=120 lat (usec) : 50=0.26%, 100=2.05%, 250=1.17%, 500=0.16%, 750=0.07% lat (msec) : 2=3.03%, 4=8.46%, 10=12.27%, 20=32.91%, 50=35.55% lat (msec) : 100=3.81%, 250=0.23%, 750=0.03% cpu : usr=0.13%, sys=15.28%, ctx=7993, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147510: Wed Sep 2 11:34:36 2026 read: IOPS=24, BW=97.8KiB/s (100kB/s)(5940KiB/60760msec) clat (usec): min=38, max=156794, avg=19952.51, stdev=13415.95 lat (usec): min=39, max=156795, avg=19953.67, stdev=13415.73 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 109], 10.00th=[ 8291], 20.00th=[ 11076], | 30.00th=[ 13304], 40.00th=[ 15139], 50.00th=[ 17433], 60.00th=[ 20317], | 70.00th=[ 23725], 80.00th=[ 28181], 90.00th=[ 34866], 95.00th=[ 40633], | 99.00th=[ 61080], 99.50th=[ 84411], 99.90th=[126354], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 6, max= 160, per=25.03%, avg=97.35, stdev=27.31, samples=120 iops : min= 1, max= 40, avg=23.86, stdev= 6.82, samples=120 write: IOPS=26, BW=104KiB/s (107kB/s)(6348KiB/60760msec); 0 zone resets clat (usec): min=954, max=637339, avg=19453.64, stdev=24335.27 lat (usec): min=956, max=637340, avg=19455.77, stdev=24335.12 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1745], 10.00th=[ 2409], 20.00th=[ 3752], | 30.00th=[ 5932], 40.00th=[ 10945], 50.00th=[ 15139], 60.00th=[ 19006], | 70.00th=[ 23987], 80.00th=[ 31065], 90.00th=[ 40109], 95.00th=[ 50594], | 99.00th=[ 82314], 99.50th=[131597], 99.90th=[179307], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 39, max= 184, per=25.70%, avg=104.60, stdev=28.29, samples=119 iops : min= 9, max= 46, avg=25.67, stdev= 7.11, samples=119 lat (usec) : 50=0.26%, 100=1.92%, 250=1.27%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=3.35%, 4=7.71%, 10=11.82%, 20=33.92%, 50=35.64% lat (msec) : 100=3.39%, 250=0.42%, 750=0.03% cpu : usr=0.15%, sys=15.17%, ctx=7779, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147511: Wed Sep 2 11:34:36 2026 read: IOPS=24, BW=98.6KiB/s (101kB/s)(6028KiB/61151msec) clat (usec): min=31, max=151629, avg=19599.80, stdev=13685.56 lat (usec): min=32, max=151630, avg=19601.95, stdev=13685.59 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 104], 10.00th=[ 8029], 20.00th=[ 10814], | 30.00th=[ 12518], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19792], | 70.00th=[ 22938], 80.00th=[ 27657], 90.00th=[ 34866], 95.00th=[ 40633], | 99.00th=[ 66847], 99.50th=[ 86508], 99.90th=[137364], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 47, max= 160, per=25.40%, avg=98.80, stdev=28.46, samples=120 iops : min= 11, max= 40, avg=24.22, stdev= 7.16, samples=120 write: IOPS=25, BW=102KiB/s (105kB/s)(6260KiB/61151msec); 0 zone resets clat (usec): min=842, max=655882, avg=20031.43, stdev=24979.14 lat (usec): min=843, max=655883, avg=20036.33, stdev=24978.40 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1729], 10.00th=[ 2474], 20.00th=[ 3589], | 30.00th=[ 6063], 40.00th=[ 10945], 50.00th=[ 15270], 60.00th=[ 19792], | 70.00th=[ 24773], 80.00th=[ 31589], 90.00th=[ 42206], 95.00th=[ 52167], | 99.00th=[ 87557], 99.50th=[101188], 99.90th=[204473], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 13, max= 176, per=24.92%, avg=101.40, stdev=29.24, samples=121 iops : min= 3, max= 44, avg=24.88, stdev= 7.30, samples=121 lat (usec) : 50=0.36%, 100=1.95%, 250=1.17%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=3.58%, 4=7.78%, 10=12.24%, 20=33.14%, 50=35.38% lat (msec) : 100=3.65%, 250=0.46%, 750=0.03% cpu : usr=0.13%, sys=15.14%, ctx=7866, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147512: Wed Sep 2 11:34:36 2026 read: IOPS=24, BW=98.1KiB/s (100kB/s)(6052KiB/61699msec) clat (usec): min=31, max=155667, avg=19962.76, stdev=13922.46 lat (usec): min=31, max=155668, avg=19964.10, stdev=13922.41 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 110], 10.00th=[ 8160], 20.00th=[ 10945], | 30.00th=[ 12780], 40.00th=[ 15008], 50.00th=[ 17433], 60.00th=[ 20317], | 70.00th=[ 23987], 80.00th=[ 27657], 90.00th=[ 34866], 95.00th=[ 40633], | 99.00th=[ 66323], 99.50th=[ 88605], 99.90th=[137364], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 39, max= 175, per=25.31%, avg=98.47, stdev=25.85, samples=120 iops : min= 9, max= 43, avg=24.14, stdev= 6.53, samples=120 write: IOPS=25, BW=101KiB/s (103kB/s)(6236KiB/61699msec); 0 zone resets clat (usec): min=788, max=699671, avg=20032.24, stdev=24883.25 lat (usec): min=789, max=699674, avg=20035.49, stdev=24883.71 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1745], 10.00th=[ 2474], 20.00th=[ 3851], | 30.00th=[ 6325], 40.00th=[ 11338], 50.00th=[ 15401], 60.00th=[ 20579], | 70.00th=[ 26084], 80.00th=[ 32375], 90.00th=[ 41157], 95.00th=[ 52167], | 99.00th=[ 76022], 99.50th=[ 99091], 99.90th=[229639], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 23, max= 192, per=24.82%, avg=101.02, stdev=30.23, samples=121 iops : min= 5, max= 48, avg=24.78, stdev= 7.53, samples=121 lat (usec) : 50=0.33%, 100=1.76%, 250=1.14%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=3.52%, 4=7.13%, 10=12.53%, 20=32.29%, 50=37.04% lat (msec) : 100=3.58%, 250=0.39%, 750=0.03% cpu : usr=0.12%, sys=15.00%, ctx=8024, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=389KiB/s (399kB/s), 97.8KiB/s-98.6KiB/s (100kB/s-101kB/s), io=23.4MiB (24.6MB), run=60760-61699msec WRITE: bw=407KiB/s (417kB/s), 101KiB/s-104KiB/s (103kB/s-107kB/s), io=24.6MiB (25.7MB), run=60760-61699msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147514: Wed Sep 2 11:35:34 2026 read: IOPS=12, BW=50.3KiB/s (51.5kB/s)(5992KiB/119113msec) clat (msec): min=3, max=662, avg=17.22, stdev=23.36 lat (msec): min=3, max=662, avg=17.22, stdev=23.36 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 50], | 99.00th=[ 87], 99.50th=[ 112], 99.90th=[ 184], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 143, per=25.26%, avg=50.53, stdev=29.56, samples=234 iops : min= 1, max= 35, avg=12.15, stdev= 7.45, samples=234 write: IOPS=13, BW=52.9KiB/s (54.1kB/s)(6296KiB/119113msec); 0 zone resets clat (msec): min=20, max=265, avg=59.16, stdev=25.80 lat (msec): min=20, max=265, avg=59.16, stdev=25.80 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 60], | 70.00th=[ 67], 80.00th=[ 77], 90.00th=[ 92], 95.00th=[ 108], | 99.00th=[ 150], 99.50th=[ 169], 99.90th=[ 203], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 15, max= 96, per=25.05%, avg=52.61, stdev=20.63, samples=236 iops : min= 3, max= 24, avg=12.67, stdev= 5.23, samples=236 lat (msec) : 4=0.03%, 10=22.56%, 20=14.75%, 50=31.84%, 100=26.63% lat (msec) : 250=4.13%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.70%, ctx=5590, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147515: Wed Sep 2 11:35:34 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5940KiB/119505msec) clat (msec): min=3, max=646, avg=16.99, stdev=22.92 lat (msec): min=3, max=646, avg=16.99, stdev=22.92 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 37], 95.00th=[ 47], | 99.00th=[ 89], 99.50th=[ 108], 99.90th=[ 138], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 152, per=24.89%, avg=49.78, stdev=30.36, samples=234 iops : min= 1, max= 38, avg=11.97, stdev= 7.64, samples=234 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6348KiB/119505msec); 0 zone resets clat (msec): min=21, max=324, avg=59.27, stdev=26.13 lat (msec): min=21, max=324, avg=59.27, stdev=26.13 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 35], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 53], 60.00th=[ 59], | 70.00th=[ 67], 80.00th=[ 77], 90.00th=[ 93], 95.00th=[ 108], | 99.00th=[ 146], 99.50th=[ 165], 99.90th=[ 259], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 96, per=25.06%, avg=52.64, stdev=20.29, samples=236 iops : min= 1, max= 24, avg=12.68, stdev= 5.14, samples=236 lat (msec) : 4=0.03%, 10=23.05%, 20=14.32%, 50=32.06%, 100=26.79% lat (msec) : 250=3.65%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=3.74%, ctx=5637, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147516: Wed Sep 2 11:35:34 2026 read: IOPS=12, BW=50.8KiB/s (51.0kB/s)(6028KiB/118746msec) clat (msec): min=4, max=295, avg=17.31, stdev=19.16 lat (msec): min=4, max=295, avg=17.31, stdev=19.16 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 37], 95.00th=[ 51], | 99.00th=[ 83], 99.50th=[ 125], 99.90th=[ 234], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 152, per=25.29%, avg=50.58, stdev=28.35, samples=235 iops : min= 1, max= 38, avg=12.16, stdev= 7.14, samples=235 write: IOPS=13, BW=52.7KiB/s (53.0kB/s)(6260KiB/118746msec); 0 zone resets clat (msec): min=20, max=679, avg=59.07, stdev=29.58 lat (msec): min=20, max=679, avg=59.07, stdev=29.58 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 53], 60.00th=[ 58], | 70.00th=[ 67], 80.00th=[ 79], 90.00th=[ 93], 95.00th=[ 106], | 99.00th=[ 144], 99.50th=[ 165], 99.90th=[ 201], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 111, per=24.98%, avg=52.45, stdev=22.17, samples=235 iops : min= 1, max= 27, avg=12.63, stdev= 5.62, samples=235 lat (msec) : 10=22.53%, 20=15.27%, 50=32.03%, 100=26.07%, 250=4.04% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.70%, ctx=5584, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147517: Wed Sep 2 11:35:34 2026 read: IOPS=12, BW=51.4KiB/s (52.7kB/s)(6052KiB/117680msec) clat (msec): min=4, max=184, avg=16.22, stdev=15.96 lat (msec): min=4, max=184, avg=16.22, stdev=15.96 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 77], 99.50th=[ 99], 99.90th=[ 182], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 7, max= 144, per=25.61%, avg=51.23, stdev=29.17, samples=233 iops : min= 1, max= 36, avg=12.32, stdev= 7.36, samples=233 write: IOPS=13, BW=52.0KiB/s (54.3kB/s)(6236KiB/117680msec); 0 zone resets clat (msec): min=21, max=693, avg=59.60, stdev=30.88 lat (msec): min=21, max=693, avg=59.61, stdev=30.88 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 53], 60.00th=[ 59], | 70.00th=[ 67], 80.00th=[ 77], 90.00th=[ 93], 95.00th=[ 109], | 99.00th=[ 146], 99.50th=[ 163], 99.90th=[ 326], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 15, max= 103, per=25.11%, avg=52.73, stdev=20.57, samples=233 iops : min= 3, max= 25, avg=12.70, stdev= 5.20, samples=233 lat (msec) : 10=23.40%, 20=15.10%, 50=31.41%, 100=25.75%, 250=4.20% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=3.84%, ctx=5600, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=201KiB/s (206kB/s), 49.7KiB/s-51.4KiB/s (50.9kB/s-52.7kB/s), io=23.4MiB (24.6MB), run=117680-119505msec WRITE: bw=210KiB/s (215kB/s), 52.7KiB/s-53.1KiB/s (53.0kB/s-54.4kB/s), io=24.6MiB (25.7MB), run=117680-119505msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147552: Wed Sep 2 11:35:53 2026 read: IOPS=27, BW=443KiB/s (454kB/s)(5920KiB/13359msec) clat (usec): min=37, max=140313, avg=18475.15, stdev=14629.42 lat (usec): min=37, max=140313, avg=18476.05, stdev=14629.43 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 87], 10.00th=[ 105], 20.00th=[ 10159], | 30.00th=[ 12125], 40.00th=[ 14615], 50.00th=[ 16450], 60.00th=[ 18744], | 70.00th=[ 22938], 80.00th=[ 27132], 90.00th=[ 32900], 95.00th=[ 38011], | 99.00th=[ 65799], 99.50th=[125305], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 255, max= 698, per=25.17%, avg=438.96, stdev=123.69, samples=26 iops : min= 15, max= 43, avg=27.00, stdev= 7.84, samples=26 write: IOPS=29, BW=477KiB/s (488kB/s)(6368KiB/13359msec); 0 zone resets clat (usec): min=1503, max=64616, avg=16156.08, stdev=13914.61 lat (usec): min=1505, max=64618, avg=16158.21, stdev=13915.20 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2638], 10.00th=[ 3392], 20.00th=[ 4621], | 30.00th=[ 5538], 40.00th=[ 8094], 50.00th=[11338], 60.00th=[15664], | 70.00th=[20579], 80.00th=[27395], 90.00th=[36439], 95.00th=[43779], | 99.00th=[62653], 99.50th=[64226], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 223, max= 728, per=26.05%, avg=478.04, stdev=133.12, samples=26 iops : min= 13, max= 45, avg=29.46, stdev= 8.52, samples=26 lat (usec) : 50=0.52%, 100=3.52%, 250=2.99%, 500=0.26% lat (msec) : 2=0.78%, 4=6.77%, 10=18.62%, 20=32.03%, 50=31.77% lat (msec) : 100=2.47%, 250=0.26% cpu : usr=0.13%, sys=20.83%, ctx=2103, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147554: Wed Sep 2 11:35:53 2026 read: IOPS=26, BW=418KiB/s (428kB/s)(5744KiB/13730msec) clat (usec): min=41, max=98353, avg=18673.31, stdev=13836.32 lat (usec): min=41, max=98354, avg=18674.65, stdev=13836.51 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 83], 10.00th=[ 111], 20.00th=[ 9765], | 30.00th=[12256], 40.00th=[14877], 50.00th=[17695], 60.00th=[20055], | 70.00th=[23725], 80.00th=[26608], 90.00th=[32900], 95.00th=[43254], | 99.00th=[72877], 99.50th=[79168], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 58, max= 760, per=23.90%, avg=416.78, stdev=143.12, samples=27 iops : min= 3, max= 47, avg=25.63, stdev= 9.07, samples=27 write: IOPS=29, BW=477KiB/s (488kB/s)(6544KiB/13730msec); 0 zone resets clat (usec): min=1738, max=78210, avg=16920.32, stdev=14586.10 lat (usec): min=1740, max=78213, avg=16922.28, stdev=14586.44 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2769], 10.00th=[ 3490], 20.00th=[ 4424], | 30.00th=[ 5932], 40.00th=[ 9110], 50.00th=[13435], 60.00th=[17171], | 70.00th=[21103], 80.00th=[27395], 90.00th=[35914], 95.00th=[45876], | 99.00th=[69731], 99.50th=[74974], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 265, max= 672, per=25.83%, avg=473.96, stdev=98.87, samples=27 iops : min= 16, max= 42, avg=29.22, stdev= 6.35, samples=27 lat (usec) : 50=0.13%, 100=3.78%, 250=3.65%, 500=0.13% lat (msec) : 2=1.17%, 4=7.03%, 10=16.54%, 20=31.38%, 50=33.33% lat (msec) : 100=2.86% cpu : usr=0.15%, sys=20.54%, ctx=2088, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147556: Wed Sep 2 11:35:53 2026 read: IOPS=29, BW=465KiB/s (476kB/s)(6256KiB/13445msec) clat (usec): min=38, max=182089, avg=19944.10, stdev=17989.64 lat (usec): min=40, max=182090, avg=19946.67, stdev=17987.98 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 79], 10.00th=[ 100], 20.00th=[ 9634], | 30.00th=[ 12911], 40.00th=[ 15926], 50.00th=[ 18482], 60.00th=[ 21365], | 70.00th=[ 23725], 80.00th=[ 29230], 90.00th=[ 34866], 95.00th=[ 43779], | 99.00th=[ 85459], 99.50th=[164627], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 254, max= 734, per=26.78%, avg=467.00, stdev=120.79, samples=26 iops : min= 15, max= 45, avg=28.77, stdev= 7.59, samples=26 write: IOPS=28, BW=449KiB/s (459kB/s)(6032KiB/13445msec); 0 zone resets clat (usec): min=1059, max=59283, avg=14658.94, stdev=11677.04 lat (usec): min=1060, max=59285, avg=14663.00, stdev=11677.25 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2311], 10.00th=[ 3097], 20.00th=[ 4228], | 30.00th=[ 5735], 40.00th=[ 8717], 50.00th=[11469], 60.00th=[15008], | 70.00th=[18744], 80.00th=[23462], 90.00th=[31065], 95.00th=[38011], | 99.00th=[51643], 99.50th=[55313], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 192, max= 704, per=24.10%, avg=442.27, stdev=130.58, samples=26 iops : min= 12, max= 44, avg=27.23, stdev= 8.26, samples=26 lat (usec) : 50=0.39%, 100=4.82%, 250=4.43% lat (msec) : 2=1.30%, 4=7.42%, 10=13.54%, 20=31.12%, 50=34.90% lat (msec) : 100=1.82%, 250=0.26% cpu : usr=0.16%, sys=20.43%, ctx=2089, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147558: Wed Sep 2 11:35:53 2026 read: IOPS=28, BW=451KiB/s (462kB/s)(6032KiB/13363msec) clat (usec): min=46, max=79049, avg=18696.89, stdev=12901.19 lat (usec): min=47, max=79050, avg=18697.94, stdev=12901.18 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 88], 10.00th=[ 106], 20.00th=[10552], | 30.00th=[13042], 40.00th=[15664], 50.00th=[18220], 60.00th=[20579], | 70.00th=[23462], 80.00th=[26870], 90.00th=[33817], 95.00th=[39060], | 99.00th=[68682], 99.50th=[77071], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 287, max= 672, per=25.85%, avg=450.81, stdev=91.06, samples=26 iops : min= 17, max= 42, avg=27.77, stdev= 5.70, samples=26 write: IOPS=29, BW=468KiB/s (479kB/s)(6256KiB/13363msec); 0 zone resets clat (usec): min=1728, max=123783, avg=16042.92, stdev=13899.64 lat (usec): min=1730, max=123785, avg=16049.02, stdev=13898.23 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2868], 10.00th=[ 3556], 20.00th=[ 4555], | 30.00th=[ 6128], 40.00th=[ 8160], 50.00th=[ 12125], 60.00th=[ 15795], | 70.00th=[ 20317], 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 40109], | 99.00th=[ 58983], 99.50th=[ 65799], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 192, max= 704, per=25.43%, avg=466.58, stdev=118.13, samples=26 iops : min= 12, max= 44, avg=28.73, stdev= 7.38, samples=26 lat (usec) : 50=0.26%, 100=3.65%, 250=4.04%, 500=0.26% lat (msec) : 2=0.78%, 4=6.12%, 10=17.84%, 20=30.99%, 50=33.98% lat (msec) : 100=1.95%, 250=0.13% cpu : usr=0.13%, sys=20.92%, ctx=2121, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1745KiB/s (1786kB/s), 418KiB/s-465KiB/s (428kB/s-476kB/s), io=23.4MiB (24.5MB), run=13359-13730msec WRITE: bw=1835KiB/s (1879kB/s), 449KiB/s-477KiB/s (459kB/s-488kB/s), io=24.6MiB (25.8MB), run=13359-13730msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147553: Wed Sep 2 11:36:08 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5920KiB/28278msec) clat (msec): min=4, max=107, avg=19.47, stdev=16.55 lat (msec): min=4, max=107, avg=19.47, stdev=16.55 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 24], 90.00th=[ 42], 95.00th=[ 59], | 99.00th=[ 83], 99.50th=[ 90], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 63, max= 480, per=24.86%, avg=209.36, stdev=91.63, samples=56 iops : min= 3, max= 30, avg=12.59, stdev= 5.83, samples=56 write: IOPS=14, BW=225KiB/s (231kB/s)(6368KiB/28278msec); 0 zone resets clat (msec): min=23, max=186, avg=52.66, stdev=23.97 lat (msec): min=23, max=186, avg=52.66, stdev=23.97 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 42], 50.00th=[ 47], 60.00th=[ 51], | 70.00th=[ 58], 80.00th=[ 67], 90.00th=[ 83], 95.00th=[ 95], | 99.00th=[ 161], 99.50th=[ 165], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 32, max= 448, per=25.40%, avg=224.82, stdev=95.91, samples=56 iops : min= 2, max= 28, avg=13.55, stdev= 6.14, samples=56 lat (msec) : 10=14.84%, 20=20.05%, 50=40.36%, 100=22.66%, 250=2.08% cpu : usr=0.08%, sys=5.00%, ctx=1555, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147555: Wed Sep 2 11:36:08 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(5744KiB/28446msec) clat (usec): min=4629, max=85853, avg=18895.86, stdev=14937.43 lat (usec): min=4630, max=85854, avg=18896.91, stdev=14937.34 clat percentiles (usec): | 1.00th=[ 5276], 5.00th=[ 6259], 10.00th=[ 6980], 20.00th=[ 8455], | 30.00th=[ 9765], 40.00th=[11600], 50.00th=[13698], 60.00th=[15664], | 70.00th=[19530], 80.00th=[26346], 90.00th=[39584], 95.00th=[51119], | 99.00th=[80217], 99.50th=[83362], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 59, max= 509, per=23.86%, avg=200.91, stdev=116.44, samples=56 iops : min= 3, max= 31, avg=12.05, stdev= 7.38, samples=56 write: IOPS=14, BW=230KiB/s (236kB/s)(6544KiB/28446msec); 0 zone resets clat (msec): min=17, max=211, avg=52.84, stdev=24.03 lat (msec): min=17, max=211, avg=52.84, stdev=24.03 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 32], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 42], 50.00th=[ 46], 60.00th=[ 51], | 70.00th=[ 58], 80.00th=[ 66], 90.00th=[ 84], 95.00th=[ 99], | 99.00th=[ 132], 99.50th=[ 146], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 95, max= 384, per=25.85%, avg=228.75, stdev=83.54, samples=56 iops : min= 5, max= 24, avg=13.80, stdev= 5.39, samples=56 lat (msec) : 10=14.45%, 20=18.75%, 50=41.93%, 100=22.27%, 250=2.60% cpu : usr=0.07%, sys=5.03%, ctx=1546, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147557: Wed Sep 2 11:36:08 2026 read: IOPS=14, BW=229KiB/s (234kB/s)(6256KiB/27369msec) clat (msec): min=4, max=132, avg=18.98, stdev=15.75 lat (msec): min=4, max=132, avg=18.98, stdev=15.75 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 40], 95.00th=[ 55], | 99.00th=[ 80], 99.50th=[ 84], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 31, max= 704, per=27.34%, avg=230.19, stdev=128.81, samples=54 iops : min= 1, max= 44, avg=13.89, stdev= 8.18, samples=54 write: IOPS=13, BW=220KiB/s (226kB/s)(6032KiB/27369msec); 0 zone resets clat (msec): min=21, max=161, avg=52.57, stdev=22.86 lat (msec): min=21, max=161, avg=52.58, stdev=22.86 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 52], | 70.00th=[ 57], 80.00th=[ 67], 90.00th=[ 84], 95.00th=[ 101], | 99.00th=[ 130], 99.50th=[ 153], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 95, max= 383, per=24.81%, avg=219.56, stdev=84.81, samples=54 iops : min= 5, max= 23, avg=13.22, stdev= 5.46, samples=54 lat (msec) : 10=15.36%, 20=21.74%, 50=39.06%, 100=21.22%, 250=2.60% cpu : usr=0.08%, sys=5.36%, ctx=1634, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147559: Wed Sep 2 11:36:08 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28221msec) clat (usec): min=4717, max=99472, avg=18703.12, stdev=15420.07 lat (usec): min=4718, max=99473, avg=18704.19, stdev=15420.00 clat percentiles (usec): | 1.00th=[ 4883], 5.00th=[ 6325], 10.00th=[ 7046], 20.00th=[ 8455], | 30.00th=[ 9896], 40.00th=[11994], 50.00th=[13960], 60.00th=[15533], | 70.00th=[18482], 80.00th=[23987], 90.00th=[39060], 95.00th=[53740], | 99.00th=[80217], 99.50th=[83362], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 32, max= 446, per=25.21%, avg=212.30, stdev=98.46, samples=56 iops : min= 2, max= 27, avg=12.77, stdev= 6.29, samples=56 write: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28221msec); 0 zone resets clat (msec): min=19, max=211, avg=53.77, stdev=23.44 lat (msec): min=19, max=211, avg=53.78, stdev=23.44 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 36], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 61], 80.00th=[ 70], 90.00th=[ 90], 95.00th=[ 97], | 99.00th=[ 127], 99.50th=[ 148], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 95, max= 448, per=25.02%, avg=221.45, stdev=88.21, samples=56 iops : min= 5, max= 28, avg=13.34, stdev= 5.70, samples=56 lat (msec) : 10=15.36%, 20=21.09%, 50=38.02%, 100=23.31%, 250=2.21% cpu : usr=0.08%, sys=5.19%, ctx=1597, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=842KiB/s (862kB/s), 202KiB/s-229KiB/s (207kB/s-234kB/s), io=23.4MiB (24.5MB), run=27369-28446msec WRITE: bw=886KiB/s (907kB/s), 220KiB/s-230KiB/s (226kB/s-236kB/s), io=24.6MiB (25.8MB), run=27369-28446msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147570: Wed Sep 2 11:36:17 2026 read: IOPS=3, BW=3260KiB/s (3338kB/s)(7168KiB/2199msec) clat (msec): min=49, max=285, avg=120.18, stdev=87.63 lat (msec): min=49, max=285, avg=120.18, stdev=87.63 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 54], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 79], 60.00th=[ 120], | 70.00th=[ 120], 80.00th=[ 188], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 2039, max= 7420, per=61.55%, avg=3835.67, stdev=3104.13, samples=3 iops : min= 1, max= 7, avg= 3.33, stdev= 3.21, samples=3 write: IOPS=2, BW=2328KiB/s (2384kB/s)(5120KiB/2199msec); 0 zone resets clat (msec): min=175, max=457, avg=258.10, stdev=115.75 lat (msec): min=175, max=458, avg=258.17, stdev=115.76 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1855, max= 2048, per=22.89%, avg=1997.50, stdev=95.09, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=50.00%, 500=16.67% cpu : usr=0.00%, sys=15.20%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147571: Wed Sep 2 11:36:17 2026 read: IOPS=0, BW=634KiB/s (649kB/s)(2048KiB/3229msec) clat (usec): min=54865, max=94725, avg=74795.37, stdev=28185.15 lat (usec): min=54867, max=94726, avg=74797.01, stdev=28184.53 clat percentiles (usec): | 1.00th=[54789], 5.00th=[54789], 10.00th=[54789], 20.00th=[54789], | 30.00th=[54789], 40.00th=[54789], 50.00th=[54789], 60.00th=[94897], | 70.00th=[94897], 80.00th=[94897], 90.00th=[94897], 95.00th=[94897], | 99.00th=[94897], 99.50th=[94897], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 1906, max= 2039, per=31.65%, avg=1972.50, stdev=94.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3171KiB/s (3247kB/s)(10.0MiB/3229msec); 0 zone resets clat (msec): min=113, max=615, avg=306.10, stdev=185.05 lat (msec): min=113, max=615, avg=306.18, stdev=185.05 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 116], | 30.00th=[ 180], 40.00th=[ 205], 50.00th=[ 220], 60.00th=[ 266], | 70.00th=[ 347], 80.00th=[ 388], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1906, max= 6144, per=34.92%, avg=3046.83, stdev=1732.38, samples=6 iops : min= 1, max= 6, avg= 2.67, stdev= 1.97, samples=6 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.06%, sys=13.35%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147573: Wed Sep 2 11:36:17 2026 read: IOPS=1, BW=1870KiB/s (1915kB/s)(6144KiB/3286msec) clat (msec): min=69, max=428, avg=255.89, stdev=152.20 lat (msec): min=69, max=428, avg=255.89, stdev=152.20 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 284], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 2048, max= 4096, per=54.68%, avg=3407.67, stdev=1177.54, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1870KiB/s (1915kB/s)(6144KiB/3286msec); 0 zone resets clat (msec): min=156, max=352, avg=265.51, stdev=81.43 lat (msec): min=156, max=352, avg=265.64, stdev=81.44 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 300], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1851, max= 2048, per=23.02%, avg=2008.60, stdev=88.10, samples=5 iops : min= 1, max= 2, avg= 1.80, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=58.33% cpu : usr=0.00%, sys=10.41%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147576: Wed Sep 2 11:36:17 2026 read: IOPS=1, BW=1611KiB/s (1649kB/s)(5120KiB/3179msec) clat (msec): min=55, max=235, avg=158.57, stdev=69.84 lat (msec): min=55, max=235, avg=158.57, stdev=69.84 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 2048, max= 6144, per=65.73%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2255KiB/s (2309kB/s)(7168KiB/3179msec); 0 zone resets clat (msec): min=81, max=671, avg=328.02, stdev=217.49 lat (msec): min=81, max=671, avg=328.08, stdev=217.50 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 161], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 257], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 567], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1872, max= 4096, per=34.66%, avg=3023.75, stdev=1230.43, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=11.64%, ctx=122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6233KiB/s (6382kB/s), 634KiB/s-3260KiB/s (649kB/s-3338kB/s), io=20.0MiB (20.0MB), run=2199-3286msec WRITE: bw=8726KiB/s (8935kB/s), 1870KiB/s-3171KiB/s (1915kB/s-3247kB/s), io=28.0MiB (29.4MB), run=2199-3286msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147572: Wed Sep 2 11:36:17 2026 read: IOPS=2, BW=2735KiB/s (2800kB/s)(7168KiB/2621msec) clat (msec): min=79, max=212, avg=169.86, stdev=47.76 lat (msec): min=79, max=212, avg=169.86, stdev=47.76 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 142], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 190], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 207], 90.00th=[ 213], 95.00th=[ 213], | 99.00th=[ 213], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 1976, max= 4087, per=48.14%, avg=3017.50, stdev=1167.54, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1953KiB/s (2000kB/s)(5120KiB/2621msec); 0 zone resets clat (msec): min=144, max=369, avg=257.10, stdev=92.48 lat (msec): min=144, max=369, avg=257.17, stdev=92.48 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1976, max= 4087, per=28.73%, avg=2521.50, stdev=1044.04, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=43.24%, ctx=746, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147574: Wed Sep 2 11:36:17 2026 read: IOPS=0, BW=627KiB/s (642kB/s)(2048KiB/3267msec) clat (msec): min=122, max=155, avg=139.13, stdev=23.86 lat (msec): min=122, max=155, avg=139.13, stdev=23.86 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 157], 95.00th=[ 157], | 99.00th=[ 157], 99.50th=[ 157], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 1370, max= 1976, per=26.69%, avg=1673.00, stdev=428.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3134KiB/s (3210kB/s)(10.0MiB/3267msec); 0 zone resets clat (msec): min=105, max=1008, avg=284.04, stdev=272.26 lat (msec): min=105, max=1008, avg=284.12, stdev=272.26 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 120], | 30.00th=[ 123], 40.00th=[ 136], 50.00th=[ 171], 60.00th=[ 194], | 70.00th=[ 279], 80.00th=[ 309], 90.00th=[ 401], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1370, max= 3961, per=32.28%, avg=2833.00, stdev=1327.07, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 250=66.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=33.47%, ctx=222, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147575: Wed Sep 2 11:36:17 2026 read: IOPS=2, BW=2721KiB/s (2786kB/s)(6144KiB/2258msec) clat (usec): min=448, max=188964, avg=32560.98, stdev=76634.79 lat (usec): min=448, max=188965, avg=32562.08, stdev=76634.82 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 553], 50.00th=[ 553], 60.00th=[ 766], | 70.00th=[ 4113], 80.00th=[ 4113], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 4087, max= 4087, per=65.20%, avg=4087.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2721KiB/s (2786kB/s)(6144KiB/2258msec); 0 zone resets clat (msec): min=142, max=427, avg=320.87, stdev=97.24 lat (msec): min=142, max=427, avg=320.92, stdev=97.24 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 342], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1376, max= 4087, per=28.27%, avg=2481.00, stdev=1423.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : 10=8.33%, 250=16.67%, 500=41.67% cpu : usr=0.00%, sys=34.60%, ctx=148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147577: Wed Sep 2 11:36:17 2026 read: IOPS=1, BW=1953KiB/s (2000kB/s)(5120KiB/2621msec) clat (usec): min=517, max=212466, avg=98587.77, stdev=98124.50 lat (usec): min=518, max=212467, avg=98588.61, stdev=98124.37 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 519], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[101188], 60.00th=[101188], | 70.00th=[177210], 80.00th=[177210], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 3968, max= 4087, per=64.25%, avg=4027.50, stdev=84.15, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2735KiB/s (2800kB/s)(7168KiB/2621msec); 0 zone resets clat (msec): min=121, max=500, avg=297.80, stdev=169.38 lat (msec): min=121, max=500, avg=297.88, stdev=169.37 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 138], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 213], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 489], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2039, max= 3968, per=34.21%, avg=3002.00, stdev=1106.80, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=31.53%, ctx=124, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6269KiB/s (6419kB/s), 627KiB/s-2735KiB/s (642kB/s-2800kB/s), io=20.0MiB (20.0MB), run=2258-3267msec WRITE: bw=8776KiB/s (8987kB/s), 1953KiB/s-3134KiB/s (2000kB/s-3210kB/s), io=28.0MiB (29.4MB), run=2258-3267msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147583: Wed Sep 2 11:36:25 2026 read: IOPS=3, BW=13.2MiB/s (13.9MB/s)(12.0MiB/908msec) clat (msec): min=177, max=348, avg=267.55, stdev=85.84 lat (msec): min=177, max=348, avg=267.56, stdev=85.84 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min=11070, max=11070, per=100.00%, avg=11070.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=30.43%, ctx=140, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147584: Wed Sep 2 11:36:25 2026 read: IOPS=0, BW=1706KiB/s (1747kB/s)(4096KiB/2401msec) clat (nsec): min=780428k, max=780428k, avg=780427528.00, stdev= 0.00 lat (nsec): min=780429k, max=780429k, avg=780428964.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3412KiB/s (3494kB/s)(8192KiB/2401msec); 0 zone resets clat (msec): min=358, max=1155, avg=756.74, stdev=563.90 lat (msec): min=358, max=1155, avg=757.06, stdev=563.90 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8175, max= 8175, per=59.90%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=11.12%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147585: Wed Sep 2 11:36:25 2026 write: IOPS=1, BW=6410KiB/s (6564kB/s)(12.0MiB/1917msec); 0 zone resets clat (msec): min=589, max=641, avg=607.49, stdev=29.72 lat (msec): min=589, max=642, avg=607.82, stdev=29.68 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 5680, max= 8062, per=50.35%, avg=6871.00, stdev=1684.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=17.22%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147586: Wed Sep 2 11:36:25 2026 write: IOPS=1, BW=5846KiB/s (5986kB/s)(12.0MiB/2102msec); 0 zone resets clat (msec): min=172, max=1455, avg=669.33, stdev=688.99 lat (msec): min=172, max=1456, avg=669.76, stdev=689.22 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 5634, max= 5634, per=41.28%, avg=5634.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=14.80%, ctx=95, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6824KiB/s (6988kB/s), 1706KiB/s-13.2MiB/s (1747kB/s-13.9MB/s), io=16.0MiB (16.8MB), run=908-2401msec WRITE: bw=13.3MiB/s (13.0MB/s), 3412KiB/s-6410KiB/s (3494kB/s-6564kB/s), io=32.0MiB (33.6MB), run=1917-2401msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147587: Wed Sep 2 11:36:25 2026 read: IOPS=2, BW=8690KiB/s (8899kB/s)(12.0MiB/1414msec) clat (msec): min=400, max=487, avg=452.88, stdev=46.21 lat (msec): min=400, max=487, avg=452.88, stdev=46.21 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 5970, max= 8143, per=95.41%, avg=7056.50, stdev=1536.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.07%, sys=44.02%, ctx=1397, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147588: Wed Sep 2 11:36:25 2026 read: IOPS=0, BW=1849KiB/s (1894kB/s)(4096KiB/2215msec) clat (nsec): min=459812k, max=459812k, avg=459812133.00, stdev= 0.00 lat (nsec): min=459815k, max=459815k, avg=459815433.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 5769, max= 5769, per=78.00%, avg=5769.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3698KiB/s (3787kB/s)(8192KiB/2215msec); 0 zone resets clat (msec): min=864, max=870, avg=867.58, stdev= 4.23 lat (msec): min=864, max=870, avg=867.90, stdev= 4.26 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8175, max= 8175, per=55.26%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.18%, ctx=399, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147589: Wed Sep 2 11:36:25 2026 write: IOPS=1, BW=5606KiB/s (5740kB/s)(12.0MiB/2192msec); 0 zone resets clat (msec): min=147, max=1160, avg=709.27, stdev=515.56 lat (msec): min=147, max=1161, avg=709.59, stdev=515.56 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8175, max= 8175, per=55.26%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.90%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147590: Wed Sep 2 11:36:25 2026 write: IOPS=1, BW=6554KiB/s (6711kB/s)(12.0MiB/1875msec); 0 zone resets clat (msec): min=252, max=996, avg=616.80, stdev=372.15 lat (msec): min=253, max=997, avg=617.20, stdev=372.17 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 5970, max= 8175, per=47.81%, avg=7072.50, stdev=1559.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=12.70%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7397KiB/s (7574kB/s), 1849KiB/s-8690KiB/s (1894kB/s-8899kB/s), io=16.0MiB (16.8MB), run=1414-2215msec WRITE: bw=14.4MiB/s (15.1MB/s), 3698KiB/s-6554KiB/s (3787kB/s-6711kB/s), io=32.0MiB (33.6MB), run=1875-2215msec