== sanity test 398b: DIO and buffer IO race ============== 07:52:16 (1789127536) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.61462 s, 7.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145854: Fri Sep 11 07:54:52 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(5992KiB/134638msec) clat (usec): min=30, max=740707, avg=43379.55, stdev=37424.84 lat (usec): min=30, max=740708, avg=43380.83, stdev=37424.86 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 84], 20.00th=[ 19792], | 30.00th=[ 25560], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 54789], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[139461], 99.50th=[179307], 99.90th=[413139], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 103, per=25.20%, avg=44.36, stdev=19.78, samples=264 iops : min= 1, max= 25, avg=10.48, stdev= 4.97, samples=264 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6296KiB/134638msec); 0 zone resets clat (usec): min=966, max=352880, avg=44064.89, stdev=44452.07 lat (usec): min=967, max=352884, avg=44066.85, stdev=44452.03 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1942], 20.00th=[ 4424], | 30.00th=[ 8291], 40.00th=[ 20579], 50.00th=[ 33424], 60.00th=[ 47449], | 70.00th=[ 60031], 80.00th=[ 76022], 90.00th=[100140], 95.00th=[130548], | 99.00th=[187696], 99.50th=[204473], 99.90th=[325059], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 7, max= 150, per=25.29%, avg=46.54, stdev=19.65, samples=264 iops : min= 1, max= 37, avg=11.03, stdev= 4.96, samples=264 lat (usec) : 50=0.42%, 100=4.92%, 250=0.52%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.24%, 4=4.10%, 10=7.65%, 20=7.19%, 50=33.59% lat (msec) : 100=28.81%, 250=7.06%, 500=0.26%, 750=0.03% cpu : usr=0.09%, sys=4.98%, ctx=6699, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145855: Fri Sep 11 07:54:52 2026 read: IOPS=11, BW=44.4KiB/s (45.4kB/s)(5940KiB/133899msec) clat (usec): min=26, max=417161, avg=43941.32, stdev=34444.43 lat (usec): min=27, max=417162, avg=43944.32, stdev=34443.08 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 95], 20.00th=[ 19792], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[100140], | 99.00th=[154141], 99.50th=[185598], 99.90th=[325059], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 111, per=25.10%, avg=44.17, stdev=18.50, samples=262 iops : min= 1, max= 27, avg=10.44, stdev= 4.67, samples=262 write: IOPS=11, BW=47.4KiB/s (48.5kB/s)(6348KiB/133899msec); 0 zone resets clat (usec): min=1044, max=689555, avg=42990.83, stdev=46401.66 lat (usec): min=1045, max=689556, avg=42993.94, stdev=46400.71 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1991], 20.00th=[ 4490], | 30.00th=[ 9634], 40.00th=[ 20055], 50.00th=[ 31327], 60.00th=[ 42206], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[124257], | 99.00th=[191890], 99.50th=[229639], 99.90th=[320865], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 136, per=25.54%, avg=46.98, stdev=20.75, samples=263 iops : min= 1, max= 34, avg=11.14, stdev= 5.24, samples=263 lat (usec) : 50=0.46%, 100=4.39%, 250=0.55%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.24%, 4=4.49%, 10=6.38%, 20=8.76%, 50=35.32% lat (msec) : 100=26.53%, 250=7.42%, 500=0.23%, 750=0.03% cpu : usr=0.07%, sys=4.92%, ctx=6502, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145856: Fri Sep 11 07:54:52 2026 read: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6028KiB/136288msec) clat (usec): min=27, max=291609, avg=42426.37, stdev=31659.83 lat (usec): min=27, max=291610, avg=42430.41, stdev=31658.15 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 63], 10.00th=[ 115], 20.00th=[ 19530], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[139461], 99.50th=[166724], 99.90th=[206570], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 112, per=25.19%, avg=44.33, stdev=20.10, samples=265 iops : min= 1, max= 28, avg=10.48, stdev= 5.07, samples=265 write: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6260KiB/136288msec); 0 zone resets clat (usec): min=1010, max=991287, avg=45934.49, stdev=49620.47 lat (usec): min=1010, max=991291, avg=45936.30, stdev=49620.43 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1926], 20.00th=[ 5145], | 30.00th=[ 10683], 40.00th=[ 23987], 50.00th=[ 35914], 60.00th=[ 47973], | 70.00th=[ 61080], 80.00th=[ 78119], 90.00th=[103285], 95.00th=[125305], | 99.00th=[191890], 99.50th=[225444], 99.90th=[270533], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 128, per=24.81%, avg=45.65, stdev=18.82, samples=267 iops : min= 1, max= 32, avg=10.81, stdev= 4.75, samples=267 lat (usec) : 50=0.62%, 100=4.23%, 250=0.46%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.44%, 4=3.78%, 10=5.86%, 20=8.27%, 50=35.94% lat (msec) : 100=26.95%, 250=8.04%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=4.86%, ctx=6640, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145857: Fri Sep 11 07:54:52 2026 read: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6052KiB/132696msec) clat (usec): min=33, max=463807, avg=42894.30, stdev=35554.09 lat (usec): min=33, max=463808, avg=42895.91, stdev=35553.96 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 81], 20.00th=[ 19268], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 53216], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[143655], 99.50th=[200279], 99.90th=[346031], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 111, per=26.04%, avg=45.83, stdev=19.30, samples=258 iops : min= 1, max= 27, avg=10.84, stdev= 4.84, samples=258 write: IOPS=11, BW=46.0KiB/s (48.1kB/s)(6236KiB/132696msec); 0 zone resets clat (usec): min=1007, max=991774, avg=43236.66, stdev=48684.21 lat (usec): min=1009, max=991779, avg=43239.56, stdev=48686.07 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 2008], 20.00th=[ 4686], | 30.00th=[ 8160], 40.00th=[ 19530], 50.00th=[ 31589], 60.00th=[ 44827], | 70.00th=[ 58983], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[123208], | 99.00th=[173016], 99.50th=[214959], 99.90th=[295699], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 135, per=25.64%, avg=47.17, stdev=19.44, samples=258 iops : min= 1, max= 33, avg=11.19, stdev= 4.89, samples=258 lat (usec) : 50=0.59%, 100=4.82%, 250=0.62%, 500=0.16%, 750=0.07% lat (msec) : 2=5.18%, 4=3.94%, 10=7.98%, 20=7.39%, 50=34.67% lat (msec) : 100=26.40%, 250=7.91%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=4.91%, ctx=6444, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=176KiB/s (180kB/s), 44.2KiB/s-45.6KiB/s (45.3kB/s-46.7kB/s), io=23.4MiB (24.6MB), run=132696-136288msec WRITE: bw=184KiB/s (189kB/s), 45.9KiB/s-47.4KiB/s (47.0kB/s-48.5kB/s), io=24.6MiB (25.7MB), run=132696-136288msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145849: Fri Sep 11 07:57:32 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(5992KiB/293879msec) clat (msec): min=6, max=745, avg=38.06, stdev=42.56 lat (msec): min=6, max=745, avg=38.06, stdev=42.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 110], | 99.00th=[ 171], 99.50th=[ 249], 99.90th=[ 468], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 88, per=29.26%, avg=23.70, stdev=15.96, samples=488 iops : min= 1, max= 22, avg= 5.29, stdev= 4.00, samples=488 write: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6296KiB/293879msec); 0 zone resets clat (msec): min=37, max=568, avg=150.20, stdev=65.30 lat (msec): min=37, max=568, avg=150.20, stdev=65.30 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 124], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 171], 80.00th=[ 197], 90.00th=[ 239], 95.00th=[ 271], | 99.00th=[ 359], 99.50th=[ 393], 99.90th=[ 523], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 48, per=25.08%, avg=21.07, stdev= 9.14, samples=574 iops : min= 1, max= 12, avg= 4.63, stdev= 2.35, samples=574 lat (msec) : 10=2.12%, 20=16.18%, 50=20.48%, 100=18.72%, 250=38.28% lat (msec) : 500=4.13%, 750=0.10% cpu : usr=0.04%, sys=1.06%, ctx=5045, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145850: Fri Sep 11 07:57:32 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(5940KiB/295287msec) clat (msec): min=5, max=911, avg=37.52, stdev=43.10 lat (msec): min=5, max=911, avg=37.52, stdev=43.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 82], 95.00th=[ 108], | 99.00th=[ 186], 99.50th=[ 241], 99.90th=[ 347], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 80, per=28.73%, avg=23.27, stdev=15.71, samples=491 iops : min= 1, max= 20, avg= 5.19, stdev= 3.98, samples=491 write: IOPS=5, BW=21.5KiB/s (22.0kB/s)(6348KiB/295287msec); 0 zone resets clat (msec): min=42, max=479, avg=150.64, stdev=65.55 lat (msec): min=42, max=479, avg=150.65, stdev=65.55 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 197], 90.00th=[ 241], 95.00th=[ 275], | 99.00th=[ 359], 99.50th=[ 380], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 56, per=25.17%, avg=21.14, stdev= 8.98, samples=576 iops : min= 1, max= 14, avg= 4.65, stdev= 2.30, samples=576 lat (msec) : 10=1.99%, 20=14.88%, 50=22.66%, 100=17.55%, 250=38.35% lat (msec) : 500=4.56%, 1000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5196, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145851: Fri Sep 11 07:57:32 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6028KiB/295517msec) clat (msec): min=5, max=366, avg=39.31, stdev=39.16 lat (msec): min=5, max=366, avg=39.31, stdev=39.16 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 55], 90.00th=[ 86], 95.00th=[ 115], | 99.00th=[ 180], 99.50th=[ 230], 99.90th=[ 338], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 95, per=28.14%, avg=22.79, stdev=15.59, samples=509 iops : min= 1, max= 23, avg= 5.06, stdev= 3.94, samples=509 write: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6260KiB/295517msec); 0 zone resets clat (msec): min=41, max=1023, avg=150.70, stdev=70.27 lat (msec): min=41, max=1023, avg=150.70, stdev=70.27 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 95], | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 197], 90.00th=[ 239], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 430], 99.90th=[ 592], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 48, per=24.90%, avg=20.91, stdev= 9.27, samples=574 iops : min= 1, max= 12, avg= 4.59, stdev= 2.37, samples=574 lat (msec) : 10=1.82%, 20=15.69%, 50=21.06%, 100=19.21%, 250=37.66% lat (msec) : 500=4.46%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.04%, ctx=4975, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145852: Fri Sep 11 07:57:32 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6052KiB/296373msec) clat (msec): min=6, max=502, avg=38.23, stdev=40.15 lat (msec): min=6, max=502, avg=38.24, stdev=40.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 180], 99.50th=[ 215], 99.90th=[ 481], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 103, per=29.06%, avg=23.54, stdev=16.14, samples=496 iops : min= 1, max= 25, avg= 5.25, stdev= 4.07, samples=496 write: IOPS=5, BW=21.0KiB/s (21.5kB/s)(6236KiB/296373msec); 0 zone resets clat (msec): min=47, max=1040, avg=152.71, stdev=70.96 lat (msec): min=47, max=1040, avg=152.71, stdev=70.95 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 72], 10.00th=[ 83], 20.00th=[ 95], | 30.00th=[ 110], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 157], | 70.00th=[ 174], 80.00th=[ 201], 90.00th=[ 241], 95.00th=[ 288], | 99.00th=[ 372], 99.50th=[ 397], 99.90th=[ 609], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 47, per=24.92%, avg=20.94, stdev= 8.86, samples=572 iops : min= 1, max= 11, avg= 4.60, stdev= 2.26, samples=572 lat (msec) : 10=2.25%, 20=15.89%, 50=21.52%, 100=17.77%, 250=38.25% lat (msec) : 500=4.20%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=81.0KiB/s (82.0kB/s), 20.1KiB/s-20.4KiB/s (20.6kB/s-20.9kB/s), io=23.4MiB (24.6MB), run=293879-296373msec WRITE: bw=84.8KiB/s (86.9kB/s), 21.0KiB/s-21.5KiB/s (21.5kB/s-22.0kB/s), io=24.6MiB (25.7MB), run=293879-296373msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145917: Fri Sep 11 07:58:17 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(5920KiB/31886msec) clat (usec): min=39, max=271643, avg=45961.91, stdev=40504.03 lat (usec): min=40, max=271645, avg=45964.23, stdev=40503.75 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 445], | 30.00th=[ 25035], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[206570], 99.50th=[231736], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 415, per=25.23%, avg=184.47, stdev=71.53, samples=62 iops : min= 3, max= 25, avg=10.77, stdev= 4.49, samples=62 write: IOPS=12, BW=200KiB/s (205kB/s)(6368KiB/31886msec); 0 zone resets clat (usec): min=1489, max=198147, avg=37186.25, stdev=37710.67 lat (usec): min=1490, max=198149, avg=37188.54, stdev=37710.89 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1795], 10.00th=[ 2802], 20.00th=[ 5932], | 30.00th=[ 8586], 40.00th=[ 14091], 50.00th=[ 23462], 60.00th=[ 35390], | 70.00th=[ 49021], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[119014], | 99.00th=[158335], 99.50th=[181404], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 62, max= 414, per=25.99%, avg=199.85, stdev=74.26, samples=62 iops : min= 3, max= 25, avg=11.74, stdev= 4.62, samples=62 lat (usec) : 50=1.04%, 100=7.55%, 250=0.65%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.56%, 4=2.99%, 10=10.29%, 20=8.72%, 50=29.69% lat (msec) : 100=26.82%, 250=6.90%, 500=0.13% cpu : usr=0.07%, sys=4.95%, ctx=1424, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145918: Fri Sep 11 07:58:17 2026 read: IOPS=10, BW=175KiB/s (180kB/s)(5744KiB/32740msec) clat (usec): min=38, max=240334, avg=47419.69, stdev=39037.54 lat (usec): min=38, max=240335, avg=47420.85, stdev=39037.53 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 4555], | 30.00th=[ 29492], 40.00th=[ 36439], 50.00th=[ 43779], 60.00th=[ 49546], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[208667], 99.50th=[238027], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 359, per=24.10%, avg=176.17, stdev=65.92, samples=64 iops : min= 1, max= 22, avg=10.25, stdev= 4.17, samples=64 write: IOPS=12, BW=200KiB/s (205kB/s)(6544KiB/32740msec); 0 zone resets clat (usec): min=1443, max=238342, avg=37898.20, stdev=41838.87 lat (usec): min=1444, max=238344, avg=37900.40, stdev=41838.91 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1745], 10.00th=[ 2507], 20.00th=[ 5407], | 30.00th=[ 7635], 40.00th=[ 12518], 50.00th=[ 19530], 60.00th=[ 35390], | 70.00th=[ 51643], 80.00th=[ 65274], 90.00th=[ 91751], 95.00th=[130548], | 99.00th=[181404], 99.50th=[193987], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 62, max= 419, per=25.80%, avg=198.42, stdev=83.10, samples=64 iops : min= 3, max= 26, avg=11.64, stdev= 5.24, samples=64 lat (usec) : 50=1.56%, 100=6.90%, 250=0.78% lat (msec) : 2=4.30%, 4=3.26%, 10=11.59%, 20=8.72%, 50=28.13% lat (msec) : 100=26.17%, 250=8.59% cpu : usr=0.06%, sys=4.62%, ctx=1419, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145919: Fri Sep 11 07:58:17 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(6256KiB/31451msec) clat (usec): min=35, max=269398, avg=43899.19, stdev=36999.88 lat (usec): min=36, max=269399, avg=43912.17, stdev=36986.63 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 88], | 30.00th=[ 25035], 40.00th=[ 32113], 50.00th=[ 42730], 60.00th=[ 52167], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[107480], | 99.00th=[154141], 99.50th=[166724], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 447, per=27.46%, avg=200.72, stdev=83.06, samples=61 iops : min= 1, max= 27, avg=11.80, stdev= 5.26, samples=61 write: IOPS=11, BW=192KiB/s (196kB/s)(6032KiB/31451msec); 0 zone resets clat (usec): min=1415, max=472727, avg=37095.03, stdev=47183.36 lat (usec): min=1416, max=472729, avg=37097.49, stdev=47183.16 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1778], 10.00th=[ 2573], 20.00th=[ 4948], | 30.00th=[ 7898], 40.00th=[ 12518], 50.00th=[ 20055], 60.00th=[ 32637], | 70.00th=[ 47973], 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[115868], | 99.00th=[166724], 99.50th=[387974], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 62, max= 409, per=24.80%, avg=190.74, stdev=77.57, samples=61 iops : min= 3, max= 25, avg=11.16, stdev= 4.90, samples=61 lat (usec) : 50=2.21%, 100=9.11%, 250=0.78%, 1000=0.13% lat (msec) : 2=3.78%, 4=5.21%, 10=8.59%, 20=8.46%, 50=27.08% lat (msec) : 100=27.73%, 250=6.38%, 500=0.52% cpu : usr=0.06%, sys=4.84%, ctx=1392, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145920: Fri Sep 11 07:58:17 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30900msec) clat (usec): min=31, max=177309, avg=44738.81, stdev=35260.84 lat (usec): min=32, max=177310, avg=44740.14, stdev=35260.72 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 108], | 30.00th=[ 26608], 40.00th=[ 34341], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 59507], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[154141], 99.50th=[164627], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 63, max= 447, per=26.42%, avg=193.15, stdev=84.69, samples=60 iops : min= 3, max= 27, avg=11.33, stdev= 5.37, samples=60 write: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30900msec); 0 zone resets clat (usec): min=1477, max=312529, avg=34598.53, stdev=41240.30 lat (usec): min=1479, max=312530, avg=34601.94, stdev=41240.44 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1811], 10.00th=[ 2737], 20.00th=[ 4686], | 30.00th=[ 7242], 40.00th=[ 10421], 50.00th=[ 17171], 60.00th=[ 30802], | 70.00th=[ 43254], 80.00th=[ 60031], 90.00th=[ 87557], 95.00th=[116917], | 99.00th=[173016], 99.50th=[244319], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 62, max= 509, per=26.17%, avg=201.28, stdev=87.30, samples=60 iops : min= 3, max= 31, avg=11.83, stdev= 5.46, samples=60 lat (usec) : 50=0.91%, 100=8.46%, 250=0.91%, 750=0.13% lat (msec) : 2=3.78%, 4=5.08%, 10=11.72%, 20=7.55%, 50=29.82% lat (msec) : 100=24.35%, 250=7.16%, 500=0.13% cpu : usr=0.06%, sys=4.78%, ctx=1412, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=732KiB/s (749kB/s), 175KiB/s-199KiB/s (180kB/s-204kB/s), io=23.4MiB (24.5MB), run=30900-32740msec WRITE: bw=770KiB/s (788kB/s), 192KiB/s-202KiB/s (196kB/s-207kB/s), io=24.6MiB (25.8MB), run=30900-32740msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145921: Fri Sep 11 07:59:03 2026 read: IOPS=4, BW=75.2KiB/s (77.0kB/s)(5920KiB/78690msec) clat (msec): min=8, max=269, avg=41.10, stdev=37.49 lat (msec): min=8, max=269, avg=41.10, stdev=37.49 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 79], 95.00th=[ 113], | 99.00th=[ 232], 99.50th=[ 268], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 30, max= 255, per=27.47%, avg=83.51, stdev=52.79, samples=140 iops : min= 1, max= 15, avg= 4.46, stdev= 3.37, samples=140 write: IOPS=5, BW=80.9KiB/s (82.9kB/s)(6368KiB/78690msec); 0 zone resets clat (msec): min=52, max=563, avg=159.19, stdev=72.04 lat (msec): min=52, max=563, avg=159.20, stdev=72.04 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 80], 10.00th=[ 92], 20.00th=[ 106], | 30.00th=[ 118], 40.00th=[ 126], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 257], 95.00th=[ 300], | 99.00th=[ 401], 99.50th=[ 514], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 31, max= 192, per=25.28%, avg=80.90, stdev=34.63, samples=155 iops : min= 1, max= 12, avg= 4.30, stdev= 2.26, samples=155 lat (msec) : 10=0.65%, 20=11.98%, 50=24.61%, 100=16.15%, 250=40.76% lat (msec) : 500=5.60%, 750=0.26% cpu : usr=0.05%, sys=1.05%, ctx=1212, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145922: Fri Sep 11 07:59:03 2026 read: IOPS=4, BW=73.0KiB/s (74.8kB/s)(5744KiB/78664msec) clat (msec): min=7, max=387, avg=42.27, stdev=48.75 lat (msec): min=7, max=387, avg=42.28, stdev=48.75 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 84], 95.00th=[ 128], | 99.00th=[ 288], 99.50th=[ 334], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 21, max= 352, per=29.12%, avg=88.54, stdev=61.51, samples=128 iops : min= 1, max= 22, avg= 4.81, stdev= 3.89, samples=128 write: IOPS=5, BW=83.2KiB/s (85.2kB/s)(6544KiB/78664msec); 0 zone resets clat (msec): min=48, max=516, avg=154.47, stdev=75.00 lat (msec): min=48, max=516, avg=154.49, stdev=75.01 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 75], 10.00th=[ 86], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 171], 80.00th=[ 190], 90.00th=[ 264], 95.00th=[ 300], | 99.00th=[ 418], 99.50th=[ 481], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 21, max= 191, per=26.77%, avg=85.67, stdev=36.46, samples=150 iops : min= 1, max= 11, avg= 4.62, stdev= 2.33, samples=150 lat (msec) : 10=0.39%, 20=11.07%, 50=26.43%, 100=17.32%, 250=38.41% lat (msec) : 500=6.25%, 750=0.13% cpu : usr=0.03%, sys=1.13%, ctx=1335, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145923: Fri Sep 11 07:59:03 2026 read: IOPS=5, BW=81.7KiB/s (83.6kB/s)(6256KiB/76590msec) clat (msec): min=7, max=299, avg=41.61, stdev=41.93 lat (msec): min=7, max=299, avg=41.61, stdev=41.93 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 109], | 99.00th=[ 259], 99.50th=[ 275], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 319, per=30.27%, avg=92.02, stdev=60.50, samples=134 iops : min= 1, max= 19, avg= 5.01, stdev= 3.81, samples=134 write: IOPS=4, BW=78.8KiB/s (80.6kB/s)(6032KiB/76590msec); 0 zone resets clat (msec): min=48, max=563, avg=158.49, stdev=73.40 lat (msec): min=48, max=563, avg=158.49, stdev=73.40 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 75], 10.00th=[ 87], 20.00th=[ 101], | 30.00th=[ 113], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 207], 90.00th=[ 251], 95.00th=[ 296], | 99.00th=[ 401], 99.50th=[ 506], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 31, max= 160, per=25.58%, avg=81.86, stdev=33.78, samples=144 iops : min= 1, max= 10, avg= 4.37, stdev= 2.23, samples=144 lat (msec) : 10=0.65%, 20=12.63%, 50=26.56%, 100=17.32%, 250=37.50% lat (msec) : 500=5.08%, 750=0.26% cpu : usr=0.03%, sys=1.05%, ctx=1282, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145924: Fri Sep 11 07:59:03 2026 read: IOPS=4, BW=77.1KiB/s (78.0kB/s)(6032KiB/78213msec) clat (msec): min=7, max=390, avg=43.13, stdev=47.04 lat (msec): min=7, max=390, avg=43.14, stdev=47.04 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 100], 95.00th=[ 140], | 99.00th=[ 264], 99.50th=[ 288], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 319, per=29.55%, avg=89.82, stdev=62.98, samples=132 iops : min= 1, max= 19, avg= 4.86, stdev= 4.01, samples=132 write: IOPS=4, BW=79.0KiB/s (81.9kB/s)(6256KiB/78213msec); 0 zone resets clat (msec): min=52, max=690, avg=157.20, stdev=71.92 lat (msec): min=52, max=690, avg=157.20, stdev=71.92 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 87], 20.00th=[ 106], | 30.00th=[ 116], 40.00th=[ 127], 50.00th=[ 138], 60.00th=[ 157], | 70.00th=[ 176], 80.00th=[ 205], 90.00th=[ 245], 95.00th=[ 279], | 99.00th=[ 430], 99.50th=[ 464], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 30, max= 160, per=25.40%, avg=81.29, stdev=34.93, samples=152 iops : min= 1, max= 10, avg= 4.33, stdev= 2.31, samples=152 lat (msec) : 10=0.65%, 20=13.02%, 50=25.13%, 100=14.32%, 250=41.67% lat (msec) : 500=5.08%, 750=0.13% cpu : usr=0.03%, sys=1.07%, ctx=1302, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=304KiB/s (312kB/s), 73.0KiB/s-81.7KiB/s (74.8kB/s-83.6kB/s), io=23.4MiB (24.5MB), run=76590-78690msec WRITE: bw=320KiB/s (328kB/s), 78.8KiB/s-83.2KiB/s (80.6kB/s-85.2kB/s), io=24.6MiB (25.8MB), run=76590-78690msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145946: Fri Sep 11 07:59:19 2026 read: IOPS=1, BW=1817KiB/s (1861kB/s)(7168KiB/3945msec) clat (usec): min=523, max=311942, avg=147636.22, stdev=141162.99 lat (usec): min=524, max=311945, avg=147637.75, stdev=141163.22 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 988], | 30.00th=[ 2024], 40.00th=[ 2024], 50.00th=[204473], 60.00th=[231736], | 70.00th=[231736], 80.00th=[283116], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2007, max= 4087, per=70.36%, avg=3015.75, stdev=1157.02, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1298KiB/s (1329kB/s)(5120KiB/3945msec); 0 zone resets clat (msec): min=185, max=947, avg=467.34, stdev=312.81 lat (msec): min=185, max=947, avg=467.42, stdev=312.79 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2039, max= 6023, per=67.18%, avg=4031.00, stdev=2817.11, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=11.13%, ctx=168, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145948: Fri Sep 11 07:59:19 2026 read: IOPS=0, BW=429KiB/s (439kB/s)(2048KiB/4778msec) clat (usec): min=602, max=385637, avg=193119.77, stdev=272260.89 lat (usec): min=603, max=385640, avg=193121.74, stdev=272261.99 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[ 603], 60.00th=[383779], | 70.00th=[383779], 80.00th=[383779], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 1620, max= 2007, per=42.31%, avg=1813.50, stdev=273.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2143KiB/s (2195kB/s)(10.0MiB/4778msec); 0 zone resets clat (msec): min=129, max=1014, avg=427.38, stdev=283.59 lat (msec): min=129, max=1014, avg=427.48, stdev=283.59 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 176], | 30.00th=[ 209], 40.00th=[ 279], 50.00th=[ 317], 60.00th=[ 372], | 70.00th=[ 414], 80.00th=[ 600], 90.00th=[ 760], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1973, max= 4087, per=43.39%, avg=2603.29, stdev=989.49, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.16%, ctx=136, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145949: Fri Sep 11 07:59:19 2026 read: IOPS=1, BW=1543KiB/s (1580kB/s)(6144KiB/3981msec) clat (usec): min=550, max=312257, avg=85492.06, stdev=136153.21 lat (usec): min=551, max=312259, avg=85493.43, stdev=136153.38 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[ 947], 50.00th=[ 947], 60.00th=[ 1045], | 70.00th=[198181], 80.00th=[198181], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2011, max= 4079, per=78.05%, avg=3345.33, stdev=1157.48, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1543KiB/s (1580kB/s)(6144KiB/3981msec); 0 zone resets clat (msec): min=253, max=979, avg=548.64, stdev=304.43 lat (msec): min=253, max=979, avg=548.72, stdev=304.44 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 493], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1530, max= 2039, per=31.92%, avg=1915.20, stdev=216.71, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=9.07%, ctx=131, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145952: Fri Sep 11 07:59:19 2026 read: IOPS=1, BW=1628KiB/s (1667kB/s)(5120KiB/3145msec) clat (usec): min=525, max=383317, avg=187689.01, stdev=172941.27 lat (usec): min=526, max=383318, avg=187690.21, stdev=172941.17 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 21890], 40.00th=[ 21890], 50.00th=[210764], 60.00th=[210764], | 70.00th=[325059], 80.00th=[325059], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 3946, max= 4079, per=93.62%, avg=4012.50, stdev=94.05, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2279KiB/s (2334kB/s)(7168KiB/3145msec); 0 zone resets clat (msec): min=174, max=415, avg=308.19, stdev=87.42 lat (msec): min=174, max=415, avg=308.28, stdev=87.43 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 241], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 409], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1484, max= 4047, per=39.78%, avg=2386.75, stdev=1134.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=25.00%, 500=58.33% cpu : usr=0.00%, sys=13.26%, ctx=204, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4286KiB/s (4389kB/s), 429KiB/s-1817KiB/s (439kB/s-1861kB/s), io=20.0MiB (20.0MB), run=3145-4778msec WRITE: bw=6001KiB/s (6145kB/s), 1298KiB/s-2279KiB/s (1329kB/s-2334kB/s), io=28.0MiB (29.4MB), run=3145-4778msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145947: Fri Sep 11 07:59:20 2026 read: IOPS=1, BW=1809KiB/s (1853kB/s)(7168KiB/3962msec) clat (msec): min=132, max=521, avg=259.86, stdev=144.14 lat (msec): min=132, max=521, avg=259.87, stdev=144.14 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 146], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 218], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 397], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1858, max= 2035, per=55.97%, avg=1990.33, stdev=65.98, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=1, BW=1292KiB/s (1323kB/s)(5120KiB/3962msec); 0 zone resets clat (msec): min=273, max=606, avg=398.35, stdev=145.77 lat (msec): min=273, max=606, avg=398.46, stdev=145.77 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2007, max= 4079, per=54.29%, avg=2703.00, stdev=1191.68, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=3.81%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145950: Fri Sep 11 07:59:20 2026 read: IOPS=0, BW=363KiB/s (372kB/s)(2048KiB/5643msec) clat (msec): min=91, max=141, avg=116.33, stdev=35.27 lat (msec): min=91, max=141, avg=116.33, stdev=35.27 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 142], 95.00th=[ 142], | 99.00th=[ 142], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 2000, max= 2007, per=56.34%, avg=2003.50, stdev= 4.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1815KiB/s (1858kB/s)(10.0MiB/5643msec); 0 zone resets clat (msec): min=173, max=1063, avg=486.05, stdev=247.86 lat (msec): min=173, max=1064, avg=486.41, stdev=247.84 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 279], | 30.00th=[ 338], 40.00th=[ 351], 50.00th=[ 456], 60.00th=[ 468], | 70.00th=[ 502], 80.00th=[ 575], 90.00th=[ 651], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1996, max= 4087, per=61.00%, avg=3037.17, stdev=1132.59, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=3.79%, ctx=119, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145951: Fri Sep 11 07:59:20 2026 read: IOPS=1, BW=1109KiB/s (1135kB/s)(6144KiB/5542msec) clat (msec): min=123, max=482, avg=273.25, stdev=133.68 lat (msec): min=124, max=482, avg=273.25, stdev=133.69 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 243], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 2007, max= 3946, per=70.55%, avg=2508.75, stdev=958.30, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1109KiB/s (1135kB/s)(6144KiB/5542msec); 0 zone resets clat (msec): min=304, max=1387, avg=591.86, stdev=408.88 lat (msec): min=304, max=1388, avg=591.96, stdev=408.89 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 464], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 2000, max= 2043, per=40.60%, avg=2021.60, stdev=19.02, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.01%, ctx=111, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145953: Fri Sep 11 07:59:20 2026 read: IOPS=0, BW=889KiB/s (911kB/s)(5120KiB/5758msec) clat (msec): min=82, max=475, avg=269.89, stdev=176.35 lat (msec): min=82, max=475, avg=269.89, stdev=176.35 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2007, max= 3946, per=74.95%, avg=2665.33, stdev=1109.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1245KiB/s (1275kB/s)(7168KiB/5758msec); 0 zone resets clat (msec): min=184, max=1372, avg=586.04, stdev=455.31 lat (msec): min=184, max=1372, avg=586.18, stdev=455.33 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 236], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 330], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 877], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 2007, max= 5988, per=56.59%, avg=2817.60, stdev=1772.35, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.05%, sys=3.67%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3557KiB/s (3642kB/s), 363KiB/s-1809KiB/s (372kB/s-1853kB/s), io=20.0MiB (20.0MB), run=3962-5758msec WRITE: bw=4980KiB/s (5099kB/s), 1109KiB/s-1815KiB/s (1135kB/s-1858kB/s), io=28.0MiB (29.4MB), run=3962-5758msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145964: Fri Sep 11 07:59:33 2026 read: IOPS=0, BW=3547KiB/s (3632kB/s)(12.0MiB/3464msec) clat (msec): min=898, max=1198, avg=1061.74, stdev=151.84 lat (msec): min=898, max=1198, avg=1061.74, stdev=151.84 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8047, max= 8078, per=100.00%, avg=8062.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.90%, ctx=312, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145965: Fri Sep 11 07:59:33 2026 read: IOPS=0, BW=1037KiB/s (1062kB/s)(4096KiB/3949msec) clat (nsec): min=814429k, max=814429k, avg=814428659.00, stdev= 0.00 lat (nsec): min=814431k, max=814431k, avg=814431406.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2074KiB/s (2124kB/s)(8192KiB/3949msec); 0 zone resets clat (msec): min=983, max=1878, avg=1431.18, stdev=632.67 lat (msec): min=984, max=1878, avg=1431.75, stdev=632.48 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 1871], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.44%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145966: Fri Sep 11 07:59:33 2026 write: IOPS=0, BW=2512KiB/s (2573kB/s)(12.0MiB/4891msec); 0 zone resets clat (msec): min=484, max=2288, avg=1545.45, stdev=943.18 lat (msec): min=495, max=2288, avg=1551.02, stdev=938.10 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 1871], 50.00th=[ 1871], 60.00th=[ 1871], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7953, max= 8159, per=100.00%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.23%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145967: Fri Sep 11 07:59:33 2026 write: IOPS=0, BW=3633KiB/s (3721kB/s)(12.0MiB/3382msec); 0 zone resets clat (msec): min=634, max=1661, avg=1077.62, stdev=528.01 lat (msec): min=634, max=1665, avg=1079.18, stdev=529.74 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7831, max= 8047, per=100.00%, avg=7939.00, stdev=152.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=5.15%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4149KiB/s (4248kB/s), 1037KiB/s-3547KiB/s (1062kB/s-3632kB/s), io=16.0MiB (16.8MB), run=3464-3949msec WRITE: bw=6700KiB/s (6860kB/s), 2074KiB/s-3633KiB/s (2124kB/s-3721kB/s), io=32.0MiB (33.6MB), run=3382-4891msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145960: Fri Sep 11 07:59:34 2026 read: IOPS=0, BW=3056KiB/s (3129kB/s)(12.0MiB/4021msec) clat (msec): min=221, max=2275, avg=1264.63, stdev=1027.07 lat (msec): min=221, max=2275, avg=1264.63, stdev=1027.07 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=2.59%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145961: Fri Sep 11 07:59:34 2026 read: IOPS=0, BW=814KiB/s (833kB/s)(4096KiB/5034msec) clat (nsec): min=1385.3M, max=1385.3M, avg=1385290702.00, stdev= 0.00 lat (nsec): min=1385.3M, max=1385.3M, avg=1385293039.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1627KiB/s (1666kB/s)(8192KiB/5034msec); 0 zone resets clat (msec): min=1210, max=2249, avg=1729.92, stdev=735.24 lat (msec): min=1210, max=2261, avg=1736.18, stdev=743.48 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 7787, max= 7787, per=100.00%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.09%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145962: Fri Sep 11 07:59:34 2026 write: IOPS=1, BW=6994KiB/s (7162kB/s)(12.0MiB/1757msec); 0 zone resets clat (msec): min=349, max=715, avg=535.19, stdev=182.79 lat (msec): min=351, max=715, avg=537.46, stdev=182.25 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 5688, max= 8143, per=100.00%, avg=6915.50, stdev=1735.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=6.66%, ctx=49, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145963: Fri Sep 11 07:59:34 2026 write: IOPS=1, BW=4234KiB/s (4336kB/s)(12.0MiB/2902msec); 0 zone resets clat (msec): min=525, max=1476, avg=933.93, stdev=489.43 lat (msec): min=525, max=1476, avg=934.33, stdev=489.44 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=3.72%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3255KiB/s (3333kB/s), 814KiB/s-3056KiB/s (833kB/s-3129kB/s), io=16.0MiB (16.8MB), run=4021-5034msec WRITE: bw=6509KiB/s (6666kB/s), 1627KiB/s-6994KiB/s (1666kB/s-7162kB/s), io=32.0MiB (33.6MB), run=1757-5034msec