== sanity test 398b: DIO and buffer IO race ============== 12:06:33 (1788537993) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.72908 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144619: Fri Sep 4 12:09:09 2026 read: IOPS=10, BW=43.0KiB/s (45.0kB/s)(5992KiB/136213msec) clat (usec): min=28, max=447112, avg=43354.61, stdev=34297.62 lat (usec): min=28, max=447114, avg=43358.49, stdev=34298.13 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 1369], 20.00th=[ 20055], | 30.00th=[ 25822], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[156238], 99.50th=[196084], 99.90th=[396362], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 119, per=25.57%, avg=44.50, stdev=20.17, samples=262 iops : min= 1, max= 29, avg=10.51, stdev= 5.08, samples=262 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6296KiB/136213msec); 0 zone resets clat (usec): min=796, max=614167, avg=44968.08, stdev=51034.22 lat (usec): min=797, max=614169, avg=44971.37, stdev=51035.05 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1778], 20.00th=[ 4490], | 30.00th=[ 9896], 40.00th=[ 20841], 50.00th=[ 32637], 60.00th=[ 45351], | 70.00th=[ 56361], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[130548], | 99.00th=[238027], 99.50th=[265290], 99.90th=[522191], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 112, per=25.31%, avg=46.06, stdev=20.72, samples=266 iops : min= 1, max= 28, avg=10.91, stdev= 5.20, samples=266 lat (usec) : 50=0.59%, 100=3.58%, 250=0.42%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=5.79%, 4=3.52%, 10=6.48%, 20=9.11%, 50=35.55% lat (msec) : 100=26.69%, 250=7.45%, 500=0.42%, 750=0.07% cpu : usr=0.09%, sys=5.09%, ctx=6561, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144620: Fri Sep 4 12:09:09 2026 read: IOPS=10, BW=43.6KiB/s (44.6kB/s)(5940KiB/136308msec) clat (usec): min=30, max=425066, avg=43686.80, stdev=35113.64 lat (usec): min=31, max=425068, avg=43689.51, stdev=35114.77 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 9372], 20.00th=[ 19006], | 30.00th=[ 24773], 40.00th=[ 30016], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[158335], 99.50th=[181404], 99.90th=[413139], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 6, max= 110, per=25.23%, avg=43.90, stdev=20.48, samples=264 iops : min= 1, max= 27, avg=10.36, stdev= 5.16, samples=264 write: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6348KiB/136308msec); 0 zone resets clat (usec): min=933, max=639810, avg=44712.73, stdev=51420.20 lat (usec): min=934, max=639812, avg=44714.86, stdev=51419.61 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1254], 10.00th=[ 1942], 20.00th=[ 4686], | 30.00th=[ 9241], 40.00th=[ 19268], 50.00th=[ 31065], 60.00th=[ 42730], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[103285], 95.00th=[132645], | 99.00th=[225444], 99.50th=[278922], 99.90th=[492831], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 112, per=25.42%, avg=46.26, stdev=20.70, samples=268 iops : min= 1, max= 28, avg=10.96, stdev= 5.23, samples=268 lat (usec) : 50=0.52%, 100=3.26%, 250=0.42%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=5.34%, 4=4.17%, 10=6.93%, 20=10.35%, 50=34.73% lat (msec) : 100=25.29%, 250=8.11%, 500=0.42%, 750=0.03% cpu : usr=0.06%, sys=5.04%, ctx=6632, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144622: Fri Sep 4 12:09:09 2026 read: IOPS=11, BW=44.2KiB/s (45.2kB/s)(6028KiB/136484msec) clat (usec): min=27, max=709587, avg=43736.26, stdev=40656.21 lat (usec): min=27, max=709588, avg=43740.00, stdev=40655.52 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 215], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[149947], 99.50th=[252707], 99.90th=[442500], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 127, per=25.33%, avg=44.07, stdev=21.90, samples=267 iops : min= 1, max= 31, avg=10.40, stdev= 5.51, samples=267 write: IOPS=11, BW=45.9KiB/s (46.0kB/s)(6260KiB/136484msec); 0 zone resets clat (usec): min=988, max=512383, avg=44807.37, stdev=48780.63 lat (usec): min=988, max=512384, avg=44809.65, stdev=48780.32 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1647], 20.00th=[ 4686], | 30.00th=[ 9241], 40.00th=[ 19530], 50.00th=[ 32113], 60.00th=[ 42730], | 70.00th=[ 56886], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[139461], | 99.00th=[219153], 99.50th=[235930], 99.90th=[346031], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 7, max= 127, per=25.36%, avg=46.15, stdev=20.67, samples=265 iops : min= 1, max= 31, avg=10.92, stdev= 5.21, samples=265 lat (usec) : 50=0.62%, 100=3.84%, 250=0.46%, 500=0.26%, 1000=0.07% lat (msec) : 2=5.66%, 4=3.78%, 10=6.54%, 20=9.80%, 50=35.90% lat (msec) : 100=24.58%, 250=8.01%, 500=0.42%, 750=0.07% cpu : usr=0.07%, sys=5.05%, ctx=6494, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144623: Fri Sep 4 12:09:09 2026 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6052KiB/137454msec) clat (usec): min=33, max=705556, avg=43666.75, stdev=38478.82 lat (usec): min=33, max=705557, avg=43668.63, stdev=38479.16 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 1680], 20.00th=[ 19268], | 30.00th=[ 24511], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 63177], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[168821], 99.50th=[187696], 99.90th=[480248], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=43.52, stdev=20.18, samples=270 iops : min= 1, max= 27, avg=10.27, stdev= 5.07, samples=270 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6236KiB/137454msec); 0 zone resets clat (usec): min=969, max=531013, avg=45506.64, stdev=49210.10 lat (usec): min=970, max=531015, avg=45508.45, stdev=49209.87 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1270], 10.00th=[ 2147], 20.00th=[ 4948], | 30.00th=[ 10028], 40.00th=[ 21365], 50.00th=[ 31065], 60.00th=[ 43254], | 70.00th=[ 59507], 80.00th=[ 78119], 90.00th=[107480], 95.00th=[137364], | 99.00th=[221250], 99.50th=[254804], 99.90th=[442500], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 119, per=24.65%, avg=44.87, stdev=21.02, samples=270 iops : min= 1, max= 29, avg=10.60, stdev= 5.28, samples=270 lat (usec) : 50=0.55%, 100=3.71%, 250=0.46%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.82%, 4=4.13%, 10=6.58%, 20=9.96%, 50=36.26% lat (msec) : 100=24.22%, 250=8.72%, 500=0.29%, 750=0.07% cpu : usr=0.08%, sys=4.96%, ctx=6498, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=175KiB/s (179kB/s), 43.6KiB/s-44.2KiB/s (44.6kB/s-45.2kB/s), io=23.4MiB (24.6MB), run=136213-137454msec WRITE: bw=183KiB/s (187kB/s), 45.4KiB/s-46.6KiB/s (46.5kB/s-47.7kB/s), io=24.6MiB (25.7MB), run=136213-137454msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144624: Fri Sep 4 12:11:37 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(5992KiB/282428msec) clat (msec): min=5, max=855, avg=37.24, stdev=43.38 lat (msec): min=5, max=855, avg=37.24, stdev=43.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 79], 95.00th=[ 114], | 99.00th=[ 199], 99.50th=[ 236], 99.90th=[ 397], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 87, per=29.08%, avg=24.43, stdev=16.10, samples=474 iops : min= 1, max= 21, avg= 5.51, stdev= 4.10, samples=474 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6296KiB/282428msec); 0 zone resets clat (msec): min=39, max=865, avg=143.78, stdev=79.12 lat (msec): min=39, max=865, avg=143.78, stdev=79.12 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 192], 90.00th=[ 243], 95.00th=[ 305], | 99.00th=[ 422], 99.50th=[ 456], 99.90th=[ 567], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 48, per=25.25%, avg=22.22, stdev=10.79, samples=545 iops : min= 1, max= 12, avg= 4.95, stdev= 2.78, samples=545 lat (msec) : 10=3.42%, 20=15.56%, 50=20.90%, 100=22.53%, 250=32.81% lat (msec) : 500=4.62%, 750=0.10%, 1000=0.07% cpu : usr=0.04%, sys=1.11%, ctx=5414, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144625: Fri Sep 4 12:11:37 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(5940KiB/284651msec) clat (msec): min=5, max=654, avg=36.91, stdev=42.42 lat (msec): min=5, max=654, avg=36.91, stdev=42.42 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 186], 99.50th=[ 234], 99.90th=[ 550], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 79, per=28.86%, avg=24.24, stdev=16.41, samples=474 iops : min= 1, max= 19, avg= 5.47, stdev= 4.15, samples=474 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6348KiB/284651msec); 0 zone resets clat (msec): min=40, max=872, avg=144.59, stdev=81.60 lat (msec): min=40, max=872, avg=144.59, stdev=81.60 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 194], 90.00th=[ 249], 95.00th=[ 296], | 99.00th=[ 447], 99.50th=[ 493], 99.90th=[ 718], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 64, per=25.06%, avg=22.06, stdev=11.19, samples=555 iops : min= 1, max= 16, avg= 4.91, stdev= 2.89, samples=555 lat (msec) : 10=3.74%, 20=15.85%, 50=19.82%, 100=23.44%, 250=31.90% lat (msec) : 500=4.95%, 750=0.26%, 1000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5471, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144626: Fri Sep 4 12:11:37 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6028KiB/281938msec) clat (msec): min=5, max=550, avg=37.50, stdev=40.70 lat (msec): min=5, max=550, avg=37.51, stdev=40.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 114], | 99.00th=[ 201], 99.50th=[ 241], 99.90th=[ 393], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 111, per=28.71%, avg=24.12, stdev=16.77, samples=483 iops : min= 1, max= 27, avg= 5.43, stdev= 4.22, samples=483 write: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6260KiB/281938msec); 0 zone resets clat (msec): min=42, max=853, avg=143.85, stdev=80.74 lat (msec): min=42, max=853, avg=143.86, stdev=80.74 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 122], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 192], 90.00th=[ 241], 95.00th=[ 309], | 99.00th=[ 414], 99.50th=[ 489], 99.90th=[ 718], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 56, per=25.16%, avg=22.14, stdev=10.97, samples=544 iops : min= 1, max= 14, avg= 4.93, stdev= 2.84, samples=544 lat (msec) : 10=3.87%, 20=15.66%, 50=20.15%, 100=22.88%, 250=32.78% lat (msec) : 500=4.39%, 750=0.23%, 1000=0.03% cpu : usr=0.03%, sys=1.13%, ctx=5384, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144627: Fri Sep 4 12:11:37 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6052KiB/283110msec) clat (msec): min=5, max=846, avg=36.82, stdev=41.24 lat (msec): min=5, max=846, avg=36.82, stdev=41.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 82], 95.00th=[ 114], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 292], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 96, per=29.12%, avg=24.46, stdev=16.91, samples=479 iops : min= 1, max= 24, avg= 5.52, stdev= 4.29, samples=479 write: IOPS=5, BW=22.0KiB/s (22.6kB/s)(6236KiB/283110msec); 0 zone resets clat (msec): min=36, max=776, avg=145.57, stdev=77.87 lat (msec): min=36, max=776, avg=145.58, stdev=77.87 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 85], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 249], 95.00th=[ 300], | 99.00th=[ 418], 99.50th=[ 447], 99.90th=[ 567], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 48, per=24.70%, avg=21.73, stdev=10.65, samples=553 iops : min= 1, max= 12, avg= 4.83, stdev= 2.75, samples=553 lat (msec) : 10=4.07%, 20=16.31%, 50=19.60%, 100=22.23%, 250=32.78% lat (msec) : 500=4.88%, 750=0.07%, 1000=0.07% cpu : usr=0.04%, sys=1.10%, ctx=5241, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=84.4KiB/s (86.4kB/s), 20.9KiB/s-21.4KiB/s (21.4kB/s-21.9kB/s), io=23.4MiB (24.6MB), run=281938-284651msec WRITE: bw=88.3KiB/s (90.4kB/s), 22.0KiB/s-22.3KiB/s (22.6kB/s-22.8kB/s), io=24.6MiB (25.7MB), run=281938-284651msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144681: Fri Sep 4 12:12:10 2026 read: IOPS=14, BW=239KiB/s (245kB/s)(5920KiB/24742msec) clat (usec): min=36, max=197032, avg=34357.51, stdev=28160.46 lat (usec): min=37, max=197033, avg=34358.52, stdev=28160.51 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 133], | 30.00th=[ 20579], 40.00th=[ 26870], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 44827], 80.00th=[ 53740], 90.00th=[ 66847], 95.00th=[ 78119], | 99.00th=[152044], 99.50th=[162530], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 86, max= 474, per=24.31%, avg=235.33, stdev=82.04, samples=48 iops : min= 5, max= 29, avg=13.98, stdev= 5.14, samples=48 write: IOPS=16, BW=257KiB/s (264kB/s)(6368KiB/24742msec); 0 zone resets clat (usec): min=1348, max=144185, avg=29404.50, stdev=30498.38 lat (usec): min=1349, max=144188, avg=29407.04, stdev=30498.06 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1696], 10.00th=[ 2409], 20.00th=[ 4817], | 30.00th=[ 6718], 40.00th=[ 10683], 50.00th=[ 17433], 60.00th=[ 28181], | 70.00th=[ 38011], 80.00th=[ 52167], 90.00th=[ 71828], 95.00th=[ 96994], | 99.00th=[125305], 99.50th=[141558], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 28, max= 477, per=25.09%, avg=255.46, stdev=98.28, samples=48 iops : min= 1, max= 29, avg=15.23, stdev= 6.19, samples=48 lat (usec) : 50=1.95%, 100=6.90%, 250=0.91%, 750=0.26% lat (msec) : 2=4.30%, 4=4.43%, 10=11.98%, 20=10.16%, 50=36.59% lat (msec) : 100=19.14%, 250=3.39% cpu : usr=0.08%, sys=6.34%, ctx=1452, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144682: Fri Sep 4 12:12:10 2026 read: IOPS=14, BW=235KiB/s (241kB/s)(5744KiB/24447msec) clat (usec): min=37, max=196180, avg=35132.82, stdev=27212.46 lat (usec): min=37, max=196180, avg=35133.83, stdev=27212.52 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 12125], | 30.00th=[ 22676], 40.00th=[ 27132], 50.00th=[ 32113], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 55313], 90.00th=[ 64750], 95.00th=[ 79168], | 99.00th=[137364], 99.50th=[145753], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 58, max= 509, per=24.18%, avg=234.10, stdev=92.43, samples=48 iops : min= 3, max= 31, avg=13.90, stdev= 5.83, samples=48 write: IOPS=16, BW=268KiB/s (274kB/s)(6544KiB/24447msec); 0 zone resets clat (usec): min=1419, max=275735, avg=28738.35, stdev=31753.30 lat (usec): min=1420, max=275736, avg=28758.22, stdev=31743.90 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1811], 10.00th=[ 2442], 20.00th=[ 4555], | 30.00th=[ 7242], 40.00th=[ 11469], 50.00th=[ 17957], 60.00th=[ 27657], | 70.00th=[ 37487], 80.00th=[ 51119], 90.00th=[ 66847], 95.00th=[ 84411], | 99.00th=[127402], 99.50th=[168821], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 63, max= 573, per=26.14%, avg=266.10, stdev=108.35, samples=48 iops : min= 3, max= 35, avg=15.90, stdev= 6.81, samples=48 lat (usec) : 50=1.30%, 100=5.99%, 250=0.78%, 500=0.26%, 750=0.26% lat (msec) : 2=3.91%, 4=5.34%, 10=11.07%, 20=11.46%, 50=36.20% lat (msec) : 100=21.22%, 250=2.08%, 500=0.13% cpu : usr=0.09%, sys=6.97%, ctx=1476, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144683: Fri Sep 4 12:12:10 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(6256KiB/24555msec) clat (usec): min=38, max=163891, avg=32721.99, stdev=27278.41 lat (usec): min=39, max=163892, avg=32723.19, stdev=27278.19 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 62], 20.00th=[ 122], | 30.00th=[ 19268], 40.00th=[ 26608], 50.00th=[ 30278], 60.00th=[ 35390], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 64226], 95.00th=[ 79168], | 99.00th=[143655], 99.50th=[160433], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 539, per=26.43%, avg=255.88, stdev=108.64, samples=48 iops : min= 3, max= 33, avg=15.27, stdev= 6.86, samples=48 write: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24555msec); 0 zone resets clat (usec): min=1380, max=287379, avg=30678.42, stdev=33958.29 lat (usec): min=1381, max=287381, avg=30680.31, stdev=33958.35 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1778], 10.00th=[ 2442], 20.00th=[ 5014], | 30.00th=[ 7111], 40.00th=[ 10421], 50.00th=[ 16319], 60.00th=[ 28181], | 70.00th=[ 38011], 80.00th=[ 53216], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[164627], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 63, max= 478, per=23.83%, avg=242.54, stdev=101.34, samples=48 iops : min= 3, max= 29, avg=14.44, stdev= 6.37, samples=48 lat (usec) : 50=1.56%, 100=8.07%, 250=1.30%, 500=0.13%, 1000=0.26% lat (msec) : 2=4.04%, 4=4.30%, 10=10.94%, 20=10.81%, 50=37.11% lat (msec) : 100=18.62%, 250=2.73%, 500=0.13% cpu : usr=0.11%, sys=6.74%, ctx=1557, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144684: Fri Sep 4 12:12:10 2026 read: IOPS=15, BW=251KiB/s (258kB/s)(6032KiB/23985msec) clat (usec): min=39, max=196100, avg=31771.67, stdev=29273.06 lat (usec): min=39, max=196100, avg=31772.65, stdev=29273.12 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 94], | 30.00th=[ 18482], 40.00th=[ 23987], 50.00th=[ 28967], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 48497], 90.00th=[ 62653], 95.00th=[ 78119], | 99.00th=[164627], 99.50th=[183501], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 95, max= 442, per=25.82%, avg=249.94, stdev=94.02, samples=47 iops : min= 5, max= 27, avg=14.89, stdev= 5.93, samples=47 write: IOPS=16, BW=261KiB/s (267kB/s)(6256KiB/23985msec); 0 zone resets clat (usec): min=1254, max=261033, avg=29723.37, stdev=34000.85 lat (usec): min=1254, max=261035, avg=29727.32, stdev=33999.52 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1795], 10.00th=[ 2409], 20.00th=[ 4752], | 30.00th=[ 6915], 40.00th=[ 10683], 50.00th=[ 16909], 60.00th=[ 26346], | 70.00th=[ 35914], 80.00th=[ 50594], 90.00th=[ 70779], 95.00th=[ 93848], | 99.00th=[160433], 99.50th=[204473], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 95, max= 660, per=25.58%, avg=260.38, stdev=109.30, samples=47 iops : min= 5, max= 41, avg=15.57, stdev= 6.89, samples=47 lat (usec) : 50=1.30%, 100=8.59%, 250=1.95%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=3.39%, 4=4.95%, 10=11.20%, 20=10.81%, 50=37.89% lat (msec) : 100=15.89%, 250=3.12%, 500=0.13% cpu : usr=0.06%, sys=7.04%, ctx=1461, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=968KiB/s (991kB/s), 235KiB/s-255KiB/s (241kB/s-261kB/s), io=23.4MiB (24.5MB), run=23985-24742msec WRITE: bw=1019KiB/s (1043kB/s), 246KiB/s-268KiB/s (252kB/s-274kB/s), io=24.6MiB (25.8MB), run=23985-24742msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144686: Fri Sep 4 12:12:47 2026 read: IOPS=6, BW=96.1KiB/s (98.5kB/s)(5920KiB/61572msec) clat (msec): min=6, max=261, avg=30.18, stdev=33.08 lat (msec): min=6, max=261, avg=30.18, stdev=33.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 59], 95.00th=[ 93], | 99.00th=[ 171], 99.50th=[ 249], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 319, per=27.96%, avg=107.39, stdev=62.15, samples=109 iops : min= 1, max= 19, avg= 5.96, stdev= 3.95, samples=109 write: IOPS=6, BW=103KiB/s (106kB/s)(6368KiB/61572msec); 0 zone resets clat (msec): min=49, max=421, avg=125.92, stdev=59.19 lat (msec): min=49, max=421, avg=125.92, stdev=59.20 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 64], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 101], 50.00th=[ 109], 60.00th=[ 123], | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 199], 95.00th=[ 257], | 99.00th=[ 342], 99.50th=[ 388], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 31, max= 191, per=25.94%, avg=104.82, stdev=44.33, samples=120 iops : min= 1, max= 11, avg= 5.78, stdev= 2.87, samples=120 lat (msec) : 10=2.47%, 20=23.70%, 50=16.02%, 100=25.26%, 250=29.82% lat (msec) : 500=2.73% cpu : usr=0.05%, sys=1.30%, ctx=1331, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144687: Fri Sep 4 12:12:47 2026 read: IOPS=5, BW=92.3KiB/s (94.5kB/s)(5744KiB/62225msec) clat (msec): min=6, max=304, avg=31.61, stdev=35.83 lat (msec): min=6, max=304, avg=31.61, stdev=35.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 67], 95.00th=[ 101], | 99.00th=[ 203], 99.50th=[ 234], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 27, max= 318, per=26.91%, avg=103.33, stdev=71.16, samples=110 iops : min= 1, max= 19, avg= 5.71, stdev= 4.53, samples=110 write: IOPS=6, BW=105KiB/s (108kB/s)(6544KiB/62225msec); 0 zone resets clat (msec): min=40, max=340, avg=124.06, stdev=53.24 lat (msec): min=40, max=340, avg=124.06, stdev=53.24 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 125], | 70.00th=[ 136], 80.00th=[ 157], 90.00th=[ 194], 95.00th=[ 239], | 99.00th=[ 300], 99.50th=[ 338], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 27, max= 192, per=26.15%, avg=105.65, stdev=42.56, samples=122 iops : min= 1, max= 12, avg= 5.84, stdev= 2.75, samples=122 lat (msec) : 10=3.39%, 20=18.75%, 50=18.49%, 100=23.57%, 250=33.20% lat (msec) : 500=2.60% cpu : usr=0.03%, sys=1.28%, ctx=1293, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144688: Fri Sep 4 12:12:47 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(6256KiB/60053msec) clat (msec): min=6, max=290, avg=31.70, stdev=35.16 lat (msec): min=6, max=290, avg=31.70, stdev=35.16 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 64], 95.00th=[ 112], | 99.00th=[ 180], 99.50th=[ 255], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 320, per=29.24%, avg=112.30, stdev=69.57, samples=110 iops : min= 1, max= 20, avg= 6.25, stdev= 4.43, samples=110 write: IOPS=6, BW=100KiB/s (103kB/s)(6032KiB/60053msec); 0 zone resets clat (msec): min=38, max=336, avg=125.34, stdev=50.91 lat (msec): min=38, max=336, avg=125.34, stdev=50.91 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 116], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 203], 95.00th=[ 226], | 99.00th=[ 279], 99.50th=[ 326], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 27, max= 191, per=25.27%, avg=102.08, stdev=39.42, samples=115 iops : min= 1, max= 11, avg= 5.61, stdev= 2.54, samples=115 lat (msec) : 10=2.73%, 20=22.53%, 50=19.53%, 100=22.27%, 250=31.25% lat (msec) : 500=1.69% cpu : usr=0.03%, sys=1.31%, ctx=1295, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144689: Fri Sep 4 12:12:47 2026 read: IOPS=6, BW=98.0KiB/s (100kB/s)(6032KiB/61523msec) clat (msec): min=6, max=293, avg=33.20, stdev=35.42 lat (msec): min=6, max=293, avg=33.20, stdev=35.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 77], 95.00th=[ 116], | 99.00th=[ 167], 99.50th=[ 220], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 352, per=26.98%, avg=103.62, stdev=66.22, samples=113 iops : min= 1, max= 22, avg= 5.71, stdev= 4.22, samples=113 write: IOPS=6, BW=102KiB/s (104kB/s)(6256KiB/61523msec); 0 zone resets clat (msec): min=46, max=320, avg=124.05, stdev=52.29 lat (msec): min=46, max=320, avg=124.06, stdev=52.30 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 83], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 140], 80.00th=[ 159], 90.00th=[ 192], 95.00th=[ 234], | 99.00th=[ 305], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 191, per=25.86%, avg=104.46, stdev=40.81, samples=117 iops : min= 1, max= 11, avg= 5.76, stdev= 2.60, samples=117 lat (msec) : 10=2.60%, 20=20.70%, 50=18.23%, 100=25.00%, 250=31.64% lat (msec) : 500=1.82% cpu : usr=0.03%, sys=1.33%, ctx=1387, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=385KiB/s (394kB/s), 92.3KiB/s-104KiB/s (94.5kB/s-107kB/s), io=23.4MiB (24.5MB), run=60053-62225msec WRITE: bw=405KiB/s (415kB/s), 100KiB/s-105KiB/s (103kB/s-108kB/s), io=24.6MiB (25.8MB), run=60053-62225msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144705: Fri Sep 4 12:13:03 2026 read: IOPS=1, BW=1727KiB/s (1768kB/s)(7168KiB/4151msec) clat (msec): min=106, max=513, avg=192.38, stdev=144.29 lat (msec): min=106, max=513, avg=192.38, stdev=144.28 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 112], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 140], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1957, max= 5941, per=100.00%, avg=3935.33, stdev=1992.14, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1233KiB/s (1263kB/s)(5120KiB/4151msec); 0 zone resets clat (msec): min=391, max=852, avg=547.56, stdev=191.55 lat (msec): min=391, max=852, avg=547.65, stdev=191.55 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1984, max= 3893, per=53.36%, avg=2621.67, stdev=1101.01, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=2.65%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144706: Fri Sep 4 12:13:03 2026 read: IOPS=0, BW=351KiB/s (359kB/s)(2048KiB/5835msec) clat (msec): min=146, max=174, avg=160.50, stdev=19.93 lat (msec): min=146, max=174, avg=160.51, stdev=19.93 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 1812, max= 2019, per=54.59%, avg=1915.50, stdev=146.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1755KiB/s (1797kB/s)(10.0MiB/5835msec); 0 zone resets clat (msec): min=174, max=1105, avg=539.44, stdev=318.54 lat (msec): min=175, max=1105, avg=539.98, stdev=318.31 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 279], | 30.00th=[ 347], 40.00th=[ 355], 50.00th=[ 409], 60.00th=[ 447], | 70.00th=[ 456], 80.00th=[ 827], 90.00th=[ 995], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1957, max= 4096, per=52.32%, avg=2570.29, stdev=979.95, samples=7 iops : min= 1, max= 4, avg= 1.86, stdev= 1.21, samples=7 lat (msec) : 250=25.00%, 500=50.00%, 1000=16.67%, 2000=8.33% cpu : usr=0.02%, sys=3.70%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144707: Fri Sep 4 12:13:03 2026 read: IOPS=1, BW=1060KiB/s (1085kB/s)(6144KiB/5796msec) clat (msec): min=94, max=1190, avg=439.08, stdev=408.05 lat (msec): min=94, max=1190, avg=439.08, stdev=408.05 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 363], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1921, max= 2048, per=57.10%, avg=2003.60, stdev=48.61, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1060KiB/s (1085kB/s)(6144KiB/5796msec); 0 zone resets clat (msec): min=246, max=1216, avg=508.27, stdev=359.12 lat (msec): min=246, max=1216, avg=508.47, stdev=359.05 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 439], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1354, max= 2048, per=38.21%, avg=1877.40, stdev=295.24, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=2.45%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144708: Fri Sep 4 12:13:03 2026 read: IOPS=0, BW=954KiB/s (977kB/s)(5120KiB/5369msec) clat (msec): min=129, max=731, avg=356.09, stdev=262.39 lat (msec): min=129, max=731, avg=356.09, stdev=262.39 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1921, max= 3690, per=71.76%, avg=2518.00, stdev=1015.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1335KiB/s (1367kB/s)(7168KiB/5369msec); 0 zone resets clat (msec): min=187, max=918, avg=499.18, stdev=260.37 lat (msec): min=187, max=918, avg=499.28, stdev=260.35 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 213], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 464], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 659], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1406, max= 2027, per=38.30%, avg=1881.80, stdev=267.43, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=16.67%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=3.46%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3510KiB/s (3594kB/s), 351KiB/s-1727KiB/s (359kB/s-1768kB/s), io=20.0MiB (20.0MB), run=4151-5835msec WRITE: bw=4914KiB/s (5032kB/s), 1060KiB/s-1755KiB/s (1085kB/s-1797kB/s), io=28.0MiB (29.4MB), run=4151-5835msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144711: Fri Sep 4 12:13:03 2026 read: IOPS=1, BW=1823KiB/s (1867kB/s)(7168KiB/3931msec) clat (usec): min=1691, max=370409, avg=228952.00, stdev=115522.50 lat (usec): min=1692, max=370411, avg=228953.06, stdev=115522.60 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1696], 10.00th=[ 1696], 20.00th=[185598], | 30.00th=[229639], 40.00th=[229639], 50.00th=[256902], 60.00th=[267387], | 70.00th=[267387], 80.00th=[295699], 90.00th=[371196], 95.00th=[371196], | 99.00th=[371196], 99.50th=[371196], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 2015, max= 3813, per=77.27%, avg=2805.50, stdev=913.95, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1302KiB/s (1334kB/s)(5120KiB/3931msec); 0 zone resets clat (msec): min=152, max=906, avg=465.32, stdev=291.06 lat (msec): min=152, max=906, avg=465.41, stdev=291.04 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1910, max= 2048, per=39.30%, avg=1998.00, stdev=60.48, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.50%, ctx=190, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144712: Fri Sep 4 12:13:03 2026 read: IOPS=0, BW=363KiB/s (372kB/s)(2048KiB/5639msec) clat (usec): min=491, max=238686, avg=119588.78, stdev=168429.63 lat (usec): min=492, max=238688, avg=119590.47, stdev=168430.55 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 490], 40.00th=[ 490], 50.00th=[ 490], 60.00th=[238027], | 70.00th=[238027], 80.00th=[238027], 90.00th=[238027], 95.00th=[238027], | 99.00th=[238027], 99.50th=[238027], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 1514, max= 1976, per=48.06%, avg=1745.00, stdev=326.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1816KiB/s (1860kB/s)(10.0MiB/5639msec); 0 zone resets clat (msec): min=140, max=1129, avg=539.55, stdev=361.03 lat (msec): min=140, max=1129, avg=539.62, stdev=361.04 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 167], | 30.00th=[ 288], 40.00th=[ 388], 50.00th=[ 409], 60.00th=[ 426], | 70.00th=[ 489], 80.00th=[ 885], 90.00th=[ 1083], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1514, max= 6119, per=49.14%, avg=2498.14, stdev=1606.50, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (usec) : 500=8.33% lat (msec) : 250=25.00%, 500=41.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=9.81%, ctx=133, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144713: Fri Sep 4 12:13:03 2026 read: IOPS=1, BW=1249KiB/s (1279kB/s)(6144KiB/4918msec) clat (usec): min=558, max=446634, avg=209891.07, stdev=185045.38 lat (usec): min=560, max=446636, avg=209892.41, stdev=185045.12 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 1876], | 30.00th=[ 1876], 40.00th=[164627], 50.00th=[164627], 60.00th=[308282], | 70.00th=[337642], 80.00th=[337642], 90.00th=[446694], 95.00th=[446694], | 99.00th=[446694], 99.50th=[446694], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 1910, max= 4071, per=69.12%, avg=2509.75, stdev=1042.41, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1249KiB/s (1279kB/s)(6144KiB/4918msec); 0 zone resets clat (msec): min=61, max=1856, avg=607.32, stdev=633.08 lat (msec): min=61, max=1856, avg=608.99, stdev=632.47 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 447], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 1602, max= 2048, per=37.65%, avg=1914.20, stdev=182.89, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=8.33%, 500=50.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.06%, sys=6.77%, ctx=110, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144714: Fri Sep 4 12:13:03 2026 read: IOPS=1, BW=1142KiB/s (1170kB/s)(5120KiB/4482msec) clat (usec): min=425, max=306066, avg=194739.77, stdev=119703.84 lat (usec): min=426, max=306067, avg=194740.87, stdev=119703.91 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 424], | 30.00th=[166724], 40.00th=[166724], 50.00th=[242222], 60.00th=[242222], | 70.00th=[258999], 80.00th=[258999], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2015, max= 5930, per=100.00%, avg=3972.50, stdev=2768.32, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1599KiB/s (1638kB/s)(7168KiB/4482msec); 0 zone resets clat (msec): min=158, max=1671, avg=501.02, stdev=542.81 lat (msec): min=158, max=1671, avg=501.08, stdev=542.82 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 192], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 275], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 667], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1976, max= 4071, per=54.80%, avg=2786.00, stdev=1062.49, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=7.59%, ctx=175, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3632KiB/s (3719kB/s), 363KiB/s-1823KiB/s (372kB/s-1867kB/s), io=20.0MiB (20.0MB), run=3931-5639msec WRITE: bw=5085KiB/s (5207kB/s), 1249KiB/s-1816KiB/s (1279kB/s-1860kB/s), io=28.0MiB (29.4MB), run=3931-5639msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144721: Fri Sep 4 12:13:19 2026 read: IOPS=1, BW=4164KiB/s (4264kB/s)(12.0MiB/2951msec) clat (msec): min=744, max=1227, avg=932.81, stdev=258.51 lat (msec): min=744, max=1227, avg=932.81, stdev=258.51 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.97%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144722: Fri Sep 4 12:13:19 2026 read: IOPS=0, BW=1316KiB/s (1347kB/s)(4096KiB/3113msec) clat (nsec): min=982300k, max=982300k, avg=982300009.00, stdev= 0.00 lat (nsec): min=982303k, max=982303k, avg=982302599.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2632KiB/s (2695kB/s)(8192KiB/3113msec); 0 zone resets clat (msec): min=737, max=1294, avg=1015.85, stdev=393.55 lat (msec): min=737, max=1294, avg=1016.22, stdev=393.78 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8175, max= 8175, per=93.76%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.79%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144723: Fri Sep 4 12:13:19 2026 write: IOPS=0, BW=3270KiB/s (3348kB/s)(12.0MiB/3758msec); 0 zone resets clat (msec): min=438, max=1700, avg=1240.76, stdev=697.32 lat (msec): min=439, max=1700, avg=1241.50, stdev=696.65 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8175, max= 8192, per=93.86%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.39%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144725: Fri Sep 4 12:13:19 2026 write: IOPS=1, BW=4414KiB/s (4520kB/s)(12.0MiB/2784msec); 0 zone resets clat (msec): min=378, max=1514, avg=890.03, stdev=576.03 lat (msec): min=379, max=1514, avg=890.54, stdev=576.00 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8031, max= 8047, per=92.20%, avg=8039.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.65%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5263KiB/s (5389kB/s), 1316KiB/s-4164KiB/s (1347kB/s-4264kB/s), io=16.0MiB (16.8MB), run=2951-3113msec WRITE: bw=8720KiB/s (8929kB/s), 2632KiB/s-4414KiB/s (2695kB/s-4520kB/s), io=32.0MiB (33.6MB), run=2784-3758msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144724: Fri Sep 4 12:13:19 2026 read: IOPS=1, BW=4256KiB/s (4358kB/s)(12.0MiB/2887msec) clat (msec): min=854, max=1030, avg=915.71, stdev=99.53 lat (msec): min=854, max=1030, avg=915.71, stdev=99.53 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=16.56%, ctx=353, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144726: Fri Sep 4 12:13:19 2026 read: IOPS=0, BW=1462KiB/s (1497kB/s)(4096KiB/2801msec) clat (nsec): min=869305k, max=869305k, avg=869304942.00, stdev= 0.00 lat (nsec): min=869308k, max=869308k, avg=869307835.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2925KiB/s (2995kB/s)(8192KiB/2801msec); 0 zone resets clat (msec): min=447, max=1442, avg=945.00, stdev=703.62 lat (msec): min=448, max=1442, avg=945.49, stdev=703.23 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.07%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144727: Fri Sep 4 12:13:19 2026 write: IOPS=0, BW=2960KiB/s (3031kB/s)(12.0MiB/4151msec); 0 zone resets clat (msec): min=500, max=1937, avg=1371.37, stdev=765.68 lat (msec): min=500, max=1939, avg=1372.22, stdev=766.17 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.41%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144728: Fri Sep 4 12:13:19 2026 write: IOPS=1, BW=5196KiB/s (5320kB/s)(12.0MiB/2365msec); 0 zone resets clat (msec): min=330, max=1604, avg=765.15, stdev=726.71 lat (msec): min=330, max=1605, avg=765.85, stdev=727.01 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 5868, max= 8094, per=88.43%, avg=6981.00, stdev=1574.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.30%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5675KiB/s (5811kB/s), 1462KiB/s-4256KiB/s (1497kB/s-4358kB/s), io=16.0MiB (16.8MB), run=2801-2887msec WRITE: bw=7894KiB/s (8083kB/s), 2925KiB/s-5196KiB/s (2995kB/s-5320kB/s), io=32.0MiB (33.6MB), run=2365-4151msec