== sanity test 398b: DIO and buffer IO race ============== 11:43:33 (1787845413) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.99737 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178921: Thu Aug 27 11:46:07 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(5992KiB/130846msec) clat (usec): min=45, max=937947, avg=47312.57, stdev=40884.99 lat (usec): min=45, max=937948, avg=47317.68, stdev=40883.63 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 9896], 10.00th=[ 16909], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32375], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[181404], 99.50th=[206570], 99.90th=[304088], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 127, per=25.63%, avg=45.36, stdev=19.78, samples=258 iops : min= 1, max= 31, avg=10.67, stdev= 4.97, samples=258 write: IOPS=12, BW=48.1KiB/s (49.3kB/s)(6296KiB/130846msec); 0 zone resets clat (usec): min=984, max=339213, avg=37935.49, stdev=40985.40 lat (usec): min=986, max=339214, avg=37939.80, stdev=40985.52 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1762], 20.00th=[ 3982], | 30.00th=[ 7242], 40.00th=[ 16057], 50.00th=[ 26608], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 65274], 90.00th=[ 94897], 95.00th=[122160], | 99.00th=[173016], 99.50th=[202376], 99.90th=[252707], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 126, per=25.94%, avg=48.00, stdev=23.32, samples=256 iops : min= 1, max= 31, avg=11.33, stdev= 5.87, samples=256 lat (usec) : 50=0.10%, 100=1.79%, 250=0.26%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.15%, 4=4.17%, 10=7.42%, 20=9.86%, 50=38.77% lat (msec) : 100=23.40%, 250=7.85%, 500=0.10%, 1000=0.03% cpu : usr=0.06%, sys=4.70%, ctx=6584, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178922: Thu Aug 27 11:46:07 2026 read: IOPS=11, BW=44.9KiB/s (45.0kB/s)(5940KiB/132236msec) clat (usec): min=43, max=280932, avg=48421.04, stdev=31389.63 lat (usec): min=44, max=280933, avg=48424.36, stdev=31390.19 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 13435], 10.00th=[ 18220], 20.00th=[ 23725], | 30.00th=[ 29492], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[105382], | 99.00th=[158335], 99.50th=[173016], 99.90th=[244319], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 5, max= 96, per=25.10%, avg=44.42, stdev=17.97, samples=261 iops : min= 1, max= 24, avg=10.43, stdev= 4.53, samples=261 write: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6348KiB/132236msec); 0 zone resets clat (usec): min=1003, max=798852, avg=37827.67, stdev=44893.03 lat (usec): min=1004, max=798854, avg=37839.14, stdev=44897.45 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1319], 10.00th=[ 1909], 20.00th=[ 3818], | 30.00th=[ 7111], 40.00th=[ 15270], 50.00th=[ 25297], 60.00th=[ 35390], | 70.00th=[ 47973], 80.00th=[ 65274], 90.00th=[ 89654], 95.00th=[124257], | 99.00th=[173016], 99.50th=[198181], 99.90th=[371196], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 5, max= 119, per=25.87%, avg=47.86, stdev=21.88, samples=259 iops : min= 1, max= 29, avg=11.31, stdev= 5.50, samples=259 lat (usec) : 50=0.13%, 100=1.27%, 250=0.07%, 500=0.03% lat (msec) : 2=5.44%, 4=5.53%, 10=7.42%, 20=9.15%, 50=37.57% lat (msec) : 100=26.37%, 250=6.87%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=4.68%, ctx=6613, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178923: Thu Aug 27 11:46:07 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6028KiB/135415msec) clat (usec): min=31, max=395616, avg=48288.35, stdev=34705.34 lat (usec): min=31, max=395617, avg=48294.29, stdev=34706.82 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11469], 10.00th=[ 17433], 20.00th=[ 23462], | 30.00th=[ 28181], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[166724], 99.50th=[221250], 99.90th=[316670], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 142, per=25.20%, avg=44.61, stdev=19.33, samples=263 iops : min= 1, max= 35, avg=10.48, stdev= 4.87, samples=263 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6260KiB/135415msec); 0 zone resets clat (usec): min=999, max=870139, avg=39894.89, stdev=44693.72 lat (usec): min=1000, max=870142, avg=39897.47, stdev=44693.36 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1369], 10.00th=[ 2180], 20.00th=[ 4555], | 30.00th=[ 10290], 40.00th=[ 19268], 50.00th=[ 28443], 60.00th=[ 38536], | 70.00th=[ 50070], 80.00th=[ 65799], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[173016], 99.50th=[193987], 99.90th=[233833], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 118, per=24.76%, avg=45.81, stdev=20.41, samples=266 iops : min= 1, max= 29, avg=10.79, stdev= 5.14, samples=266 lat (usec) : 50=0.23%, 100=1.53%, 250=0.16%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.69%, 4=4.62%, 10=5.86%, 20=10.25%, 50=38.35% lat (msec) : 100=26.30%, 250=7.75%, 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=4.65%, ctx=6812, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178924: Thu Aug 27 11:46:07 2026 read: IOPS=11, BW=45.0KiB/s (46.1kB/s)(6052KiB/134414msec) clat (usec): min=45, max=816556, avg=49438.15, stdev=40224.00 lat (usec): min=46, max=816558, avg=49442.22, stdev=40224.08 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 9765], 10.00th=[ 17171], 20.00th=[ 23462], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 50070], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[177210], 99.50th=[206570], 99.90th=[387974], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 5, max= 111, per=25.08%, avg=44.38, stdev=19.07, samples=265 iops : min= 1, max= 27, avg=10.43, stdev= 4.81, samples=265 write: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6236KiB/134414msec); 0 zone resets clat (usec): min=1017, max=366654, avg=38099.17, stdev=40131.68 lat (usec): min=1019, max=366655, avg=38104.18, stdev=40132.16 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1876], 20.00th=[ 4146], | 30.00th=[ 7635], 40.00th=[ 17957], 50.00th=[ 27395], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[115868], | 99.00th=[175113], 99.50th=[189793], 99.90th=[295699], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 111, per=24.78%, avg=45.84, stdev=19.49, samples=264 iops : min= 1, max= 27, avg=10.78, stdev= 4.90, samples=264 lat (usec) : 50=0.16%, 100=1.63%, 250=0.20%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.63%, 4=4.43%, 10=7.13%, 20=9.08%, 50=37.27% lat (msec) : 100=26.63%, 250=7.36%, 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=4.82%, ctx=6829, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=177KiB/s (182kB/s), 44.5KiB/s-45.8KiB/s (45.6kB/s-46.9kB/s), io=23.4MiB (24.6MB), run=130846-135415msec WRITE: bw=186KiB/s (190kB/s), 46.2KiB/s-48.1KiB/s (47.3kB/s-49.3kB/s), io=24.6MiB (25.7MB), run=130846-135415msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178916: Thu Aug 27 11:46:49 2026 read: IOPS=8, BW=33.9KiB/s (34.7kB/s)(5992KiB/176924msec) clat (msec): min=6, max=949, avg=45.76, stdev=48.24 lat (msec): min=6, max=949, avg=45.77, stdev=48.24 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 105], 95.00th=[ 138], | 99.00th=[ 218], 99.50th=[ 264], 99.90th=[ 313], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 174, per=25.54%, avg=34.49, stdev=24.25, samples=338 iops : min= 1, max= 43, avg= 7.97, stdev= 6.08, samples=338 write: IOPS=8, BW=35.6KiB/s (36.4kB/s)(6296KiB/176924msec); 0 zone resets clat (msec): min=12, max=422, avg=68.59, stdev=48.38 lat (msec): min=12, max=422, avg=68.59, stdev=48.38 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 99], 90.00th=[ 131], 95.00th=[ 165], | 99.00th=[ 241], 99.50th=[ 271], 99.90th=[ 388], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 119, per=25.02%, avg=35.28, stdev=22.10, samples=347 iops : min= 1, max= 29, avg= 8.16, stdev= 5.54, samples=347 lat (msec) : 10=1.53%, 20=12.73%, 50=45.18%, 100=25.46%, 250=14.36% lat (msec) : 500=0.72%, 1000=0.03% cpu : usr=0.05%, sys=1.67%, ctx=4732, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178917: Thu Aug 27 11:46:49 2026 read: IOPS=8, BW=33.5KiB/s (34.3kB/s)(5940KiB/177501msec) clat (msec): min=6, max=820, avg=46.43, stdev=48.56 lat (msec): min=6, max=820, avg=46.43, stdev=48.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 230], 99.50th=[ 284], 99.90th=[ 347], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 143, per=25.45%, avg=34.36, stdev=24.07, samples=336 iops : min= 1, max= 35, avg= 7.93, stdev= 6.02, samples=336 write: IOPS=8, BW=35.8KiB/s (36.6kB/s)(6348KiB/177501msec); 0 zone resets clat (msec): min=11, max=387, avg=68.14, stdev=48.72 lat (msec): min=11, max=387, avg=68.14, stdev=48.72 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 102], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 236], 99.50th=[ 266], 99.90th=[ 376], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 126, per=25.22%, avg=35.56, stdev=23.03, samples=347 iops : min= 1, max= 31, avg= 8.23, stdev= 5.78, samples=347 lat (msec) : 10=1.37%, 20=13.18%, 50=45.80%, 100=24.02%, 250=14.94% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.05%, sys=1.64%, ctx=4724, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178918: Thu Aug 27 11:46:49 2026 read: IOPS=8, BW=33.9KiB/s (34.8kB/s)(6028KiB/177560msec) clat (msec): min=5, max=337, avg=46.64, stdev=43.61 lat (msec): min=5, max=337, avg=46.64, stdev=43.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 69], 90.00th=[ 103], 95.00th=[ 138], | 99.00th=[ 222], 99.50th=[ 251], 99.90th=[ 288], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 174, per=25.25%, avg=34.08, stdev=24.35, samples=343 iops : min= 1, max= 43, avg= 7.87, stdev= 6.11, samples=343 write: IOPS=8, BW=35.3KiB/s (36.1kB/s)(6260KiB/177560msec); 0 zone resets clat (msec): min=9, max=863, avg=68.29, stdev=51.41 lat (msec): min=9, max=863, avg=68.29, stdev=51.41 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 101], 90.00th=[ 131], 95.00th=[ 165], | 99.00th=[ 230], 99.50th=[ 271], 99.90th=[ 376], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 112, per=24.99%, avg=35.23, stdev=22.52, samples=345 iops : min= 1, max= 28, avg= 8.14, stdev= 5.64, samples=345 lat (msec) : 10=1.92%, 20=13.18%, 50=44.37%, 100=25.23%, 250=14.68% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.06%, sys=1.66%, ctx=4849, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178919: Thu Aug 27 11:46:49 2026 read: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6052KiB/176588msec) clat (msec): min=5, max=324, avg=46.55, stdev=43.21 lat (msec): min=5, max=324, avg=46.56, stdev=43.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 218], 99.50th=[ 264], 99.90th=[ 296], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 143, per=26.09%, avg=35.22, stdev=23.99, samples=334 iops : min= 1, max= 35, avg= 8.15, stdev= 6.02, samples=334 write: IOPS=8, BW=35.3KiB/s (36.2kB/s)(6236KiB/176588msec); 0 zone resets clat (msec): min=15, max=835, avg=67.83, stdev=51.79 lat (msec): min=15, max=835, avg=67.83, stdev=51.79 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 100], 90.00th=[ 134], 95.00th=[ 165], | 99.00th=[ 232], 99.50th=[ 268], 99.90th=[ 422], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 119, per=24.98%, avg=35.22, stdev=22.45, samples=344 iops : min= 1, max= 29, avg= 8.15, stdev= 5.63, samples=344 lat (msec) : 10=1.46%, 20=13.54%, 50=44.95%, 100=24.45%, 250=14.91% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4798, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=135KiB/s (138kB/s), 33.5KiB/s-34.3KiB/s (34.3kB/s-35.1kB/s), io=23.4MiB (24.6MB), run=176588-177560msec WRITE: bw=142KiB/s (145kB/s), 35.3KiB/s-35.8KiB/s (36.1kB/s-36.6kB/s), io=24.6MiB (25.7MB), run=176588-177560msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178968: Thu Aug 27 11:47:37 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(5920KiB/34379msec) clat (usec): min=41, max=298685, avg=50684.87, stdev=38778.07 lat (usec): min=42, max=298687, avg=50686.02, stdev=38778.06 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 69], 10.00th=[ 249], 20.00th=[ 23462], | 30.00th=[ 31327], 40.00th=[ 36963], 50.00th=[ 44303], 60.00th=[ 53216], | 70.00th=[ 61080], 80.00th=[ 74974], 90.00th=[ 89654], 95.00th=[116917], | 99.00th=[193987], 99.50th=[242222], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 384, per=27.37%, avg=172.42, stdev=69.21, samples=67 iops : min= 1, max= 24, avg=10.01, stdev= 4.42, samples=67 write: IOPS=11, BW=185KiB/s (190kB/s)(6368KiB/34379msec); 0 zone resets clat (usec): min=1500, max=436730, avg=39012.98, stdev=43645.91 lat (usec): min=1502, max=436733, avg=39016.15, stdev=43645.74 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1811], 10.00th=[ 2737], 20.00th=[ 5735], | 30.00th=[ 9372], 40.00th=[ 15664], 50.00th=[ 24773], 60.00th=[ 35914], | 70.00th=[ 49021], 80.00th=[ 67634], 90.00th=[ 98042], 95.00th=[113771], | 99.00th=[168821], 99.50th=[250610], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 31, max= 437, per=28.05%, avg=186.00, stdev=78.52, samples=67 iops : min= 1, max= 27, avg=10.90, stdev= 4.96, samples=67 lat (usec) : 50=0.52%, 100=3.52%, 250=0.78%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.17%, 4=3.78%, 10=8.46%, 20=9.38%, 50=33.20% lat (msec) : 100=27.21%, 250=8.20%, 500=0.39% cpu : usr=0.08%, sys=4.84%, ctx=1567, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178969: Thu Aug 27 11:47:37 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(5744KiB/37995msec) clat (usec): min=54, max=254345, avg=56463.32, stdev=38483.92 lat (usec): min=55, max=254347, avg=56464.70, stdev=38483.95 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 17957], 20.00th=[ 28181], | 30.00th=[ 34866], 40.00th=[ 43254], 50.00th=[ 51119], 60.00th=[ 58983], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[102237], 95.00th=[132645], | 99.00th=[181404], 99.50th=[219153], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 28, max= 286, per=23.82%, avg=150.07, stdev=63.83, samples=74 iops : min= 1, max= 17, avg= 8.61, stdev= 4.05, samples=74 write: IOPS=10, BW=172KiB/s (176kB/s)(6544KiB/37995msec); 0 zone resets clat (usec): min=1476, max=288756, avg=42251.31, stdev=44388.39 lat (usec): min=1478, max=288758, avg=42253.87, stdev=44388.23 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2114], 10.00th=[ 3654], 20.00th=[ 6390], | 30.00th=[ 10421], 40.00th=[ 19530], 50.00th=[ 28967], 60.00th=[ 39060], | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[135267], | 99.00th=[189793], 99.50th=[217056], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 28, max= 351, per=25.87%, avg=171.53, stdev=80.30, samples=74 iops : min= 1, max= 21, avg= 9.96, stdev= 5.08, samples=74 lat (usec) : 100=3.12%, 250=0.78% lat (msec) : 2=2.08%, 4=3.78%, 10=9.90%, 20=7.16%, 50=32.42% lat (msec) : 100=30.73%, 250=9.64%, 500=0.39% cpu : usr=0.08%, sys=4.68%, ctx=1731, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178972: Thu Aug 27 11:47:37 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35730msec) clat (usec): min=39, max=213130, avg=51100.87, stdev=35780.29 lat (usec): min=40, max=213131, avg=51105.42, stdev=35785.58 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 100], 20.00th=[ 24249], | 30.00th=[ 33817], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 61604], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[175113], 99.50th=[208667], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 349, per=27.90%, avg=175.79, stdev=65.41, samples=70 iops : min= 1, max= 21, avg=10.24, stdev= 4.13, samples=70 write: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35730msec); 0 zone resets clat (usec): min=1476, max=303977, avg=40862.46, stdev=42072.27 lat (usec): min=1477, max=303979, avg=40890.72, stdev=42070.91 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1926], 10.00th=[ 3228], 20.00th=[ 6521], | 30.00th=[ 9896], 40.00th=[ 16909], 50.00th=[ 28443], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[101188], 95.00th=[126354], | 99.00th=[173016], 99.50th=[210764], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 352, per=25.14%, avg=166.67, stdev=72.90, samples=70 iops : min= 1, max= 22, avg= 9.66, stdev= 4.63, samples=70 lat (usec) : 50=0.39%, 100=4.82%, 250=0.39%, 500=0.13% lat (msec) : 2=2.47%, 4=3.91%, 10=8.72%, 20=7.55%, 50=34.24% lat (msec) : 100=28.13%, 250=9.11%, 500=0.13% cpu : usr=0.07%, sys=4.88%, ctx=1729, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178973: Thu Aug 27 11:47:37 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37971msec) clat (usec): min=34, max=288679, avg=54976.66, stdev=40720.85 lat (usec): min=34, max=288680, avg=54977.92, stdev=40720.89 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 124], 20.00th=[ 26870], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 47973], 60.00th=[ 56361], | 70.00th=[ 66323], 80.00th=[ 80217], 90.00th=[104334], 95.00th=[137364], | 99.00th=[191890], 99.50th=[225444], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 288, per=26.03%, avg=163.99, stdev=60.67, samples=71 iops : min= 1, max= 18, avg= 9.49, stdev= 3.83, samples=71 write: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37971msec); 0 zone resets clat (usec): min=1535, max=241434, avg=43038.89, stdev=42765.94 lat (usec): min=1538, max=241436, avg=43083.72, stdev=42821.66 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2737], 10.00th=[ 4293], 20.00th=[ 7111], | 30.00th=[ 11863], 40.00th=[ 18744], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 53740], 80.00th=[ 71828], 90.00th=[104334], 95.00th=[131597], | 99.00th=[185598], 99.50th=[227541], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 380, per=24.63%, avg=163.30, stdev=77.12, samples=74 iops : min= 1, max= 23, avg= 9.45, stdev= 4.90, samples=74 lat (usec) : 50=0.65%, 100=3.91%, 250=1.04%, 500=0.13% lat (msec) : 2=1.82%, 4=3.39%, 10=9.64%, 20=7.16%, 50=32.29% lat (msec) : 100=28.52%, 250=11.33%, 500=0.13% cpu : usr=0.06%, sys=4.48%, ctx=1678, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=630KiB/s (646kB/s), 151KiB/s-175KiB/s (155kB/s-179kB/s), io=23.4MiB (24.5MB), run=34379-37995msec WRITE: bw=663KiB/s (679kB/s), 165KiB/s-185KiB/s (169kB/s-190kB/s), io=24.6MiB (25.8MB), run=34379-37995msec fio: pid=178971, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=178966: Thu Aug 27 11:47:52 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5920KiB/52011msec) clat (msec): min=7, max=365, avg=50.45, stdev=45.42 lat (msec): min=7, max=365, avg=50.45, stdev=45.42 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 105], 95.00th=[ 146], | 99.00th=[ 236], 99.50th=[ 249], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 414, per=28.24%, avg=118.59, stdev=77.07, samples=96 iops : min= 1, max= 25, avg= 6.57, stdev= 4.86, samples=96 write: IOPS=7, BW=122KiB/s (125kB/s)(6368KiB/52011msec); 0 zone resets clat (msec): min=13, max=492, avg=82.86, stdev=58.01 lat (msec): min=13, max=492, avg=82.86, stdev=58.01 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 47], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 77], | 70.00th=[ 101], 80.00th=[ 124], 90.00th=[ 163], 95.00th=[ 194], | 99.00th=[ 275], 99.50th=[ 305], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 350, per=27.92%, avg=123.39, stdev=73.92, samples=100 iops : min= 1, max= 21, avg= 6.89, stdev= 4.68, samples=100 lat (msec) : 10=0.39%, 20=8.72%, 50=42.58%, 100=27.47%, 250=19.92% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.37%, ctx=1165, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178967: Thu Aug 27 11:47:52 2026 read: IOPS=6, BW=111KiB/s (113kB/s)(5744KiB/51956msec) clat (msec): min=7, max=419, avg=52.94, stdev=50.51 lat (msec): min=7, max=419, avg=52.95, stdev=50.51 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 73], 90.00th=[ 118], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 351], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 383, per=27.98%, avg=117.54, stdev=77.79, samples=95 iops : min= 1, max= 23, avg= 6.51, stdev= 4.91, samples=95 write: IOPS=7, BW=126KiB/s (129kB/s)(6544KiB/51956msec); 0 zone resets clat (msec): min=13, max=492, avg=80.17, stdev=56.67 lat (msec): min=13, max=492, avg=80.19, stdev=56.67 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 53], 50.00th=[ 64], 60.00th=[ 75], | 70.00th=[ 94], 80.00th=[ 120], 90.00th=[ 157], 95.00th=[ 188], | 99.00th=[ 251], 99.50th=[ 271], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 431, per=28.74%, avg=127.04, stdev=81.45, samples=100 iops : min= 1, max= 26, avg= 7.12, stdev= 5.14, samples=100 lat (msec) : 10=1.30%, 20=7.42%, 50=42.58%, 100=28.39%, 250=19.27% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.38%, ctx=1211, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178970: Thu Aug 27 11:47:52 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52285msec) clat (msec): min=6, max=400, avg=53.43, stdev=47.94 lat (msec): min=6, max=400, avg=53.43, stdev=47.94 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 47], | 70.00th=[ 59], 80.00th=[ 78], 90.00th=[ 114], 95.00th=[ 144], | 99.00th=[ 266], 99.50th=[ 338], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 504, per=30.52%, avg=128.18, stdev=92.86, samples=96 iops : min= 1, max= 31, avg= 7.20, stdev= 5.87, samples=96 write: IOPS=7, BW=115KiB/s (118kB/s)(6032KiB/52285msec); 0 zone resets clat (msec): min=13, max=390, avg=82.31, stdev=56.31 lat (msec): min=13, max=390, avg=82.31, stdev=56.31 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 38], | 30.00th=[ 46], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 79], | 70.00th=[ 97], 80.00th=[ 120], 90.00th=[ 163], 95.00th=[ 203], | 99.00th=[ 251], 99.50th=[ 321], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 415, per=26.29%, avg=116.20, stdev=73.78, samples=101 iops : min= 1, max= 25, avg= 6.44, stdev= 4.64, samples=101 lat (msec) : 10=0.52%, 20=9.64%, 50=39.32%, 100=29.43%, 250=20.05% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.51%, ctx=1215, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=178971: Thu Aug 27 11:47:52 2026 read: IOPS=5, BW=92.8KiB/s (95.0kB/s)(4048KiB/43622msec) clat (msec): min=7, max=370, avg=64.91, stdev=49.37 lat (msec): min=7, max=370, avg=64.92, stdev=49.37 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 59], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 122], 95.00th=[ 182], | 99.00th=[ 241], 99.50th=[ 257], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 351, per=23.14%, avg=97.18, stdev=56.87, samples=82 iops : min= 1, max= 21, avg= 5.23, stdev= 3.58, samples=82 write: IOPS=5, BW=95.7KiB/s (98.0kB/s)(4176KiB/43622msec); 0 zone resets clat (msec): min=17, max=393, avg=102.97, stdev=57.37 lat (msec): min=17, max=393, avg=102.98, stdev=57.37 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 38], 10.00th=[ 43], 20.00th=[ 53], | 30.00th=[ 66], 40.00th=[ 78], 50.00th=[ 93], 60.00th=[ 107], | 70.00th=[ 124], 80.00th=[ 146], 90.00th=[ 186], 95.00th=[ 211], | 99.00th=[ 259], 99.50th=[ 321], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 29, max= 221, per=21.80%, avg=96.35, stdev=47.09, samples=85 iops : min= 1, max= 13, avg= 5.18, stdev= 2.98, samples=85 lat (msec) : 10=0.19%, 20=1.94%, 50=32.62%, 100=35.53%, 250=28.54% lat (msec) : 500=0.97% cpu : usr=0.03%, sys=1.13%, ctx=711, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=254,261,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=420KiB/s (430kB/s), 92.8KiB/s-120KiB/s (95.0kB/s-123kB/s), io=21.5MiB (22.5MB), run=43622-52285msec WRITE: bw=442KiB/s (453kB/s), 95.7KiB/s-126KiB/s (98.0kB/s-129kB/s), io=22.6MiB (23.7MB), run=43622-52285msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178990: Thu Aug 27 11:48:12 2026 read: IOPS=0, BW=999KiB/s (1023kB/s)(7168KiB/7173msec) clat (usec): min=486, max=4018.6k, avg=776225.15, stdev=1434919.18 lat (usec): min=487, max=4018.6k, avg=776226.74, stdev=1434919.07 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], | 20.00th=[ 208667], 30.00th=[ 221250], 40.00th=[ 221250], | 50.00th=[ 261096], 60.00th=[ 358613], 70.00th=[ 358613], | 80.00th=[ 362808], 90.00th=[4009755], 95.00th=[4009755], | 99.00th=[4009755], 99.50th=[4009755], 99.90th=[4009755], | 99.95th=[4009755], 99.99th=[4009755] bw ( KiB/s): min= 1654, max= 4096, per=91.50%, avg=2350.60, stdev=987.58, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=714KiB/s (731kB/s)(5120KiB/7173msec); 0 zone resets clat (msec): min=120, max=784, avg=323.47, stdev=263.99 lat (msec): min=120, max=784, avg=323.54, stdev=263.95 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2019, max= 6083, per=100.00%, avg=4051.00, stdev=2873.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.60%, ctx=666, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178991: Thu Aug 27 11:48:12 2026 read: IOPS=0, BW=257KiB/s (263kB/s)(2048KiB/7971msec) clat (usec): min=525, max=224399, avg=112462.33, stdev=158302.90 lat (usec): min=526, max=224401, avg=112463.86, stdev=158303.49 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 529], 60.00th=[225444], | 70.00th=[225444], 80.00th=[225444], 90.00th=[225444], 95.00th=[225444], | 99.00th=[225444], 99.50th=[225444], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 1630, max= 2023, per=71.10%, avg=1826.50, stdev=277.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1285KiB/s (1315kB/s)(10.0MiB/7971msec); 0 zone resets clat (msec): min=162, max=4481, avg=759.11, stdev=1322.49 lat (msec): min=162, max=4481, avg=759.20, stdev=1322.53 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 220], | 30.00th=[ 222], 40.00th=[ 257], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 418], 80.00th=[ 430], 90.00th=[ 852], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1957, max= 4096, per=100.00%, avg=3630.80, stdev=936.15, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.10, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.08%, ctx=151, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178993: Thu Aug 27 11:48:12 2026 read: IOPS=0, BW=946KiB/s (968kB/s)(6144KiB/6497msec) clat (usec): min=658, max=498779, avg=128920.11, stdev=194359.61 lat (usec): min=659, max=498780, avg=128921.28, stdev=194359.62 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 734], | 30.00th=[ 734], 40.00th=[ 3163], 50.00th=[ 3163], 60.00th=[ 94897], | 70.00th=[175113], 80.00th=[175113], 90.00th=[497026], 95.00th=[497026], | 99.00th=[497026], 99.50th=[497026], 99.90th=[497026], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 3915, max= 6083, per=100.00%, avg=4999.00, stdev=1533.01, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=0, BW=946KiB/s (968kB/s)(6144KiB/6497msec); 0 zone resets clat (msec): min=165, max=4198, avg=883.33, stdev=1625.72 lat (msec): min=166, max=4198, avg=883.40, stdev=1625.74 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 209], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 4212], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 1638, max= 4055, per=67.77%, avg=2437.75, stdev=1093.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.96%, ctx=119, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178995: Thu Aug 27 11:48:12 2026 read: IOPS=0, BW=704KiB/s (721kB/s)(5120KiB/7273msec) clat (usec): min=521, max=276086, avg=110751.67, stdev=148413.10 lat (usec): min=523, max=276087, avg=110752.95, stdev=148413.13 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 1729], 40.00th=[ 1729], 50.00th=[ 4883], 60.00th=[ 4883], | 70.00th=[270533], 80.00th=[270533], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 1957, max= 6083, per=100.00%, avg=4020.00, stdev=2917.52, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=986KiB/s (1009kB/s)(7168KiB/7273msec); 0 zone resets clat (msec): min=205, max=4386, avg=947.32, stdev=1519.61 lat (msec): min=205, max=4386, avg=947.43, stdev=1519.60 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 338], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 514], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 1542, max= 2048, per=53.73%, avg=1932.67, stdev=193.73, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=8.33%, 500=50.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.68%, ctx=129, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2569KiB/s (2631kB/s), 257KiB/s-999KiB/s (263kB/s-1023kB/s), io=20.0MiB (20.0MB), run=6497-7971msec WRITE: bw=3597KiB/s (3683kB/s), 714KiB/s-1285KiB/s (731kB/s-1315kB/s), io=28.0MiB (29.4MB), run=6497-7971msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178992: Thu Aug 27 11:48:13 2026 read: IOPS=0, BW=803KiB/s (822kB/s)(7168KiB/8926msec) clat (msec): min=60, max=3858, avg=1084.17, stdev=1323.74 lat (msec): min=60, max=3858, avg=1084.17, stdev=1323.74 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 105], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 709], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 1536], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 1976, max= 2048, per=89.28%, avg=2026.60, stdev=28.92, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=574KiB/s (587kB/s)(5120KiB/8926msec); 0 zone resets clat (msec): min=83, max=318, avg=157.95, stdev=96.06 lat (msec): min=83, max=318, avg=159.05, stdev=96.28 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2039, max= 6144, per=100.00%, avg=4091.50, stdev=2902.67, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 100=25.00%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.74%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178994: Thu Aug 27 11:48:13 2026 read: IOPS=0, BW=236KiB/s (242kB/s)(2048KiB/8679msec) clat (msec): min=101, max=867, avg=484.30, stdev=542.06 lat (msec): min=101, max=867, avg=484.30, stdev=542.06 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 102], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1546, max= 2039, per=78.96%, avg=1792.50, stdev=348.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1180KiB/s (1208kB/s)(10.0MiB/8679msec); 0 zone resets clat (msec): min=110, max=4346, avg=763.29, stdev=1285.85 lat (msec): min=110, max=4346, avg=763.43, stdev=1285.83 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 163], | 30.00th=[ 167], 40.00th=[ 174], 50.00th=[ 220], 60.00th=[ 409], | 70.00th=[ 443], 80.00th=[ 701], 90.00th=[ 902], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 1787, max= 4079, per=83.53%, avg=2654.67, stdev=1059.65, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=1.97%, ctx=71, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178996: Thu Aug 27 11:48:13 2026 read: IOPS=0, BW=692KiB/s (708kB/s)(6144KiB/8882msec) clat (msec): min=63, max=754, avg=308.47, stdev=296.47 lat (msec): min=63, max=754, avg=308.47, stdev=296.47 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 121], 50.00th=[ 121], 60.00th=[ 224], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2031, max= 2048, per=89.87%, avg=2040.00, stdev= 6.24, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=692KiB/s (708kB/s)(6144KiB/8882msec); 0 zone resets clat (msec): min=91, max=4791, avg=1105.68, stdev=1823.04 lat (msec): min=91, max=4792, avg=1105.80, stdev=1823.07 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 550], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 2031, max= 4096, per=80.38%, avg=2554.50, stdev=1027.69, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=33.33%, 250=16.67%, 500=8.33%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=2.31%, ctx=117, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178997: Thu Aug 27 11:48:13 2026 read: IOPS=0, BW=568KiB/s (581kB/s)(5120KiB/9020msec) clat (msec): min=60, max=410, avg=195.91, stdev=152.68 lat (msec): min=60, max=410, avg=195.92, stdev=152.68 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 113], 60.00th=[ 113], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2043, max= 4079, per=100.00%, avg=2723.33, stdev=1174.04, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=795KiB/s (814kB/s)(7168KiB/9020msec); 0 zone resets clat (msec): min=97, max=4701, avg=1092.85, stdev=1646.15 lat (msec): min=97, max=4701, avg=1092.94, stdev=1646.15 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 110], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 531], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 1351], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1787, max= 2048, per=62.71%, avg=1993.00, stdev=115.22, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=25.00%, 250=16.67%, 500=25.00%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.17%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2271KiB/s (2325kB/s), 236KiB/s-803KiB/s (242kB/s-822kB/s), io=20.0MiB (20.0MB), run=8679-9020msec WRITE: bw=3179KiB/s (3255kB/s), 574KiB/s-1180KiB/s (587kB/s-1208kB/s), io=28.0MiB (29.4MB), run=8679-9020msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179005: Thu Aug 27 11:48:29 2026 read: IOPS=0, BW=4020KiB/s (4116kB/s)(12.0MiB/3057msec) clat (msec): min=837, max=1076, avg=989.23, stdev=131.78 lat (msec): min=837, max=1076, avg=989.23, stdev=131.78 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.68%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179006: Thu Aug 27 11:48:29 2026 read: IOPS=0, BW=1063KiB/s (1088kB/s)(4096KiB/3855msec) clat (nsec): min=1867.4M, max=1867.4M, avg=1867402798.00, stdev= 0.00 lat (nsec): min=1867.4M, max=1867.4M, avg=1867405047.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1871], 5.00th=[ 1871], 10.00th=[ 1871], 20.00th=[ 1871], | 30.00th=[ 1871], 40.00th=[ 1871], 50.00th=[ 1871], 60.00th=[ 1871], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2125KiB/s (2176kB/s)(8192KiB/3855msec); 0 zone resets clat (msec): min=337, max=1479, avg=908.18, stdev=807.61 lat (msec): min=337, max=1480, avg=909.00, stdev=808.29 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8094, max= 8094, per=95.22%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.75%, ctx=49, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179008: Thu Aug 27 11:48:29 2026 write: IOPS=0, BW=3252KiB/s (3330kB/s)(12.0MiB/3779msec); 0 zone resets clat (msec): min=670, max=1553, avg=1237.29, stdev=491.70 lat (msec): min=670, max=1557, avg=1239.07, stdev=493.22 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8031, max= 8143, per=95.14%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.73%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179010: Thu Aug 27 11:48:29 2026 write: IOPS=0, BW=3719KiB/s (3808kB/s)(12.0MiB/3304msec); 0 zone resets clat (msec): min=203, max=2664, avg=1068.60, stdev=1383.75 lat (msec): min=203, max=2664, avg=1069.09, stdev=1383.69 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 7984, max= 8159, per=94.96%, avg=8071.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.45%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4250KiB/s (4352kB/s), 1063KiB/s-4020KiB/s (1088kB/s-4116kB/s), io=16.0MiB (16.8MB), run=3057-3855msec WRITE: bw=8500KiB/s (8704kB/s), 2125KiB/s-3719KiB/s (2176kB/s-3808kB/s), io=32.0MiB (33.6MB), run=3304-3855msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179007: Thu Aug 27 11:48:29 2026 read: IOPS=1, BW=4286KiB/s (4389kB/s)(12.0MiB/2867msec) clat (msec): min=758, max=1050, avg=940.80, stdev=159.30 lat (msec): min=758, max=1050, avg=940.80, stdev=159.30 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8047, max= 8143, per=100.00%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.85%, ctx=275, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179009: Thu Aug 27 11:48:29 2026 read: IOPS=0, BW=1227KiB/s (1257kB/s)(4096KiB/3337msec) clat (nsec): min=516850k, max=516850k, avg=516850327.00, stdev= 0.00 lat (nsec): min=516853k, max=516853k, avg=516852877.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2455KiB/s (2514kB/s)(8192KiB/3337msec); 0 zone resets clat (msec): min=812, max=1750, avg=1281.52, stdev=663.52 lat (msec): min=812, max=1753, avg=1283.18, stdev=665.33 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8094, max= 8094, per=98.44%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.41%, ctx=163, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179011: Thu Aug 27 11:48:29 2026 write: IOPS=0, BW=3084KiB/s (3158kB/s)(12.0MiB/3985msec); 0 zone resets clat (msec): min=413, max=2513, avg=1275.87, stdev=1099.51 lat (msec): min=415, max=2514, avg=1276.80, stdev=1098.86 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8062, max= 8192, per=98.84%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.86%, ctx=41, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179012: Thu Aug 27 11:48:29 2026 write: IOPS=0, BW=3395KiB/s (3477kB/s)(12.0MiB/3619msec); 0 zone resets clat (msec): min=406, max=2032, avg=1121.22, stdev=830.34 lat (msec): min=408, max=2033, avg=1122.48, stdev=830.50 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8094, max= 8143, per=98.74%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=4.28%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4910KiB/s (5028kB/s), 1227KiB/s-4286KiB/s (1257kB/s-4389kB/s), io=16.0MiB (16.8MB), run=2867-3337msec WRITE: bw=8223KiB/s (8420kB/s), 2455KiB/s-3395KiB/s (2514kB/s-3477kB/s), io=32.0MiB (33.6MB), run=3337-3985msec