== sanity test 398b: DIO and buffer IO race ============== 01:40:19 (1790746819) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.23262 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180296: Wed Sep 30 01:42:29 2026 read: IOPS=13, BW=54.7KiB/s (55.0kB/s)(5992KiB/109620msec) clat (usec): min=44, max=988987, avg=40917.95, stdev=36277.02 lat (usec): min=45, max=988988, avg=40922.56, stdev=36276.42 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10814], 10.00th=[ 14615], 20.00th=[ 19530], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[131597], 99.50th=[152044], 99.90th=[261096], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 5, max= 159, per=25.32%, avg=54.43, stdev=21.95, samples=215 iops : min= 1, max= 39, avg=12.94, stdev= 5.50, samples=215 write: IOPS=14, BW=57.4KiB/s (58.8kB/s)(6296KiB/109620msec); 0 zone resets clat (usec): min=694, max=418966, avg=30420.97, stdev=32671.73 lat (usec): min=695, max=418968, avg=30430.15, stdev=32671.68 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1467], 20.00th=[ 3195], | 30.00th=[ 6783], 40.00th=[ 14484], 50.00th=[ 22414], 60.00th=[ 29230], | 70.00th=[ 38536], 80.00th=[ 50594], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[143655], 99.50th=[168821], 99.90th=[206570], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 143, per=25.55%, avg=57.48, stdev=23.94, samples=214 iops : min= 1, max= 35, avg=13.71, stdev= 6.00, samples=214 lat (usec) : 50=0.33%, 100=1.27%, 250=0.10%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=7.19%, 4=4.52%, 10=6.84%, 20=13.77%, 50=41.73% lat (msec) : 100=20.67%, 250=3.29%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.40%, ctx=6581, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180297: Wed Sep 30 01:42:29 2026 read: IOPS=13, BW=54.0KiB/s (56.3kB/s)(5940KiB/108008msec) clat (usec): min=39, max=249950, avg=39797.91, stdev=27416.62 lat (usec): min=39, max=249951, avg=39801.05, stdev=27416.78 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 9765], 10.00th=[ 14615], 20.00th=[ 19268], | 30.00th=[ 23462], 40.00th=[ 27919], 50.00th=[ 33162], 60.00th=[ 39584], | 70.00th=[ 47973], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[141558], 99.50th=[156238], 99.90th=[206570], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 5, max= 135, per=25.44%, avg=54.70, stdev=21.49, samples=212 iops : min= 1, max= 33, avg=13.01, stdev= 5.39, samples=212 write: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6348KiB/108008msec); 0 zone resets clat (usec): min=808, max=976444, avg=30588.11, stdev=39637.06 lat (usec): min=809, max=976446, avg=30589.90, stdev=39636.79 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1598], 20.00th=[ 2769], | 30.00th=[ 5735], 40.00th=[ 13698], 50.00th=[ 22152], 60.00th=[ 28967], | 70.00th=[ 38011], 80.00th=[ 52691], 90.00th=[ 72877], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[173016], 99.90th=[278922], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 135, per=26.05%, avg=58.62, stdev=24.37, samples=211 iops : min= 1, max= 33, avg=14.00, stdev= 6.13, samples=211 lat (usec) : 50=0.20%, 100=1.30%, 250=0.26%, 500=0.10%, 1000=0.20% lat (msec) : 2=6.93%, 4=5.86%, 10=6.64%, 20=13.64%, 50=40.04% lat (msec) : 100=21.52%, 250=3.26%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.43%, ctx=6340, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180298: Wed Sep 30 01:42:29 2026 read: IOPS=13, BW=54.0KiB/s (55.3kB/s)(6028KiB/111525msec) clat (usec): min=26, max=222203, avg=40162.75, stdev=26780.06 lat (usec): min=26, max=222204, avg=40165.21, stdev=26781.64 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10028], 10.00th=[ 14877], 20.00th=[ 19530], | 30.00th=[ 24249], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[135267], 99.50th=[149947], 99.90th=[196084], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 7, max= 111, per=25.03%, avg=53.81, stdev=20.36, samples=218 iops : min= 1, max= 27, avg=12.78, stdev= 5.11, samples=218 write: IOPS=14, BW=56.1KiB/s (57.5kB/s)(6260KiB/111525msec); 0 zone resets clat (usec): min=768, max=980106, avg=32329.76, stdev=40484.14 lat (usec): min=769, max=980108, avg=32341.19, stdev=40493.17 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1582], 20.00th=[ 3228], | 30.00th=[ 6325], 40.00th=[ 14746], 50.00th=[ 22938], 60.00th=[ 31065], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[132645], 99.50th=[162530], 99.90th=[258999], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 143, per=24.73%, avg=55.63, stdev=24.83, samples=219 iops : min= 1, max= 35, avg=13.24, stdev= 6.23, samples=219 lat (usec) : 50=0.42%, 100=1.33%, 250=0.16%, 500=0.03%, 1000=0.16% lat (msec) : 2=6.61%, 4=5.14%, 10=6.38%, 20=13.67%, 50=41.37% lat (msec) : 100=20.90%, 250=3.74%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.44%, ctx=6561, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180299: Wed Sep 30 01:42:29 2026 read: IOPS=13, BW=54.7KiB/s (55.0kB/s)(6052KiB/110690msec) clat (usec): min=38, max=214465, avg=39715.44, stdev=26882.76 lat (usec): min=39, max=214466, avg=39716.75, stdev=26882.80 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 603], 10.00th=[ 13960], 20.00th=[ 19792], | 30.00th=[ 24249], 40.00th=[ 28705], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[125305], 99.50th=[164627], 99.90th=[212861], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 7, max= 119, per=25.31%, avg=54.42, stdev=21.06, samples=216 iops : min= 1, max= 29, avg=12.94, stdev= 5.28, samples=216 write: IOPS=14, BW=56.3KiB/s (57.7kB/s)(6236KiB/110690msec); 0 zone resets clat (usec): min=995, max=907443, avg=32194.38, stdev=38942.46 lat (usec): min=997, max=907445, avg=32211.53, stdev=38939.20 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1614], 20.00th=[ 3490], | 30.00th=[ 6128], 40.00th=[ 13698], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 41157], 80.00th=[ 55313], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[154141], 99.90th=[238027], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 150, per=24.86%, avg=55.94, stdev=25.40, samples=217 iops : min= 1, max= 37, avg=13.32, stdev= 6.37, samples=217 lat (usec) : 50=0.33%, 100=1.79%, 250=0.20%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=6.67%, 4=4.82%, 10=7.52%, 20=11.65%, 50=42.12% lat (msec) : 100=21.19%, 250=3.45%, 1000=0.03% cpu : usr=0.07%, sys=5.48%, ctx=6571, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=215KiB/s (220kB/s), 54.0KiB/s-54.0KiB/s (55.3kB/s-56.3kB/s), io=23.4MiB (24.6MB), run=108008-111525msec WRITE: bw=225KiB/s (231kB/s), 56.1KiB/s-58.8KiB/s (57.5kB/s-60.2kB/s), io=24.6MiB (25.7MB), run=108008-111525msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180292: Wed Sep 30 01:43:05 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(5992KiB/146848msec) clat (msec): min=5, max=998, avg=38.09, stdev=42.86 lat (msec): min=5, max=998, avg=38.10, stdev=42.86 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 57], 90.00th=[ 87], 95.00th=[ 113], | 99.00th=[ 165], 99.50th=[ 199], 99.90th=[ 309], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 136, per=25.42%, avg=41.44, stdev=27.26, samples=282 iops : min= 1, max= 34, avg= 9.72, stdev= 6.88, samples=282 write: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6296KiB/146848msec); 0 zone resets clat (msec): min=9, max=399, avg=56.77, stdev=40.33 lat (msec): min=9, max=399, avg=56.77, stdev=40.33 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 113], 95.00th=[ 136], | 99.00th=[ 192], 99.50th=[ 209], 99.90th=[ 334], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 127, per=25.52%, avg=43.38, stdev=26.60, samples=283 iops : min= 1, max= 31, avg=10.20, stdev= 6.72, samples=283 lat (msec) : 10=3.12%, 20=19.11%, 50=45.48%, 100=21.94%, 250=10.12% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=1.87%, ctx=4838, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180293: Wed Sep 30 01:43:05 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(5940KiB/145585msec) clat (msec): min=4, max=887, avg=38.25, stdev=41.39 lat (msec): min=4, max=887, avg=38.25, stdev=41.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 86], 95.00th=[ 115], | 99.00th=[ 169], 99.50th=[ 197], 99.90th=[ 313], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 141, per=25.48%, avg=41.53, stdev=28.75, samples=279 iops : min= 1, max= 35, avg= 9.73, stdev= 7.25, samples=279 write: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6348KiB/145585msec); 0 zone resets clat (msec): min=11, max=456, avg=55.69, stdev=40.05 lat (msec): min=11, max=456, avg=55.70, stdev=40.05 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 81], 90.00th=[ 109], 95.00th=[ 134], | 99.00th=[ 194], 99.50th=[ 243], 99.90th=[ 334], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 128, per=25.58%, avg=43.48, stdev=26.33, samples=284 iops : min= 1, max= 32, avg=10.22, stdev= 6.64, samples=284 lat (msec) : 10=3.58%, 20=18.46%, 50=45.80%, 100=22.04%, 250=9.90% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=1.91%, ctx=4715, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180294: Wed Sep 30 01:43:05 2026 read: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6028KiB/145911msec) clat (msec): min=4, max=251, avg=36.96, stdev=33.23 lat (msec): min=4, max=251, avg=36.96, stdev=33.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 105], | 99.00th=[ 167], 99.50th=[ 197], 99.90th=[ 241], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 7, max= 134, per=25.60%, avg=41.72, stdev=27.23, samples=281 iops : min= 1, max= 33, avg= 9.79, stdev= 6.88, samples=281 write: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6260KiB/145911msec); 0 zone resets clat (msec): min=10, max=895, avg=57.38, stdev=47.41 lat (msec): min=10, max=895, avg=57.38, stdev=47.41 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 112], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 253], 99.90th=[ 460], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 128, per=25.27%, avg=42.95, stdev=27.49, samples=284 iops : min= 1, max= 32, avg=10.09, stdev= 6.93, samples=284 lat (msec) : 10=3.22%, 20=18.75%, 50=45.74%, 100=22.69%, 250=9.31% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=4913, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180295: Wed Sep 30 01:43:05 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6052KiB/147226msec) clat (msec): min=5, max=422, avg=38.15, stdev=34.83 lat (msec): min=5, max=422, avg=38.15, stdev=34.83 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 87], 95.00th=[ 113], | 99.00th=[ 153], 99.50th=[ 169], 99.90th=[ 232], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 144, per=25.15%, avg=40.99, stdev=28.54, samples=288 iops : min= 1, max= 36, avg= 9.60, stdev= 7.20, samples=288 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6236KiB/147226msec); 0 zone resets clat (msec): min=9, max=896, avg=57.13, stdev=46.51 lat (msec): min=9, max=896, avg=57.13, stdev=46.51 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 81], 90.00th=[ 110], 95.00th=[ 144], | 99.00th=[ 218], 99.50th=[ 268], 99.90th=[ 321], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 120, per=24.83%, avg=42.21, stdev=25.94, samples=288 iops : min= 1, max= 30, avg= 9.91, stdev= 6.55, samples=288 lat (msec) : 10=3.22%, 20=19.11%, 50=45.28%, 100=22.69%, 250=9.38% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=1.87%, ctx=4744, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 40.8KiB/s-41.3KiB/s (41.8kB/s-42.3kB/s), io=23.4MiB (24.6MB), run=145585-147226msec WRITE: bw=171KiB/s (175kB/s), 42.4KiB/s-43.6KiB/s (43.4kB/s-44.6kB/s), io=24.6MiB (25.7MB), run=145585-147226msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180340: Wed Sep 30 01:43:53 2026 read: IOPS=11, BW=178KiB/s (183kB/s)(5920KiB/33182msec) clat (usec): min=43, max=175698, avg=48538.31, stdev=31425.30 lat (usec): min=44, max=175700, avg=48547.33, stdev=31419.84 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 85], 10.00th=[ 15533], 20.00th=[ 24511], | 30.00th=[ 31851], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 49546], | 70.00th=[ 59507], 80.00th=[ 69731], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[162530], 99.50th=[168821], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 62, max= 352, per=26.63%, avg=178.15, stdev=62.98, samples=65 iops : min= 3, max= 22, avg=10.38, stdev= 4.00, samples=65 write: IOPS=11, BW=192KiB/s (197kB/s)(6368KiB/33182msec); 0 zone resets clat (usec): min=1482, max=221572, avg=37653.10, stdev=38238.84 lat (usec): min=1484, max=221574, avg=37655.93, stdev=38238.52 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1926], 10.00th=[ 3064], 20.00th=[ 5800], | 30.00th=[ 9110], 40.00th=[ 16909], 50.00th=[ 24249], 60.00th=[ 33424], | 70.00th=[ 49546], 80.00th=[ 64750], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[162530], 99.50th=[191890], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 62, max= 439, per=27.37%, avg=192.68, stdev=84.60, samples=65 iops : min= 3, max= 27, avg=11.29, stdev= 5.32, samples=65 lat (usec) : 50=0.26%, 100=2.60%, 250=0.91%, 500=0.13% lat (msec) : 2=2.73%, 4=5.21%, 10=8.85%, 20=8.20%, 50=36.46% lat (msec) : 100=27.47%, 250=7.16% cpu : usr=0.07%, sys=5.51%, ctx=1709, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180342: Wed Sep 30 01:43:53 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5744KiB/34347msec) clat (usec): min=39, max=225836, avg=50066.97, stdev=32509.19 lat (usec): min=39, max=225837, avg=50074.21, stdev=32512.09 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 101], 10.00th=[ 16909], 20.00th=[ 27132], | 30.00th=[ 32113], 40.00th=[ 38536], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 84411], 95.00th=[109577], | 99.00th=[183501], 99.50th=[189793], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 23, max= 350, per=25.76%, avg=172.34, stdev=72.80, samples=65 iops : min= 1, max= 21, avg=10.02, stdev= 4.62, samples=65 write: IOPS=11, BW=191KiB/s (195kB/s)(6544KiB/34347msec); 0 zone resets clat (usec): min=1293, max=175896, avg=38700.87, stdev=36263.38 lat (usec): min=1294, max=175898, avg=38703.46, stdev=36263.20 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2089], 10.00th=[ 3785], 20.00th=[ 6456], | 30.00th=[ 11338], 40.00th=[ 20579], 50.00th=[ 29230], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 65274], 90.00th=[ 95945], 95.00th=[115868], | 99.00th=[141558], 99.50th=[166724], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 23, max= 415, per=27.04%, avg=190.39, stdev=84.23, samples=67 iops : min= 1, max= 25, avg=11.15, stdev= 5.29, samples=67 lat (usec) : 50=0.13%, 100=2.08%, 250=0.78%, 750=0.13% lat (msec) : 2=2.47%, 4=3.91%, 10=8.59%, 20=8.33%, 50=38.41% lat (msec) : 100=26.95%, 250=8.20% cpu : usr=0.07%, sys=5.64%, ctx=1811, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180343: Wed Sep 30 01:43:53 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35767msec) clat (usec): min=44, max=223727, avg=48339.53, stdev=32093.07 lat (usec): min=44, max=223728, avg=48341.66, stdev=32092.96 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 83], 10.00th=[ 16909], 20.00th=[ 24511], | 30.00th=[ 30802], 40.00th=[ 37487], 50.00th=[ 44827], 60.00th=[ 50070], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[160433], 99.50th=[219153], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 30, max= 378, per=26.64%, avg=178.23, stdev=72.47, samples=69 iops : min= 1, max= 23, avg=10.38, stdev= 4.58, samples=69 write: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35767msec); 0 zone resets clat (usec): min=1480, max=229126, avg=43199.80, stdev=41605.94 lat (usec): min=1481, max=229127, avg=43209.16, stdev=41599.60 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2376], 10.00th=[ 4293], 20.00th=[ 7439], | 30.00th=[ 13829], 40.00th=[ 23725], 50.00th=[ 31065], 60.00th=[ 40633], | 70.00th=[ 56361], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[137364], | 99.00th=[198181], 99.50th=[212861], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 31, max= 319, per=23.55%, avg=165.76, stdev=72.44, samples=70 iops : min= 1, max= 19, avg= 9.60, stdev= 4.55, samples=70 lat (usec) : 50=0.26%, 100=2.99%, 250=0.65%, 500=0.13% lat (msec) : 2=2.08%, 4=2.60%, 10=8.07%, 20=6.90%, 50=39.58% lat (msec) : 100=29.69%, 250=7.03% cpu : usr=0.06%, sys=5.30%, ctx=1877, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180344: Wed Sep 30 01:43:53 2026 read: IOPS=10, BW=169KiB/s (174kB/s)(6032KiB/35591msec) clat (usec): min=37, max=203749, avg=47551.08, stdev=32479.48 lat (usec): min=37, max=203750, avg=47552.58, stdev=32479.33 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 92], 20.00th=[ 21627], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 45351], 60.00th=[ 51643], | 70.00th=[ 60031], 80.00th=[ 69731], 90.00th=[ 84411], 95.00th=[108528], | 99.00th=[170918], 99.50th=[185598], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 351, per=25.76%, avg=172.32, stdev=86.42, samples=69 iops : min= 1, max= 21, avg=10.00, stdev= 5.47, samples=69 write: IOPS=10, BW=176KiB/s (180kB/s)(6256KiB/35591msec); 0 zone resets clat (usec): min=1364, max=307440, avg=43956.46, stdev=45522.70 lat (usec): min=1366, max=307442, avg=43961.47, stdev=45523.34 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2212], 10.00th=[ 3064], 20.00th=[ 6915], | 30.00th=[ 12387], 40.00th=[ 21103], 50.00th=[ 31589], 60.00th=[ 38536], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[104334], 95.00th=[133694], | 99.00th=[202376], 99.50th=[206570], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 23, max= 415, per=25.06%, avg=176.44, stdev=91.18, samples=70 iops : min= 1, max= 25, avg=10.27, stdev= 5.74, samples=70 lat (usec) : 50=0.26%, 100=4.82%, 250=0.78%, 500=0.26% lat (msec) : 2=2.47%, 4=4.43%, 10=6.90%, 20=8.33%, 50=34.51% lat (msec) : 100=28.78%, 250=8.33%, 500=0.13% cpu : usr=0.07%, sys=5.32%, ctx=1793, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=670KiB/s (686kB/s), 167KiB/s-178KiB/s (171kB/s-183kB/s), io=23.4MiB (24.5MB), run=33182-35767msec WRITE: bw=705KiB/s (721kB/s), 169KiB/s-192KiB/s (173kB/s-197kB/s), io=24.6MiB (25.8MB), run=33182-35767msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180337: Wed Sep 30 01:44:03 2026 read: IOPS=8, BW=130KiB/s (134kB/s)(5920KiB/45375msec) clat (msec): min=7, max=218, avg=49.20, stdev=44.23 lat (msec): min=7, max=218, avg=49.21, stdev=44.23 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 121], 95.00th=[ 159], | 99.00th=[ 197], 99.50th=[ 215], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 30, max= 415, per=24.87%, avg=130.31, stdev=89.92, samples=88 iops : min= 1, max= 25, avg= 7.36, stdev= 5.63, samples=88 write: IOPS=8, BW=140KiB/s (144kB/s)(6368KiB/45375msec); 0 zone resets clat (msec): min=14, max=272, avg=67.99, stdev=47.87 lat (msec): min=14, max=272, avg=68.02, stdev=47.88 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 102], 90.00th=[ 138], 95.00th=[ 174], | 99.00th=[ 239], 99.50th=[ 266], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 416, per=25.31%, avg=139.48, stdev=92.05, samples=89 iops : min= 1, max= 26, avg= 7.96, stdev= 5.76, samples=89 lat (msec) : 10=0.39%, 20=13.41%, 50=44.27%, 100=25.52%, 250=16.15% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.66%, ctx=1194, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180338: Wed Sep 30 01:44:03 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5744KiB/45283msec) clat (msec): min=9, max=260, avg=45.98, stdev=41.80 lat (msec): min=9, max=260, avg=45.98, stdev=41.80 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 102], 95.00th=[ 138], | 99.00th=[ 222], 99.50th=[ 234], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 22, max= 383, per=25.68%, avg=134.58, stdev=84.80, samples=84 iops : min= 1, max= 23, avg= 7.63, stdev= 5.27, samples=84 write: IOPS=9, BW=145KiB/s (148kB/s)(6544KiB/45283msec); 0 zone resets clat (msec): min=14, max=260, avg=69.41, stdev=46.68 lat (msec): min=14, max=260, avg=69.42, stdev=46.68 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 109], 90.00th=[ 142], 95.00th=[ 171], | 99.00th=[ 199], 99.50th=[ 218], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 411, per=26.81%, avg=147.75, stdev=89.64, samples=87 iops : min= 1, max= 25, avg= 8.46, stdev= 5.62, samples=87 lat (msec) : 10=0.52%, 20=11.98%, 50=47.14%, 100=23.96%, 250=16.15% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.74%, ctx=1245, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180339: Wed Sep 30 01:44:03 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(6256KiB/45663msec) clat (msec): min=8, max=221, avg=46.93, stdev=41.21 lat (msec): min=8, max=221, avg=46.93, stdev=41.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 70], 90.00th=[ 105], 95.00th=[ 150], | 99.00th=[ 194], 99.50th=[ 213], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 479, per=26.75%, avg=140.15, stdev=101.50, samples=86 iops : min= 1, max= 29, avg= 7.98, stdev= 6.35, samples=86 write: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45663msec); 0 zone resets clat (msec): min=15, max=280, avg=71.61, stdev=52.29 lat (msec): min=15, max=280, avg=71.61, stdev=52.29 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 111], 90.00th=[ 144], 95.00th=[ 182], | 99.00th=[ 249], 99.50th=[ 271], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 383, per=23.32%, avg=128.48, stdev=79.32, samples=89 iops : min= 1, max= 23, avg= 7.26, stdev= 4.94, samples=89 lat (msec) : 10=0.65%, 20=13.28%, 50=46.88%, 100=22.27%, 250=16.54% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.72%, ctx=1180, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180341: Wed Sep 30 01:44:03 2026 read: IOPS=8, BW=132KiB/s (136kB/s)(6032KiB/45536msec) clat (msec): min=6, max=261, avg=49.38, stdev=44.48 lat (msec): min=6, max=261, avg=49.38, stdev=44.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 73], 90.00th=[ 124], 95.00th=[ 150], | 99.00th=[ 190], 99.50th=[ 245], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 412, per=25.89%, avg=135.65, stdev=93.18, samples=86 iops : min= 1, max= 25, avg= 7.70, stdev= 5.82, samples=86 write: IOPS=8, BW=137KiB/s (141kB/s)(6256KiB/45536msec); 0 zone resets clat (msec): min=12, max=240, avg=67.92, stdev=47.66 lat (msec): min=12, max=240, avg=67.93, stdev=47.66 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 102], 90.00th=[ 146], 95.00th=[ 169], | 99.00th=[ 228], 99.50th=[ 234], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 479, per=24.85%, avg=136.90, stdev=90.45, samples=88 iops : min= 1, max= 29, avg= 7.78, stdev= 5.65, samples=88 lat (msec) : 10=0.78%, 20=12.24%, 50=47.01%, 100=22.92%, 250=16.93% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.80%, ctx=1216, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=525KiB/s (537kB/s), 127KiB/s-137KiB/s (130kB/s-140kB/s), io=23.4MiB (24.5MB), run=45283-45663msec WRITE: bw=552KiB/s (565kB/s), 132KiB/s-145KiB/s (135kB/s-148kB/s), io=24.6MiB (25.8MB), run=45283-45663msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180361: Wed Sep 30 01:44:18 2026 read: IOPS=1, BW=1877KiB/s (1922kB/s)(7168KiB/3818msec) clat (usec): min=532, max=333310, avg=159891.05, stdev=122498.48 lat (usec): min=534, max=333312, avg=159892.57, stdev=122498.65 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 3097], | 30.00th=[158335], 40.00th=[158335], 50.00th=[170918], 60.00th=[204473], | 70.00th=[204473], 80.00th=[248513], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2027, max= 4047, per=62.33%, avg=2726.50, stdev=951.52, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1341KiB/s (1373kB/s)(5120KiB/3818msec); 0 zone resets clat (msec): min=368, max=962, avg=526.99, stdev=245.85 lat (msec): min=368, max=962, avg=527.06, stdev=245.83 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1718, max= 2035, per=31.89%, avg=1952.75, stdev=156.53, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=12.26%, ctx=175, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180362: Wed Sep 30 01:44:18 2026 read: IOPS=0, BW=437KiB/s (448kB/s)(2048KiB/4682msec) clat (msec): min=58, max=711, avg=385.31, stdev=461.71 lat (msec): min=58, max=711, avg=385.31, stdev=461.71 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 59], 40.00th=[ 59], 50.00th=[ 59], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2027, max= 2035, per=46.43%, avg=2031.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2187KiB/s (2240kB/s)(10.0MiB/4682msec); 0 zone resets clat (msec): min=118, max=1142, avg=352.62, stdev=309.74 lat (msec): min=118, max=1142, avg=352.71, stdev=309.73 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 123], | 30.00th=[ 169], 40.00th=[ 174], 50.00th=[ 213], 60.00th=[ 284], | 70.00th=[ 317], 80.00th=[ 485], 90.00th=[ 502], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1718, max= 6071, per=52.01%, avg=3184.40, stdev=1861.76, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=14.36%, ctx=156, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180363: Wed Sep 30 01:44:18 2026 read: IOPS=1, BW=2006KiB/s (2054kB/s)(6144KiB/3063msec) clat (usec): min=503, max=240242, avg=40779.62, stdev=97716.85 lat (usec): min=505, max=240243, avg=40780.81, stdev=97716.94 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 1057], 50.00th=[ 1057], 60.00th=[ 1090], | 70.00th=[ 1237], 80.00th=[ 1237], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 1718, max= 4063, per=74.90%, avg=3276.00, stdev=1349.29, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=2006KiB/s (2054kB/s)(6144KiB/3063msec); 0 zone resets clat (msec): min=229, max=581, avg=434.42, stdev=130.58 lat (msec): min=229, max=581, avg=435.14, stdev=130.92 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 493], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1426, max= 2035, per=30.16%, avg=1846.60, stdev=271.14, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 2=25.00%, 250=16.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=14.99%, ctx=143, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180364: Wed Sep 30 01:44:18 2026 read: IOPS=1, BW=1278KiB/s (1308kB/s)(5120KiB/4007msec) clat (usec): min=383, max=292175, avg=105306.67, stdev=145088.70 lat (usec): min=383, max=292175, avg=105307.81, stdev=145088.54 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 383], | 30.00th=[ 465], 40.00th=[ 465], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[233833], 80.00th=[233833], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 2027, max= 6119, per=93.12%, avg=4073.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1789KiB/s (1832kB/s)(7168KiB/4007msec); 0 zone resets clat (msec): min=94, max=905, avg=466.72, stdev=307.19 lat (msec): min=94, max=906, avg=466.79, stdev=307.19 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 264], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 368], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 860], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1444, max= 4079, per=37.94%, avg=2323.20, stdev=1013.90, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=12.51%, ctx=143, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4374KiB/s (4479kB/s), 437KiB/s-2006KiB/s (448kB/s-2054kB/s), io=20.0MiB (20.0MB), run=3063-4682msec WRITE: bw=6124KiB/s (6271kB/s), 1341KiB/s-2187KiB/s (1373kB/s-2240kB/s), io=28.0MiB (29.4MB), run=3063-4682msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180356: Wed Sep 30 01:44:18 2026 read: IOPS=2, BW=2086KiB/s (2136kB/s)(7168KiB/3437msec) clat (msec): min=95, max=294, avg=161.44, stdev=67.19 lat (msec): min=95, max=294, avg=161.44, stdev=67.19 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 142], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1928, max= 4190, per=82.50%, avg=3357.00, stdev=1243.21, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1490KiB/s (1525kB/s)(5120KiB/3437msec); 0 zone resets clat (msec): min=295, max=592, avg=446.63, stdev=141.72 lat (msec): min=295, max=592, avg=446.75, stdev=141.68 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1928, max= 4079, per=47.09%, avg=2682.00, stdev=1211.11, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=4.19%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180357: Wed Sep 30 01:44:18 2026 read: IOPS=0, BW=454KiB/s (465kB/s)(2048KiB/4511msec) clat (msec): min=106, max=184, avg=145.51, stdev=55.08 lat (msec): min=106, max=184, avg=145.52, stdev=55.08 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 1408, max= 2003, per=41.91%, avg=1705.50, stdev=420.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2270KiB/s (2324kB/s)(10.0MiB/4511msec); 0 zone resets clat (msec): min=121, max=1211, avg=405.99, stdev=348.84 lat (msec): min=121, max=1211, avg=406.10, stdev=348.84 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 127], | 30.00th=[ 186], 40.00th=[ 188], 50.00th=[ 209], 60.00th=[ 247], | 70.00th=[ 477], 80.00th=[ 600], 90.00th=[ 701], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1976, max= 4079, per=46.54%, avg=2650.83, stdev=1022.41, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=66.67%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=6.05%, ctx=150, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180358: Wed Sep 30 01:44:18 2026 read: IOPS=1, BW=1221KiB/s (1250kB/s)(6144KiB/5033msec) clat (msec): min=86, max=918, avg=423.86, stdev=357.59 lat (msec): min=86, max=918, avg=423.87, stdev=357.58 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 284], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1976, max= 2048, per=49.42%, avg=2010.80, stdev=32.93, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1221KiB/s (1250kB/s)(6144KiB/5033msec); 0 zone resets clat (msec): min=228, max=662, avg=378.02, stdev=175.99 lat (msec): min=228, max=662, avg=378.13, stdev=175.98 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 334], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1406, max= 2048, per=33.00%, avg=1879.40, stdev=269.12, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=4.95%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180360: Wed Sep 30 01:44:18 2026 read: IOPS=1, BW=1044KiB/s (1070kB/s)(5120KiB/4902msec) clat (msec): min=53, max=794, avg=356.45, stdev=279.30 lat (msec): min=53, max=794, avg=356.45, stdev=279.30 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1928, max= 4023, per=64.97%, avg=2643.67, stdev=1194.82, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1462KiB/s (1497kB/s)(7168KiB/4902msec); 0 zone resets clat (msec): min=153, max=815, avg=416.77, stdev=262.53 lat (msec): min=153, max=815, avg=417.58, stdev=262.12 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 171], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 284], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 659], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1393, max= 4096, per=40.36%, avg=2299.00, stdev=1039.58, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=4.98%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4069KiB/s (4167kB/s), 454KiB/s-2086KiB/s (465kB/s-2136kB/s), io=20.0MiB (20.0MB), run=3437-5033msec WRITE: bw=5697KiB/s (5834kB/s), 1221KiB/s-2270KiB/s (1250kB/s-2324kB/s), io=28.0MiB (29.4MB), run=3437-5033msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180371: Wed Sep 30 01:44:32 2026 read: IOPS=1, BW=4214KiB/s (4315kB/s)(12.0MiB/2916msec) clat (msec): min=190, max=1558, avg=962.94, stdev=700.74 lat (msec): min=190, max=1558, avg=962.94, stdev=700.74 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.71%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180372: Wed Sep 30 01:44:32 2026 read: IOPS=0, BW=1225KiB/s (1254kB/s)(4096KiB/3344msec) clat (nsec): min=1427.7M, max=1427.7M, avg=1427676079.00, stdev= 0.00 lat (nsec): min=1427.7M, max=1427.7M, avg=1427678714.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2450KiB/s (2509kB/s)(8192KiB/3344msec); 0 zone resets clat (msec): min=891, max=955, avg=923.56, stdev=44.78 lat (msec): min=892, max=955, avg=923.85, stdev=44.83 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7984, max= 7984, per=81.48%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.39%, ctx=30, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180373: Wed Sep 30 01:44:32 2026 write: IOPS=2, BW=8771KiB/s (8981kB/s)(12.0MiB/1401msec); 0 zone resets clat (msec): min=351, max=565, avg=446.74, stdev=108.90 lat (msec): min=352, max=565, avg=447.09, stdev=108.78 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 6826, max= 8175, per=76.54%, avg=7500.50, stdev=953.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=8.36%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180374: Wed Sep 30 01:44:32 2026 write: IOPS=1, BW=4662KiB/s (4773kB/s)(12.0MiB/2636msec); 0 zone resets clat (msec): min=396, max=1255, avg=828.88, stdev=429.76 lat (msec): min=396, max=1256, avg=829.22, stdev=429.83 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 5936, max= 8159, per=71.92%, avg=7047.50, stdev=1571.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.24%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4900KiB/s (5017kB/s), 1225KiB/s-4214KiB/s (1254kB/s-4315kB/s), io=16.0MiB (16.8MB), run=2916-3344msec WRITE: bw=9799KiB/s (10.0MB/s), 2450KiB/s-8771KiB/s (2509kB/s-8981kB/s), io=32.0MiB (33.6MB), run=1401-3344msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180375: Wed Sep 30 01:44:32 2026 read: IOPS=1, BW=4874KiB/s (4991kB/s)(12.0MiB/2521msec) clat (msec): min=751, max=912, avg=806.00, stdev=92.36 lat (msec): min=751, max=912, avg=806.01, stdev=92.36 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.01%, ctx=370, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180376: Wed Sep 30 01:44:32 2026 read: IOPS=0, BW=1427KiB/s (1461kB/s)(4096KiB/2870msec) clat (nsec): min=753848k, max=753848k, avg=753847932.00, stdev= 0.00 lat (nsec): min=753850k, max=753850k, avg=753850335.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2854KiB/s (2923kB/s)(8192KiB/2870msec); 0 zone resets clat (msec): min=701, max=1285, avg=993.20, stdev=413.12 lat (msec): min=701, max=1285, avg=993.50, stdev=413.31 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8192, max= 8192, per=82.26%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.13%, ctx=124, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180377: Wed Sep 30 01:44:32 2026 write: IOPS=0, BW=3735KiB/s (3825kB/s)(12.0MiB/3290msec); 0 zone resets clat (msec): min=206, max=1880, avg=1013.99, stdev=838.35 lat (msec): min=207, max=1880, avg=1014.78, stdev=838.26 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 7937, max= 8159, per=80.81%, avg=8048.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.20%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180378: Wed Sep 30 01:44:32 2026 write: IOPS=1, BW=4669KiB/s (4781kB/s)(12.0MiB/2632msec); 0 zone resets clat (msec): min=506, max=1334, avg=791.42, stdev=470.73 lat (msec): min=507, max=1336, avg=792.09, stdev=471.31 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8159, max= 8159, per=81.93%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=4.56%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5709KiB/s (5846kB/s), 1427KiB/s-4874KiB/s (1461kB/s-4991kB/s), io=16.0MiB (16.8MB), run=2521-2870msec WRITE: bw=9960KiB/s (10.2MB/s), 2854KiB/s-4669KiB/s (2923kB/s-4781kB/s), io=32.0MiB (33.6MB), run=2632-3290msec