== sanity test 398b: DIO and buffer IO race ============== 13:18:53 (1788974333) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.99739 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147107: Wed Sep 9 13:21:25 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(5992KiB/128866msec) clat (usec): min=30, max=1009.8k, avg=41550.60, stdev=40424.83 lat (usec): min=31, max=1009.8k, avg=41555.91, stdev=40426.43 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 73], | 20.00th=[ 18220], 30.00th=[ 23987], 40.00th=[ 28967], | 50.00th=[ 34866], 60.00th=[ 41681], 70.00th=[ 50594], | 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[ 149947], 99.50th=[ 164627], 99.90th=[ 283116], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 102, per=25.39%, avg=46.20, stdev=19.65, samples=253 iops : min= 1, max= 25, avg=10.90, stdev= 4.93, samples=253 write: IOPS=12, BW=48.9KiB/s (50.0kB/s)(6296KiB/128866msec); 0 zone resets clat (usec): min=938, max=358300, avg=42024.33, stdev=43332.67 lat (usec): min=938, max=358301, avg=42028.82, stdev=43330.85 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1696], 20.00th=[ 4146], | 30.00th=[ 7963], 40.00th=[ 19006], 50.00th=[ 30802], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[125305], | 99.00th=[177210], 99.50th=[214959], 99.90th=[337642], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 118, per=25.65%, avg=48.74, stdev=20.44, samples=252 iops : min= 1, max= 29, avg=11.54, stdev= 5.15, samples=252 lat (usec) : 50=0.91%, 100=4.82%, 250=0.42%, 500=0.07%, 1000=0.20% lat (msec) : 2=5.83%, 4=4.00%, 10=7.03%, 20=8.89%, 50=35.12% lat (msec) : 100=25.16%, 250=7.36%, 500=0.16%, 2000=0.03% cpu : usr=0.06%, sys=5.00%, ctx=6408, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147109: Wed Sep 9 13:21:25 2026 read: IOPS=11, BW=45.1KiB/s (46.2kB/s)(5940KiB/131588msec) clat (usec): min=32, max=298904, avg=41368.90, stdev=31082.40 lat (usec): min=32, max=298906, avg=41370.11, stdev=31082.84 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 81], 20.00th=[ 17957], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[133694], 99.50th=[156238], 99.90th=[238027], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 5, max= 111, per=24.70%, avg=44.96, stdev=19.70, samples=257 iops : min= 1, max= 27, avg=10.60, stdev= 4.97, samples=257 write: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6348KiB/131588msec); 0 zone resets clat (usec): min=964, max=1003.6k, avg=43880.80, stdev=49167.17 lat (usec): min=965, max=1003.6k, avg=43889.50, stdev=49167.78 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1729], | 20.00th=[ 4621], 30.00th=[ 10814], 40.00th=[ 22676], | 50.00th=[ 33162], 60.00th=[ 44827], 70.00th=[ 56361], | 80.00th=[ 73925], 90.00th=[ 101188], 95.00th=[ 126354], | 99.00th=[ 187696], 99.50th=[ 227541], 99.90th=[ 329253], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 5, max= 133, per=25.17%, avg=47.83, stdev=20.98, samples=258 iops : min= 1, max= 33, avg=11.31, stdev= 5.25, samples=258 lat (usec) : 50=0.88%, 100=4.39%, 250=0.39%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.79%, 4=3.52%, 10=5.79%, 20=9.77%, 50=35.16% lat (msec) : 100=26.46%, 250=7.36%, 500=0.16%, 2000=0.03% cpu : usr=0.07%, sys=4.95%, ctx=6593, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147111: Wed Sep 9 13:21:25 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6028KiB/131644msec) clat (usec): min=28, max=445153, avg=39545.71, stdev=32992.93 lat (usec): min=28, max=445157, avg=39551.63, stdev=32994.01 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 68], 20.00th=[ 16581], | 30.00th=[ 22938], 40.00th=[ 27657], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[137364], 99.50th=[170918], 99.90th=[274727], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 142, per=25.27%, avg=46.00, stdev=22.25, samples=255 iops : min= 1, max= 35, avg=10.85, stdev= 5.59, samples=255 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6260KiB/131644msec); 0 zone resets clat (usec): min=975, max=1243.0k, avg=45714.84, stdev=55675.43 lat (usec): min=976, max=1243.0k, avg=45716.79, stdev=55675.98 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1713], | 20.00th=[ 3884], 30.00th=[ 8979], 40.00th=[ 20055], | 50.00th=[ 34341], 60.00th=[ 44827], 70.00th=[ 58983], | 80.00th=[ 77071], 90.00th=[ 108528], 95.00th=[ 131597], | 99.00th=[ 204473], 99.50th=[ 248513], 99.90th=[ 425722], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 174, per=25.07%, avg=47.63, stdev=22.95, samples=256 iops : min= 1, max= 43, avg=11.26, stdev= 5.77, samples=256 lat (usec) : 50=1.20%, 100=5.01%, 250=0.59%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.02%, 4=4.39%, 10=6.25%, 20=8.50%, 50=34.73% lat (msec) : 100=24.51%, 250=8.24%, 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=4.91%, ctx=6436, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147113: Wed Sep 9 13:21:25 2026 read: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6052KiB/131587msec) clat (usec): min=31, max=478016, avg=40528.37, stdev=33447.94 lat (usec): min=31, max=478017, avg=40531.62, stdev=33446.63 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 74], 20.00th=[ 17433], | 30.00th=[ 23462], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[164627], 99.90th=[283116], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 103, per=25.30%, avg=46.05, stdev=19.81, samples=255 iops : min= 1, max= 25, avg=10.86, stdev= 4.99, samples=255 write: IOPS=11, BW=47.4KiB/s (48.5kB/s)(6236KiB/131587msec); 0 zone resets clat (usec): min=938, max=1194.8k, avg=44757.68, stdev=53303.52 lat (usec): min=938, max=1194.8k, avg=44762.34, stdev=53304.01 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1205], 10.00th=[ 1647], | 20.00th=[ 4080], 30.00th=[ 8225], 40.00th=[ 20841], | 50.00th=[ 32900], 60.00th=[ 44827], 70.00th=[ 58459], | 80.00th=[ 79168], 90.00th=[ 104334], 95.00th=[ 127402], | 99.00th=[ 187696], 99.50th=[ 233833], 99.90th=[ 375391], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 7, max= 125, per=24.87%, avg=47.26, stdev=19.34, samples=256 iops : min= 1, max= 31, avg=11.17, stdev= 4.87, samples=256 lat (usec) : 50=0.85%, 100=4.82%, 250=0.55%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=6.12%, 4=4.07%, 10=6.64%, 20=8.11%, 50=35.74% lat (msec) : 100=24.64%, 250=7.85%, 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=5.04%, ctx=6456, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=182KiB/s (187kB/s), 45.1KiB/s-46.5KiB/s (46.2kB/s-47.6kB/s), io=23.4MiB (24.6MB), run=128866-131644msec WRITE: bw=191KiB/s (196kB/s), 47.4KiB/s-48.9KiB/s (48.5kB/s-50.0kB/s), io=24.6MiB (25.7MB), run=128866-131644msec fio: pid=147108, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=147106: Wed Sep 9 13:23:34 2026 read: IOPS=5, BW=23.0KiB/s (23.6kB/s)(5992KiB/260379msec) clat (msec): min=6, max=1034, avg=34.63, stdev=44.29 lat (msec): min=6, max=1034, avg=34.64, stdev=44.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 79], 95.00th=[ 106], | 99.00th=[ 184], 99.50th=[ 239], 99.90th=[ 368], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 103, per=32.49%, avg=25.34, stdev=18.44, samples=457 iops : min= 1, max= 25, avg= 5.69, stdev= 4.65, samples=457 write: IOPS=6, BW=24.2KiB/s (24.8kB/s)(6296KiB/260379msec); 0 zone resets clat (msec): min=41, max=549, avg=132.18, stdev=70.12 lat (msec): min=41, max=549, avg=132.18, stdev=70.12 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 150], 80.00th=[ 180], 90.00th=[ 226], 95.00th=[ 275], | 99.00th=[ 372], 99.50th=[ 414], 99.90th=[ 514], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 56, per=29.20%, avg=23.94, stdev=12.04, samples=507 iops : min= 1, max= 14, avg= 5.33, stdev= 3.04, samples=507 lat (msec) : 10=2.83%, 20=19.99%, 50=18.00%, 100=26.37%, 250=28.87% lat (msec) : 500=3.84%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5425, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=147108: Wed Sep 9 13:23:34 2026 read: IOPS=3, BW=15.5KiB/s (15.9kB/s)(2408KiB/154897msec) clat (msec): min=7, max=1034, avg=56.37, stdev=58.94 lat (msec): min=7, max=1034, avg=56.37, stdev=58.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 107], 95.00th=[ 138], | 99.00th=[ 226], 99.50th=[ 266], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 79, per=24.27%, avg=18.93, stdev=13.55, samples=242 iops : min= 1, max= 19, avg= 4.07, stdev= 3.40, samples=242 write: IOPS=4, BW=17.2KiB/s (17.6kB/s)(2664KiB/154897msec); 0 zone resets clat (msec): min=43, max=710, avg=181.06, stdev=81.76 lat (msec): min=43, max=710, avg=181.06, stdev=81.76 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 77], 10.00th=[ 91], 20.00th=[ 110], | 30.00th=[ 129], 40.00th=[ 148], 50.00th=[ 167], 60.00th=[ 192], | 70.00th=[ 211], 80.00th=[ 243], 90.00th=[ 292], 95.00th=[ 326], | 99.00th=[ 430], 99.50th=[ 464], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 47, per=20.61%, avg=16.90, stdev= 8.52, samples=299 iops : min= 1, max= 11, avg= 3.56, stdev= 2.15, samples=299 lat (msec) : 10=1.02%, 20=8.51%, 50=17.42%, 100=22.14%, 250=40.66% lat (msec) : 500=9.93%, 750=0.16%, 2000=0.08% cpu : usr=0.03%, sys=0.80%, ctx=1771, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=603,666,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147110: Wed Sep 9 13:23:34 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(6028KiB/257791msec) clat (msec): min=5, max=382, avg=35.64, stdev=38.70 lat (msec): min=5, max=382, avg=35.64, stdev=38.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 109], | 99.00th=[ 197], 99.50th=[ 249], 99.90th=[ 368], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 126, per=33.16%, avg=25.87, stdev=19.05, samples=450 iops : min= 1, max= 31, avg= 5.81, stdev= 4.78, samples=450 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6260KiB/257791msec); 0 zone resets clat (msec): min=38, max=1229, avg=130.10, stdev=75.18 lat (msec): min=38, max=1229, avg=130.11, stdev=75.18 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 96], 50.00th=[ 109], 60.00th=[ 125], | 70.00th=[ 146], 80.00th=[ 178], 90.00th=[ 228], 95.00th=[ 268], | 99.00th=[ 359], 99.50th=[ 405], 99.90th=[ 751], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 63, per=29.38%, avg=24.09, stdev=12.49, samples=500 iops : min= 1, max= 15, avg= 5.36, stdev= 3.16, samples=500 lat (msec) : 10=3.39%, 20=19.66%, 50=16.60%, 100=28.26%, 250=28.35% lat (msec) : 500=3.65%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.21%, ctx=5431, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147112: Wed Sep 9 13:23:34 2026 read: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6052KiB/259757msec) clat (msec): min=6, max=382, avg=34.46, stdev=37.45 lat (msec): min=6, max=382, avg=34.46, stdev=37.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 47], 90.00th=[ 79], 95.00th=[ 109], | 99.00th=[ 186], 99.50th=[ 213], 99.90th=[ 347], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 102, per=33.69%, avg=26.28, stdev=18.40, samples=445 iops : min= 1, max= 25, avg= 5.92, stdev= 4.62, samples=445 write: IOPS=6, BW=24.0KiB/s (24.6kB/s)(6236KiB/259757msec); 0 zone resets clat (msec): min=35, max=1166, avg=132.88, stdev=75.46 lat (msec): min=35, max=1166, avg=132.89, stdev=75.46 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 148], 80.00th=[ 184], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 422], 99.90th=[ 743], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 55, per=28.71%, avg=23.55, stdev=12.16, samples=509 iops : min= 1, max= 13, avg= 5.23, stdev= 3.07, samples=509 lat (msec) : 10=3.29%, 20=20.05%, 50=17.25%, 100=26.56%, 250=28.71% lat (msec) : 500=4.07%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5472, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=78.7KiB/s (80.5kB/s), 15.5KiB/s-23.4KiB/s (15.9kB/s-23.9kB/s), io=20.0MiB (20.0MB), run=154897-260379msec WRITE: bw=82.4KiB/s (84.4kB/s), 17.2KiB/s-24.3KiB/s (17.6kB/s-24.9kB/s), io=20.0MiB (21.0MB), run=154897-260379msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147170: Wed Sep 9 13:24:15 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(5920KiB/28544msec) clat (usec): min=32, max=252743, avg=37681.88, stdev=34158.37 lat (usec): min=33, max=252744, avg=37682.97, stdev=34158.36 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 84], | 30.00th=[ 20841], 40.00th=[ 28705], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[162530], 99.50th=[196084], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 447, per=26.07%, avg=207.02, stdev=91.10, samples=56 iops : min= 1, max= 27, avg=12.21, stdev= 5.77, samples=56 write: IOPS=13, BW=223KiB/s (228kB/s)(6368KiB/28544msec); 0 zone resets clat (usec): min=1389, max=434042, avg=36179.66, stdev=43364.31 lat (usec): min=1390, max=434043, avg=36181.60, stdev=43364.34 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1598], 10.00th=[ 2089], 20.00th=[ 4555], | 30.00th=[ 7373], 40.00th=[ 10552], 50.00th=[ 18744], 60.00th=[ 32900], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[162530], 99.50th=[227541], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 31, max= 411, per=26.71%, avg=223.02, stdev=73.33, samples=56 iops : min= 1, max= 25, avg=13.23, stdev= 4.58, samples=56 lat (usec) : 50=1.04%, 100=9.24%, 250=1.17%, 500=0.26%, 750=0.26% lat (msec) : 2=5.08%, 4=4.43%, 10=11.20%, 20=7.94%, 50=30.34% lat (msec) : 100=22.79%, 250=5.99%, 500=0.26% cpu : usr=0.04%, sys=4.92%, ctx=1374, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147171: Wed Sep 9 13:24:15 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5744KiB/28658msec) clat (usec): min=38, max=220041, avg=42032.70, stdev=31920.64 lat (usec): min=39, max=220043, avg=42034.17, stdev=31920.84 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 11600], | 30.00th=[ 25035], 40.00th=[ 33162], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 82314], 95.00th=[ 88605], | 99.00th=[125305], 99.50th=[193987], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 411, per=25.15%, avg=199.68, stdev=75.08, samples=56 iops : min= 1, max= 25, avg=11.75, stdev= 4.71, samples=56 write: IOPS=14, BW=228KiB/s (234kB/s)(6544KiB/28658msec); 0 zone resets clat (usec): min=1386, max=426511, avg=32669.57, stdev=40391.71 lat (usec): min=1388, max=426514, avg=32673.33, stdev=40397.90 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1680], 10.00th=[ 2245], 20.00th=[ 4113], | 30.00th=[ 6652], 40.00th=[ 10290], 50.00th=[ 17171], 60.00th=[ 27657], | 70.00th=[ 38536], 80.00th=[ 56361], 90.00th=[ 85459], 95.00th=[108528], | 99.00th=[152044], 99.50th=[160433], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 63, max= 473, per=27.65%, avg=230.85, stdev=85.94, samples=55 iops : min= 3, max= 29, avg=13.71, stdev= 5.40, samples=55 lat (usec) : 50=1.17%, 100=6.77%, 250=0.52%, 500=0.39% lat (msec) : 2=4.56%, 4=6.12%, 10=10.81%, 20=9.51%, 50=30.99% lat (msec) : 100=24.61%, 250=4.43%, 500=0.13% cpu : usr=0.07%, sys=5.48%, ctx=1434, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147172: Wed Sep 9 13:24:15 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30156msec) clat (usec): min=33, max=199265, avg=40207.25, stdev=35729.77 lat (usec): min=34, max=199266, avg=40215.01, stdev=35726.15 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 163], | 30.00th=[ 20841], 40.00th=[ 29230], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[ 99091], | 99.00th=[183501], 99.50th=[196084], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 62, max= 414, per=25.97%, avg=206.17, stdev=92.72, samples=59 iops : min= 3, max= 25, avg=12.15, stdev= 5.83, samples=59 write: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30156msec); 0 zone resets clat (usec): min=1356, max=206232, avg=37771.94, stdev=39931.38 lat (usec): min=1356, max=206233, avg=37774.31, stdev=39931.69 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1745], 10.00th=[ 2802], 20.00th=[ 4948], | 30.00th=[ 7177], 40.00th=[ 12125], 50.00th=[ 23462], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 70779], 90.00th=[100140], 95.00th=[115868], | 99.00th=[179307], 99.50th=[198181], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 380, per=23.38%, avg=195.25, stdev=78.61, samples=59 iops : min= 1, max= 23, avg=11.47, stdev= 4.99, samples=59 lat (usec) : 50=1.56%, 100=7.68%, 250=1.56%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.91%, 4=3.65%, 10=10.55%, 20=8.72%, 50=29.82% lat (msec) : 100=24.61%, 250=7.16% cpu : usr=0.06%, sys=4.97%, ctx=1485, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147173: Wed Sep 9 13:24:15 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28070msec) clat (usec): min=31, max=325194, avg=38617.59, stdev=33552.22 lat (usec): min=31, max=325195, avg=38618.90, stdev=33552.24 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 116], | 30.00th=[ 23725], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[229639], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 62, max= 480, per=26.81%, avg=212.84, stdev=81.44, samples=55 iops : min= 3, max= 30, avg=12.58, stdev= 5.17, samples=55 write: IOPS=13, BW=223KiB/s (228kB/s)(6256KiB/28070msec); 0 zone resets clat (usec): min=1301, max=282777, avg=34326.14, stdev=40650.08 lat (usec): min=1303, max=282780, avg=34329.34, stdev=40652.29 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1696], 10.00th=[ 2114], 20.00th=[ 4080], | 30.00th=[ 6587], 40.00th=[ 9372], 50.00th=[ 16581], 60.00th=[ 29754], | 70.00th=[ 42730], 80.00th=[ 60556], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[183501], 99.50th=[191890], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 448, per=26.59%, avg=222.02, stdev=93.50, samples=55 iops : min= 1, max= 28, avg=13.16, stdev= 5.90, samples=55 lat (usec) : 50=1.56%, 100=7.81%, 250=1.04%, 500=0.26%, 750=0.13% lat (msec) : 2=5.21%, 4=5.08%, 10=11.33%, 20=7.42%, 50=32.55% lat (msec) : 100=22.01%, 250=5.34%, 500=0.26% cpu : usr=0.10%, sys=5.12%, ctx=1355, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=794KiB/s (813kB/s), 200KiB/s-215KiB/s (205kB/s-220kB/s), io=23.4MiB (24.5MB), run=28070-30156msec WRITE: bw=836KiB/s (856kB/s), 200KiB/s-228KiB/s (205kB/s-234kB/s), io=24.6MiB (25.8MB), run=28070-30156msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147176: Wed Sep 9 13:25:00 2026 read: IOPS=5, BW=80.1KiB/s (82.0kB/s)(5920KiB/73898msec) clat (msec): min=6, max=469, avg=41.65, stdev=41.96 lat (msec): min=6, max=469, avg=41.65, stdev=41.96 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 81], 95.00th=[ 116], | 99.00th=[ 203], 99.50th=[ 309], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 29, max= 416, per=27.28%, avg=88.39, stdev=60.29, samples=132 iops : min= 1, max= 26, avg= 4.80, stdev= 3.82, samples=132 write: IOPS=5, BW=86.2KiB/s (88.2kB/s)(6368KiB/73898msec); 0 zone resets clat (msec): min=54, max=417, avg=146.76, stdev=68.13 lat (msec): min=54, max=417, avg=146.77, stdev=68.13 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 91], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 136], 60.00th=[ 146], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 239], 95.00th=[ 292], | 99.00th=[ 384], 99.50th=[ 414], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 23, max= 160, per=25.89%, avg=88.27, stdev=35.62, samples=142 iops : min= 1, max= 10, avg= 4.77, stdev= 2.35, samples=142 lat (msec) : 10=0.91%, 20=12.11%, 50=24.74%, 100=21.48%, 250=35.94% lat (msec) : 500=4.82% cpu : usr=0.04%, sys=1.19%, ctx=1365, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147177: Wed Sep 9 13:25:00 2026 read: IOPS=4, BW=77.8KiB/s (79.6kB/s)(5744KiB/73865msec) clat (msec): min=6, max=391, avg=38.95, stdev=35.84 lat (msec): min=6, max=391, avg=38.95, stdev=35.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 70], 95.00th=[ 92], | 99.00th=[ 169], 99.50th=[ 257], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 23, max= 381, per=27.47%, avg=88.99, stdev=60.80, samples=126 iops : min= 1, max= 23, avg= 4.83, stdev= 3.83, samples=126 write: IOPS=5, BW=88.6KiB/s (90.7kB/s)(6544KiB/73865msec); 0 zone resets clat (msec): min=44, max=567, avg=146.24, stdev=72.32 lat (msec): min=44, max=567, avg=146.24, stdev=72.32 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 93], | 30.00th=[ 108], 40.00th=[ 117], 50.00th=[ 129], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 236], 95.00th=[ 275], | 99.00th=[ 443], 99.50th=[ 502], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 29, max= 160, per=26.02%, avg=88.74, stdev=37.76, samples=144 iops : min= 1, max= 10, avg= 4.80, stdev= 2.48, samples=144 lat (msec) : 10=1.43%, 20=11.98%, 50=22.79%, 100=22.01%, 250=37.37% lat (msec) : 500=4.04%, 750=0.39% cpu : usr=0.04%, sys=1.20%, ctx=1318, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147178: Wed Sep 9 13:25:00 2026 read: IOPS=5, BW=88.9KiB/s (91.1kB/s)(6256KiB/70355msec) clat (msec): min=8, max=233, avg=39.58, stdev=35.80 lat (msec): min=8, max=233, avg=39.58, stdev=35.80 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 69], 95.00th=[ 110], | 99.00th=[ 199], 99.50th=[ 211], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 30, max= 320, per=31.81%, avg=103.07, stdev=67.70, samples=120 iops : min= 1, max= 20, avg= 5.71, stdev= 4.34, samples=120 write: IOPS=5, BW=85.7KiB/s (87.8kB/s)(6032KiB/70355msec); 0 zone resets clat (msec): min=46, max=579, avg=145.41, stdev=72.82 lat (msec): min=46, max=579, avg=145.42, stdev=72.81 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 104], 40.00th=[ 115], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 194], 90.00th=[ 243], 95.00th=[ 288], | 99.00th=[ 405], 99.50th=[ 523], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 29, max= 191, per=25.40%, avg=86.61, stdev=36.97, samples=137 iops : min= 1, max= 11, avg= 4.66, stdev= 2.40, samples=137 lat (msec) : 10=0.52%, 20=13.93%, 50=26.04%, 100=21.35%, 250=34.11% lat (msec) : 500=3.78%, 750=0.26% cpu : usr=0.03%, sys=1.21%, ctx=1415, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147179: Wed Sep 9 13:25:00 2026 read: IOPS=5, BW=83.2KiB/s (85.1kB/s)(6032KiB/72539msec) clat (msec): min=6, max=257, avg=41.01, stdev=34.27 lat (msec): min=6, max=257, avg=41.02, stdev=34.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 85], 95.00th=[ 107], | 99.00th=[ 180], 99.50th=[ 230], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 298, per=30.55%, avg=98.97, stdev=57.45, samples=119 iops : min= 1, max= 18, avg= 5.45, stdev= 3.71, samples=119 write: IOPS=5, BW=86.2KiB/s (88.3kB/s)(6256KiB/72539msec); 0 zone resets clat (msec): min=43, max=519, avg=145.84, stdev=71.56 lat (msec): min=43, max=519, avg=145.84, stdev=71.56 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 82], 20.00th=[ 93], | 30.00th=[ 103], 40.00th=[ 118], 50.00th=[ 127], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 247], 95.00th=[ 292], | 99.00th=[ 397], 99.50th=[ 498], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 29, max= 160, per=25.35%, avg=86.46, stdev=37.95, samples=142 iops : min= 1, max= 10, avg= 4.66, stdev= 2.49, samples=142 lat (msec) : 10=1.04%, 20=11.07%, 50=26.17%, 100=21.74%, 250=35.29% lat (msec) : 500=4.56%, 750=0.13% cpu : usr=0.03%, sys=1.16%, ctx=1460, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=324KiB/s (332kB/s), 77.8KiB/s-88.9KiB/s (79.6kB/s-91.1kB/s), io=23.4MiB (24.5MB), run=70355-73898msec WRITE: bw=341KiB/s (349kB/s), 85.7KiB/s-88.6KiB/s (87.8kB/s-90.7kB/s), io=24.6MiB (25.8MB), run=70355-73898msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147200: Wed Sep 9 13:25:18 2026 read: IOPS=1, BW=1312KiB/s (1343kB/s)(7168KiB/5464msec) clat (usec): min=474, max=3032.2k, avg=569951.99, stdev=1088677.19 lat (usec): min=475, max=3032.2k, avg=569953.59, stdev=1088677.28 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], | 20.00th=[ 120062], 30.00th=[ 183501], 40.00th=[ 183501], | 50.00th=[ 204473], 60.00th=[ 212861], 70.00th=[ 212861], | 80.00th=[ 238027], 90.00th=[3036677], 95.00th=[3036677], | 99.00th=[3036677], 99.50th=[3036677], 99.90th=[3036677], | 99.95th=[3036677], 99.99th=[3036677] bw ( KiB/s): min= 1408, max= 4096, per=100.00%, avg=2896.50, stdev=1384.75, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=937KiB/s (960kB/s)(5120KiB/5464msec); 0 zone resets clat (msec): min=156, max=542, avg=285.03, stdev=158.38 lat (msec): min=156, max=542, avg=285.10, stdev=158.36 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2027, max= 6083, per=100.00%, avg=4055.00, stdev=2868.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33% lat (msec) : 250=66.67%, 500=8.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.78%, ctx=657, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147201: Wed Sep 9 13:25:18 2026 read: IOPS=0, BW=278KiB/s (284kB/s)(2048KiB/7373msec) clat (usec): min=552, max=240905, avg=120728.86, stdev=169955.27 lat (usec): min=553, max=240909, avg=120731.48, stdev=169957.33 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[ 553], 50.00th=[ 553], 60.00th=[240124], | 70.00th=[240124], 80.00th=[240124], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 1473, max= 2048, per=63.40%, avg=1760.50, stdev=406.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1389KiB/s (1422kB/s)(10.0MiB/7373msec); 0 zone resets clat (msec): min=137, max=3142, avg=668.00, stdev=884.01 lat (msec): min=137, max=3142, avg=668.08, stdev=884.01 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 163], | 30.00th=[ 292], 40.00th=[ 347], 50.00th=[ 426], 60.00th=[ 502], | 70.00th=[ 518], 80.00th=[ 567], 90.00th=[ 592], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1992, max= 6071, per=78.28%, avg=3043.67, stdev=1689.24, samples=6 iops : min= 1, max= 5, avg= 2.50, stdev= 1.38, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=9.03%, ctx=144, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147202: Wed Sep 9 13:25:18 2026 read: IOPS=0, BW=838KiB/s (859kB/s)(6144KiB/7328msec) clat (msec): min=151, max=320, avg=214.13, stdev=63.77 lat (msec): min=151, max=320, avg=214.13, stdev=63.77 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 222], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1992, max= 4087, per=91.60%, avg=2543.75, stdev=1029.17, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=0, BW=838KiB/s (859kB/s)(6144KiB/7328msec); 0 zone resets clat (msec): min=167, max=3639, avg=926.00, stdev=1340.12 lat (msec): min=168, max=3639, avg=926.09, stdev=1340.12 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 393], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 2023, max= 4096, per=63.06%, avg=2451.60, stdev=919.31, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.22, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=8.83%, ctx=264, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147203: Wed Sep 9 13:25:18 2026 read: IOPS=0, BW=922KiB/s (944kB/s)(5120KiB/5554msec) clat (usec): min=466, max=303727, avg=93770.02, stdev=136813.38 lat (usec): min=468, max=303728, avg=93771.20, stdev=136813.08 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 465], | 30.00th=[ 758], 40.00th=[ 758], 50.00th=[ 848], 60.00th=[ 848], | 70.00th=[162530], 80.00th=[162530], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 4055, max= 4096, per=100.00%, avg=4075.50, stdev=28.99, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1291KiB/s (1322kB/s)(7168KiB/5554msec); 0 zone resets clat (msec): min=97, max=3169, avg=711.35, stdev=1095.01 lat (msec): min=97, max=3169, avg=711.42, stdev=1095.02 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 180], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 296], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 527], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1539, max= 4096, per=60.38%, avg=2347.40, stdev=1000.76, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (usec) : 500=8.33%, 1000=16.67% lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.80%, ctx=185, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2778KiB/s (2844kB/s), 278KiB/s-1312KiB/s (284kB/s-1343kB/s), io=20.0MiB (20.0MB), run=5464-7373msec WRITE: bw=3889KiB/s (3982kB/s), 838KiB/s-1389KiB/s (859kB/s-1422kB/s), io=28.0MiB (29.4MB), run=5464-7373msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147204: Wed Sep 9 13:25:18 2026 read: IOPS=0, BW=895KiB/s (916kB/s)(7168KiB/8011msec) clat (msec): min=69, max=3049, avg=883.13, stdev=1159.09 lat (msec): min=69, max=3049, avg=883.14, stdev=1159.09 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 93], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 176], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 1888], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1882, max= 4087, per=94.27%, avg=2409.60, stdev=940.02, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=639KiB/s (654kB/s)(5120KiB/8011msec); 0 zone resets clat (msec): min=149, max=739, avg=315.75, stdev=245.59 lat (msec): min=149, max=739, avg=315.83, stdev=245.59 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1992, max= 4079, per=75.13%, avg=2689.00, stdev=1203.78, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.45%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147205: Wed Sep 9 13:25:18 2026 read: IOPS=0, BW=285KiB/s (292kB/s)(2048KiB/7179msec) clat (msec): min=165, max=244, avg=204.93, stdev=56.27 lat (msec): min=165, max=244, avg=204.93, stdev=56.27 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 1638, max= 1992, per=71.01%, avg=1815.00, stdev=250.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1426KiB/s (1461kB/s)(10.0MiB/7179msec); 0 zone resets clat (msec): min=195, max=3136, avg=664.06, stdev=879.07 lat (msec): min=196, max=3136, avg=664.24, stdev=879.02 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 222], | 30.00th=[ 226], 40.00th=[ 380], 50.00th=[ 414], 60.00th=[ 477], | 70.00th=[ 518], 80.00th=[ 535], 90.00th=[ 542], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1882, max= 4087, per=63.95%, avg=2288.71, stdev=795.15, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=2.61%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147206: Wed Sep 9 13:25:18 2026 read: IOPS=0, BW=912KiB/s (934kB/s)(6144KiB/6739msec) clat (msec): min=152, max=324, avg=227.44, stdev=65.79 lat (msec): min=152, max=324, avg=227.44, stdev=65.79 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 249], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1946, max= 3984, per=97.86%, avg=2501.25, stdev=989.48, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=912KiB/s (934kB/s)(6144KiB/6739msec); 0 zone resets clat (msec): min=210, max=3520, avg=841.90, stdev=1315.89 lat (msec): min=210, max=3520, avg=842.01, stdev=1315.88 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 359], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1558, max= 2048, per=53.68%, avg=1921.20, stdev=206.76, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=50.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.03%, sys=2.51%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147207: Wed Sep 9 13:25:18 2026 read: IOPS=0, BW=712KiB/s (729kB/s)(5120KiB/7187msec) clat (msec): min=84, max=749, avg=332.08, stdev=303.51 lat (msec): min=84, max=749, avg=332.08, stdev=303.51 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1992, max= 4087, per=100.00%, avg=2709.00, stdev=1193.71, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=997KiB/s (1021kB/s)(7168KiB/7187msec); 0 zone resets clat (msec): min=174, max=3349, avg=738.75, stdev=1156.07 lat (msec): min=174, max=3349, avg=738.86, stdev=1156.06 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 211], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 317], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 443], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1946, max= 2048, per=56.46%, avg=2020.60, stdev=42.42, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=3.41%, ctx=124, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2556KiB/s (2618kB/s), 285KiB/s-912KiB/s (292kB/s-934kB/s), io=20.0MiB (20.0MB), run=6739-8011msec WRITE: bw=3579KiB/s (3665kB/s), 639KiB/s-1426KiB/s (654kB/s-1461kB/s), io=28.0MiB (29.4MB), run=6739-8011msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147216: Wed Sep 9 13:25:31 2026 read: IOPS=1, BW=4357KiB/s (4462kB/s)(12.0MiB/2820msec) clat (msec): min=733, max=864, avg=817.91, stdev=73.01 lat (msec): min=733, max=864, avg=817.91, stdev=73.01 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.92%, ctx=338, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147217: Wed Sep 9 13:25:31 2026 read: IOPS=0, BW=1672KiB/s (1712kB/s)(4096KiB/2450msec) clat (nsec): min=779600k, max=779600k, avg=779600106.00, stdev= 0.00 lat (nsec): min=779603k, max=779603k, avg=779602917.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3344KiB/s (3424kB/s)(8192KiB/2450msec); 0 zone resets clat (msec): min=435, max=940, avg=687.84, stdev=356.68 lat (msec): min=436, max=940, avg=688.23, stdev=356.55 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8159, max= 8159, per=61.01%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=7.19%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147219: Wed Sep 9 13:25:31 2026 write: IOPS=1, BW=5632KiB/s (5767kB/s)(12.0MiB/2182msec); 0 zone resets clat (msec): min=497, max=818, avg=700.82, stdev=176.59 lat (msec): min=498, max=818, avg=701.17, stdev=176.52 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 5843, max= 8159, per=52.35%, avg=7001.00, stdev=1637.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=3.76%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147221: Wed Sep 9 13:25:31 2026 write: IOPS=1, BW=5042KiB/s (5163kB/s)(12.0MiB/2437msec); 0 zone resets clat (msec): min=320, max=1371, avg=684.31, stdev=595.72 lat (msec): min=321, max=1372, avg=684.66, stdev=595.69 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8175, max= 8192, per=61.19%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.94%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5810KiB/s (5949kB/s), 1672KiB/s-4357KiB/s (1712kB/s-4462kB/s), io=16.0MiB (16.8MB), run=2450-2820msec WRITE: bw=13.1MiB/s (13.7MB/s), 3344KiB/s-5632KiB/s (3424kB/s-5767kB/s), io=32.0MiB (33.6MB), run=2182-2450msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147214: Wed Sep 9 13:25:32 2026 read: IOPS=2, BW=8690KiB/s (8899kB/s)(12.0MiB/1414msec) clat (msec): min=201, max=741, avg=438.85, stdev=276.05 lat (msec): min=201, max=741, avg=438.85, stdev=276.05 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7641, max= 8126, per=100.00%, avg=7883.50, stdev=342.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=7.50%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147215: Wed Sep 9 13:25:32 2026 read: IOPS=0, BW=1401KiB/s (1435kB/s)(4096KiB/2923msec) clat (nsec): min=1161.2M, max=1161.2M, avg=1161230513.00, stdev= 0.00 lat (nsec): min=1161.2M, max=1161.2M, avg=1161233551.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2803KiB/s (2870kB/s)(8192KiB/2923msec); 0 zone resets clat (msec): min=610, max=1047, avg=829.06, stdev=309.57 lat (msec): min=610, max=1050, avg=830.54, stdev=311.19 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8000, max= 8000, per=82.87%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.40%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147218: Wed Sep 9 13:25:32 2026 write: IOPS=0, BW=3621KiB/s (3707kB/s)(12.0MiB/3394msec); 0 zone resets clat (msec): min=326, max=2014, avg=1078.56, stdev=858.59 lat (msec): min=326, max=2019, avg=1080.60, stdev=861.41 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8015, max= 8159, per=83.77%, avg=8087.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.45%, ctx=65, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147220: Wed Sep 9 13:25:32 2026 write: IOPS=1, BW=6065KiB/s (6211kB/s)(12.0MiB/2026msec); 0 zone resets clat (msec): min=318, max=1177, avg=657.47, stdev=457.08 lat (msec): min=318, max=1178, avg=658.12, stdev=457.66 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 5997, max= 8110, per=73.06%, avg=7053.50, stdev=1494.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.93%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5605KiB/s (5740kB/s), 1401KiB/s-8690KiB/s (1435kB/s-8899kB/s), io=16.0MiB (16.8MB), run=1414-2923msec WRITE: bw=9655KiB/s (9886kB/s), 2803KiB/s-6065KiB/s (2870kB/s-6211kB/s), io=32.0MiB (33.6MB), run=2026-3394msec