== sanity test 398b: DIO and buffer IO race ============== 10:00:43 (1788530443) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.71654 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146807: Fri Sep 4 10:03:15 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5992KiB/128059msec) clat (usec): min=30, max=1017.9k, avg=41426.99, stdev=42186.99 lat (usec): min=30, max=1017.9k, avg=41428.00, stdev=42186.99 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 68], | 20.00th=[ 17433], 30.00th=[ 22938], 40.00th=[ 28705], | 50.00th=[ 33817], 60.00th=[ 41157], 70.00th=[ 50070], | 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[ 102237], | 99.00th=[ 149947], 99.50th=[ 191890], 99.90th=[ 358613], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 109, per=26.06%, avg=46.66, stdev=18.41, samples=250 iops : min= 1, max= 27, avg=11.02, stdev= 4.64, samples=250 write: IOPS=12, BW=49.2KiB/s (50.3kB/s)(6296KiB/128059msec); 0 zone resets clat (usec): min=956, max=428410, avg=41827.64, stdev=44500.07 lat (usec): min=956, max=428412, avg=41830.65, stdev=44499.26 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1516], 20.00th=[ 3851], | 30.00th=[ 8094], 40.00th=[ 18482], 50.00th=[ 30278], 60.00th=[ 40633], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[124257], | 99.00th=[187696], 99.50th=[227541], 99.90th=[316670], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 116, per=26.31%, avg=49.20, stdev=20.23, samples=249 iops : min= 1, max= 29, avg=11.65, stdev= 5.10, samples=249 lat (usec) : 50=0.75%, 100=5.14%, 250=0.42%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=6.58%, 4=3.94%, 10=6.32%, 20=9.86%, 50=35.51% lat (msec) : 100=23.18%, 250=7.65%, 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=4.94%, ctx=6274, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146808: Fri Sep 4 10:03:15 2026 read: IOPS=11, BW=45.6KiB/s (46.7kB/s)(5940KiB/130161msec) clat (usec): min=29, max=1083.0k, avg=41770.18, stdev=43094.08 lat (usec): min=29, max=1083.0k, avg=41771.38, stdev=43094.04 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 69], | 20.00th=[ 17171], 30.00th=[ 22938], 40.00th=[ 28181], | 50.00th=[ 34341], 60.00th=[ 41681], 70.00th=[ 51643], | 80.00th=[ 63177], 90.00th=[ 83362], 95.00th=[ 98042], | 99.00th=[ 158335], 99.50th=[ 183501], 99.90th=[ 312476], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 119, per=25.60%, avg=45.83, stdev=20.63, samples=253 iops : min= 1, max= 29, avg=10.79, stdev= 5.19, samples=253 write: IOPS=12, BW=48.8KiB/s (49.9kB/s)(6348KiB/130161msec); 0 zone resets clat (usec): min=931, max=423856, avg=42842.74, stdev=46120.26 lat (usec): min=931, max=423857, avg=42847.45, stdev=46121.18 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1532], 20.00th=[ 3818], | 30.00th=[ 8160], 40.00th=[ 20055], 50.00th=[ 30802], 60.00th=[ 41681], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[130548], | 99.00th=[208667], 99.50th=[246416], 99.90th=[312476], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 125, per=26.11%, avg=48.83, stdev=21.41, samples=253 iops : min= 1, max= 31, avg=11.56, stdev= 5.39, samples=253 lat (usec) : 50=1.14%, 100=4.82%, 250=0.46%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=6.38%, 4=4.20%, 10=6.28%, 20=8.92%, 50=34.67% lat (msec) : 100=25.13%, 250=7.32%, 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=4.79%, ctx=6318, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146809: Fri Sep 4 10:03:15 2026 read: IOPS=11, BW=45.0KiB/s (46.1kB/s)(6028KiB/133919msec) clat (usec): min=30, max=531991, avg=41189.69, stdev=37166.00 lat (usec): min=30, max=531992, avg=41193.07, stdev=37166.67 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 64], 20.00th=[ 15795], | 30.00th=[ 22152], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 51119], 80.00th=[ 63701], 90.00th=[ 84411], 95.00th=[ 99091], | 99.00th=[154141], 99.50th=[166724], 99.90th=[425722], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 120, per=25.00%, avg=44.75, stdev=21.45, samples=262 iops : min= 1, max= 30, avg=10.53, stdev= 5.39, samples=262 write: IOPS=11, BW=46.7KiB/s (47.9kB/s)(6260KiB/133919msec); 0 zone resets clat (usec): min=911, max=1224.4k, avg=45771.85, stdev=56547.89 lat (usec): min=912, max=1224.4k, avg=45774.76, stdev=56546.79 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1500], | 20.00th=[ 3589], 30.00th=[ 7701], 40.00th=[ 19530], | 50.00th=[ 32113], 60.00th=[ 44827], 70.00th=[ 58459], | 80.00th=[ 77071], 90.00th=[ 111674], 95.00th=[ 143655], | 99.00th=[ 212861], 99.50th=[ 244319], 99.90th=[ 329253], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 103, per=24.81%, avg=46.40, stdev=19.61, samples=262 iops : min= 1, max= 25, avg=10.96, stdev= 4.96, samples=262 lat (usec) : 50=1.63%, 100=4.75%, 250=0.16%, 500=0.29%, 750=0.07% lat (usec) : 1000=0.26% lat (msec) : 2=6.51%, 4=4.00%, 10=6.58%, 20=8.85%, 50=33.14% lat (msec) : 100=25.00%, 250=8.46%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=4.56%, ctx=6261, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146810: Fri Sep 4 10:03:15 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6052KiB/131129msec) clat (usec): min=29, max=323300, avg=40055.38, stdev=32077.80 lat (usec): min=29, max=323302, avg=40066.58, stdev=32093.75 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 67], 20.00th=[ 16057], | 30.00th=[ 23200], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 60556], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[141558], 99.50th=[164627], 99.90th=[254804], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 111, per=25.92%, avg=46.40, stdev=21.16, samples=254 iops : min= 1, max= 27, avg=10.96, stdev= 5.33, samples=254 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6236KiB/131129msec); 0 zone resets clat (usec): min=950, max=1133.9k, avg=45146.17, stdev=56045.32 lat (usec): min=952, max=1133.0k, avg=45149.02, stdev=56044.80 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1352], | 20.00th=[ 3490], 30.00th=[ 8094], 40.00th=[ 19268], | 50.00th=[ 32637], 60.00th=[ 44303], 70.00th=[ 55837], | 80.00th=[ 76022], 90.00th=[ 106431], 95.00th=[ 135267], | 99.00th=[ 227541], 99.50th=[ 250610], 99.90th=[ 434111], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 128, per=25.45%, avg=47.58, stdev=19.88, samples=255 iops : min= 1, max= 32, avg=11.24, stdev= 4.99, samples=255 lat (usec) : 50=1.20%, 100=4.69%, 250=0.36%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=7.03%, 4=4.10%, 10=5.63%, 20=9.86%, 50=34.93% lat (msec) : 100=23.44%, 250=8.14%, 500=0.29%, 2000=0.03% cpu : usr=0.07%, sys=4.73%, ctx=6338, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=179KiB/s (184kB/s), 45.0KiB/s-46.8KiB/s (46.1kB/s-47.9kB/s), io=23.4MiB (24.6MB), run=128059-133919msec WRITE: bw=188KiB/s (192kB/s), 46.7KiB/s-49.2KiB/s (47.9kB/s-50.3kB/s), io=24.6MiB (25.7MB), run=128059-133919msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146800: Fri Sep 4 10:05:39 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5992KiB/276009msec) clat (msec): min=5, max=1095, avg=36.07, stdev=43.04 lat (msec): min=5, max=1095, avg=36.08, stdev=43.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 84], 95.00th=[ 112], | 99.00th=[ 165], 99.50th=[ 184], 99.90th=[ 262], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 79, per=28.19%, avg=24.25, stdev=16.00, samples=477 iops : min= 1, max= 19, avg= 5.42, stdev= 4.01, samples=477 write: IOPS=5, BW=22.8KiB/s (23.4kB/s)(6296KiB/276009msec); 0 zone resets clat (msec): min=41, max=686, avg=140.76, stdev=66.76 lat (msec): min=41, max=686, avg=140.76, stdev=66.76 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 359], 99.50th=[ 422], 99.90th=[ 531], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 55, per=24.97%, avg=22.48, stdev= 9.96, samples=539 iops : min= 1, max= 13, avg= 4.97, stdev= 2.54, samples=539 lat (msec) : 10=3.87%, 20=17.06%, 50=18.42%, 100=22.07%, 250=34.64% lat (msec) : 500=3.81%, 750=0.10%, 2000=0.03% cpu : usr=0.03%, sys=1.02%, ctx=4828, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146801: Fri Sep 4 10:05:39 2026 read: IOPS=5, BW=21.3KiB/s (21.9kB/s)(5940KiB/278318msec) clat (msec): min=5, max=1140, avg=35.44, stdev=46.77 lat (msec): min=5, max=1140, avg=35.44, stdev=46.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 107], | 99.00th=[ 176], 99.50th=[ 209], 99.90th=[ 609], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 104, per=28.39%, avg=24.42, stdev=16.65, samples=469 iops : min= 1, max= 26, avg= 5.47, stdev= 4.20, samples=469 write: IOPS=5, BW=22.8KiB/s (23.4kB/s)(6348KiB/278318msec); 0 zone resets clat (msec): min=31, max=619, avg=141.94, stdev=70.70 lat (msec): min=31, max=619, avg=141.95, stdev=70.71 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 186], 90.00th=[ 239], 95.00th=[ 279], | 99.00th=[ 359], 99.50th=[ 443], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 56, per=25.23%, avg=22.70, stdev=10.10, samples=537 iops : min= 1, max= 14, avg= 5.03, stdev= 2.57, samples=537 lat (msec) : 10=3.61%, 20=17.48%, 50=18.68%, 100=22.01%, 250=33.85% lat (msec) : 500=4.17%, 750=0.16%, 2000=0.03% cpu : usr=0.03%, sys=1.00%, ctx=5037, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146802: Fri Sep 4 10:05:39 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6028KiB/277763msec) clat (msec): min=4, max=603, avg=36.89, stdev=38.05 lat (msec): min=4, max=603, avg=36.90, stdev=38.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 110], | 99.00th=[ 182], 99.50th=[ 211], 99.90th=[ 292], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 95, per=27.56%, avg=23.70, stdev=16.12, samples=490 iops : min= 1, max= 23, avg= 5.29, stdev= 4.05, samples=490 write: IOPS=5, BW=22.5KiB/s (23.1kB/s)(6260KiB/277763msec); 0 zone resets clat (msec): min=35, max=1271, avg=141.69, stdev=74.08 lat (msec): min=35, max=1271, avg=141.69, stdev=74.08 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 79], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 228], 95.00th=[ 275], | 99.00th=[ 388], 99.50th=[ 456], 99.90th=[ 709], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 55, per=24.83%, avg=22.35, stdev= 9.79, samples=538 iops : min= 1, max= 13, avg= 4.94, stdev= 2.49, samples=538 lat (msec) : 10=2.99%, 20=17.68%, 50=18.03%, 100=22.43%, 250=35.12% lat (msec) : 500=3.58%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.03%, ctx=4917, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146803: Fri Sep 4 10:05:39 2026 read: IOPS=5, BW=22.0KiB/s (22.5kB/s)(6052KiB/274987msec) clat (msec): min=5, max=499, avg=35.49, stdev=36.78 lat (msec): min=5, max=499, avg=35.49, stdev=36.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 80], 95.00th=[ 104], | 99.00th=[ 180], 99.50th=[ 230], 99.90th=[ 330], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 95, per=28.93%, avg=24.88, stdev=16.37, samples=470 iops : min= 1, max= 23, avg= 5.58, stdev= 4.12, samples=470 write: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6236KiB/274987msec); 0 zone resets clat (msec): min=32, max=1215, avg=141.67, stdev=71.82 lat (msec): min=32, max=1215, avg=141.68, stdev=71.82 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 102], 40.00th=[ 112], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 388], 99.50th=[ 414], 99.90th=[ 535], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 55, per=24.73%, avg=22.26, stdev=10.01, samples=539 iops : min= 1, max= 13, avg= 4.92, stdev= 2.54, samples=539 lat (msec) : 10=3.39%, 20=17.61%, 50=19.53%, 100=20.80%, 250=34.96% lat (msec) : 500=3.65%, 750=0.03%, 2000=0.03% cpu : usr=0.03%, sys=0.98%, ctx=5038, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.3KiB/s (88.3kB/s), 21.3KiB/s-22.0KiB/s (21.9kB/s-22.5kB/s), io=23.4MiB (24.6MB), run=274987-278318msec WRITE: bw=90.3KiB/s (92.5kB/s), 22.5KiB/s-22.8KiB/s (23.1kB/s-23.4kB/s), io=24.6MiB (25.7MB), run=274987-278318msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146879: Fri Sep 4 10:06:18 2026 read: IOPS=14, BW=225KiB/s (231kB/s)(5920KiB/26256msec) clat (usec): min=31, max=201731, avg=33903.71, stdev=33146.12 lat (usec): min=31, max=201732, avg=33914.29, stdev=33136.82 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 69], | 30.00th=[ 141], 40.00th=[ 24773], 50.00th=[ 30802], 60.00th=[ 38536], | 70.00th=[ 44303], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[156238], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 95, max= 476, per=25.78%, avg=224.55, stdev=82.16, samples=51 iops : min= 5, max= 29, avg=13.27, stdev= 5.11, samples=51 write: IOPS=15, BW=243KiB/s (248kB/s)(6368KiB/26256msec); 0 zone resets clat (usec): min=1329, max=362650, avg=33986.80, stdev=39249.63 lat (usec): min=1329, max=362651, avg=33988.62, stdev=39249.56 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1762], 10.00th=[ 2638], 20.00th=[ 5080], | 30.00th=[ 8848], 40.00th=[ 11338], 50.00th=[ 21365], 60.00th=[ 29492], | 70.00th=[ 39060], 80.00th=[ 59507], 90.00th=[ 82314], 95.00th=[114820], | 99.00th=[170918], 99.50th=[189793], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 85, max= 416, per=26.46%, avg=242.63, stdev=78.53, samples=51 iops : min= 5, max= 26, avg=14.43, stdev= 4.97, samples=51 lat (usec) : 50=1.69%, 100=11.85%, 250=1.30%, 500=0.39%, 1000=0.13% lat (msec) : 2=3.78%, 4=4.04%, 10=10.29%, 20=8.59%, 50=33.46% lat (msec) : 100=19.01%, 250=5.34%, 500=0.13% cpu : usr=0.06%, sys=5.38%, ctx=1326, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146881: Fri Sep 4 10:06:18 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5744KiB/27477msec) clat (usec): min=36, max=323874, avg=38972.50, stdev=35795.63 lat (usec): min=37, max=323875, avg=38973.46, stdev=35795.65 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 75], | 30.00th=[ 21365], 40.00th=[ 29492], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 53740], 80.00th=[ 65799], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[152044], 99.50th=[193987], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 32, max= 479, per=24.12%, avg=210.09, stdev=93.96, samples=53 iops : min= 2, max= 29, avg=12.36, stdev= 5.83, samples=53 write: IOPS=14, BW=238KiB/s (244kB/s)(6544KiB/27477msec); 0 zone resets clat (usec): min=1227, max=186809, avg=32556.11, stdev=34647.85 lat (usec): min=1229, max=186812, avg=32564.74, stdev=34667.28 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1745], 10.00th=[ 2606], 20.00th=[ 4080], | 30.00th=[ 6652], 40.00th=[ 10683], 50.00th=[ 17957], 60.00th=[ 28705], | 70.00th=[ 43254], 80.00th=[ 63177], 90.00th=[ 81265], 95.00th=[106431], | 99.00th=[135267], 99.50th=[137364], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 447, per=25.93%, avg=237.74, stdev=87.33, samples=53 iops : min= 3, max= 27, avg=14.09, stdev= 5.49, samples=53 lat (usec) : 50=1.69%, 100=8.85%, 250=1.30%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.78%, 4=6.25%, 10=10.55%, 20=7.94%, 50=30.73% lat (msec) : 100=23.96%, 250=4.56%, 500=0.13% cpu : usr=0.08%, sys=5.42%, ctx=1383, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146882: Fri Sep 4 10:06:18 2026 read: IOPS=14, BW=233KiB/s (238kB/s)(6256KiB/26873msec) clat (usec): min=38, max=144612, avg=35386.58, stdev=28624.17 lat (usec): min=39, max=144614, avg=35402.77, stdev=28606.99 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 86], | 30.00th=[ 21103], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 55313], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[114820], 99.50th=[124257], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 62, max= 444, per=26.97%, avg=234.88, stdev=90.12, samples=52 iops : min= 3, max= 27, avg=13.92, stdev= 5.66, samples=52 write: IOPS=14, BW=224KiB/s (230kB/s)(6032KiB/26873msec); 0 zone resets clat (usec): min=1423, max=460159, avg=34090.64, stdev=42455.70 lat (usec): min=1425, max=460160, avg=34095.58, stdev=42460.20 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1696], 10.00th=[ 2245], 20.00th=[ 4424], | 30.00th=[ 6980], 40.00th=[ 11338], 50.00th=[ 19792], 60.00th=[ 29492], | 70.00th=[ 41157], 80.00th=[ 56886], 90.00th=[ 86508], 95.00th=[114820], | 99.00th=[185598], 99.50th=[202376], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 64, max= 478, per=24.15%, avg=221.42, stdev=87.71, samples=52 iops : min= 4, max= 29, avg=13.08, stdev= 5.45, samples=52 lat (usec) : 50=1.04%, 100=10.03%, 250=1.30%, 500=0.39% lat (msec) : 2=4.04%, 4=5.21%, 10=9.38%, 20=8.07%, 50=34.90% lat (msec) : 100=19.79%, 250=5.73%, 500=0.13% cpu : usr=0.06%, sys=5.38%, ctx=1366, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146883: Fri Sep 4 10:06:18 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(6032KiB/26089msec) clat (usec): min=36, max=196921, avg=35625.16, stdev=33236.85 lat (usec): min=36, max=196922, avg=35626.42, stdev=33237.03 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 71], | 30.00th=[ 17695], 40.00th=[ 26084], 50.00th=[ 32375], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 56361], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[154141], 99.50th=[189793], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 86, max= 382, per=26.44%, avg=230.25, stdev=79.98, samples=51 iops : min= 5, max= 23, avg=13.65, stdev= 5.07, samples=51 write: IOPS=14, BW=240KiB/s (246kB/s)(6256KiB/26089msec); 0 zone resets clat (usec): min=1414, max=345359, avg=32161.48, stdev=37228.01 lat (usec): min=1415, max=345360, avg=32168.31, stdev=37225.42 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1713], 10.00th=[ 2343], 20.00th=[ 4146], | 30.00th=[ 6915], 40.00th=[ 10159], 50.00th=[ 17433], 60.00th=[ 27919], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[158335], 99.50th=[183501], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 95, max= 444, per=26.21%, avg=240.37, stdev=77.10, samples=51 iops : min= 5, max= 27, avg=14.29, stdev= 4.80, samples=51 lat (usec) : 50=1.82%, 100=10.29%, 250=0.65%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=4.04%, 4=5.99%, 10=10.29%, 20=8.59%, 50=32.55% lat (msec) : 100=20.57%, 250=4.30%, 500=0.13% cpu : usr=0.05%, sys=5.40%, ctx=1407, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=872KiB/s (893kB/s), 209KiB/s-233KiB/s (214kB/s-238kB/s), io=23.4MiB (24.5MB), run=26089-27477msec WRITE: bw=917KiB/s (939kB/s), 224KiB/s-243KiB/s (230kB/s-248kB/s), io=24.6MiB (25.8MB), run=26089-27477msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146884: Fri Sep 4 10:07:00 2026 read: IOPS=5, BW=88.4KiB/s (90.5kB/s)(5920KiB/66950msec) clat (msec): min=5, max=322, avg=39.80, stdev=39.89 lat (msec): min=5, max=322, avg=39.80, stdev=39.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 57], 90.00th=[ 80], 95.00th=[ 120], | 99.00th=[ 232], 99.50th=[ 255], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 256, per=28.03%, avg=96.70, stdev=55.38, samples=120 iops : min= 1, max= 16, avg= 5.28, stdev= 3.52, samples=120 write: IOPS=5, BW=95.1KiB/s (97.4kB/s)(6368KiB/66950msec); 0 zone resets clat (msec): min=30, max=626, avg=131.12, stdev=61.81 lat (msec): min=30, max=626, avg=131.13, stdev=61.81 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 58], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 95], 40.00th=[ 108], 50.00th=[ 117], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 169], 90.00th=[ 205], 95.00th=[ 249], | 99.00th=[ 321], 99.50th=[ 376], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 27, max= 287, per=26.52%, avg=96.28, stdev=42.70, samples=130 iops : min= 1, max= 17, avg= 5.25, stdev= 2.72, samples=130 lat (msec) : 10=2.99%, 20=13.41%, 50=21.74%, 100=23.18%, 250=35.94% lat (msec) : 500=2.60%, 750=0.13% cpu : usr=0.03%, sys=1.24%, ctx=1275, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146885: Fri Sep 4 10:07:00 2026 read: IOPS=5, BW=82.8KiB/s (84.8kB/s)(5744KiB/69394msec) clat (msec): min=6, max=243, avg=38.55, stdev=37.91 lat (msec): min=6, max=243, avg=38.55, stdev=37.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 129], | 99.00th=[ 194], 99.50th=[ 234], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 25, max= 253, per=27.15%, avg=93.68, stdev=56.44, samples=120 iops : min= 1, max= 15, avg= 5.08, stdev= 3.54, samples=120 write: IOPS=5, BW=94.3KiB/s (96.6kB/s)(6544KiB/69394msec); 0 zone resets clat (msec): min=34, max=512, avg=135.70, stdev=63.72 lat (msec): min=34, max=512, avg=135.71, stdev=63.72 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 72], 20.00th=[ 89], | 30.00th=[ 100], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 134], | 70.00th=[ 153], 80.00th=[ 180], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 321], 99.50th=[ 355], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 30, max= 255, per=26.22%, avg=95.19, stdev=43.52, samples=135 iops : min= 1, max= 15, avg= 5.19, stdev= 2.77, samples=135 lat (msec) : 10=1.82%, 20=14.32%, 50=22.01%, 100=21.88%, 250=36.72% lat (msec) : 500=3.12%, 750=0.13% cpu : usr=0.04%, sys=1.09%, ctx=1293, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146886: Fri Sep 4 10:07:00 2026 read: IOPS=5, BW=95.9KiB/s (98.2kB/s)(6256KiB/65234msec) clat (msec): min=5, max=253, avg=35.95, stdev=35.69 lat (msec): min=5, max=253, avg=35.96, stdev=35.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 67], 95.00th=[ 114], | 99.00th=[ 190], 99.50th=[ 222], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 30, max= 415, per=30.37%, avg=104.79, stdev=72.89, samples=118 iops : min= 1, max= 25, avg= 5.79, stdev= 4.62, samples=118 write: IOPS=5, BW=92.5KiB/s (94.7kB/s)(6032KiB/65234msec); 0 zone resets clat (msec): min=32, max=529, avg=135.58, stdev=62.91 lat (msec): min=32, max=529, avg=135.59, stdev=62.91 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 176], 90.00th=[ 220], 95.00th=[ 257], | 99.00th=[ 326], 99.50th=[ 368], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 31, max= 191, per=25.76%, avg=93.50, stdev=37.10, samples=127 iops : min= 1, max= 11, avg= 5.07, stdev= 2.36, samples=127 lat (msec) : 10=2.99%, 20=16.15%, 50=23.18%, 100=21.88%, 250=32.68% lat (msec) : 500=2.99%, 750=0.13% cpu : usr=0.04%, sys=1.09%, ctx=1271, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146887: Fri Sep 4 10:07:00 2026 read: IOPS=5, BW=89.6KiB/s (91.8kB/s)(6032KiB/67311msec) clat (msec): min=5, max=258, avg=36.68, stdev=35.54 lat (msec): min=5, max=258, avg=36.68, stdev=35.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 74], 95.00th=[ 107], | 99.00th=[ 190], 99.50th=[ 234], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 348, per=28.15%, avg=97.11, stdev=64.65, samples=122 iops : min= 1, max= 21, avg= 5.30, stdev= 4.12, samples=122 write: IOPS=5, BW=92.9KiB/s (95.2kB/s)(6256KiB/67311msec); 0 zone resets clat (msec): min=29, max=492, avg=136.67, stdev=62.35 lat (msec): min=29, max=492, avg=136.67, stdev=62.34 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 77], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 127], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 174], 90.00th=[ 211], 95.00th=[ 255], | 99.00th=[ 376], 99.50th=[ 426], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 31, max= 255, per=26.18%, avg=95.02, stdev=39.18, samples=130 iops : min= 1, max= 15, avg= 5.16, stdev= 2.50, samples=130 lat (msec) : 10=1.82%, 20=16.41%, 50=22.27%, 100=20.83%, 250=35.68% lat (msec) : 500=2.99% cpu : usr=0.03%, sys=1.19%, ctx=1297, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=345KiB/s (353kB/s), 82.8KiB/s-95.9KiB/s (84.8kB/s-98.2kB/s), io=23.4MiB (24.5MB), run=65234-69394msec WRITE: bw=363KiB/s (372kB/s), 92.5KiB/s-95.1KiB/s (94.7kB/s-97.4kB/s), io=24.6MiB (25.8MB), run=65234-69394msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146903: Fri Sep 4 10:07:16 2026 read: IOPS=1, BW=1321KiB/s (1352kB/s)(7168KiB/5428msec) clat (msec): min=127, max=1261, avg=384.23, stdev=400.38 lat (msec): min=127, max=1261, avg=384.23, stdev=400.38 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 159], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 268], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 435], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1440, max= 2043, per=53.71%, avg=1906.83, stdev=232.70, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=943KiB/s (966kB/s)(5120KiB/5428msec); 0 zone resets clat (msec): min=153, max=957, avg=485.35, stdev=353.23 lat (msec): min=153, max=957, avg=485.43, stdev=353.23 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2023, max= 3856, per=50.05%, avg=2487.25, stdev=912.54, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=7.46%, ctx=262, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146904: Fri Sep 4 10:07:16 2026 read: IOPS=0, BW=355KiB/s (364kB/s)(2048KiB/5769msec) clat (msec): min=295, max=362, avg=328.86, stdev=47.67 lat (msec): min=295, max=362, avg=328.86, stdev=47.67 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1473, max= 2035, per=49.41%, avg=1754.00, stdev=397.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1775KiB/s (1818kB/s)(10.0MiB/5769msec); 0 zone resets clat (msec): min=109, max=2221, avg=504.53, stdev=650.02 lat (msec): min=109, max=2221, avg=504.61, stdev=650.02 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 127], | 30.00th=[ 134], 40.00th=[ 186], 50.00th=[ 188], 60.00th=[ 247], | 70.00th=[ 384], 80.00th=[ 592], 90.00th=[ 860], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1928, max= 6083, per=72.49%, avg=3603.00, stdev=2237.00, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=8.72%, ctx=114, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146905: Fri Sep 4 10:07:16 2026 read: IOPS=1, BW=1275KiB/s (1305kB/s)(6144KiB/4820msec) clat (usec): min=528, max=466153, avg=205307.01, stdev=181076.69 lat (usec): min=530, max=466155, avg=205308.16, stdev=181076.81 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 1631], | 30.00th=[ 1631], 40.00th=[198181], 50.00th=[198181], 60.00th=[267387], | 70.00th=[299893], 80.00th=[299893], 90.00th=[467665], 95.00th=[467665], | 99.00th=[467665], 99.50th=[467665], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 2035, max= 4047, per=93.73%, avg=3327.33, stdev=1121.60, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1275KiB/s (1305kB/s)(6144KiB/4820msec); 0 zone resets clat (msec): min=133, max=1857, avg=569.86, stdev=641.77 lat (msec): min=133, max=1857, avg=569.93, stdev=641.77 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 393], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 1448, max= 2035, per=37.99%, avg=1888.33, stdev=220.11, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=58.33%, 2000=8.33% cpu : usr=0.00%, sys=7.16%, ctx=107, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146906: Fri Sep 4 10:07:16 2026 read: IOPS=0, BW=914KiB/s (936kB/s)(5120KiB/5601msec) clat (usec): min=342, max=473033, avg=168460.27, stdev=233049.66 lat (usec): min=342, max=473034, avg=168461.26, stdev=233049.53 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 343], 10.00th=[ 343], 20.00th=[ 343], | 30.00th=[ 449], 40.00th=[ 449], 50.00th=[ 537], 60.00th=[ 537], | 70.00th=[367002], 80.00th=[367002], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1280KiB/s (1310kB/s)(7168KiB/5601msec); 0 zone resets clat (msec): min=186, max=1948, avg=616.60, stdev=631.21 lat (msec): min=186, max=1948, avg=616.68, stdev=631.21 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 192], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 351], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 827], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 1928, max= 3900, per=49.30%, avg=2450.25, stdev=967.46, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.25%, ctx=136, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3550KiB/s (3635kB/s), 355KiB/s-1321KiB/s (364kB/s-1352kB/s), io=20.0MiB (20.0MB), run=4820-5769msec WRITE: bw=4970KiB/s (5089kB/s), 943KiB/s-1775KiB/s (966kB/s-1818kB/s), io=28.0MiB (29.4MB), run=4820-5769msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146907: Fri Sep 4 10:07:17 2026 read: IOPS=1, BW=1587KiB/s (1625kB/s)(7168KiB/4518msec) clat (msec): min=107, max=956, avg=353.28, stdev=318.44 lat (msec): min=107, max=956, avg=353.28, stdev=318.44 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 136], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 211], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 617], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1961, max= 4096, per=86.97%, avg=2818.75, stdev=1037.04, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1133KiB/s (1160kB/s)(5120KiB/4518msec); 0 zone resets clat (msec): min=243, max=559, avg=384.31, stdev=135.41 lat (msec): min=243, max=559, avg=384.40, stdev=135.41 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1961, max= 4007, per=54.73%, avg=2483.00, stdev=1016.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.07%, sys=2.99%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146908: Fri Sep 4 10:07:17 2026 read: IOPS=0, BW=324KiB/s (332kB/s)(2048KiB/6319msec) clat (msec): min=190, max=466, avg=328.57, stdev=195.46 lat (msec): min=190, max=466, avg=328.57, stdev=195.46 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1771, max= 2048, per=58.92%, avg=1909.50, stdev=195.87, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1621KiB/s (1659kB/s)(10.0MiB/6319msec); 0 zone resets clat (msec): min=149, max=1966, avg=541.46, stdev=569.65 lat (msec): min=149, max=1967, avg=541.54, stdev=569.65 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 230], | 30.00th=[ 245], 40.00th=[ 247], 50.00th=[ 326], 60.00th=[ 351], | 70.00th=[ 355], 80.00th=[ 430], 90.00th=[ 1116], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 2011, max= 4071, per=57.56%, avg=2611.29, stdev=986.39, samples=7 iops : min= 1, max= 3, avg= 1.86, stdev= 0.90, samples=7 lat (msec) : 250=41.67%, 500=41.67%, 2000=16.67% cpu : usr=0.02%, sys=3.17%, ctx=81, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146909: Fri Sep 4 10:07:17 2026 read: IOPS=0, BW=1022KiB/s (1046kB/s)(6144KiB/6012msec) clat (msec): min=71, max=591, avg=249.60, stdev=197.81 lat (msec): min=71, max=591, avg=249.60, stdev=197.81 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 253], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1961, max= 2048, per=61.93%, avg=2007.00, stdev=44.92, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=0, BW=1022KiB/s (1046kB/s)(6144KiB/6012msec); 0 zone resets clat (msec): min=188, max=2160, avg=688.81, stdev=741.14 lat (msec): min=188, max=2160, avg=688.93, stdev=741.14 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 535], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1961, max= 2043, per=44.18%, avg=2004.40, stdev=31.22, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=3.14%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146910: Fri Sep 4 10:07:17 2026 read: IOPS=0, BW=841KiB/s (861kB/s)(5120KiB/6090msec) clat (msec): min=96, max=824, avg=373.33, stdev=284.12 lat (msec): min=96, max=824, avg=373.33, stdev=284.12 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1961, max= 4096, per=82.98%, avg=2689.33, stdev=1218.47, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1177KiB/s (1205kB/s)(7168KiB/6090msec); 0 zone resets clat (msec): min=188, max=1678, avg=561.50, stdev=520.48 lat (msec): min=188, max=1678, avg=561.58, stdev=520.47 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 292], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 317], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 718], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1641, max= 4071, per=53.54%, avg=2429.00, stdev=1108.32, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.92%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3241KiB/s (3319kB/s), 324KiB/s-1587KiB/s (332kB/s-1625kB/s), io=20.0MiB (20.0MB), run=4518-6319msec WRITE: bw=4537KiB/s (4646kB/s), 1022KiB/s-1621KiB/s (1046kB/s-1659kB/s), io=28.0MiB (29.4MB), run=4518-6319msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146917: Fri Sep 4 10:07:32 2026 read: IOPS=1, BW=6693KiB/s (6853kB/s)(12.0MiB/1836msec) clat (msec): min=411, max=739, avg=586.77, stdev=165.03 lat (msec): min=411, max=739, avg=586.77, stdev=165.03 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 5953, max= 8126, per=78.94%, avg=7039.50, stdev=1536.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=5.78%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146918: Fri Sep 4 10:07:32 2026 read: IOPS=0, BW=2230KiB/s (2283kB/s)(4096KiB/1837msec) clat (nsec): min=318280k, max=318280k, avg=318280140.00, stdev= 0.00 lat (nsec): min=318282k, max=318282k, avg=318282437.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 5497, max= 5497, per=61.64%, avg=5497.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4459KiB/s (4566kB/s)(8192KiB/1837msec); 0 zone resets clat (msec): min=669, max=767, avg=718.44, stdev=69.17 lat (msec): min=669, max=767, avg=718.81, stdev=69.21 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7922, max= 7922, per=87.43%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=3.49%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146919: Fri Sep 4 10:07:32 2026 write: IOPS=0, BW=3398KiB/s (3480kB/s)(12.0MiB/3616msec); 0 zone resets clat (msec): min=443, max=1802, avg=1177.10, stdev=686.03 lat (msec): min=443, max=1803, avg=1177.59, stdev=686.20 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8015, max= 8047, per=88.63%, avg=8031.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.23%, ctx=67, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146920: Fri Sep 4 10:07:32 2026 write: IOPS=1, BW=4681KiB/s (4793kB/s)(12.0MiB/2625msec); 0 zone resets clat (msec): min=468, max=1523, avg=837.02, stdev=595.17 lat (msec): min=472, max=1523, avg=840.39, stdev=592.55 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 5565, max= 7922, per=74.42%, avg=6743.50, stdev=1666.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.04%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8919KiB/s (9133kB/s), 2230KiB/s-6693KiB/s (2283kB/s-6853kB/s), io=16.0MiB (16.8MB), run=1836-1837msec WRITE: bw=9062KiB/s (9279kB/s), 3398KiB/s-4681KiB/s (3480kB/s-4793kB/s), io=32.0MiB (33.6MB), run=1837-3616msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146922: Fri Sep 4 10:07:33 2026 read: IOPS=1, BW=4683KiB/s (4795kB/s)(12.0MiB/2624msec) clat (msec): min=772, max=1002, avg=871.70, stdev=118.12 lat (msec): min=772, max=1002, avg=871.70, stdev=118.12 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.67%, ctx=318, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146923: Fri Sep 4 10:07:33 2026 read: IOPS=0, BW=1480KiB/s (1516kB/s)(4096KiB/2767msec) clat (nsec): min=664192k, max=664192k, avg=664192259.00, stdev= 0.00 lat (nsec): min=664194k, max=664194k, avg=664193931.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 6050, max= 6050, per=100.00%, avg=6050.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2961KiB/s (3032kB/s)(8192KiB/2767msec); 0 zone resets clat (msec): min=811, max=1284, avg=1048.31, stdev=334.31 lat (msec): min=816, max=1285, avg=1050.90, stdev=331.64 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8159, max= 8159, per=84.11%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.34%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146924: Fri Sep 4 10:07:33 2026 write: IOPS=0, BW=3638KiB/s (3725kB/s)(12.0MiB/3378msec); 0 zone resets clat (msec): min=326, max=1537, avg=1122.88, stdev=690.23 lat (msec): min=327, max=1542, avg=1125.15, stdev=690.69 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8143, max= 8159, per=84.03%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.93%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146925: Fri Sep 4 10:07:33 2026 write: IOPS=1, BW=4813KiB/s (4929kB/s)(12.0MiB/2553msec); 0 zone resets clat (msec): min=576, max=1123, avg=849.08, stdev=273.94 lat (msec): min=576, max=1126, avg=850.43, stdev=275.17 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8094, max= 8143, per=83.70%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.12%, sys=5.96%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5921KiB/s (6063kB/s), 1480KiB/s-4683KiB/s (1516kB/s-4795kB/s), io=16.0MiB (16.8MB), run=2624-2767msec WRITE: bw=9700KiB/s (9933kB/s), 2961KiB/s-4813KiB/s (3032kB/s-4929kB/s), io=32.0MiB (33.6MB), run=2553-3378msec