== sanity test 398b: DIO and buffer IO race ============== 14:30:17 (1763407817) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.68737 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182377: Mon Nov 17 14:32:18 2025 read: IOPS=14, BW=58.4KiB/s (59.8kB/s)(5992KiB/102572msec) clat (usec): min=106, max=1160.8k, avg=39282.42, stdev=38794.30 lat (usec): min=106, max=1160.8k, avg=39283.49, stdev=38794.32 clat percentiles (usec): | 1.00th=[ 149], 5.00th=[ 11469], 10.00th=[ 15008], | 20.00th=[ 20055], 30.00th=[ 23725], 40.00th=[ 28181], | 50.00th=[ 32637], 60.00th=[ 38011], 70.00th=[ 44827], | 80.00th=[ 54264], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[ 129500], 99.50th=[ 164627], 99.90th=[ 291505], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 124, per=24.82%, avg=58.09, stdev=21.81, samples=199 iops : min= 1, max= 31, avg=13.90, stdev= 5.48, samples=199 write: IOPS=15, BW=61.4KiB/s (62.9kB/s)(6296KiB/102572msec); 0 zone resets clat (usec): min=885, max=199096, avg=27448.88, stdev=29700.74 lat (usec): min=885, max=199098, avg=27452.43, stdev=29700.11 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1057], 10.00th=[ 1123], 20.00th=[ 1287], | 30.00th=[ 4555], 40.00th=[ 10814], 50.00th=[ 19006], 60.00th=[ 25822], | 70.00th=[ 36439], 80.00th=[ 47973], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[126354], 99.50th=[145753], 99.90th=[196084], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 146, per=24.80%, avg=60.76, stdev=26.51, samples=199 iops : min= 1, max= 36, avg=14.59, stdev= 6.71, samples=199 lat (usec) : 250=1.46%, 500=0.16%, 1000=0.94% lat (msec) : 2=12.08%, 4=2.02%, 10=5.40%, 20=14.23%, 50=41.70% lat (msec) : 100=19.30%, 250=2.64%, 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.79%, ctx=6006, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182378: Mon Nov 17 14:32:18 2025 read: IOPS=14, BW=58.3KiB/s (59.7kB/s)(5940KiB/101889msec) clat (usec): min=118, max=337442, avg=38834.81, stdev=25662.60 lat (usec): min=119, max=337444, avg=38844.26, stdev=25660.43 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 10028], 10.00th=[ 15008], 20.00th=[ 20579], | 30.00th=[ 24773], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 46400], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 80217], | 99.00th=[119014], 99.50th=[147850], 99.90th=[221250], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 14, max= 119, per=24.87%, avg=58.20, stdev=20.29, samples=198 iops : min= 3, max= 29, avg=13.95, stdev= 5.12, samples=198 write: IOPS=15, BW=62.3KiB/s (63.8kB/s)(6348KiB/101889msec); 0 zone resets clat (usec): min=797, max=976598, avg=27558.46, stdev=37508.44 lat (usec): min=797, max=976599, avg=27559.72, stdev=37508.46 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1057], 10.00th=[ 1106], 20.00th=[ 1303], | 30.00th=[ 4146], 40.00th=[ 12125], 50.00th=[ 20055], 60.00th=[ 26870], | 70.00th=[ 34866], 80.00th=[ 46400], 90.00th=[ 65799], 95.00th=[ 84411], | 99.00th=[131597], 99.50th=[147850], 99.90th=[196084], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 159, per=25.18%, avg=61.70, stdev=25.32, samples=199 iops : min= 1, max= 39, avg=14.81, stdev= 6.37, samples=199 lat (usec) : 250=1.86%, 500=0.07%, 750=0.03%, 1000=0.85% lat (msec) : 2=11.59%, 4=3.09%, 10=4.43%, 20=12.96%, 50=43.75% lat (msec) : 100=19.01%, 250=2.31%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=5.77%, ctx=6033, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182379: Mon Nov 17 14:32:18 2025 read: IOPS=14, BW=59.1KiB/s (60.5kB/s)(6028KiB/102049msec) clat (usec): min=115, max=294009, avg=38059.52, stdev=25168.89 lat (usec): min=116, max=294010, avg=38060.75, stdev=25168.87 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 8225], 10.00th=[ 14877], 20.00th=[ 19792], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 33162], 60.00th=[ 39060], | 70.00th=[ 45351], 80.00th=[ 54264], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[122160], 99.50th=[143655], 99.90th=[235930], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 15, max= 127, per=25.14%, avg=58.83, stdev=22.28, samples=198 iops : min= 3, max= 31, avg=14.10, stdev= 5.60, samples=198 write: IOPS=15, BW=61.3KiB/s (62.8kB/s)(6260KiB/102049msec); 0 zone resets clat (usec): min=894, max=1149.8k, avg=28229.71, stdev=41575.70 lat (usec): min=894, max=1149.8k, avg=28231.10, stdev=41575.71 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 1057], 10.00th=[ 1106], | 20.00th=[ 1287], 30.00th=[ 4047], 40.00th=[ 10683], | 50.00th=[ 17957], 60.00th=[ 25297], 70.00th=[ 35390], | 80.00th=[ 50594], 90.00th=[ 70779], 95.00th=[ 88605], | 99.00th=[ 125305], 99.50th=[ 160433], 99.90th=[ 212861], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 15, max= 160, per=25.02%, avg=61.30, stdev=25.90, samples=197 iops : min= 3, max= 40, avg=14.73, stdev= 6.54, samples=197 lat (usec) : 250=1.82%, 500=0.16%, 750=0.03%, 1000=1.07% lat (msec) : 2=11.49%, 4=2.80%, 10=5.27%, 20=14.13%, 50=40.92% lat (msec) : 100=19.69%, 250=2.54%, 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.88%, ctx=6079, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182380: Mon Nov 17 14:32:18 2025 read: IOPS=14, BW=59.5KiB/s (60.9kB/s)(6052KiB/101704msec) clat (usec): min=103, max=217562, avg=37838.18, stdev=24504.15 lat (usec): min=103, max=217563, avg=37845.53, stdev=24502.52 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 310], 10.00th=[ 14222], 20.00th=[ 19792], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 33162], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 54789], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[120062], 99.50th=[135267], 99.90th=[198181], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 15, max= 102, per=25.52%, avg=59.71, stdev=19.07, samples=198 iops : min= 3, max= 25, avg=14.32, stdev= 4.83, samples=198 write: IOPS=15, BW=61.3KiB/s (62.8kB/s)(6236KiB/101704msec); 0 zone resets clat (usec): min=876, max=974801, avg=28186.17, stdev=38660.60 lat (usec): min=877, max=974802, avg=28193.81, stdev=38667.21 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1057], 10.00th=[ 1123], 20.00th=[ 1516], | 30.00th=[ 5538], 40.00th=[ 12256], 50.00th=[ 20317], 60.00th=[ 26608], | 70.00th=[ 34866], 80.00th=[ 47449], 90.00th=[ 65799], 95.00th=[ 83362], | 99.00th=[141558], 99.50th=[183501], 99.90th=[248513], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 156, per=24.91%, avg=61.04, stdev=25.65, samples=199 iops : min= 1, max= 39, avg=14.66, stdev= 6.50, samples=199 lat (usec) : 250=2.31%, 500=0.20%, 1000=0.85% lat (msec) : 2=10.61%, 4=2.47%, 10=5.47%, 20=13.22%, 50=43.78% lat (msec) : 100=18.52%, 250=2.54%, 1000=0.03% cpu : usr=0.07%, sys=5.75%, ctx=6016, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=234KiB/s (240kB/s), 58.3KiB/s-59.5KiB/s (59.7kB/s-60.9kB/s), io=23.4MiB (24.6MB), run=101704-102572msec WRITE: bw=245KiB/s (251kB/s), 61.3KiB/s-62.3KiB/s (62.8kB/s-63.8kB/s), io=24.6MiB (25.7MB), run=101704-102572msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182383: Mon Nov 17 14:32:58 2025 read: IOPS=10, BW=42.0KiB/s (44.0kB/s)(5992KiB/139370msec) clat (msec): min=4, max=1259, avg=36.47, stdev=45.62 lat (msec): min=4, max=1259, avg=36.47, stdev=45.62 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 78], 95.00th=[ 105], | 99.00th=[ 169], 99.50th=[ 190], 99.90th=[ 338], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 135, per=25.41%, avg=43.45, stdev=27.57, samples=268 iops : min= 1, max= 33, avg=10.21, stdev= 6.96, samples=268 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6296KiB/139370msec); 0 zone resets clat (msec): min=8, max=364, avg=53.70, stdev=37.55 lat (msec): min=8, max=364, avg=53.72, stdev=37.55 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 78], 90.00th=[ 102], 95.00th=[ 128], | 99.00th=[ 197], 99.50th=[ 232], 99.90th=[ 300], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 128, per=25.10%, avg=44.92, stdev=26.75, samples=272 iops : min= 1, max= 32, avg=10.58, stdev= 6.76, samples=272 lat (msec) : 10=2.99%, 20=19.99%, 50=47.04%, 100=21.81%, 250=7.88% lat (msec) : 500=0.26%, 2000=0.03% cpu : usr=0.05%, sys=1.95%, ctx=4852, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182384: Mon Nov 17 14:32:58 2025 read: IOPS=10, BW=42.4KiB/s (43.4kB/s)(5940KiB/140025msec) clat (msec): min=6, max=1051, avg=36.04, stdev=42.76 lat (msec): min=6, max=1051, avg=36.04, stdev=42.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 81], 95.00th=[ 108], | 99.00th=[ 167], 99.50th=[ 197], 99.90th=[ 259], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 136, per=24.98%, avg=42.71, stdev=28.92, samples=269 iops : min= 1, max= 34, avg=10.02, stdev= 7.31, samples=269 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6348KiB/140025msec); 0 zone resets clat (msec): min=8, max=343, avg=54.37, stdev=38.56 lat (msec): min=8, max=343, avg=54.37, stdev=38.56 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 105], 95.00th=[ 129], | 99.00th=[ 186], 99.50th=[ 243], 99.90th=[ 338], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 151, per=25.19%, avg=45.08, stdev=27.52, samples=272 iops : min= 1, max= 37, avg=10.61, stdev= 6.94, samples=272 lat (msec) : 10=3.35%, 20=20.83%, 50=45.51%, 100=21.58%, 250=8.37% lat (msec) : 500=0.33%, 2000=0.03% cpu : usr=0.06%, sys=1.92%, ctx=4910, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182385: Mon Nov 17 14:32:58 2025 read: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6028KiB/139055msec) clat (msec): min=5, max=254, avg=34.38, stdev=31.48 lat (msec): min=5, max=254, avg=34.38, stdev=31.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 153], 99.50th=[ 192], 99.90th=[ 228], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 151, per=25.56%, avg=43.71, stdev=27.26, samples=269 iops : min= 1, max= 37, avg=10.28, stdev= 6.90, samples=269 write: IOPS=11, BW=45.0KiB/s (46.1kB/s)(6260KiB/139055msec); 0 zone resets clat (msec): min=8, max=1128, avg=55.65, stdev=46.87 lat (msec): min=8, max=1128, avg=55.65, stdev=46.87 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 80], 90.00th=[ 107], 95.00th=[ 132], | 99.00th=[ 205], 99.50th=[ 247], 99.90th=[ 292], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 128, per=25.09%, avg=44.90, stdev=27.02, samples=272 iops : min= 1, max= 32, avg=10.57, stdev= 6.83, samples=272 lat (msec) : 10=3.22%, 20=20.48%, 50=46.61%, 100=21.00%, 250=8.43% lat (msec) : 500=0.23%, 2000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=4916, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182386: Mon Nov 17 14:32:58 2025 read: IOPS=10, BW=43.5KiB/s (44.5kB/s)(6052KiB/139144msec) clat (msec): min=5, max=253, avg=35.42, stdev=32.36 lat (msec): min=5, max=253, avg=35.42, stdev=32.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 109], | 99.00th=[ 150], 99.50th=[ 169], 99.90th=[ 211], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7, max= 143, per=25.63%, avg=43.83, stdev=29.01, samples=269 iops : min= 1, max= 35, avg=10.30, stdev= 7.32, samples=269 write: IOPS=11, BW=44.8KiB/s (45.9kB/s)(6236KiB/139144msec); 0 zone resets clat (msec): min=8, max=1120, avg=54.78, stdev=47.58 lat (msec): min=8, max=1120, avg=54.79, stdev=47.58 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 77], 90.00th=[ 103], 95.00th=[ 130], | 99.00th=[ 201], 99.50th=[ 253], 99.90th=[ 376], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 127, per=25.03%, avg=44.80, stdev=27.11, samples=271 iops : min= 1, max= 31, avg=10.55, stdev= 6.85, samples=271 lat (msec) : 10=3.03%, 20=20.80%, 50=46.16%, 100=21.78%, 250=7.94% lat (msec) : 500=0.26%, 2000=0.03% cpu : usr=0.05%, sys=1.94%, ctx=4926, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (176kB/s), 42.4KiB/s-43.5KiB/s (43.4kB/s-44.5kB/s), io=23.4MiB (24.6MB), run=139055-140025msec WRITE: bw=180KiB/s (184kB/s), 44.8KiB/s-45.3KiB/s (45.9kB/s-46.4kB/s), io=24.6MiB (25.7MB), run=139055-140025msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182424: Mon Nov 17 14:33:37 2025 read: IOPS=12, BW=195KiB/s (200kB/s)(5920KiB/30339msec) clat (usec): min=113, max=239290, avg=44680.39, stdev=33426.42 lat (usec): min=113, max=239292, avg=44681.54, stdev=33426.39 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 167], 10.00th=[ 15008], 20.00th=[ 21627], | 30.00th=[ 26346], 40.00th=[ 31851], 50.00th=[ 39060], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[187696], 99.50th=[193987], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 62, max= 384, per=24.68%, avg=193.76, stdev=82.62, samples=59 iops : min= 3, max= 24, avg=11.36, stdev= 5.24, samples=59 write: IOPS=13, BW=210KiB/s (215kB/s)(6368KiB/30339msec); 0 zone resets clat (usec): min=1230, max=175692, avg=34264.52, stdev=33701.56 lat (usec): min=1233, max=175693, avg=34266.35, stdev=33701.63 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1565], 10.00th=[ 1680], 20.00th=[ 3818], | 30.00th=[ 9765], 40.00th=[ 17433], 50.00th=[ 24249], 60.00th=[ 32113], | 70.00th=[ 45876], 80.00th=[ 58983], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[145753], 99.50th=[162530], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 472, per=25.39%, avg=209.73, stdev=77.65, samples=59 iops : min= 1, max= 29, avg=12.37, stdev= 4.93, samples=59 lat (usec) : 250=3.39%, 500=0.13% lat (msec) : 2=8.85%, 4=1.95%, 10=5.47%, 20=10.29%, 50=41.41% lat (msec) : 100=23.31%, 250=5.21% cpu : usr=0.07%, sys=5.45%, ctx=1582, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182425: Mon Nov 17 14:33:37 2025 read: IOPS=12, BW=192KiB/s (197kB/s)(5744KiB/29871msec) clat (usec): min=133, max=182469, avg=44321.53, stdev=27863.20 lat (usec): min=134, max=182470, avg=44322.60, stdev=27863.16 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 167], 10.00th=[ 16319], 20.00th=[ 22676], | 30.00th=[ 29230], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 53740], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[162530], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 343, per=24.29%, avg=190.67, stdev=67.51, samples=58 iops : min= 3, max= 21, avg=11.16, stdev= 4.28, samples=58 write: IOPS=13, BW=219KiB/s (224kB/s)(6544KiB/29871msec); 0 zone resets clat (usec): min=1340, max=254429, avg=33736.44, stdev=33915.82 lat (usec): min=1342, max=254430, avg=33738.33, stdev=33915.82 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1614], 10.00th=[ 1696], 20.00th=[ 3752], | 30.00th=[ 10421], 40.00th=[ 16319], 50.00th=[ 24773], 60.00th=[ 32375], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[145753], 99.50th=[162530], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 61, max= 416, per=26.30%, avg=217.22, stdev=88.83, samples=58 iops : min= 3, max= 26, avg=12.83, stdev= 5.64, samples=58 lat (usec) : 250=2.99%, 500=0.13% lat (msec) : 2=8.59%, 4=2.21%, 10=4.56%, 20=12.50%, 50=38.02% lat (msec) : 100=27.08%, 250=3.78%, 500=0.13% cpu : usr=0.08%, sys=6.43%, ctx=1652, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182426: Mon Nov 17 14:33:37 2025 read: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30486msec) clat (usec): min=93, max=218768, avg=43128.39, stdev=29127.73 lat (usec): min=93, max=218770, avg=43143.09, stdev=29109.25 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 161], 10.00th=[ 12780], 20.00th=[ 22676], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 61080], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[143655], 99.50th=[196084], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 62, max= 347, per=26.06%, avg=204.56, stdev=69.68, samples=59 iops : min= 3, max= 21, avg=12.05, stdev= 4.37, samples=59 write: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30486msec); 0 zone resets clat (usec): min=1226, max=164909, avg=35653.00, stdev=34814.33 lat (usec): min=1228, max=164910, avg=35654.87, stdev=34814.33 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1598], 10.00th=[ 1729], 20.00th=[ 5735], | 30.00th=[ 11207], 40.00th=[ 17957], 50.00th=[ 23987], 60.00th=[ 35390], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[156238], 99.50th=[162530], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 62, max= 437, per=23.51%, avg=194.17, stdev=78.30, samples=59 iops : min= 3, max= 27, avg=11.37, stdev= 4.99, samples=59 lat (usec) : 100=0.13%, 250=4.43% lat (msec) : 2=7.03%, 4=1.69%, 10=5.47%, 20=11.59%, 50=39.58% lat (msec) : 100=24.61%, 250=5.47% cpu : usr=0.07%, sys=6.46%, ctx=1704, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182427: Mon Nov 17 14:33:37 2025 read: IOPS=12, BW=208KiB/s (213kB/s)(6032KiB/29048msec) clat (usec): min=110, max=244429, avg=40847.89, stdev=29221.54 lat (usec): min=111, max=244430, avg=40855.24, stdev=29224.86 clat percentiles (usec): | 1.00th=[ 130], 5.00th=[ 151], 10.00th=[ 192], 20.00th=[ 22414], | 30.00th=[ 28705], 40.00th=[ 32637], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 49021], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[156238], 99.50th=[162530], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 62, max= 383, per=26.37%, avg=207.04, stdev=76.64, samples=57 iops : min= 3, max= 23, avg=12.19, stdev= 4.87, samples=57 write: IOPS=13, BW=215KiB/s (221kB/s)(6256KiB/29048msec); 0 zone resets clat (usec): min=1238, max=204453, avg=34635.52, stdev=33821.52 lat (usec): min=1240, max=204456, avg=34653.03, stdev=33818.71 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1614], 10.00th=[ 1729], 20.00th=[ 5735], | 30.00th=[ 11338], 40.00th=[ 18744], 50.00th=[ 23725], 60.00th=[ 32637], | 70.00th=[ 44303], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[156238], 99.50th=[175113], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 62, max= 382, per=26.07%, avg=215.35, stdev=70.63, samples=57 iops : min= 3, max= 23, avg=12.72, stdev= 4.48, samples=57 lat (usec) : 250=5.34%, 500=0.26%, 750=0.13% lat (msec) : 2=7.29%, 4=1.95%, 10=5.21%, 20=9.51%, 50=43.62% lat (msec) : 100=22.14%, 250=4.56% cpu : usr=0.11%, sys=6.60%, ctx=1635, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=786KiB/s (805kB/s), 192KiB/s-208KiB/s (197kB/s-213kB/s), io=23.4MiB (24.5MB), run=29048-30486msec WRITE: bw=827KiB/s (846kB/s), 198KiB/s-219KiB/s (203kB/s-224kB/s), io=24.6MiB (25.8MB), run=29048-30486msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182429: Mon Nov 17 14:33:48 2025 read: IOPS=8, BW=143KiB/s (146kB/s)(5920KiB/41472msec) clat (msec): min=6, max=251, avg=44.19, stdev=33.14 lat (msec): min=6, max=251, avg=44.19, stdev=33.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 19], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 87], 95.00th=[ 115], | 99.00th=[ 180], 99.50th=[ 194], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 30, max= 382, per=24.70%, avg=142.53, stdev=79.27, samples=80 iops : min= 1, max= 23, avg= 8.09, stdev= 5.01, samples=80 write: IOPS=9, BW=154KiB/s (157kB/s)(6368KiB/41472msec); 0 zone resets clat (msec): min=9, max=265, avg=62.90, stdev=44.26 lat (msec): min=9, max=265, avg=62.90, stdev=44.26 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 128], 95.00th=[ 155], | 99.00th=[ 241], 99.50th=[ 251], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 414, per=25.09%, avg=152.27, stdev=88.48, samples=81 iops : min= 1, max= 25, avg= 8.72, stdev= 5.59, samples=81 lat (msec) : 10=2.47%, 20=11.20%, 50=47.66%, 100=27.34%, 250=10.81% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.80%, ctx=1290, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182430: Mon Nov 17 14:33:48 2025 read: IOPS=8, BW=140KiB/s (143kB/s)(5744KiB/41116msec) clat (msec): min=7, max=226, avg=45.49, stdev=36.64 lat (msec): min=7, max=226, avg=45.49, stdev=36.64 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 96], 95.00th=[ 127], | 99.00th=[ 184], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 30, max= 446, per=24.73%, avg=142.71, stdev=90.41, samples=78 iops : min= 1, max= 27, avg= 8.12, stdev= 5.75, samples=78 write: IOPS=9, BW=159KiB/s (163kB/s)(6544KiB/41116msec); 0 zone resets clat (msec): min=11, max=249, avg=60.45, stdev=42.28 lat (msec): min=11, max=249, avg=60.46, stdev=42.28 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 89], 90.00th=[ 120], 95.00th=[ 142], | 99.00th=[ 220], 99.50th=[ 224], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 540, per=26.14%, avg=158.66, stdev=98.55, samples=80 iops : min= 1, max= 33, avg= 9.11, stdev= 6.19, samples=80 lat (msec) : 10=1.43%, 20=13.02%, 50=46.09%, 100=26.95%, 250=12.50% cpu : usr=0.04%, sys=2.00%, ctx=1315, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182431: Mon Nov 17 14:33:48 2025 read: IOPS=9, BW=154KiB/s (158kB/s)(6256KiB/40582msec) clat (msec): min=5, max=217, avg=41.04, stdev=33.07 lat (msec): min=5, max=217, avg=41.05, stdev=33.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 87], 95.00th=[ 114], | 99.00th=[ 157], 99.50th=[ 178], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 568, per=27.20%, avg=156.92, stdev=104.53, samples=78 iops : min= 1, max= 35, avg= 9.01, stdev= 6.60, samples=78 write: IOPS=9, BW=149KiB/s (152kB/s)(6032KiB/40582msec); 0 zone resets clat (msec): min=9, max=299, avg=64.87, stdev=46.36 lat (msec): min=9, max=299, avg=64.88, stdev=46.37 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 40], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 96], 90.00th=[ 129], 95.00th=[ 161], | 99.00th=[ 222], 99.50th=[ 251], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 416, per=24.08%, avg=146.18, stdev=79.68, samples=79 iops : min= 1, max= 26, avg= 8.34, stdev= 5.07, samples=79 lat (msec) : 10=2.60%, 20=15.63%, 50=44.14%, 100=24.74%, 250=12.76% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.89%, ctx=1254, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182432: Mon Nov 17 14:33:48 2025 read: IOPS=9, BW=146KiB/s (150kB/s)(6032KiB/41271msec) clat (msec): min=5, max=175, avg=44.15, stdev=33.46 lat (msec): min=5, max=175, avg=44.15, stdev=33.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 61], 90.00th=[ 96], 95.00th=[ 117], | 99.00th=[ 163], 99.50th=[ 171], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 352, per=26.02%, avg=150.13, stdev=84.43, samples=77 iops : min= 1, max= 22, avg= 8.58, stdev= 5.36, samples=77 write: IOPS=9, BW=152KiB/s (155kB/s)(6256KiB/41271msec); 0 zone resets clat (msec): min=11, max=292, avg=62.80, stdev=42.64 lat (msec): min=11, max=292, avg=62.80, stdev=42.64 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 120], 95.00th=[ 142], | 99.00th=[ 224], 99.50th=[ 251], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 445, per=24.72%, avg=150.05, stdev=80.65, samples=80 iops : min= 1, max= 27, avg= 8.58, stdev= 5.09, samples=80 lat (msec) : 10=1.56%, 20=11.33%, 50=48.31%, 100=26.56%, 250=12.11% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.07%, ctx=1293, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=578KiB/s (591kB/s), 140KiB/s-154KiB/s (143kB/s-158kB/s), io=23.4MiB (24.5MB), run=40582-41472msec WRITE: bw=608KiB/s (622kB/s), 149KiB/s-159KiB/s (152kB/s-163kB/s), io=24.6MiB (25.8MB), run=40582-41472msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182444: Mon Nov 17 14:34:04 2025 read: IOPS=1, BW=1244KiB/s (1274kB/s)(7168KiB/5762msec) clat (msec): min=70, max=2307, avg=483.49, stdev=810.27 lat (msec): min=70, max=2307, avg=483.49, stdev=810.27 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 80], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 176], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 313], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1532, max= 4079, per=71.30%, avg=2362.25, stdev=1158.95, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=889KiB/s (910kB/s)(5120KiB/5762msec); 0 zone resets clat (msec): min=335, max=538, avg=422.12, stdev=81.30 lat (msec): min=335, max=538, avg=422.21, stdev=81.33 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1917, max= 2039, per=43.02%, avg=1995.67, stdev=68.24, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=16.67%, 250=16.67%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.50%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182445: Mon Nov 17 14:34:04 2025 read: IOPS=0, BW=331KiB/s (339kB/s)(2048KiB/6180msec) clat (msec): min=114, max=146, avg=130.45, stdev=22.87 lat (msec): min=114, max=146, avg=130.45, stdev=22.87 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 1535, max= 1921, per=52.16%, avg=1728.00, stdev=272.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1657KiB/s (1697kB/s)(10.0MiB/6180msec); 0 zone resets clat (msec): min=54, max=2898, avg=586.53, stdev=831.77 lat (msec): min=54, max=2898, avg=586.62, stdev=831.76 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 57], | 30.00th=[ 249], 40.00th=[ 305], 50.00th=[ 317], 60.00th=[ 380], | 70.00th=[ 502], 80.00th=[ 550], 90.00th=[ 558], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1921, max= 8031, per=68.92%, avg=3197.40, stdev=2702.50, samples=5 iops : min= 1, max= 7, avg= 2.20, stdev= 2.68, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=4.73%, ctx=166, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182446: Mon Nov 17 14:34:04 2025 read: IOPS=0, BW=1008KiB/s (1032kB/s)(6144KiB/6098msec) clat (msec): min=88, max=385, avg=211.76, stdev=110.42 lat (msec): min=88, max=385, avg=211.76, stdev=110.42 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 232], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1917, max= 4063, per=75.01%, avg=2485.00, stdev=1053.52, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=1008KiB/s (1032kB/s)(6144KiB/6098msec); 0 zone resets clat (msec): min=130, max=2652, avg=773.81, stdev=956.86 lat (msec): min=131, max=2652, avg=775.82, stdev=955.58 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 439], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1851, max= 2039, per=41.97%, avg=1947.00, stdev=75.59, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.28%, ctx=86, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182447: Mon Nov 17 14:34:04 2025 read: IOPS=1, BW=1041KiB/s (1066kB/s)(5120KiB/4919msec) clat (msec): min=111, max=301, avg=186.19, stdev=70.37 lat (msec): min=111, max=301, avg=186.19, stdev=70.37 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 3835, max= 3842, per=100.00%, avg=3838.50, stdev= 4.95, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1457KiB/s (1492kB/s)(7168KiB/4919msec); 0 zone resets clat (msec): min=116, max=2390, avg=544.90, stdev=817.48 lat (msec): min=116, max=2390, avg=544.99, stdev=817.49 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 153], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 275], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 338], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1448, max= 6095, per=72.96%, avg=3384.75, stdev=2139.53, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 250=50.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=4.03%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3314KiB/s (3393kB/s), 331KiB/s-1244KiB/s (339kB/s-1274kB/s), io=20.0MiB (20.0MB), run=4919-6180msec WRITE: bw=4639KiB/s (4751kB/s), 889KiB/s-1657KiB/s (910kB/s-1697kB/s), io=28.0MiB (29.4MB), run=4919-6180msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182448: Mon Nov 17 14:34:04 2025 read: IOPS=1, BW=1457KiB/s (1492kB/s)(7168KiB/4920msec) clat (usec): min=535, max=2216.7k, avg=435526.88, stdev=792224.21 lat (usec): min=537, max=2216.7k, avg=435528.12, stdev=792224.09 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], | 20.00th=[ 635], 30.00th=[ 139461], 40.00th=[ 139461], | 50.00th=[ 206570], 60.00th=[ 235930], 70.00th=[ 235930], | 80.00th=[ 248513], 90.00th=[2231370], 95.00th=[2231370], | 99.00th=[2231370], 99.50th=[2231370], 99.90th=[2231370], | 99.95th=[2231370], 99.99th=[2231370] bw ( KiB/s): min= 1510, max= 4023, per=70.21%, avg=2312.80, stdev=980.75, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1041KiB/s (1066kB/s)(5120KiB/4920msec); 0 zone resets clat (msec): min=182, max=471, avg=343.29, stdev=115.50 lat (msec): min=182, max=471, avg=347.14, stdev=113.14 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1896, max= 3923, per=56.71%, avg=2615.33, stdev=1134.37, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=33.33%, >=2000=8.33% cpu : usr=0.10%, sys=11.89%, ctx=525, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182449: Mon Nov 17 14:34:04 2025 read: IOPS=0, BW=329KiB/s (337kB/s)(2048KiB/6216msec) clat (msec): min=82, max=127, avg=105.14, stdev=31.74 lat (msec): min=82, max=127, avg=105.14, stdev=31.74 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 128], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 128], 95.00th=[ 128], | 99.00th=[ 128], 99.50th=[ 128], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 1503, max= 1961, per=52.58%, avg=1732.00, stdev=323.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1647KiB/s (1687kB/s)(10.0MiB/6216msec); 0 zone resets clat (msec): min=105, max=2941, avg=593.62, stdev=867.12 lat (msec): min=105, max=2941, avg=593.69, stdev=867.11 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 150], 50.00th=[ 161], 60.00th=[ 249], | 70.00th=[ 592], 80.00th=[ 676], 90.00th=[ 827], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1896, max= 6095, per=60.74%, avg=2801.40, stdev=1842.10, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.06%, sys=9.44%, ctx=174, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182450: Mon Nov 17 14:34:04 2025 read: IOPS=1, BW=1125KiB/s (1152kB/s)(6144KiB/5463msec) clat (usec): min=526, max=265234, avg=135984.37, stdev=111714.93 lat (usec): min=526, max=265235, avg=135985.52, stdev=111714.92 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 33424], | 30.00th=[ 33424], 40.00th=[ 93848], 50.00th=[ 93848], 60.00th=[166724], | 70.00th=[254804], 80.00th=[254804], 90.00th=[265290], 95.00th=[265290], | 99.00th=[265290], 99.50th=[265290], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 1896, max= 5885, per=99.09%, avg=3264.00, stdev=2270.58, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1125KiB/s (1152kB/s)(6144KiB/5463msec); 0 zone resets clat (msec): min=177, max=2668, avg=741.34, stdev=957.17 lat (msec): min=177, max=2668, avg=741.41, stdev=957.18 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 409], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1558, max= 2035, per=41.53%, avg=1915.33, stdev=182.76, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.07%, sys=8.39%, ctx=245, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182451: Mon Nov 17 14:34:04 2025 read: IOPS=0, BW=869KiB/s (890kB/s)(5120KiB/5889msec) clat (msec): min=4, max=252, avg=178.97, stdev=101.95 lat (msec): min=4, max=252, avg=178.97, stdev=101.95 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1217KiB/s (1246kB/s)(7168KiB/5889msec); 0 zone resets clat (msec): min=215, max=2397, avg=687.95, stdev=765.69 lat (msec): min=215, max=2397, avg=688.03, stdev=765.69 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 262], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 418], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 584], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1602, max= 3900, per=48.68%, avg=2245.17, stdev=827.12, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 10=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=9.65%, ctx=145, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3295KiB/s (3374kB/s), 329KiB/s-1457KiB/s (337kB/s-1492kB/s), io=20.0MiB (20.0MB), run=4920-6216msec WRITE: bw=4613KiB/s (4723kB/s), 1041KiB/s-1647KiB/s (1066kB/s-1687kB/s), io=28.0MiB (29.4MB), run=4920-6216msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182458: Mon Nov 17 14:34:21 2025 read: IOPS=1, BW=4477KiB/s (4584kB/s)(12.0MiB/2745msec) clat (msec): min=798, max=853, avg=827.43, stdev=27.70 lat (msec): min=798, max=853, avg=827.43, stdev=27.70 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7984, max= 8000, per=100.00%, avg=7992.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.04%, sys=5.14%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182459: Mon Nov 17 14:34:21 2025 read: IOPS=1, BW=4571KiB/s (4681kB/s)(4096KiB/896msec) clat (nsec): min=216756k, max=216756k, avg=216756301.00, stdev= 0.00 lat (nsec): min=216757k, max=216757k, avg=216757211.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 6736, max= 6736, per=100.00%, avg=6736.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=2, BW=9143KiB/s (9362kB/s)(8192KiB/896msec); 0 zone resets clat (msec): min=259, max=349, avg=304.20, stdev=63.83 lat (msec): min=259, max=349, avg=304.58, stdev=63.74 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=11.62%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182460: Mon Nov 17 14:34:21 2025 write: IOPS=1, BW=6295KiB/s (6446kB/s)(12.0MiB/1952msec); 0 zone resets clat (msec): min=366, max=846, avg=574.08, stdev=246.48 lat (msec): min=367, max=846, avg=574.45, stdev=246.48 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8000, max= 8000, per=63.36%, avg=8000.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.71%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182461: Mon Nov 17 14:34:21 2025 write: IOPS=1, BW=4735KiB/s (4849kB/s)(12.0MiB/2595msec); 0 zone resets clat (msec): min=192, max=1850, avg=801.97, stdev=911.79 lat (msec): min=192, max=1850, avg=802.30, stdev=911.79 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 5634, max= 8000, per=53.99%, avg=6817.00, stdev=1673.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.04%, sys=5.40%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5969KiB/s (6112kB/s), 4477KiB/s-4571KiB/s (4584kB/s-4681kB/s), io=16.0MiB (16.8MB), run=896-2745msec WRITE: bw=12.3MiB/s (12.9MB/s), 4735KiB/s-9143KiB/s (4849kB/s-9362kB/s), io=32.0MiB (33.6MB), run=896-2595msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182463: Mon Nov 17 14:34:22 2025 read: IOPS=1, BW=4806KiB/s (4921kB/s)(12.0MiB/2557msec) clat (msec): min=666, max=1022, avg=848.45, stdev=178.23 lat (msec): min=666, max=1022, avg=848.45, stdev=178.23 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 5893, max= 8094, per=100.00%, avg=6993.50, stdev=1556.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.40%, ctx=304, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182464: Mon Nov 17 14:34:22 2025 read: IOPS=0, BW=1358KiB/s (1391kB/s)(4096KiB/3016msec) clat (nsec): min=703827k, max=703827k, avg=703827168.00, stdev= 0.00 lat (nsec): min=703828k, max=703828k, avg=703828181.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 5649, max= 5649, per=100.00%, avg=5649.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2716KiB/s (2781kB/s)(8192KiB/3016msec); 0 zone resets clat (msec): min=672, max=1638, avg=1155.19, stdev=682.89 lat (msec): min=672, max=1638, avg=1155.53, stdev=682.88 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8094, max= 8094, per=74.50%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.21%, ctx=91, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182465: Mon Nov 17 14:34:22 2025 write: IOPS=1, BW=4144KiB/s (4244kB/s)(12.0MiB/2965msec); 0 zone resets clat (msec): min=286, max=1777, avg=986.39, stdev=749.52 lat (msec): min=286, max=1777, avg=988.04, stdev=749.33 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7907, max= 8175, per=74.02%, avg=8041.00, stdev=189.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.50%, ctx=31, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182466: Mon Nov 17 14:34:22 2025 write: IOPS=1, BW=5103KiB/s (5225kB/s)(12.0MiB/2408msec); 0 zone resets clat (msec): min=496, max=1302, avg=801.95, stdev=436.67 lat (msec): min=497, max=1302, avg=802.39, stdev=436.58 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 5475, max= 8143, per=62.67%, avg=6809.00, stdev=1886.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.08%, sys=6.56%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5432KiB/s (5563kB/s), 1358KiB/s-4806KiB/s (1391kB/s-4921kB/s), io=16.0MiB (16.8MB), run=2557-3016msec WRITE: bw=10.6MiB/s (11.1MB/s), 2716KiB/s-5103KiB/s (2781kB/s-5225kB/s), io=32.0MiB (33.6MB), run=2408-3016msec