== sanity test 398b: DIO and buffer IO race ============== 13:52:46 (1789062766) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.03532 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146137: Thu Sep 10 13:55:26 2026 read: IOPS=10, BW=43.1KiB/s (44.1kB/s)(5992KiB/138994msec) clat (usec): min=31, max=978692, avg=45052.31, stdev=42978.78 lat (usec): min=32, max=978694, avg=45054.68, stdev=42978.60 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 1004], 20.00th=[ 20841], | 30.00th=[ 26870], 40.00th=[ 32113], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[ 98042], | 99.00th=[154141], 99.50th=[196084], 99.90th=[583009], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 95, per=25.42%, avg=43.47, stdev=17.38, samples=269 iops : min= 1, max= 23, avg=10.24, stdev= 4.39, samples=269 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6296KiB/138994msec); 0 zone resets clat (usec): min=1063, max=305842, avg=45078.13, stdev=44691.44 lat (usec): min=1064, max=305843, avg=45085.10, stdev=44687.10 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1385], 10.00th=[ 2180], 20.00th=[ 5145], | 30.00th=[ 10290], 40.00th=[ 23462], 50.00th=[ 34341], 60.00th=[ 45351], | 70.00th=[ 59507], 80.00th=[ 78119], 90.00th=[103285], 95.00th=[128451], | 99.00th=[193987], 99.50th=[219153], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=45.43, stdev=18.95, samples=270 iops : min= 1, max= 25, avg=10.74, stdev= 4.77, samples=270 lat (usec) : 50=0.72%, 100=3.52%, 250=0.36%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.01%, 4=3.58%, 10=6.93%, 20=8.33%, 50=36.00% lat (msec) : 100=27.38%, 250=7.65%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.12%, ctx=6549, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146139: Thu Sep 10 13:55:26 2026 read: IOPS=10, BW=42.8KiB/s (43.8kB/s)(5940KiB/138858msec) clat (usec): min=30, max=217821, avg=42494.43, stdev=31303.55 lat (usec): min=30, max=217822, avg=42500.54, stdev=31305.39 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 93], 20.00th=[ 20055], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[162530], 99.90th=[200279], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 5, max= 111, per=25.03%, avg=42.80, stdev=19.64, samples=270 iops : min= 1, max= 27, avg=10.07, stdev= 4.94, samples=270 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6348KiB/138858msec); 0 zone resets clat (usec): min=980, max=960551, avg=47439.84, stdev=53681.72 lat (usec): min=981, max=960554, avg=47442.87, stdev=53681.14 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1418], 10.00th=[ 2245], 20.00th=[ 5538], | 30.00th=[ 10552], 40.00th=[ 22414], 50.00th=[ 35390], 60.00th=[ 48497], | 70.00th=[ 62653], 80.00th=[ 79168], 90.00th=[107480], 95.00th=[135267], | 99.00th=[202376], 99.50th=[252707], 99.90th=[549454], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 102, per=25.39%, avg=45.45, stdev=19.94, samples=271 iops : min= 1, max= 25, avg=10.75, stdev= 5.01, samples=271 lat (usec) : 50=0.59%, 100=4.43%, 250=0.46%, 500=0.13%, 1000=0.07% lat (msec) : 2=4.79%, 4=3.45%, 10=7.10%, 20=8.20%, 50=35.19% lat (msec) : 100=27.21%, 250=8.14%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.08%, ctx=6649, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146141: Thu Sep 10 13:55:26 2026 read: IOPS=10, BW=42.9KiB/s (43.0kB/s)(6028KiB/140391msec) clat (usec): min=33, max=857850, avg=43702.95, stdev=38290.11 lat (usec): min=34, max=857852, avg=43783.02, stdev=38470.47 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 98], 20.00th=[ 20579], | 30.00th=[ 26608], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[177210], 99.90th=[308282], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 119, per=25.34%, avg=43.33, stdev=20.05, samples=269 iops : min= 1, max= 29, avg=10.20, stdev= 5.07, samples=269 write: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6260KiB/140391msec); 0 zone resets clat (usec): min=1109, max=1185.0k, avg=47239.51, stdev=56424.68 lat (usec): min=1110, max=1185.0k, avg=47245.95, stdev=56428.24 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1876], | 20.00th=[ 5080], 30.00th=[ 10421], 40.00th=[ 23200], | 50.00th=[ 35390], 60.00th=[ 46400], 70.00th=[ 61604], | 80.00th=[ 80217], 90.00th=[ 107480], 95.00th=[ 130548], | 99.00th=[ 212861], 99.50th=[ 283116], 99.90th=[ 463471], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 111, per=24.78%, avg=44.35, stdev=19.00, samples=272 iops : min= 1, max= 27, avg=10.47, stdev= 4.79, samples=272 lat (usec) : 50=0.78%, 100=4.13%, 250=0.46%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.40%, 4=3.52%, 10=6.74%, 20=7.68%, 50=34.99% lat (msec) : 100=27.67%, 250=7.91%, 500=0.39%, 1000=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.95%, ctx=6520, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146143: Thu Sep 10 13:55:26 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(6052KiB/138046msec) clat (usec): min=33, max=985620, avg=44766.10, stdev=42546.70 lat (usec): min=33, max=985622, avg=44767.95, stdev=42546.56 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 235], 20.00th=[ 20579], | 30.00th=[ 26870], 40.00th=[ 32375], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[242222], 99.90th=[434111], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 5, max= 104, per=25.65%, avg=43.86, stdev=18.10, samples=269 iops : min= 1, max= 26, avg=10.34, stdev= 4.57, samples=269 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6236KiB/138046msec); 0 zone resets clat (usec): min=1056, max=368866, avg=44750.51, stdev=45266.46 lat (usec): min=1057, max=368867, avg=44755.70, stdev=45265.27 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 2180], 20.00th=[ 5473], | 30.00th=[ 9896], 40.00th=[ 20841], 50.00th=[ 34341], 60.00th=[ 45876], | 70.00th=[ 59507], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[126354], | 99.00th=[198181], 99.50th=[242222], 99.90th=[325059], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 123, per=25.12%, avg=44.97, stdev=19.78, samples=270 iops : min= 1, max= 30, avg=10.62, stdev= 5.00, samples=270 lat (usec) : 50=0.88%, 100=3.71%, 250=0.39%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.82%, 4=3.42%, 10=7.62%, 20=8.14%, 50=35.32% lat (msec) : 100=27.05%, 250=8.07%, 500=0.36%, 1000=0.03% cpu : usr=0.06%, sys=5.20%, ctx=6712, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.8KiB/s-43.8KiB/s (43.8kB/s-44.9kB/s), io=23.4MiB (24.6MB), run=138046-140391msec WRITE: bw=179KiB/s (183kB/s), 44.6KiB/s-45.7KiB/s (45.7kB/s-46.8kB/s), io=24.6MiB (25.7MB), run=138046-140391msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146138: Thu Sep 10 13:58:27 2026 read: IOPS=4, BW=18.8KiB/s (19.3kB/s)(5992KiB/318555msec) clat (msec): min=5, max=995, avg=40.03, stdev=46.91 lat (msec): min=5, max=995, avg=40.03, stdev=46.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 85], 95.00th=[ 114], | 99.00th=[ 201], 99.50th=[ 284], 99.90th=[ 464], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 95, per=29.85%, avg=22.09, stdev=14.97, samples=521 iops : min= 1, max= 23, avg= 4.88, stdev= 3.79, samples=521 write: IOPS=4, BW=19.8KiB/s (20.2kB/s)(6296KiB/318555msec); 0 zone resets clat (msec): min=36, max=863, avg=164.01, stdev=74.56 lat (msec): min=36, max=863, avg=164.01, stdev=74.56 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 86], 20.00th=[ 103], | 30.00th=[ 120], 40.00th=[ 136], 50.00th=[ 153], 60.00th=[ 169], | 70.00th=[ 188], 80.00th=[ 213], 90.00th=[ 262], 95.00th=[ 305], | 99.00th=[ 384], 99.50th=[ 426], 99.90th=[ 776], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 54, per=24.97%, avg=19.48, stdev= 8.57, samples=617 iops : min= 1, max= 13, avg= 4.22, stdev= 2.16, samples=617 lat (msec) : 10=1.76%, 20=14.62%, 50=22.49%, 100=16.05%, 250=38.48% lat (msec) : 500=6.45%, 750=0.07%, 1000=0.10% cpu : usr=0.04%, sys=1.20%, ctx=5105, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146140: Thu Sep 10 13:58:27 2026 read: IOPS=4, BW=18.6KiB/s (18.0kB/s)(5940KiB/320200msec) clat (msec): min=6, max=986, avg=39.27, stdev=47.55 lat (msec): min=6, max=986, avg=39.28, stdev=47.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 81], 95.00th=[ 120], | 99.00th=[ 192], 99.50th=[ 279], 99.90th=[ 514], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 95, per=29.91%, avg=22.13, stdev=15.20, samples=516 iops : min= 1, max= 23, avg= 4.88, stdev= 3.82, samples=516 write: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6348KiB/320200msec); 0 zone resets clat (msec): min=38, max=868, avg=164.73, stdev=75.75 lat (msec): min=38, max=868, avg=164.74, stdev=75.75 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 72], 10.00th=[ 86], 20.00th=[ 104], | 30.00th=[ 121], 40.00th=[ 136], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 190], 80.00th=[ 218], 90.00th=[ 264], 95.00th=[ 305], | 99.00th=[ 401], 99.50th=[ 443], 99.90th=[ 617], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 47, per=24.98%, avg=19.49, stdev= 8.58, samples=623 iops : min= 1, max= 11, avg= 4.22, stdev= 2.19, samples=623 lat (msec) : 10=1.82%, 20=14.62%, 50=22.62%, 100=15.46%, 250=38.90% lat (msec) : 500=6.35%, 750=0.16%, 1000=0.07% cpu : usr=0.04%, sys=1.23%, ctx=5130, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146142: Thu Sep 10 13:58:27 2026 read: IOPS=4, BW=18.0KiB/s (19.4kB/s)(6028KiB/317599msec) clat (msec): min=5, max=635, avg=40.33, stdev=41.63 lat (msec): min=5, max=635, avg=40.33, stdev=41.63 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 85], 95.00th=[ 116], | 99.00th=[ 190], 99.50th=[ 257], 99.90th=[ 510], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 95, per=29.59%, avg=21.90, stdev=14.79, samples=528 iops : min= 1, max= 23, avg= 4.82, stdev= 3.72, samples=528 write: IOPS=4, BW=19.7KiB/s (20.2kB/s)(6260KiB/317599msec); 0 zone resets clat (msec): min=34, max=1153, avg=163.81, stdev=76.96 lat (msec): min=34, max=1153, avg=163.81, stdev=76.96 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 74], 10.00th=[ 85], 20.00th=[ 105], | 30.00th=[ 118], 40.00th=[ 134], 50.00th=[ 148], 60.00th=[ 167], | 70.00th=[ 186], 80.00th=[ 220], 90.00th=[ 264], 95.00th=[ 300], | 99.00th=[ 388], 99.50th=[ 414], 99.90th=[ 776], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 47, per=24.88%, avg=19.41, stdev= 8.58, samples=616 iops : min= 1, max= 11, avg= 4.20, stdev= 2.18, samples=616 lat (msec) : 10=1.33%, 20=14.39%, 50=22.88%, 100=16.15%, 250=38.67% lat (msec) : 500=6.38%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.16%, ctx=5092, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146144: Thu Sep 10 13:58:27 2026 read: IOPS=4, BW=18.0KiB/s (19.4kB/s)(6052KiB/318882msec) clat (msec): min=5, max=776, avg=38.67, stdev=39.94 lat (msec): min=5, max=776, avg=38.68, stdev=39.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 184], 99.50th=[ 215], 99.90th=[ 368], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 94, per=30.52%, avg=22.58, stdev=15.42, samples=515 iops : min= 1, max= 23, avg= 4.99, stdev= 3.87, samples=515 write: IOPS=4, BW=19.6KiB/s (20.0kB/s)(6236KiB/318882msec); 0 zone resets clat (msec): min=37, max=1291, avg=166.71, stdev=79.98 lat (msec): min=37, max=1291, avg=166.72, stdev=79.98 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 86], 20.00th=[ 104], | 30.00th=[ 121], 40.00th=[ 138], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 190], 80.00th=[ 222], 90.00th=[ 271], 95.00th=[ 309], | 99.00th=[ 422], 99.50th=[ 472], 99.90th=[ 617], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 48, per=24.84%, avg=19.38, stdev= 8.70, samples=615 iops : min= 1, max= 12, avg= 4.20, stdev= 2.22, samples=615 lat (msec) : 10=1.63%, 20=14.45%, 50=23.44%, 100=15.53%, 250=38.25% lat (msec) : 500=6.51%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=4982, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=74.0KiB/s (76.8kB/s), 18.6KiB/s-18.0KiB/s (18.0kB/s-19.4kB/s), io=23.4MiB (24.6MB), run=317599-320200msec WRITE: bw=78.5KiB/s (80.4kB/s), 19.6KiB/s-19.8KiB/s (20.0kB/s-20.3kB/s), io=24.6MiB (25.7MB), run=317599-320200msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146205: Thu Sep 10 13:59:10 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(5920KiB/30808msec) clat (usec): min=38, max=357262, avg=42688.98, stdev=40728.78 lat (usec): min=38, max=357264, avg=42697.13, stdev=40721.65 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 81], | 30.00th=[ 19006], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[149947], 99.50th=[274727], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 62, max= 446, per=25.60%, avg=191.22, stdev=78.43, samples=60 iops : min= 3, max= 27, avg=11.18, stdev= 4.92, samples=60 write: IOPS=12, BW=207KiB/s (212kB/s)(6368KiB/30808msec); 0 zone resets clat (usec): min=1334, max=206153, avg=37323.32, stdev=38156.09 lat (usec): min=1336, max=206154, avg=37325.86, stdev=38156.03 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1893], 10.00th=[ 3818], 20.00th=[ 6587], | 30.00th=[ 10290], 40.00th=[ 14877], 50.00th=[ 24511], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 62129], 90.00th=[ 92799], 95.00th=[124257], | 99.00th=[170918], 99.50th=[177210], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 468, per=26.35%, avg=207.10, stdev=96.57, samples=60 iops : min= 1, max= 29, avg=12.20, stdev= 6.08, samples=60 lat (usec) : 50=1.69%, 100=9.64%, 250=0.91%, 750=0.26%, 1000=0.13% lat (msec) : 2=3.52%, 4=2.47%, 10=9.90%, 20=10.29%, 50=28.91% lat (msec) : 100=24.74%, 250=7.29%, 500=0.26% cpu : usr=0.07%, sys=6.01%, ctx=1424, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146206: Thu Sep 10 13:59:10 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(5744KiB/31642msec) clat (usec): min=34, max=283680, avg=43987.31, stdev=37449.61 lat (usec): min=34, max=283682, avg=43988.41, stdev=37449.67 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 91], | 30.00th=[ 25560], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 48497], | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[132645], 99.50th=[212861], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 351, per=24.97%, avg=186.55, stdev=77.56, samples=60 iops : min= 1, max= 21, avg=10.90, stdev= 4.88, samples=60 write: IOPS=12, BW=207KiB/s (212kB/s)(6544KiB/31642msec); 0 zone resets clat (usec): min=1438, max=408677, avg=37438.30, stdev=48025.64 lat (usec): min=1440, max=408678, avg=37440.42, stdev=48025.65 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1827], 10.00th=[ 2212], 20.00th=[ 4883], | 30.00th=[ 8356], 40.00th=[ 10814], 50.00th=[ 17695], 60.00th=[ 29754], | 70.00th=[ 46400], 80.00th=[ 63177], 90.00th=[ 94897], 95.00th=[125305], | 99.00th=[206570], 99.50th=[254804], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 31, max= 544, per=26.74%, avg=210.15, stdev=101.96, samples=61 iops : min= 1, max= 34, avg=12.38, stdev= 6.47, samples=61 lat (usec) : 50=1.17%, 100=8.46%, 250=0.52%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=3.91%, 4=5.86%, 10=10.68%, 20=8.98%, 50=26.69% lat (msec) : 100=25.26%, 250=7.42%, 500=0.52% cpu : usr=0.08%, sys=5.80%, ctx=1411, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146207: Thu Sep 10 13:59:10 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6256KiB/32057msec) clat (usec): min=28, max=334717, avg=42535.44, stdev=40421.96 lat (usec): min=28, max=334718, avg=42541.44, stdev=40423.94 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 77], | 30.00th=[ 21890], 40.00th=[ 31589], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[104334], | 99.00th=[177210], 99.50th=[283116], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 28, max= 507, per=26.23%, avg=195.90, stdev=97.53, samples=63 iops : min= 1, max= 31, avg=11.48, stdev= 6.10, samples=63 write: IOPS=11, BW=188KiB/s (193kB/s)(6032KiB/32057msec); 0 zone resets clat (usec): min=1479, max=230478, avg=39754.56, stdev=40423.75 lat (usec): min=1481, max=230480, avg=39757.44, stdev=40423.41 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1827], 10.00th=[ 3163], 20.00th=[ 6128], | 30.00th=[ 9634], 40.00th=[ 15401], 50.00th=[ 26608], 60.00th=[ 41157], | 70.00th=[ 51643], 80.00th=[ 65799], 90.00th=[101188], 95.00th=[124257], | 99.00th=[168821], 99.50th=[208667], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 31, max= 415, per=23.76%, avg=186.73, stdev=90.74, samples=63 iops : min= 1, max= 25, avg=10.90, stdev= 5.71, samples=63 lat (usec) : 50=2.60%, 100=9.38%, 250=0.91%, 500=0.26%, 750=0.13% lat (msec) : 2=3.26%, 4=2.99%, 10=9.64%, 20=8.07%, 50=28.52% lat (msec) : 100=26.17%, 250=7.81%, 500=0.26% cpu : usr=0.09%, sys=5.94%, ctx=1467, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146209: Thu Sep 10 13:59:10 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(6032KiB/31230msec) clat (usec): min=18, max=370787, avg=42281.66, stdev=43839.82 lat (usec): min=19, max=370788, avg=42283.18, stdev=43840.13 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 49], 10.00th=[ 60], 20.00th=[ 79], | 30.00th=[ 734], 40.00th=[ 29230], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 55313], 80.00th=[ 68682], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[191890], 99.50th=[267387], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 63, max= 416, per=26.12%, avg=195.10, stdev=84.47, samples=60 iops : min= 3, max= 26, avg=11.43, stdev= 5.36, samples=60 write: IOPS=12, BW=200KiB/s (205kB/s)(6256KiB/31230msec); 0 zone resets clat (usec): min=1525, max=379625, avg=37887.53, stdev=43646.05 lat (usec): min=1526, max=379627, avg=37889.62, stdev=43646.06 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1860], 10.00th=[ 2343], 20.00th=[ 5735], | 30.00th=[ 8455], 40.00th=[ 12256], 50.00th=[ 21627], 60.00th=[ 33424], | 70.00th=[ 48497], 80.00th=[ 66847], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[181404], 99.50th=[233833], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 437, per=25.43%, avg=199.90, stdev=85.29, samples=61 iops : min= 1, max= 27, avg=11.75, stdev= 5.40, samples=61 lat (usec) : 20=0.13%, 50=2.47%, 100=9.51%, 250=2.08%, 500=0.13% lat (usec) : 750=0.52% lat (msec) : 2=3.91%, 4=4.04%, 10=9.90%, 20=7.81%, 50=27.47% lat (msec) : 100=24.61%, 250=7.03%, 500=0.39% cpu : usr=0.07%, sys=5.71%, ctx=1393, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=747KiB/s (765kB/s), 182KiB/s-195KiB/s (186kB/s-200kB/s), io=23.4MiB (24.5MB), run=30808-32057msec WRITE: bw=786KiB/s (805kB/s), 188KiB/s-207KiB/s (193kB/s-212kB/s), io=24.6MiB (25.8MB), run=30808-32057msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146208: Thu Sep 10 13:59:58 2026 read: IOPS=4, BW=74.4KiB/s (76.2kB/s)(5920KiB/79571msec) clat (msec): min=7, max=487, avg=40.67, stdev=43.09 lat (msec): min=7, max=487, avg=40.68, stdev=43.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 53], 90.00th=[ 81], 95.00th=[ 121], | 99.00th=[ 199], 99.50th=[ 249], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 28, max= 283, per=29.32%, avg=87.37, stdev=53.77, samples=133 iops : min= 1, max= 17, avg= 4.68, stdev= 3.45, samples=133 write: IOPS=5, BW=80.0KiB/s (81.9kB/s)(6368KiB/79571msec); 0 zone resets clat (msec): min=51, max=611, avg=160.92, stdev=86.00 lat (msec): min=51, max=611, avg=160.93, stdev=86.00 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 99], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 140], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 211], 90.00th=[ 268], 95.00th=[ 338], | 99.00th=[ 498], 99.50th=[ 550], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 30, max= 191, per=25.97%, avg=81.56, stdev=40.25, samples=153 iops : min= 1, max= 11, avg= 4.33, stdev= 2.61, samples=153 lat (msec) : 10=1.04%, 20=11.85%, 50=25.13%, 100=18.62%, 250=37.24% lat (msec) : 500=5.73%, 750=0.39% cpu : usr=0.04%, sys=1.37%, ctx=1394, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146210: Thu Sep 10 13:59:58 2026 read: IOPS=4, BW=71.6KiB/s (73.4kB/s)(5744KiB/80170msec) clat (msec): min=6, max=392, avg=39.93, stdev=44.74 lat (msec): min=6, max=392, avg=39.93, stdev=44.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 52], 90.00th=[ 83], 95.00th=[ 117], | 99.00th=[ 257], 99.50th=[ 309], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 28, max= 352, per=30.37%, avg=90.50, stdev=62.02, samples=124 iops : min= 1, max= 22, avg= 4.91, stdev= 3.89, samples=124 write: IOPS=5, BW=81.6KiB/s (83.6kB/s)(6544KiB/80170msec); 0 zone resets clat (msec): min=46, max=598, avg=160.45, stdev=82.97 lat (msec): min=46, max=598, avg=160.46, stdev=82.97 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 75], 10.00th=[ 84], 20.00th=[ 99], | 30.00th=[ 110], 40.00th=[ 123], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 209], 90.00th=[ 275], 95.00th=[ 321], | 99.00th=[ 464], 99.50th=[ 468], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 28, max= 191, per=26.46%, avg=83.08, stdev=38.13, samples=154 iops : min= 1, max= 11, avg= 4.42, stdev= 2.45, samples=154 lat (msec) : 10=1.69%, 20=13.93%, 50=21.74%, 100=17.45%, 250=37.63% lat (msec) : 500=7.29%, 750=0.26% cpu : usr=0.03%, sys=1.22%, ctx=1372, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146211: Thu Sep 10 13:59:58 2026 read: IOPS=4, BW=79.9KiB/s (81.8kB/s)(6256KiB/78306msec) clat (msec): min=7, max=390, avg=41.43, stdev=44.74 lat (msec): min=7, max=390, avg=41.43, stdev=44.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 83], 95.00th=[ 121], | 99.00th=[ 284], 99.50th=[ 300], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 351, per=31.45%, avg=93.73, stdev=62.84, samples=132 iops : min= 1, max= 21, avg= 5.10, stdev= 3.97, samples=132 write: IOPS=4, BW=77.0KiB/s (78.9kB/s)(6032KiB/78306msec); 0 zone resets clat (msec): min=47, max=588, avg=163.69, stdev=78.75 lat (msec): min=47, max=588, avg=163.70, stdev=78.75 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 88], 20.00th=[ 102], | 30.00th=[ 116], 40.00th=[ 131], 50.00th=[ 144], 60.00th=[ 165], | 70.00th=[ 184], 80.00th=[ 213], 90.00th=[ 262], 95.00th=[ 309], | 99.00th=[ 460], 99.50th=[ 550], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 30, max= 160, per=24.88%, avg=78.12, stdev=33.73, samples=152 iops : min= 1, max= 10, avg= 4.11, stdev= 2.21, samples=152 lat (msec) : 10=0.65%, 20=13.80%, 50=26.17%, 100=16.67%, 250=36.07% lat (msec) : 500=6.25%, 750=0.39% cpu : usr=0.03%, sys=1.31%, ctx=1347, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146212: Thu Sep 10 13:59:58 2026 read: IOPS=4, BW=75.8KiB/s (77.6kB/s)(6032KiB/79626msec) clat (msec): min=7, max=263, avg=42.87, stdev=43.94 lat (msec): min=7, max=263, avg=42.87, stdev=43.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 87], 95.00th=[ 148], | 99.00th=[ 251], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 310, per=31.21%, avg=93.02, stdev=58.61, samples=126 iops : min= 1, max= 19, avg= 5.06, stdev= 3.70, samples=126 write: IOPS=4, BW=78.6KiB/s (80.5kB/s)(6256KiB/79626msec); 0 zone resets clat (msec): min=45, max=530, avg=160.98, stdev=76.73 lat (msec): min=45, max=530, avg=160.99, stdev=76.74 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 75], 10.00th=[ 85], 20.00th=[ 104], | 30.00th=[ 113], 40.00th=[ 129], 50.00th=[ 144], 60.00th=[ 163], | 70.00th=[ 180], 80.00th=[ 207], 90.00th=[ 249], 95.00th=[ 305], | 99.00th=[ 477], 99.50th=[ 493], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 30, max= 160, per=25.35%, avg=79.58, stdev=35.09, samples=154 iops : min= 1, max= 10, avg= 4.20, stdev= 2.27, samples=154 lat (msec) : 10=1.04%, 20=12.89%, 50=24.61%, 100=14.97%, 250=40.89% lat (msec) : 500=5.47%, 750=0.13% cpu : usr=0.04%, sys=1.24%, ctx=1346, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=299KiB/s (306kB/s), 71.6KiB/s-79.9KiB/s (73.4kB/s-81.8kB/s), io=23.4MiB (24.5MB), run=78306-80170msec WRITE: bw=314KiB/s (322kB/s), 77.0KiB/s-81.6KiB/s (78.9kB/s-83.6kB/s), io=24.6MiB (25.8MB), run=78306-80170msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146232: Thu Sep 10 14:00:17 2026 read: IOPS=1, BW=1454KiB/s (1489kB/s)(7168KiB/4931msec) clat (msec): min=232, max=481, avg=357.00, stdev=95.78 lat (msec): min=232, max=481, avg=357.01, stdev=95.78 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 284], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 334], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 472], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1984, max= 4071, per=80.56%, avg=2862.25, stdev=1023.47, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1038KiB/s (1063kB/s)(5120KiB/4931msec); 0 zone resets clat (msec): min=253, max=817, avg=471.55, stdev=216.97 lat (msec): min=253, max=817, avg=471.75, stdev=216.91 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1396, max= 2043, per=37.99%, avg=1889.80, stdev=276.83, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=8.33%, 500=75.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=8.11%, ctx=212, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146233: Thu Sep 10 14:00:17 2026 read: IOPS=0, BW=355KiB/s (364kB/s)(2048KiB/5763msec) clat (usec): min=478, max=251536, avg=126007.18, stdev=177524.82 lat (usec): min=479, max=251538, avg=126008.90, stdev=177525.39 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 478], 50.00th=[ 478], 60.00th=[250610], | 70.00th=[250610], 80.00th=[250610], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 1692, max= 1984, per=51.73%, avg=1838.00, stdev=206.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1777KiB/s (1819kB/s)(10.0MiB/5763msec); 0 zone resets clat (msec): min=124, max=981, avg=532.54, stdev=314.86 lat (msec): min=125, max=981, avg=532.73, stdev=314.67 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 194], | 30.00th=[ 296], 40.00th=[ 359], 50.00th=[ 401], 60.00th=[ 489], | 70.00th=[ 676], 80.00th=[ 860], 90.00th=[ 953], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1396, max= 4031, per=50.24%, avg=2499.43, stdev=1057.94, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 500=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=8.33%, 1000=25.00% cpu : usr=0.00%, sys=7.25%, ctx=159, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146234: Thu Sep 10 14:00:17 2026 read: IOPS=1, BW=1082KiB/s (1108kB/s)(6144KiB/5676msec) clat (usec): min=451, max=776419, avg=349981.03, stdev=289853.13 lat (usec): min=452, max=776420, avg=349982.29, stdev=289852.92 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 50594], | 30.00th=[ 50594], 40.00th=[346031], 50.00th=[346031], 60.00th=[446694], | 70.00th=[480248], 80.00th=[480248], 90.00th=[775947], 95.00th=[775947], | 99.00th=[775947], 99.50th=[775947], 99.90th=[775947], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 1996, max= 4031, per=70.88%, avg=2518.25, stdev=1008.63, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1082KiB/s (1108kB/s)(6144KiB/5676msec); 0 zone resets clat (msec): min=297, max=837, avg=565.45, stdev=222.29 lat (msec): min=297, max=837, avg=565.51, stdev=222.28 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 651], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1396, max= 2043, per=38.52%, avg=1916.17, stdev=256.06, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 500=41.67%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=6.57%, ctx=123, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146235: Thu Sep 10 14:00:17 2026 read: IOPS=0, BW=1021KiB/s (1045kB/s)(5120KiB/5015msec) clat (usec): min=351, max=452485, avg=206593.03, stdev=217368.26 lat (usec): min=352, max=452486, avg=206594.03, stdev=217368.33 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 441], 40.00th=[ 441], 50.00th=[168821], 60.00th=[168821], | 70.00th=[413139], 80.00th=[413139], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1429KiB/s (1464kB/s)(7168KiB/5015msec); 0 zone resets clat (msec): min=328, max=741, avg=541.05, stdev=152.24 lat (msec): min=328, max=741, avg=541.22, stdev=152.21 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 401], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 523], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 701], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1396, max= 2043, per=38.67%, avg=1923.83, stdev=258.95, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=16.67% lat (msec) : 250=8.33%, 500=41.67%, 750=33.33% cpu : usr=0.00%, sys=7.76%, ctx=138, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3554KiB/s (3639kB/s), 355KiB/s-1454KiB/s (364kB/s-1489kB/s), io=20.0MiB (20.0MB), run=4931-5763msec WRITE: bw=4975KiB/s (5095kB/s), 1038KiB/s-1777KiB/s (1063kB/s-1819kB/s), io=28.0MiB (29.4MB), run=4931-5763msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146237: Thu Sep 10 14:00:18 2026 read: IOPS=1, BW=1283KiB/s (1313kB/s)(7168KiB/5589msec) clat (msec): min=66, max=655, avg=274.35, stdev=195.92 lat (msec): min=66, max=655, avg=274.38, stdev=195.88 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 122], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 234], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 372], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1976, max= 3390, per=68.57%, avg=2284.60, stdev=618.35, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=916KiB/s (938kB/s)(5120KiB/5589msec); 0 zone resets clat (msec): min=398, max=1276, avg=711.18, stdev=355.38 lat (msec): min=398, max=1277, avg=711.26, stdev=355.37 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1787, max= 2019, per=41.64%, avg=1942.50, stdev=105.24, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=2.72%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146238: Thu Sep 10 14:00:18 2026 read: IOPS=0, BW=339KiB/s (347kB/s)(2048KiB/6036msec) clat (msec): min=357, max=503, avg=430.63, stdev=103.31 lat (msec): min=357, max=503, avg=430.63, stdev=103.31 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2019, max= 2039, per=60.89%, avg=2029.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1696KiB/s (1737kB/s)(10.0MiB/6036msec); 0 zone resets clat (msec): min=154, max=949, avg=512.96, stdev=270.06 lat (msec): min=154, max=949, avg=513.58, stdev=270.80 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 284], | 30.00th=[ 300], 40.00th=[ 338], 50.00th=[ 388], 60.00th=[ 514], | 70.00th=[ 558], 80.00th=[ 785], 90.00th=[ 860], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1976, max= 6095, per=63.40%, avg=2957.83, stdev=1676.56, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=8.33%, 500=41.67%, 750=25.00%, 1000=25.00% cpu : usr=0.00%, sys=2.90%, ctx=110, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146239: Thu Sep 10 14:00:18 2026 read: IOPS=0, BW=1000KiB/s (1024kB/s)(6144KiB/6145msec) clat (msec): min=134, max=706, avg=360.52, stdev=248.81 lat (msec): min=134, max=706, avg=360.52, stdev=248.81 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 305], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1787, max= 4007, per=73.63%, avg=2453.25, stdev=1041.28, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=1000KiB/s (1024kB/s)(6144KiB/6145msec); 0 zone resets clat (msec): min=299, max=1269, avg=654.34, stdev=375.98 lat (msec): min=299, max=1269, avg=654.40, stdev=375.99 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 726], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1835, max= 2039, per=42.05%, avg=1961.80, stdev=83.92, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.20%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146240: Thu Sep 10 14:00:18 2026 read: IOPS=0, BW=838KiB/s (858kB/s)(5120KiB/6110msec) clat (msec): min=143, max=557, avg=281.83, stdev=170.18 lat (msec): min=143, max=557, avg=281.83, stdev=170.18 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1835, max= 6059, per=100.00%, avg=3947.00, stdev=2986.82, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1173KiB/s (1201kB/s)(7168KiB/6110msec); 0 zone resets clat (msec): min=271, max=1043, avg=661.44, stdev=348.68 lat (msec): min=271, max=1043, avg=661.54, stdev=348.70 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 284], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 642], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 1003], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1787, max= 4063, per=50.73%, avg=2366.40, stdev=953.55, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.02%, sys=2.65%, ctx=97, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3333KiB/s (3413kB/s), 339KiB/s-1283KiB/s (347kB/s-1313kB/s), io=20.0MiB (20.0MB), run=5589-6145msec WRITE: bw=4666KiB/s (4778kB/s), 916KiB/s-1696KiB/s (938kB/s-1737kB/s), io=28.0MiB (29.4MB), run=5589-6145msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146247: Thu Sep 10 14:00:31 2026 read: IOPS=0, BW=3457KiB/s (3539kB/s)(12.0MiB/3555msec) clat (msec): min=966, max=1343, avg=1153.21, stdev=188.58 lat (msec): min=966, max=1343, avg=1153.21, stdev=188.58 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8062, max= 8078, per=100.00%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.43%, ctx=154, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146248: Thu Sep 10 14:00:31 2026 read: IOPS=0, BW=1114KiB/s (1141kB/s)(4096KiB/3677msec) clat (nsec): min=1089.2M, max=1089.2M, avg=1089183414.00, stdev= 0.00 lat (nsec): min=1089.2M, max=1089.2M, avg=1089185609.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2228KiB/s (2281kB/s)(8192KiB/3677msec); 0 zone resets clat (msec): min=681, max=1849, avg=1265.59, stdev=825.37 lat (msec): min=682, max=1849, avg=1266.21, stdev=824.95 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8078, max= 8078, per=94.75%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.80%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146249: Thu Sep 10 14:00:31 2026 write: IOPS=0, BW=3198KiB/s (3274kB/s)(12.0MiB/3843msec); 0 zone resets clat (msec): min=1000, max=1587, avg=1211.31, stdev=326.29 lat (msec): min=1001, max=1591, avg=1213.09, stdev=328.09 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7772, max= 8078, per=92.95%, avg=7925.00, stdev=216.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=6.27%, ctx=92, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146250: Thu Sep 10 14:00:31 2026 write: IOPS=1, BW=4208KiB/s (4309kB/s)(12.0MiB/2920msec); 0 zone resets clat (msec): min=719, max=1285, avg=943.79, stdev=300.84 lat (msec): min=720, max=1286, avg=944.45, stdev=300.65 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8062, max= 8078, per=94.65%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.17%, sys=5.14%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4456KiB/s (4563kB/s), 1114KiB/s-3457KiB/s (1141kB/s-3539kB/s), io=16.0MiB (16.8MB), run=3555-3677msec WRITE: bw=8527KiB/s (8731kB/s), 2228KiB/s-4208KiB/s (2281kB/s-4309kB/s), io=32.0MiB (33.6MB), run=2920-3843msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146252: Thu Sep 10 14:00:33 2026 read: IOPS=0, BW=3960KiB/s (4055kB/s)(12.0MiB/3103msec) clat (msec): min=426, max=1854, avg=1029.41, stdev=739.62 lat (msec): min=426, max=1854, avg=1029.42, stdev=739.62 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 5696, max= 8159, per=100.00%, avg=6927.50, stdev=1741.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.06%, sys=2.80%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146253: Thu Sep 10 14:00:33 2026 read: IOPS=0, BW=1196KiB/s (1224kB/s)(4096KiB/3426msec) clat (nsec): min=1522.9M, max=1522.9M, avg=1522869191.00, stdev= 0.00 lat (nsec): min=1522.9M, max=1522.9M, avg=1522870994.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1519], 5.00th=[ 1519], 10.00th=[ 1519], 20.00th=[ 1519], | 30.00th=[ 1519], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2391KiB/s (2449kB/s)(8192KiB/3426msec); 0 zone resets clat (msec): min=803, max=1096, avg=950.15, stdev=207.23 lat (msec): min=804, max=1097, avg=950.70, stdev=207.24 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8159, max= 8159, per=85.86%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=2.60%, ctx=29, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146254: Thu Sep 10 14:00:33 2026 write: IOPS=0, BW=3564KiB/s (3649kB/s)(12.0MiB/3448msec); 0 zone resets clat (msec): min=345, max=2219, avg=1148.72, stdev=964.96 lat (msec): min=346, max=2219, avg=1149.09, stdev=964.89 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8126, max= 8175, per=85.77%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.08%, ctx=32, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146255: Thu Sep 10 14:00:33 2026 write: IOPS=0, BW=3884KiB/s (3977kB/s)(12.0MiB/3164msec); 0 zone resets clat (msec): min=490, max=1999, avg=1052.99, stdev=824.85 lat (msec): min=491, max=2001, avg=1054.09, stdev=825.10 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 5953, max= 8159, per=74.25%, avg=7056.00, stdev=1559.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.06%, sys=4.81%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4782KiB/s (4897kB/s), 1196KiB/s-3960KiB/s (1224kB/s-4055kB/s), io=16.0MiB (16.8MB), run=3103-3426msec WRITE: bw=9503KiB/s (9732kB/s), 2391KiB/s-3884KiB/s (2449kB/s-3977kB/s), io=32.0MiB (33.6MB), run=3164-3448msec