== sanity test 398b: DIO and buffer IO race ============== 20:14:41 (1788567281) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.49255 s, 6.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179647: Fri Sep 4 20:17:55 2026 read: IOPS=8, BW=35.9KiB/s (36.8kB/s)(5992KiB/166709msec) clat (usec): min=31, max=417502, avg=62602.03, stdev=46218.47 lat (usec): min=31, max=417503, avg=62605.36, stdev=46218.81 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11731], 10.00th=[ 19006], 20.00th=[ 28181], | 30.00th=[ 35390], 40.00th=[ 43779], 50.00th=[ 52167], 60.00th=[ 62129], | 70.00th=[ 74974], 80.00th=[ 91751], 90.00th=[115868], 95.00th=[145753], | 99.00th=[231736], 99.50th=[270533], 99.90th=[387974], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 116, per=25.29%, avg=35.91, stdev=17.34, samples=321 iops : min= 1, max= 29, avg= 8.33, stdev= 4.36, samples=321 write: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6296KiB/166709msec); 0 zone resets clat (usec): min=822, max=376638, avg=46169.01, stdev=51573.21 lat (usec): min=822, max=376639, avg=46173.27, stdev=51577.09 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1270], 20.00th=[ 2999], | 30.00th=[ 8094], 40.00th=[ 18482], 50.00th=[ 31327], 60.00th=[ 43254], | 70.00th=[ 56886], 80.00th=[ 81265], 90.00th=[114820], 95.00th=[145753], | 99.00th=[229639], 99.50th=[261096], 99.90th=[346031], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 6, max= 119, per=25.24%, avg=37.61, stdev=21.14, samples=322 iops : min= 1, max= 29, avg= 8.76, stdev= 5.32, samples=322 lat (usec) : 50=0.23%, 100=1.60%, 250=0.16%, 1000=0.36% lat (msec) : 2=8.07%, 4=3.26%, 10=5.14%, 20=8.04%, 50=29.98% lat (msec) : 100=27.93%, 250=14.55%, 500=0.68% cpu : usr=0.06%, sys=3.82%, ctx=6025, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179648: Fri Sep 4 20:17:55 2026 read: IOPS=8, BW=35.7KiB/s (36.5kB/s)(5940KiB/166425msec) clat (usec): min=39, max=338044, avg=61193.24, stdev=43788.92 lat (usec): min=40, max=338045, avg=61197.01, stdev=43788.22 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12125], 10.00th=[ 19530], 20.00th=[ 28181], | 30.00th=[ 35914], 40.00th=[ 43254], 50.00th=[ 51119], 60.00th=[ 60556], | 70.00th=[ 71828], 80.00th=[ 86508], 90.00th=[112722], 95.00th=[145753], | 99.00th=[221250], 99.50th=[238027], 99.90th=[299893], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 6, max= 124, per=25.33%, avg=35.97, stdev=17.14, samples=319 iops : min= 1, max= 31, avg= 8.34, stdev= 4.32, samples=319 write: IOPS=9, BW=38.1KiB/s (39.1kB/s)(6348KiB/166425msec); 0 zone resets clat (usec): min=598, max=654960, avg=47496.29, stdev=56117.27 lat (usec): min=599, max=654962, avg=47502.29, stdev=56116.65 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 2900], | 30.00th=[ 7504], 40.00th=[ 17433], 50.00th=[ 30016], 60.00th=[ 44303], | 70.00th=[ 59507], 80.00th=[ 82314], 90.00th=[120062], 95.00th=[156238], | 99.00th=[246416], 99.50th=[287310], 99.90th=[480248], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 119, per=25.34%, avg=37.75, stdev=19.93, samples=324 iops : min= 1, max= 29, avg= 8.80, stdev= 5.02, samples=324 lat (usec) : 50=0.23%, 100=1.46%, 250=0.20%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.42% lat (msec) : 2=8.24%, 4=2.99%, 10=5.53%, 20=7.49%, 50=29.82% lat (msec) : 100=29.10%, 250=13.67%, 500=0.65%, 750=0.03% cpu : usr=0.05%, sys=3.61%, ctx=6005, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179649: Fri Sep 4 20:17:55 2026 read: IOPS=8, BW=35.9KiB/s (36.7kB/s)(6028KiB/168103msec) clat (usec): min=27, max=441722, avg=61944.86, stdev=46244.78 lat (usec): min=27, max=441722, avg=61947.33, stdev=46244.53 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 8717], 10.00th=[ 19006], 20.00th=[ 27395], | 30.00th=[ 34341], 40.00th=[ 42730], 50.00th=[ 51643], 60.00th=[ 62129], | 70.00th=[ 72877], 80.00th=[ 89654], 90.00th=[114820], 95.00th=[145753], | 99.00th=[225444], 99.50th=[248513], 99.90th=[425722], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 119, per=25.43%, avg=36.11, stdev=18.61, samples=322 iops : min= 1, max= 29, avg= 8.37, stdev= 4.69, samples=322 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6260KiB/168103msec); 0 zone resets clat (usec): min=673, max=715245, avg=47629.67, stdev=55773.42 lat (usec): min=674, max=715246, avg=47638.09, stdev=55774.34 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1336], 20.00th=[ 3818], | 30.00th=[ 8717], 40.00th=[ 18482], 50.00th=[ 31851], 60.00th=[ 44303], | 70.00th=[ 60031], 80.00th=[ 80217], 90.00th=[116917], 95.00th=[149947], | 99.00th=[242222], 99.50th=[287310], 99.90th=[425722], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 119, per=24.90%, avg=37.10, stdev=20.17, samples=325 iops : min= 1, max= 29, avg= 8.62, stdev= 5.06, samples=325 lat (usec) : 50=0.29%, 100=1.73%, 250=0.10%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.33% lat (msec) : 2=7.00%, 4=3.19%, 10=5.96%, 20=7.71%, 50=29.85% lat (msec) : 100=29.04%, 250=13.93%, 500=0.65%, 750=0.03% cpu : usr=0.07%, sys=3.83%, ctx=6017, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179650: Fri Sep 4 20:17:55 2026 read: IOPS=9, BW=36.1KiB/s (36.0kB/s)(6052KiB/167564msec) clat (usec): min=34, max=438082, avg=62461.39, stdev=46498.95 lat (usec): min=34, max=438084, avg=62464.37, stdev=46498.46 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11731], 10.00th=[ 19268], 20.00th=[ 27919], | 30.00th=[ 34866], 40.00th=[ 42206], 50.00th=[ 52167], 60.00th=[ 61604], | 70.00th=[ 74974], 80.00th=[ 91751], 90.00th=[116917], 95.00th=[145753], | 99.00th=[233833], 99.50th=[287310], 99.90th=[350225], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 7, max= 99, per=25.35%, avg=36.00, stdev=17.42, samples=324 iops : min= 1, max= 24, avg= 8.35, stdev= 4.39, samples=324 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6236KiB/167564msec); 0 zone resets clat (usec): min=842, max=497331, avg=46724.78, stdev=56079.15 lat (usec): min=844, max=497334, avg=46743.84, stdev=56076.59 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 2900], | 30.00th=[ 7701], 40.00th=[ 17171], 50.00th=[ 30016], 60.00th=[ 41681], | 70.00th=[ 56361], 80.00th=[ 78119], 90.00th=[117965], 95.00th=[158335], | 99.00th=[244319], 99.50th=[308282], 99.90th=[425722], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 5, max= 109, per=25.19%, avg=37.54, stdev=19.96, samples=320 iops : min= 1, max= 27, avg= 8.74, stdev= 5.03, samples=320 lat (usec) : 50=0.33%, 100=1.53%, 250=0.26%, 500=0.03%, 1000=0.39% lat (msec) : 2=7.65%, 4=3.48%, 10=5.53%, 20=7.23%, 50=30.70% lat (msec) : 100=28.32%, 250=13.74%, 500=0.81% cpu : usr=0.06%, sys=3.70%, ctx=5995, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=143KiB/s (146kB/s), 35.7KiB/s-36.1KiB/s (36.5kB/s-36.0kB/s), io=23.4MiB (24.6MB), run=166425-168103msec WRITE: bw=150KiB/s (153kB/s), 37.2KiB/s-38.1KiB/s (38.1kB/s-39.1kB/s), io=24.6MiB (25.7MB), run=166425-168103msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179642: Fri Sep 4 20:18:58 2026 read: IOPS=6, BW=25.8KiB/s (26.5kB/s)(5992KiB/231872msec) clat (msec): min=6, max=1042, avg=59.48, stdev=62.05 lat (msec): min=6, max=1042, avg=59.48, stdev=62.05 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 85], 90.00th=[ 125], 95.00th=[ 180], | 99.00th=[ 284], 99.50th=[ 351], 99.90th=[ 567], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 103, per=26.84%, avg=27.65, stdev=20.16, samples=417 iops : min= 1, max= 25, avg= 6.25, stdev= 5.07, samples=417 write: IOPS=6, BW=27.2KiB/s (27.8kB/s)(6296KiB/231872msec); 0 zone resets clat (msec): min=12, max=606, avg=90.40, stdev=72.77 lat (msec): min=12, max=606, avg=90.40, stdev=72.77 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 54], 50.00th=[ 67], 60.00th=[ 83], | 70.00th=[ 101], 80.00th=[ 136], 90.00th=[ 188], 95.00th=[ 234], | 99.00th=[ 355], 99.50th=[ 439], 99.90th=[ 592], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 5, max= 111, per=25.53%, avg=27.57, stdev=18.39, samples=439 iops : min= 1, max= 27, avg= 6.22, stdev= 4.62, samples=439 lat (msec) : 10=0.72%, 20=9.34%, 50=38.25%, 100=28.81%, 250=20.21% lat (msec) : 500=2.47%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=4695, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179643: Fri Sep 4 20:18:58 2026 read: IOPS=6, BW=25.6KiB/s (26.3kB/s)(5940KiB/231627msec) clat (msec): min=5, max=1018, avg=60.15, stdev=64.85 lat (msec): min=5, max=1018, avg=60.15, stdev=64.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 40], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 83], 90.00th=[ 129], 95.00th=[ 180], | 99.00th=[ 305], 99.50th=[ 376], 99.90th=[ 567], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 127, per=26.83%, avg=27.63, stdev=20.24, samples=414 iops : min= 1, max= 31, avg= 6.24, stdev= 5.10, samples=414 write: IOPS=6, BW=27.4KiB/s (28.1kB/s)(6348KiB/231627msec); 0 zone resets clat (msec): min=11, max=605, avg=89.32, stdev=68.16 lat (msec): min=11, max=605, avg=89.33, stdev=68.16 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 67], 60.00th=[ 83], | 70.00th=[ 103], 80.00th=[ 133], 90.00th=[ 176], 95.00th=[ 226], | 99.00th=[ 338], 99.50th=[ 393], 99.90th=[ 451], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 88, per=25.82%, avg=27.88, stdev=18.36, samples=439 iops : min= 1, max= 22, avg= 6.31, stdev= 4.61, samples=439 lat (msec) : 10=1.27%, 20=8.53%, 50=36.59%, 100=30.50%, 250=20.35% lat (msec) : 500=2.64%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.45%, ctx=4993, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179644: Fri Sep 4 20:18:58 2026 read: IOPS=6, BW=26.1KiB/s (26.7kB/s)(6028KiB/230897msec) clat (msec): min=5, max=586, avg=61.55, stdev=59.82 lat (msec): min=5, max=586, avg=61.55, stdev=59.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 88], 90.00th=[ 136], 95.00th=[ 184], | 99.00th=[ 292], 99.50th=[ 347], 99.90th=[ 439], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 5, max= 102, per=26.62%, avg=27.42, stdev=19.71, samples=424 iops : min= 1, max= 25, avg= 6.19, stdev= 4.96, samples=424 write: IOPS=6, BW=27.1KiB/s (27.8kB/s)(6260KiB/230897msec); 0 zone resets clat (msec): min=13, max=1055, avg=87.95, stdev=71.27 lat (msec): min=13, max=1055, avg=87.95, stdev=71.27 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 38], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 65], 60.00th=[ 80], | 70.00th=[ 101], 80.00th=[ 129], 90.00th=[ 180], 95.00th=[ 218], | 99.00th=[ 342], 99.50th=[ 430], 99.90th=[ 506], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 103, per=25.50%, avg=27.54, stdev=18.85, samples=438 iops : min= 1, max= 25, avg= 6.22, stdev= 4.74, samples=438 lat (msec) : 10=0.98%, 20=8.30%, 50=37.04%, 100=30.21%, 250=21.03% lat (msec) : 500=2.34%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.31%, ctx=4739, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179645: Fri Sep 4 20:18:58 2026 read: IOPS=6, BW=26.4KiB/s (27.0kB/s)(6052KiB/229389msec) clat (msec): min=6, max=595, avg=60.38, stdev=61.43 lat (msec): min=6, max=595, avg=60.38, stdev=61.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 64], 80.00th=[ 85], 90.00th=[ 130], 95.00th=[ 188], | 99.00th=[ 296], 99.50th=[ 363], 99.90th=[ 498], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 5, max= 103, per=27.86%, avg=28.69, stdev=20.09, samples=407 iops : min= 1, max= 25, avg= 6.52, stdev= 5.06, samples=407 write: IOPS=6, BW=27.2KiB/s (27.8kB/s)(6236KiB/229389msec); 0 zone resets clat (msec): min=11, max=1056, avg=88.21, stdev=74.72 lat (msec): min=11, max=1056, avg=88.21, stdev=74.72 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 38], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 65], 60.00th=[ 79], | 70.00th=[ 99], 80.00th=[ 128], 90.00th=[ 178], 95.00th=[ 232], | 99.00th=[ 347], 99.50th=[ 393], 99.90th=[ 768], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 110, per=25.91%, avg=27.98, stdev=18.56, samples=430 iops : min= 1, max= 27, avg= 6.33, stdev= 4.67, samples=430 lat (msec) : 10=0.98%, 20=9.51%, 50=37.70%, 100=29.39%, 250=19.30% lat (msec) : 500=2.96%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=4607, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=104KiB/s (106kB/s), 25.6KiB/s-26.4KiB/s (26.3kB/s-27.0kB/s), io=23.4MiB (24.6MB), run=229389-231872msec WRITE: bw=108KiB/s (111kB/s), 27.1KiB/s-27.4KiB/s (27.8kB/s-28.1kB/s), io=24.6MiB (25.7MB), run=229389-231872msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179700: Fri Sep 4 20:19:52 2026 read: IOPS=9, BW=152KiB/s (155kB/s)(5920KiB/39043msec) clat (usec): min=34, max=288665, avg=53844.89, stdev=42031.31 lat (usec): min=34, max=288666, avg=53849.25, stdev=42028.71 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 98], 20.00th=[ 26346], | 30.00th=[ 33162], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 53740], | 70.00th=[ 62129], 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[254804], 99.50th=[283116], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 30, max= 383, per=24.69%, avg=151.13, stdev=80.95, samples=76 iops : min= 1, max= 23, avg= 8.64, stdev= 5.13, samples=76 write: IOPS=10, BW=163KiB/s (167kB/s)(6368KiB/39043msec); 0 zone resets clat (usec): min=1028, max=287059, avg=47274.31, stdev=47914.08 lat (usec): min=1029, max=287059, avg=47276.74, stdev=47913.80 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1942], 10.00th=[ 3032], 20.00th=[ 6915], | 30.00th=[ 11600], 40.00th=[ 21627], 50.00th=[ 32637], 60.00th=[ 43779], | 70.00th=[ 64750], 80.00th=[ 85459], 90.00th=[110625], 95.00th=[139461], | 99.00th=[227541], 99.50th=[263193], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 24, max= 383, per=25.42%, avg=163.71, stdev=78.63, samples=76 iops : min= 1, max= 23, avg= 9.43, stdev= 4.93, samples=76 lat (usec) : 50=0.52%, 100=4.30%, 250=0.26%, 750=0.13% lat (msec) : 2=2.99%, 4=3.52%, 10=7.16%, 20=7.94%, 50=32.81% lat (msec) : 100=29.30%, 250=10.29%, 500=0.78% cpu : usr=0.05%, sys=4.01%, ctx=1504, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179702: Fri Sep 4 20:19:52 2026 read: IOPS=9, BW=147KiB/s (150kB/s)(5744KiB/39097msec) clat (usec): min=38, max=444598, avg=60099.76, stdev=45785.99 lat (usec): min=38, max=444600, avg=60101.01, stdev=45786.02 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 69], 10.00th=[ 15270], 20.00th=[ 26346], | 30.00th=[ 34866], 40.00th=[ 43254], 50.00th=[ 52167], 60.00th=[ 63177], | 70.00th=[ 76022], 80.00th=[ 89654], 90.00th=[111674], 95.00th=[131597], | 99.00th=[233833], 99.50th=[252707], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 31, max= 316, per=23.79%, avg=145.58, stdev=61.87, samples=76 iops : min= 1, max= 19, avg= 8.30, stdev= 3.91, samples=76 write: IOPS=10, BW=167KiB/s (171kB/s)(6544KiB/39097msec); 0 zone resets clat (usec): min=1231, max=335227, avg=42518.17, stdev=46928.49 lat (usec): min=1232, max=335229, avg=42521.47, stdev=46928.77 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1762], 10.00th=[ 2442], 20.00th=[ 5473], | 30.00th=[ 10159], 40.00th=[ 17957], 50.00th=[ 27657], 60.00th=[ 39584], | 70.00th=[ 51643], 80.00th=[ 76022], 90.00th=[101188], 95.00th=[129500], | 99.00th=[198181], 99.50th=[235930], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 31, max= 606, per=25.67%, avg=165.30, stdev=98.00, samples=76 iops : min= 1, max= 37, avg= 9.54, stdev= 6.21, samples=76 lat (usec) : 50=0.65%, 100=2.73%, 250=0.26%, 500=0.26% lat (msec) : 2=4.30%, 4=4.17%, 10=7.55%, 20=9.64%, 50=29.04% lat (msec) : 100=29.30%, 250=11.46%, 500=0.65% cpu : usr=0.08%, sys=4.39%, ctx=1625, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179704: Fri Sep 4 20:19:52 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6256KiB/38199msec) clat (usec): min=25, max=196465, avg=56652.50, stdev=38233.19 lat (usec): min=25, max=196466, avg=56653.77, stdev=38233.22 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 67], 10.00th=[ 15270], 20.00th=[ 27657], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 49021], 60.00th=[ 60031], | 70.00th=[ 71828], 80.00th=[ 87557], 90.00th=[108528], 95.00th=[130548], | 99.00th=[173016], 99.50th=[189793], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 23, max= 432, per=26.87%, avg=164.43, stdev=83.87, samples=75 iops : min= 1, max= 27, avg= 9.48, stdev= 5.31, samples=75 write: IOPS=9, BW=158KiB/s (162kB/s)(6032KiB/38199msec); 0 zone resets clat (usec): min=1049, max=221726, avg=41471.51, stdev=44222.69 lat (usec): min=1050, max=221728, avg=41476.58, stdev=44228.85 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1713], 10.00th=[ 2089], 20.00th=[ 5014], | 30.00th=[ 9896], 40.00th=[ 16057], 50.00th=[ 26608], 60.00th=[ 36963], | 70.00th=[ 51643], 80.00th=[ 72877], 90.00th=[104334], 95.00th=[135267], | 99.00th=[206570], 99.50th=[208667], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 479, per=24.71%, avg=159.14, stdev=87.41, samples=74 iops : min= 1, max= 29, avg= 9.15, stdev= 5.48, samples=74 lat (usec) : 50=0.65%, 100=3.78%, 250=0.13%, 500=0.26% lat (msec) : 2=4.43%, 4=3.65%, 10=6.90%, 20=7.68%, 50=32.16% lat (msec) : 100=27.99%, 250=12.37% cpu : usr=0.05%, sys=4.25%, ctx=1543, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179706: Fri Sep 4 20:19:52 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37645msec) clat (usec): min=39, max=343843, avg=54639.73, stdev=45615.46 lat (usec): min=40, max=343844, avg=54643.64, stdev=45613.25 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 93], 20.00th=[ 24249], | 30.00th=[ 31065], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 77071], 90.00th=[109577], 95.00th=[143655], | 99.00th=[227541], 99.50th=[233833], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 23, max= 380, per=26.39%, avg=161.51, stdev=78.01, samples=72 iops : min= 1, max= 23, avg= 9.31, stdev= 4.94, samples=72 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37645msec); 0 zone resets clat (usec): min=1180, max=288951, avg=42560.16, stdev=44019.94 lat (usec): min=1183, max=288953, avg=42564.85, stdev=44018.28 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1713], 10.00th=[ 1942], 20.00th=[ 4686], | 30.00th=[ 9110], 40.00th=[ 17695], 50.00th=[ 30278], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[132645], | 99.00th=[185598], 99.50th=[233833], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 62, max= 447, per=25.63%, avg=165.05, stdev=75.78, samples=73 iops : min= 3, max= 27, avg= 9.52, stdev= 4.74, samples=73 lat (usec) : 50=0.65%, 100=4.56%, 250=0.26%, 500=0.26% lat (msec) : 2=5.73%, 4=3.91%, 10=6.12%, 20=8.20%, 50=30.86% lat (msec) : 100=28.39%, 250=10.81%, 500=0.26% cpu : usr=0.05%, sys=4.49%, ctx=1514, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=613KiB/s (627kB/s), 147KiB/s-164KiB/s (150kB/s-168kB/s), io=23.4MiB (24.5MB), run=37645-39097msec WRITE: bw=645KiB/s (660kB/s), 158KiB/s-167KiB/s (162kB/s-171kB/s), io=24.6MiB (25.8MB), run=37645-39097msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179701: Fri Sep 4 20:20:10 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(5920KiB/56937msec) clat (msec): min=7, max=394, avg=58.65, stdev=49.43 lat (msec): min=7, max=394, avg=58.65, stdev=49.43 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 83], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 234], 99.50th=[ 330], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 351, per=25.46%, avg=106.17, stdev=69.07, samples=109 iops : min= 1, max= 21, avg= 5.83, stdev= 4.42, samples=109 write: IOPS=6, BW=112KiB/s (115kB/s)(6368KiB/56937msec); 0 zone resets clat (msec): min=19, max=308, avg=87.45, stdev=53.99 lat (msec): min=19, max=308, avg=87.45, stdev=53.99 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 44], | 30.00th=[ 52], 40.00th=[ 61], 50.00th=[ 72], 60.00th=[ 83], | 70.00th=[ 103], 80.00th=[ 129], 90.00th=[ 165], 95.00th=[ 194], | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 320, per=25.86%, avg=113.53, stdev=60.37, samples=110 iops : min= 1, max= 20, avg= 6.29, stdev= 3.87, samples=110 lat (msec) : 10=0.52%, 20=5.86%, 50=35.55%, 100=34.77%, 250=22.01% lat (msec) : 500=1.30% cpu : usr=0.04%, sys=1.32%, ctx=1151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179703: Fri Sep 4 20:20:10 2026 read: IOPS=6, BW=100KiB/s (103kB/s)(5744KiB/57196msec) clat (msec): min=10, max=330, avg=57.84, stdev=47.25 lat (msec): min=10, max=330, avg=57.84, stdev=47.25 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 86], 90.00th=[ 127], 95.00th=[ 157], | 99.00th=[ 228], 99.50th=[ 284], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 23, max= 381, per=25.53%, avg=106.47, stdev=70.21, samples=105 iops : min= 1, max= 23, avg= 5.85, stdev= 4.49, samples=105 write: IOPS=7, BW=114KiB/s (117kB/s)(6544KiB/57196msec); 0 zone resets clat (msec): min=18, max=343, avg=88.38, stdev=60.01 lat (msec): min=18, max=343, avg=88.38, stdev=60.01 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 36], 20.00th=[ 43], | 30.00th=[ 51], 40.00th=[ 62], 50.00th=[ 71], 60.00th=[ 83], | 70.00th=[ 99], 80.00th=[ 123], 90.00th=[ 169], 95.00th=[ 222], | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 288, per=25.86%, avg=113.54, stdev=61.69, samples=112 iops : min= 1, max= 18, avg= 6.29, stdev= 3.94, samples=112 lat (msec) : 20=6.38%, 50=36.07%, 100=35.94%, 250=19.79%, 500=1.82% cpu : usr=0.03%, sys=1.39%, ctx=1179, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179705: Fri Sep 4 20:20:10 2026 read: IOPS=6, BW=109KiB/s (112kB/s)(6256KiB/57309msec) clat (msec): min=8, max=546, avg=61.58, stdev=55.79 lat (msec): min=8, max=546, avg=61.58, stdev=55.79 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 65], 80.00th=[ 88], 90.00th=[ 123], 95.00th=[ 159], | 99.00th=[ 284], 99.50th=[ 338], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 414, per=27.48%, avg=114.61, stdev=74.55, samples=107 iops : min= 1, max= 25, avg= 6.36, stdev= 4.73, samples=107 write: IOPS=6, BW=105KiB/s (108kB/s)(6032KiB/57309msec); 0 zone resets clat (msec): min=17, max=444, avg=87.04, stdev=59.42 lat (msec): min=17, max=444, avg=87.04, stdev=59.42 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 34], 20.00th=[ 43], | 30.00th=[ 52], 40.00th=[ 61], 50.00th=[ 69], 60.00th=[ 82], | 70.00th=[ 102], 80.00th=[ 124], 90.00th=[ 163], 95.00th=[ 213], | 99.00th=[ 292], 99.50th=[ 334], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 24, max= 288, per=23.79%, avg=104.43, stdev=57.93, samples=111 iops : min= 1, max= 18, avg= 5.72, stdev= 3.69, samples=111 lat (msec) : 10=0.52%, 20=5.99%, 50=35.94%, 100=33.85%, 250=21.88% lat (msec) : 500=1.69%, 750=0.13% cpu : usr=0.04%, sys=1.32%, ctx=1178, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179707: Fri Sep 4 20:20:10 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55788msec) clat (msec): min=7, max=282, avg=59.93, stdev=46.86 lat (msec): min=7, max=282, avg=59.94, stdev=46.86 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 90], 90.00th=[ 117], 95.00th=[ 165], | 99.00th=[ 224], 99.50th=[ 257], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 384, per=26.86%, avg=112.02, stdev=62.18, samples=104 iops : min= 1, max= 24, avg= 6.19, stdev= 3.98, samples=104 write: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55788msec); 0 zone resets clat (msec): min=18, max=445, avg=84.72, stdev=59.69 lat (msec): min=18, max=445, avg=84.72, stdev=59.69 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 57], 50.00th=[ 68], 60.00th=[ 82], | 70.00th=[ 96], 80.00th=[ 116], 90.00th=[ 159], 95.00th=[ 201], | 99.00th=[ 330], 99.50th=[ 376], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 349, per=25.88%, avg=113.62, stdev=63.61, samples=107 iops : min= 1, max= 21, avg= 6.30, stdev= 4.05, samples=107 lat (msec) : 10=0.52%, 20=4.56%, 50=41.15%, 100=31.12%, 250=21.09% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.44%, ctx=1217, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=418KiB/s (428kB/s), 100KiB/s-109KiB/s (103kB/s-112kB/s), io=23.4MiB (24.5MB), run=55788-57309msec WRITE: bw=440KiB/s (450kB/s), 105KiB/s-114KiB/s (108kB/s-117kB/s), io=24.6MiB (25.8MB), run=55788-57309msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179724: Fri Sep 4 20:20:38 2026 read: IOPS=1, BW=1121KiB/s (1148kB/s)(7168KiB/6393msec) clat (msec): min=102, max=688, avg=399.96, stdev=212.46 lat (msec): min=102, max=688, avg=399.96, stdev=212.46 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 161], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 460], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 558], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1492, max= 3968, per=100.00%, avg=2294.80, stdev=961.38, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=801KiB/s (820kB/s)(5120KiB/6393msec); 0 zone resets clat (msec): min=177, max=1710, avg=706.03, stdev=627.01 lat (msec): min=177, max=1710, avg=706.11, stdev=627.01 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1796, max= 6119, per=100.00%, avg=3312.67, stdev=2433.00, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.65%, ctx=229, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179725: Fri Sep 4 20:20:38 2026 read: IOPS=0, BW=223KiB/s (228kB/s)(2048KiB/9203msec) clat (usec): min=694, max=1824.0k, avg=912349.30, stdev=1289274.92 lat (usec): min=695, max=1824.0k, avg=912351.08, stdev=1289275.87 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], | 20.00th=[ 693], 30.00th=[ 693], 40.00th=[ 693], | 50.00th=[ 693], 60.00th=[1820328], 70.00th=[1820328], | 80.00th=[1820328], 90.00th=[1820328], 95.00th=[1820328], | 99.00th=[1820328], 99.50th=[1820328], 99.90th=[1820328], | 99.95th=[1820328], 99.99th=[1820328] bw ( KiB/s): min= 1969, max= 1984, per=88.83%, avg=1976.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1113KiB/s (1139kB/s)(10.0MiB/9203msec); 0 zone resets clat (msec): min=195, max=2909, avg=702.08, stdev=804.50 lat (msec): min=195, max=2909, avg=702.18, stdev=804.48 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 236], | 30.00th=[ 338], 40.00th=[ 384], 50.00th=[ 409], 60.00th=[ 426], | 70.00th=[ 514], 80.00th=[ 709], 90.00th=[ 911], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1750, max= 4096, per=82.26%, avg=2562.29, stdev=1046.24, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.77%, ctx=125, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179726: Fri Sep 4 20:20:38 2026 read: IOPS=0, BW=1009KiB/s (1034kB/s)(6144KiB/6087msec) clat (usec): min=390, max=502413, avg=248626.46, stdev=238043.33 lat (usec): min=390, max=502414, avg=248627.44, stdev=238043.34 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 392], 10.00th=[ 392], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[104334], 50.00th=[104334], 60.00th=[438305], | 70.00th=[446694], 80.00th=[446694], 90.00th=[501220], 95.00th=[501220], | 99.00th=[501220], 99.50th=[501220], 99.90th=[501220], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 1750, max= 4079, per=100.00%, avg=2451.25, stdev=1090.96, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=1009KiB/s (1034kB/s)(6144KiB/6087msec); 0 zone resets clat (msec): min=232, max=1646, avg=714.90, stdev=497.14 lat (msec): min=232, max=1646, avg=714.98, stdev=497.12 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 600], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1796, max= 2039, per=63.52%, avg=1978.67, stdev=90.96, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=16.67%, 500=25.00%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.91%, ctx=119, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179727: Fri Sep 4 20:20:38 2026 read: IOPS=0, BW=793KiB/s (812kB/s)(5120KiB/6453msec) clat (usec): min=511, max=1168.2k, avg=329711.86, stdev=509653.88 lat (usec): min=512, max=1168.2k, avg=329713.25, stdev=509654.00 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], | 20.00th=[ 510], 30.00th=[ 3851], 40.00th=[ 3851], | 50.00th=[ 9372], 60.00th=[ 9372], 70.00th=[ 467665], | 80.00th=[ 467665], 90.00th=[1166017], 95.00th=[1166017], | 99.00th=[1166017], 99.50th=[1166017], 99.90th=[1166017], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1111KiB/s (1137kB/s)(7168KiB/6453msec); 0 zone resets clat (msec): min=370, max=1175, avg=658.83, stdev=363.05 lat (msec): min=370, max=1175, avg=661.06, stdev=361.64 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 380], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 443], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 1167], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1698, max= 2027, per=60.86%, avg=1895.71, stdev=141.87, samples=7 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=7 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=8.33%, 500=41.67%, 750=8.33%, 2000=25.00% cpu : usr=0.00%, sys=5.69%, ctx=134, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2225KiB/s (2279kB/s), 223KiB/s-1121KiB/s (228kB/s-1148kB/s), io=20.0MiB (20.0MB), run=6087-9203msec WRITE: bw=3116KiB/s (3190kB/s), 801KiB/s-1113KiB/s (820kB/s-1139kB/s), io=28.0MiB (29.4MB), run=6087-9203msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179729: Fri Sep 4 20:20:38 2026 read: IOPS=0, BW=798KiB/s (817kB/s)(7168KiB/8983msec) clat (msec): min=198, max=3502, avg=866.71, stdev=1183.53 lat (msec): min=198, max=3502, avg=866.71, stdev=1183.53 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 215], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 468], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 827], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1434, max= 2039, per=82.01%, avg=1869.00, stdev=226.83, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=570KiB/s (584kB/s)(5120KiB/8983msec); 0 zone resets clat (msec): min=344, max=775, avg=555.59, stdev=182.25 lat (msec): min=344, max=775, avg=555.69, stdev=182.25 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1899, max= 2031, per=61.34%, avg=1957.25, stdev=66.53, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=16.67%, 500=33.33%, 750=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.53%, ctx=72, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179730: Fri Sep 4 20:20:38 2026 read: IOPS=0, BW=235KiB/s (240kB/s)(2048KiB/8723msec) clat (msec): min=126, max=1136, avg=631.58, stdev=714.74 lat (msec): min=126, max=1136, avg=631.58, stdev=714.74 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 127], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1787, max= 2031, per=83.76%, avg=1909.00, stdev=172.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1174KiB/s (1202kB/s)(10.0MiB/8723msec); 0 zone resets clat (msec): min=183, max=2426, avg=721.51, stdev=659.53 lat (msec): min=184, max=2426, avg=721.60, stdev=659.52 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 275], | 30.00th=[ 330], 40.00th=[ 342], 50.00th=[ 485], 60.00th=[ 550], | 70.00th=[ 684], 80.00th=[ 885], 90.00th=[ 1053], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1828, max= 3992, per=69.18%, avg=2207.38, stdev=725.21, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.43%, ctx=143, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179731: Fri Sep 4 20:20:38 2026 read: IOPS=0, BW=700KiB/s (717kB/s)(6144KiB/8775msec) clat (msec): min=117, max=700, avg=382.39, stdev=239.01 lat (msec): min=117, max=700, avg=382.39, stdev=239.01 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 531], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1861, max= 4023, per=100.00%, avg=2456.25, stdev=1045.78, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=700KiB/s (717kB/s)(6144KiB/8775msec); 0 zone resets clat (msec): min=234, max=3630, avg=1052.57, stdev=1274.54 lat (msec): min=235, max=3637, avg=1053.96, stdev=1277.54 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 625], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1793, max= 2039, per=61.31%, avg=1956.50, stdev=87.87, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 750=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.77%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179732: Fri Sep 4 20:20:38 2026 read: IOPS=0, BW=617KiB/s (632kB/s)(5120KiB/8294msec) clat (msec): min=185, max=556, avg=307.07, stdev=152.82 lat (msec): min=185, max=556, avg=307.08, stdev=152.82 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2031, max= 3992, per=100.00%, avg=2687.33, stdev=1129.88, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=864KiB/s (885kB/s)(7168KiB/8294msec); 0 zone resets clat (msec): min=159, max=3822, avg=915.17, stdev=1301.63 lat (msec): min=159, max=3822, avg=915.32, stdev=1301.63 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 326], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 388], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 885], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1756, max= 1946, per=59.14%, avg=1887.20, stdev=75.94, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.64%, ctx=101, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2280KiB/s (2335kB/s), 235KiB/s-798KiB/s (240kB/s-817kB/s), io=20.0MiB (20.0MB), run=8294-8983msec WRITE: bw=3192KiB/s (3268kB/s), 570KiB/s-1174KiB/s (584kB/s-1202kB/s), io=28.0MiB (29.4MB), run=8294-8983msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179739: Fri Sep 4 20:20:57 2026 read: IOPS=1, BW=4757KiB/s (4871kB/s)(12.0MiB/2583msec) clat (msec): min=253, max=1736, avg=844.13, stdev=786.05 lat (msec): min=253, max=1736, avg=844.13, stdev=786.05 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 5565, max= 7984, per=100.00%, avg=6774.50, stdev=1710.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.29%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Fri Sep 4 20:20:57 2026 read: IOPS=0, BW=1319KiB/s (1350kB/s)(4096KiB/3106msec) clat (nsec): min=681720k, max=681720k, avg=681720122.00, stdev= 0.00 lat (nsec): min=681723k, max=681723k, avg=681722694.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2637KiB/s (2701kB/s)(8192KiB/3106msec); 0 zone resets clat (msec): min=1145, max=1208, avg=1176.93, stdev=44.20 lat (msec): min=1146, max=1208, avg=1177.32, stdev=44.19 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.51%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179741: Fri Sep 4 20:20:57 2026 write: IOPS=0, BW=2852KiB/s (2920kB/s)(12.0MiB/4309msec); 0 zone resets clat (msec): min=328, max=2133, avg=1379.37, stdev=938.38 lat (msec): min=331, max=2136, avg=1381.27, stdev=938.02 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 6907, max= 8143, per=98.96%, avg=7525.00, stdev=873.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=3.32%, ctx=53, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Fri Sep 4 20:20:57 2026 write: IOPS=0, BW=3839KiB/s (3931kB/s)(12.0MiB/3201msec); 0 zone resets clat (msec): min=587, max=1699, avg=1015.34, stdev=599.00 lat (msec): min=592, max=1700, avg=1017.07, stdev=597.57 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7816, max= 7984, per=100.00%, avg=7900.00, stdev=118.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.09%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5275KiB/s (5402kB/s), 1319KiB/s-4757KiB/s (1350kB/s-4871kB/s), io=16.0MiB (16.8MB), run=2583-3106msec WRITE: bw=7605KiB/s (7787kB/s), 2637KiB/s-3839KiB/s (2701kB/s-3931kB/s), io=32.0MiB (33.6MB), run=3106-4309msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179744: Fri Sep 4 20:20:58 2026 read: IOPS=0, BW=3862KiB/s (3954kB/s)(12.0MiB/3182msec) clat (msec): min=828, max=1130, avg=1020.89, stdev=167.08 lat (msec): min=828, max=1130, avg=1020.89, stdev=167.08 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.97%, ctx=274, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179745: Fri Sep 4 20:20:58 2026 read: IOPS=0, BW=1094KiB/s (1120kB/s)(4096KiB/3744msec) clat (nsec): min=907850k, max=907850k, avg=907850325.00, stdev= 0.00 lat (nsec): min=907853k, max=907853k, avg=907852610.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7641, max= 7641, per=100.00%, avg=7641.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2188KiB/s (2241kB/s)(8192KiB/3744msec); 0 zone resets clat (msec): min=1202, max=1468, avg=1335.44, stdev=188.07 lat (msec): min=1202, max=1474, avg=1338.55, stdev=191.96 clat percentiles (msec): | 1.00th=[ 1200], 5.00th=[ 1200], 10.00th=[ 1200], 20.00th=[ 1200], | 30.00th=[ 1200], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.31%, ctx=151, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179747: Fri Sep 4 20:20:58 2026 write: IOPS=0, BW=3019KiB/s (3092kB/s)(12.0MiB/4070msec); 0 zone resets clat (msec): min=203, max=2062, avg=1296.11, stdev=971.72 lat (msec): min=203, max=2062, avg=1296.47, stdev=971.76 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.56%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179748: Fri Sep 4 20:20:58 2026 write: IOPS=0, BW=3746KiB/s (3836kB/s)(12.0MiB/3280msec); 0 zone resets clat (msec): min=276, max=1510, avg=1065.54, stdev=684.77 lat (msec): min=277, max=1512, avg=1066.77, stdev=685.51 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.74%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4376KiB/s (4481kB/s), 1094KiB/s-3862KiB/s (1120kB/s-3954kB/s), io=16.0MiB (16.8MB), run=3182-3744msec WRITE: bw=8051KiB/s (8244kB/s), 2188KiB/s-3746KiB/s (2241kB/s-3836kB/s), io=32.0MiB (33.6MB), run=3280-4070msec