== sanity test 398b: DIO and buffer IO race ============== 21:19:02 (1788916742) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.48673 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153158: Tue Sep 8 21:21:52 2026 read: IOPS=9, BW=39.8KiB/s (40.8kB/s)(5992KiB/150521msec) clat (usec): min=28, max=376456, avg=50162.59, stdev=41795.80 lat (usec): min=29, max=376458, avg=50166.49, stdev=41794.71 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 110], 20.00th=[ 20055], | 30.00th=[ 27395], 40.00th=[ 33424], 50.00th=[ 40633], 60.00th=[ 50594], | 70.00th=[ 62129], 80.00th=[ 77071], 90.00th=[ 99091], 95.00th=[124257], | 99.00th=[204473], 99.50th=[244319], 99.90th=[358613], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 142, per=24.93%, avg=39.63, stdev=19.33, samples=293 iops : min= 1, max= 35, avg= 9.26, stdev= 4.85, samples=293 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6296KiB/150521msec); 0 zone resets clat (usec): min=996, max=723177, avg=47568.06, stdev=52913.94 lat (usec): min=996, max=723180, avg=47571.35, stdev=52914.41 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1303], 10.00th=[ 1795], 20.00th=[ 4424], | 30.00th=[ 9765], 40.00th=[ 21365], 50.00th=[ 33817], 60.00th=[ 46924], | 70.00th=[ 61604], 80.00th=[ 81265], 90.00th=[110625], 95.00th=[145753], | 99.00th=[227541], 99.50th=[258999], 99.90th=[467665], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 119, per=25.10%, avg=41.92, stdev=19.84, samples=291 iops : min= 1, max= 29, avg= 9.82, stdev= 5.00, samples=291 lat (usec) : 50=0.26%, 100=4.43%, 250=0.52%, 500=0.16%, 750=0.23% lat (usec) : 1000=0.10% lat (msec) : 2=5.83%, 4=3.81%, 10=6.09%, 20=8.43%, 50=31.15% lat (msec) : 100=27.73%, 250=10.74%, 500=0.49%, 750=0.03% cpu : usr=0.07%, sys=4.84%, ctx=6676, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153159: Tue Sep 8 21:21:52 2026 read: IOPS=10, BW=40.2KiB/s (41.2kB/s)(5940KiB/147639msec) clat (usec): min=28, max=431112, avg=49466.35, stdev=42249.79 lat (usec): min=28, max=431113, avg=49469.11, stdev=42249.75 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 128], 20.00th=[ 20841], | 30.00th=[ 27657], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[121111], | 99.00th=[204473], 99.50th=[278922], 99.90th=[379585], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 5, max= 110, per=25.30%, avg=40.22, stdev=20.01, samples=287 iops : min= 1, max= 27, avg= 9.40, stdev= 5.04, samples=287 write: IOPS=10, BW=42.0KiB/s (44.0kB/s)(6348KiB/147639msec); 0 zone resets clat (usec): min=924, max=738936, avg=46430.79, stdev=52471.25 lat (usec): min=924, max=738938, avg=46439.30, stdev=52467.43 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1745], 20.00th=[ 4424], | 30.00th=[ 8848], 40.00th=[ 20579], 50.00th=[ 33817], 60.00th=[ 46400], | 70.00th=[ 59507], 80.00th=[ 79168], 90.00th=[110625], 95.00th=[139461], | 99.00th=[204473], 99.50th=[254804], 99.90th=[488637], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 5, max= 95, per=25.50%, avg=42.59, stdev=19.86, samples=289 iops : min= 1, max= 23, avg= 9.99, stdev= 4.97, samples=289 lat (usec) : 50=0.39%, 100=4.07%, 250=0.55%, 500=0.13%, 1000=0.07% lat (msec) : 2=5.99%, 4=4.00%, 10=6.61%, 20=7.71%, 50=32.88% lat (msec) : 100=26.56%, 250=10.42%, 500=0.59%, 750=0.03% cpu : usr=0.08%, sys=4.86%, ctx=6411, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153160: Tue Sep 8 21:21:52 2026 read: IOPS=10, BW=40.1KiB/s (41.0kB/s)(6028KiB/150372msec) clat (usec): min=33, max=577695, avg=49012.56, stdev=41838.11 lat (usec): min=34, max=577696, avg=49015.40, stdev=41840.06 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 151], 20.00th=[ 20317], | 30.00th=[ 27132], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[191890], 99.50th=[219153], 99.90th=[446694], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 103, per=25.36%, avg=40.32, stdev=20.52, samples=291 iops : min= 1, max= 25, avg= 9.43, stdev= 5.16, samples=291 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6260KiB/150372msec); 0 zone resets clat (usec): min=918, max=774738, avg=48591.84, stdev=57084.51 lat (usec): min=920, max=774741, avg=48595.62, stdev=57083.80 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 1631], 20.00th=[ 3752], | 30.00th=[ 8586], 40.00th=[ 19792], 50.00th=[ 33817], 60.00th=[ 45876], | 70.00th=[ 61604], 80.00th=[ 83362], 90.00th=[116917], 95.00th=[147850], | 99.00th=[242222], 99.50th=[265290], 99.90th=[549454], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 6, max= 126, per=24.99%, avg=41.73, stdev=20.09, samples=292 iops : min= 1, max= 31, avg= 9.78, stdev= 5.04, samples=292 lat (usec) : 50=0.39%, 100=4.10%, 250=0.59%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=6.25%, 4=4.65%, 10=5.73%, 20=8.07%, 50=31.80% lat (msec) : 100=26.86%, 250=10.74%, 500=0.39%, 750=0.10%, 1000=0.03% cpu : usr=0.07%, sys=4.56%, ctx=6447, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153162: Tue Sep 8 21:21:52 2026 read: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6052KiB/149715msec) clat (usec): min=33, max=467791, avg=49064.02, stdev=43872.18 lat (usec): min=34, max=467793, avg=49065.59, stdev=43872.65 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 66], 10.00th=[ 94], 20.00th=[ 19792], | 30.00th=[ 26346], 40.00th=[ 32900], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[210764], 99.50th=[299893], 99.90th=[367002], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 119, per=25.63%, avg=40.75, stdev=20.71, samples=288 iops : min= 1, max= 29, avg= 9.53, stdev= 5.18, samples=288 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6236KiB/149715msec); 0 zone resets clat (usec): min=925, max=890725, avg=48093.26, stdev=54562.58 lat (usec): min=927, max=890727, avg=48097.50, stdev=54562.63 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 1663], 20.00th=[ 4293], | 30.00th=[ 9241], 40.00th=[ 20317], 50.00th=[ 34866], 60.00th=[ 47973], | 70.00th=[ 61604], 80.00th=[ 83362], 90.00th=[113771], 95.00th=[141558], | 99.00th=[221250], 99.50th=[265290], 99.90th=[404751], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 134, per=25.20%, avg=42.08, stdev=21.13, samples=287 iops : min= 1, max= 33, avg= 9.86, stdev= 5.32, samples=287 lat (usec) : 50=0.62%, 100=4.56%, 250=0.59%, 500=0.16%, 750=0.13% lat (usec) : 1000=0.16% lat (msec) : 2=5.86%, 4=3.84%, 10=6.02%, 20=8.17%, 50=31.32% lat (msec) : 100=27.64%, 250=10.29%, 500=0.62%, 1000=0.03% cpu : usr=0.07%, sys=4.63%, ctx=6561, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=160KiB/s (163kB/s), 39.8KiB/s-40.4KiB/s (40.8kB/s-41.4kB/s), io=23.4MiB (24.6MB), run=147639-150521msec WRITE: bw=167KiB/s (171kB/s), 41.6KiB/s-42.0KiB/s (42.6kB/s-44.0kB/s), io=24.6MiB (25.7MB), run=147639-150521msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153163: Tue Sep 8 21:24:09 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(5992KiB/286856msec) clat (msec): min=6, max=1052, avg=40.97, stdev=54.53 lat (msec): min=6, max=1052, avg=40.98, stdev=54.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 83], 95.00th=[ 118], | 99.00th=[ 253], 99.50th=[ 296], 99.90th=[ 869], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 88, per=29.03%, avg=24.10, stdev=16.33, samples=480 iops : min= 1, max= 22, avg= 5.39, stdev= 4.14, samples=480 write: IOPS=5, BW=21.9KiB/s (22.5kB/s)(6296KiB/286856msec); 0 zone resets clat (msec): min=35, max=761, avg=143.03, stdev=81.41 lat (msec): min=35, max=761, avg=143.03, stdev=81.41 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 108], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 188], 90.00th=[ 245], 95.00th=[ 305], | 99.00th=[ 447], 99.50th=[ 493], 99.90th=[ 642], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 48, per=25.24%, avg=21.95, stdev=10.67, samples=551 iops : min= 1, max= 12, avg= 4.85, stdev= 2.74, samples=551 lat (msec) : 10=2.64%, 20=15.01%, 50=20.54%, 100=24.41%, 250=32.16% lat (msec) : 500=4.92%, 750=0.23%, 1000=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.13%, ctx=5277, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153164: Tue Sep 8 21:24:09 2026 read: IOPS=5, BW=20.7KiB/s (21.2kB/s)(5940KiB/287572msec) clat (msec): min=6, max=567, avg=42.09, stdev=46.07 lat (msec): min=6, max=567, avg=42.09, stdev=46.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 88], 95.00th=[ 129], | 99.00th=[ 226], 99.50th=[ 279], 99.90th=[ 485], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 94, per=28.58%, avg=23.72, stdev=16.19, samples=482 iops : min= 1, max= 23, avg= 5.30, stdev= 4.11, samples=482 write: IOPS=5, BW=22.1KiB/s (22.6kB/s)(6348KiB/287572msec); 0 zone resets clat (msec): min=35, max=758, avg=141.53, stdev=78.39 lat (msec): min=35, max=758, avg=141.53, stdev=78.39 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 241], 95.00th=[ 296], | 99.00th=[ 418], 99.50th=[ 493], 99.90th=[ 676], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 48, per=25.42%, avg=22.12, stdev=10.89, samples=551 iops : min= 1, max= 12, avg= 4.89, stdev= 2.78, samples=551 lat (msec) : 10=2.05%, 20=15.53%, 50=19.47%, 100=25.39%, 250=32.52% lat (msec) : 500=4.82%, 750=0.20%, 1000=0.03% cpu : usr=0.04%, sys=1.14%, ctx=5358, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153165: Tue Sep 8 21:24:09 2026 read: IOPS=5, BW=20.0KiB/s (21.5kB/s)(6028KiB/287367msec) clat (msec): min=5, max=494, avg=41.83, stdev=45.23 lat (msec): min=5, max=494, avg=41.84, stdev=45.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 85], 95.00th=[ 124], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 489], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 103, per=28.65%, avg=23.78, stdev=15.68, samples=489 iops : min= 1, max= 25, avg= 5.31, stdev= 3.95, samples=489 write: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6260KiB/287367msec); 0 zone resets clat (msec): min=41, max=802, avg=143.08, stdev=83.10 lat (msec): min=41, max=802, avg=143.08, stdev=83.10 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 106], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 190], 90.00th=[ 247], 95.00th=[ 305], | 99.00th=[ 443], 99.50th=[ 518], 99.90th=[ 701], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 56, per=25.13%, avg=21.87, stdev=11.23, samples=550 iops : min= 1, max= 14, avg= 4.83, stdev= 2.88, samples=550 lat (msec) : 10=1.69%, 20=14.23%, 50=21.74%, 100=25.29%, 250=31.90% lat (msec) : 500=4.82%, 750=0.29%, 1000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5288, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153166: Tue Sep 8 21:24:09 2026 read: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6052KiB/286526msec) clat (msec): min=5, max=408, avg=41.24, stdev=44.01 lat (msec): min=5, max=408, avg=41.24, stdev=44.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 94], 95.00th=[ 129], | 99.00th=[ 215], 99.50th=[ 268], 99.90th=[ 376], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 111, per=29.10%, avg=24.15, stdev=17.19, samples=483 iops : min= 1, max= 27, avg= 5.41, stdev= 4.35, samples=483 write: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6236KiB/286526msec); 0 zone resets clat (msec): min=35, max=874, avg=143.59, stdev=81.30 lat (msec): min=35, max=874, avg=143.60, stdev=81.30 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 247], 95.00th=[ 305], | 99.00th=[ 439], 99.50th=[ 510], 99.90th=[ 726], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 48, per=25.06%, avg=21.81, stdev=10.87, samples=549 iops : min= 1, max= 12, avg= 4.81, stdev= 2.79, samples=549 lat (msec) : 10=2.60%, 20=15.66%, 50=20.08%, 100=23.60%, 250=33.01% lat (msec) : 500=4.75%, 750=0.26%, 1000=0.03% cpu : usr=0.04%, sys=1.14%, ctx=5312, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=83.5KiB/s (85.5kB/s), 20.7KiB/s-21.1KiB/s (21.2kB/s-21.6kB/s), io=23.4MiB (24.6MB), run=286526-287572msec WRITE: bw=87.4KiB/s (89.5kB/s), 21.8KiB/s-22.1KiB/s (22.3kB/s-22.6kB/s), io=24.6MiB (25.7MB), run=286526-287572msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153226: Tue Sep 8 21:24:45 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(5920KiB/26486msec) clat (usec): min=38, max=175755, avg=36090.12, stdev=27383.18 lat (usec): min=38, max=175756, avg=36093.58, stdev=27381.95 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 69], 10.00th=[ 86], 20.00th=[ 16188], | 30.00th=[ 23462], 40.00th=[ 28705], 50.00th=[ 33162], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 53216], 90.00th=[ 65799], 95.00th=[ 81265], | 99.00th=[141558], 99.50th=[175113], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 126, max= 474, per=24.89%, avg=223.54, stdev=78.24, samples=52 iops : min= 7, max= 29, avg=13.23, stdev= 4.92, samples=52 write: IOPS=15, BW=240KiB/s (246kB/s)(6368KiB/26486msec); 0 zone resets clat (usec): min=1591, max=229628, avg=32761.98, stdev=33989.52 lat (usec): min=1592, max=229630, avg=32808.83, stdev=34072.35 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2278], 10.00th=[ 3458], 20.00th=[ 5932], | 30.00th=[ 8717], 40.00th=[ 12649], 50.00th=[ 20055], 60.00th=[ 31065], | 70.00th=[ 40633], 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[154141], 99.50th=[214959], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 79, max= 443, per=25.50%, avg=240.98, stdev=82.48, samples=52 iops : min= 4, max= 27, avg=14.31, stdev= 5.21, samples=52 lat (usec) : 50=0.65%, 100=5.47%, 250=1.30%, 500=0.13%, 750=0.13% lat (msec) : 2=1.69%, 4=4.95%, 10=10.94%, 20=11.98%, 50=38.41% lat (msec) : 100=20.57%, 250=3.78% cpu : usr=0.11%, sys=7.12%, ctx=1591, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153227: Tue Sep 8 21:24:45 2026 read: IOPS=13, BW=217KiB/s (223kB/s)(5744KiB/26418msec) clat (usec): min=41, max=242122, avg=37271.53, stdev=28197.69 lat (usec): min=41, max=242122, avg=37272.95, stdev=28197.71 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 65], 10.00th=[ 76], 20.00th=[ 19006], | 30.00th=[ 25560], 40.00th=[ 30016], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[116917], 99.50th=[196084], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 53, max= 411, per=25.23%, avg=226.57, stdev=84.18, samples=49 iops : min= 3, max= 25, avg=13.43, stdev= 5.24, samples=49 write: IOPS=15, BW=248KiB/s (254kB/s)(6544KiB/26418msec); 0 zone resets clat (usec): min=1628, max=274624, avg=31757.40, stdev=38469.47 lat (usec): min=1629, max=274626, avg=31768.68, stdev=38469.36 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2040], 10.00th=[ 2737], 20.00th=[ 4686], | 30.00th=[ 7111], 40.00th=[ 10421], 50.00th=[ 16319], 60.00th=[ 27395], | 70.00th=[ 36439], 80.00th=[ 52691], 90.00th=[ 79168], 95.00th=[116917], | 99.00th=[164627], 99.50th=[223347], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 29, max= 669, per=26.24%, avg=247.92, stdev=120.82, samples=51 iops : min= 1, max= 41, avg=14.76, stdev= 7.63, samples=51 lat (usec) : 50=0.52%, 100=5.34%, 250=1.43%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.21%, 4=6.77%, 10=11.85%, 20=9.77%, 50=38.02% lat (msec) : 100=19.40%, 250=4.04%, 500=0.13% cpu : usr=0.09%, sys=6.87%, ctx=1555, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153228: Tue Sep 8 21:24:45 2026 read: IOPS=14, BW=235KiB/s (240kB/s)(6256KiB/26660msec) clat (usec): min=44, max=197915, avg=36576.62, stdev=28493.28 lat (usec): min=44, max=197916, avg=36604.02, stdev=28522.05 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 81], 20.00th=[ 13698], | 30.00th=[ 23200], 40.00th=[ 28181], 50.00th=[ 33424], 60.00th=[ 39584], | 70.00th=[ 46400], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 80217], | 99.00th=[154141], 99.50th=[158335], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 94, max= 446, per=26.26%, avg=235.81, stdev=82.04, samples=52 iops : min= 5, max= 27, avg=14.00, stdev= 5.16, samples=52 write: IOPS=14, BW=226KiB/s (232kB/s)(6032KiB/26660msec); 0 zone resets clat (usec): min=1457, max=169700, avg=32638.09, stdev=32089.40 lat (usec): min=1459, max=169703, avg=32640.94, stdev=32089.17 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2180], 10.00th=[ 3425], 20.00th=[ 5473], | 30.00th=[ 8455], 40.00th=[ 13173], 50.00th=[ 22938], 60.00th=[ 30016], | 70.00th=[ 41681], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[145753], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 93, max= 378, per=23.57%, avg=222.75, stdev=84.68, samples=52 iops : min= 5, max= 23, avg=13.17, stdev= 5.34, samples=52 lat (usec) : 50=0.39%, 100=6.12%, 250=1.43%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=2.60%, 4=4.17%, 10=10.42%, 20=10.16%, 50=39.58% lat (msec) : 100=20.83%, 250=3.65% cpu : usr=0.09%, sys=6.68%, ctx=1657, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153229: Tue Sep 8 21:24:45 2026 read: IOPS=14, BW=230KiB/s (235kB/s)(6032KiB/26236msec) clat (usec): min=42, max=176891, avg=36239.52, stdev=30595.31 lat (usec): min=42, max=176893, avg=36241.21, stdev=30595.31 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 227], | 30.00th=[ 20841], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[166724], 99.50th=[170918], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 29, max= 384, per=25.92%, avg=232.72, stdev=80.23, samples=50 iops : min= 1, max= 24, avg=13.80, stdev= 5.08, samples=50 write: IOPS=14, BW=238KiB/s (244kB/s)(6256KiB/26236msec); 0 zone resets clat (usec): min=1556, max=306540, avg=31984.83, stdev=36777.66 lat (usec): min=1558, max=306542, avg=31990.04, stdev=36779.17 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1958], 10.00th=[ 2573], 20.00th=[ 4424], | 30.00th=[ 7046], 40.00th=[ 10421], 50.00th=[ 19006], 60.00th=[ 28181], | 70.00th=[ 41157], 80.00th=[ 54264], 90.00th=[ 76022], 95.00th=[107480], | 99.00th=[166724], 99.50th=[208667], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 63, max= 438, per=25.15%, avg=237.67, stdev=88.52, samples=51 iops : min= 3, max= 27, avg=14.14, stdev= 5.61, samples=51 lat (usec) : 50=0.26%, 100=8.07%, 250=1.69%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=6.38%, 10=10.94%, 20=9.24%, 50=35.29% lat (msec) : 100=19.92%, 250=4.56%, 500=0.13% cpu : usr=0.10%, sys=6.70%, ctx=1521, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=898KiB/s (920kB/s), 217KiB/s-235KiB/s (223kB/s-240kB/s), io=23.4MiB (24.5MB), run=26236-26660msec WRITE: bw=945KiB/s (968kB/s), 226KiB/s-248KiB/s (232kB/s-254kB/s), io=24.6MiB (25.8MB), run=26236-26660msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153221: Tue Sep 8 21:25:17 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(5920KiB/58118msec) clat (msec): min=7, max=247, avg=33.25, stdev=35.08 lat (msec): min=7, max=247, avg=33.26, stdev=35.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 77], 95.00th=[ 109], | 99.00th=[ 182], 99.50th=[ 232], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 320, per=27.47%, avg=112.09, stdev=69.68, samples=104 iops : min= 1, max= 20, avg= 6.23, stdev= 4.43, samples=104 write: IOPS=6, BW=110KiB/s (112kB/s)(6368KiB/58118msec); 0 zone resets clat (msec): min=42, max=413, avg=114.76, stdev=54.06 lat (msec): min=42, max=413, avg=114.76, stdev=54.06 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 74], | 30.00th=[ 83], 40.00th=[ 93], 50.00th=[ 101], 60.00th=[ 111], | 70.00th=[ 126], 80.00th=[ 148], 90.00th=[ 188], 95.00th=[ 222], | 99.00th=[ 334], 99.50th=[ 355], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 30, max= 192, per=25.36%, avg=108.81, stdev=47.98, samples=115 iops : min= 1, max= 12, avg= 6.02, stdev= 3.08, samples=115 lat (msec) : 10=4.17%, 20=18.75%, 50=17.32%, 100=31.38%, 250=26.95% lat (msec) : 500=1.43% cpu : usr=0.04%, sys=1.52%, ctx=1358, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153222: Tue Sep 8 21:25:17 2026 read: IOPS=6, BW=97.0KiB/s (100kB/s)(5744KiB/58627msec) clat (msec): min=6, max=287, avg=33.58, stdev=40.12 lat (msec): min=6, max=287, avg=33.58, stdev=40.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 69], 95.00th=[ 117], | 99.00th=[ 255], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 384, per=26.32%, avg=107.39, stdev=70.92, samples=105 iops : min= 1, max= 24, avg= 5.92, stdev= 4.52, samples=105 write: IOPS=6, BW=112KiB/s (114kB/s)(6544KiB/58627msec); 0 zone resets clat (msec): min=33, max=412, avg=113.48, stdev=52.44 lat (msec): min=33, max=412, avg=113.49, stdev=52.44 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 92], 50.00th=[ 104], 60.00th=[ 110], | 70.00th=[ 124], 80.00th=[ 146], 90.00th=[ 180], 95.00th=[ 218], | 99.00th=[ 326], 99.50th=[ 355], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 30, max= 223, per=26.14%, avg=112.13, stdev=48.13, samples=115 iops : min= 1, max= 13, avg= 6.23, stdev= 3.04, samples=115 lat (msec) : 10=2.73%, 20=21.22%, 50=16.28%, 100=29.04%, 250=29.17% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.45%, ctx=1270, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153223: Tue Sep 8 21:25:17 2026 read: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55832msec) clat (msec): min=6, max=333, avg=32.72, stdev=34.65 lat (msec): min=6, max=333, avg=32.73, stdev=34.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 74], 95.00th=[ 100], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 350, per=29.11%, avg=118.76, stdev=79.46, samples=104 iops : min= 1, max= 21, avg= 6.65, stdev= 5.05, samples=104 write: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55832msec); 0 zone resets clat (msec): min=40, max=356, avg=113.90, stdev=51.48 lat (msec): min=40, max=356, avg=113.90, stdev=51.48 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 103], 60.00th=[ 114], | 70.00th=[ 131], 80.00th=[ 146], 90.00th=[ 171], 95.00th=[ 215], | 99.00th=[ 292], 99.50th=[ 313], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 223, per=25.61%, avg=109.85, stdev=44.88, samples=107 iops : min= 1, max= 13, avg= 6.09, stdev= 2.86, samples=107 lat (msec) : 10=2.73%, 20=22.40%, 50=18.36%, 100=28.91%, 250=25.91% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.49%, ctx=1374, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153224: Tue Sep 8 21:25:17 2026 read: IOPS=6, BW=106KiB/s (108kB/s)(6032KiB/57079msec) clat (msec): min=5, max=276, avg=32.73, stdev=37.02 lat (msec): min=5, max=276, avg=32.74, stdev=37.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 41], 90.00th=[ 70], 95.00th=[ 111], | 99.00th=[ 218], 99.50th=[ 236], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 351, per=27.84%, avg=113.61, stdev=73.86, samples=104 iops : min= 1, max= 21, avg= 6.33, stdev= 4.65, samples=104 write: IOPS=6, BW=110KiB/s (112kB/s)(6256KiB/57079msec); 0 zone resets clat (msec): min=40, max=417, avg=114.01, stdev=54.39 lat (msec): min=40, max=417, avg=114.02, stdev=54.40 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 99], 60.00th=[ 110], | 70.00th=[ 126], 80.00th=[ 148], 90.00th=[ 194], 95.00th=[ 226], | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 224, per=25.48%, avg=109.33, stdev=49.92, samples=113 iops : min= 1, max= 14, avg= 6.05, stdev= 3.20, samples=113 lat (msec) : 10=2.60%, 20=22.14%, 50=17.58%, 100=30.99%, 250=25.00% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.48%, ctx=1303, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=409KiB/s (418kB/s), 97.0KiB/s-112KiB/s (100kB/s-115kB/s), io=23.4MiB (24.5MB), run=55832-58627msec WRITE: bw=430KiB/s (440kB/s), 108KiB/s-112KiB/s (111kB/s-114kB/s), io=24.6MiB (25.8MB), run=55832-58627msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153243: Tue Sep 8 21:25:28 2026 read: IOPS=3, BW=3384KiB/s (3466kB/s)(7168KiB/2118msec) clat (usec): min=512, max=353529, avg=190057.68, stdev=120399.21 lat (usec): min=512, max=353530, avg=190058.91, stdev=120399.41 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 87557], | 30.00th=[149947], 40.00th=[149947], 50.00th=[204473], 60.00th=[263193], | 70.00th=[263193], 80.00th=[270533], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 1984, max= 4202, per=52.13%, avg=2736.33, stdev=1269.45, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2417KiB/s (2475kB/s)(5120KiB/2118msec); 0 zone resets clat (msec): min=57, max=204, avg=149.18, stdev=63.59 lat (msec): min=57, max=204, avg=149.25, stdev=63.58 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 205], 95.00th=[ 205], | 99.00th=[ 205], 99.50th=[ 205], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 1984, max= 4047, per=41.03%, avg=3015.50, stdev=1458.76, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=24.28%, ctx=166, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153244: Tue Sep 8 21:25:28 2026 read: IOPS=0, BW=525KiB/s (538kB/s)(2048KiB/3901msec) clat (usec): min=456, max=258129, avg=129293.13, stdev=182202.41 lat (usec): min=457, max=258131, avg=129294.86, stdev=182203.17 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 457], | 30.00th=[ 457], 40.00th=[ 457], 50.00th=[ 457], 60.00th=[258999], | 70.00th=[258999], 80.00th=[258999], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 1380, max= 2039, per=32.57%, avg=1709.50, stdev=465.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2625KiB/s (2688kB/s)(10.0MiB/3901msec); 0 zone resets clat (msec): min=148, max=701, avg=360.24, stdev=207.55 lat (msec): min=148, max=702, avg=360.38, stdev=207.54 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 157], | 30.00th=[ 205], 40.00th=[ 213], 50.00th=[ 264], 60.00th=[ 275], | 70.00th=[ 443], 80.00th=[ 575], 90.00th=[ 625], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2023, max= 4096, per=49.57%, avg=3642.60, stdev=906.72, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.10, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=18.63%, ctx=161, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153245: Tue Sep 8 21:25:28 2026 read: IOPS=1, BW=1818KiB/s (1862kB/s)(6144KiB/3379msec) clat (usec): min=499, max=290711, avg=203863.96, stdev=110202.37 lat (usec): min=500, max=290712, avg=203865.08, stdev=110202.56 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[162530], | 30.00th=[162530], 40.00th=[223347], 50.00th=[223347], 60.00th=[270533], | 70.00th=[274727], 80.00th=[274727], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 2031, max= 4079, per=64.55%, avg=3388.33, stdev=1175.55, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1818KiB/s (1862kB/s)(6144KiB/3379msec); 0 zone resets clat (msec): min=156, max=562, avg=354.21, stdev=169.16 lat (msec): min=156, max=562, avg=354.29, stdev=169.17 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 439], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2039, max= 4079, per=45.08%, avg=3312.67, stdev=1110.60, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=15.63%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153246: Tue Sep 8 21:25:28 2026 read: IOPS=1, BW=1805KiB/s (1848kB/s)(5120KiB/2837msec) clat (usec): min=486, max=535354, avg=175042.28, stdev=224134.78 lat (usec): min=487, max=535355, avg=175043.27, stdev=224134.92 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[ 98042], 60.00th=[ 98042], | 70.00th=[240124], 80.00th=[240124], 90.00th=[534774], 95.00th=[534774], | 99.00th=[534774], 99.50th=[534774], 99.90th=[534774], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 4055, max= 4079, per=77.48%, avg=4067.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2527KiB/s (2587kB/s)(7168KiB/2837msec); 0 zone resets clat (msec): min=107, max=571, avg=274.34, stdev=169.88 lat (msec): min=107, max=572, avg=274.41, stdev=169.87 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 140], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 213], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 443], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1984, max= 4079, per=36.66%, avg=2694.00, stdev=1199.57, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=18.12%, ctx=133, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5250KiB/s (5376kB/s), 525KiB/s-3384KiB/s (538kB/s-3466kB/s), io=20.0MiB (20.0MB), run=2118-3901msec WRITE: bw=7350KiB/s (7526kB/s), 1818KiB/s-2625KiB/s (1862kB/s-2688kB/s), io=28.0MiB (29.4MB), run=2118-3901msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153248: Tue Sep 8 21:25:28 2026 read: IOPS=2, BW=2208KiB/s (2261kB/s)(7168KiB/3246msec) clat (msec): min=52, max=797, avg=196.79, stdev=266.98 lat (msec): min=52, max=797, avg=196.80, stdev=266.98 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 82], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 85], 60.00th=[ 138], | 70.00th=[ 138], 80.00th=[ 142], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1723, max= 3992, per=45.58%, avg=2366.60, stdev=918.93, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1577KiB/s (1615kB/s)(5120KiB/3246msec); 0 zone resets clat (msec): min=123, max=587, avg=353.77, stdev=185.88 lat (msec): min=123, max=587, avg=353.94, stdev=185.75 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2011, max= 3992, per=36.82%, avg=2676.67, stdev=1139.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=6.63%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153249: Tue Sep 8 21:25:28 2026 read: IOPS=0, BW=519KiB/s (532kB/s)(2048KiB/3944msec) clat (msec): min=145, max=182, avg=163.94, stdev=26.53 lat (msec): min=145, max=182, avg=163.95, stdev=26.53 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 1771, max= 2027, per=36.58%, avg=1899.00, stdev=181.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2596KiB/s (2659kB/s)(10.0MiB/3944msec); 0 zone resets clat (msec): min=95, max=1307, avg=353.92, stdev=347.46 lat (msec): min=95, max=1307, avg=354.02, stdev=347.44 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 142], | 30.00th=[ 186], 40.00th=[ 211], 50.00th=[ 230], 60.00th=[ 326], | 70.00th=[ 330], 80.00th=[ 342], 90.00th=[ 372], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 2011, max= 4087, per=38.97%, avg=2833.00, stdev=1101.97, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=5.22%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153250: Tue Sep 8 21:25:28 2026 read: IOPS=1, BW=1899KiB/s (1944kB/s)(6144KiB/3236msec) clat (msec): min=92, max=332, avg=165.85, stdev=92.89 lat (msec): min=92, max=332, avg=165.85, stdev=92.89 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 150], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 2027, max= 4023, per=64.47%, avg=3347.33, stdev=1143.55, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1899KiB/s (1944kB/s)(6144KiB/3236msec); 0 zone resets clat (msec): min=226, max=880, avg=368.87, stdev=251.87 lat (msec): min=227, max=880, avg=368.95, stdev=251.86 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 288], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1943, max= 4096, per=34.66%, avg=2519.25, stdev=1051.80, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=5.38%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153251: Tue Sep 8 21:25:28 2026 read: IOPS=1, BW=1416KiB/s (1450kB/s)(5120KiB/3617msec) clat (msec): min=58, max=157, avg=107.03, stdev=42.87 lat (msec): min=58, max=157, avg=107.03, stdev=42.87 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 77], 40.00th=[ 77], 50.00th=[ 100], 60.00th=[ 100], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1982KiB/s (2029kB/s)(7168KiB/3617msec); 0 zone resets clat (msec): min=125, max=967, avg=429.36, stdev=328.61 lat (msec): min=125, max=967, avg=429.43, stdev=328.61 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 159], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 234], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 693], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1802, max= 6131, per=38.49%, avg=2797.60, stdev=1865.88, samples=5 iops : min= 1, max= 5, avg= 2.00, stdev= 1.73, samples=5 lat (msec) : 100=25.00%, 250=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=6.08%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5193KiB/s (5317kB/s), 519KiB/s-2208KiB/s (532kB/s-2261kB/s), io=20.0MiB (20.0MB), run=3236-3944msec WRITE: bw=7270KiB/s (7444kB/s), 1577KiB/s-2596KiB/s (1615kB/s-2659kB/s), io=28.0MiB (29.4MB), run=3236-3944msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153258: Tue Sep 8 21:25:39 2026 read: IOPS=1, BW=5251KiB/s (5377kB/s)(12.0MiB/2340msec) clat (msec): min=617, max=885, avg=771.99, stdev=138.72 lat (msec): min=617, max=885, avg=771.99, stdev=138.72 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 6282, max= 8143, per=100.00%, avg=7212.50, stdev=1315.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.04%, ctx=428, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153259: Tue Sep 8 21:25:39 2026 read: IOPS=0, BW=1629KiB/s (1668kB/s)(4096KiB/2514msec) clat (nsec): min=619121k, max=619121k, avg=619120683.00, stdev= 0.00 lat (nsec): min=619122k, max=619122k, avg=619121895.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 6350, max= 6350, per=97.44%, avg=6350.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3259KiB/s (3337kB/s)(8192KiB/2514msec); 0 zone resets clat (msec): min=410, max=1467, avg=938.92, stdev=747.68 lat (msec): min=412, max=1468, avg=940.31, stdev=746.55 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8192, max= 8192, per=65.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.84%, ctx=182, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153260: Tue Sep 8 21:25:39 2026 write: IOPS=1, BW=4715KiB/s (4828kB/s)(12.0MiB/2606msec); 0 zone resets clat (msec): min=509, max=1144, avg=841.06, stdev=318.30 lat (msec): min=509, max=1144, avg=841.41, stdev=318.21 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8126, max= 8192, per=64.89%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.79%, ctx=122, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153261: Tue Sep 8 21:25:39 2026 write: IOPS=1, BW=6065KiB/s (6211kB/s)(12.0MiB/2026msec); 0 zone resets clat (msec): min=349, max=1238, avg=668.51, stdev=495.17 lat (msec): min=350, max=1239, avg=669.17, stdev=494.89 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 6215, max= 8192, per=57.29%, avg=7203.50, stdev=1397.95, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.61%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6517KiB/s (6674kB/s), 1629KiB/s-5251KiB/s (1668kB/s-5377kB/s), io=16.0MiB (16.8MB), run=2340-2514msec WRITE: bw=12.3MiB/s (12.9MB/s), 3259KiB/s-6065KiB/s (3337kB/s-6211kB/s), io=32.0MiB (33.6MB), run=2026-2606msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153263: Tue Sep 8 21:25:39 2026 read: IOPS=1, BW=4770KiB/s (4885kB/s)(12.0MiB/2576msec) clat (msec): min=177, max=1574, avg=858.15, stdev=699.03 lat (msec): min=177, max=1574, avg=858.15, stdev=699.03 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.24%, ctx=41, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153264: Tue Sep 8 21:25:39 2026 read: IOPS=0, BW=1378KiB/s (1411kB/s)(4096KiB/2972msec) clat (nsec): min=988905k, max=988905k, avg=988905331.00, stdev= 0.00 lat (nsec): min=988908k, max=988908k, avg=988908025.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2756KiB/s (2823kB/s)(8192KiB/2972msec); 0 zone resets clat (msec): min=571, max=1406, avg=988.90, stdev=590.20 lat (msec): min=571, max=1408, avg=990.20, stdev=591.51 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8159, max= 8159, per=74.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.13%, sys=4.54%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153265: Tue Sep 8 21:25:39 2026 write: IOPS=1, BW=4151KiB/s (4251kB/s)(12.0MiB/2960msec); 0 zone resets clat (msec): min=363, max=1468, avg=986.02, stdev=565.61 lat (msec): min=363, max=1468, avg=986.37, stdev=565.64 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8159, max= 8159, per=74.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.63%, ctx=34, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153266: Tue Sep 8 21:25:39 2026 write: IOPS=1, BW=5991KiB/s (6135kB/s)(12.0MiB/2051msec); 0 zone resets clat (msec): min=516, max=973, avg=682.88, stdev=252.60 lat (msec): min=516, max=973, avg=683.28, stdev=252.61 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 6918, max= 8159, per=68.38%, avg=7538.50, stdev=877.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.05%, sys=10.73%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5513KiB/s (5645kB/s), 1378KiB/s-4770KiB/s (1411kB/s-4885kB/s), io=16.0MiB (16.8MB), run=2576-2972msec WRITE: bw=10.8MiB/s (11.3MB/s), 2756KiB/s-5991KiB/s (2823kB/s-6135kB/s), io=32.0MiB (33.6MB), run=2051-2972msec