== sanity test 398b: DIO and buffer IO race ============== 17:25:57 (1787606757) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.07098 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145466: Mon Aug 24 17:29:05 2026 read: IOPS=8, BW=35.0KiB/s (35.8kB/s)(5992KiB/171151msec) clat (usec): min=31, max=53210k, avg=74205.47, stdev=1374119.58 lat (usec): min=32, max=53210k, avg=74215.44, stdev=1374119.48 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 9634], | 20.00th=[ 18482], 30.00th=[ 22938], 40.00th=[ 27919], | 50.00th=[ 32900], 60.00th=[ 39060], 70.00th=[ 47449], | 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[ 139461], 99.50th=[ 191890], 99.90th=[ 400557], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 119, per=35.88%, avg=50.23, stdev=22.63, samples=233 iops : min= 1, max= 29, avg=11.94, stdev= 5.69, samples=233 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6296KiB/171151msec); 0 zone resets clat (usec): min=899, max=318351, avg=38033.78, stdev=38714.17 lat (usec): min=901, max=318352, avg=38036.04, stdev=38714.14 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1647], 20.00th=[ 3982], | 30.00th=[ 8094], 40.00th=[ 17695], 50.00th=[ 28443], 60.00th=[ 38011], | 70.00th=[ 50594], 80.00th=[ 64750], 90.00th=[ 91751], 95.00th=[111674], | 99.00th=[154141], 99.50th=[202376], 99.90th=[295699], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 136, per=35.95%, avg=52.49, stdev=20.87, samples=234 iops : min= 1, max= 34, avg=12.51, stdev= 5.28, samples=234 lat (usec) : 50=0.55%, 100=3.16%, 250=0.49%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=6.05%, 4=4.26%, 10=6.48%, 20=11.39%, 50=38.44% lat (msec) : 100=23.47%, 250=5.11%, 500=0.20%, >=2000=0.03% cpu : usr=0.05%, sys=3.57%, ctx=6606, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145467: Mon Aug 24 17:29:05 2026 read: IOPS=8, BW=34.7KiB/s (35.6kB/s)(5940KiB/170954msec) clat (usec): min=30, max=401557, avg=38516.38, stdev=30778.64 lat (usec): min=30, max=401558, avg=38522.53, stdev=30779.66 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 1270], 20.00th=[ 17171], | 30.00th=[ 22152], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 57410], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[143655], 99.50th=[179307], 99.90th=[274727], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 6, max= 119, per=35.62%, avg=49.87, stdev=22.31, samples=232 iops : min= 1, max= 29, avg=11.84, stdev= 5.62, samples=232 write: IOPS=9, BW=37.1KiB/s (38.0kB/s)(6348KiB/170954msec); 0 zone resets clat (usec): min=872, max=52952k, avg=71562.32, stdev=1328859.76 lat (usec): min=873, max=52952k, avg=71567.69, stdev=1328859.57 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1958], | 20.00th=[ 4293], 30.00th=[ 7963], 40.00th=[ 18744], | 50.00th=[ 28181], 60.00th=[ 38536], 70.00th=[ 50594], | 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[ 111674], | 99.00th=[ 175113], 99.50th=[ 214959], 99.90th=[ 492831], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 168, per=36.29%, avg=52.98, stdev=23.97, samples=233 iops : min= 1, max= 42, avg=12.64, stdev= 6.05, samples=233 lat (usec) : 50=0.49%, 100=3.87%, 250=0.23%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=5.34%, 4=4.65%, 10=7.68%, 20=11.39%, 50=37.11% lat (msec) : 100=23.67%, 250=5.08%, 500=0.23%, >=2000=0.03% cpu : usr=0.04%, sys=3.48%, ctx=6470, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145468: Mon Aug 24 17:29:05 2026 read: IOPS=8, BW=35.5KiB/s (36.4kB/s)(6028KiB/169585msec) clat (usec): min=32, max=463886, avg=37829.53, stdev=29820.48 lat (usec): min=32, max=463887, avg=37831.16, stdev=29820.57 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 766], 20.00th=[ 17433], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 46400], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 84411], | 99.00th=[125305], 99.50th=[166724], 99.90th=[274727], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 120, per=36.66%, avg=51.32, stdev=23.85, samples=230 iops : min= 1, max= 30, avg=12.20, stdev= 6.00, samples=230 write: IOPS=9, BW=36.9KiB/s (37.8kB/s)(6260KiB/169585msec); 0 zone resets clat (usec): min=947, max=52750k, avg=71835.57, stdev=1333043.64 lat (usec): min=948, max=52750k, avg=71847.41, stdev=1333043.36 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1647], | 20.00th=[ 3621], 30.00th=[ 8717], 40.00th=[ 18220], | 50.00th=[ 29492], 60.00th=[ 39584], 70.00th=[ 50594], | 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[ 108528], | 99.00th=[ 173016], 99.50th=[ 210764], 99.90th=[ 379585], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 127, per=36.32%, avg=53.03, stdev=22.28, samples=231 iops : min= 1, max= 31, avg=12.63, stdev= 5.58, samples=231 lat (usec) : 50=0.59%, 100=3.55%, 250=0.62%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.32%, 4=4.59%, 10=5.63%, 20=11.72%, 50=38.54% lat (msec) : 100=23.54%, 250=4.46%, 500=0.20%, >=2000=0.03% cpu : usr=0.05%, sys=3.50%, ctx=6605, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145469: Mon Aug 24 17:29:05 2026 read: IOPS=8, BW=35.7KiB/s (36.5kB/s)(6052KiB/169730msec) clat (usec): min=30, max=359065, avg=37513.79, stdev=28592.45 lat (usec): min=30, max=359067, avg=37518.32, stdev=28591.82 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 396], 20.00th=[ 17433], | 30.00th=[ 22152], 40.00th=[ 26608], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 85459], | 99.00th=[129500], 99.50th=[156238], 99.90th=[223347], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 120, per=36.86%, avg=51.60, stdev=21.14, samples=229 iops : min= 1, max= 30, avg=12.28, stdev= 5.34, samples=229 write: IOPS=9, BW=36.7KiB/s (37.6kB/s)(6236KiB/169730msec); 0 zone resets clat (usec): min=866, max=53082k, avg=72358.58, stdev=1344041.54 lat (usec): min=867, max=53082k, avg=72363.57, stdev=1344041.49 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1647], | 20.00th=[ 3785], 30.00th=[ 7767], 40.00th=[ 18220], | 50.00th=[ 29754], 60.00th=[ 38536], 70.00th=[ 49546], | 80.00th=[ 65274], 90.00th=[ 90702], 95.00th=[ 111674], | 99.00th=[ 173016], 99.50th=[ 200279], 99.90th=[ 425722], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 118, per=35.88%, avg=52.39, stdev=21.77, samples=232 iops : min= 1, max= 29, avg=12.47, stdev= 5.49, samples=232 lat (usec) : 50=0.68%, 100=3.65%, 250=0.55%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.41%, 4=4.39%, 10=6.25%, 20=11.10%, 50=39.03% lat (msec) : 100=22.07%, 250=5.31%, 500=0.20%, >=2000=0.03% cpu : usr=0.05%, sys=3.55%, ctx=6530, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=140KiB/s (144kB/s), 34.7KiB/s-35.7KiB/s (35.6kB/s-36.5kB/s), io=23.4MiB (24.6MB), run=169585-171151msec WRITE: bw=147KiB/s (150kB/s), 36.7KiB/s-37.1KiB/s (37.6kB/s-38.0kB/s), io=24.6MiB (25.7MB), run=169585-171151msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145461: Mon Aug 24 17:31:13 2026 read: IOPS=5, BW=20.1KiB/s (20.5kB/s)(5992KiB/298735msec) clat (msec): min=5, max=785, avg=32.00, stdev=39.99 lat (msec): min=5, max=785, avg=32.00, stdev=39.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 43], 90.00th=[ 73], 95.00th=[ 101], | 99.00th=[ 176], 99.50th=[ 211], 99.90th=[ 439], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 104, per=33.49%, avg=26.79, stdev=17.95, samples=434 iops : min= 1, max= 26, avg= 6.10, stdev= 4.55, samples=434 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6296KiB/298735msec); 0 zone resets clat (msec): min=33, max=53269, avg=159.13, stdev=1340.88 lat (msec): min=33, max=53269, avg=159.13, stdev=1340.88 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 163], 90.00th=[ 203], 95.00th=[ 245], | 99.00th=[ 351], 99.50th=[ 393], 99.90th=[ 456], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 55, per=30.54%, avg=25.35, stdev=11.24, samples=481 iops : min= 1, max= 13, avg= 5.73, stdev= 2.90, samples=481 lat (msec) : 10=6.45%, 20=19.01%, 50=16.24%, 100=25.10%, 250=30.73% lat (msec) : 500=2.41%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=0.93%, ctx=5175, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145462: Mon Aug 24 17:31:13 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(5940KiB/300014msec) clat (msec): min=4, max=53026, avg=66.86, stdev=1375.67 lat (msec): min=4, max=53026, avg=66.86, stdev=1375.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 68], 95.00th=[ 93], | 99.00th=[ 161], 99.50th=[ 188], 99.90th=[ 676], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 103, per=33.36%, avg=26.69, stdev=18.04, samples=431 iops : min= 1, max= 25, avg= 6.07, stdev= 4.54, samples=431 write: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6348KiB/300014msec); 0 zone resets clat (msec): min=26, max=473, avg=126.28, stdev=58.47 lat (msec): min=26, max=473, avg=126.29, stdev=58.47 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 239], | 99.00th=[ 326], 99.50th=[ 355], 99.90th=[ 435], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 72, per=30.53%, avg=25.34, stdev=11.12, samples=484 iops : min= 1, max= 18, avg= 5.73, stdev= 2.88, samples=484 lat (msec) : 10=5.37%, 20=19.17%, 50=16.44%, 100=26.01%, 250=30.83% lat (msec) : 500=2.12%, 750=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=0.89%, ctx=5078, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145463: Mon Aug 24 17:31:13 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6028KiB/299297msec) clat (msec): min=4, max=446, avg=31.73, stdev=31.47 lat (msec): min=4, max=446, avg=31.73, stdev=31.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 150], 99.50th=[ 171], 99.90th=[ 211], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 103, per=32.24%, avg=25.79, stdev=17.72, samples=453 iops : min= 1, max= 25, avg= 5.85, stdev= 4.50, samples=453 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6260KiB/299297msec); 0 zone resets clat (msec): min=31, max=52812, avg=160.48, stdev=1333.31 lat (msec): min=31, max=52812, avg=160.49, stdev=1333.31 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 207], 95.00th=[ 241], | 99.00th=[ 347], 99.50th=[ 388], 99.90th=[ 768], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 56, per=30.15%, avg=25.02, stdev=11.46, samples=484 iops : min= 1, max= 14, avg= 5.65, stdev= 2.94, samples=484 lat (msec) : 10=5.47%, 20=18.91%, 50=17.09%, 100=26.17%, 250=30.08% lat (msec) : 500=2.15%, 750=0.07%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=0.95%, ctx=5143, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145464: Mon Aug 24 17:31:13 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6052KiB/298505msec) clat (msec): min=4, max=444, avg=32.51, stdev=35.27 lat (msec): min=4, max=444, avg=32.51, stdev=35.27 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 78], 95.00th=[ 102], | 99.00th=[ 174], 99.50th=[ 211], 99.90th=[ 309], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 119, per=33.72%, avg=26.97, stdev=17.67, samples=435 iops : min= 1, max= 29, avg= 6.14, stdev= 4.47, samples=435 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6236KiB/298505msec); 0 zone resets clat (msec): min=34, max=53286, avg=159.71, stdev=1347.78 lat (msec): min=34, max=53286, avg=159.72, stdev=1347.78 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 203], 95.00th=[ 241], | 99.00th=[ 334], 99.50th=[ 372], 99.90th=[ 827], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 48, per=30.12%, avg=25.00, stdev=11.03, samples=482 iops : min= 1, max= 12, avg= 5.65, stdev= 2.84, samples=482 lat (msec) : 10=5.31%, 20=19.66%, 50=16.76%, 100=25.26%, 250=30.79% lat (msec) : 500=2.08%, 750=0.07%, 1000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=0.89%, ctx=5232, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=80.0KiB/s (81.0kB/s), 19.8KiB/s-20.3KiB/s (20.3kB/s-20.8kB/s), io=23.4MiB (24.6MB), run=298505-300014msec WRITE: bw=83.8KiB/s (85.8kB/s), 20.9KiB/s-21.2KiB/s (21.4kB/s-21.7kB/s), io=24.6MiB (25.7MB), run=298505-300014msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145528: Mon Aug 24 17:31:48 2026 read: IOPS=14, BW=229KiB/s (235kB/s)(5920KiB/25845msec) clat (usec): min=35, max=295161, avg=34942.75, stdev=31976.03 lat (usec): min=35, max=295161, avg=34944.38, stdev=31975.85 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 84], | 30.00th=[ 19006], 40.00th=[ 25035], 50.00th=[ 31327], 60.00th=[ 38011], | 70.00th=[ 45876], 80.00th=[ 54789], 90.00th=[ 77071], 95.00th=[ 85459], | 99.00th=[103285], 99.50th=[229639], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 63, max= 381, per=24.65%, avg=228.25, stdev=81.60, samples=51 iops : min= 3, max= 23, avg=13.49, stdev= 5.16, samples=51 write: IOPS=15, BW=246KiB/s (252kB/s)(6368KiB/25845msec); 0 zone resets clat (usec): min=1374, max=180623, avg=32171.29, stdev=34911.59 lat (usec): min=1375, max=180625, avg=32173.90, stdev=34911.02 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1663], 10.00th=[ 2073], 20.00th=[ 4015], | 30.00th=[ 7046], 40.00th=[ 11600], 50.00th=[ 18220], 60.00th=[ 27657], | 70.00th=[ 41681], 80.00th=[ 58459], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[158335], 99.50th=[170918], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 446, per=25.25%, avg=246.16, stdev=86.61, samples=51 iops : min= 3, max= 27, avg=14.63, stdev= 5.51, samples=51 lat (usec) : 50=1.17%, 100=8.46%, 250=1.30%, 500=0.65% lat (msec) : 2=5.21%, 4=5.34%, 10=9.38%, 20=10.55%, 50=32.55% lat (msec) : 100=21.88%, 250=3.39%, 500=0.13% cpu : usr=0.09%, sys=5.58%, ctx=1390, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145529: Mon Aug 24 17:31:48 2026 read: IOPS=14, BW=226KiB/s (232kB/s)(5744KiB/25373msec) clat (usec): min=41, max=235894, avg=35683.32, stdev=29661.35 lat (usec): min=41, max=235895, avg=35687.54, stdev=29666.30 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 60], 20.00th=[ 115], | 30.00th=[ 21627], 40.00th=[ 28443], 50.00th=[ 33162], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[124257], 99.50th=[145753], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 32, max= 408, per=24.52%, avg=227.06, stdev=88.09, samples=50 iops : min= 2, max= 25, avg=13.42, stdev= 5.49, samples=50 write: IOPS=16, BW=258KiB/s (264kB/s)(6544KiB/25373msec); 0 zone resets clat (usec): min=1398, max=276099, avg=30561.89, stdev=34364.66 lat (usec): min=1400, max=276100, avg=30572.36, stdev=34360.76 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1844], 10.00th=[ 2606], 20.00th=[ 5014], | 30.00th=[ 7111], 40.00th=[ 10159], 50.00th=[ 17433], 60.00th=[ 27132], | 70.00th=[ 38536], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[141558], 99.50th=[198181], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 63, max= 507, per=26.38%, avg=257.24, stdev=93.60, samples=50 iops : min= 3, max= 31, avg=15.32, stdev= 5.95, samples=50 lat (usec) : 50=1.04%, 100=7.42%, 250=1.82%, 500=0.26%, 750=0.13% lat (msec) : 2=4.04%, 4=5.08%, 10=11.98%, 20=9.77%, 50=34.90% lat (msec) : 100=20.05%, 250=3.39%, 500=0.13% cpu : usr=0.09%, sys=5.86%, ctx=1362, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145530: Mon Aug 24 17:31:48 2026 read: IOPS=15, BW=243KiB/s (248kB/s)(6256KiB/25783msec) clat (usec): min=35, max=140971, avg=35612.41, stdev=28972.99 lat (usec): min=35, max=140972, avg=35614.24, stdev=28973.59 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 87], | 30.00th=[ 20841], 40.00th=[ 27657], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 46400], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[109577], 99.50th=[121111], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 63, max= 471, per=26.17%, avg=242.31, stdev=93.07, samples=51 iops : min= 3, max= 29, avg=14.39, stdev= 5.89, samples=51 write: IOPS=14, BW=234KiB/s (240kB/s)(6032KiB/25783msec); 0 zone resets clat (usec): min=1331, max=231596, avg=31103.55, stdev=35270.71 lat (usec): min=1333, max=231598, avg=31107.94, stdev=35269.58 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1696], 10.00th=[ 2245], 20.00th=[ 4555], | 30.00th=[ 6521], 40.00th=[ 9765], 50.00th=[ 17171], 60.00th=[ 27919], | 70.00th=[ 36963], 80.00th=[ 55313], 90.00th=[ 81265], 95.00th=[108528], | 99.00th=[141558], 99.50th=[173016], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 446, per=23.90%, avg=233.00, stdev=98.05, samples=51 iops : min= 1, max= 27, avg=13.80, stdev= 6.18, samples=51 lat (usec) : 50=1.69%, 100=8.98%, 250=0.78%, 500=0.26% lat (msec) : 2=4.56%, 4=5.21%, 10=11.46%, 20=7.68%, 50=34.38% lat (msec) : 100=21.22%, 250=3.78% cpu : usr=0.05%, sys=5.69%, ctx=1391, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145531: Mon Aug 24 17:31:48 2026 read: IOPS=15, BW=251KiB/s (257kB/s)(6032KiB/23998msec) clat (usec): min=34, max=115930, avg=31410.22, stdev=26784.22 lat (usec): min=35, max=115930, avg=31411.56, stdev=26784.87 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 12387], 40.00th=[ 24773], 50.00th=[ 30016], 60.00th=[ 36963], | 70.00th=[ 42730], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[ 99091], 99.50th=[112722], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 31, max= 574, per=27.10%, avg=250.91, stdev=99.10, samples=47 iops : min= 1, max= 35, avg=14.91, stdev= 6.26, samples=47 write: IOPS=16, BW=261KiB/s (267kB/s)(6256KiB/23998msec); 0 zone resets clat (usec): min=1375, max=330899, avg=30722.39, stdev=36750.91 lat (usec): min=1376, max=330901, avg=30739.81, stdev=36747.45 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1811], 10.00th=[ 2540], 20.00th=[ 4686], | 30.00th=[ 6718], 40.00th=[ 10028], 50.00th=[ 17957], 60.00th=[ 25035], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 77071], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[235930], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 92, max= 670, per=26.86%, avg=261.85, stdev=101.01, samples=47 iops : min= 5, max= 41, avg=15.60, stdev= 6.33, samples=47 lat (usec) : 50=1.82%, 100=10.42%, 250=1.43%, 500=0.39% lat (msec) : 2=3.52%, 4=5.60%, 10=11.46%, 20=9.64%, 50=33.59% lat (msec) : 100=19.53%, 250=2.47%, 500=0.13% cpu : usr=0.11%, sys=6.25%, ctx=1363, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=927KiB/s (949kB/s), 226KiB/s-251KiB/s (232kB/s-257kB/s), io=23.4MiB (24.5MB), run=23998-25845msec WRITE: bw=975KiB/s (998kB/s), 234KiB/s-261KiB/s (240kB/s-267kB/s), io=24.6MiB (25.8MB), run=23998-25845msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145533: Mon Aug 24 17:32:29 2026 read: IOPS=5, BW=90.3KiB/s (92.5kB/s)(5920KiB/65544msec) clat (msec): min=6, max=318, avg=37.92, stdev=37.33 lat (msec): min=6, max=318, avg=37.93, stdev=37.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 74], 95.00th=[ 123], | 99.00th=[ 188], 99.50th=[ 205], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 384, per=26.84%, avg=97.43, stdev=61.76, samples=118 iops : min= 1, max= 24, avg= 5.30, stdev= 3.95, samples=118 write: IOPS=6, BW=97.2KiB/s (99.5kB/s)(6368KiB/65544msec); 0 zone resets clat (msec): min=47, max=431, avg=129.26, stdev=57.60 lat (msec): min=47, max=431, avg=129.26, stdev=57.60 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 104], 50.00th=[ 113], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 247], | 99.00th=[ 321], 99.50th=[ 405], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 25, max= 192, per=25.46%, avg=97.27, stdev=37.87, samples=128 iops : min= 1, max= 12, avg= 5.29, stdev= 2.45, samples=128 lat (msec) : 10=1.82%, 20=14.32%, 50=23.05%, 100=24.35%, 250=33.98% lat (msec) : 500=2.47% cpu : usr=0.03%, sys=1.17%, ctx=1272, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145534: Mon Aug 24 17:32:29 2026 read: IOPS=5, BW=87.1KiB/s (89.2kB/s)(5744KiB/65943msec) clat (msec): min=6, max=322, avg=37.76, stdev=35.70 lat (msec): min=6, max=322, avg=37.76, stdev=35.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 83], 95.00th=[ 118], | 99.00th=[ 171], 99.50th=[ 213], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 24, max= 319, per=27.33%, avg=99.20, stdev=59.85, samples=113 iops : min= 1, max= 19, avg= 5.42, stdev= 3.75, samples=113 write: IOPS=6, BW=99.2KiB/s (102kB/s)(6544KiB/65943msec); 0 zone resets clat (msec): min=40, max=380, avg=127.93, stdev=55.43 lat (msec): min=40, max=380, avg=127.93, stdev=55.43 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 128], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 207], 95.00th=[ 245], | 99.00th=[ 313], 99.50th=[ 334], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 251, per=25.73%, avg=98.29, stdev=41.13, samples=130 iops : min= 1, max= 15, avg= 5.36, stdev= 2.67, samples=130 lat (msec) : 10=2.08%, 20=13.15%, 50=23.57%, 100=24.22%, 250=34.38% lat (msec) : 500=2.60% cpu : usr=0.03%, sys=1.31%, ctx=1414, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145535: Mon Aug 24 17:32:29 2026 read: IOPS=6, BW=96.8KiB/s (99.1kB/s)(6256KiB/64661msec) clat (msec): min=7, max=323, avg=38.30, stdev=36.41 lat (msec): min=7, max=323, avg=38.30, stdev=36.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 79], 95.00th=[ 111], | 99.00th=[ 182], 99.50th=[ 245], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 319, per=28.84%, avg=104.68, stdev=68.16, samples=118 iops : min= 1, max= 19, avg= 5.76, stdev= 4.29, samples=118 write: IOPS=5, BW=93.3KiB/s (95.5kB/s)(6032KiB/64661msec); 0 zone resets clat (msec): min=55, max=425, avg=131.68, stdev=54.16 lat (msec): min=55, max=425, avg=131.68, stdev=54.16 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 132], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 201], 95.00th=[ 236], | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 31, max= 191, per=24.25%, avg=92.65, stdev=35.79, samples=127 iops : min= 1, max= 11, avg= 5.00, stdev= 2.29, samples=127 lat (msec) : 10=1.17%, 20=14.58%, 50=25.91%, 100=20.83%, 250=35.68% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.21%, ctx=1287, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145536: Mon Aug 24 17:32:29 2026 read: IOPS=5, BW=92.8KiB/s (94.0kB/s)(6032KiB/65034msec) clat (msec): min=6, max=246, avg=37.23, stdev=34.38 lat (msec): min=6, max=246, avg=37.23, stdev=34.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 114], | 99.00th=[ 163], 99.50th=[ 211], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 287, per=27.35%, avg=99.27, stdev=68.70, samples=118 iops : min= 1, max= 17, avg= 5.41, stdev= 4.31, samples=118 write: IOPS=6, BW=96.2KiB/s (98.5kB/s)(6256KiB/65034msec); 0 zone resets clat (msec): min=42, max=416, avg=130.29, stdev=56.51 lat (msec): min=42, max=416, avg=130.29, stdev=56.51 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 130], | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 199], 95.00th=[ 241], | 99.00th=[ 351], 99.50th=[ 414], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 31, max= 191, per=25.43%, avg=97.16, stdev=35.49, samples=126 iops : min= 1, max= 11, avg= 5.29, stdev= 2.29, samples=126 lat (msec) : 10=1.56%, 20=17.19%, 50=20.57%, 100=23.05%, 250=35.55% lat (msec) : 500=2.08% cpu : usr=0.04%, sys=1.25%, ctx=1317, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=363KiB/s (372kB/s), 87.1KiB/s-96.8KiB/s (89.2kB/s-99.1kB/s), io=23.4MiB (24.5MB), run=64661-65943msec WRITE: bw=382KiB/s (391kB/s), 93.3KiB/s-99.2KiB/s (95.5kB/s-102kB/s), io=24.6MiB (25.8MB), run=64661-65943msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145556: Mon Aug 24 17:32:41 2026 read: IOPS=2, BW=2445KiB/s (2503kB/s)(7168KiB/2932msec) clat (usec): min=477, max=574589, avg=222027.97, stdev=197527.96 lat (usec): min=478, max=574591, avg=222029.48, stdev=197527.93 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 14615], | 30.00th=[175113], 40.00th=[175113], 50.00th=[189793], 60.00th=[263193], | 70.00th=[263193], 80.00th=[333448], 90.00th=[574620], 95.00th=[574620], | 99.00th=[574620], 99.50th=[574620], 99.90th=[574620], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 2027, max= 3953, per=55.73%, avg=3040.33, stdev=966.94, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1746KiB/s (1788kB/s)(5120KiB/2932msec); 0 zone resets clat (msec): min=156, max=438, avg=275.22, stdev=115.93 lat (msec): min=156, max=438, avg=275.30, stdev=115.94 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 2027, max= 4071, per=35.50%, avg=2711.00, stdev=1177.80, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 20=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=19.14%, ctx=261, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145557: Mon Aug 24 17:32:41 2026 read: IOPS=0, BW=600KiB/s (614kB/s)(2048KiB/3416msec) clat (msec): min=30, max=127, avg=79.00, stdev=68.86 lat (msec): min=30, max=127, avg=79.00, stdev=68.86 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 128], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 128], 95.00th=[ 128], | 99.00th=[ 128], 99.50th=[ 128], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 1600, max= 2035, per=33.32%, avg=1817.50, stdev=307.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2998KiB/s (3070kB/s)(10.0MiB/3416msec); 0 zone resets clat (msec): min=121, max=890, avg=325.35, stdev=262.13 lat (msec): min=121, max=890, avg=325.50, stdev=262.16 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 129], | 30.00th=[ 150], 40.00th=[ 176], 50.00th=[ 199], 60.00th=[ 241], | 70.00th=[ 317], 80.00th=[ 330], 90.00th=[ 701], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1600, max= 6131, per=41.37%, avg=3159.40, stdev=1918.92, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 50=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=20.03%, ctx=116, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145558: Mon Aug 24 17:32:41 2026 read: IOPS=1, BW=1637KiB/s (1676kB/s)(6144KiB/3754msec) clat (usec): min=712, max=493191, avg=237143.14, stdev=165964.11 lat (usec): min=714, max=493192, avg=237144.87, stdev=165963.92 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[158335], | 30.00th=[158335], 40.00th=[187696], 50.00th=[187696], 60.00th=[261096], | 70.00th=[320865], 80.00th=[320865], 90.00th=[492831], 95.00th=[492831], | 99.00th=[492831], 99.50th=[492831], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 1976, max= 3984, per=46.00%, avg=2509.50, stdev=983.45, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1637KiB/s (1676kB/s)(6144KiB/3754msec); 0 zone resets clat (msec): min=68, max=708, avg=388.14, stdev=242.35 lat (msec): min=68, max=708, avg=388.20, stdev=242.36 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 418], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1780, max= 3984, per=30.91%, avg=2360.40, stdev=913.47, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=16.92%, ctx=350, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145559: Mon Aug 24 17:32:41 2026 read: IOPS=1, BW=1725KiB/s (1766kB/s)(5120KiB/2968msec) clat (usec): min=503, max=233373, avg=127286.53, stdev=117036.36 lat (usec): min=504, max=233374, avg=127287.68, stdev=117036.03 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 2737], 40.00th=[ 2737], 50.00th=[173016], 60.00th=[173016], | 70.00th=[225444], 80.00th=[225444], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 4071, max= 4071, per=74.63%, avg=4071.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2415KiB/s (2473kB/s)(7168KiB/2968msec); 0 zone resets clat (msec): min=62, max=623, avg=332.72, stdev=192.68 lat (msec): min=62, max=623, avg=332.78, stdev=192.69 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 106], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 384], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 414], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2035, max= 4055, per=43.83%, avg=3347.67, stdev=1137.95, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=22.31%, ctx=178, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5456KiB/s (5586kB/s), 600KiB/s-2445KiB/s (614kB/s-2503kB/s), io=20.0MiB (20.0MB), run=2932-3754msec WRITE: bw=7638KiB/s (7821kB/s), 1637KiB/s-2998KiB/s (1676kB/s-3070kB/s), io=28.0MiB (29.4MB), run=2932-3754msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145551: Mon Aug 24 17:32:42 2026 read: IOPS=2, BW=2562KiB/s (2623kB/s)(7168KiB/2798msec) clat (msec): min=53, max=405, avg=177.18, stdev=146.46 lat (msec): min=53, max=405, avg=177.18, stdev=146.46 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 93], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 108], 60.00th=[ 113], | 70.00th=[ 113], 80.00th=[ 372], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2015, max= 5840, per=83.24%, avg=3980.67, stdev=1914.72, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1830KiB/s (1874kB/s)(5120KiB/2798msec); 0 zone resets clat (msec): min=125, max=610, avg=288.83, stdev=197.26 lat (msec): min=125, max=610, avg=288.92, stdev=197.26 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2003, max= 6047, per=60.12%, avg=4025.00, stdev=2859.54, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=8.83%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145552: Mon Aug 24 17:32:42 2026 read: IOPS=0, BW=478KiB/s (490kB/s)(2048KiB/4282msec) clat (msec): min=85, max=264, avg=175.04, stdev=126.59 lat (msec): min=85, max=264, avg=175.04, stdev=126.59 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 86], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 2015, max= 2039, per=42.39%, avg=2027.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2391KiB/s (2449kB/s)(10.0MiB/4282msec); 0 zone resets clat (msec): min=137, max=1297, avg=384.22, stdev=367.96 lat (msec): min=138, max=1298, avg=384.32, stdev=367.94 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 142], | 30.00th=[ 163], 40.00th=[ 176], 50.00th=[ 203], 60.00th=[ 305], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 743], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 2031, max= 4096, per=40.48%, avg=2709.83, stdev=1039.64, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.59%, ctx=114, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145553: Mon Aug 24 17:32:42 2026 read: IOPS=1, BW=1612KiB/s (1650kB/s)(6144KiB/3812msec) clat (msec): min=118, max=478, avg=239.29, stdev=128.81 lat (msec): min=118, max=478, avg=239.30, stdev=128.81 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 249], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2043, max= 4063, per=70.49%, avg=3371.00, stdev=1150.42, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1612KiB/s (1650kB/s)(6144KiB/3812msec); 0 zone resets clat (msec): min=118, max=896, avg=384.44, stdev=290.59 lat (msec): min=118, max=896, avg=384.50, stdev=290.60 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 338], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2015, max= 3624, per=36.31%, avg=2431.25, stdev=795.28, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.08%, sys=6.25%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145554: Mon Aug 24 17:32:42 2026 read: IOPS=1, BW=1818KiB/s (1861kB/s)(5120KiB/2817msec) clat (msec): min=98, max=446, avg=238.79, stdev=127.85 lat (msec): min=98, max=446, avg=238.79, stdev=127.85 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2015, max= 6095, per=84.80%, avg=4055.00, stdev=2885.00, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2545KiB/s (2606kB/s)(7168KiB/2817msec); 0 zone resets clat (msec): min=122, max=473, avg=217.75, stdev=123.07 lat (msec): min=122, max=473, avg=217.83, stdev=123.09 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 125], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 176], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 243], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2003, max= 4015, per=37.63%, avg=2519.00, stdev=997.47, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.04%, sys=6.64%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4783KiB/s (4898kB/s), 478KiB/s-2562KiB/s (490kB/s-2623kB/s), io=20.0MiB (20.0MB), run=2798-4282msec WRITE: bw=6696KiB/s (6857kB/s), 1612KiB/s-2545KiB/s (1650kB/s-2606kB/s), io=28.0MiB (29.4MB), run=2798-4282msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145568: Mon Aug 24 17:32:55 2026 read: IOPS=1, BW=4414KiB/s (4520kB/s)(12.0MiB/2784msec) clat (msec): min=803, max=979, avg=872.38, stdev=94.27 lat (msec): min=803, max=979, avg=872.38, stdev=94.27 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7757, max= 8078, per=100.00%, avg=7917.50, stdev=226.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=15.49%, ctx=407, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145570: Mon Aug 24 17:32:55 2026 read: IOPS=0, BW=1715KiB/s (1756kB/s)(4096KiB/2388msec) clat (nsec): min=934103k, max=934103k, avg=934102732.00, stdev= 0.00 lat (nsec): min=934105k, max=934105k, avg=934105027.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3430KiB/s (3513kB/s)(8192KiB/2388msec); 0 zone resets clat (msec): min=650, max=693, avg=671.64, stdev=30.36 lat (msec): min=650, max=693, avg=671.97, stdev=30.36 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8078, max= 8078, per=89.72%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.16%, ctx=199, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145572: Mon Aug 24 17:32:55 2026 write: IOPS=0, BW=3377KiB/s (3458kB/s)(12.0MiB/3639msec); 0 zone resets clat (msec): min=437, max=2372, avg=1191.56, stdev=1035.90 lat (msec): min=437, max=2373, avg=1191.98, stdev=1035.85 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 7922, max= 8192, per=89.48%, avg=8057.00, stdev=190.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.68%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145573: Mon Aug 24 17:32:55 2026 write: IOPS=0, BW=3384KiB/s (3465kB/s)(12.0MiB/3631msec); 0 zone resets clat (msec): min=708, max=1993, avg=1177.79, stdev=708.94 lat (msec): min=709, max=1993, avg=1178.15, stdev=709.09 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 7846, max= 8078, per=88.43%, avg=7962.00, stdev=164.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.64%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5885KiB/s (6026kB/s), 1715KiB/s-4414KiB/s (1756kB/s-4520kB/s), io=16.0MiB (16.8MB), run=2388-2784msec WRITE: bw=9005KiB/s (9221kB/s), 3377KiB/s-3430KiB/s (3458kB/s-3513kB/s), io=32.0MiB (33.6MB), run=2388-3639msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145566: Mon Aug 24 17:32:55 2026 read: IOPS=1, BW=4161KiB/s (4261kB/s)(12.0MiB/2953msec) clat (msec): min=707, max=1150, avg=904.85, stdev=225.52 lat (msec): min=707, max=1150, avg=904.86, stdev=225.52 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8015, max= 8192, per=100.00%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.93%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145567: Mon Aug 24 17:32:55 2026 read: IOPS=0, BW=1392KiB/s (1425kB/s)(4096KiB/2943msec) clat (nsec): min=1478.3M, max=1478.3M, avg=1478327388.00, stdev= 0.00 lat (nsec): min=1478.3M, max=1478.3M, avg=1478330384.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1485], 5.00th=[ 1485], 10.00th=[ 1485], 20.00th=[ 1485], | 30.00th=[ 1485], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2784KiB/s (2850kB/s)(8192KiB/2943msec); 0 zone resets clat (msec): min=533, max=801, avg=667.41, stdev=189.87 lat (msec): min=533, max=801, avg=667.69, stdev=189.86 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8143, max= 8143, per=96.03%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.35%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145569: Mon Aug 24 17:32:55 2026 write: IOPS=0, BW=3180KiB/s (3256kB/s)(12.0MiB/3864msec); 0 zone resets clat (msec): min=199, max=2836, avg=1259.55, stdev=1392.49 lat (msec): min=200, max=2837, avg=1259.94, stdev=1392.58 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8175, max= 8175, per=96.40%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.49%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145571: Mon Aug 24 17:32:55 2026 write: IOPS=0, BW=3717KiB/s (3806kB/s)(12.0MiB/3306msec); 0 zone resets clat (msec): min=248, max=2323, avg=1043.93, stdev=1119.26 lat (msec): min=248, max=2324, avg=1044.30, stdev=1119.18 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 6671, max= 8015, per=86.59%, avg=7343.00, stdev=950.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.11%, ctx=78, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5548KiB/s (5681kB/s), 1392KiB/s-4161KiB/s (1425kB/s-4261kB/s), io=16.0MiB (16.8MB), run=2943-2953msec WRITE: bw=8480KiB/s (8684kB/s), 2784KiB/s-3717KiB/s (2850kB/s-3806kB/s), io=32.0MiB (33.6MB), run=2943-3864msec