== sanity test 398b: DIO and buffer IO race ============== 19:49:01 (1784591341) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.38213 s, 9.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178499: Mon Jul 20 19:50:59 2026 read: IOPS=14, BW=59.4KiB/s (60.8kB/s)(5992KiB/100874msec) clat (usec): min=36, max=793173, avg=36373.49, stdev=30109.86 lat (usec): min=36, max=793176, avg=36377.86, stdev=30108.36 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 9372], 10.00th=[ 13829], 20.00th=[ 18220], | 30.00th=[ 21890], 40.00th=[ 26084], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 64750], 95.00th=[ 79168], | 99.00th=[119014], 99.50th=[130548], 99.90th=[143655], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 144, per=24.93%, avg=59.09, stdev=23.08, samples=198 iops : min= 1, max= 36, avg=14.17, stdev= 5.85, samples=198 write: IOPS=15, BW=62.4KiB/s (63.9kB/s)(6296KiB/100874msec); 0 zone resets clat (usec): min=969, max=274503, avg=29185.45, stdev=28649.32 lat (usec): min=971, max=274505, avg=29191.59, stdev=28648.64 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1516], 10.00th=[ 2057], 20.00th=[ 4178], | 30.00th=[ 7701], 40.00th=[ 15401], 50.00th=[ 22152], 60.00th=[ 28967], | 70.00th=[ 36963], 80.00th=[ 50594], 90.00th=[ 66847], 95.00th=[ 87557], | 99.00th=[120062], 99.50th=[141558], 99.90th=[206570], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 15, max= 176, per=25.21%, avg=62.52, stdev=26.01, samples=197 iops : min= 3, max= 44, avg=15.03, stdev= 6.57, samples=197 lat (usec) : 50=0.13%, 100=1.63%, 250=0.10%, 500=0.03%, 1000=0.07% lat (msec) : 2=4.98%, 4=4.95%, 10=8.04%, 20=16.11%, 50=43.36% lat (msec) : 100=18.10%, 250=2.44%, 500=0.03%, 1000=0.03% cpu : usr=0.12%, sys=7.46%, ctx=7115, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178500: Mon Jul 20 19:50:59 2026 read: IOPS=14, BW=59.8KiB/s (61.2kB/s)(5940KiB/99401msec) clat (usec): min=35, max=237584, avg=36024.64, stdev=23862.69 lat (usec): min=35, max=237584, avg=36027.52, stdev=23863.13 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 10290], 10.00th=[ 13960], 20.00th=[ 18482], | 30.00th=[ 22676], 40.00th=[ 27132], 50.00th=[ 31327], 60.00th=[ 35914], | 70.00th=[ 42206], 80.00th=[ 49546], 90.00th=[ 64226], 95.00th=[ 77071], | 99.00th=[124257], 99.50th=[154141], 99.90th=[187696], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 6, max= 118, per=25.06%, avg=59.39, stdev=22.80, samples=195 iops : min= 1, max= 29, avg=14.23, stdev= 5.76, samples=195 write: IOPS=15, BW=63.9KiB/s (65.4kB/s)(6348KiB/99401msec); 0 zone resets clat (usec): min=1047, max=827066, avg=28701.15, stdev=34040.01 lat (usec): min=1049, max=827067, avg=28703.41, stdev=34039.84 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1549], 10.00th=[ 2245], 20.00th=[ 4080], | 30.00th=[ 7242], 40.00th=[ 14877], 50.00th=[ 20579], 60.00th=[ 27132], | 70.00th=[ 35390], 80.00th=[ 48497], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[122160], 99.50th=[137364], 99.90th=[189793], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 175, per=25.54%, avg=63.33, stdev=27.22, samples=195 iops : min= 1, max= 43, avg=15.22, stdev= 6.86, samples=195 lat (usec) : 50=0.07%, 100=1.37%, 250=0.29%, 500=0.03% lat (msec) : 2=4.62%, 4=5.57%, 10=8.04%, 20=16.73%, 50=43.82% lat (msec) : 100=17.35%, 250=2.08%, 1000=0.03% cpu : usr=0.12%, sys=7.63%, ctx=7184, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178501: Mon Jul 20 19:50:59 2026 read: IOPS=14, BW=59.6KiB/s (61.1kB/s)(6028KiB/101082msec) clat (usec): min=36, max=187824, avg=36354.79, stdev=23531.07 lat (usec): min=36, max=187826, avg=36362.15, stdev=23530.11 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10945], 10.00th=[ 14091], 20.00th=[ 19006], | 30.00th=[ 22938], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 36439], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 63701], 95.00th=[ 80217], | 99.00th=[128451], 99.50th=[143655], 99.90th=[164627], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7, max= 135, per=25.22%, avg=59.78, stdev=21.73, samples=198 iops : min= 1, max= 33, avg=14.34, stdev= 5.51, samples=198 write: IOPS=15, BW=61.9KiB/s (63.4kB/s)(6260KiB/101082msec); 0 zone resets clat (usec): min=943, max=756805, avg=29297.57, stdev=34367.91 lat (usec): min=945, max=756810, avg=29308.01, stdev=34365.48 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1582], 10.00th=[ 2040], 20.00th=[ 3851], | 30.00th=[ 6915], 40.00th=[ 13566], 50.00th=[ 21103], 60.00th=[ 28443], | 70.00th=[ 37487], 80.00th=[ 50070], 90.00th=[ 67634], 95.00th=[ 85459], | 99.00th=[137364], 99.50th=[149947], 99.90th=[210764], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 128, per=24.89%, avg=61.72, stdev=25.15, samples=199 iops : min= 1, max= 32, avg=14.82, stdev= 6.34, samples=199 lat (usec) : 50=0.26%, 100=1.07%, 250=0.23%, 500=0.07%, 1000=0.10% lat (msec) : 2=4.85%, 4=5.76%, 10=7.85%, 20=15.59%, 50=43.52% lat (msec) : 100=18.46%, 250=2.21%, 1000=0.03% cpu : usr=0.12%, sys=7.40%, ctx=7120, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178502: Mon Jul 20 19:50:59 2026 read: IOPS=15, BW=60.8KiB/s (62.3kB/s)(6052KiB/99515msec) clat (usec): min=36, max=699346, avg=36488.36, stdev=29083.48 lat (usec): min=36, max=699347, avg=36490.13, stdev=29083.40 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 9765], 10.00th=[ 13566], 20.00th=[ 18744], | 30.00th=[ 22152], 40.00th=[ 26084], 50.00th=[ 31065], 60.00th=[ 36963], | 70.00th=[ 43779], 80.00th=[ 50594], 90.00th=[ 64226], 95.00th=[ 77071], | 99.00th=[116917], 99.50th=[145753], 99.90th=[258999], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 6, max= 135, per=25.47%, avg=60.38, stdev=22.47, samples=197 iops : min= 1, max= 33, avg=14.49, stdev= 5.64, samples=197 write: IOPS=15, BW=62.7KiB/s (64.2kB/s)(6236KiB/99515msec); 0 zone resets clat (usec): min=970, max=216185, avg=28173.40, stdev=27465.88 lat (usec): min=972, max=216187, avg=28181.57, stdev=27462.68 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1483], 10.00th=[ 1975], 20.00th=[ 4015], | 30.00th=[ 6980], 40.00th=[ 15270], 50.00th=[ 21890], 60.00th=[ 27919], | 70.00th=[ 36963], 80.00th=[ 47449], 90.00th=[ 63177], 95.00th=[ 81265], | 99.00th=[121111], 99.50th=[139461], 99.90th=[200279], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 133, per=25.09%, avg=62.23, stdev=23.06, samples=197 iops : min= 1, max= 33, avg=14.94, stdev= 5.84, samples=197 lat (usec) : 50=0.20%, 100=1.63%, 250=0.03%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.05%, 4=5.01%, 10=8.04%, 20=15.33%, 50=45.05% lat (msec) : 100=17.32%, 250=2.15%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=7.47%, ctx=7028, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=238KiB/s (243kB/s), 59.4KiB/s-60.8KiB/s (60.8kB/s-62.3kB/s), io=23.4MiB (24.6MB), run=99401-101082msec WRITE: bw=249KiB/s (255kB/s), 61.9KiB/s-63.9KiB/s (63.4kB/s-65.4kB/s), io=24.6MiB (25.7MB), run=99401-101082msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178494: Mon Jul 20 19:51:30 2026 read: IOPS=11, BW=45.2KiB/s (46.3kB/s)(5992KiB/132639msec) clat (msec): min=4, max=826, avg=35.47, stdev=36.00 lat (msec): min=4, max=826, avg=35.47, stdev=36.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 74], 95.00th=[ 100], | 99.00th=[ 157], 99.50th=[ 171], 99.90th=[ 239], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 158, per=25.06%, avg=45.36, stdev=30.04, samples=258 iops : min= 1, max= 39, avg=10.72, stdev= 7.53, samples=258 write: IOPS=11, BW=47.5KiB/s (48.6kB/s)(6296KiB/132639msec); 0 zone resets clat (msec): min=8, max=308, avg=50.25, stdev=35.31 lat (msec): min=8, max=308, avg=50.26, stdev=35.31 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 60], 80.00th=[ 74], 90.00th=[ 94], 95.00th=[ 117], | 99.00th=[ 171], 99.50th=[ 203], 99.90th=[ 271], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 142, per=25.01%, avg=47.26, stdev=27.44, samples=260 iops : min= 1, max= 35, avg=11.20, stdev= 6.89, samples=260 lat (msec) : 10=3.12%, 20=21.91%, 50=45.41%, 100=23.05%, 250=6.35% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=3.11%, ctx=5273, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178495: Mon Jul 20 19:51:30 2026 read: IOPS=11, BW=44.9KiB/s (45.0kB/s)(5940KiB/132313msec) clat (msec): min=5, max=738, avg=33.60, stdev=32.82 lat (msec): min=5, max=738, avg=33.60, stdev=32.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 69], 95.00th=[ 92], | 99.00th=[ 140], 99.50th=[ 161], 99.90th=[ 190], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 159, per=24.73%, avg=44.75, stdev=30.76, samples=259 iops : min= 1, max= 39, avg=10.57, stdev= 7.72, samples=259 write: IOPS=11, BW=47.0KiB/s (49.1kB/s)(6348KiB/132313msec); 0 zone resets clat (msec): min=8, max=336, avg=51.68, stdev=37.47 lat (msec): min=8, max=336, avg=51.68, stdev=37.47 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 77], 90.00th=[ 101], 95.00th=[ 124], | 99.00th=[ 182], 99.50th=[ 207], 99.90th=[ 292], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 136, per=25.17%, avg=47.58, stdev=28.58, samples=260 iops : min= 1, max= 34, avg=11.28, stdev= 7.17, samples=260 lat (msec) : 10=3.81%, 20=23.18%, 50=43.55%, 100=22.36%, 250=6.97% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.07%, sys=3.13%, ctx=5343, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178496: Mon Jul 20 19:51:30 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6028KiB/131811msec) clat (msec): min=5, max=204, avg=35.03, stdev=29.64 lat (msec): min=5, max=204, avg=35.03, stdev=29.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 97], | 99.00th=[ 142], 99.50th=[ 159], 99.90th=[ 182], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 7, max= 175, per=25.29%, avg=45.78, stdev=29.43, samples=258 iops : min= 1, max= 43, avg=10.83, stdev= 7.40, samples=258 write: IOPS=11, BW=47.5KiB/s (48.6kB/s)(6260KiB/131811msec); 0 zone resets clat (msec): min=8, max=748, avg=50.23, stdev=40.42 lat (msec): min=8, max=748, avg=50.24, stdev=40.42 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 72], 90.00th=[ 95], 95.00th=[ 117], | 99.00th=[ 190], 99.50th=[ 236], 99.90th=[ 309], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 159, per=24.96%, avg=47.17, stdev=29.01, samples=260 iops : min= 1, max= 39, avg=11.17, stdev= 7.28, samples=260 lat (msec) : 10=4.17%, 20=21.00%, 50=46.09%, 100=22.04%, 250=6.48% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.08%, sys=3.10%, ctx=5205, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178497: Mon Jul 20 19:51:30 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6052KiB/132484msec) clat (msec): min=5, max=192, avg=34.75, stdev=28.71 lat (msec): min=5, max=192, avg=34.75, stdev=28.71 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 74], 95.00th=[ 96], | 99.00th=[ 140], 99.50th=[ 161], 99.90th=[ 184], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 7, max= 159, per=25.31%, avg=45.81, stdev=29.90, samples=259 iops : min= 1, max= 39, avg=10.83, stdev= 7.50, samples=259 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6236KiB/132484msec); 0 zone resets clat (msec): min=8, max=738, avg=50.99, stdev=39.73 lat (msec): min=8, max=738, avg=51.00, stdev=39.73 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 75], 90.00th=[ 99], 95.00th=[ 124], | 99.00th=[ 171], 99.50th=[ 197], 99.90th=[ 321], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 135, per=24.78%, avg=46.84, stdev=28.30, samples=261 iops : min= 1, max= 33, avg=11.09, stdev= 7.10, samples=261 lat (msec) : 10=3.78%, 20=21.58%, 50=45.05%, 100=22.85%, 250=6.64% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=3.14%, ctx=5318, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (185kB/s), 44.9KiB/s-45.7KiB/s (45.0kB/s-46.8kB/s), io=23.4MiB (24.6MB), run=131811-132639msec WRITE: bw=190KiB/s (194kB/s), 47.1KiB/s-47.0KiB/s (48.2kB/s-49.1kB/s), io=24.6MiB (25.7MB), run=131811-132639msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178545: Mon Jul 20 19:52:03 2026 read: IOPS=14, BW=227KiB/s (233kB/s)(5920KiB/26038msec) clat (usec): min=40, max=176645, avg=37668.48, stdev=24752.21 lat (usec): min=41, max=176647, avg=37670.00, stdev=24752.24 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 84], 10.00th=[ 10814], 20.00th=[ 20841], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 44303], 80.00th=[ 51119], 90.00th=[ 70779], 95.00th=[ 81265], | 99.00th=[127402], 99.50th=[131597], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 93, max= 446, per=24.57%, avg=225.76, stdev=76.73, samples=51 iops : min= 5, max= 27, avg=13.47, stdev= 4.80, samples=51 write: IOPS=15, BW=245KiB/s (250kB/s)(6368KiB/26038msec); 0 zone resets clat (usec): min=1160, max=169884, avg=29755.81, stdev=27345.31 lat (usec): min=1162, max=169887, avg=29758.97, stdev=27345.37 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2671], 10.00th=[ 3523], 20.00th=[ 6128], | 30.00th=[ 10421], 40.00th=[ 15795], 50.00th=[ 22152], 60.00th=[ 29230], | 70.00th=[ 37487], 80.00th=[ 50070], 90.00th=[ 66323], 95.00th=[ 85459], | 99.00th=[111674], 99.50th=[154141], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 89, max= 446, per=25.29%, avg=244.55, stdev=82.28, samples=51 iops : min= 5, max= 27, avg=14.65, stdev= 5.18, samples=51 lat (usec) : 50=0.26%, 100=2.34%, 250=0.91%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=5.60%, 10=9.51%, 20=12.63%, 50=46.61% lat (msec) : 100=18.49%, 250=2.34% cpu : usr=0.12%, sys=8.50%, ctx=1892, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178546: Mon Jul 20 19:52:03 2026 read: IOPS=14, BW=231KiB/s (236kB/s)(5744KiB/24872msec) clat (usec): min=41, max=196793, avg=35032.29, stdev=21527.43 lat (usec): min=42, max=196794, avg=35041.78, stdev=21528.46 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 172], 10.00th=[ 16188], 20.00th=[ 20055], | 30.00th=[ 23200], 40.00th=[ 27395], 50.00th=[ 31589], 60.00th=[ 35914], | 70.00th=[ 40633], 80.00th=[ 48497], 90.00th=[ 58983], 95.00th=[ 68682], | 99.00th=[114820], 99.50th=[143655], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 59, max= 446, per=25.23%, avg=231.90, stdev=89.43, samples=49 iops : min= 3, max= 27, avg=13.86, stdev= 5.61, samples=49 write: IOPS=16, BW=263KiB/s (269kB/s)(6544KiB/24872msec); 0 zone resets clat (usec): min=1479, max=145476, avg=29514.02, stdev=25817.70 lat (usec): min=1482, max=145479, avg=29517.17, stdev=25817.44 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2573], 10.00th=[ 3720], 20.00th=[ 6783], | 30.00th=[ 11076], 40.00th=[ 16909], 50.00th=[ 23462], 60.00th=[ 28705], | 70.00th=[ 35914], 80.00th=[ 49021], 90.00th=[ 65799], 95.00th=[ 84411], | 99.00th=[103285], 99.50th=[109577], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 95, max= 448, per=27.26%, avg=263.59, stdev=86.64, samples=49 iops : min= 5, max= 28, avg=15.86, stdev= 5.50, samples=49 lat (usec) : 50=0.13%, 100=1.82%, 250=0.39%, 500=0.13% lat (msec) : 2=1.17%, 4=4.82%, 10=9.24%, 20=15.36%, 50=47.79% lat (msec) : 100=17.84%, 250=1.30% cpu : usr=0.12%, sys=8.56%, ctx=1927, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178547: Mon Jul 20 19:52:03 2026 read: IOPS=15, BW=243KiB/s (248kB/s)(6256KiB/25782msec) clat (usec): min=44, max=195645, avg=35826.91, stdev=24750.79 lat (usec): min=45, max=195647, avg=35869.07, stdev=24831.48 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 76], 10.00th=[ 12387], 20.00th=[ 20055], | 30.00th=[ 23987], 40.00th=[ 27919], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 42730], 80.00th=[ 47973], 90.00th=[ 60556], 95.00th=[ 79168], | 99.00th=[132645], 99.50th=[187696], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 95, max= 415, per=26.46%, avg=243.14, stdev=68.90, samples=51 iops : min= 5, max= 25, avg=14.57, stdev= 4.36, samples=51 write: IOPS=14, BW=234KiB/s (240kB/s)(6032KiB/25782msec); 0 zone resets clat (usec): min=1491, max=205732, avg=30619.97, stdev=27774.84 lat (usec): min=1495, max=205735, avg=30623.01, stdev=27774.90 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2474], 10.00th=[ 3556], 20.00th=[ 6390], | 30.00th=[ 10683], 40.00th=[ 16909], 50.00th=[ 22414], 60.00th=[ 31065], | 70.00th=[ 42730], 80.00th=[ 50594], 90.00th=[ 66323], 95.00th=[ 80217], | 99.00th=[125305], 99.50th=[166724], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 62, max= 448, per=24.12%, avg=233.24, stdev=90.62, samples=51 iops : min= 3, max= 28, avg=13.94, stdev= 5.67, samples=51 lat (usec) : 50=0.13%, 100=3.26%, 250=0.65%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.17%, 4=4.17%, 10=9.11%, 20=14.19%, 50=48.05% lat (msec) : 100=16.93%, 250=2.08% cpu : usr=0.07%, sys=8.21%, ctx=1953, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178548: Mon Jul 20 19:52:03 2026 read: IOPS=14, BW=239KiB/s (245kB/s)(6032KiB/25226msec) clat (usec): min=38, max=114896, avg=35324.29, stdev=21841.47 lat (usec): min=39, max=114899, avg=35327.75, stdev=21840.94 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 108], 20.00th=[ 19792], | 30.00th=[ 24511], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 38536], | 70.00th=[ 43254], 80.00th=[ 50070], 90.00th=[ 61080], 95.00th=[ 77071], | 99.00th=[106431], 99.50th=[113771], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 62, max= 447, per=25.71%, avg=236.31, stdev=91.62, samples=49 iops : min= 3, max= 27, avg=14.14, stdev= 5.69, samples=49 write: IOPS=15, BW=248KiB/s (254kB/s)(6256KiB/25226msec); 0 zone resets clat (usec): min=1306, max=170150, avg=30201.28, stdev=28080.96 lat (usec): min=1308, max=170151, avg=30205.73, stdev=28080.14 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2180], 10.00th=[ 3130], 20.00th=[ 5342], | 30.00th=[ 10290], 40.00th=[ 16057], 50.00th=[ 21890], 60.00th=[ 28705], | 70.00th=[ 37487], 80.00th=[ 51119], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[110625], 99.50th=[132645], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 93, max= 447, per=25.52%, avg=246.80, stdev=85.10, samples=49 iops : min= 5, max= 27, avg=14.80, stdev= 5.34, samples=49 lat (usec) : 50=0.39%, 100=4.43%, 250=0.65%, 750=0.13% lat (msec) : 2=1.56%, 4=5.21%, 10=8.33%, 20=13.54%, 50=45.57% lat (msec) : 100=18.49%, 250=1.69% cpu : usr=0.11%, sys=8.15%, ctx=1866, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=920KiB/s (942kB/s), 227KiB/s-243KiB/s (233kB/s-248kB/s), io=23.4MiB (24.5MB), run=24872-26038msec WRITE: bw=968KiB/s (991kB/s), 234KiB/s-263KiB/s (240kB/s-269kB/s), io=24.6MiB (25.8MB), run=24872-26038msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178541: Mon Jul 20 19:52:11 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(5920KiB/33979msec) clat (msec): min=6, max=177, avg=35.48, stdev=26.69 lat (msec): min=6, max=177, avg=35.48, stdev=26.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 72], 95.00th=[ 95], | 99.00th=[ 130], 99.50th=[ 148], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 31, max= 480, per=24.75%, avg=172.52, stdev=101.27, samples=67 iops : min= 1, max= 30, avg=10.06, stdev= 6.42, samples=67 write: IOPS=11, BW=187KiB/s (192kB/s)(6368KiB/33979msec); 0 zone resets clat (msec): min=14, max=229, avg=51.94, stdev=33.49 lat (msec): min=14, max=229, avg=51.94, stdev=33.49 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 75], 90.00th=[ 96], 95.00th=[ 118], | 99.00th=[ 178], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 32, max= 445, per=25.42%, avg=186.34, stdev=97.96, samples=67 iops : min= 2, max= 27, avg=10.94, stdev= 6.13, samples=67 lat (msec) : 10=1.56%, 20=18.36%, 50=49.22%, 100=24.48%, 250=6.38% cpu : usr=0.08%, sys=3.10%, ctx=1235, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178542: Mon Jul 20 19:52:11 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5744KiB/34363msec) clat (msec): min=5, max=178, avg=35.30, stdev=29.59 lat (msec): min=5, max=178, avg=35.30, stdev=29.59 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 79], 95.00th=[ 100], | 99.00th=[ 155], 99.50th=[ 167], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 31, max= 572, per=23.75%, avg=165.51, stdev=102.88, samples=68 iops : min= 1, max= 35, avg= 9.63, stdev= 6.51, samples=68 write: IOPS=11, BW=190KiB/s (195kB/s)(6544KiB/34363msec); 0 zone resets clat (msec): min=7, max=231, avg=52.52, stdev=34.96 lat (msec): min=7, max=231, avg=52.52, stdev=34.96 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 62], 80.00th=[ 77], 90.00th=[ 101], 95.00th=[ 116], | 99.00th=[ 188], 99.50th=[ 201], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 600, per=25.87%, avg=189.62, stdev=112.46, samples=68 iops : min= 1, max= 37, avg=11.15, stdev= 7.13, samples=68 lat (msec) : 10=3.65%, 20=18.23%, 50=47.92%, 100=23.18%, 250=7.03% cpu : usr=0.10%, sys=3.19%, ctx=1346, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178543: Mon Jul 20 19:52:11 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(6256KiB/34107msec) clat (msec): min=7, max=153, avg=34.88, stdev=26.51 lat (msec): min=7, max=153, avg=34.88, stdev=26.51 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 70], 95.00th=[ 92], | 99.00th=[ 129], 99.50th=[ 136], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 31, max= 572, per=26.24%, avg=182.93, stdev=116.65, samples=67 iops : min= 1, max= 35, avg=10.73, stdev= 7.31, samples=67 write: IOPS=11, BW=177KiB/s (181kB/s)(6032KiB/34107msec); 0 zone resets clat (msec): min=14, max=211, avg=53.84, stdev=33.43 lat (msec): min=14, max=211, avg=53.84, stdev=33.43 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 84], 90.00th=[ 101], 95.00th=[ 118], | 99.00th=[ 150], 99.50th=[ 184], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 61, max= 479, per=23.69%, avg=173.61, stdev=94.30, samples=67 iops : min= 3, max= 29, avg=10.13, stdev= 5.97, samples=67 lat (msec) : 10=1.69%, 20=19.66%, 50=47.40%, 100=24.48%, 250=6.77% cpu : usr=0.08%, sys=3.19%, ctx=1304, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178544: Mon Jul 20 19:52:11 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(6032KiB/33763msec) clat (msec): min=6, max=176, avg=34.53, stdev=26.33 lat (msec): min=6, max=176, avg=34.53, stdev=26.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 73], 95.00th=[ 93], | 99.00th=[ 126], 99.50th=[ 153], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 31, max= 477, per=25.21%, avg=175.68, stdev=103.76, samples=66 iops : min= 1, max= 29, avg=10.24, stdev= 6.50, samples=66 write: IOPS=11, BW=185KiB/s (190kB/s)(6256KiB/33763msec); 0 zone resets clat (msec): min=14, max=230, avg=52.89, stdev=33.78 lat (msec): min=14, max=231, avg=52.90, stdev=33.78 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 74], 90.00th=[ 97], 95.00th=[ 117], | 99.00th=[ 190], 99.50th=[ 228], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 61, max= 442, per=24.92%, avg=182.68, stdev=87.89, samples=66 iops : min= 3, max= 27, avg=10.70, stdev= 5.55, samples=66 lat (msec) : 10=2.34%, 20=15.89%, 50=52.86%, 100=22.27%, 250=6.64% cpu : usr=0.08%, sys=3.28%, ctx=1241, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=697KiB/s (714kB/s), 167KiB/s-183KiB/s (171kB/s-188kB/s), io=23.4MiB (24.5MB), run=33763-34363msec WRITE: bw=733KiB/s (751kB/s), 177KiB/s-190KiB/s (181kB/s-195kB/s), io=24.6MiB (25.8MB), run=33763-34363msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178559: Mon Jul 20 19:52:24 2026 read: IOPS=1, BW=1509KiB/s (1545kB/s)(7168KiB/4750msec) clat (usec): min=450, max=2856.6k, avg=529964.25, stdev=1029618.98 lat (usec): min=452, max=2856.6k, avg=529965.43, stdev=1029618.97 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], | 20.00th=[ 114820], 30.00th=[ 120062], 40.00th=[ 120062], | 50.00th=[ 131597], 60.00th=[ 200279], 70.00th=[ 200279], | 80.00th=[ 283116], 90.00th=[2868904], 95.00th=[2868904], | 99.00th=[2868904], 99.50th=[2868904], 99.90th=[2868904], | 99.95th=[2868904], 99.99th=[2868904] bw ( KiB/s): min= 2031, max= 4087, per=69.19%, avg=2982.75, stdev=1103.91, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1078KiB/s (1104kB/s)(5120KiB/4750msec); 0 zone resets clat (msec): min=80, max=338, avg=186.69, stdev=99.29 lat (msec): min=80, max=338, avg=186.76, stdev=99.28 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2031, max= 4087, per=45.02%, avg=2717.67, stdev=1185.88, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.79%, ctx=443, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178560: Mon Jul 20 19:52:24 2026 read: IOPS=0, BW=532KiB/s (545kB/s)(2048KiB/3850msec) clat (usec): min=570, max=1021.0k, avg=510800.04, stdev=721573.01 lat (usec): min=572, max=1021.0k, avg=510802.01, stdev=721573.45 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], | 20.00th=[ 570], 30.00th=[ 570], 40.00th=[ 570], | 50.00th=[ 570], 60.00th=[1019216], 70.00th=[1019216], | 80.00th=[1019216], 90.00th=[1019216], 95.00th=[1019216], | 99.00th=[1019216], 99.50th=[1019216], 99.90th=[1019216], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 2039, max= 2043, per=47.34%, avg=2041.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2660KiB/s (2724kB/s)(10.0MiB/3850msec); 0 zone resets clat (msec): min=101, max=828, avg=266.97, stdev=207.01 lat (msec): min=101, max=828, avg=267.13, stdev=207.03 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 138], | 30.00th=[ 186], 40.00th=[ 192], 50.00th=[ 205], 60.00th=[ 207], | 70.00th=[ 209], 80.00th=[ 284], 90.00th=[ 321], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2039, max= 6131, per=67.73%, avg=4088.25, stdev=1670.56, samples=4 iops : min= 1, max= 5, avg= 3.25, stdev= 1.71, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=18.60%, ctx=255, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178561: Mon Jul 20 19:52:24 2026 read: IOPS=1, BW=1487KiB/s (1523kB/s)(6144KiB/4131msec) clat (usec): min=1507, max=459523, avg=193341.16, stdev=156868.12 lat (usec): min=1508, max=459524, avg=193342.60, stdev=156868.17 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1516], 10.00th=[ 1516], 20.00th=[104334], | 30.00th=[104334], 40.00th=[129500], 50.00th=[129500], 60.00th=[219153], | 70.00th=[246416], 80.00th=[246416], 90.00th=[459277], 95.00th=[459277], | 99.00th=[459277], 99.50th=[459277], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 2039, max= 4079, per=59.20%, avg=2552.25, stdev=1017.84, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1487KiB/s (1523kB/s)(6144KiB/4131msec); 0 zone resets clat (msec): min=96, max=1716, avg=493.17, stdev=619.22 lat (msec): min=96, max=1716, avg=493.24, stdev=619.21 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 435], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 2035, max= 4079, per=53.96%, avg=3257.00, stdev=1079.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 100=8.33%, 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=10.17%, ctx=264, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178562: Mon Jul 20 19:52:24 2026 read: IOPS=1, BW=1249KiB/s (1279kB/s)(5120KiB/4100msec) clat (usec): min=531, max=199479, avg=112130.02, stdev=102653.20 lat (usec): min=532, max=199481, avg=112131.21, stdev=102653.21 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 1631], 40.00th=[ 1631], 50.00th=[160433], 60.00th=[160433], | 70.00th=[198181], 80.00th=[198181], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 4087, max= 4096, per=94.91%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1748KiB/s (1790kB/s)(7168KiB/4100msec); 0 zone resets clat (msec): min=85, max=1379, avg=481.79, stdev=457.77 lat (msec): min=85, max=1379, avg=481.87, stdev=457.75 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 157], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 305], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 785], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1796, max= 4087, per=38.78%, avg=2340.67, stdev=861.10, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=12.81%, ctx=227, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4312KiB/s (4415kB/s), 532KiB/s-1509KiB/s (545kB/s-1545kB/s), io=20.0MiB (20.0MB), run=3850-4750msec WRITE: bw=6036KiB/s (6181kB/s), 1078KiB/s-2660KiB/s (1104kB/s-2724kB/s), io=28.0MiB (29.4MB), run=3850-4750msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178563: Mon Jul 20 19:52:25 2026 read: IOPS=1, BW=1453KiB/s (1488kB/s)(7168KiB/4933msec) clat (msec): min=64, max=2397, avg=551.03, stdev=833.70 lat (msec): min=64, max=2397, avg=551.03, stdev=833.70 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 70], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 259], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 575], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1932, max= 4096, per=60.87%, avg=2526.75, stdev=1047.42, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1038KiB/s (1063kB/s)(5120KiB/4933msec); 0 zone resets clat (msec): min=129, max=248, avg=179.02, stdev=47.99 lat (msec): min=129, max=248, avg=179.10, stdev=47.97 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 2031, max= 4096, per=52.71%, avg=3063.50, stdev=1460.18, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.54%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178564: Mon Jul 20 19:52:25 2026 read: IOPS=0, BW=489KiB/s (501kB/s)(2048KiB/4189msec) clat (msec): min=75, max=1068, avg=571.87, stdev=702.52 lat (msec): min=75, max=1068, avg=571.88, stdev=702.52 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1984, max= 2023, per=48.27%, avg=2003.50, stdev=27.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2444KiB/s (2503kB/s)(10.0MiB/4189msec); 0 zone resets clat (msec): min=49, max=824, avg=279.74, stdev=226.82 lat (msec): min=49, max=824, avg=279.87, stdev=226.83 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 117], | 30.00th=[ 118], 40.00th=[ 144], 50.00th=[ 194], 60.00th=[ 218], | 70.00th=[ 355], 80.00th=[ 380], 90.00th=[ 405], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2023, max= 6095, per=62.62%, avg=3639.40, stdev=1692.53, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.48, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.07%, sys=8.14%, ctx=158, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178565: Mon Jul 20 19:52:25 2026 read: IOPS=1, BW=1264KiB/s (1294kB/s)(6144KiB/4862msec) clat (msec): min=53, max=395, avg=213.69, stdev=151.82 lat (msec): min=53, max=395, avg=213.70, stdev=151.82 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2000, max= 4047, per=60.89%, avg=2527.50, stdev=1013.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1264KiB/s (1294kB/s)(6144KiB/4862msec); 0 zone resets clat (msec): min=111, max=1311, avg=591.87, stdev=420.55 lat (msec): min=111, max=1311, avg=591.96, stdev=420.55 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 514], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1984, max= 4000, per=41.65%, avg=2420.60, stdev=883.30, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=4.22%, ctx=91, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178566: Mon Jul 20 19:52:25 2026 read: IOPS=1, BW=1192KiB/s (1221kB/s)(5120KiB/4294msec) clat (msec): min=70, max=564, avg=174.90, stdev=217.98 lat (msec): min=70, max=564, avg=174.90, stdev=217.98 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 77], 60.00th=[ 77], | 70.00th=[ 91], 80.00th=[ 91], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 4031, max= 4047, per=97.30%, avg=4039.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1669KiB/s (1709kB/s)(7168KiB/4294msec); 0 zone resets clat (msec): min=74, max=1182, avg=462.05, stdev=407.08 lat (msec): min=74, max=1182, avg=462.12, stdev=407.08 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 201], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 300], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 877], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1984, max= 4000, per=43.22%, avg=2511.75, stdev=992.51, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=41.67%, 250=16.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=4.29%, ctx=103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4152KiB/s (4251kB/s), 489KiB/s-1453KiB/s (501kB/s-1488kB/s), io=20.0MiB (20.0MB), run=4189-4933msec WRITE: bw=5812KiB/s (5952kB/s), 1038KiB/s-2444KiB/s (1063kB/s-2503kB/s), io=28.0MiB (29.4MB), run=4189-4933msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178575: Mon Jul 20 19:52:35 2026 read: IOPS=2, BW=8208KiB/s (8405kB/s)(12.0MiB/1497msec) clat (msec): min=363, max=592, avg=482.51, stdev=114.97 lat (msec): min=363, max=592, avg=482.51, stdev=114.97 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 6430, max= 8094, per=89.68%, avg=7262.00, stdev=1176.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=5.68%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178577: Mon Jul 20 19:52:35 2026 read: IOPS=0, BW=2025KiB/s (2073kB/s)(4096KiB/2023msec) clat (nsec): min=1079.5M, max=1079.5M, avg=1079502014.00, stdev= 0.00 lat (nsec): min=1079.5M, max=1079.5M, avg=1079504496.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4049KiB/s (4147kB/s)(8192KiB/2023msec); 0 zone resets clat (msec): min=303, max=512, avg=407.91, stdev=147.21 lat (msec): min=304, max=512, avg=408.20, stdev=147.05 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.80%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178579: Mon Jul 20 19:52:35 2026 write: IOPS=1, BW=4849KiB/s (4966kB/s)(12.0MiB/2534msec); 0 zone resets clat (msec): min=133, max=2040, avg=824.32, stdev=1056.22 lat (msec): min=142, max=2041, avg=827.96, stdev=1054.06 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8143, max= 8143, per=62.97%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.71%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178581: Mon Jul 20 19:52:35 2026 write: IOPS=1, BW=7022KiB/s (7190kB/s)(12.0MiB/1750msec); 0 zone resets clat (msec): min=195, max=1276, avg=572.76, stdev=609.90 lat (msec): min=195, max=1276, avg=573.00, stdev=609.95 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min=11669, max=11669, per=90.24%, avg=11669.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.15%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8099KiB/s (8293kB/s), 2025KiB/s-8208KiB/s (2073kB/s-8405kB/s), io=16.0MiB (16.8MB), run=1497-2023msec WRITE: bw=12.6MiB/s (13.2MB/s), 4049KiB/s-7022KiB/s (4147kB/s-7190kB/s), io=32.0MiB (33.6MB), run=1750-2534msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178574: Mon Jul 20 19:52:35 2026 read: IOPS=2, BW=8445KiB/s (8648kB/s)(12.0MiB/1455msec) clat (msec): min=355, max=603, avg=476.63, stdev=124.05 lat (msec): min=355, max=603, avg=476.63, stdev=124.05 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8192, max= 8192, per=84.80%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=22.83%, ctx=472, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178576: Mon Jul 20 19:52:35 2026 read: IOPS=0, BW=2415KiB/s (2473kB/s)(4096KiB/1696msec) clat (nsec): min=347158k, max=347158k, avg=347158289.00, stdev= 0.00 lat (nsec): min=347162k, max=347162k, avg=347161645.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 6440, max= 6440, per=66.67%, avg=6440.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4830KiB/s (4946kB/s)(8192KiB/1696msec); 0 zone resets clat (msec): min=377, max=856, avg=616.89, stdev=338.70 lat (msec): min=377, max=857, avg=617.38, stdev=338.98 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8192, max= 8192, per=60.95%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.37%, ctx=100, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178578: Mon Jul 20 19:52:35 2026 write: IOPS=1, BW=5040KiB/s (5161kB/s)(12.0MiB/2438msec); 0 zone resets clat (msec): min=233, max=1737, avg=795.50, stdev=821.23 lat (msec): min=234, max=1738, avg=796.01, stdev=821.60 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8143, max= 8143, per=60.59%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.21%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178580: Mon Jul 20 19:52:35 2026 write: IOPS=1, BW=6074KiB/s (6220kB/s)(12.0MiB/2023msec); 0 zone resets clat (msec): min=396, max=1167, avg=664.36, stdev=436.31 lat (msec): min=396, max=1168, avg=664.71, stdev=436.20 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 6224, max= 8192, per=53.63%, avg=7208.00, stdev=1391.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.20%, sys=4.25%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9660KiB/s (9892kB/s), 2415KiB/s-8445KiB/s (2473kB/s-8648kB/s), io=16.0MiB (16.8MB), run=1455-1696msec WRITE: bw=13.1MiB/s (13.8MB/s), 4830KiB/s-6074KiB/s (4946kB/s-6220kB/s), io=32.0MiB (33.6MB), run=1696-2438msec