== sanity test 398b: DIO and buffer IO race ============== 18:10:55 (1788819055) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.27982 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179211: Mon Sep 7 18:13:16 2026 read: IOPS=12, BW=49.3KiB/s (50.5kB/s)(5992KiB/121605msec) clat (usec): min=41, max=772610, avg=44630.12, stdev=36268.97 lat (usec): min=42, max=772611, avg=44640.34, stdev=36268.75 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 11338], 10.00th=[ 16319], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 32900], 50.00th=[ 38536], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[145753], 99.50th=[179307], 99.90th=[417334], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 15, max= 131, per=24.84%, avg=48.93, stdev=20.60, samples=238 iops : min= 3, max= 32, avg=11.57, stdev= 5.18, samples=238 write: IOPS=12, BW=51.8KiB/s (53.0kB/s)(6296KiB/121605msec); 0 zone resets clat (usec): min=783, max=280821, avg=34664.28, stdev=35196.84 lat (usec): min=783, max=280823, avg=34667.99, stdev=35198.29 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1401], 10.00th=[ 1991], 20.00th=[ 4424], | 30.00th=[ 9241], 40.00th=[ 18220], 50.00th=[ 25560], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 58459], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[160433], 99.50th=[181404], 99.90th=[250610], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 191, per=25.03%, avg=51.56, stdev=23.73, samples=238 iops : min= 1, max= 47, avg=12.22, stdev= 5.96, samples=238 lat (usec) : 50=0.07%, 100=1.73%, 250=0.16%, 750=0.07%, 1000=0.20% lat (msec) : 2=5.05%, 4=4.36%, 10=6.64%, 20=11.52%, 50=41.15% lat (msec) : 100=24.32%, 250=4.59%, 500=0.13%, 1000=0.03% cpu : usr=0.11%, sys=5.65%, ctx=6982, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179212: Mon Sep 7 18:13:16 2026 read: IOPS=12, BW=49.3KiB/s (50.5kB/s)(5940KiB/120450msec) clat (usec): min=42, max=663905, avg=44443.70, stdev=32701.05 lat (usec): min=44, max=663907, avg=44450.19, stdev=32702.83 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 11994], 10.00th=[ 16450], 20.00th=[ 22414], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[145753], 99.50th=[168821], 99.90th=[278922], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 103, per=24.85%, avg=48.95, stdev=19.26, samples=237 iops : min= 1, max= 25, avg=11.57, stdev= 4.83, samples=237 write: IOPS=13, BW=52.7KiB/s (53.0kB/s)(6348KiB/120450msec); 0 zone resets clat (usec): min=911, max=290067, avg=34142.02, stdev=34693.74 lat (usec): min=913, max=290068, avg=34145.53, stdev=34693.46 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1401], 10.00th=[ 1926], 20.00th=[ 4047], | 30.00th=[ 8455], 40.00th=[ 17433], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[160433], 99.50th=[200279], 99.90th=[270533], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 15, max= 127, per=25.44%, avg=52.41, stdev=21.82, samples=236 iops : min= 3, max= 31, avg=12.44, stdev= 5.49, samples=236 lat (usec) : 50=0.10%, 100=1.56%, 250=0.07%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.37%, 4=4.85%, 10=6.58%, 20=11.00%, 50=41.28% lat (msec) : 100=24.87%, 250=4.04%, 500=0.10%, 750=0.03% cpu : usr=0.10%, sys=5.77%, ctx=6804, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179213: Mon Sep 7 18:13:16 2026 read: IOPS=12, BW=49.6KiB/s (50.7kB/s)(6028KiB/121646msec) clat (usec): min=46, max=230709, avg=43396.03, stdev=27915.95 lat (usec): min=46, max=230710, avg=43409.68, stdev=27932.37 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 12256], 10.00th=[ 16712], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[177210], 99.90th=[219153], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 95, per=25.07%, avg=49.38, stdev=17.72, samples=237 iops : min= 1, max= 23, avg=11.68, stdev= 4.47, samples=237 write: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6260KiB/121646msec); 0 zone resets clat (usec): min=850, max=667031, avg=35803.07, stdev=37789.07 lat (usec): min=852, max=667033, avg=35806.54, stdev=37789.34 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1434], 10.00th=[ 2008], 20.00th=[ 4178], | 30.00th=[ 9634], 40.00th=[ 18482], 50.00th=[ 28181], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 60031], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[145753], 99.50th=[160433], 99.90th=[283116], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 119, per=24.68%, avg=50.84, stdev=22.20, samples=239 iops : min= 1, max= 29, avg=12.05, stdev= 5.58, samples=239 lat (usec) : 50=0.07%, 100=1.40%, 250=0.07%, 1000=0.07% lat (msec) : 2=5.05%, 4=4.85%, 10=6.02%, 20=11.43%, 50=42.15% lat (msec) : 100=24.38%, 250=4.43%, 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=5.73%, ctx=6947, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179214: Mon Sep 7 18:13:16 2026 read: IOPS=12, BW=50.3KiB/s (51.5kB/s)(6052KiB/120278msec) clat (usec): min=46, max=235294, avg=43065.70, stdev=28000.19 lat (usec): min=47, max=235296, avg=43079.50, stdev=27998.03 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 10945], 10.00th=[ 16450], 20.00th=[ 21627], | 30.00th=[ 26608], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[162530], 99.90th=[200279], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 95, per=25.25%, avg=49.75, stdev=19.28, samples=236 iops : min= 1, max= 23, avg=11.77, stdev= 4.85, samples=236 write: IOPS=12, BW=51.8KiB/s (53.1kB/s)(6236KiB/120278msec); 0 zone resets clat (usec): min=876, max=672338, avg=35179.26, stdev=38529.17 lat (usec): min=877, max=672341, avg=35185.90, stdev=38525.90 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1401], 10.00th=[ 1975], 20.00th=[ 4555], | 30.00th=[ 8717], 40.00th=[ 18744], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[154141], 99.50th=[170918], 99.90th=[320865], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 151, per=24.92%, avg=51.33, stdev=21.99, samples=236 iops : min= 1, max= 37, avg=12.18, stdev= 5.54, samples=236 lat (usec) : 50=0.03%, 100=1.69%, 250=0.16%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.21%, 4=4.13%, 10=7.19%, 20=10.81%, 50=42.71% lat (msec) : 100=22.88%, 250=4.85%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.81%, ctx=6924, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=197KiB/s (202kB/s), 49.3KiB/s-50.3KiB/s (50.5kB/s-51.5kB/s), io=23.4MiB (24.6MB), run=120278-121646msec WRITE: bw=207KiB/s (212kB/s), 51.5KiB/s-52.7KiB/s (52.7kB/s-53.0kB/s), io=24.6MiB (25.7MB), run=120278-121646msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179206: Mon Sep 7 18:13:55 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(5992KiB/161006msec) clat (msec): min=4, max=1015, avg=42.99, stdev=43.66 lat (msec): min=4, max=1015, avg=42.99, stdev=43.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 91], 95.00th=[ 118], | 99.00th=[ 178], 99.50th=[ 197], 99.90th=[ 255], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 192, per=25.42%, avg=37.62, stdev=26.44, samples=310 iops : min= 1, max= 48, avg= 8.75, stdev= 6.65, samples=310 write: IOPS=9, BW=39.1KiB/s (40.0kB/s)(6296KiB/161006msec); 0 zone resets clat (msec): min=9, max=373, avg=61.06, stdev=42.35 lat (msec): min=9, max=373, avg=61.06, stdev=42.35 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 115], 95.00th=[ 146], | 99.00th=[ 199], 99.50th=[ 218], 99.90th=[ 347], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 119, per=25.09%, avg=38.89, stdev=23.30, samples=315 iops : min= 1, max= 29, avg= 9.06, stdev= 5.85, samples=315 lat (msec) : 10=2.21%, 20=16.28%, 50=42.94%, 100=26.73%, 250=11.65% lat (msec) : 500=0.16%, 2000=0.03% cpu : usr=0.07%, sys=2.05%, ctx=4738, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179207: Mon Sep 7 18:13:55 2026 read: IOPS=9, BW=37.1KiB/s (38.0kB/s)(5940KiB/159911msec) clat (msec): min=5, max=909, avg=41.69, stdev=42.93 lat (msec): min=5, max=909, avg=41.69, stdev=42.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 86], 95.00th=[ 114], | 99.00th=[ 190], 99.50th=[ 211], 99.90th=[ 342], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 176, per=25.58%, avg=37.87, stdev=26.63, samples=305 iops : min= 1, max= 44, avg= 8.81, stdev= 6.69, samples=305 write: IOPS=9, BW=39.7KiB/s (40.6kB/s)(6348KiB/159911msec); 0 zone resets clat (msec): min=9, max=415, avg=61.47, stdev=42.46 lat (msec): min=9, max=415, avg=61.47, stdev=42.46 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 90], 90.00th=[ 117], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 241], 99.90th=[ 338], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 158, per=25.50%, avg=39.52, stdev=23.77, samples=313 iops : min= 1, max= 39, avg= 9.22, stdev= 5.98, samples=313 lat (msec) : 10=3.09%, 20=16.28%, 50=42.61%, 100=26.79%, 250=10.97% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=2.01%, ctx=4905, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179208: Mon Sep 7 18:13:55 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6028KiB/160769msec) clat (msec): min=5, max=317, avg=42.31, stdev=36.90 lat (msec): min=5, max=317, avg=42.32, stdev=36.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 89], 95.00th=[ 115], | 99.00th=[ 180], 99.50th=[ 222], 99.90th=[ 305], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 173, per=25.61%, avg=37.90, stdev=24.71, samples=310 iops : min= 1, max= 43, avg= 8.82, stdev= 6.21, samples=310 write: IOPS=9, BW=38.9KiB/s (39.9kB/s)(6260KiB/160769msec); 0 zone resets clat (msec): min=10, max=911, avg=61.68, stdev=46.99 lat (msec): min=10, max=911, avg=61.70, stdev=46.98 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 90], 90.00th=[ 117], 95.00th=[ 142], | 99.00th=[ 215], 99.50th=[ 234], 99.90th=[ 347], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 134, per=24.99%, avg=38.73, stdev=24.15, samples=315 iops : min= 1, max= 33, avg= 9.03, stdev= 6.07, samples=315 lat (msec) : 10=2.08%, 20=15.07%, 50=45.38%, 100=25.59%, 250=11.59% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=2.00%, ctx=4735, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179209: Mon Sep 7 18:13:55 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6052KiB/161161msec) clat (msec): min=5, max=294, avg=42.32, stdev=36.43 lat (msec): min=5, max=294, avg=42.32, stdev=36.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 90], 95.00th=[ 117], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 249], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 167, per=25.71%, avg=38.05, stdev=25.96, samples=309 iops : min= 1, max= 41, avg= 8.85, stdev= 6.51, samples=309 write: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6236KiB/161162msec); 0 zone resets clat (msec): min=8, max=921, avg=62.01, stdev=48.94 lat (msec): min=8, max=921, avg=62.01, stdev=48.94 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 34], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 89], 90.00th=[ 118], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 275], 99.90th=[ 418], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 142, per=24.85%, avg=38.52, stdev=23.32, samples=314 iops : min= 1, max= 35, avg= 8.97, stdev= 5.86, samples=314 lat (msec) : 10=2.47%, 20=15.89%, 50=43.23%, 100=26.46%, 250=11.56% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=1.96%, ctx=4819, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 37.1KiB/s-37.6KiB/s (38.0kB/s-38.5kB/s), io=23.4MiB (24.6MB), run=159911-161161msec WRITE: bw=156KiB/s (160kB/s), 38.7KiB/s-39.7KiB/s (39.6kB/s-40.6kB/s), io=24.6MiB (25.7MB), run=159911-161162msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179262: Mon Sep 7 18:14:47 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(5920KiB/41021msec) clat (usec): min=33, max=282186, avg=56486.48, stdev=42913.90 lat (usec): min=33, max=282187, avg=56493.73, stdev=42915.45 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 73], 10.00th=[ 469], 20.00th=[ 24511], | 30.00th=[ 31851], 40.00th=[ 39060], 50.00th=[ 49021], 60.00th=[ 55837], | 70.00th=[ 68682], 80.00th=[ 85459], 90.00th=[108528], 95.00th=[130548], | 99.00th=[221250], 99.50th=[238027], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 349, per=25.19%, avg=145.36, stdev=68.86, samples=78 iops : min= 1, max= 21, avg= 8.26, stdev= 4.33, samples=78 write: IOPS=9, BW=155KiB/s (159kB/s)(6368KiB/41021msec); 0 zone resets clat (usec): min=1180, max=266837, avg=50399.79, stdev=50074.78 lat (usec): min=1182, max=266839, avg=50405.91, stdev=50071.63 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2073], 10.00th=[ 3687], 20.00th=[ 7898], | 30.00th=[ 15401], 40.00th=[ 23462], 50.00th=[ 33817], 60.00th=[ 47973], | 70.00th=[ 64750], 80.00th=[ 88605], 90.00th=[123208], 95.00th=[149947], | 99.00th=[221250], 99.50th=[238027], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 440, per=25.28%, avg=153.73, stdev=67.20, samples=80 iops : min= 1, max= 27, avg= 8.80, stdev= 4.24, samples=80 lat (usec) : 50=0.39%, 100=3.12%, 250=1.04%, 500=0.26% lat (msec) : 2=2.21%, 4=3.52%, 10=6.77%, 20=8.85%, 50=30.86% lat (msec) : 100=28.39%, 250=14.32%, 500=0.26% cpu : usr=0.10%, sys=4.71%, ctx=1706, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179263: Mon Sep 7 18:14:47 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(5744KiB/41009msec) clat (usec): min=58, max=399316, avg=62339.87, stdev=45211.45 lat (usec): min=59, max=399317, avg=62342.48, stdev=45213.98 clat percentiles (usec): | 1.00th=[ 66], 5.00th=[ 95], 10.00th=[ 23462], 20.00th=[ 30802], | 30.00th=[ 38536], 40.00th=[ 47449], 50.00th=[ 56886], 60.00th=[ 64226], | 70.00th=[ 72877], 80.00th=[ 86508], 90.00th=[106431], 95.00th=[127402], | 99.00th=[235930], 99.50th=[350225], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 31, max= 287, per=24.37%, avg=140.59, stdev=58.90, samples=79 iops : min= 1, max= 17, avg= 7.96, stdev= 3.70, samples=79 write: IOPS=9, BW=160KiB/s (163kB/s)(6544KiB/41009msec); 0 zone resets clat (usec): min=1141, max=182522, avg=45460.51, stdev=43440.41 lat (usec): min=1142, max=182525, avg=45467.33, stdev=43443.90 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2212], 10.00th=[ 4047], 20.00th=[ 7242], | 30.00th=[ 13435], 40.00th=[ 22938], 50.00th=[ 33817], 60.00th=[ 44303], | 70.00th=[ 57410], 80.00th=[ 77071], 90.00th=[109577], 95.00th=[141558], | 99.00th=[175113], 99.50th=[177210], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 380, per=26.68%, avg=162.22, stdev=76.70, samples=78 iops : min= 1, max= 23, avg= 9.32, stdev= 4.80, samples=78 lat (usec) : 100=2.47%, 250=0.52% lat (msec) : 2=1.95%, 4=3.12%, 10=8.85%, 20=6.64%, 50=30.60% lat (msec) : 100=32.68%, 250=12.76%, 500=0.39% cpu : usr=0.08%, sys=5.02%, ctx=1768, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179264: Mon Sep 7 18:14:47 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6256KiB/41447msec) clat (usec): min=39, max=266903, avg=58586.11, stdev=41306.59 lat (usec): min=40, max=266907, avg=58617.94, stdev=41326.12 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 75], 10.00th=[ 1811], 20.00th=[ 27132], | 30.00th=[ 36439], 40.00th=[ 44303], 50.00th=[ 51119], 60.00th=[ 60556], | 70.00th=[ 72877], 80.00th=[ 85459], 90.00th=[114820], 95.00th=[135267], | 99.00th=[189793], 99.50th=[227541], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 351, per=26.11%, avg=150.63, stdev=72.41, samples=81 iops : min= 1, max= 21, avg= 8.59, stdev= 4.53, samples=81 write: IOPS=9, BW=146KiB/s (149kB/s)(6032KiB/41447msec); 0 zone resets clat (usec): min=1498, max=306553, avg=49044.46, stdev=48406.44 lat (usec): min=1500, max=306556, avg=49047.08, stdev=48406.49 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2147], 10.00th=[ 3523], 20.00th=[ 8291], | 30.00th=[ 17957], 40.00th=[ 28181], 50.00th=[ 36963], 60.00th=[ 49021], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[110625], 95.00th=[149947], | 99.00th=[242222], 99.50th=[295699], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 381, per=24.13%, avg=146.71, stdev=67.56, samples=79 iops : min= 1, max= 23, avg= 8.35, stdev= 4.26, samples=79 lat (usec) : 50=0.13%, 100=4.30%, 250=0.39%, 750=0.13% lat (msec) : 2=2.21%, 4=3.52%, 10=5.08%, 20=6.77%, 50=31.64% lat (msec) : 100=32.29%, 250=13.02%, 500=0.52% cpu : usr=0.10%, sys=5.01%, ctx=1786, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179265: Mon Sep 7 18:14:47 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38885msec) clat (usec): min=26, max=190515, avg=53945.73, stdev=36315.49 lat (usec): min=26, max=190516, avg=53947.18, stdev=36315.52 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 67], 10.00th=[ 118], 20.00th=[ 26346], | 30.00th=[ 35914], 40.00th=[ 41681], 50.00th=[ 49546], 60.00th=[ 56361], | 70.00th=[ 68682], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[126354], | 99.00th=[162530], 99.50th=[179307], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 319, per=26.66%, avg=153.83, stdev=71.83, samples=76 iops : min= 1, max= 19, avg= 8.79, stdev= 4.48, samples=76 write: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38885msec); 0 zone resets clat (usec): min=1336, max=274846, avg=47246.25, stdev=47132.31 lat (usec): min=1338, max=274849, avg=47250.10, stdev=47132.68 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2376], 10.00th=[ 4047], 20.00th=[ 7701], | 30.00th=[ 13304], 40.00th=[ 22152], 50.00th=[ 33162], 60.00th=[ 43254], | 70.00th=[ 60031], 80.00th=[ 81265], 90.00th=[119014], 95.00th=[139461], | 99.00th=[208667], 99.50th=[258999], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 447, per=26.42%, avg=160.66, stdev=73.50, samples=76 iops : min= 1, max= 27, avg= 9.24, stdev= 4.62, samples=76 lat (usec) : 50=0.78%, 100=3.91%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=1.95%, 4=3.52%, 10=8.20%, 20=7.68%, 50=30.99% lat (msec) : 100=29.95%, 250=11.98%, 500=0.26% cpu : usr=0.07%, sys=5.19%, ctx=1661, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=578KiB/s (592kB/s), 140KiB/s-155KiB/s (143kB/s-159kB/s), io=23.4MiB (24.5MB), run=38885-41447msec WRITE: bw=608KiB/s (623kB/s), 146KiB/s-161KiB/s (149kB/s-165kB/s), io=24.6MiB (25.8MB), run=38885-41447msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179257: Mon Sep 7 18:14:59 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(5920KiB/54713msec) clat (msec): min=6, max=370, avg=59.79, stdev=58.26 lat (msec): min=6, max=370, avg=59.79, stdev=58.26 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 83], 90.00th=[ 138], 95.00th=[ 194], | 99.00th=[ 288], 99.50th=[ 313], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 380, per=25.11%, avg=109.73, stdev=75.95, samples=104 iops : min= 1, max= 23, avg= 6.04, stdev= 4.83, samples=104 write: IOPS=7, BW=116KiB/s (119kB/s)(6368KiB/54713msec); 0 zone resets clat (msec): min=15, max=339, avg=81.16, stdev=55.31 lat (msec): min=15, max=339, avg=81.18, stdev=55.32 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 96], 80.00th=[ 123], 90.00th=[ 167], 95.00th=[ 201], | 99.00th=[ 245], 99.50th=[ 321], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 26, max= 349, per=26.07%, avg=119.93, stdev=73.46, samples=103 iops : min= 1, max= 21, avg= 6.67, stdev= 4.67, samples=103 lat (msec) : 10=0.39%, 20=7.68%, 50=42.45%, 100=27.47%, 250=20.83% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.53%, ctx=1182, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179258: Mon Sep 7 18:14:59 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(5744KiB/54741msec) clat (msec): min=7, max=243, avg=55.97, stdev=47.97 lat (msec): min=7, max=243, avg=55.97, stdev=47.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 79], 90.00th=[ 116], 95.00th=[ 169], | 99.00th=[ 241], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 380, per=25.42%, avg=111.10, stdev=76.93, samples=100 iops : min= 1, max= 23, avg= 6.13, stdev= 4.87, samples=100 write: IOPS=7, BW=120KiB/s (122kB/s)(6544KiB/54741msec); 0 zone resets clat (msec): min=13, max=372, avg=84.48, stdev=61.24 lat (msec): min=13, max=372, avg=84.48, stdev=61.24 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 45], 40.00th=[ 54], 50.00th=[ 64], 60.00th=[ 84], | 70.00th=[ 102], 80.00th=[ 125], 90.00th=[ 174], 95.00th=[ 213], | 99.00th=[ 279], 99.50th=[ 338], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 384, per=26.25%, avg=120.74, stdev=78.60, samples=105 iops : min= 1, max= 24, avg= 6.73, stdev= 5.00, samples=105 lat (msec) : 10=0.91%, 20=8.46%, 50=37.50%, 100=31.51%, 250=20.18% lat (msec) : 500=1.43% cpu : usr=0.05%, sys=1.51%, ctx=1166, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179259: Mon Sep 7 18:14:59 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/53762msec) clat (msec): min=8, max=355, avg=60.47, stdev=57.15 lat (msec): min=8, max=355, avg=60.48, stdev=57.15 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 86], 90.00th=[ 133], 95.00th=[ 190], | 99.00th=[ 279], 99.50th=[ 347], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 380, per=27.08%, avg=118.35, stdev=83.86, samples=104 iops : min= 1, max= 23, avg= 6.59, stdev= 5.33, samples=104 write: IOPS=7, BW=112KiB/s (115kB/s)(6032KiB/53762msec); 0 zone resets clat (msec): min=11, max=344, avg=79.43, stdev=57.18 lat (msec): min=11, max=344, avg=79.43, stdev=57.18 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 93], 80.00th=[ 120], 90.00th=[ 163], 95.00th=[ 192], | 99.00th=[ 288], 99.50th=[ 334], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 384, per=24.75%, avg=113.84, stdev=73.83, samples=104 iops : min= 1, max= 24, avg= 6.29, stdev= 4.70, samples=104 lat (msec) : 10=0.26%, 20=8.72%, 50=41.54%, 100=29.04%, 250=18.62% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.61%, ctx=1195, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179260: Mon Sep 7 18:14:59 2026 read: IOPS=6, BW=112KiB/s (115kB/s)(6032KiB/53908msec) clat (msec): min=8, max=347, avg=57.65, stdev=55.49 lat (msec): min=8, max=347, avg=57.65, stdev=55.49 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 60], 80.00th=[ 81], 90.00th=[ 129], 95.00th=[ 174], | 99.00th=[ 300], 99.50th=[ 330], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 27, max= 352, per=26.38%, avg=115.26, stdev=79.99, samples=102 iops : min= 1, max= 22, avg= 6.38, stdev= 5.10, samples=102 write: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/53908msec); 0 zone resets clat (msec): min=11, max=319, avg=81.55, stdev=56.79 lat (msec): min=11, max=319, avg=81.55, stdev=56.79 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 75], | 70.00th=[ 99], 80.00th=[ 124], 90.00th=[ 159], 95.00th=[ 194], | 99.00th=[ 284], 99.50th=[ 313], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 414, per=25.92%, avg=119.23, stdev=75.34, samples=103 iops : min= 1, max= 25, avg= 6.63, stdev= 4.78, samples=103 lat (msec) : 10=0.52%, 20=8.59%, 50=41.02%, 100=27.60%, 250=20.57% lat (msec) : 500=1.69% cpu : usr=0.06%, sys=1.65%, ctx=1252, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=438KiB/s (448kB/s), 105KiB/s-116KiB/s (107kB/s-119kB/s), io=23.4MiB (24.5MB), run=53762-54741msec WRITE: bw=460KiB/s (471kB/s), 112KiB/s-120KiB/s (115kB/s-122kB/s), io=24.6MiB (25.8MB), run=53762-54741msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179278: Mon Sep 7 18:15:13 2026 read: IOPS=2, BW=2607KiB/s (2670kB/s)(7168KiB/2749msec) clat (msec): min=73, max=476, avg=216.97, stdev=157.45 lat (msec): min=73, max=476, avg=216.97, stdev=157.45 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 121], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 405], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1917, max= 5728, per=68.47%, avg=3207.00, stdev=2183.45, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1862KiB/s (1907kB/s)(5120KiB/2749msec); 0 zone resets clat (msec): min=95, max=460, avg=235.70, stdev=136.73 lat (msec): min=95, max=460, avg=235.85, stdev=136.72 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1432, max= 3893, per=37.11%, avg=2433.67, stdev=1292.76, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=5.02%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179279: Mon Sep 7 18:15:13 2026 read: IOPS=0, BW=550KiB/s (563kB/s)(2048KiB/3722msec) clat (msec): min=133, max=200, avg=167.11, stdev=47.27 lat (msec): min=133, max=200, avg=167.11, stdev=47.27 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 1477, max= 1946, per=36.54%, avg=1711.50, stdev=331.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2751KiB/s (2817kB/s)(10.0MiB/3722msec); 0 zone resets clat (msec): min=89, max=784, avg=320.62, stdev=256.10 lat (msec): min=89, max=784, avg=320.93, stdev=256.37 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 108], | 30.00th=[ 115], 40.00th=[ 165], 50.00th=[ 178], 60.00th=[ 199], | 70.00th=[ 359], 80.00th=[ 531], 90.00th=[ 676], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1917, max= 5930, per=51.43%, avg=3372.80, stdev=1663.34, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=16.67%, 1000=8.33% cpu : usr=0.05%, sys=2.63%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179280: Mon Sep 7 18:15:13 2026 read: IOPS=1, BW=1405KiB/s (1439kB/s)(6144KiB/4372msec) clat (msec): min=164, max=1088, avg=437.73, stdev=370.32 lat (msec): min=164, max=1088, avg=437.73, stdev=370.32 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 292], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1946, max= 2031, per=42.56%, avg=1993.60, stdev=33.44, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1405KiB/s (1439kB/s)(6144KiB/4372msec); 0 zone resets clat (msec): min=168, max=436, avg=268.53, stdev=107.65 lat (msec): min=168, max=436, avg=268.85, stdev=107.87 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 236], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1946, max= 2892, per=33.07%, avg=2169.00, stdev=405.37, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.80%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179281: Mon Sep 7 18:15:13 2026 read: IOPS=1, BW=1299KiB/s (1330kB/s)(5120KiB/3943msec) clat (msec): min=155, max=1010, avg=415.03, stdev=346.42 lat (msec): min=155, max=1010, avg=415.04, stdev=346.42 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1946, max= 4031, per=56.60%, avg=2651.00, stdev=1195.21, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1818KiB/s (1862kB/s)(7168KiB/3943msec); 0 zone resets clat (msec): min=72, max=718, avg=255.14, stdev=220.17 lat (msec): min=72, max=718, avg=255.42, stdev=220.05 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 106], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 190], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 321], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2000, max= 3953, per=42.84%, avg=2809.75, stdev=960.45, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.17%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4684KiB/s (4797kB/s), 550KiB/s-2607KiB/s (563kB/s-2670kB/s), io=20.0MiB (20.0MB), run=2749-4372msec WRITE: bw=6558KiB/s (6715kB/s), 1405KiB/s-2751KiB/s (1439kB/s-2817kB/s), io=28.0MiB (29.4MB), run=2749-4372msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179283: Mon Sep 7 18:15:13 2026 read: IOPS=2, BW=2205KiB/s (2258kB/s)(7168KiB/3251msec) clat (usec): min=660, max=268894, avg=144908.86, stdev=107322.27 lat (usec): min=661, max=268895, avg=144910.36, stdev=107322.31 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 955], | 30.00th=[133694], 40.00th=[133694], 50.00th=[173016], 60.00th=[200279], | 70.00th=[200279], 80.00th=[233833], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 2023, max= 4140, per=51.87%, avg=2730.00, stdev=1221.10, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1575KiB/s (1613kB/s)(5120KiB/3251msec); 0 zone resets clat (msec): min=183, max=677, avg=446.95, stdev=185.15 lat (msec): min=183, max=677, avg=447.02, stdev=185.16 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1954, max= 2043, per=27.23%, avg=2006.67, stdev=46.69, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=12.74%, ctx=137, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179284: Mon Sep 7 18:15:13 2026 read: IOPS=0, BW=546KiB/s (559kB/s)(2048KiB/3751msec) clat (usec): min=1460, max=227354, avg=114407.42, stdev=159731.34 lat (usec): min=1461, max=227356, avg=114408.81, stdev=159731.46 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1467], 10.00th=[ 1467], 20.00th=[ 1467], | 30.00th=[ 1467], 40.00th=[ 1467], 50.00th=[ 1467], 60.00th=[227541], | 70.00th=[227541], 80.00th=[227541], 90.00th=[227541], 95.00th=[227541], | 99.00th=[227541], 99.50th=[227541], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 1406, max= 2011, per=32.46%, avg=1708.50, stdev=427.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2730KiB/s (2795kB/s)(10.0MiB/3751msec); 0 zone resets clat (msec): min=56, max=1536, avg=351.77, stdev=451.11 lat (msec): min=56, max=1536, avg=352.04, stdev=451.06 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 70], | 30.00th=[ 79], 40.00th=[ 140], 50.00th=[ 194], 60.00th=[ 197], | 70.00th=[ 275], 80.00th=[ 326], 90.00th=[ 651], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 2027, max= 4047, per=45.68%, avg=3365.67, stdev=1159.38, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=15.12%, ctx=140, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179285: Mon Sep 7 18:15:13 2026 read: IOPS=1, BW=1720KiB/s (1761kB/s)(6144KiB/3572msec) clat (msec): min=107, max=363, avg=234.23, stdev=89.17 lat (msec): min=107, max=363, avg=234.23, stdev=89.17 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 241], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2011, max= 4087, per=64.30%, avg=3384.33, stdev=1189.45, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1720KiB/s (1761kB/s)(6144KiB/3572msec); 0 zone resets clat (msec): min=256, max=504, avg=360.76, stdev=98.69 lat (msec): min=256, max=504, avg=360.84, stdev=98.67 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 409], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1954, max= 2793, per=29.38%, avg=2164.80, stdev=352.73, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=12.88%, ctx=208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179286: Mon Sep 7 18:15:13 2026 read: IOPS=1, BW=1316KiB/s (1347kB/s)(5120KiB/3891msec) clat (usec): min=675, max=290637, avg=120429.78, stdev=109372.30 lat (usec): min=677, max=290638, avg=120431.14, stdev=109372.33 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 63177], 40.00th=[ 63177], 50.00th=[ 99091], 60.00th=[ 99091], | 70.00th=[147850], 80.00th=[147850], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 4023, max= 4023, per=76.44%, avg=4023.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1842KiB/s (1886kB/s)(7168KiB/3891msec); 0 zone resets clat (msec): min=91, max=1663, avg=469.38, stdev=562.71 lat (msec): min=91, max=1663, avg=469.49, stdev=562.71 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 94], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 271], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 617], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1383, max= 4023, per=30.93%, avg=2278.80, stdev=1010.86, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=33.33%, 250=16.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.57%, ctx=107, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5263KiB/s (5390kB/s), 546KiB/s-2205KiB/s (559kB/s-2258kB/s), io=20.0MiB (20.0MB), run=3251-3891msec WRITE: bw=7369KiB/s (7546kB/s), 1575KiB/s-2730KiB/s (1613kB/s-2795kB/s), io=28.0MiB (29.4MB), run=3251-3891msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179292: Mon Sep 7 18:15:28 2026 read: IOPS=1, BW=5306KiB/s (5433kB/s)(12.0MiB/2316msec) clat (msec): min=619, max=782, avg=720.59, stdev=88.31 lat (msec): min=620, max=782, avg=720.81, stdev=87.94 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8110, max= 8159, per=100.00%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.69%, ctx=460, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179295: Mon Sep 7 18:15:28 2026 read: IOPS=0, BW=1549KiB/s (1586kB/s)(4096KiB/2644msec) clat (nsec): min=626724k, max=626724k, avg=626724203.00, stdev= 0.00 lat (nsec): min=626725k, max=626725k, avg=626725338.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3098KiB/s (3173kB/s)(8192KiB/2644msec); 0 zone resets clat (msec): min=425, max=1250, avg=837.91, stdev=583.39 lat (msec): min=425, max=1250, avg=838.33, stdev=583.41 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8175, max= 8175, per=79.09%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=7.76%, ctx=153, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179296: Mon Sep 7 18:15:28 2026 write: IOPS=0, BW=3876KiB/s (3969kB/s)(12.0MiB/3170msec); 0 zone resets clat (msec): min=438, max=1308, avg=1001.29, stdev=488.48 lat (msec): min=438, max=1309, avg=1001.76, stdev=488.33 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8159, max= 8159, per=78.94%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.32%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179297: Mon Sep 7 18:15:28 2026 write: IOPS=1, BW=4221KiB/s (4323kB/s)(12.0MiB/2911msec); 0 zone resets clat (msec): min=263, max=2188, avg=909.73, stdev=1107.51 lat (msec): min=263, max=2188, avg=910.92, stdev=1106.70 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min=11115, max=11115, per=100.00%, avg=11115.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.53%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6197KiB/s (6345kB/s), 1549KiB/s-5306KiB/s (1586kB/s-5433kB/s), io=16.0MiB (16.8MB), run=2316-2644msec WRITE: bw=10.1MiB/s (10.6MB/s), 3098KiB/s-4221KiB/s (3173kB/s-4323kB/s), io=32.0MiB (33.6MB), run=2644-3170msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179298: Mon Sep 7 18:15:28 2026 read: IOPS=0, BW=3464KiB/s (3547kB/s)(12.0MiB/3547msec) clat (msec): min=334, max=1856, avg=1107.66, stdev=761.12 lat (msec): min=334, max=1856, avg=1107.67, stdev=761.12 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8031, max= 8143, per=100.00%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.86%, ctx=86, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179299: Mon Sep 7 18:15:28 2026 read: IOPS=0, BW=1203KiB/s (1231kB/s)(4096KiB/3406msec) clat (nsec): min=2330.8M, max=2330.8M, avg=2330838253.00, stdev= 0.00 lat (nsec): min=2330.8M, max=2330.8M, avg=2330841585.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2333], 5.00th=[ 2333], 10.00th=[ 2333], 20.00th=[ 2333], | 30.00th=[ 2333], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2405KiB/s (2463kB/s)(8192KiB/3406msec); 0 zone resets clat (msec): min=275, max=597, avg=436.29, stdev=228.08 lat (msec): min=275, max=598, avg=436.77, stdev=228.06 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8143, max= 8143, per=84.65%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.26%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179300: Mon Sep 7 18:15:28 2026 write: IOPS=1, BW=4913KiB/s (5031kB/s)(12.0MiB/2501msec); 0 zone resets clat (msec): min=715, max=885, avg=784.29, stdev=89.86 lat (msec): min=715, max=886, avg=784.72, stdev=89.87 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8031, max= 8192, per=84.32%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.68%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179301: Mon Sep 7 18:15:28 2026 write: IOPS=0, BW=3901KiB/s (3995kB/s)(12.0MiB/3150msec); 0 zone resets clat (msec): min=400, max=2006, avg=965.57, stdev=902.93 lat (msec): min=410, max=2007, avg=969.39, stdev=899.82 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 6050, max= 8192, per=74.02%, avg=7121.00, stdev=1514.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.06%, sys=3.84%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4619KiB/s (4730kB/s), 1203KiB/s-3464KiB/s (1231kB/s-3547kB/s), io=16.0MiB (16.8MB), run=3406-3547msec WRITE: bw=9621KiB/s (9852kB/s), 2405KiB/s-4913KiB/s (2463kB/s-5031kB/s), io=32.0MiB (33.6MB), run=2501-3406msec