== sanity test 398b: DIO and buffer IO race ============== 00:01:00 (1790740860) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.2276 s, 7.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180757: Wed Sep 30 00:03:45 2026 read: IOPS=10, BW=42.0KiB/s (43.0kB/s)(5992KiB/142666msec) clat (usec): min=47, max=528347, avg=52560.65, stdev=36885.49 lat (usec): min=48, max=528348, avg=52563.05, stdev=36884.80 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11863], 10.00th=[ 18482], 20.00th=[ 25822], | 30.00th=[ 32637], 40.00th=[ 39060], 50.00th=[ 46400], 60.00th=[ 53216], | 70.00th=[ 62653], 80.00th=[ 73925], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[179307], 99.50th=[214959], 99.90th=[312476], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 5, max= 94, per=24.60%, avg=41.33, stdev=16.24, samples=281 iops : min= 1, max= 23, avg= 9.65, stdev= 4.05, samples=281 write: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6296KiB/142666msec); 0 zone resets clat (usec): min=875, max=318865, avg=40241.55, stdev=40540.31 lat (usec): min=877, max=318866, avg=40248.00, stdev=40543.32 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1352], 10.00th=[ 2278], 20.00th=[ 4424], | 30.00th=[ 8717], 40.00th=[ 19530], 50.00th=[ 30016], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[173016], 99.50th=[204473], 99.90th=[312476], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 119, per=24.90%, avg=43.83, stdev=19.95, samples=279 iops : min= 1, max= 29, avg=10.28, stdev= 5.02, samples=279 lat (usec) : 50=0.10%, 100=1.46%, 250=0.33%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=4.65%, 4=4.82%, 10=7.26%, 20=7.71%, 50=34.77% lat (msec) : 100=30.73%, 250=7.75%, 500=0.20%, 750=0.03% cpu : usr=0.08%, sys=4.40%, ctx=6667, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180758: Wed Sep 30 00:03:45 2026 read: IOPS=10, BW=43.0KiB/s (44.1kB/s)(5940KiB/138050msec) clat (usec): min=41, max=385826, avg=49655.06, stdev=33435.63 lat (usec): min=41, max=385829, avg=49660.33, stdev=33433.60 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11338], 10.00th=[ 18220], 20.00th=[ 25297], | 30.00th=[ 31327], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[168821], 99.50th=[193987], 99.90th=[312476], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 5, max= 95, per=25.35%, avg=42.59, stdev=18.10, samples=271 iops : min= 1, max= 23, avg= 9.97, stdev= 4.56, samples=271 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6348KiB/138050msec); 0 zone resets clat (usec): min=990, max=511656, avg=40191.30, stdev=43429.88 lat (usec): min=992, max=511657, avg=40193.95, stdev=43429.94 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1958], 20.00th=[ 4293], | 30.00th=[ 7767], 40.00th=[ 15401], 50.00th=[ 28181], 60.00th=[ 39060], | 70.00th=[ 52167], 80.00th=[ 68682], 90.00th=[ 99091], 95.00th=[127402], | 99.00th=[187696], 99.50th=[204473], 99.90th=[246416], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 127, per=26.03%, avg=45.81, stdev=20.09, samples=269 iops : min= 1, max= 31, avg=10.78, stdev= 5.04, samples=269 lat (usec) : 50=0.13%, 100=1.53%, 250=0.26%, 500=0.13%, 1000=0.07% lat (msec) : 2=5.21%, 4=4.36%, 10=8.17%, 20=8.79%, 50=35.68% lat (msec) : 100=27.47%, 250=8.11%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=4.43%, ctx=6409, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180759: Wed Sep 30 00:03:45 2026 read: IOPS=10, BW=42.8KiB/s (43.8kB/s)(6028KiB/140875msec) clat (usec): min=48, max=510039, avg=53085.77, stdev=37472.62 lat (usec): min=49, max=510042, avg=53088.11, stdev=37472.23 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12649], 10.00th=[ 19530], 20.00th=[ 27132], | 30.00th=[ 32375], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 62653], 80.00th=[ 74974], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[168821], 99.50th=[191890], 99.90th=[308282], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 5, max= 112, per=25.35%, avg=42.58, stdev=17.92, samples=276 iops : min= 1, max= 28, avg= 9.97, stdev= 4.51, samples=276 write: IOPS=11, BW=44.4KiB/s (45.5kB/s)(6260KiB/140875msec); 0 zone resets clat (usec): min=868, max=281105, avg=38559.17, stdev=40285.03 lat (usec): min=869, max=281107, avg=38562.07, stdev=40285.14 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1876], 20.00th=[ 4490], | 30.00th=[ 8455], 40.00th=[ 16450], 50.00th=[ 27132], 60.00th=[ 36439], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[173016], 99.50th=[198181], 99.90th=[225444], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 119, per=25.10%, avg=44.18, stdev=19.89, samples=276 iops : min= 1, max= 29, avg=10.37, stdev= 4.98, samples=276 lat (usec) : 50=0.10%, 100=1.76%, 250=0.26%, 1000=0.07% lat (msec) : 2=5.31%, 4=4.23%, 10=7.49%, 20=8.14%, 50=36.56% lat (msec) : 100=27.18%, 250=8.72%, 500=0.16%, 750=0.03% cpu : usr=0.06%, sys=4.42%, ctx=6651, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180760: Wed Sep 30 00:03:45 2026 read: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6052KiB/142741msec) clat (usec): min=43, max=674890, avg=52411.15, stdev=37648.55 lat (usec): min=43, max=674891, avg=52417.85, stdev=37646.61 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12649], 10.00th=[ 18744], 20.00th=[ 26346], | 30.00th=[ 31327], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 62129], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[168821], 99.50th=[219153], 99.90th=[254804], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 104, per=25.00%, avg=42.01, stdev=17.51, samples=281 iops : min= 1, max= 26, avg= 9.82, stdev= 4.40, samples=281 write: IOPS=10, BW=43.7KiB/s (44.7kB/s)(6236KiB/142741msec); 0 zone resets clat (usec): min=1029, max=551148, avg=40371.44, stdev=43681.86 lat (usec): min=1030, max=551149, avg=40383.27, stdev=43691.15 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1369], 10.00th=[ 2212], 20.00th=[ 4621], | 30.00th=[ 8356], 40.00th=[ 18482], 50.00th=[ 28443], 60.00th=[ 37487], | 70.00th=[ 50594], 80.00th=[ 70779], 90.00th=[100140], 95.00th=[124257], | 99.00th=[173016], 99.50th=[206570], 99.90th=[287310], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 111, per=24.76%, avg=43.58, stdev=20.05, samples=279 iops : min= 1, max= 27, avg=10.23, stdev= 5.05, samples=279 lat (usec) : 50=0.13%, 100=1.53%, 250=0.16%, 500=0.07%, 750=0.07% lat (msec) : 2=4.65%, 4=4.26%, 10=7.55%, 20=8.04%, 50=37.08% lat (msec) : 100=27.28%, 250=8.95%, 500=0.16%, 750=0.07% cpu : usr=0.07%, sys=4.19%, ctx=6430, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (172kB/s), 42.0KiB/s-43.0KiB/s (43.0kB/s-44.1kB/s), io=23.4MiB (24.6MB), run=138050-142741msec WRITE: bw=176KiB/s (180kB/s), 43.7KiB/s-45.0KiB/s (44.7kB/s-47.1kB/s), io=24.6MiB (25.7MB), run=138050-142741msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180761: Wed Sep 30 00:04:34 2026 read: IOPS=7, BW=31.5KiB/s (32.2kB/s)(5992KiB/190388msec) clat (msec): min=6, max=550, avg=49.38, stdev=44.75 lat (msec): min=6, max=550, avg=49.39, stdev=44.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 70], 90.00th=[ 112], 95.00th=[ 138], | 99.00th=[ 199], 99.50th=[ 234], 99.90th=[ 359], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 142, per=25.68%, avg=32.10, stdev=21.62, samples=362 iops : min= 1, max= 35, avg= 7.35, stdev= 5.45, samples=362 write: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6296KiB/190388msec); 0 zone resets clat (msec): min=12, max=457, avg=73.70, stdev=50.66 lat (msec): min=12, max=457, avg=73.70, stdev=50.66 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 106], 90.00th=[ 142], 95.00th=[ 182], | 99.00th=[ 243], 99.50th=[ 275], 99.90th=[ 409], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 110, per=25.10%, avg=32.89, stdev=20.24, samples=371 iops : min= 1, max= 27, avg= 7.54, stdev= 5.09, samples=371 lat (msec) : 10=1.01%, 20=11.17%, 50=42.42%, 100=27.99%, 250=16.80% lat (msec) : 500=0.59%, 750=0.03% cpu : usr=0.05%, sys=1.64%, ctx=4860, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180762: Wed Sep 30 00:04:34 2026 read: IOPS=7, BW=31.0KiB/s (31.8kB/s)(5940KiB/191359msec) clat (msec): min=5, max=680, avg=49.00, stdev=45.80 lat (msec): min=5, max=680, avg=49.00, stdev=45.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 107], 95.00th=[ 136], | 99.00th=[ 224], 99.50th=[ 236], 99.90th=[ 300], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 118, per=26.01%, avg=32.51, stdev=21.94, samples=354 iops : min= 1, max= 29, avg= 7.45, stdev= 5.53, samples=354 write: IOPS=8, BW=33.2KiB/s (33.0kB/s)(6348KiB/191359msec); 0 zone resets clat (msec): min=9, max=484, avg=74.44, stdev=51.56 lat (msec): min=9, max=484, avg=74.44, stdev=51.56 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 60], 60.00th=[ 70], | 70.00th=[ 87], 80.00th=[ 111], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 251], 99.50th=[ 279], 99.90th=[ 380], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 103, per=25.32%, avg=33.17, stdev=20.56, samples=371 iops : min= 1, max= 25, avg= 7.61, stdev= 5.18, samples=371 lat (msec) : 10=1.40%, 20=10.71%, 50=42.32%, 100=27.77%, 250=17.15% lat (msec) : 500=0.62%, 750=0.03% cpu : usr=0.05%, sys=1.56%, ctx=4761, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180763: Wed Sep 30 00:04:34 2026 read: IOPS=7, BW=31.5KiB/s (32.2kB/s)(6028KiB/191495msec) clat (msec): min=6, max=389, avg=49.76, stdev=43.81 lat (msec): min=6, max=389, avg=49.76, stdev=43.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 72], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 209], 99.50th=[ 243], 99.90th=[ 342], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 142, per=25.96%, avg=32.44, stdev=20.93, samples=360 iops : min= 1, max= 35, avg= 7.43, stdev= 5.28, samples=360 write: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6260KiB/191495msec); 0 zone resets clat (msec): min=11, max=727, avg=74.18, stdev=54.97 lat (msec): min=11, max=727, avg=74.19, stdev=54.97 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 87], 80.00th=[ 107], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 259], 99.50th=[ 284], 99.90th=[ 592], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 135, per=24.81%, avg=32.50, stdev=20.79, samples=373 iops : min= 1, max= 33, avg= 7.44, stdev= 5.23, samples=373 lat (msec) : 10=1.14%, 20=10.61%, 50=42.81%, 100=27.77%, 250=16.76% lat (msec) : 500=0.85%, 750=0.07% cpu : usr=0.05%, sys=1.56%, ctx=4822, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180764: Wed Sep 30 00:04:34 2026 read: IOPS=7, BW=31.6KiB/s (32.3kB/s)(6052KiB/191605msec) clat (msec): min=5, max=379, avg=49.02, stdev=43.17 lat (msec): min=5, max=379, avg=49.02, stdev=43.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 69], 90.00th=[ 107], 95.00th=[ 142], | 99.00th=[ 213], 99.50th=[ 234], 99.90th=[ 305], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 119, per=25.95%, avg=32.43, stdev=22.12, samples=361 iops : min= 1, max= 29, avg= 7.43, stdev= 5.57, samples=361 write: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6236KiB/191605msec); 0 zone resets clat (msec): min=12, max=673, avg=75.04, stdev=56.41 lat (msec): min=12, max=673, avg=75.05, stdev=56.41 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 87], 80.00th=[ 109], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 268], 99.50th=[ 330], 99.90th=[ 592], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 119, per=24.50%, avg=32.09, stdev=20.53, samples=375 iops : min= 1, max= 29, avg= 7.34, stdev= 5.17, samples=375 lat (msec) : 10=1.17%, 20=11.00%, 50=42.84%, 100=27.77%, 250=16.34% lat (msec) : 500=0.81%, 750=0.07% cpu : usr=0.06%, sys=1.55%, ctx=4780, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=125KiB/s (128kB/s), 31.0KiB/s-31.6KiB/s (31.8kB/s-32.3kB/s), io=23.4MiB (24.6MB), run=190388-191605msec WRITE: bw=131KiB/s (134kB/s), 32.5KiB/s-33.2KiB/s (33.3kB/s-33.0kB/s), io=24.6MiB (25.7MB), run=190388-191605msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180810: Wed Sep 30 00:05:31 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(5920KiB/44602msec) clat (usec): min=55, max=266451, avg=61984.64, stdev=42390.74 lat (usec): min=56, max=266453, avg=61986.53, stdev=42390.45 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 709], 20.00th=[ 29754], | 30.00th=[ 39060], 40.00th=[ 49021], 50.00th=[ 56886], 60.00th=[ 63701], | 70.00th=[ 77071], 80.00th=[ 89654], 90.00th=[112722], 95.00th=[143655], | 99.00th=[204473], 99.50th=[256902], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 255, per=24.44%, avg=131.25, stdev=54.75, samples=87 iops : min= 1, max= 15, avg= 7.41, stdev= 3.45, samples=87 write: IOPS=8, BW=143KiB/s (146kB/s)(6368KiB/44602msec); 0 zone resets clat (usec): min=1343, max=279576, avg=53442.40, stdev=49261.27 lat (usec): min=1345, max=279578, avg=53456.50, stdev=49269.74 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2671], 10.00th=[ 4424], 20.00th=[ 10290], | 30.00th=[ 17957], 40.00th=[ 28181], 50.00th=[ 39584], 60.00th=[ 53216], | 70.00th=[ 67634], 80.00th=[ 91751], 90.00th=[126354], 95.00th=[145753], | 99.00th=[227541], 99.50th=[254804], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 340, per=25.44%, avg=143.47, stdev=63.94, samples=86 iops : min= 1, max= 21, avg= 8.19, stdev= 4.10, samples=86 lat (usec) : 100=3.65%, 250=0.52%, 500=0.13%, 750=0.52%, 1000=0.13% lat (msec) : 2=2.08%, 4=2.34%, 10=6.12%, 20=6.90%, 50=27.60% lat (msec) : 100=33.98%, 250=15.49%, 500=0.52% cpu : usr=0.06%, sys=3.71%, ctx=1679, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180811: Wed Sep 30 00:05:31 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(5744KiB/44533msec) clat (usec): min=49, max=407809, avg=64400.65, stdev=45858.16 lat (usec): min=50, max=407811, avg=64402.06, stdev=45858.19 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 8029], 20.00th=[ 33424], | 30.00th=[ 40633], 40.00th=[ 47973], 50.00th=[ 56361], 60.00th=[ 66323], | 70.00th=[ 79168], 80.00th=[ 92799], 90.00th=[119014], 95.00th=[139461], | 99.00th=[204473], 99.50th=[248513], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 26, max= 283, per=24.13%, avg=129.58, stdev=55.97, samples=86 iops : min= 1, max= 17, avg= 7.30, stdev= 3.56, samples=86 write: IOPS=9, BW=147KiB/s (150kB/s)(6544KiB/44533msec); 0 zone resets clat (usec): min=1654, max=276732, avg=51819.31, stdev=52648.64 lat (usec): min=1655, max=276736, avg=51821.76, stdev=52648.71 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 1958], 10.00th=[ 4047], 20.00th=[ 8029], | 30.00th=[ 13829], 40.00th=[ 24249], 50.00th=[ 35914], 60.00th=[ 47973], | 70.00th=[ 66847], 80.00th=[ 85459], 90.00th=[126354], 95.00th=[173016], | 99.00th=[223347], 99.50th=[240124], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 382, per=26.37%, avg=148.73, stdev=68.84, samples=86 iops : min= 1, max= 23, avg= 8.51, stdev= 4.30, samples=86 lat (usec) : 50=0.13%, 100=3.52%, 250=0.13%, 750=0.13%, 1000=0.26% lat (msec) : 2=3.12%, 4=2.21%, 10=7.81%, 20=7.03%, 50=27.73% lat (msec) : 100=31.77%, 250=15.89%, 500=0.26% cpu : usr=0.06%, sys=4.01%, ctx=1693, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180812: Wed Sep 30 00:05:31 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(6256KiB/42328msec) clat (usec): min=42, max=323413, avg=64142.83, stdev=43851.74 lat (usec): min=43, max=323413, avg=64144.31, stdev=43851.76 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 19268], 20.00th=[ 31851], | 30.00th=[ 39060], 40.00th=[ 47973], 50.00th=[ 57934], 60.00th=[ 65799], | 70.00th=[ 76022], 80.00th=[ 92799], 90.00th=[119014], 95.00th=[143655], | 99.00th=[206570], 99.50th=[212861], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 320, per=27.43%, avg=147.31, stdev=61.70, samples=83 iops : min= 1, max= 20, avg= 8.43, stdev= 3.95, samples=83 write: IOPS=8, BW=143KiB/s (146kB/s)(6032KiB/42328msec); 0 zone resets clat (usec): min=1542, max=220537, avg=45496.17, stdev=44273.43 lat (usec): min=1543, max=220538, avg=45515.51, stdev=44269.80 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2008], 10.00th=[ 3326], 20.00th=[ 6063], | 30.00th=[ 10290], 40.00th=[ 21627], 50.00th=[ 35390], 60.00th=[ 46400], | 70.00th=[ 59507], 80.00th=[ 77071], 90.00th=[105382], 95.00th=[131597], | 99.00th=[193987], 99.50th=[217056], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 30, max= 382, per=24.98%, avg=140.87, stdev=78.53, samples=83 iops : min= 1, max= 23, avg= 8.02, stdev= 4.95, samples=83 lat (usec) : 50=0.13%, 100=3.52%, 250=0.26%, 500=0.13% lat (msec) : 2=2.47%, 4=3.78%, 10=8.59%, 20=5.08%, 50=27.99% lat (msec) : 100=34.24%, 250=13.67%, 500=0.13% cpu : usr=0.05%, sys=3.71%, ctx=1626, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180813: Wed Sep 30 00:05:31 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6032KiB/44505msec) clat (usec): min=42, max=381764, avg=64241.69, stdev=48935.04 lat (usec): min=43, max=381766, avg=64243.51, stdev=48934.56 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 81], 20.00th=[ 30802], | 30.00th=[ 41681], 40.00th=[ 48497], 50.00th=[ 58459], 60.00th=[ 66323], | 70.00th=[ 79168], 80.00th=[ 95945], 90.00th=[114820], 95.00th=[141558], | 99.00th=[261096], 99.50th=[333448], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 31, max= 314, per=25.84%, avg=138.74, stdev=60.26, samples=84 iops : min= 1, max= 19, avg= 7.87, stdev= 3.81, samples=84 write: IOPS=8, BW=141KiB/s (144kB/s)(6256KiB/44505msec); 0 zone resets clat (usec): min=1247, max=299278, avg=50899.67, stdev=51200.12 lat (usec): min=1257, max=299280, avg=50902.01, stdev=51200.18 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1926], 10.00th=[ 4015], 20.00th=[ 8848], | 30.00th=[ 15664], 40.00th=[ 25035], 50.00th=[ 35390], 60.00th=[ 48497], | 70.00th=[ 61080], 80.00th=[ 82314], 90.00th=[124257], 95.00th=[158335], | 99.00th=[202376], 99.50th=[283116], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 30, max= 377, per=25.45%, avg=143.52, stdev=78.72, samples=85 iops : min= 1, max= 23, avg= 8.18, stdev= 4.99, samples=85 lat (usec) : 50=0.26%, 100=5.08%, 250=0.52%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=2.08%, 10=6.25%, 20=7.68%, 50=26.69% lat (msec) : 100=31.90%, 250=15.10%, 500=1.04% cpu : usr=0.07%, sys=3.98%, ctx=1679, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=537KiB/s (550kB/s), 129KiB/s-148KiB/s (132kB/s-151kB/s), io=23.4MiB (24.5MB), run=42328-44602msec WRITE: bw=565KiB/s (579kB/s), 141KiB/s-147KiB/s (144kB/s-150kB/s), io=24.6MiB (25.8MB), run=42328-44602msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180814: Wed Sep 30 00:05:46 2026 read: IOPS=6, BW=100KiB/s (103kB/s)(5920KiB/59003msec) clat (msec): min=8, max=334, avg=61.17, stdev=52.65 lat (msec): min=8, max=334, avg=61.17, stdev=52.65 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 88], 90.00th=[ 133], 95.00th=[ 180], | 99.00th=[ 262], 99.50th=[ 264], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 343, per=25.94%, avg=103.74, stdev=67.24, samples=112 iops : min= 1, max= 21, avg= 5.63, stdev= 4.26, samples=112 write: IOPS=6, BW=108KiB/s (111kB/s)(6368KiB/59003msec); 0 zone resets clat (msec): min=18, max=374, avg=90.51, stdev=62.48 lat (msec): min=18, max=374, avg=90.51, stdev=62.48 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 51], 40.00th=[ 61], 50.00th=[ 71], 60.00th=[ 86], | 70.00th=[ 104], 80.00th=[ 126], 90.00th=[ 169], 95.00th=[ 234], | 99.00th=[ 317], 99.50th=[ 368], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 30, max= 319, per=26.31%, avg=110.51, stdev=67.14, samples=113 iops : min= 1, max= 19, avg= 6.05, stdev= 4.24, samples=113 lat (msec) : 10=0.26%, 20=5.47%, 50=37.50%, 100=32.81%, 250=21.35% lat (msec) : 500=2.60% cpu : usr=0.04%, sys=1.31%, ctx=1147, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180815: Wed Sep 30 00:05:46 2026 read: IOPS=6, BW=97.7KiB/s (100kB/s)(5744KiB/58817msec) clat (msec): min=6, max=300, avg=63.02, stdev=52.87 lat (msec): min=6, max=300, avg=63.02, stdev=52.87 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 25], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 91], 90.00th=[ 148], 95.00th=[ 184], | 99.00th=[ 251], 99.50th=[ 279], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 28, max= 318, per=25.69%, avg=102.74, stdev=65.78, samples=108 iops : min= 1, max= 19, avg= 5.56, stdev= 4.16, samples=108 write: IOPS=6, BW=111KiB/s (114kB/s)(6544KiB/58817msec); 0 zone resets clat (msec): min=19, max=331, avg=88.17, stdev=59.44 lat (msec): min=19, max=331, avg=88.18, stdev=59.44 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 61], 50.00th=[ 70], 60.00th=[ 86], | 70.00th=[ 102], 80.00th=[ 125], 90.00th=[ 174], 95.00th=[ 205], | 99.00th=[ 296], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 415, per=26.63%, avg=111.86, stdev=69.76, samples=113 iops : min= 1, max= 25, avg= 6.14, stdev= 4.40, samples=113 lat (msec) : 10=0.13%, 20=6.38%, 50=36.33%, 100=32.55%, 250=22.66% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.24%, ctx=1125, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180816: Wed Sep 30 00:05:46 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59831msec) clat (msec): min=8, max=354, avg=61.47, stdev=54.84 lat (msec): min=8, max=354, avg=61.47, stdev=54.84 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 49], | 70.00th=[ 61], 80.00th=[ 89], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 275], 99.50th=[ 351], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 350, per=28.04%, avg=112.17, stdev=78.73, samples=109 iops : min= 1, max= 21, avg= 6.17, stdev= 4.97, samples=109 write: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59831msec); 0 zone resets clat (msec): min=21, max=377, avg=94.38, stdev=64.22 lat (msec): min=21, max=377, avg=94.39, stdev=64.23 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 31], 10.00th=[ 36], 20.00th=[ 44], | 30.00th=[ 54], 40.00th=[ 62], 50.00th=[ 71], 60.00th=[ 88], | 70.00th=[ 112], 80.00th=[ 142], 90.00th=[ 186], 95.00th=[ 230], | 99.00th=[ 317], 99.50th=[ 372], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 314, per=23.79%, avg=99.93, stdev=62.49, samples=116 iops : min= 1, max= 19, avg= 5.39, stdev= 3.97, samples=116 lat (msec) : 10=0.13%, 20=4.56%, 50=39.97%, 100=30.21%, 250=22.92% lat (msec) : 500=2.21% cpu : usr=0.04%, sys=1.29%, ctx=1167, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180817: Wed Sep 30 00:05:46 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59858msec) clat (msec): min=8, max=348, avg=64.05, stdev=58.13 lat (msec): min=8, max=351, avg=64.06, stdev=58.16 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 67], 80.00th=[ 92], 90.00th=[ 153], 95.00th=[ 192], | 99.00th=[ 279], 99.50th=[ 292], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 319, per=27.10%, avg=108.41, stdev=68.90, samples=107 iops : min= 1, max= 19, avg= 5.93, stdev= 4.35, samples=107 write: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59858msec); 0 zone resets clat (msec): min=12, max=350, avg=90.49, stdev=65.46 lat (msec): min=12, max=350, avg=90.50, stdev=65.46 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 43], | 30.00th=[ 51], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 80], | 70.00th=[ 103], 80.00th=[ 138], 90.00th=[ 174], 95.00th=[ 241], | 99.00th=[ 330], 99.50th=[ 338], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 28, max= 318, per=25.51%, avg=107.12, stdev=68.40, samples=113 iops : min= 1, max= 19, avg= 5.84, stdev= 4.32, samples=113 lat (msec) : 10=0.13%, 20=5.21%, 50=39.19%, 100=30.99%, 250=21.48% lat (msec) : 500=2.99% cpu : usr=0.04%, sys=1.31%, ctx=1156, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=400KiB/s (410kB/s), 97.7KiB/s-105KiB/s (100kB/s-107kB/s), io=23.4MiB (24.5MB), run=58817-59858msec WRITE: bw=421KiB/s (431kB/s), 101KiB/s-111KiB/s (103kB/s-114kB/s), io=24.6MiB (25.8MB), run=58817-59858msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180831: Wed Sep 30 00:06:06 2026 read: IOPS=0, BW=1012KiB/s (1036kB/s)(7168KiB/7085msec) clat (usec): min=569, max=5376.9k, avg=850056.15, stdev=1998887.36 lat (usec): min=570, max=5376.9k, avg=850057.67, stdev=1998887.20 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], | 20.00th=[ 594], 30.00th=[ 717], 40.00th=[ 717], | 50.00th=[ 112722], 60.00th=[ 191890], 70.00th=[ 191890], | 80.00th=[ 267387], 90.00th=[5402264], 95.00th=[5402264], | 99.00th=[5402264], 99.50th=[5402264], 99.90th=[5402264], | 99.95th=[5402264], 99.99th=[5402264] bw ( KiB/s): min= 2027, max= 4039, per=100.00%, avg=3073.67, stdev=1008.46, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=723KiB/s (740kB/s)(5120KiB/7085msec); 0 zone resets clat (msec): min=153, max=241, avg=198.00, stdev=35.89 lat (msec): min=153, max=241, avg=198.06, stdev=35.86 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 2027, max= 4039, per=81.01%, avg=3033.00, stdev=1422.70, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=25.00% lat (msec) : 250=58.33%, 500=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.68%, ctx=531, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180832: Wed Sep 30 00:06:06 2026 read: IOPS=0, BW=267KiB/s (274kB/s)(2048KiB/7658msec) clat (usec): min=1961, max=278303, avg=140132.87, stdev=195403.15 lat (usec): min=1963, max=278305, avg=140134.80, stdev=195403.58 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 1958], 10.00th=[ 1958], 20.00th=[ 1958], | 30.00th=[ 1958], 40.00th=[ 1958], 50.00th=[ 1958], 60.00th=[278922], | 70.00th=[278922], 80.00th=[278922], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1659, max= 2043, per=69.22%, avg=1851.00, stdev=271.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1337KiB/s (1369kB/s)(10.0MiB/7658msec); 0 zone resets clat (msec): min=198, max=3331, avg=723.87, stdev=936.08 lat (msec): min=198, max=3331, avg=725.59, stdev=935.68 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 253], | 30.00th=[ 296], 40.00th=[ 330], 50.00th=[ 384], 60.00th=[ 506], | 70.00th=[ 518], 80.00th=[ 575], 90.00th=[ 852], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1885, max= 4087, per=71.40%, avg=2673.17, stdev=1063.32, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 2=8.33%, 250=8.33%, 500=41.67%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=7.89%, ctx=208, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180833: Wed Sep 30 00:06:06 2026 read: IOPS=0, BW=850KiB/s (871kB/s)(6144KiB/7225msec) clat (usec): min=495, max=792407, avg=283959.58, stdev=309412.10 lat (usec): min=497, max=792408, avg=283960.98, stdev=309412.33 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 3392], | 30.00th=[ 3392], 40.00th=[147850], 50.00th=[147850], 60.00th=[270533], | 70.00th=[488637], 80.00th=[488637], 90.00th=[792724], 95.00th=[792724], | 99.00th=[792724], 99.50th=[792724], 99.90th=[792724], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 1885, max= 4087, per=93.41%, avg=2497.75, stdev=1061.15, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=850KiB/s (871kB/s)(6144KiB/7225msec); 0 zone resets clat (msec): min=218, max=3208, avg=913.35, stdev=1147.09 lat (msec): min=218, max=3209, avg=913.50, stdev=1147.21 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 684], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2019, max= 3235, per=62.40%, avg=2336.25, stdev=599.30, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=7.42%, ctx=196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180834: Wed Sep 30 00:06:06 2026 read: IOPS=0, BW=772KiB/s (790kB/s)(5120KiB/6636msec) clat (usec): min=1202, max=469839, avg=162841.13, stdev=217492.20 lat (usec): min=1203, max=469840, avg=162842.38, stdev=217492.24 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1205], 10.00th=[ 1205], 20.00th=[ 1205], | 30.00th=[ 1614], 40.00th=[ 1614], 50.00th=[ 24511], 60.00th=[ 24511], | 70.00th=[316670], 80.00th=[316670], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 1885, max= 6131, per=100.00%, avg=4008.00, stdev=3002.38, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1080KiB/s (1106kB/s)(7168KiB/6636msec); 0 zone resets clat (msec): min=182, max=3360, avg=824.01, stdev=1143.72 lat (msec): min=182, max=3360, avg=824.46, stdev=1143.67 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 220], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 305], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 751], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1729, max= 4000, per=69.16%, avg=2589.33, stdev=1231.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=16.67%, 50=8.33%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.07%, ctx=159, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2674KiB/s (2739kB/s), 267KiB/s-1012KiB/s (274kB/s-1036kB/s), io=20.0MiB (20.0MB), run=6636-7658msec WRITE: bw=3744KiB/s (3834kB/s), 723KiB/s-1337KiB/s (740kB/s-1369kB/s), io=28.0MiB (29.4MB), run=6636-7658msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180836: Wed Sep 30 00:06:07 2026 read: IOPS=0, BW=938KiB/s (961kB/s)(7168KiB/7639msec) clat (msec): min=90, max=4076, avg=886.67, stdev=1445.26 lat (msec): min=90, max=4076, avg=886.67, stdev=1445.26 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 103], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 186], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 852], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 1406, max= 4023, per=85.75%, avg=2298.00, stdev=1000.39, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=670KiB/s (686kB/s)(5120KiB/7639msec); 0 zone resets clat (msec): min=104, max=396, avg=271.90, stdev=135.05 lat (msec): min=104, max=396, avg=272.00, stdev=135.02 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2031, max= 4079, per=72.34%, avg=2715.00, stdev=1181.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.99%, ctx=74, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180837: Wed Sep 30 00:06:07 2026 read: IOPS=0, BW=284KiB/s (291kB/s)(2048KiB/7213msec) clat (msec): min=55, max=573, avg=314.44, stdev=365.72 lat (msec): min=55, max=573, avg=314.44, stdev=365.72 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 56], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1426, max= 2039, per=64.65%, avg=1732.50, stdev=433.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1420KiB/s (1454kB/s)(10.0MiB/7213msec); 0 zone resets clat (msec): min=83, max=3330, avg=653.65, stdev=977.78 lat (msec): min=83, max=3331, avg=653.76, stdev=977.78 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 94], | 30.00th=[ 184], 40.00th=[ 275], 50.00th=[ 300], 60.00th=[ 321], | 70.00th=[ 397], 80.00th=[ 542], 90.00th=[ 1003], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 2000, max= 6119, per=82.45%, avg=3094.20, stdev=1782.22, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 100=25.00%, 250=8.33%, 500=33.33%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=2.63%, ctx=90, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180838: Wed Sep 30 00:06:07 2026 read: IOPS=0, BW=864KiB/s (885kB/s)(6144KiB/7107msec) clat (msec): min=86, max=409, avg=192.12, stdev=111.81 lat (msec): min=86, max=409, avg=192.12, stdev=111.81 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 165], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2035, max= 4063, per=100.00%, avg=3371.00, stdev=1157.26, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=864KiB/s (885kB/s)(6144KiB/7107msec); 0 zone resets clat (msec): min=136, max=3227, avg=950.50, stdev=1140.60 lat (msec): min=136, max=3228, avg=950.61, stdev=1140.61 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 718], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1939, max= 4071, per=64.26%, avg=2411.80, stdev=928.17, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.07%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180839: Wed Sep 30 00:06:07 2026 read: IOPS=0, BW=708KiB/s (725kB/s)(5120KiB/7236msec) clat (msec): min=68, max=189, avg=124.33, stdev=47.58 lat (msec): min=68, max=189, avg=124.33, stdev=47.58 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 115], 60.00th=[ 115], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 4000, max= 4079, per=100.00%, avg=4039.50, stdev=55.86, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=991KiB/s (1014kB/s)(7168KiB/7236msec); 0 zone resets clat (msec): min=95, max=3681, avg=943.23, stdev=1269.79 lat (msec): min=95, max=3681, avg=943.33, stdev=1269.78 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 171], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 468], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 1284], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 2000, max= 3313, per=62.53%, avg=2346.75, stdev=644.40, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=2.81%, ctx=117, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2681KiB/s (2745kB/s), 284KiB/s-938KiB/s (291kB/s-961kB/s), io=20.0MiB (20.0MB), run=7107-7639msec WRITE: bw=3753KiB/s (3843kB/s), 670KiB/s-1420KiB/s (686kB/s-1454kB/s), io=28.0MiB (29.4MB), run=7107-7639msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180847: Wed Sep 30 00:06:23 2026 read: IOPS=1, BW=4851KiB/s (4968kB/s)(12.0MiB/2533msec) clat (msec): min=650, max=963, avg=825.96, stdev=159.59 lat (msec): min=650, max=963, avg=825.96, stdev=159.59 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.90%, ctx=336, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180848: Wed Sep 30 00:06:23 2026 read: IOPS=0, BW=1283KiB/s (1314kB/s)(4096KiB/3193msec) clat (nsec): min=772287k, max=772287k, avg=772286823.00, stdev= 0.00 lat (nsec): min=772291k, max=772291k, avg=772290509.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2566KiB/s (2627kB/s)(8192KiB/3193msec); 0 zone resets clat (msec): min=949, max=1397, avg=1173.47, stdev=317.07 lat (msec): min=951, max=1398, avg=1174.76, stdev=316.18 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8159, max= 8159, per=94.13%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.20%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180849: Wed Sep 30 00:06:23 2026 write: IOPS=0, BW=3251KiB/s (3329kB/s)(12.0MiB/3780msec); 0 zone resets clat (msec): min=297, max=2390, avg=1241.15, stdev=1061.89 lat (msec): min=297, max=2391, avg=1241.69, stdev=1062.20 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8031, max= 8159, per=93.39%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.70%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180850: Wed Sep 30 00:06:23 2026 write: IOPS=1, BW=4270KiB/s (4372kB/s)(12.0MiB/2878msec); 0 zone resets clat (msec): min=510, max=1422, avg=898.22, stdev=471.22 lat (msec): min=511, max=1423, avg=898.87, stdev=471.42 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7892, max= 8143, per=92.50%, avg=8017.50, stdev=177.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.93%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5131KiB/s (5254kB/s), 1283KiB/s-4851KiB/s (1314kB/s-4968kB/s), io=16.0MiB (16.8MB), run=2533-3193msec WRITE: bw=8669KiB/s (8877kB/s), 2566KiB/s-4270KiB/s (2627kB/s-4372kB/s), io=32.0MiB (33.6MB), run=2878-3780msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180851: Wed Sep 30 00:06:23 2026 read: IOPS=1, BW=4357KiB/s (4462kB/s)(12.0MiB/2820msec) clat (msec): min=566, max=1099, avg=914.96, stdev=302.09 lat (msec): min=566, max=1099, avg=914.96, stdev=302.09 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8062, max= 8110, per=100.00%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.94%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180852: Wed Sep 30 00:06:23 2026 read: IOPS=0, BW=1083KiB/s (1109kB/s)(4096KiB/3783msec) clat (nsec): min=1602.5M, max=1602.5M, avg=1602468506.00, stdev= 0.00 lat (nsec): min=1602.5M, max=1602.5M, avg=1602471087.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1603], 5.00th=[ 1603], 10.00th=[ 1603], 20.00th=[ 1603], | 30.00th=[ 1603], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2165KiB/s (2217kB/s)(8192KiB/3783msec); 0 zone resets clat (msec): min=633, max=1300, avg=966.87, stdev=471.51 lat (msec): min=634, max=1300, avg=967.39, stdev=471.38 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7953, max= 7953, per=91.83%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=2.99%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180853: Wed Sep 30 00:06:23 2026 write: IOPS=0, BW=3629KiB/s (3716kB/s)(12.0MiB/3386msec); 0 zone resets clat (msec): min=689, max=1258, avg=1066.44, stdev=326.23 lat (msec): min=690, max=1259, avg=1066.93, stdev=326.29 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7953, max= 8110, per=92.73%, avg=8031.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.19%, ctx=70, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180854: Wed Sep 30 00:06:23 2026 write: IOPS=0, BW=3898KiB/s (3992kB/s)(12.0MiB/3152msec); 0 zone resets clat (msec): min=793, max=1051, avg=959.73, stdev=144.36 lat (msec): min=793, max=1051, avg=960.18, stdev=144.39 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8110, max= 8126, per=93.73%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.89%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4331KiB/s (4435kB/s), 1083KiB/s-4357KiB/s (1109kB/s-4462kB/s), io=16.0MiB (16.8MB), run=2820-3783msec WRITE: bw=8662KiB/s (8870kB/s), 2165KiB/s-3898KiB/s (2217kB/s-3992kB/s), io=32.0MiB (33.6MB), run=3152-3783msec