== sanity test 398b: DIO and buffer IO race ============== 09:20:35 (1789132835) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.00294 s, 6.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179356: Fri Sep 11 09:23:21 2026 read: IOPS=10, BW=42.3KiB/s (43.3kB/s)(5992KiB/141664msec) clat (usec): min=38, max=364874, avg=52021.14, stdev=35619.04 lat (usec): min=38, max=364875, avg=52023.75, stdev=35621.19 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 12125], 10.00th=[ 19268], 20.00th=[ 25822], | 30.00th=[ 31851], 40.00th=[ 38011], 50.00th=[ 45351], 60.00th=[ 52691], | 70.00th=[ 60556], 80.00th=[ 73925], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[191890], 99.50th=[219153], 99.90th=[283116], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 119, per=24.76%, avg=41.84, stdev=18.31, samples=278 iops : min= 1, max= 29, avg= 9.79, stdev= 4.63, samples=278 write: IOPS=11, BW=44.4KiB/s (45.5kB/s)(6296KiB/141664msec); 0 zone resets clat (usec): min=756, max=318396, avg=40387.64, stdev=44436.74 lat (usec): min=757, max=318398, avg=40397.89, stdev=44465.37 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 2868], | 30.00th=[ 6980], 40.00th=[ 17695], 50.00th=[ 28443], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 70779], 90.00th=[103285], 95.00th=[130548], | 99.00th=[202376], 99.50th=[233833], 99.90th=[270533], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 125, per=24.93%, avg=44.12, stdev=20.09, samples=277 iops : min= 1, max= 31, avg=10.37, stdev= 5.06, samples=277 lat (usec) : 50=0.23%, 100=1.69%, 250=0.03%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=8.11%, 4=3.84%, 10=5.53%, 20=6.64%, 50=37.37% lat (msec) : 100=27.28%, 250=8.85%, 500=0.26% cpu : usr=0.08%, sys=4.05%, ctx=6142, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179357: Fri Sep 11 09:23:21 2026 read: IOPS=10, BW=43.3KiB/s (44.3kB/s)(5940KiB/137148msec) clat (usec): min=36, max=278587, avg=51315.60, stdev=35041.35 lat (usec): min=36, max=278588, avg=51319.98, stdev=35039.92 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 2900], 10.00th=[ 18220], 20.00th=[ 24773], | 30.00th=[ 31065], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 62129], 80.00th=[ 74974], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[181404], 99.50th=[214959], 99.90th=[248513], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 95, per=25.60%, avg=43.26, stdev=16.61, samples=268 iops : min= 1, max= 23, avg=10.15, stdev= 4.19, samples=268 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6348KiB/137148msec); 0 zone resets clat (usec): min=785, max=340469, avg=38233.65, stdev=42133.50 lat (usec): min=787, max=340471, avg=38262.66, stdev=42143.67 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1303], 20.00th=[ 2900], | 30.00th=[ 6063], 40.00th=[ 13698], 50.00th=[ 25822], 60.00th=[ 35914], | 70.00th=[ 49021], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[181404], 99.50th=[198181], 99.90th=[278922], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 111, per=25.92%, avg=45.88, stdev=20.57, samples=270 iops : min= 1, max= 27, avg=10.81, stdev= 5.20, samples=270 lat (usec) : 50=0.26%, 100=1.92%, 250=0.13%, 1000=0.10% lat (msec) : 2=8.40%, 4=4.07%, 10=6.38%, 20=7.94%, 50=35.58% lat (msec) : 100=26.66%, 250=8.46%, 500=0.10% cpu : usr=0.07%, sys=4.07%, ctx=5943, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179358: Fri Sep 11 09:23:21 2026 read: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6028KiB/138949msec) clat (usec): min=35, max=288974, avg=50522.42, stdev=34754.14 lat (usec): min=35, max=288976, avg=50530.33, stdev=34753.60 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 125], 10.00th=[ 16712], 20.00th=[ 25035], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[111674], | 99.00th=[185598], 99.50th=[208667], 99.90th=[263193], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 103, per=25.28%, avg=42.72, stdev=18.10, samples=274 iops : min= 1, max= 25, avg=10.01, stdev= 4.55, samples=274 write: IOPS=11, BW=45.1KiB/s (46.1kB/s)(6260KiB/138949msec); 0 zone resets clat (usec): min=757, max=296870, avg=40025.99, stdev=43355.63 lat (usec): min=757, max=296871, avg=40028.62, stdev=43355.19 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 2802], | 30.00th=[ 6980], 40.00th=[ 18220], 50.00th=[ 28967], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[123208], | 99.00th=[198181], 99.50th=[246416], 99.90th=[287310], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 134, per=25.13%, avg=44.48, stdev=20.38, samples=273 iops : min= 1, max= 33, avg=10.46, stdev= 5.14, samples=273 lat (usec) : 50=0.29%, 100=2.12%, 250=0.13%, 750=0.03%, 1000=0.29% lat (msec) : 2=7.85%, 4=3.94%, 10=5.50%, 20=7.29%, 50=36.75% lat (msec) : 100=27.08%, 250=8.46%, 500=0.26% cpu : usr=0.06%, sys=4.10%, ctx=6108, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179359: Fri Sep 11 09:23:21 2026 read: IOPS=10, BW=43.6KiB/s (44.7kB/s)(6052KiB/138784msec) clat (usec): min=35, max=410261, avg=50075.20, stdev=34457.03 lat (usec): min=35, max=410263, avg=50079.41, stdev=34458.40 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 2409], 10.00th=[ 16188], 20.00th=[ 24249], | 30.00th=[ 29754], 40.00th=[ 36439], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 60556], 80.00th=[ 70779], 90.00th=[ 91751], 95.00th=[109577], | 99.00th=[164627], 99.50th=[196084], 99.90th=[270533], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 96, per=25.57%, avg=43.22, stdev=17.93, samples=273 iops : min= 1, max= 24, avg=10.14, stdev= 4.51, samples=273 write: IOPS=11, BW=44.9KiB/s (46.0kB/s)(6236KiB/138784msec); 0 zone resets clat (usec): min=751, max=281160, avg=40293.51, stdev=42350.99 lat (usec): min=752, max=281162, avg=40295.36, stdev=42351.04 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1319], 20.00th=[ 3326], | 30.00th=[ 7570], 40.00th=[ 18744], 50.00th=[ 28705], 60.00th=[ 39060], | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[100140], 95.00th=[125305], | 99.00th=[179307], 99.50th=[204473], 99.90th=[274727], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 119, per=25.16%, avg=44.53, stdev=19.69, samples=273 iops : min= 1, max= 29, avg=10.47, stdev= 4.96, samples=273 lat (usec) : 50=0.36%, 100=1.73%, 250=0.16%, 500=0.10%, 1000=0.13% lat (msec) : 2=7.36%, 4=3.87%, 10=6.41%, 20=7.71%, 50=34.93% lat (msec) : 100=28.78%, 250=8.30%, 500=0.16% cpu : usr=0.07%, sys=4.09%, ctx=5982, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=169KiB/s (174kB/s), 42.3KiB/s-43.6KiB/s (43.3kB/s-44.7kB/s), io=23.4MiB (24.6MB), run=137148-141664msec WRITE: bw=177KiB/s (182kB/s), 44.4KiB/s-46.3KiB/s (45.5kB/s-47.4kB/s), io=24.6MiB (25.7MB), run=137148-141664msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179351: Fri Sep 11 09:24:07 2026 read: IOPS=7, BW=31.7KiB/s (32.5kB/s)(5992KiB/189064msec) clat (msec): min=5, max=820, avg=48.66, stdev=50.38 lat (msec): min=5, max=820, avg=48.66, stdev=50.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 72], 90.00th=[ 111], 95.00th=[ 144], | 99.00th=[ 220], 99.50th=[ 271], 99.90th=[ 485], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 111, per=25.43%, avg=32.30, stdev=23.22, samples=360 iops : min= 1, max= 27, avg= 7.41, stdev= 5.86, samples=360 write: IOPS=8, BW=33.3KiB/s (34.1kB/s)(6296KiB/189064msec); 0 zone resets clat (msec): min=11, max=448, avg=73.54, stdev=54.65 lat (msec): min=11, max=448, avg=73.55, stdev=54.65 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 67], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 150], 95.00th=[ 180], | 99.00th=[ 268], 99.50th=[ 305], 99.90th=[ 426], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 127, per=25.66%, avg=33.87, stdev=22.70, samples=361 iops : min= 1, max= 31, avg= 7.80, stdev= 5.74, samples=361 lat (msec) : 10=2.21%, 20=11.98%, 50=42.71%, 100=25.13%, 250=16.99% lat (msec) : 500=0.94%, 1000=0.03% cpu : usr=0.05%, sys=1.43%, ctx=4687, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179352: Fri Sep 11 09:24:07 2026 read: IOPS=7, BW=31.6KiB/s (32.3kB/s)(5940KiB/188201msec) clat (msec): min=5, max=882, avg=49.10, stdev=50.14 lat (msec): min=5, max=882, avg=49.10, stdev=50.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 73], 90.00th=[ 111], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 422], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 144, per=25.67%, avg=32.60, stdev=23.06, samples=353 iops : min= 1, max= 36, avg= 7.49, stdev= 5.83, samples=353 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6348KiB/188201msec); 0 zone resets clat (msec): min=9, max=413, avg=72.38, stdev=52.33 lat (msec): min=9, max=413, avg=72.38, stdev=52.33 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 109], 90.00th=[ 144], 95.00th=[ 180], | 99.00th=[ 259], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 119, per=25.75%, avg=33.99, stdev=22.45, samples=362 iops : min= 1, max= 29, avg= 7.84, stdev= 5.67, samples=362 lat (msec) : 10=1.92%, 20=11.59%, 50=43.65%, 100=25.29%, 250=16.63% lat (msec) : 500=0.88%, 1000=0.03% cpu : usr=0.06%, sys=1.42%, ctx=4607, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179353: Fri Sep 11 09:24:07 2026 read: IOPS=7, BW=31.9KiB/s (32.7kB/s)(6028KiB/189034msec) clat (msec): min=5, max=348, avg=49.05, stdev=45.31 lat (msec): min=5, max=348, avg=49.05, stdev=45.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 107], 95.00th=[ 148], | 99.00th=[ 222], 99.50th=[ 239], 99.90th=[ 326], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 136, per=25.31%, avg=32.14, stdev=23.65, samples=361 iops : min= 1, max= 34, avg= 7.37, stdev= 5.97, samples=361 write: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6260KiB/189034msec); 0 zone resets clat (msec): min=10, max=898, avg=73.29, stdev=57.16 lat (msec): min=10, max=898, avg=73.30, stdev=57.15 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 67], | 70.00th=[ 84], 80.00th=[ 112], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 264], 99.50th=[ 296], 99.90th=[ 426], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 120, per=24.94%, avg=32.92, stdev=22.48, samples=365 iops : min= 1, max= 30, avg= 7.57, stdev= 5.68, samples=365 lat (msec) : 10=2.25%, 20=12.40%, 50=41.99%, 100=25.29%, 250=17.25% lat (msec) : 500=0.78%, 1000=0.03% cpu : usr=0.05%, sys=1.37%, ctx=4571, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179354: Fri Sep 11 09:24:07 2026 read: IOPS=8, BW=32.1KiB/s (32.8kB/s)(6052KiB/188648msec) clat (msec): min=4, max=492, avg=48.04, stdev=47.06 lat (msec): min=4, max=492, avg=48.05, stdev=47.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 69], 90.00th=[ 110], 95.00th=[ 150], | 99.00th=[ 213], 99.50th=[ 257], 99.90th=[ 351], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 152, per=26.27%, avg=33.36, stdev=24.94, samples=352 iops : min= 1, max= 38, avg= 7.68, stdev= 6.30, samples=352 write: IOPS=8, BW=33.1KiB/s (33.8kB/s)(6236KiB/188648msec); 0 zone resets clat (msec): min=7, max=916, avg=74.13, stdev=57.89 lat (msec): min=7, max=916, avg=74.13, stdev=57.89 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 111], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 279], 99.50th=[ 317], 99.90th=[ 426], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 120, per=24.81%, avg=32.75, stdev=22.24, samples=369 iops : min= 1, max= 30, avg= 7.53, stdev= 5.62, samples=369 lat (msec) : 10=2.02%, 20=12.63%, 50=43.03%, 100=24.15%, 250=17.19% lat (msec) : 500=0.94%, 1000=0.03% cpu : usr=0.06%, sys=1.45%, ctx=4670, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=127KiB/s (130kB/s), 31.6KiB/s-32.1KiB/s (32.3kB/s-32.8kB/s), io=23.4MiB (24.6MB), run=188201-189064msec WRITE: bw=133KiB/s (136kB/s), 33.1KiB/s-33.7KiB/s (33.8kB/s-34.5kB/s), io=24.6MiB (25.7MB), run=188201-189064msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179408: Fri Sep 11 09:25:02 2026 read: IOPS=9, BW=145KiB/s (148kB/s)(5920KiB/40908msec) clat (usec): min=37, max=285303, avg=58713.17, stdev=40395.62 lat (usec): min=38, max=285304, avg=58719.32, stdev=40390.83 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 15139], 20.00th=[ 28705], | 30.00th=[ 36963], 40.00th=[ 45351], 50.00th=[ 53740], 60.00th=[ 62129], | 70.00th=[ 72877], 80.00th=[ 89654], 90.00th=[105382], 95.00th=[117965], | 99.00th=[210764], 99.50th=[258999], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 30, max= 349, per=25.07%, avg=142.89, stdev=64.07, samples=80 iops : min= 1, max= 21, avg= 8.16, stdev= 4.06, samples=80 write: IOPS=9, BW=156KiB/s (159kB/s)(6368KiB/40908msec); 0 zone resets clat (usec): min=1254, max=285999, avg=47919.79, stdev=51269.23 lat (usec): min=1256, max=286001, avg=47921.95, stdev=51269.23 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1795], 10.00th=[ 2212], 20.00th=[ 6063], | 30.00th=[ 10552], 40.00th=[ 21103], 50.00th=[ 33817], 60.00th=[ 43779], | 70.00th=[ 60031], 80.00th=[ 80217], 90.00th=[114820], 95.00th=[158335], | 99.00th=[258999], 99.50th=[261096], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 349, per=25.85%, avg=155.13, stdev=72.17, samples=80 iops : min= 1, max= 21, avg= 8.94, stdev= 4.59, samples=80 lat (usec) : 50=0.39%, 100=3.78%, 250=0.13% lat (msec) : 2=4.56%, 4=3.26%, 10=7.55%, 20=6.77%, 50=29.30% lat (msec) : 100=32.42%, 250=11.07%, 500=0.78% cpu : usr=0.05%, sys=4.13%, ctx=1580, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179409: Fri Sep 11 09:25:02 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(5744KiB/40758msec) clat (usec): min=38, max=286662, avg=60608.17, stdev=40459.76 lat (usec): min=38, max=286663, avg=60609.44, stdev=40459.78 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 19792], 20.00th=[ 32637], | 30.00th=[ 39584], 40.00th=[ 46924], 50.00th=[ 54789], 60.00th=[ 64750], | 70.00th=[ 73925], 80.00th=[ 84411], 90.00th=[106431], 95.00th=[130548], | 99.00th=[210764], 99.50th=[274727], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 285, per=24.71%, avg=140.86, stdev=61.98, samples=80 iops : min= 1, max= 17, avg= 8.04, stdev= 3.91, samples=80 write: IOPS=10, BW=161KiB/s (164kB/s)(6544KiB/40758msec); 0 zone resets clat (usec): min=1187, max=316476, avg=46370.89, stdev=50671.65 lat (usec): min=1189, max=316478, avg=46374.72, stdev=50670.39 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1860], 10.00th=[ 2966], 20.00th=[ 6325], | 30.00th=[ 11076], 40.00th=[ 19792], 50.00th=[ 30016], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 79168], 90.00th=[117965], 95.00th=[154141], | 99.00th=[233833], 99.50th=[242222], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 375, per=26.91%, avg=161.43, stdev=83.80, samples=79 iops : min= 1, max= 23, avg= 9.33, stdev= 5.33, samples=79 lat (usec) : 50=0.26%, 100=3.65%, 500=0.13% lat (msec) : 2=3.78%, 4=2.99%, 10=8.20%, 20=7.16%, 50=31.51% lat (msec) : 100=29.43%, 250=12.37%, 500=0.52% cpu : usr=0.06%, sys=4.02%, ctx=1572, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179410: Fri Sep 11 09:25:02 2026 read: IOPS=9, BW=149KiB/s (153kB/s)(6256KiB/41967msec) clat (usec): min=28, max=218092, avg=56855.03, stdev=40246.21 lat (usec): min=29, max=218095, avg=56857.15, stdev=40246.18 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 343], 20.00th=[ 26608], | 30.00th=[ 34866], 40.00th=[ 40633], 50.00th=[ 49021], 60.00th=[ 59507], | 70.00th=[ 69731], 80.00th=[ 85459], 90.00th=[108528], 95.00th=[128451], | 99.00th=[200279], 99.50th=[214959], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 349, per=26.12%, avg=148.87, stdev=72.65, samples=82 iops : min= 1, max= 21, avg= 8.54, stdev= 4.62, samples=82 write: IOPS=8, BW=144KiB/s (147kB/s)(6032KiB/41967msec); 0 zone resets clat (usec): min=1531, max=318254, avg=52217.83, stdev=54535.25 lat (usec): min=1533, max=318257, avg=52220.05, stdev=54535.30 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1893], 10.00th=[ 3392], 20.00th=[ 6980], | 30.00th=[ 15533], 40.00th=[ 25560], 50.00th=[ 34341], 60.00th=[ 47973], | 70.00th=[ 63177], 80.00th=[ 86508], 90.00th=[125305], 95.00th=[166724], | 99.00th=[240124], 99.50th=[244319], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 415, per=24.10%, avg=144.57, stdev=73.88, samples=80 iops : min= 1, max= 25, avg= 8.26, stdev= 4.65, samples=80 lat (usec) : 50=0.26%, 100=4.30%, 250=0.52%, 500=0.13% lat (msec) : 2=2.86%, 4=3.12%, 10=6.64%, 20=6.51%, 50=32.16% lat (msec) : 100=28.91%, 250=14.45%, 500=0.13% cpu : usr=0.08%, sys=3.94%, ctx=1669, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179411: Fri Sep 11 09:25:02 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(6032KiB/39583msec) clat (usec): min=48, max=347099, avg=58645.24, stdev=43323.26 lat (usec): min=49, max=347101, avg=58646.54, stdev=43323.28 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 62], 10.00th=[ 94], 20.00th=[ 26870], | 30.00th=[ 35390], 40.00th=[ 43254], 50.00th=[ 51643], 60.00th=[ 60556], | 70.00th=[ 70779], 80.00th=[ 90702], 90.00th=[105382], 95.00th=[133694], | 99.00th=[219153], 99.50th=[235930], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 448, per=26.48%, avg=150.96, stdev=71.13, samples=77 iops : min= 1, max= 28, avg= 8.68, stdev= 4.51, samples=77 write: IOPS=9, BW=158KiB/s (162kB/s)(6256KiB/39583msec); 0 zone resets clat (usec): min=1583, max=219681, avg=44523.74, stdev=44378.96 lat (usec): min=1584, max=219683, avg=44527.05, stdev=44378.46 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1860], 10.00th=[ 2966], 20.00th=[ 6980], | 30.00th=[ 10814], 40.00th=[ 20579], 50.00th=[ 32900], 60.00th=[ 42206], | 70.00th=[ 58983], 80.00th=[ 79168], 90.00th=[104334], 95.00th=[135267], | 99.00th=[200279], 99.50th=[210764], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 416, per=26.33%, avg=157.99, stdev=82.27, samples=77 iops : min= 1, max= 26, avg= 9.10, stdev= 5.25, samples=77 lat (usec) : 50=0.13%, 100=4.95%, 250=0.26%, 500=0.13% lat (msec) : 2=3.26%, 4=3.52%, 10=7.29%, 20=7.42%, 50=29.95% lat (msec) : 100=30.86%, 250=12.11%, 500=0.13% cpu : usr=0.06%, sys=3.96%, ctx=1568, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=571KiB/s (584kB/s), 141KiB/s-152KiB/s (144kB/s-156kB/s), io=23.4MiB (24.5MB), run=39583-41967msec WRITE: bw=600KiB/s (615kB/s), 144KiB/s-161KiB/s (147kB/s-164kB/s), io=24.6MiB (25.8MB), run=39583-41967msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179403: Fri Sep 11 09:25:14 2026 read: IOPS=6, BW=107KiB/s (110kB/s)(5920KiB/55080msec) clat (msec): min=6, max=326, avg=57.34, stdev=51.84 lat (msec): min=6, max=326, avg=57.34, stdev=51.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 63], 80.00th=[ 81], 90.00th=[ 128], 95.00th=[ 174], | 99.00th=[ 259], 99.50th=[ 284], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 413, per=25.37%, avg=109.36, stdev=78.79, samples=105 iops : min= 1, max= 25, avg= 6.00, stdev= 4.97, samples=105 write: IOPS=7, BW=116KiB/s (118kB/s)(6368KiB/55080msec); 0 zone resets clat (msec): min=15, max=328, avg=84.53, stdev=56.16 lat (msec): min=15, max=328, avg=84.54, stdev=56.16 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 50], 40.00th=[ 59], 50.00th=[ 68], 60.00th=[ 81], | 70.00th=[ 97], 80.00th=[ 124], 90.00th=[ 161], 95.00th=[ 188], | 99.00th=[ 292], 99.50th=[ 313], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 318, per=25.78%, avg=117.02, stdev=70.03, samples=106 iops : min= 1, max= 19, avg= 6.49, stdev= 4.41, samples=106 lat (msec) : 10=0.78%, 20=8.85%, 50=36.33%, 100=31.25%, 250=21.22% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.27%, ctx=1161, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179404: Fri Sep 11 09:25:14 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(5744KiB/55280msec) clat (msec): min=7, max=284, avg=57.16, stdev=49.25 lat (msec): min=7, max=284, avg=57.16, stdev=49.25 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 64], 80.00th=[ 81], 90.00th=[ 129], 95.00th=[ 167], | 99.00th=[ 228], 99.50th=[ 268], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 381, per=25.41%, avg=109.52, stdev=77.14, samples=101 iops : min= 1, max= 23, avg= 6.03, stdev= 4.85, samples=101 write: IOPS=7, BW=118KiB/s (121kB/s)(6544KiB/55280msec); 0 zone resets clat (msec): min=15, max=328, avg=84.57, stdev=59.38 lat (msec): min=15, max=328, avg=84.57, stdev=59.38 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 82], | 70.00th=[ 101], 80.00th=[ 124], 90.00th=[ 167], 95.00th=[ 218], | 99.00th=[ 275], 99.50th=[ 288], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 477, per=25.65%, avg=116.45, stdev=76.90, samples=108 iops : min= 1, max= 29, avg= 6.45, stdev= 4.83, samples=108 lat (msec) : 10=0.52%, 20=8.20%, 50=38.93%, 100=29.30%, 250=21.22% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.19%, ctx=1075, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179405: Fri Sep 11 09:25:14 2026 read: IOPS=7, BW=114KiB/s (116kB/s)(6256KiB/55024msec) clat (msec): min=7, max=344, avg=56.56, stdev=50.59 lat (msec): min=7, max=344, avg=56.57, stdev=50.59 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 85], 90.00th=[ 121], 95.00th=[ 165], | 99.00th=[ 255], 99.50th=[ 300], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 445, per=26.87%, avg=115.81, stdev=80.71, samples=106 iops : min= 1, max= 27, avg= 6.42, stdev= 5.08, samples=106 write: IOPS=6, BW=110KiB/s (112kB/s)(6032KiB/55024msec); 0 zone resets clat (msec): min=13, max=302, avg=86.80, stdev=58.52 lat (msec): min=13, max=302, avg=86.80, stdev=58.52 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 33], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 55], 50.00th=[ 65], 60.00th=[ 82], | 70.00th=[ 104], 80.00th=[ 128], 90.00th=[ 178], 95.00th=[ 213], | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 477, per=24.32%, avg=110.42, stdev=69.32, samples=106 iops : min= 1, max= 29, avg= 6.08, stdev= 4.38, samples=106 lat (msec) : 10=0.52%, 20=8.20%, 50=39.58%, 100=28.13%, 250=22.27% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.18%, ctx=1061, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179406: Fri Sep 11 09:25:14 2026 read: IOPS=6, BW=109KiB/s (111kB/s)(6032KiB/55477msec) clat (msec): min=6, max=297, avg=62.40, stdev=60.87 lat (msec): min=6, max=297, avg=62.41, stdev=60.87 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 64], 80.00th=[ 90], 90.00th=[ 165], 95.00th=[ 213], | 99.00th=[ 271], 99.50th=[ 292], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 384, per=26.14%, avg=112.67, stdev=78.13, samples=104 iops : min= 1, max= 24, avg= 6.22, stdev= 4.93, samples=104 write: IOPS=7, BW=113KiB/s (115kB/s)(6256KiB/55477msec); 0 zone resets clat (msec): min=15, max=332, avg=81.50, stdev=59.53 lat (msec): min=15, max=332, avg=81.51, stdev=59.53 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 62], 60.00th=[ 74], | 70.00th=[ 93], 80.00th=[ 118], 90.00th=[ 165], 95.00th=[ 209], | 99.00th=[ 300], 99.50th=[ 321], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 508, per=25.75%, avg=116.90, stdev=82.74, samples=105 iops : min= 1, max= 31, avg= 6.49, stdev= 5.23, samples=105 lat (msec) : 10=0.65%, 20=7.94%, 50=40.49%, 100=28.39%, 250=20.18% lat (msec) : 500=2.34% cpu : usr=0.03%, sys=1.21%, ctx=1124, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=432KiB/s (442kB/s), 104KiB/s-114KiB/s (106kB/s-116kB/s), io=23.4MiB (24.5MB), run=55024-55477msec WRITE: bw=454KiB/s (465kB/s), 110KiB/s-118KiB/s (112kB/s-121kB/s), io=24.6MiB (25.8MB), run=55024-55477msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179427: Fri Sep 11 09:25:40 2026 read: IOPS=0, BW=737KiB/s (754kB/s)(7168KiB/9729msec) clat (usec): min=510, max=4506.9k, avg=1211051.42, stdev=1946683.36 lat (usec): min=511, max=4506.9k, avg=1211052.67, stdev=1946683.57 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], | 20.00th=[ 1172], 30.00th=[ 106431], 40.00th=[ 106431], | 50.00th=[ 147850], 60.00th=[ 158335], 70.00th=[ 158335], | 80.00th=[3539993], 90.00th=[4529849], 95.00th=[4529849], | 99.00th=[4529849], 99.50th=[4529849], 99.90th=[4529849], | 99.95th=[4529849], 99.99th=[4529849] bw ( KiB/s): min= 1980, max= 4096, per=100.00%, avg=3047.50, stdev=1201.12, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=526KiB/s (539kB/s)(5120KiB/9729msec); 0 zone resets clat (msec): min=139, max=311, avg=227.90, stdev=77.64 lat (msec): min=139, max=311, avg=227.98, stdev=77.66 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2035, max= 5941, per=100.00%, avg=3338.33, stdev=2253.98, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=6.52%, ctx=1081, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179430: Fri Sep 11 09:25:40 2026 read: IOPS=0, BW=203KiB/s (208kB/s)(2048KiB/10065msec) clat (msec): min=171, max=335, avg=253.45, stdev=115.68 lat (msec): min=171, max=335, avg=253.45, stdev=115.68 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1973, max= 2039, per=98.62%, avg=2006.00, stdev=46.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=1017KiB/s (1042kB/s)(10.0MiB/10065msec); 0 zone resets clat (msec): min=77, max=3402, avg=913.60, stdev=1285.55 lat (msec): min=77, max=3402, avg=913.68, stdev=1285.55 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 153], | 30.00th=[ 161], 40.00th=[ 222], 50.00th=[ 268], 60.00th=[ 317], | 70.00th=[ 435], 80.00th=[ 877], 90.00th=[ 3239], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1973, max= 6144, per=100.00%, avg=3250.00, stdev=1849.67, samples=5 iops : min= 1, max= 6, avg= 2.40, stdev= 2.19, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=6.64%, ctx=179, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179431: Fri Sep 11 09:25:40 2026 read: IOPS=0, BW=646KiB/s (661kB/s)(6144KiB/9511msec) clat (usec): min=865, max=228637, avg=102561.61, stdev=113413.85 lat (usec): min=866, max=228639, avg=102562.68, stdev=113414.08 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 865], 10.00th=[ 865], 20.00th=[ 1237], | 30.00th=[ 1237], 40.00th=[ 2089], 50.00th=[ 2089], 60.00th=[160433], | 70.00th=[223347], 80.00th=[223347], 90.00th=[229639], 95.00th=[229639], | 99.00th=[229639], 99.50th=[229639], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 2039, max= 6131, per=100.00%, avg=3404.33, stdev=2361.36, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=646KiB/s (661kB/s)(6144KiB/9511msec); 0 zone resets clat (msec): min=306, max=3798, avg=1471.85, stdev=1669.92 lat (msec): min=306, max=3798, avg=1471.92, stdev=1669.91 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 481], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1698, max= 2043, per=69.26%, avg=1972.40, stdev=153.41, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=3.96%, ctx=129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179434: Fri Sep 11 09:25:40 2026 read: IOPS=0, BW=550KiB/s (563kB/s)(5120KiB/9313msec) clat (usec): min=631, max=207103, avg=101211.74, stdev=96964.95 lat (usec): min=632, max=207104, avg=101213.08, stdev=96964.95 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 996], 40.00th=[ 996], 50.00th=[119014], 60.00th=[119014], | 70.00th=[177210], 80.00th=[177210], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 2048, max= 6131, per=100.00%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=0, BW=770KiB/s (788kB/s)(7168KiB/9313msec); 0 zone resets clat (msec): min=186, max=3602, avg=1221.86, stdev=1570.67 lat (msec): min=187, max=3602, avg=1222.09, stdev=1570.56 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 220], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 359], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 3440], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1406, max= 4096, per=81.21%, avg=2312.80, stdev=1032.01, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=25.00%, >=2000=16.67% cpu : usr=0.03%, sys=6.04%, ctx=113, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2035KiB/s (2084kB/s), 203KiB/s-737KiB/s (208kB/s-754kB/s), io=20.0MiB (20.0MB), run=9313-10065msec WRITE: bw=2849KiB/s (2917kB/s), 526KiB/s-1017KiB/s (539kB/s-1042kB/s), io=28.0MiB (29.4MB), run=9313-10065msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179428: Fri Sep 11 09:25:41 2026 read: IOPS=1, BW=1092KiB/s (1118kB/s)(7168KiB/6566msec) clat (msec): min=91, max=3574, avg=723.13, stdev=1277.75 lat (msec): min=91, max=3574, avg=723.13, stdev=1277.75 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 125], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 186], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 751], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 1665, max= 4079, per=100.00%, avg=2929.25, stdev=1260.70, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=780KiB/s (798kB/s)(5120KiB/6566msec); 0 zone resets clat (msec): min=104, max=470, avg=276.50, stdev=155.22 lat (msec): min=104, max=470, avg=277.01, stdev=154.93 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2027, max= 4031, per=100.00%, avg=2699.00, stdev=1153.56, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.54%, ctx=42, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179429: Fri Sep 11 09:25:41 2026 read: IOPS=0, BW=187KiB/s (192kB/s)(2048KiB/10926msec) clat (msec): min=532, max=1061, avg=796.89, stdev=374.19 lat (msec): min=532, max=1061, avg=796.89, stdev=374.19 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 2019, max= 2031, per=100.00%, avg=2025.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=937KiB/s (960kB/s)(10.0MiB/10926msec); 0 zone resets clat (msec): min=99, max=3432, avg=896.77, stdev=1275.41 lat (msec): min=99, max=3432, avg=897.03, stdev=1275.30 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 101], | 30.00th=[ 105], 40.00th=[ 257], 50.00th=[ 363], 60.00th=[ 401], | 70.00th=[ 518], 80.00th=[ 542], 90.00th=[ 3171], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 1973, max= 6071, per=100.00%, avg=3031.33, stdev=1698.11, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=25.00%, 750=25.00%, 2000=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.01%, sys=2.17%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179432: Fri Sep 11 09:25:41 2026 read: IOPS=0, BW=559KiB/s (572kB/s)(6144KiB/10998msec) clat (msec): min=161, max=582, avg=339.79, stdev=164.00 lat (msec): min=161, max=582, avg=339.79, stdev=164.00 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 363], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2011, max= 4063, per=100.00%, avg=2538.00, stdev=1016.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=559KiB/s (572kB/s)(6144KiB/10998msec); 0 zone resets clat (msec): min=85, max=3841, avg=1450.94, stdev=1700.57 lat (msec): min=85, max=3841, avg=1451.03, stdev=1700.57 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 1062], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 2000, max= 4087, per=95.50%, avg=2440.00, stdev=920.86, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=0.97%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179433: Fri Sep 11 09:25:41 2026 read: IOPS=0, BW=456KiB/s (467kB/s)(5120KiB/11219msec) clat (msec): min=71, max=969, avg=302.67, stdev=384.29 lat (msec): min=71, max=969, avg=302.67, stdev=384.29 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 89], 60.00th=[ 89], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 4039, max= 4055, per=100.00%, avg=4047.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=639KiB/s (654kB/s)(7168KiB/11219msec); 0 zone resets clat (msec): min=49, max=3444, avg=1289.00, stdev=1485.40 lat (msec): min=49, max=3444, avg=1289.19, stdev=1485.32 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 159], | 30.00th=[ 489], 40.00th=[ 489], 50.00th=[ 709], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 3406], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 1973, max= 4031, per=94.72%, avg=2420.20, stdev=900.84, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=25.00%, 250=8.33%, 500=16.67%, 750=8.33% lat (msec) : 1000=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=1.69%, ctx=97, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1825KiB/s (1869kB/s), 187KiB/s-1092KiB/s (192kB/s-1118kB/s), io=20.0MiB (20.0MB), run=6566-11219msec WRITE: bw=2556KiB/s (2617kB/s), 559KiB/s-937KiB/s (572kB/s-960kB/s), io=28.0MiB (29.4MB), run=6566-11219msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179442: Fri Sep 11 09:25:57 2026 read: IOPS=0, BW=4053KiB/s (4150kB/s)(12.0MiB/3032msec) clat (msec): min=856, max=1077, avg=974.45, stdev=111.26 lat (msec): min=856, max=1077, avg=974.45, stdev=111.26 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.22%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179443: Fri Sep 11 09:25:57 2026 read: IOPS=0, BW=1210KiB/s (1239kB/s)(4096KiB/3386msec) clat (nsec): min=1382.3M, max=1382.3M, avg=1382339802.00, stdev= 0.00 lat (nsec): min=1382.3M, max=1382.3M, avg=1382341506.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2419KiB/s (2477kB/s)(8192KiB/3386msec); 0 zone resets clat (msec): min=269, max=1656, avg=962.89, stdev=980.67 lat (msec): min=272, max=1659, avg=965.89, stdev=981.17 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.84%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179444: Fri Sep 11 09:25:57 2026 write: IOPS=1, BW=6700KiB/s (6861kB/s)(12.0MiB/1834msec); 0 zone resets clat (msec): min=243, max=1175, avg=590.34, stdev=509.84 lat (msec): min=243, max=1176, avg=590.90, stdev=509.83 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7984, max= 8078, per=82.99%, avg=8031.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=6.27%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179445: Fri Sep 11 09:25:57 2026 write: IOPS=0, BW=3981KiB/s (4076kB/s)(12.0MiB/3087msec); 0 zone resets clat (msec): min=737, max=1418, avg=993.31, stdev=370.78 lat (msec): min=737, max=1418, avg=993.66, stdev=370.68 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8047, max= 8094, per=83.40%, avg=8070.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.34%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4839KiB/s (4955kB/s), 1210KiB/s-4053KiB/s (1239kB/s-4150kB/s), io=16.0MiB (16.8MB), run=3032-3386msec WRITE: bw=9677KiB/s (9910kB/s), 2419KiB/s-6700KiB/s (2477kB/s-6861kB/s), io=32.0MiB (33.6MB), run=1834-3386msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179446: Fri Sep 11 09:25:57 2026 read: IOPS=1, BW=4577KiB/s (4686kB/s)(12.0MiB/2685msec) clat (msec): min=778, max=990, avg=857.32, stdev=116.33 lat (msec): min=778, max=990, avg=857.32, stdev=116.33 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8000, max= 8126, per=100.00%, avg=8063.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=15.42%, ctx=277, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179447: Fri Sep 11 09:25:57 2026 read: IOPS=0, BW=1302KiB/s (1333kB/s)(4096KiB/3146msec) clat (nsec): min=690056k, max=690056k, avg=690055597.00, stdev= 0.00 lat (nsec): min=690058k, max=690058k, avg=690058321.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2604KiB/s (2666kB/s)(8192KiB/3146msec); 0 zone resets clat (msec): min=806, max=1552, avg=1179.83, stdev=527.27 lat (msec): min=807, max=1555, avg=1181.21, stdev=528.65 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8192, max= 8192, per=82.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.31%, ctx=184, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179448: Fri Sep 11 09:25:57 2026 write: IOPS=0, BW=3732KiB/s (3821kB/s)(12.0MiB/3293msec); 0 zone resets clat (msec): min=506, max=1949, avg=1022.53, stdev=804.31 lat (msec): min=506, max=1952, avg=1024.97, stdev=804.76 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8143, max= 8159, per=81.92%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.19%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179449: Fri Sep 11 09:25:57 2026 write: IOPS=1, BW=4599KiB/s (4709kB/s)(12.0MiB/2672msec); 0 zone resets clat (msec): min=407, max=1752, avg=876.72, stdev=759.36 lat (msec): min=408, max=1753, avg=877.26, stdev=759.23 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8000, max= 8078, per=80.79%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=5.24%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5208KiB/s (5333kB/s), 1302KiB/s-4577KiB/s (1333kB/s-4686kB/s), io=16.0MiB (16.8MB), run=2685-3146msec WRITE: bw=9951KiB/s (10.2MB/s), 2604KiB/s-4599KiB/s (2666kB/s-4709kB/s), io=32.0MiB (33.6MB), run=2672-3293msec