== sanity test 398b: DIO and buffer IO race ============== 16:28:16 (1789504096) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.92079 s, 7.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179205: Tue Sep 15 16:30:55 2026 read: IOPS=10, BW=43.9KiB/s (44.0kB/s)(5992KiB/136354msec) clat (usec): min=45, max=365570, avg=49647.25, stdev=34629.75 lat (usec): min=46, max=365571, avg=49651.83, stdev=34628.82 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10945], 10.00th=[ 17695], 20.00th=[ 24249], | 30.00th=[ 29492], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 72877], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[160433], 99.50th=[219153], 99.90th=[350225], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 94, per=25.13%, avg=43.48, stdev=17.04, samples=267 iops : min= 1, max= 23, avg=10.22, stdev= 4.30, samples=267 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6296KiB/136354msec); 0 zone resets clat (usec): min=934, max=935939, avg=39051.04, stdev=47118.31 lat (usec): min=936, max=935940, avg=39053.81, stdev=47118.20 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1614], 20.00th=[ 4047], | 30.00th=[ 7570], 40.00th=[ 16450], 50.00th=[ 27395], 60.00th=[ 36439], | 70.00th=[ 50070], 80.00th=[ 66847], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[183501], 99.50th=[233833], 99.90th=[350225], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 127, per=25.50%, avg=46.16, stdev=21.86, samples=265 iops : min= 1, max= 31, avg=10.90, stdev= 5.51, samples=265 lat (usec) : 50=0.16%, 100=1.69%, 250=0.29%, 500=0.03%, 1000=0.03% lat (msec) : 2=6.18%, 4=4.00%, 10=7.36%, 20=8.79%, 50=36.20% lat (msec) : 100=27.41%, 250=7.65%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.38%, ctx=6372, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179206: Tue Sep 15 16:30:55 2026 read: IOPS=10, BW=43.4KiB/s (44.4kB/s)(5940KiB/136856msec) clat (usec): min=46, max=1021.2k, avg=51606.05, stdev=40758.52 lat (usec): min=47, max=1021.2k, avg=51607.35, stdev=40758.59 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 13042], 10.00th=[ 19268], | 20.00th=[ 25560], 30.00th=[ 31065], 40.00th=[ 36963], | 50.00th=[ 44303], 60.00th=[ 53216], 70.00th=[ 62653], | 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[ 112722], | 99.00th=[ 158335], 99.50th=[ 198181], 99.90th=[ 248513], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 95, per=24.92%, avg=43.10, stdev=16.43, samples=267 iops : min= 1, max= 23, avg=10.13, stdev= 4.16, samples=267 write: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6348KiB/136856msec); 0 zone resets clat (usec): min=1001, max=395383, avg=37638.83, stdev=39886.07 lat (usec): min=1001, max=395385, avg=37640.43, stdev=39886.13 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1221], 10.00th=[ 1532], 20.00th=[ 3392], | 30.00th=[ 7504], 40.00th=[ 16057], 50.00th=[ 27132], 60.00th=[ 36439], | 70.00th=[ 48497], 80.00th=[ 65274], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[166724], 99.50th=[187696], 99.90th=[242222], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 126, per=25.28%, avg=45.75, stdev=22.47, samples=268 iops : min= 1, max= 31, avg=10.80, stdev= 5.67, samples=268 lat (usec) : 50=0.03%, 100=1.43%, 250=0.10%, 500=0.07% lat (msec) : 2=6.64%, 4=4.95%, 10=5.96%, 20=8.37%, 50=36.49% lat (msec) : 100=28.09%, 250=7.81%, 500=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.49%, ctx=6445, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179207: Tue Sep 15 16:30:55 2026 read: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6028KiB/136588msec) clat (usec): min=35, max=993576, avg=50848.11, stdev=42538.23 lat (usec): min=36, max=993577, avg=50849.73, stdev=42538.23 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 221], 10.00th=[ 17433], 20.00th=[ 24511], | 30.00th=[ 29754], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[110625], | 99.00th=[168821], 99.50th=[200279], 99.90th=[425722], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 110, per=25.38%, avg=43.91, stdev=19.27, samples=267 iops : min= 1, max= 27, avg=10.33, stdev= 4.84, samples=267 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6260KiB/136588msec); 0 zone resets clat (usec): min=991, max=252594, avg=37978.36, stdev=39828.74 lat (usec): min=993, max=252595, avg=37980.59, stdev=39828.09 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1221], 10.00th=[ 1418], 20.00th=[ 3523], | 30.00th=[ 7046], 40.00th=[ 15795], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 66323], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[173016], 99.50th=[187696], 99.90th=[212861], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 111, per=25.09%, avg=45.42, stdev=20.27, samples=268 iops : min= 1, max= 27, avg=10.71, stdev= 5.11, samples=268 lat (usec) : 50=0.36%, 100=1.76%, 250=0.36%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.67%, 4=4.36%, 10=6.71%, 20=8.14%, 50=36.46% lat (msec) : 100=26.79%, 250=8.17%, 500=0.10%, 1000=0.03% cpu : usr=0.06%, sys=4.25%, ctx=6131, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179208: Tue Sep 15 16:30:55 2026 read: IOPS=10, BW=43.7KiB/s (44.8kB/s)(6052KiB/138365msec) clat (usec): min=31, max=995083, avg=50373.89, stdev=40729.73 lat (usec): min=32, max=995084, avg=50375.20, stdev=40729.73 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 8848], 10.00th=[ 18220], 20.00th=[ 25560], | 30.00th=[ 30540], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[162530], 99.50th=[202376], 99.90th=[325059], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 99, per=25.20%, avg=43.59, stdev=17.41, samples=269 iops : min= 1, max= 24, avg=10.25, stdev= 4.40, samples=269 write: IOPS=11, BW=45.1KiB/s (46.1kB/s)(6236KiB/138365msec); 0 zone resets clat (usec): min=947, max=384370, avg=39576.45, stdev=42831.15 lat (usec): min=948, max=384371, avg=39578.68, stdev=42831.56 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1254], 10.00th=[ 1532], 20.00th=[ 4015], | 30.00th=[ 8225], 40.00th=[ 16319], 50.00th=[ 26608], 60.00th=[ 38011], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[183501], 99.50th=[204473], 99.90th=[325059], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 166, per=24.83%, avg=44.95, stdev=20.97, samples=269 iops : min= 1, max= 41, avg=10.59, stdev= 5.27, samples=269 lat (usec) : 50=0.46%, 100=1.60%, 250=0.26%, 500=0.03%, 1000=0.03% lat (msec) : 2=6.32%, 4=3.84%, 10=6.58%, 20=8.98%, 50=36.23% lat (msec) : 100=27.80%, 250=7.58%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=4.22%, ctx=6416, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.4KiB/s-44.1KiB/s (44.4kB/s-45.2kB/s), io=23.4MiB (24.6MB), run=136354-138365msec WRITE: bw=182KiB/s (186kB/s), 45.1KiB/s-46.4KiB/s (46.1kB/s-47.5kB/s), io=24.6MiB (25.7MB), run=136354-138365msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179210: Tue Sep 15 16:31:32 2026 read: IOPS=8, BW=34.2KiB/s (35.1kB/s)(5992KiB/174953msec) clat (msec): min=4, max=1085, avg=46.46, stdev=52.95 lat (msec): min=4, max=1085, avg=46.46, stdev=52.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 107], 95.00th=[ 153], | 99.00th=[ 220], 99.50th=[ 247], 99.90th=[ 355], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 150, per=25.42%, avg=34.82, stdev=26.04, samples=333 iops : min= 1, max= 37, avg= 8.05, stdev= 6.55, samples=333 write: IOPS=8, BW=35.0KiB/s (36.8kB/s)(6296KiB/174953msec); 0 zone resets clat (msec): min=12, max=464, avg=66.83, stdev=50.38 lat (msec): min=12, max=464, avg=66.84, stdev=50.38 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 60], | 70.00th=[ 78], 80.00th=[ 104], 90.00th=[ 138], 95.00th=[ 167], | 99.00th=[ 245], 99.50th=[ 279], 99.90th=[ 330], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 135, per=25.00%, avg=35.75, stdev=25.39, samples=341 iops : min= 1, max= 33, avg= 8.28, stdev= 6.39, samples=341 lat (msec) : 10=2.18%, 20=15.66%, 50=44.69%, 100=21.09%, 250=15.72% lat (msec) : 500=0.62%, 2000=0.03% cpu : usr=0.05%, sys=1.51%, ctx=4712, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179211: Tue Sep 15 16:31:32 2026 read: IOPS=8, BW=34.0KiB/s (34.8kB/s)(5940KiB/174663msec) clat (msec): min=5, max=1027, avg=45.02, stdev=49.76 lat (msec): min=5, max=1027, avg=45.03, stdev=49.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 102], 95.00th=[ 144], | 99.00th=[ 207], 99.50th=[ 236], 99.90th=[ 309], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 158, per=25.30%, avg=34.66, stdev=26.51, samples=333 iops : min= 1, max= 39, avg= 8.01, stdev= 6.67, samples=333 write: IOPS=9, BW=36.3KiB/s (37.2kB/s)(6348KiB/174663msec); 0 zone resets clat (msec): min=12, max=365, avg=67.82, stdev=50.46 lat (msec): min=12, max=365, avg=67.82, stdev=50.46 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 62], | 70.00th=[ 81], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 245], 99.50th=[ 268], 99.90th=[ 342], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 119, per=25.31%, avg=36.19, stdev=25.07, samples=341 iops : min= 1, max= 29, avg= 8.39, stdev= 6.30, samples=341 lat (msec) : 10=2.38%, 20=15.23%, 50=44.53%, 100=21.48%, 250=15.69% lat (msec) : 500=0.65%, 2000=0.03% cpu : usr=0.05%, sys=1.49%, ctx=4646, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179212: Tue Sep 15 16:31:32 2026 read: IOPS=8, BW=34.6KiB/s (35.5kB/s)(6028KiB/174123msec) clat (msec): min=6, max=357, avg=45.64, stdev=44.00 lat (msec): min=6, max=357, avg=45.64, stdev=44.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 69], 90.00th=[ 107], 95.00th=[ 138], | 99.00th=[ 205], 99.50th=[ 255], 99.90th=[ 347], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 150, per=25.71%, avg=35.23, stdev=25.54, samples=333 iops : min= 1, max= 37, avg= 8.15, stdev= 6.43, samples=333 write: IOPS=8, BW=35.0KiB/s (36.8kB/s)(6260KiB/174123msec); 0 zone resets clat (msec): min=10, max=1033, avg=67.20, stdev=56.29 lat (msec): min=10, max=1033, avg=67.20, stdev=56.29 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 61], | 70.00th=[ 78], 80.00th=[ 99], 90.00th=[ 133], 95.00th=[ 167], | 99.00th=[ 230], 99.50th=[ 300], 99.90th=[ 531], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 111, per=24.97%, avg=35.71, stdev=24.84, samples=341 iops : min= 1, max= 27, avg= 8.27, stdev= 6.25, samples=341 lat (msec) : 10=2.25%, 20=15.01%, 50=44.14%, 100=23.14%, 250=14.78% lat (msec) : 500=0.62%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.48%, ctx=4483, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179213: Tue Sep 15 16:31:32 2026 read: IOPS=8, BW=34.6KiB/s (35.4kB/s)(6052KiB/174981msec) clat (msec): min=5, max=389, avg=46.20, stdev=46.49 lat (msec): min=5, max=389, avg=46.21, stdev=46.49 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 70], 90.00th=[ 109], 95.00th=[ 148], | 99.00th=[ 230], 99.50th=[ 255], 99.90th=[ 347], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 144, per=26.00%, avg=35.62, stdev=26.84, samples=329 iops : min= 1, max= 36, avg= 8.24, stdev= 6.75, samples=329 write: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6236KiB/174981msec); 0 zone resets clat (msec): min=11, max=1080, avg=67.30, stdev=56.98 lat (msec): min=11, max=1080, avg=67.31, stdev=56.98 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 61], | 70.00th=[ 80], 80.00th=[ 103], 90.00th=[ 136], 95.00th=[ 163], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 531], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 119, per=24.87%, avg=35.57, stdev=25.48, samples=339 iops : min= 1, max= 29, avg= 8.23, stdev= 6.41, samples=339 lat (msec) : 10=2.60%, 20=16.54%, 50=42.68%, 100=21.68%, 250=15.85% lat (msec) : 500=0.59%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.49%, ctx=4650, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=137KiB/s (141kB/s), 34.0KiB/s-34.6KiB/s (34.8kB/s-35.5kB/s), io=23.4MiB (24.6MB), run=174123-174981msec WRITE: bw=144KiB/s (147kB/s), 35.6KiB/s-36.3KiB/s (36.5kB/s-37.2kB/s), io=24.6MiB (25.7MB), run=174123-174981msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179255: Tue Sep 15 16:32:19 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5920KiB/34259msec) clat (usec): min=41, max=197773, avg=49001.70, stdev=30096.09 lat (usec): min=41, max=197774, avg=49004.82, stdev=30096.93 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 17957], 20.00th=[ 25297], | 30.00th=[ 32113], 40.00th=[ 37487], 50.00th=[ 43254], 60.00th=[ 52167], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[149947], 99.50th=[175113], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 62, max= 377, per=24.40%, avg=170.57, stdev=65.46, samples=67 iops : min= 3, max= 23, avg= 9.84, stdev= 4.14, samples=67 write: IOPS=11, BW=186KiB/s (190kB/s)(6368KiB/34259msec); 0 zone resets clat (usec): min=1471, max=258090, avg=39949.03, stdev=40642.75 lat (usec): min=1472, max=258091, avg=39958.00, stdev=40641.53 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2147], 10.00th=[ 3261], 20.00th=[ 5932], | 30.00th=[ 9896], 40.00th=[ 18482], 50.00th=[ 28443], 60.00th=[ 38536], | 70.00th=[ 49021], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[173016], 99.50th=[219153], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 535, per=25.14%, avg=184.76, stdev=84.86, samples=67 iops : min= 1, max= 33, avg=10.73, stdev= 5.33, samples=67 lat (usec) : 50=0.13%, 100=3.26%, 250=0.26%, 500=0.13% lat (msec) : 2=1.95%, 4=3.91%, 10=9.90%, 20=7.55%, 50=37.24% lat (msec) : 100=28.65%, 250=6.90%, 500=0.13% cpu : usr=0.06%, sys=4.96%, ctx=1727, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179256: Tue Sep 15 16:32:19 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/34039msec) clat (usec): min=39, max=187871, avg=47703.00, stdev=32502.79 lat (usec): min=40, max=187873, avg=47704.58, stdev=32503.20 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 465], 20.00th=[ 23462], | 30.00th=[ 30016], 40.00th=[ 35390], 50.00th=[ 43254], 60.00th=[ 49546], | 70.00th=[ 56361], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[104334], | 99.00th=[158335], 99.50th=[187696], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 30, max= 347, per=23.99%, avg=167.72, stdev=71.08, samples=67 iops : min= 1, max= 21, avg= 9.66, stdev= 4.46, samples=67 write: IOPS=12, BW=192KiB/s (197kB/s)(6544KiB/34039msec); 0 zone resets clat (usec): min=1531, max=329333, avg=40769.94, stdev=41083.23 lat (usec): min=1533, max=329337, avg=40778.21, stdev=41079.05 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2376], 10.00th=[ 3589], 20.00th=[ 6718], | 30.00th=[ 11994], 40.00th=[ 20055], 50.00th=[ 29754], 60.00th=[ 39060], | 70.00th=[ 49546], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[166724], 99.50th=[196084], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 410, per=26.09%, avg=191.78, stdev=87.27, samples=67 iops : min= 1, max= 25, avg=11.18, stdev= 5.47, samples=67 lat (usec) : 50=0.39%, 100=3.78%, 250=0.26%, 500=0.26% lat (msec) : 2=1.95%, 4=4.04%, 10=8.46%, 20=9.24%, 50=38.28% lat (msec) : 100=25.39%, 250=7.81%, 500=0.13% cpu : usr=0.08%, sys=5.05%, ctx=1689, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179257: Tue Sep 15 16:32:19 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(6256KiB/33409msec) clat (usec): min=39, max=282473, avg=49062.04, stdev=31399.94 lat (usec): min=39, max=282474, avg=49070.26, stdev=31394.34 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 15008], 20.00th=[ 26870], | 30.00th=[ 32900], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 59507], 80.00th=[ 69731], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[143655], 99.50th=[168821], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 375, per=26.77%, avg=187.12, stdev=77.45, samples=66 iops : min= 1, max= 23, avg=10.88, stdev= 4.89, samples=66 write: IOPS=11, BW=181KiB/s (185kB/s)(6032KiB/33409msec); 0 zone resets clat (usec): min=1458, max=277580, avg=37548.54, stdev=39480.28 lat (usec): min=1459, max=277583, avg=37557.97, stdev=39483.94 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2008], 10.00th=[ 2802], 20.00th=[ 5604], | 30.00th=[ 11207], 40.00th=[ 19530], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 48497], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[115868], | 99.00th=[198181], 99.50th=[256902], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 443, per=24.42%, avg=179.45, stdev=79.49, samples=66 iops : min= 1, max= 27, avg=10.39, stdev= 5.04, samples=66 lat (usec) : 50=0.39%, 100=3.12%, 250=0.52%, 500=0.13% lat (msec) : 2=2.34%, 4=4.82%, 10=6.90%, 20=7.94%, 50=37.89% lat (msec) : 100=29.69%, 250=5.86%, 500=0.39% cpu : usr=0.04%, sys=5.00%, ctx=1735, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179259: Tue Sep 15 16:32:19 2026 read: IOPS=11, BW=182KiB/s (187kB/s)(6032KiB/33107msec) clat (usec): min=47, max=184802, avg=47571.91, stdev=32105.58 lat (usec): min=47, max=184803, avg=47579.19, stdev=32105.60 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 97], 20.00th=[ 22152], | 30.00th=[ 29492], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 51643], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[107480], | 99.00th=[152044], 99.50th=[158335], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 351, per=26.27%, avg=183.62, stdev=70.28, samples=64 iops : min= 1, max= 21, avg=10.66, stdev= 4.43, samples=64 write: IOPS=11, BW=189KiB/s (193kB/s)(6256KiB/33107msec); 0 zone resets clat (usec): min=1540, max=256752, avg=37895.34, stdev=39614.53 lat (usec): min=1542, max=256755, avg=37897.66, stdev=39614.44 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1909], 10.00th=[ 2835], 20.00th=[ 5080], | 30.00th=[ 8586], 40.00th=[ 14877], 50.00th=[ 24249], 60.00th=[ 34866], | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 94897], 95.00th=[109577], | 99.00th=[181404], 99.50th=[204473], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 62, max= 382, per=26.12%, avg=191.95, stdev=81.56, samples=64 iops : min= 3, max= 23, avg=11.19, stdev= 5.12, samples=64 lat (usec) : 50=0.26%, 100=4.69%, 500=0.13%, 750=0.26%, 1000=0.13% lat (msec) : 2=3.39%, 4=4.04%, 10=9.11%, 20=8.98%, 50=32.94% lat (msec) : 100=27.99%, 250=7.94%, 500=0.13% cpu : usr=0.06%, sys=5.01%, ctx=1650, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=699KiB/s (716kB/s), 169KiB/s-187KiB/s (173kB/s-192kB/s), io=23.4MiB (24.5MB), run=33107-34259msec WRITE: bw=736KiB/s (753kB/s), 181KiB/s-192KiB/s (185kB/s-197kB/s), io=24.6MiB (25.8MB), run=33107-34259msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179258: Tue Sep 15 16:32:34 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(5920KiB/49288msec) clat (msec): min=9, max=259, avg=51.76, stdev=39.33 lat (msec): min=9, max=259, avg=51.76, stdev=39.33 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 101], 95.00th=[ 132], | 99.00th=[ 207], 99.50th=[ 236], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 287, per=25.46%, avg=123.49, stdev=65.29, samples=94 iops : min= 1, max= 17, avg= 6.85, stdev= 4.09, samples=94 write: IOPS=8, BW=129KiB/s (132kB/s)(6368KiB/49288msec); 0 zone resets clat (msec): min=14, max=387, avg=75.02, stdev=48.01 lat (msec): min=14, max=387, avg=75.03, stdev=48.01 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 70], | 70.00th=[ 85], 80.00th=[ 107], 90.00th=[ 132], 95.00th=[ 155], | 99.00th=[ 284], 99.50th=[ 321], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 30, max= 316, per=25.12%, avg=128.38, stdev=65.73, samples=97 iops : min= 1, max= 19, avg= 7.18, stdev= 4.13, samples=97 lat (msec) : 10=0.26%, 20=5.21%, 50=44.40%, 100=33.20%, 250=16.15% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=1.69%, ctx=1252, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179260: Tue Sep 15 16:32:34 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5744KiB/49198msec) clat (msec): min=7, max=345, avg=52.30, stdev=42.84 lat (msec): min=7, max=345, avg=52.31, stdev=42.84 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 72], 90.00th=[ 105], 95.00th=[ 140], | 99.00th=[ 201], 99.50th=[ 292], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 415, per=25.08%, avg=121.63, stdev=75.13, samples=93 iops : min= 1, max= 25, avg= 6.75, stdev= 4.73, samples=93 write: IOPS=8, BW=133KiB/s (136kB/s)(6544KiB/49198msec); 0 zone resets clat (msec): min=12, max=311, avg=74.06, stdev=44.07 lat (msec): min=12, max=311, avg=74.06, stdev=44.07 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 71], | 70.00th=[ 90], 80.00th=[ 110], 90.00th=[ 134], 95.00th=[ 159], | 99.00th=[ 215], 99.50th=[ 279], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 349, per=26.18%, avg=133.78, stdev=68.47, samples=96 iops : min= 1, max= 21, avg= 7.50, stdev= 4.27, samples=96 lat (msec) : 10=0.52%, 20=5.99%, 50=45.05%, 100=31.12%, 250=16.67% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.65%, ctx=1167, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179261: Tue Sep 15 16:32:34 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(6256KiB/48220msec) clat (msec): min=9, max=241, avg=50.96, stdev=38.85 lat (msec): min=9, max=241, avg=50.96, stdev=38.85 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 69], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 211], 99.50th=[ 218], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 30, max= 318, per=27.03%, avg=131.07, stdev=75.74, samples=94 iops : min= 1, max= 19, avg= 7.34, stdev= 4.75, samples=94 write: IOPS=7, BW=125KiB/s (128kB/s)(6032KiB/48220msec); 0 zone resets clat (msec): min=16, max=386, avg=74.10, stdev=47.67 lat (msec): min=16, max=386, avg=74.11, stdev=47.67 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 71], | 70.00th=[ 85], 80.00th=[ 102], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 251], 99.50th=[ 296], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 31, max= 318, per=24.55%, avg=125.47, stdev=63.21, samples=94 iops : min= 1, max= 19, avg= 6.99, stdev= 3.96, samples=94 lat (msec) : 10=0.39%, 20=5.99%, 50=45.18%, 100=32.42%, 250=15.49% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.69%, ctx=1221, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179262: Tue Sep 15 16:32:34 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(6032KiB/47635msec) clat (msec): min=7, max=242, avg=51.12, stdev=40.19 lat (msec): min=7, max=242, avg=51.13, stdev=40.20 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 68], 90.00th=[ 111], 95.00th=[ 146], | 99.00th=[ 205], 99.50th=[ 224], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 30, max= 414, per=26.59%, avg=128.98, stdev=75.48, samples=92 iops : min= 1, max= 25, avg= 7.21, stdev= 4.74, samples=92 write: IOPS=8, BW=131KiB/s (134kB/s)(6256KiB/47635msec); 0 zone resets clat (msec): min=19, max=280, avg=71.59, stdev=41.30 lat (msec): min=19, max=280, avg=71.61, stdev=41.29 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 72], | 70.00th=[ 86], 80.00th=[ 104], 90.00th=[ 127], 95.00th=[ 157], | 99.00th=[ 197], 99.50th=[ 230], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 380, per=25.94%, avg=132.56, stdev=65.61, samples=93 iops : min= 1, max= 23, avg= 7.44, stdev= 4.11, samples=93 lat (msec) : 10=0.78%, 20=5.73%, 50=46.35%, 100=30.21%, 250=16.80% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.58%, ctx=1182, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=486KiB/s (498kB/s), 117KiB/s-130KiB/s (120kB/s-133kB/s), io=23.4MiB (24.5MB), run=47635-49288msec WRITE: bw=511KiB/s (524kB/s), 125KiB/s-133KiB/s (128kB/s-136kB/s), io=24.6MiB (25.8MB), run=47635-49288msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179277: Tue Sep 15 16:32:52 2026 read: IOPS=1, BW=1088KiB/s (1114kB/s)(7168KiB/6588msec) clat (msec): min=13, max=2752, avg=600.34, stdev=957.65 lat (msec): min=13, max=2752, avg=600.34, stdev=957.65 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 14], 10.00th=[ 14], 20.00th=[ 178], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 257], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 418], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1721, max= 4063, per=84.79%, avg=2373.20, stdev=953.99, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=777KiB/s (796kB/s)(5120KiB/6588msec); 0 zone resets clat (msec): min=358, max=518, avg=459.13, stdev=64.26 lat (msec): min=358, max=518, avg=459.21, stdev=64.26 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1892, max= 2048, per=51.02%, avg=1999.50, stdev=73.12, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 20=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=9.52%, ctx=676, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179279: Tue Sep 15 16:32:52 2026 read: IOPS=0, BW=280KiB/s (287kB/s)(2048KiB/7315msec) clat (msec): min=180, max=413, avg=297.33, stdev=164.81 lat (msec): min=180, max=413, avg=297.33, stdev=164.81 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1777, max= 2015, per=67.74%, avg=1896.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1400KiB/s (1433kB/s)(10.0MiB/7315msec); 0 zone resets clat (msec): min=190, max=2846, avg=640.20, stdev=792.57 lat (msec): min=191, max=2846, avg=640.53, stdev=792.46 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 284], | 30.00th=[ 292], 40.00th=[ 305], 50.00th=[ 313], 60.00th=[ 443], | 70.00th=[ 447], 80.00th=[ 506], 90.00th=[ 785], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1892, max= 4096, per=66.00%, avg=2586.57, stdev=1029.35, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=8.90%, ctx=254, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179281: Tue Sep 15 16:32:52 2026 read: IOPS=0, BW=926KiB/s (948kB/s)(6144KiB/6634msec) clat (usec): min=523, max=404523, avg=136471.93, stdev=165242.35 lat (usec): min=525, max=404524, avg=136473.37, stdev=165242.40 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 938], | 30.00th=[ 938], 40.00th=[ 2671], 50.00th=[ 2671], 60.00th=[189793], | 70.00th=[221250], 80.00th=[221250], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 1892, max= 6144, per=100.00%, avg=3355.67, stdev=2415.77, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=0, BW=926KiB/s (948kB/s)(6144KiB/6634msec); 0 zone resets clat (msec): min=194, max=3545, avg=917.01, stdev=1300.07 lat (msec): min=195, max=3546, avg=917.31, stdev=1299.95 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 443], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 2015, max= 4096, per=62.37%, avg=2444.20, stdev=923.46, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.26%, ctx=180, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179282: Tue Sep 15 16:32:52 2026 read: IOPS=0, BW=791KiB/s (810kB/s)(5120KiB/6469msec) clat (usec): min=726, max=256144, avg=77481.73, stdev=104943.83 lat (usec): min=727, max=256145, avg=77483.06, stdev=104943.81 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 725], 10.00th=[ 725], 20.00th=[ 725], | 30.00th=[ 2343], 40.00th=[ 2343], 50.00th=[ 53216], 60.00th=[ 53216], | 70.00th=[ 74974], 80.00th=[ 74974], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1108KiB/s (1135kB/s)(7168KiB/6469msec); 0 zone resets clat (msec): min=255, max=3391, avg=828.25, stdev=1137.48 lat (msec): min=256, max=3391, avg=828.36, stdev=1137.46 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 279], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 430], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 600], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1892, max= 2048, per=51.21%, avg=2006.80, stdev=65.63, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=16.67%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.25%, ctx=127, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2800KiB/s (2867kB/s), 280KiB/s-1088KiB/s (287kB/s-1114kB/s), io=20.0MiB (20.0MB), run=6469-7315msec WRITE: bw=3920KiB/s (4014kB/s), 777KiB/s-1400KiB/s (796kB/s-1433kB/s), io=28.0MiB (29.4MB), run=6469-7315msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179275: Tue Sep 15 16:32:53 2026 read: IOPS=0, BW=938KiB/s (961kB/s)(7168KiB/7641msec) clat (msec): min=123, max=3369, avg=658.01, stdev=1196.88 lat (msec): min=123, max=3369, avg=658.01, stdev=1196.88 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 161], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 247], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 262], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1738, max= 4096, per=100.00%, avg=2972.00, stdev=1257.57, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=670KiB/s (686kB/s)(5120KiB/7641msec); 0 zone resets clat (msec): min=294, max=989, avg=590.79, stdev=301.11 lat (msec): min=294, max=989, avg=590.94, stdev=301.16 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 2011, max= 2039, per=55.28%, avg=2025.00, stdev=11.55, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=33.33%, 500=41.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.70%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179276: Tue Sep 15 16:32:53 2026 read: IOPS=0, BW=262KiB/s (268kB/s)(2048KiB/7826msec) clat (msec): min=109, max=267, avg=188.14, stdev=111.86 lat (msec): min=109, max=267, avg=188.14, stdev=111.86 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 268], 95.00th=[ 268], | 99.00th=[ 268], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 1510, max= 2027, per=67.60%, avg=1768.50, stdev=365.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1308KiB/s (1340kB/s)(10.0MiB/7826msec); 0 zone resets clat (msec): min=105, max=2905, avg=724.40, stdev=853.59 lat (msec): min=105, max=2906, avg=724.61, stdev=853.84 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 215], 50.00th=[ 326], 60.00th=[ 485], | 70.00th=[ 776], 80.00th=[ 877], 90.00th=[ 1234], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1973, max= 6119, per=71.18%, avg=2607.43, stdev=1548.66, samples=7 iops : min= 1, max= 5, avg= 1.71, stdev= 1.50, samples=7 lat (msec) : 250=41.67%, 500=25.00%, 1000=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.76%, ctx=126, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179278: Tue Sep 15 16:32:53 2026 read: IOPS=0, BW=811KiB/s (830kB/s)(6144KiB/7576msec) clat (msec): min=79, max=912, avg=391.53, stdev=350.99 lat (msec): min=79, max=912, avg=391.54, stdev=350.99 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 388], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 2027, max= 4047, per=100.00%, avg=2704.33, stdev=1162.80, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=811KiB/s (830kB/s)(6144KiB/7576msec); 0 zone resets clat (msec): min=65, max=3363, avg=837.55, stdev=1262.71 lat (msec): min=65, max=3368, avg=838.52, stdev=1264.73 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 409], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1488, max= 2048, per=51.91%, avg=1901.50, stdev=275.73, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=25.00%, 250=16.67%, 500=25.00%, 750=8.33%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=1.36%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179280: Tue Sep 15 16:32:53 2026 read: IOPS=0, BW=863KiB/s (883kB/s)(5120KiB/5936msec) clat (msec): min=86, max=501, avg=215.03, stdev=174.65 lat (msec): min=86, max=501, avg=215.03, stdev=174.65 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 117], 60.00th=[ 117], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2007, max= 4096, per=100.00%, avg=2708.67, stdev=1201.49, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1208KiB/s (1237kB/s)(7168KiB/5936msec); 0 zone resets clat (msec): min=190, max=3006, avg=688.44, stdev=1027.30 lat (msec): min=190, max=3006, avg=688.71, stdev=1027.24 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 205], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 326], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 489], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1514, max= 4071, per=79.03%, avg=2894.75, stdev=1305.39, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.83%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2617KiB/s (2680kB/s), 262KiB/s-938KiB/s (268kB/s-961kB/s), io=20.0MiB (20.0MB), run=5936-7826msec WRITE: bw=3664KiB/s (3752kB/s), 670KiB/s-1308KiB/s (686kB/s-1340kB/s), io=28.0MiB (29.4MB), run=5936-7826msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179294: Tue Sep 15 16:33:08 2026 read: IOPS=1, BW=4836KiB/s (4952kB/s)(12.0MiB/2541msec) clat (msec): min=536, max=1013, avg=767.27, stdev=239.08 lat (msec): min=536, max=1013, avg=767.27, stdev=239.08 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7953, max= 8110, per=100.00%, avg=8031.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.97%, ctx=220, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179295: Tue Sep 15 16:33:08 2026 read: IOPS=0, BW=1814KiB/s (1858kB/s)(4096KiB/2258msec) clat (nsec): min=563901k, max=563901k, avg=563900823.00, stdev= 0.00 lat (nsec): min=563905k, max=563905k, avg=563904560.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3628KiB/s (3715kB/s)(8192KiB/2258msec); 0 zone resets clat (msec): min=658, max=864, avg=761.47, stdev=146.28 lat (msec): min=661, max=869, avg=765.42, stdev=146.97 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8110, max= 8110, per=83.19%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=5.94%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179296: Tue Sep 15 16:33:08 2026 write: IOPS=0, BW=3656KiB/s (3744kB/s)(12.0MiB/3361msec); 0 zone resets clat (msec): min=486, max=1828, avg=1063.62, stdev=690.33 lat (msec): min=487, max=1832, avg=1066.15, stdev=692.02 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 7876, max= 8126, per=82.07%, avg=8001.00, stdev=176.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=3.10%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179297: Tue Sep 15 16:33:08 2026 write: IOPS=1, BW=4511KiB/s (4619kB/s)(12.0MiB/2724msec); 0 zone resets clat (msec): min=768, max=1020, avg=876.42, stdev=130.15 lat (msec): min=769, max=1022, avg=877.10, stdev=130.59 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7670, max= 8000, per=80.37%, avg=7835.00, stdev=233.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.11%, sys=3.31%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6448KiB/s (6603kB/s), 1814KiB/s-4836KiB/s (1858kB/s-4952kB/s), io=16.0MiB (16.8MB), run=2258-2541msec WRITE: bw=9749KiB/s (9983kB/s), 3628KiB/s-4511KiB/s (3715kB/s-4619kB/s), io=32.0MiB (33.6MB), run=2258-3361msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179290: Tue Sep 15 16:33:08 2026 read: IOPS=0, BW=3947KiB/s (4042kB/s)(12.0MiB/3113msec) clat (msec): min=744, max=1194, avg=991.14, stdev=228.42 lat (msec): min=744, max=1194, avg=991.14, stdev=228.42 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8062, max= 8175, per=100.00%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.31%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179291: Tue Sep 15 16:33:08 2026 read: IOPS=0, BW=1224KiB/s (1253kB/s)(4096KiB/3347msec) clat (nsec): min=1439.4M, max=1439.4M, avg=1439428765.00, stdev= 0.00 lat (nsec): min=1439.4M, max=1439.4M, avg=1439431077.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2448KiB/s (2506kB/s)(8192KiB/3347msec); 0 zone resets clat (msec): min=284, max=1559, avg=922.10, stdev=901.82 lat (msec): min=285, max=1562, avg=923.56, stdev=903.01 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8159, max= 8159, per=83.34%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.53%, ctx=50, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179292: Tue Sep 15 16:33:08 2026 write: IOPS=1, BW=6021KiB/s (6165kB/s)(12.0MiB/2041msec); 0 zone resets clat (msec): min=369, max=910, avg=661.07, stdev=273.00 lat (msec): min=371, max=910, avg=662.92, stdev=272.54 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 6543, max= 8126, per=74.92%, avg=7334.50, stdev=1119.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=4.80%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179293: Tue Sep 15 16:33:08 2026 write: IOPS=1, BW=5361KiB/s (5490kB/s)(12.0MiB/2292msec); 0 zone resets clat (msec): min=235, max=1521, avg=734.32, stdev=689.64 lat (msec): min=237, max=1521, avg=735.25, stdev=689.12 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7670, max= 8062, per=80.35%, avg=7866.00, stdev=277.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.06%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4895KiB/s (5013kB/s), 1224KiB/s-3947KiB/s (1253kB/s-4042kB/s), io=16.0MiB (16.8MB), run=3113-3347msec WRITE: bw=9790KiB/s (10.0MB/s), 2448KiB/s-6021KiB/s (2506kB/s-6165kB/s), io=32.0MiB (33.6MB), run=2041-3347msec