== sanity test 398b: DIO and buffer IO race ============== 15:47:54 (1788464874) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.87319 s, 7.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144538: Thu Sep 3 15:50:42 2026 read: IOPS=10, BW=40.9KiB/s (41.9kB/s)(5992KiB/146432msec) clat (usec): min=31, max=309829, avg=45967.29, stdev=37287.23 lat (usec): min=31, max=309830, avg=45968.52, stdev=37287.26 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 67], 20.00th=[ 18744], | 30.00th=[ 25035], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 46400], | 70.00th=[ 57410], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[175113], 99.50th=[202376], 99.90th=[304088], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 128, per=25.21%, avg=40.84, stdev=19.93, samples=285 iops : min= 1, max= 32, avg= 9.56, stdev= 5.03, samples=285 write: IOPS=10, BW=42.0KiB/s (44.0kB/s)(6296KiB/146432msec); 0 zone resets clat (usec): min=863, max=518537, avg=49207.82, stdev=52435.26 lat (usec): min=865, max=518538, avg=49212.88, stdev=52435.83 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1221], 20.00th=[ 3228], | 30.00th=[ 7504], 40.00th=[ 20579], 50.00th=[ 35914], 60.00th=[ 49546], | 70.00th=[ 66323], 80.00th=[ 87557], 90.00th=[120062], 95.00th=[149947], | 99.00th=[214959], 99.50th=[240124], 99.90th=[413139], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 120, per=25.27%, avg=42.71, stdev=20.94, samples=286 iops : min= 1, max= 30, avg=10.04, stdev= 5.29, samples=286 lat (usec) : 50=1.04%, 100=4.72%, 250=0.33%, 500=0.13%, 1000=0.39% lat (msec) : 2=8.01%, 4=3.19%, 10=5.83%, 20=7.36%, 50=30.89% lat (msec) : 100=26.53%, 250=11.36%, 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=4.22%, ctx=6100, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144539: Thu Sep 3 15:50:42 2026 read: IOPS=10, BW=40.2KiB/s (41.1kB/s)(5940KiB/147893msec) clat (usec): min=25, max=418079, avg=45252.60, stdev=37275.28 lat (usec): min=25, max=418081, avg=45253.82, stdev=37275.37 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 16188], | 30.00th=[ 23462], 40.00th=[ 30016], 50.00th=[ 37487], 60.00th=[ 46924], | 70.00th=[ 57934], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[156238], 99.50th=[177210], 99.90th=[252707], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 5, max= 136, per=24.90%, avg=40.34, stdev=21.17, samples=286 iops : min= 1, max= 34, avg= 9.44, stdev= 5.34, samples=286 write: IOPS=10, BW=42.9KiB/s (43.0kB/s)(6348KiB/147893msec); 0 zone resets clat (usec): min=713, max=384181, avg=50750.19, stdev=55229.69 lat (usec): min=713, max=384183, avg=50751.77, stdev=55229.71 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1139], 10.00th=[ 1237], 20.00th=[ 3097], | 30.00th=[ 7570], 40.00th=[ 21365], 50.00th=[ 35390], 60.00th=[ 49021], | 70.00th=[ 66323], 80.00th=[ 88605], 90.00th=[126354], 95.00th=[160433], | 99.00th=[235930], 99.50th=[283116], 99.90th=[337642], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 151, per=25.17%, avg=42.54, stdev=21.21, samples=290 iops : min= 1, max= 37, avg= 9.99, stdev= 5.34, samples=290 lat (usec) : 50=0.91%, 100=5.66%, 250=0.10%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=7.94%, 4=3.45%, 10=5.73%, 20=8.30%, 50=29.52% lat (msec) : 100=26.14%, 250=11.59%, 500=0.39% cpu : usr=0.06%, sys=4.27%, ctx=6076, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144541: Thu Sep 3 15:50:42 2026 read: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6028KiB/144339msec) clat (usec): min=26, max=284068, avg=44838.46, stdev=36632.93 lat (usec): min=27, max=284068, avg=44840.29, stdev=36633.60 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 17433], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[108528], | 99.00th=[164627], 99.50th=[193987], 99.90th=[278922], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 119, per=25.63%, avg=41.52, stdev=20.57, samples=282 iops : min= 1, max= 29, avg= 9.74, stdev= 5.19, samples=282 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6260KiB/144339msec); 0 zone resets clat (usec): min=675, max=399308, avg=48956.21, stdev=52456.02 lat (usec): min=675, max=399309, avg=48969.02, stdev=52455.78 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3687], | 30.00th=[ 9241], 40.00th=[ 19530], 50.00th=[ 34341], 60.00th=[ 49021], | 70.00th=[ 65799], 80.00th=[ 84411], 90.00th=[120062], 95.00th=[147850], | 99.00th=[231736], 99.50th=[263193], 99.90th=[354419], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 104, per=25.43%, avg=42.98, stdev=18.92, samples=283 iops : min= 1, max= 26, avg=10.11, stdev= 4.77, samples=283 lat (usec) : 50=1.11%, 100=5.34%, 250=0.36%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=7.26%, 4=3.29%, 10=5.53%, 20=8.76%, 50=30.92% lat (msec) : 100=25.55%, 250=11.13%, 500=0.42% cpu : usr=0.07%, sys=4.22%, ctx=5946, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144542: Thu Sep 3 15:50:42 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6052KiB/144298msec) clat (usec): min=30, max=537141, avg=46151.33, stdev=42233.19 lat (usec): min=31, max=537143, avg=46154.25, stdev=42233.58 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 16909], | 30.00th=[ 24249], 40.00th=[ 30016], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 56886], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[181404], 99.50th=[223347], 99.90th=[488637], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 119, per=25.85%, avg=41.87, stdev=20.37, samples=281 iops : min= 1, max= 29, avg= 9.82, stdev= 5.13, samples=281 write: IOPS=10, BW=43.2KiB/s (44.3kB/s)(6236KiB/144298msec); 0 zone resets clat (usec): min=859, max=348610, avg=47692.34, stdev=51304.95 lat (usec): min=860, max=348611, avg=47694.03, stdev=51304.88 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1106], 10.00th=[ 1205], 20.00th=[ 2966], | 30.00th=[ 7898], 40.00th=[ 19792], 50.00th=[ 32900], 60.00th=[ 46400], | 70.00th=[ 63701], 80.00th=[ 83362], 90.00th=[117965], 95.00th=[152044], | 99.00th=[221250], 99.50th=[244319], 99.90th=[316670], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 144, per=25.53%, avg=43.15, stdev=21.72, samples=281 iops : min= 1, max= 36, avg=10.15, stdev= 5.49, samples=281 lat (usec) : 50=1.24%, 100=5.47%, 250=0.36%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.62% lat (msec) : 2=7.85%, 4=2.96%, 10=5.50%, 20=7.68%, 50=31.18% lat (msec) : 100=25.49%, 250=11.10%, 500=0.33%, 750=0.03% cpu : usr=0.06%, sys=4.26%, ctx=6034, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=162KiB/s (166kB/s), 40.2KiB/s-41.9KiB/s (41.1kB/s-42.9kB/s), io=23.4MiB (24.6MB), run=144298-147893msec WRITE: bw=170KiB/s (174kB/s), 42.9KiB/s-43.4KiB/s (43.0kB/s-44.4kB/s), io=24.6MiB (25.7MB), run=144298-147893msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144532: Thu Sep 3 15:53:17 2026 read: IOPS=4, BW=19.7KiB/s (20.2kB/s)(5992KiB/304449msec) clat (msec): min=4, max=958, avg=39.90, stdev=52.38 lat (msec): min=4, max=958, avg=39.90, stdev=52.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 38], 80.00th=[ 57], 90.00th=[ 91], 95.00th=[ 129], | 99.00th=[ 209], 99.50th=[ 288], 99.90th=[ 818], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 103, per=29.81%, avg=23.25, stdev=17.11, samples=498 iops : min= 1, max= 25, avg= 5.21, stdev= 4.34, samples=498 write: IOPS=5, BW=20.7KiB/s (21.2kB/s)(6296KiB/304449msec); 0 zone resets clat (msec): min=32, max=585, avg=155.19, stdev=81.42 lat (msec): min=32, max=586, avg=155.20, stdev=81.42 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 87], | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 136], 60.00th=[ 157], | 70.00th=[ 182], 80.00th=[ 215], 90.00th=[ 268], 95.00th=[ 321], | 99.00th=[ 409], 99.50th=[ 447], 99.90th=[ 527], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 55, per=25.12%, avg=20.60, stdev=10.85, samples=587 iops : min= 1, max= 13, avg= 4.53, stdev= 2.79, samples=587 lat (msec) : 10=4.00%, 20=17.06%, 50=17.55%, 100=20.35%, 250=34.21% lat (msec) : 500=6.67%, 750=0.10%, 1000=0.07% cpu : usr=0.04%, sys=0.92%, ctx=5097, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144533: Thu Sep 3 15:53:17 2026 read: IOPS=4, BW=19.5KiB/s (19.0kB/s)(5940KiB/304249msec) clat (msec): min=4, max=932, avg=37.69, stdev=46.81 lat (msec): min=4, max=932, avg=37.69, stdev=46.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 114], | 99.00th=[ 220], 99.50th=[ 259], 99.90th=[ 426], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 103, per=30.15%, avg=23.52, stdev=16.86, samples=487 iops : min= 1, max= 25, avg= 5.27, stdev= 4.28, samples=487 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6348KiB/304249msec); 0 zone resets clat (msec): min=29, max=560, avg=156.20, stdev=81.54 lat (msec): min=29, max=560, avg=156.20, stdev=81.54 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 89], | 30.00th=[ 104], 40.00th=[ 121], 50.00th=[ 138], 60.00th=[ 157], | 70.00th=[ 184], 80.00th=[ 218], 90.00th=[ 266], 95.00th=[ 317], | 99.00th=[ 430], 99.50th=[ 481], 99.90th=[ 542], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 63, per=25.14%, avg=20.62, stdev=10.73, samples=591 iops : min= 1, max= 15, avg= 4.54, stdev= 2.76, samples=591 lat (msec) : 10=4.62%, 20=16.60%, 50=17.68%, 100=20.08%, 250=34.18% lat (msec) : 500=6.71%, 750=0.10%, 1000=0.03% cpu : usr=0.03%, sys=0.90%, ctx=4975, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144534: Thu Sep 3 15:53:17 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6028KiB/303936msec) clat (msec): min=4, max=822, avg=40.09, stdev=44.99 lat (msec): min=4, max=822, avg=40.09, stdev=44.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 42], 80.00th=[ 61], 90.00th=[ 95], 95.00th=[ 121], | 99.00th=[ 201], 99.50th=[ 234], 99.90th=[ 326], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 80, per=29.42%, avg=22.95, stdev=15.99, samples=507 iops : min= 1, max= 20, avg= 5.13, stdev= 4.02, samples=507 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6260KiB/303936msec); 0 zone resets clat (msec): min=35, max=1025, avg=155.36, stdev=86.51 lat (msec): min=35, max=1025, avg=155.36, stdev=86.51 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 103], 40.00th=[ 116], 50.00th=[ 133], 60.00th=[ 153], | 70.00th=[ 178], 80.00th=[ 215], 90.00th=[ 271], 95.00th=[ 326], | 99.00th=[ 422], 99.50th=[ 493], 99.90th=[ 625], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 63, per=25.17%, avg=20.64, stdev=11.32, samples=583 iops : min= 1, max= 15, avg= 4.55, stdev= 2.90, samples=583 lat (msec) : 10=4.43%, 20=16.37%, 50=17.12%, 100=21.35%, 250=33.95% lat (msec) : 500=6.54%, 750=0.16%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=0.94%, ctx=4823, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144535: Thu Sep 3 15:53:17 2026 read: IOPS=5, BW=20.0KiB/s (20.5kB/s)(6052KiB/302052msec) clat (msec): min=4, max=323, avg=38.05, stdev=40.90 lat (msec): min=4, max=323, avg=38.05, stdev=40.90 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 54], 90.00th=[ 86], 95.00th=[ 125], | 99.00th=[ 199], 99.50th=[ 255], 99.90th=[ 313], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 119, per=30.59%, avg=23.86, stdev=17.53, samples=490 iops : min= 1, max= 29, avg= 5.36, stdev= 4.42, samples=490 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6236KiB/302052msec); 0 zone resets clat (msec): min=26, max=1145, avg=156.54, stdev=89.90 lat (msec): min=26, max=1145, avg=156.55, stdev=89.90 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 102], 40.00th=[ 117], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 180], 80.00th=[ 215], 90.00th=[ 271], 95.00th=[ 321], | 99.00th=[ 464], 99.50th=[ 510], 99.90th=[ 743], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 64, per=25.09%, avg=20.58, stdev=11.04, samples=582 iops : min= 1, max= 16, avg= 4.53, stdev= 2.82, samples=582 lat (msec) : 10=4.92%, 20=16.63%, 50=18.07%, 100=20.48%, 250=32.91% lat (msec) : 500=6.71%, 750=0.26%, 2000=0.03% cpu : usr=0.03%, sys=0.97%, ctx=5076, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=78.9KiB/s (80.8kB/s), 19.5KiB/s-20.0KiB/s (19.0kB/s-20.5kB/s), io=23.4MiB (24.6MB), run=302052-304449msec WRITE: bw=82.6KiB/s (84.6kB/s), 20.6KiB/s-20.9KiB/s (21.1kB/s-21.4kB/s), io=24.6MiB (25.7MB), run=302052-304449msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144602: Thu Sep 3 15:54:04 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(5920KiB/32571msec) clat (usec): min=35, max=357729, avg=47819.69, stdev=45263.09 lat (usec): min=36, max=357730, avg=47828.53, stdev=45255.13 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 86], | 30.00th=[ 24249], 40.00th=[ 31589], 50.00th=[ 38011], 60.00th=[ 49021], | 70.00th=[ 62653], 80.00th=[ 80217], 90.00th=[105382], 95.00th=[125305], | 99.00th=[210764], 99.50th=[274727], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 383, per=25.41%, avg=178.60, stdev=82.52, samples=63 iops : min= 1, max= 23, avg=10.37, stdev= 5.19, samples=63 write: IOPS=12, BW=196KiB/s (200kB/s)(6368KiB/32571msec); 0 zone resets clat (usec): min=1045, max=212270, avg=36696.73, stdev=42442.37 lat (usec): min=1045, max=212272, avg=36699.28, stdev=42442.79 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1598], 10.00th=[ 1876], 20.00th=[ 3785], | 30.00th=[ 6128], 40.00th=[ 10159], 50.00th=[ 20055], 60.00th=[ 31065], | 70.00th=[ 48497], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[122160], | 99.00th=[193987], 99.50th=[208667], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 23, max= 477, per=26.37%, avg=194.89, stdev=110.35, samples=63 iops : min= 1, max= 29, avg=11.41, stdev= 6.96, samples=63 lat (usec) : 50=1.17%, 100=9.11%, 250=0.91%, 750=0.13% lat (msec) : 2=6.12%, 4=5.08%, 10=9.38%, 20=7.03%, 50=27.47% lat (msec) : 100=23.70%, 250=9.64%, 500=0.26% cpu : usr=0.08%, sys=4.81%, ctx=1250, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144603: Thu Sep 3 15:54:04 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/34062msec) clat (usec): min=27, max=300971, avg=47220.14, stdev=44324.72 lat (usec): min=27, max=300972, avg=47231.02, stdev=44323.10 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 51], 10.00th=[ 60], 20.00th=[ 110], | 30.00th=[ 25560], 40.00th=[ 31851], 50.00th=[ 40109], 60.00th=[ 48497], | 70.00th=[ 61080], 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[129500], | 99.00th=[196084], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 23, max= 473, per=24.12%, avg=169.58, stdev=100.23, samples=65 iops : min= 1, max= 29, avg= 9.82, stdev= 6.31, samples=65 write: IOPS=12, BW=192KiB/s (197kB/s)(6544KiB/34062msec); 0 zone resets clat (usec): min=1223, max=448636, avg=41125.10, stdev=53560.77 lat (usec): min=1224, max=448638, avg=41126.98, stdev=53560.80 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1582], 10.00th=[ 1713], 20.00th=[ 2966], | 30.00th=[ 5866], 40.00th=[ 11338], 50.00th=[ 19006], 60.00th=[ 34866], | 70.00th=[ 49546], 80.00th=[ 69731], 90.00th=[114820], 95.00th=[145753], | 99.00th=[217056], 99.50th=[252707], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 31, max= 447, per=25.52%, avg=188.59, stdev=99.82, samples=66 iops : min= 1, max= 27, avg=11.02, stdev= 6.29, samples=66 lat (usec) : 50=2.08%, 100=7.03%, 250=1.17%, 500=0.13% lat (msec) : 2=7.42%, 4=5.08%, 10=7.94%, 20=7.68%, 50=27.73% lat (msec) : 100=23.05%, 250=9.90%, 500=0.78% cpu : usr=0.07%, sys=4.57%, ctx=1303, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144604: Thu Sep 3 15:54:04 2026 read: IOPS=11, BW=188KiB/s (193kB/s)(6256KiB/33231msec) clat (usec): min=36, max=248908, avg=45293.14, stdev=42791.13 lat (usec): min=37, max=248909, avg=45294.20, stdev=42791.12 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 72], | 30.00th=[ 19268], 40.00th=[ 30016], 50.00th=[ 38536], 60.00th=[ 47973], | 70.00th=[ 59507], 80.00th=[ 73925], 90.00th=[ 96994], 95.00th=[135267], | 99.00th=[183501], 99.50th=[185598], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 446, per=26.83%, avg=188.62, stdev=104.09, samples=65 iops : min= 1, max= 27, avg=11.02, stdev= 6.58, samples=65 write: IOPS=11, BW=182KiB/s (186kB/s)(6032KiB/33231msec); 0 zone resets clat (usec): min=1019, max=375040, avg=40861.08, stdev=48824.71 lat (usec): min=1022, max=375042, avg=40863.26, stdev=48824.51 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1631], 10.00th=[ 1795], 20.00th=[ 4883], | 30.00th=[ 8029], 40.00th=[ 13960], 50.00th=[ 22676], 60.00th=[ 34341], | 70.00th=[ 47973], 80.00th=[ 69731], 90.00th=[103285], 95.00th=[137364], | 99.00th=[219153], 99.50th=[240124], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 31, max= 479, per=24.27%, avg=179.37, stdev=98.84, samples=65 iops : min= 1, max= 29, avg=10.43, stdev= 6.25, samples=65 lat (usec) : 50=1.95%, 100=10.03%, 250=0.65%, 500=0.39%, 1000=0.13% lat (msec) : 2=5.86%, 4=3.26%, 10=7.29%, 20=8.20%, 50=29.04% lat (msec) : 100=22.66%, 250=10.42%, 500=0.13% cpu : usr=0.07%, sys=4.52%, ctx=1272, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144605: Thu Sep 3 15:54:04 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(6032KiB/32573msec) clat (usec): min=34, max=271474, avg=45239.10, stdev=43108.20 lat (usec): min=34, max=271475, avg=45248.56, stdev=43116.74 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 49], 10.00th=[ 59], 20.00th=[ 76], | 30.00th=[ 20055], 40.00th=[ 30540], 50.00th=[ 38011], 60.00th=[ 46400], | 70.00th=[ 59507], 80.00th=[ 77071], 90.00th=[106431], 95.00th=[128451], | 99.00th=[179307], 99.50th=[204473], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 443, per=25.62%, avg=180.13, stdev=100.66, samples=63 iops : min= 1, max= 27, avg=10.46, stdev= 6.33, samples=63 write: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32573msec); 0 zone resets clat (usec): min=958, max=418184, avg=39021.81, stdev=50313.75 lat (usec): min=959, max=418184, avg=39023.63, stdev=50313.77 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1582], 10.00th=[ 1729], 20.00th=[ 3458], | 30.00th=[ 6128], 40.00th=[ 10159], 50.00th=[ 18482], 60.00th=[ 32113], | 70.00th=[ 49546], 80.00th=[ 64750], 90.00th=[ 98042], 95.00th=[133694], | 99.00th=[212861], 99.50th=[270533], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 31, max= 412, per=25.57%, avg=188.97, stdev=92.58, samples=63 iops : min= 1, max= 25, avg=11.03, stdev= 5.82, samples=63 lat (usec) : 50=2.60%, 100=8.98%, 250=0.78%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=6.64%, 4=4.82%, 10=8.46%, 20=8.07%, 50=25.39% lat (msec) : 100=22.92%, 250=10.03%, 500=0.52% cpu : usr=0.06%, sys=4.27%, ctx=1204, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=703KiB/s (720kB/s), 169KiB/s-188KiB/s (173kB/s-193kB/s), io=23.4MiB (24.5MB), run=32571-34062msec WRITE: bw=740KiB/s (758kB/s), 182KiB/s-196KiB/s (186kB/s-200kB/s), io=24.6MiB (25.8MB), run=32571-34062msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144607: Thu Sep 3 15:54:50 2026 read: IOPS=4, BW=76.6KiB/s (78.5kB/s)(5920KiB/77273msec) clat (msec): min=6, max=354, avg=42.91, stdev=50.71 lat (msec): min=6, max=354, avg=42.91, stdev=50.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 90], 95.00th=[ 148], | 99.00th=[ 296], 99.50th=[ 330], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 320, per=28.97%, avg=89.22, stdev=62.09, samples=129 iops : min= 1, max= 20, avg= 4.84, stdev= 3.99, samples=129 write: IOPS=5, BW=82.4KiB/s (84.4kB/s)(6368KiB/77273msec); 0 zone resets clat (msec): min=33, max=515, avg=154.07, stdev=87.14 lat (msec): min=33, max=515, avg=154.07, stdev=87.14 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 116], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 178], 80.00th=[ 213], 90.00th=[ 264], 95.00th=[ 330], | 99.00th=[ 485], 99.50th=[ 514], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 30, max= 287, per=26.11%, avg=84.59, stdev=45.17, samples=147 iops : min= 1, max= 17, avg= 4.54, stdev= 2.91, samples=147 lat (msec) : 10=2.47%, 20=15.63%, 50=20.31%, 100=21.22%, 250=33.20% lat (msec) : 500=6.90%, 750=0.26% cpu : usr=0.04%, sys=1.14%, ctx=1377, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144608: Thu Sep 3 15:54:50 2026 read: IOPS=4, BW=73.9KiB/s (75.7kB/s)(5744KiB/77723msec) clat (msec): min=6, max=386, avg=43.32, stdev=51.79 lat (msec): min=6, max=386, avg=43.32, stdev=51.79 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 90], 95.00th=[ 153], | 99.00th=[ 279], 99.50th=[ 334], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 28, max= 316, per=28.60%, avg=88.08, stdev=65.06, samples=127 iops : min= 1, max= 19, avg= 4.77, stdev= 4.14, samples=127 write: IOPS=5, BW=84.2KiB/s (86.2kB/s)(6544KiB/77723msec); 0 zone resets clat (msec): min=35, max=561, avg=151.82, stdev=80.56 lat (msec): min=35, max=561, avg=151.83, stdev=80.56 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 68], 20.00th=[ 90], | 30.00th=[ 105], 40.00th=[ 122], 50.00th=[ 134], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 203], 90.00th=[ 271], 95.00th=[ 317], | 99.00th=[ 397], 99.50th=[ 502], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 223, per=26.58%, avg=86.13, stdev=44.51, samples=148 iops : min= 1, max= 13, avg= 4.64, stdev= 2.86, samples=148 lat (msec) : 10=3.12%, 20=14.45%, 50=20.05%, 100=18.75%, 250=36.72% lat (msec) : 500=6.51%, 750=0.39% cpu : usr=0.04%, sys=1.04%, ctx=1216, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144609: Thu Sep 3 15:54:50 2026 read: IOPS=5, BW=82.9KiB/s (84.8kB/s)(6256KiB/75506msec) clat (msec): min=5, max=287, avg=38.29, stdev=41.73 lat (msec): min=5, max=287, avg=38.30, stdev=41.73 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 70], 95.00th=[ 126], | 99.00th=[ 264], 99.50th=[ 271], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 349, per=31.58%, avg=97.25, stdev=73.66, samples=127 iops : min= 1, max= 21, avg= 5.35, stdev= 4.64, samples=127 write: IOPS=4, BW=79.9KiB/s (81.8kB/s)(6032KiB/75506msec); 0 zone resets clat (msec): min=36, max=534, avg=160.41, stdev=84.86 lat (msec): min=36, max=534, avg=160.42, stdev=84.86 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 75], 20.00th=[ 94], | 30.00th=[ 110], 40.00th=[ 124], 50.00th=[ 140], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 215], 90.00th=[ 279], 95.00th=[ 342], | 99.00th=[ 422], 99.50th=[ 439], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 28, max= 192, per=24.90%, avg=80.67, stdev=40.62, samples=147 iops : min= 1, max= 12, avg= 4.30, stdev= 2.64, samples=147 lat (msec) : 10=2.73%, 20=14.97%, 50=24.61%, 100=16.67%, 250=34.38% lat (msec) : 500=6.51%, 750=0.13% cpu : usr=0.03%, sys=1.00%, ctx=1341, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144610: Thu Sep 3 15:54:50 2026 read: IOPS=4, BW=78.2KiB/s (80.1kB/s)(6032KiB/77120msec) clat (msec): min=4, max=362, avg=41.25, stdev=46.07 lat (msec): min=4, max=362, avg=41.25, stdev=46.07 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 84], 95.00th=[ 126], | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 344, per=30.09%, avg=92.69, stdev=63.07, samples=127 iops : min= 1, max= 21, avg= 5.06, stdev= 3.98, samples=127 write: IOPS=5, BW=81.1KiB/s (83.1kB/s)(6256KiB/77120msec); 0 zone resets clat (msec): min=39, max=559, avg=157.26, stdev=87.05 lat (msec): min=39, max=559, avg=157.26, stdev=87.05 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 90], | 30.00th=[ 107], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 207], 90.00th=[ 275], 95.00th=[ 342], | 99.00th=[ 485], 99.50th=[ 550], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 224, per=25.94%, avg=84.06, stdev=40.63, samples=146 iops : min= 1, max= 14, avg= 4.51, stdev= 2.63, samples=146 lat (msec) : 10=3.12%, 20=13.93%, 50=22.79%, 100=19.14%, 250=33.72% lat (msec) : 500=6.90%, 750=0.39% cpu : usr=0.04%, sys=0.98%, ctx=1222, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=308KiB/s (316kB/s), 73.9KiB/s-82.9KiB/s (75.7kB/s-84.8kB/s), io=23.4MiB (24.5MB), run=75506-77723msec WRITE: bw=324KiB/s (332kB/s), 79.9KiB/s-84.2KiB/s (81.8kB/s-86.2kB/s), io=24.6MiB (25.8MB), run=75506-77723msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144632: Thu Sep 3 15:55:04 2026 read: IOPS=2, BW=2070KiB/s (2120kB/s)(7168KiB/3462msec) clat (msec): min=175, max=332, avg=230.79, stdev=57.63 lat (msec): min=175, max=332, avg=230.79, stdev=57.63 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 180], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 224], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 264], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1875, max= 4079, per=55.49%, avg=2975.00, stdev=1256.42, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1479KiB/s (1514kB/s)(5120KiB/3462msec); 0 zone resets clat (msec): min=234, max=579, avg=368.89, stdev=142.42 lat (msec): min=234, max=579, avg=368.96, stdev=142.43 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1899, max= 2023, per=26.41%, avg=1982.25, stdev=58.47, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=12.34%, ctx=224, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144633: Thu Sep 3 15:55:04 2026 read: IOPS=0, BW=536KiB/s (549kB/s)(2048KiB/3820msec) clat (usec): min=512, max=269612, avg=135062.78, stdev=190282.35 lat (usec): min=514, max=269614, avg=135064.68, stdev=190282.79 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 515], 60.00th=[270533], | 70.00th=[270533], 80.00th=[270533], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1744, max= 1899, per=33.98%, avg=1821.50, stdev=109.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2681KiB/s (2745kB/s)(10.0MiB/3820msec); 0 zone resets clat (msec): min=122, max=979, avg=354.56, stdev=273.43 lat (msec): min=122, max=979, avg=354.75, stdev=273.54 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 150], | 30.00th=[ 178], 40.00th=[ 228], 50.00th=[ 241], 60.00th=[ 243], | 70.00th=[ 275], 80.00th=[ 477], 90.00th=[ 659], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1984, max= 7599, per=47.20%, avg=3542.40, stdev=2431.44, samples=5 iops : min= 1, max= 7, avg= 2.60, stdev= 2.61, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.79%, ctx=145, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144634: Thu Sep 3 15:55:04 2026 read: IOPS=1, BW=1612KiB/s (1651kB/s)(6144KiB/3811msec) clat (usec): min=1639, max=254468, avg=115825.04, stdev=108748.88 lat (usec): min=1640, max=254470, avg=115826.49, stdev=108748.99 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1647], 10.00th=[ 1647], 20.00th=[ 2737], | 30.00th=[ 2737], 40.00th=[ 62129], 50.00th=[ 62129], 60.00th=[162530], | 70.00th=[210764], 80.00th=[210764], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 2043, max= 4047, per=62.54%, avg=3352.67, stdev=1134.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1612KiB/s (1651kB/s)(6144KiB/3811msec); 0 zone resets clat (msec): min=194, max=1096, avg=519.00, stdev=332.96 lat (msec): min=194, max=1096, avg=519.09, stdev=332.97 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 481], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1712, max= 4087, per=31.57%, avg=2369.00, stdev=969.54, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=25.00%, 500=33.33% lat (msec) : 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=8.14%, ctx=124, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144635: Thu Sep 3 15:55:04 2026 read: IOPS=1, BW=1441KiB/s (1475kB/s)(5120KiB/3554msec) clat (usec): min=1248, max=233473, avg=90926.34, stdev=121715.69 lat (usec): min=1249, max=233474, avg=90928.12, stdev=121715.58 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1254], 10.00th=[ 1254], 20.00th=[ 1254], | 30.00th=[ 2507], 40.00th=[ 2507], 50.00th=[ 2737], 60.00th=[ 2737], | 70.00th=[214959], 80.00th=[214959], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2017KiB/s (2065kB/s)(7168KiB/3554msec); 0 zone resets clat (msec): min=71, max=1031, avg=441.88, stdev=355.82 lat (msec): min=71, max=1031, avg=441.97, stdev=355.82 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 153], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 326], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 785], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1822, max= 3968, per=34.70%, avg=2604.33, stdev=1185.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 4=16.67%, 100=8.33%, 250=33.33%, 500=8.33% lat (msec) : 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.47%, ctx=117, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5361KiB/s (5490kB/s), 536KiB/s-2070KiB/s (549kB/s-2120kB/s), io=20.0MiB (20.0MB), run=3462-3820msec WRITE: bw=7506KiB/s (7686kB/s), 1479KiB/s-2681KiB/s (1514kB/s-2745kB/s), io=28.0MiB (29.4MB), run=3462-3820msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144627: Thu Sep 3 15:55:04 2026 read: IOPS=1, BW=1975KiB/s (2022kB/s)(7168KiB/3630msec) clat (msec): min=67, max=391, avg=202.19, stdev=122.09 lat (msec): min=67, max=391, avg=202.19, stdev=122.09 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 113], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 150], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 351], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 4079, max= 4619, per=96.67%, avg=4349.00, stdev=381.84, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1410KiB/s (1444kB/s)(5120KiB/3630msec); 0 zone resets clat (msec): min=294, max=522, avg=423.20, stdev=85.18 lat (msec): min=294, max=522, avg=423.29, stdev=85.18 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2007, max= 2043, per=32.14%, avg=2024.00, stdev=16.12, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=3.20%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144628: Thu Sep 3 15:55:04 2026 read: IOPS=0, BW=450KiB/s (461kB/s)(2048KiB/4552msec) clat (msec): min=114, max=351, avg=232.62, stdev=167.58 lat (msec): min=114, max=351, avg=232.62, stdev=167.58 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1633, max= 2007, per=40.45%, avg=1820.00, stdev=264.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2250KiB/s (2304kB/s)(10.0MiB/4552msec); 0 zone resets clat (msec): min=187, max=973, avg=401.43, stdev=298.34 lat (msec): min=187, max=973, avg=401.76, stdev=298.25 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 205], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 292], 60.00th=[ 300], | 70.00th=[ 309], 80.00th=[ 393], 90.00th=[ 936], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1633, max= 4079, per=41.76%, avg=2630.17, stdev=1102.38, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=4.09%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144629: Thu Sep 3 15:55:04 2026 read: IOPS=1, BW=1416KiB/s (1450kB/s)(6144KiB/4338msec) clat (msec): min=95, max=536, avg=224.35, stdev=157.55 lat (msec): min=95, max=536, avg=224.35, stdev=157.55 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 180], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 2007, max= 4087, per=56.43%, avg=2539.00, stdev=1032.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1416KiB/s (1450kB/s)(6144KiB/4338msec); 0 zone resets clat (msec): min=250, max=644, avg=485.14, stdev=177.45 lat (msec): min=250, max=644, avg=485.72, stdev=176.81 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 617], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1617, max= 2043, per=30.95%, avg=1949.00, stdev=185.90, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=2.74%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144630: Thu Sep 3 15:55:04 2026 read: IOPS=1, BW=1434KiB/s (1468kB/s)(5120KiB/3571msec) clat (msec): min=58, max=153, avg=109.69, stdev=34.73 lat (msec): min=58, max=153, avg=109.69, stdev=34.73 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 110], 60.00th=[ 110], | 70.00th=[ 125], 80.00th=[ 125], 90.00th=[ 155], 95.00th=[ 155], | 99.00th=[ 155], 99.50th=[ 155], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2007KiB/s (2055kB/s)(7168KiB/3571msec); 0 zone resets clat (msec): min=224, max=622, avg=422.11, stdev=149.24 lat (msec): min=224, max=622, avg=422.53, stdev=149.68 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 309], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 376], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 600], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2007, max= 4079, per=44.22%, avg=2785.00, stdev=980.03, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.06%, sys=3.14%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4499KiB/s (4607kB/s), 450KiB/s-1975KiB/s (461kB/s-2022kB/s), io=20.0MiB (20.0MB), run=3571-4552msec WRITE: bw=6299KiB/s (6450kB/s), 1410KiB/s-2250KiB/s (1444kB/s-2304kB/s), io=28.0MiB (29.4MB), run=3571-4552msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144643: Thu Sep 3 15:55:20 2026 read: IOPS=0, BW=2307KiB/s (2363kB/s)(12.0MiB/5326msec) clat (msec): min=895, max=3151, avg=1734.44, stdev=1234.49 lat (msec): min=895, max=3151, avg=1734.45, stdev=1234.49 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.14%, ctx=382, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144644: Thu Sep 3 15:55:20 2026 read: IOPS=0, BW=868KiB/s (889kB/s)(4096KiB/4720msec) clat (nsec): min=3167.6M, max=3167.6M, avg=3167614392.00, stdev= 0.00 lat (nsec): min=3167.6M, max=3167.6M, avg=3167616620.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3171], 5.00th=[ 3171], 10.00th=[ 3171], 20.00th=[ 3171], | 30.00th=[ 3171], 40.00th=[ 3171], 50.00th=[ 3171], 60.00th=[ 3171], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1736KiB/s (1777kB/s)(8192KiB/4720msec); 0 zone resets clat (msec): min=571, max=856, avg=713.98, stdev=201.80 lat (msec): min=571, max=860, avg=716.01, stdev=204.31 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.34%, ctx=493, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144647: Thu Sep 3 15:55:20 2026 write: IOPS=0, BW=2284KiB/s (2339kB/s)(12.0MiB/5379msec); 0 zone resets clat (msec): min=836, max=2977, avg=1704.32, stdev=1126.38 lat (msec): min=837, max=2977, avg=1704.65, stdev=1126.37 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=2.51%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144649: Thu Sep 3 15:55:20 2026 write: IOPS=0, BW=2657KiB/s (2721kB/s)(12.0MiB/4624msec); 0 zone resets clat (msec): min=280, max=3911, avg=1509.68, stdev=2079.85 lat (msec): min=280, max=3911, avg=1509.99, stdev=2079.81 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 3910], 80.00th=[ 3910], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 7420, max= 8192, per=100.00%, avg=7806.00, stdev=545.89, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.80%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3076KiB/s (3150kB/s), 868KiB/s-2307KiB/s (889kB/s-2363kB/s), io=16.0MiB (16.8MB), run=4720-5326msec WRITE: bw=6092KiB/s (6238kB/s), 1736KiB/s-2657KiB/s (1777kB/s-2721kB/s), io=32.0MiB (33.6MB), run=4624-5379msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144645: Thu Sep 3 15:55:21 2026 read: IOPS=0, BW=2099KiB/s (2149kB/s)(12.0MiB/5855msec) clat (msec): min=428, max=3985, avg=1868.12, stdev=1873.05 lat (msec): min=428, max=3985, avg=1868.13, stdev=1873.06 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.43%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144646: Thu Sep 3 15:55:21 2026 read: IOPS=0, BW=704KiB/s (721kB/s)(4096KiB/5817msec) clat (nsec): min=3480.9M, max=3480.9M, avg=3480899390.00, stdev= 0.00 lat (nsec): min=3480.9M, max=3480.9M, avg=3480900774.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3473], 5.00th=[ 3473], 10.00th=[ 3473], 20.00th=[ 3473], | 30.00th=[ 3473], 40.00th=[ 3473], 50.00th=[ 3473], 60.00th=[ 3473], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1408KiB/s (1442kB/s)(8192KiB/5817msec); 0 zone resets clat (msec): min=782, max=1477, avg=1129.97, stdev=491.41 lat (msec): min=782, max=1477, avg=1130.31, stdev=491.46 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.46%, ctx=46, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144648: Thu Sep 3 15:55:21 2026 write: IOPS=0, BW=2195KiB/s (2248kB/s)(12.0MiB/5598msec); 0 zone resets clat (msec): min=510, max=3892, avg=1847.09, stdev=1799.17 lat (msec): min=511, max=3893, avg=1848.50, stdev=1798.56 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 3910], 80.00th=[ 3910], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 7713, max= 7984, per=100.00%, avg=7848.50, stdev=191.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.00%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144650: Thu Sep 3 15:55:21 2026 write: IOPS=0, BW=2433KiB/s (2492kB/s)(12.0MiB/5050msec); 0 zone resets clat (msec): min=160, max=4231, avg=1653.92, stdev=2241.38 lat (msec): min=161, max=4232, avg=1654.48, stdev=2241.80 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 4245], 80.00th=[ 4245], 90.00th=[ 4245], 95.00th=[ 4245], | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], | 99.99th=[ 4245] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.72%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2798KiB/s (2865kB/s), 704KiB/s-2099KiB/s (721kB/s-2149kB/s), io=16.0MiB (16.8MB), run=5817-5855msec WRITE: bw=5633KiB/s (5768kB/s), 1408KiB/s-2433KiB/s (1442kB/s-2492kB/s), io=32.0MiB (33.6MB), run=5050-5817msec