== sanity test 398b: DIO and buffer IO race ============== 11:17:59 (1788535079) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.03541 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179643: Fri Sep 4 11:20:41 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(5992KiB/139815msec) clat (usec): min=36, max=705880, avg=49814.12, stdev=36233.54 lat (usec): min=36, max=705882, avg=49815.73, stdev=36233.63 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11863], 10.00th=[ 17695], 20.00th=[ 24773], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[107480], | 99.00th=[154141], 99.50th=[191890], 99.90th=[263193], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 87, per=25.11%, avg=42.93, stdev=18.41, samples=271 iops : min= 1, max= 21, avg=10.07, stdev= 4.64, samples=271 write: IOPS=11, BW=45.0KiB/s (46.1kB/s)(6296KiB/139815msec); 0 zone resets clat (usec): min=784, max=302958, avg=41275.75, stdev=44248.36 lat (usec): min=785, max=302959, avg=41282.19, stdev=44248.28 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1958], 20.00th=[ 4817], | 30.00th=[ 9110], 40.00th=[ 19006], 50.00th=[ 28967], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[132645], | 99.00th=[206570], 99.50th=[219153], 99.90th=[295699], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=44.64, stdev=19.01, samples=274 iops : min= 1, max= 29, avg=10.50, stdev= 4.80, samples=274 lat (usec) : 50=0.10%, 100=1.66%, 250=0.03%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=5.14%, 4=3.78%, 10=7.36%, 20=9.18%, 50=36.91% lat (msec) : 100=27.57%, 250=7.81%, 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=4.75%, ctx=6530, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179644: Fri Sep 4 11:20:41 2026 read: IOPS=10, BW=43.1KiB/s (44.1kB/s)(5940KiB/137774msec) clat (usec): min=36, max=709872, avg=50920.00, stdev=37716.13 lat (usec): min=36, max=709873, avg=50924.94, stdev=37714.35 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 12780], 10.00th=[ 17957], 20.00th=[ 25560], | 30.00th=[ 31065], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[173016], 99.50th=[206570], 99.90th=[265290], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 111, per=25.09%, avg=42.90, stdev=18.91, samples=269 iops : min= 1, max= 27, avg=10.06, stdev= 4.76, samples=269 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6348KiB/137774msec); 0 zone resets clat (usec): min=726, max=365629, avg=39062.53, stdev=41596.23 lat (usec): min=727, max=365630, avg=39067.24, stdev=41595.16 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1975], 20.00th=[ 4293], | 30.00th=[ 8291], 40.00th=[ 19006], 50.00th=[ 27919], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 65274], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[185598], 99.50th=[221250], 99.90th=[267387], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 127, per=25.59%, avg=45.80, stdev=21.84, samples=269 iops : min= 1, max= 31, avg=10.78, stdev= 5.51, samples=269 lat (usec) : 50=0.13%, 100=1.37%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.14%, 4=4.82%, 10=7.03%, 20=8.37%, 50=37.83% lat (msec) : 100=26.63%, 250=8.17%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=4.84%, ctx=6460, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179645: Fri Sep 4 11:20:41 2026 read: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6028KiB/138486msec) clat (usec): min=38, max=310566, avg=50981.92, stdev=35159.69 lat (usec): min=38, max=310568, avg=50983.65, stdev=35159.67 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10683], 10.00th=[ 18220], 20.00th=[ 24773], | 30.00th=[ 30802], 40.00th=[ 36963], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[179307], 99.50th=[221250], 99.90th=[291505], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 119, per=25.35%, avg=43.34, stdev=18.01, samples=271 iops : min= 1, max= 29, avg=10.18, stdev= 4.55, samples=271 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6260KiB/138486msec); 0 zone resets clat (usec): min=930, max=749570, avg=39297.77, stdev=44408.30 lat (usec): min=931, max=749571, avg=39300.26, stdev=44407.91 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1352], 10.00th=[ 2008], 20.00th=[ 4228], | 30.00th=[ 8291], 40.00th=[ 17433], 50.00th=[ 28181], 60.00th=[ 36439], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[121111], | 99.00th=[181404], 99.50th=[229639], 99.90th=[252707], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 127, per=25.17%, avg=45.06, stdev=21.30, samples=271 iops : min= 1, max= 31, avg=10.61, stdev= 5.39, samples=271 lat (usec) : 50=0.13%, 100=1.89%, 250=0.13%, 1000=0.10% lat (msec) : 2=4.98%, 4=4.75%, 10=6.84%, 20=9.15%, 50=36.17% lat (msec) : 100=28.03%, 250=7.62%, 500=0.20%, 750=0.03% cpu : usr=0.08%, sys=4.90%, ctx=6446, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179646: Fri Sep 4 11:20:41 2026 read: IOPS=11, BW=44.2KiB/s (45.2kB/s)(6052KiB/137029msec) clat (usec): min=44, max=359113, avg=51278.24, stdev=34833.20 lat (usec): min=45, max=359115, avg=51281.80, stdev=34833.53 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11469], 10.00th=[ 17957], 20.00th=[ 25035], | 30.00th=[ 30802], 40.00th=[ 36963], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 62129], 80.00th=[ 73925], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[175113], 99.50th=[206570], 99.90th=[316670], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 95, per=25.65%, avg=43.86, stdev=17.88, samples=269 iops : min= 1, max= 23, avg=10.31, stdev= 4.52, samples=269 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6236KiB/137029msec); 0 zone resets clat (usec): min=930, max=742217, avg=38032.75, stdev=42251.71 lat (usec): min=931, max=742219, avg=38036.11, stdev=42252.21 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 2008], 20.00th=[ 4293], | 30.00th=[ 8160], 40.00th=[ 16450], 50.00th=[ 26870], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 65274], 90.00th=[ 92799], 95.00th=[117965], | 99.00th=[160433], 99.50th=[177210], 99.90th=[287310], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 119, per=25.54%, avg=45.71, stdev=19.98, samples=266 iops : min= 1, max= 29, avg=10.77, stdev= 5.01, samples=266 lat (usec) : 50=0.03%, 100=1.82%, 250=0.10%, 1000=0.03% lat (msec) : 2=5.08%, 4=4.17%, 10=7.91%, 20=8.56%, 50=36.49% lat (msec) : 100=28.29%, 250=7.32%, 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=4.87%, ctx=6507, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=172KiB/s (176kB/s), 42.9KiB/s-44.2KiB/s (43.9kB/s-45.2kB/s), io=23.4MiB (24.6MB), run=137029-139815msec WRITE: bw=180KiB/s (184kB/s), 45.0KiB/s-46.1KiB/s (46.1kB/s-47.2kB/s), io=24.6MiB (25.7MB), run=137029-139815msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179638: Fri Sep 4 11:21:28 2026 read: IOPS=8, BW=32.4KiB/s (33.2kB/s)(5992KiB/184930msec) clat (msec): min=5, max=805, avg=47.58, stdev=46.48 lat (msec): min=6, max=805, avg=47.58, stdev=46.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 69], 90.00th=[ 104], 95.00th=[ 132], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 430], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 159, per=26.11%, avg=33.43, stdev=23.05, samples=348 iops : min= 1, max= 39, avg= 7.70, stdev= 5.80, samples=348 write: IOPS=8, BW=34.0KiB/s (34.9kB/s)(6296KiB/184930msec); 0 zone resets clat (msec): min=13, max=431, avg=71.88, stdev=49.47 lat (msec): min=13, max=431, avg=71.89, stdev=49.47 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 83], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 236], 99.50th=[ 284], 99.90th=[ 409], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 111, per=25.55%, avg=34.23, stdev=20.45, samples=357 iops : min= 1, max= 27, avg= 7.89, stdev= 5.14, samples=357 lat (msec) : 10=1.56%, 20=11.23%, 50=43.78%, 100=27.34%, 250=15.46% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4772, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179639: Fri Sep 4 11:21:28 2026 read: IOPS=7, BW=31.7KiB/s (32.5kB/s)(5940KiB/187134msec) clat (msec): min=6, max=820, avg=48.23, stdev=47.53 lat (msec): min=6, max=820, avg=48.23, stdev=47.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 107], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 236], 99.90th=[ 305], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 117, per=25.40%, avg=32.51, stdev=22.76, samples=353 iops : min= 1, max= 29, avg= 7.47, stdev= 5.73, samples=353 write: IOPS=8, BW=33.9KiB/s (34.7kB/s)(6348KiB/187134msec); 0 zone resets clat (msec): min=13, max=372, avg=72.49, stdev=50.13 lat (msec): min=13, max=372, avg=72.49, stdev=50.13 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 67], | 70.00th=[ 83], 80.00th=[ 107], 90.00th=[ 146], 95.00th=[ 176], | 99.00th=[ 243], 99.50th=[ 268], 99.90th=[ 326], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 111, per=25.11%, avg=33.65, stdev=20.33, samples=364 iops : min= 1, max= 27, avg= 7.75, stdev= 5.11, samples=364 lat (msec) : 10=1.20%, 20=11.78%, 50=42.97%, 100=27.15%, 250=16.28% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.06%, sys=1.57%, ctx=4689, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179640: Fri Sep 4 11:21:28 2026 read: IOPS=8, BW=32.4KiB/s (33.1kB/s)(6028KiB/186265msec) clat (msec): min=6, max=384, avg=48.80, stdev=45.11 lat (msec): min=6, max=384, avg=48.80, stdev=45.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 211], 99.50th=[ 249], 99.90th=[ 300], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 135, per=25.63%, avg=32.80, stdev=22.13, samples=357 iops : min= 1, max= 33, avg= 7.54, stdev= 5.57, samples=357 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6260KiB/186265msec); 0 zone resets clat (msec): min=12, max=855, avg=71.72, stdev=53.76 lat (msec): min=12, max=855, avg=71.72, stdev=53.76 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 82], 80.00th=[ 105], 90.00th=[ 136], 95.00th=[ 169], | 99.00th=[ 262], 99.50th=[ 317], 99.90th=[ 401], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 127, per=25.28%, avg=33.87, stdev=21.07, samples=359 iops : min= 1, max= 31, avg= 7.81, stdev= 5.30, samples=359 lat (msec) : 10=1.69%, 20=11.65%, 50=43.95%, 100=26.04%, 250=15.89% lat (msec) : 500=0.75%, 1000=0.03% cpu : usr=0.05%, sys=1.60%, ctx=4701, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179641: Fri Sep 4 11:21:28 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6052KiB/186210msec) clat (msec): min=6, max=428, avg=48.17, stdev=44.30 lat (msec): min=6, max=428, avg=48.17, stdev=44.30 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 251], 99.90th=[ 388], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 135, per=26.11%, avg=33.41, stdev=22.90, samples=352 iops : min= 1, max= 33, avg= 7.69, stdev= 5.76, samples=352 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6236KiB/186210msec); 0 zone resets clat (msec): min=10, max=832, avg=72.36, stdev=52.29 lat (msec): min=10, max=832, avg=72.36, stdev=52.29 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 251], 99.50th=[ 284], 99.90th=[ 430], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 111, per=25.19%, avg=33.76, stdev=20.57, samples=359 iops : min= 1, max= 27, avg= 7.78, stdev= 5.18, samples=359 lat (msec) : 10=1.56%, 20=11.20%, 50=43.55%, 100=26.43%, 250=16.47% lat (msec) : 500=0.75%, 1000=0.03% cpu : usr=0.06%, sys=1.66%, ctx=4786, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (131kB/s), 31.7KiB/s-32.5KiB/s (32.5kB/s-33.3kB/s), io=23.4MiB (24.6MB), run=184930-187134msec WRITE: bw=134KiB/s (138kB/s), 33.5KiB/s-34.0KiB/s (34.3kB/s-34.9kB/s), io=24.6MiB (25.7MB), run=184930-187134msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Fri Sep 4 11:22:17 2026 read: IOPS=9, BW=155KiB/s (158kB/s)(5920KiB/38276msec) clat (usec): min=39, max=299155, avg=53147.16, stdev=38493.23 lat (usec): min=39, max=299156, avg=53148.42, stdev=38493.28 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 110], 20.00th=[ 25297], | 30.00th=[ 33817], 40.00th=[ 39584], 50.00th=[ 45876], 60.00th=[ 54789], | 70.00th=[ 64750], 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[189793], 99.50th=[196084], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 416, per=24.70%, avg=154.36, stdev=67.10, samples=75 iops : min= 1, max= 26, avg= 8.89, stdev= 4.25, samples=75 write: IOPS=10, BW=166KiB/s (170kB/s)(6368KiB/38276msec); 0 zone resets clat (usec): min=1503, max=214202, avg=46377.53, stdev=43433.51 lat (usec): min=1504, max=214204, avg=46380.84, stdev=43432.81 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2868], 10.00th=[ 5276], 20.00th=[ 8455], | 30.00th=[ 13173], 40.00th=[ 22676], 50.00th=[ 32900], 60.00th=[ 44827], | 70.00th=[ 64226], 80.00th=[ 78119], 90.00th=[112722], 95.00th=[137364], | 99.00th=[181404], 99.50th=[189793], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 478, per=25.91%, avg=170.49, stdev=72.30, samples=73 iops : min= 1, max= 29, avg= 9.92, stdev= 4.57, samples=73 lat (usec) : 50=0.39%, 100=4.17%, 250=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.30%, 4=2.99%, 10=8.72%, 20=8.46%, 50=32.68% lat (msec) : 100=28.65%, 250=11.72%, 500=0.13% cpu : usr=0.09%, sys=4.85%, ctx=1733, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179693: Fri Sep 4 11:22:17 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(5744KiB/37304msec) clat (usec): min=41, max=207905, avg=53849.82, stdev=35696.98 lat (usec): min=41, max=207907, avg=53851.96, stdev=35697.64 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 149], 20.00th=[ 27657], | 30.00th=[ 35914], 40.00th=[ 42206], 50.00th=[ 47973], 60.00th=[ 57934], | 70.00th=[ 66847], 80.00th=[ 78119], 90.00th=[101188], 95.00th=[115868], | 99.00th=[168821], 99.50th=[206570], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 46, max= 317, per=24.84%, avg=155.28, stdev=64.18, samples=72 iops : min= 2, max= 19, avg= 8.96, stdev= 4.11, samples=72 write: IOPS=10, BW=175KiB/s (180kB/s)(6544KiB/37304msec); 0 zone resets clat (usec): min=1439, max=208935, avg=43332.28, stdev=40513.87 lat (usec): min=1441, max=208973, avg=43334.85, stdev=40514.21 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2089], 10.00th=[ 3720], 20.00th=[ 8291], | 30.00th=[ 13435], 40.00th=[ 21627], 50.00th=[ 31851], 60.00th=[ 41157], | 70.00th=[ 55313], 80.00th=[ 77071], 90.00th=[105382], 95.00th=[126354], | 99.00th=[166724], 99.50th=[191890], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 62, max= 352, per=26.67%, avg=175.51, stdev=74.57, samples=73 iops : min= 3, max= 22, avg=10.23, stdev= 4.77, samples=73 lat (usec) : 50=0.39%, 100=4.04%, 250=0.52% lat (msec) : 2=2.47%, 4=3.78%, 10=7.03%, 20=8.59%, 50=33.33% lat (msec) : 100=28.91%, 250=10.94% cpu : usr=0.06%, sys=5.10%, ctx=1703, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179694: Fri Sep 4 11:22:17 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37827msec) clat (usec): min=38, max=269327, avg=55297.24, stdev=42044.20 lat (usec): min=39, max=269329, avg=55301.02, stdev=42042.90 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 71], 10.00th=[ 453], 20.00th=[ 27657], | 30.00th=[ 35390], 40.00th=[ 42206], 50.00th=[ 49021], 60.00th=[ 56361], | 70.00th=[ 63701], 80.00th=[ 74974], 90.00th=[ 98042], 95.00th=[133694], | 99.00th=[238027], 99.50th=[263193], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 30, max= 317, per=26.46%, avg=165.36, stdev=65.18, samples=74 iops : min= 1, max= 19, avg= 9.58, stdev= 4.15, samples=74 write: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37827msec); 0 zone resets clat (usec): min=1543, max=347433, avg=42432.67, stdev=43019.90 lat (usec): min=1545, max=347450, avg=42441.13, stdev=43018.56 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2573], 10.00th=[ 5211], 20.00th=[ 7832], | 30.00th=[ 12256], 40.00th=[ 21365], 50.00th=[ 28705], 60.00th=[ 38011], | 70.00th=[ 53740], 80.00th=[ 67634], 90.00th=[ 98042], 95.00th=[130548], | 99.00th=[187696], 99.50th=[214959], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 429, per=23.78%, avg=156.50, stdev=75.43, samples=74 iops : min= 1, max= 26, avg= 9.01, stdev= 4.76, samples=74 lat (usec) : 50=0.39%, 100=4.30%, 250=0.39%, 500=0.13%, 750=0.39% lat (msec) : 2=2.21%, 4=1.69%, 10=8.46%, 20=8.20%, 50=32.81% lat (msec) : 100=31.12%, 250=9.51%, 500=0.39% cpu : usr=0.07%, sys=4.87%, ctx=1692, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179695: Fri Sep 4 11:22:17 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36224msec) clat (usec): min=36, max=262741, avg=50255.01, stdev=37535.68 lat (usec): min=36, max=262743, avg=50256.27, stdev=37535.72 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 23462], | 30.00th=[ 31589], 40.00th=[ 40109], 50.00th=[ 46400], 60.00th=[ 54264], | 70.00th=[ 62129], 80.00th=[ 77071], 90.00th=[ 92799], 95.00th=[109577], | 99.00th=[214959], 99.50th=[246416], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 314, per=26.53%, avg=165.80, stdev=64.14, samples=71 iops : min= 1, max= 19, avg= 9.62, stdev= 4.09, samples=71 write: IOPS=10, BW=173KiB/s (177kB/s)(6256KiB/36224msec); 0 zone resets clat (usec): min=1527, max=263064, avg=43611.51, stdev=41055.10 lat (usec): min=1529, max=263068, avg=43617.81, stdev=41053.93 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2147], 10.00th=[ 4424], 20.00th=[ 8291], | 30.00th=[ 12518], 40.00th=[ 21890], 50.00th=[ 31589], 60.00th=[ 41681], | 70.00th=[ 57410], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[123208], | 99.00th=[173016], 99.50th=[193987], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 62, max= 352, per=26.37%, avg=173.54, stdev=71.35, samples=71 iops : min= 3, max= 22, avg=10.10, stdev= 4.50, samples=71 lat (usec) : 50=0.78%, 100=5.21%, 250=0.65%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.34%, 4=2.73%, 10=8.20%, 20=7.29%, 50=32.16% lat (msec) : 100=30.99%, 250=8.85%, 500=0.26% cpu : usr=0.08%, sys=4.83%, ctx=1658, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=626KiB/s (641kB/s), 154KiB/s-167KiB/s (158kB/s-171kB/s), io=23.4MiB (24.5MB), run=36224-38276msec WRITE: bw=658KiB/s (674kB/s), 159KiB/s-175KiB/s (163kB/s-180kB/s), io=24.6MiB (25.8MB), run=36224-38276msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Fri Sep 4 11:22:33 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(5920KiB/53603msec) clat (msec): min=8, max=279, avg=59.54, stdev=43.69 lat (msec): min=8, max=279, avg=59.54, stdev=43.69 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 128], 95.00th=[ 159], | 99.00th=[ 207], 99.50th=[ 222], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 316, per=24.90%, avg=111.07, stdev=62.77, samples=103 iops : min= 1, max= 19, avg= 6.14, stdev= 3.97, samples=103 write: IOPS=7, BW=119KiB/s (122kB/s)(6368KiB/53603msec); 0 zone resets clat (msec): min=14, max=386, avg=79.12, stdev=50.17 lat (msec): min=14, max=386, avg=79.12, stdev=50.16 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 48], 40.00th=[ 56], 50.00th=[ 63], 60.00th=[ 74], | 70.00th=[ 87], 80.00th=[ 113], 90.00th=[ 150], 95.00th=[ 180], | 99.00th=[ 264], 99.50th=[ 275], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 27, max= 287, per=25.38%, avg=119.03, stdev=61.08, samples=104 iops : min= 1, max= 17, avg= 6.62, stdev= 3.84, samples=104 lat (msec) : 10=0.13%, 20=4.04%, 50=40.23%, 100=36.07%, 250=18.88% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.51%, ctx=1232, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Fri Sep 4 11:22:33 2026 read: IOPS=6, BW=107KiB/s (110kB/s)(5744KiB/53527msec) clat (msec): min=7, max=264, avg=55.10, stdev=40.80 lat (msec): min=7, max=264, avg=55.10, stdev=40.80 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 50], | 70.00th=[ 60], 80.00th=[ 79], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 201], 99.50th=[ 218], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 345, per=24.88%, avg=110.97, stdev=66.24, samples=100 iops : min= 1, max= 21, avg= 6.13, stdev= 4.19, samples=100 write: IOPS=7, BW=122KiB/s (125kB/s)(6544KiB/53527msec); 0 zone resets clat (msec): min=19, max=381, avg=82.34, stdev=52.89 lat (msec): min=19, max=381, avg=82.35, stdev=52.89 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 77], | 70.00th=[ 94], 80.00th=[ 115], 90.00th=[ 153], 95.00th=[ 186], | 99.00th=[ 259], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 319, per=25.75%, avg=120.76, stdev=63.21, samples=105 iops : min= 1, max= 19, avg= 6.74, stdev= 3.97, samples=105 lat (msec) : 10=0.13%, 20=5.86%, 50=38.67%, 100=35.68%, 250=18.88% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.73%, ctx=1237, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Fri Sep 4 11:22:33 2026 read: IOPS=7, BW=117KiB/s (119kB/s)(6256KiB/53618msec) clat (msec): min=10, max=249, avg=56.32, stdev=41.55 lat (msec): min=10, max=249, avg=56.33, stdev=41.56 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 51], | 70.00th=[ 61], 80.00th=[ 83], 90.00th=[ 124], 95.00th=[ 148], | 99.00th=[ 184], 99.50th=[ 213], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 30, max= 415, per=26.58%, avg=118.55, stdev=78.19, samples=103 iops : min= 1, max= 25, avg= 6.61, stdev= 4.87, samples=103 write: IOPS=7, BW=112KiB/s (115kB/s)(6032KiB/53618msec); 0 zone resets clat (msec): min=17, max=403, avg=83.57, stdev=54.46 lat (msec): min=17, max=403, avg=83.58, stdev=54.46 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 36], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 57], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 100], 80.00th=[ 122], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 288], 99.50th=[ 376], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 282, per=23.50%, avg=110.20, stdev=55.03, samples=105 iops : min= 1, max= 17, avg= 6.08, stdev= 3.48, samples=105 lat (msec) : 20=6.25%, 50=38.67%, 100=32.55%, 250=21.88%, 500=0.65% cpu : usr=0.05%, sys=1.57%, ctx=1236, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179700: Fri Sep 4 11:22:33 2026 read: IOPS=7, BW=114KiB/s (116kB/s)(6032KiB/53053msec) clat (msec): min=8, max=238, avg=57.23, stdev=40.18 lat (msec): min=8, max=238, avg=57.23, stdev=40.18 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 51], | 70.00th=[ 59], 80.00th=[ 82], 90.00th=[ 109], 95.00th=[ 140], | 99.00th=[ 222], 99.50th=[ 234], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 351, per=26.10%, avg=116.40, stdev=67.29, samples=100 iops : min= 1, max= 21, avg= 6.48, stdev= 4.24, samples=100 write: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/53053msec); 0 zone resets clat (msec): min=16, max=398, avg=80.29, stdev=51.50 lat (msec): min=16, max=398, avg=80.30, stdev=51.50 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 55], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 89], 80.00th=[ 112], 90.00th=[ 157], 95.00th=[ 188], | 99.00th=[ 255], 99.50th=[ 264], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 319, per=24.97%, avg=117.09, stdev=62.50, samples=104 iops : min= 1, max= 19, avg= 6.52, stdev= 3.94, samples=104 lat (msec) : 10=0.26%, 20=2.99%, 50=41.80%, 100=36.46%, 250=17.97% lat (msec) : 500=0.52% cpu : usr=0.03%, sys=1.68%, ctx=1255, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=447KiB/s (457kB/s), 107KiB/s-117KiB/s (110kB/s-119kB/s), io=23.4MiB (24.5MB), run=53053-53618msec WRITE: bw=470KiB/s (481kB/s), 112KiB/s-122KiB/s (115kB/s-125kB/s), io=24.6MiB (25.8MB), run=53053-53618msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179714: Fri Sep 4 11:22:54 2026 read: IOPS=1, BW=1869KiB/s (1914kB/s)(7168KiB/3835msec) clat (msec): min=78, max=481, avg=248.65, stdev=159.75 lat (msec): min=78, max=481, avg=248.65, stdev=159.75 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 125], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 201], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 464], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1976, max= 4023, per=93.28%, avg=2405.80, stdev=904.23, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1335KiB/s (1367kB/s)(5120KiB/3835msec); 0 zone resets clat (msec): min=322, max=495, avg=398.69, stdev=63.18 lat (msec): min=324, max=495, avg=399.16, stdev=62.67 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1976, max= 2039, per=55.74%, avg=2012.25, stdev=27.54, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=58.33% cpu : usr=0.00%, sys=3.44%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179715: Fri Sep 4 11:22:54 2026 read: IOPS=0, BW=275KiB/s (281kB/s)(2048KiB/7451msec) clat (msec): min=184, max=225, avg=205.00, stdev=28.65 lat (msec): min=184, max=225, avg=205.00, stdev=28.65 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 1418, max= 2035, per=66.94%, avg=1726.50, stdev=436.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1374KiB/s (1407kB/s)(10.0MiB/7451msec); 0 zone resets clat (msec): min=201, max=2358, avg=667.34, stdev=649.25 lat (msec): min=201, max=2358, avg=668.69, stdev=648.33 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 228], | 30.00th=[ 234], 40.00th=[ 309], 50.00th=[ 330], 60.00th=[ 625], | 70.00th=[ 701], 80.00th=[ 718], 90.00th=[ 969], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1980, max= 4071, per=71.95%, avg=2597.57, stdev=1003.97, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.72%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179716: Fri Sep 4 11:22:54 2026 read: IOPS=0, BW=799KiB/s (818kB/s)(6144KiB/7689msec) clat (msec): min=109, max=512, avg=291.20, stdev=143.83 lat (msec): min=109, max=512, avg=291.20, stdev=143.83 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 313], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2000, max= 3992, per=97.42%, avg=2512.50, stdev=986.44, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=799KiB/s (818kB/s)(6144KiB/7689msec); 0 zone resets clat (msec): min=300, max=2544, avg=950.10, stdev=900.21 lat (msec): min=300, max=2544, avg=950.43, stdev=900.36 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 477], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1514, max= 2031, per=52.88%, avg=1908.80, stdev=221.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.80%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179718: Fri Sep 4 11:22:54 2026 read: IOPS=0, BW=645KiB/s (660kB/s)(5120KiB/7941msec) clat (msec): min=86, max=759, avg=282.24, stdev=279.69 lat (msec): min=86, max=759, avg=282.24, stdev=279.69 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 136], 60.00th=[ 136], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1996, max= 4063, per=100.00%, avg=2698.00, stdev=1182.29, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=903KiB/s (924kB/s)(7168KiB/7941msec); 0 zone resets clat (msec): min=164, max=2328, avg=909.54, stdev=698.78 lat (msec): min=164, max=2328, avg=909.75, stdev=698.78 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 464], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 735], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 1183], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2000, max= 2048, per=56.16%, avg=2027.33, stdev=16.31, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=16.67% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.61%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2579KiB/s (2641kB/s), 275KiB/s-1869KiB/s (281kB/s-1914kB/s), io=20.0MiB (20.0MB), run=3835-7941msec WRITE: bw=3611KiB/s (3697kB/s), 799KiB/s-1374KiB/s (818kB/s-1407kB/s), io=28.0MiB (29.4MB), run=3835-7941msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179719: Fri Sep 4 11:22:54 2026 read: IOPS=0, BW=893KiB/s (915kB/s)(7168KiB/8024msec) clat (usec): min=613, max=4938.8k, avg=858802.75, stdev=1805275.27 lat (usec): min=615, max=4938.8k, avg=858805.14, stdev=1805275.03 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], | 20.00th=[ 1598], 30.00th=[ 119014], 40.00th=[ 119014], | 50.00th=[ 242222], 60.00th=[ 337642], 70.00th=[ 337642], | 80.00th=[ 371196], 90.00th=[4932502], 95.00th=[4932502], | 99.00th=[4932502], 99.50th=[4932502], 99.90th=[4932502], | 99.95th=[4932502], 99.99th=[4932502] bw ( KiB/s): min= 1408, max= 5976, per=100.00%, avg=2842.75, stdev=2107.46, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=0, BW=638KiB/s (653kB/s)(5120KiB/8024msec); 0 zone resets clat (msec): min=131, max=836, avg=354.80, stdev=284.92 lat (msec): min=131, max=836, avg=354.89, stdev=284.96 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1992, max= 2048, per=56.58%, avg=2021.50, stdev=26.39, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.09%, ctx=422, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179720: Fri Sep 4 11:22:54 2026 read: IOPS=0, BW=268KiB/s (275kB/s)(2048KiB/7635msec) clat (usec): min=1339, max=455868, avg=228603.97, stdev=321401.18 lat (usec): min=1340, max=455872, avg=228606.37, stdev=321402.30 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1336], 10.00th=[ 1336], 20.00th=[ 1336], | 30.00th=[ 1336], 40.00th=[ 1336], 50.00th=[ 1336], 60.00th=[455082], | 70.00th=[455082], 80.00th=[455082], 90.00th=[455082], 95.00th=[455082], | 99.00th=[455082], 99.50th=[455082], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 1939, max= 2048, per=78.12%, avg=1993.50, stdev=77.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1341KiB/s (1373kB/s)(10.0MiB/7635msec); 0 zone resets clat (msec): min=191, max=2520, avg=674.27, stdev=693.84 lat (msec): min=191, max=2520, avg=674.50, stdev=693.78 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 245], | 30.00th=[ 247], 40.00th=[ 262], 50.00th=[ 460], 60.00th=[ 498], | 70.00th=[ 600], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1969, max= 4047, per=64.79%, avg=2314.86, stdev=764.26, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 2=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.28%, ctx=161, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179721: Fri Sep 4 11:22:54 2026 read: IOPS=0, BW=891KiB/s (912kB/s)(6144KiB/6899msec) clat (usec): min=571, max=303893, avg=118535.64, stdev=131980.50 lat (usec): min=572, max=303923, avg=118542.21, stdev=131988.44 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 56361], 50.00th=[ 56361], 60.00th=[ 88605], | 70.00th=[261096], 80.00th=[261096], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2039, max= 4096, per=100.00%, avg=3396.67, stdev=1175.95, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=891KiB/s (912kB/s)(6144KiB/6899msec); 0 zone resets clat (msec): min=216, max=2708, avg=962.28, stdev=1002.23 lat (msec): min=216, max=2708, avg=962.47, stdev=1002.26 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 493], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1481, max= 2048, per=53.10%, avg=1897.40, stdev=236.40, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=16.67% lat (msec) : 100=16.67%, 250=8.33%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.80%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179722: Fri Sep 4 11:22:54 2026 read: IOPS=0, BW=760KiB/s (778kB/s)(5120KiB/6736msec) clat (usec): min=573, max=630178, avg=180373.70, stdev=275669.70 lat (usec): min=575, max=630180, avg=180375.45, stdev=275669.82 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 3523], 40.00th=[ 3523], 50.00th=[ 3982], 60.00th=[ 3982], | 70.00th=[263193], 80.00th=[263193], 90.00th=[633340], 95.00th=[633340], | 99.00th=[633340], 99.50th=[633340], 99.90th=[633340], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1064KiB/s (1090kB/s)(7168KiB/6736msec); 0 zone resets clat (msec): min=188, max=2834, avg=820.92, stdev=949.82 lat (msec): min=189, max=2834, avg=821.18, stdev=949.70 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 251], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 401], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 1183], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1996, max= 4055, per=84.31%, avg=3012.50, stdev=1163.17, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=16.67%, 250=8.33%, 500=33.33%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.74%, ctx=106, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2552KiB/s (2614kB/s), 268KiB/s-893KiB/s (275kB/s-915kB/s), io=20.0MiB (20.0MB), run=6736-8024msec WRITE: bw=3573KiB/s (3659kB/s), 638KiB/s-1341KiB/s (653kB/s-1373kB/s), io=28.0MiB (29.4MB), run=6736-8024msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179731: Fri Sep 4 11:23:13 2026 read: IOPS=1, BW=4221KiB/s (4323kB/s)(12.0MiB/2911msec) clat (msec): min=707, max=1196, avg=938.33, stdev=245.80 lat (msec): min=707, max=1196, avg=938.33, stdev=245.80 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.00%, ctx=316, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179733: Fri Sep 4 11:23:13 2026 read: IOPS=0, BW=1362KiB/s (1394kB/s)(4096KiB/3008msec) clat (nsec): min=812183k, max=812183k, avg=812183099.00, stdev= 0.00 lat (nsec): min=812185k, max=812185k, avg=812185409.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2723KiB/s (2789kB/s)(8192KiB/3008msec); 0 zone resets clat (msec): min=707, max=1439, avg=1073.35, stdev=517.84 lat (msec): min=707, max=1440, avg=1073.90, stdev=517.80 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8126, max= 8126, per=92.73%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.96%, ctx=138, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179735: Fri Sep 4 11:23:13 2026 write: IOPS=0, BW=3286KiB/s (3365kB/s)(12.0MiB/3739msec); 0 zone resets clat (msec): min=363, max=2139, avg=1226.50, stdev=889.30 lat (msec): min=363, max=2140, avg=1227.26, stdev=889.54 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 8126, max= 8126, per=92.73%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.40%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179737: Fri Sep 4 11:23:13 2026 write: IOPS=1, BW=4253KiB/s (4355kB/s)(12.0MiB/2889msec); 0 zone resets clat (msec): min=452, max=1439, avg=928.16, stdev=494.48 lat (msec): min=455, max=1442, avg=932.13, stdev=494.40 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8126, max= 8192, per=93.11%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.88%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5447KiB/s (5578kB/s), 1362KiB/s-4221KiB/s (1394kB/s-4323kB/s), io=16.0MiB (16.8MB), run=2911-3008msec WRITE: bw=8764KiB/s (8974kB/s), 2723KiB/s-4253KiB/s (2789kB/s-4355kB/s), io=32.0MiB (33.6MB), run=2889-3739msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179730: Fri Sep 4 11:23:13 2026 read: IOPS=0, BW=3609KiB/s (3695kB/s)(12.0MiB/3405msec) clat (msec): min=532, max=1266, avg=987.95, stdev=397.95 lat (msec): min=532, max=1266, avg=987.95, stdev=397.95 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7968, max= 8159, per=100.00%, avg=8063.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.03%, ctx=57, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179732: Fri Sep 4 11:23:13 2026 read: IOPS=0, BW=1014KiB/s (1039kB/s)(4096KiB/4038msec) clat (nsec): min=974581k, max=974581k, avg=974580702.00, stdev= 0.00 lat (nsec): min=974584k, max=974584k, avg=974583897.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2029KiB/s (2077kB/s)(8192KiB/4038msec); 0 zone resets clat (msec): min=1342, max=1570, avg=1456.84, stdev=161.42 lat (msec): min=1343, max=1572, avg=1457.96, stdev=162.20 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8031, max= 8031, per=98.98%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.28%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179734: Fri Sep 4 11:23:13 2026 write: IOPS=0, BW=3506KiB/s (3590kB/s)(12.0MiB/3505msec); 0 zone resets clat (msec): min=289, max=1947, avg=1133.00, stdev=829.45 lat (msec): min=290, max=1948, avg=1134.80, stdev=829.56 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.83%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179736: Fri Sep 4 11:23:13 2026 write: IOPS=1, BW=4252KiB/s (4354kB/s)(12.0MiB/2890msec); 0 zone resets clat (msec): min=339, max=1627, avg=881.73, stdev=667.58 lat (msec): min=340, max=1627, avg=882.43, stdev=667.43 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.91%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4057KiB/s (4155kB/s), 1014KiB/s-3609KiB/s (1039kB/s-3695kB/s), io=16.0MiB (16.8MB), run=3405-4038msec WRITE: bw=8115KiB/s (8310kB/s), 2029KiB/s-4252KiB/s (2077kB/s-4354kB/s), io=32.0MiB (33.6MB), run=2890-4038msec