== sanity test 398b: DIO and buffer IO race ============== 09:27:06 (1787750826) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.70395 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177986: Wed Aug 26 09:29:49 2026 read: IOPS=11, BW=44.1KiB/s (45.1kB/s)(5992KiB/135965msec) clat (usec): min=37, max=575518, avg=49906.91, stdev=35249.47 lat (usec): min=37, max=575519, avg=49909.39, stdev=35248.86 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11207], 10.00th=[ 17171], 20.00th=[ 25035], | 30.00th=[ 30802], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[168821], 99.50th=[177210], 99.90th=[291505], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 103, per=25.65%, avg=43.86, stdev=19.08, samples=266 iops : min= 1, max= 25, avg=10.29, stdev= 4.80, samples=266 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6296KiB/135965msec); 0 zone resets clat (usec): min=974, max=271387, avg=38746.88, stdev=42012.43 lat (usec): min=974, max=271389, avg=38752.21, stdev=42012.91 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1696], 20.00th=[ 3359], | 30.00th=[ 6915], 40.00th=[ 15664], 50.00th=[ 26346], 60.00th=[ 36963], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[ 95945], 95.00th=[120062], | 99.00th=[183501], 99.50th=[219153], 99.90th=[256902], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 118, per=25.66%, avg=45.94, stdev=20.81, samples=267 iops : min= 1, max= 29, avg=10.82, stdev= 5.24, samples=267 lat (usec) : 50=0.29%, 100=1.53%, 250=0.13%, 750=0.03%, 1000=0.03% lat (msec) : 2=6.54%, 4=4.65%, 10=7.13%, 20=8.63%, 50=35.97% lat (msec) : 100=27.15%, 250=7.68%, 500=0.20%, 750=0.03% cpu : usr=0.09%, sys=4.16%, ctx=6257, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177987: Wed Aug 26 09:29:49 2026 read: IOPS=10, BW=43.3KiB/s (44.3kB/s)(5940KiB/137264msec) clat (usec): min=40, max=481586, avg=51159.48, stdev=35708.29 lat (usec): min=41, max=481587, avg=51161.71, stdev=35708.08 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 13042], 10.00th=[ 18744], 20.00th=[ 25822], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[177210], 99.50th=[208667], 99.90th=[337642], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 103, per=25.14%, avg=42.99, stdev=18.02, samples=269 iops : min= 1, max= 25, avg=10.07, stdev= 4.54, samples=269 write: IOPS=11, BW=46.2KiB/s (47.4kB/s)(6348KiB/137264msec); 0 zone resets clat (usec): min=1009, max=246187, avg=38478.83, stdev=40821.47 lat (usec): min=1011, max=246189, avg=38488.31, stdev=40823.31 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1483], 20.00th=[ 3589], | 30.00th=[ 7373], 40.00th=[ 16909], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 65799], 90.00th=[ 96994], 95.00th=[124257], | 99.00th=[173016], 99.50th=[210764], 99.90th=[233833], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 112, per=25.59%, avg=45.81, stdev=19.43, samples=270 iops : min= 1, max= 28, avg=10.80, stdev= 4.91, samples=270 lat (usec) : 50=0.16%, 100=1.50%, 250=0.20%, 1000=0.03% lat (msec) : 2=7.29%, 4=3.65%, 10=6.93%, 20=7.71%, 50=37.40% lat (msec) : 100=26.86%, 250=8.20%, 500=0.07% cpu : usr=0.08%, sys=4.22%, ctx=6344, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177988: Wed Aug 26 09:29:49 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(6028KiB/137518msec) clat (usec): min=39, max=373095, avg=49572.52, stdev=33837.87 lat (usec): min=40, max=373096, avg=49574.00, stdev=33837.96 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11469], 10.00th=[ 18744], 20.00th=[ 25297], | 30.00th=[ 31327], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 49546], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[179307], 99.50th=[208667], 99.90th=[291505], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 94, per=25.39%, avg=43.42, stdev=18.07, samples=270 iops : min= 1, max= 23, avg=10.19, stdev= 4.55, samples=270 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6260KiB/137518msec); 0 zone resets clat (usec): min=918, max=488619, avg=40023.16, stdev=44664.30 lat (usec): min=920, max=488622, avg=40026.73, stdev=44663.24 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1582], 20.00th=[ 3752], | 30.00th=[ 7177], 40.00th=[ 16450], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[100140], 95.00th=[121111], | 99.00th=[193987], 99.50th=[223347], 99.90th=[354419], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 7, max= 133, per=25.19%, avg=45.09, stdev=19.89, samples=270 iops : min= 1, max= 33, avg=10.61, stdev= 5.02, samples=270 lat (usec) : 50=0.36%, 100=1.46%, 250=0.16%, 750=0.07%, 1000=0.10% lat (msec) : 2=6.15%, 4=4.43%, 10=6.93%, 20=7.94%, 50=37.57% lat (msec) : 100=26.66%, 250=7.88%, 500=0.29% cpu : usr=0.08%, sys=4.20%, ctx=6321, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177989: Wed Aug 26 09:29:49 2026 read: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6052KiB/139714msec) clat (usec): min=35, max=273335, avg=50846.04, stdev=34594.29 lat (usec): min=36, max=273337, avg=50848.20, stdev=34594.18 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10945], 10.00th=[ 17957], 20.00th=[ 24511], | 30.00th=[ 30802], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 52167], | 70.00th=[ 60031], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[175113], 99.50th=[198181], 99.90th=[261096], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 118, per=25.19%, avg=43.08, stdev=18.60, samples=274 iops : min= 1, max= 29, avg=10.11, stdev= 4.69, samples=274 write: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6236KiB/139714msec); 0 zone resets clat (usec): min=965, max=495000, avg=40155.67, stdev=43722.81 lat (usec): min=965, max=495003, avg=40162.20, stdev=43725.33 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1713], 20.00th=[ 3982], | 30.00th=[ 7570], 40.00th=[ 17957], 50.00th=[ 26870], 60.00th=[ 38536], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 99091], 95.00th=[121111], | 99.00th=[185598], 99.50th=[229639], 99.90th=[333448], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 166, per=24.60%, avg=44.03, stdev=20.63, samples=276 iops : min= 1, max= 41, avg=10.35, stdev= 5.19, samples=276 lat (usec) : 50=0.26%, 100=1.53%, 250=0.23%, 500=0.03%, 1000=0.07% lat (msec) : 2=5.89%, 4=4.43%, 10=7.13%, 20=7.58%, 50=36.26% lat (msec) : 100=27.83%, 250=8.59%, 500=0.16% cpu : usr=0.09%, sys=4.21%, ctx=6410, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=172KiB/s (176kB/s), 43.3KiB/s-44.1KiB/s (44.3kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=135965-139714msec WRITE: bw=180KiB/s (184kB/s), 44.6KiB/s-46.3KiB/s (45.7kB/s-47.4kB/s), io=24.6MiB (25.7MB), run=135965-139714msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177981: Wed Aug 26 09:30:31 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(5992KiB/183053msec) clat (msec): min=5, max=799, avg=48.38, stdev=50.65 lat (msec): min=5, max=799, avg=48.38, stdev=50.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 72], 90.00th=[ 112], 95.00th=[ 146], | 99.00th=[ 241], 99.50th=[ 271], 99.90th=[ 376], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 135, per=25.39%, avg=33.26, stdev=24.07, samples=348 iops : min= 1, max= 33, avg= 7.64, stdev= 6.06, samples=348 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6296KiB/183053msec); 0 zone resets clat (msec): min=10, max=417, avg=69.99, stdev=52.11 lat (msec): min=10, max=417, avg=69.99, stdev=52.11 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 63], | 70.00th=[ 81], 80.00th=[ 106], 90.00th=[ 138], 95.00th=[ 174], | 99.00th=[ 262], 99.50th=[ 313], 99.90th=[ 401], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 112, per=25.19%, avg=34.50, stdev=23.08, samples=353 iops : min= 1, max= 28, avg= 7.96, stdev= 5.81, samples=353 lat (msec) : 10=1.79%, 20=13.70%, 50=44.27%, 100=23.34%, 250=15.98% lat (msec) : 500=0.88%, 1000=0.03% cpu : usr=0.06%, sys=1.41%, ctx=4568, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177982: Wed Aug 26 09:30:31 2026 read: IOPS=8, BW=32.6KiB/s (33.3kB/s)(5940KiB/182431msec) clat (msec): min=6, max=748, avg=46.28, stdev=46.32 lat (msec): min=6, max=748, avg=46.28, stdev=46.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 67], 90.00th=[ 105], 95.00th=[ 138], | 99.00th=[ 211], 99.50th=[ 232], 99.90th=[ 351], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 136, per=25.51%, avg=33.42, stdev=24.35, samples=345 iops : min= 1, max= 34, avg= 7.68, stdev= 6.13, samples=345 write: IOPS=8, BW=34.8KiB/s (35.6kB/s)(6348KiB/182431msec); 0 zone resets clat (msec): min=11, max=375, avg=71.38, stdev=50.86 lat (msec): min=11, max=375, avg=71.38, stdev=50.86 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 67], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 171], | 99.00th=[ 249], 99.50th=[ 271], 99.90th=[ 368], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 133, per=25.13%, avg=34.43, stdev=22.77, samples=357 iops : min= 1, max= 33, avg= 7.94, stdev= 5.74, samples=357 lat (msec) : 10=1.76%, 20=13.64%, 50=43.42%, 100=24.45%, 250=16.11% lat (msec) : 500=0.59%, 750=0.03% cpu : usr=0.05%, sys=1.46%, ctx=4717, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177983: Wed Aug 26 09:30:31 2026 read: IOPS=8, BW=33.2KiB/s (34.0kB/s)(6028KiB/181323msec) clat (msec): min=6, max=343, avg=47.10, stdev=44.14 lat (msec): min=6, max=343, avg=47.10, stdev=44.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 108], 95.00th=[ 142], | 99.00th=[ 209], 99.50th=[ 234], 99.90th=[ 330], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 126, per=25.45%, avg=33.34, stdev=23.67, samples=351 iops : min= 1, max= 31, avg= 7.66, stdev= 5.94, samples=351 write: IOPS=8, BW=34.5KiB/s (35.4kB/s)(6260KiB/181323msec); 0 zone resets clat (msec): min=11, max=748, avg=70.22, stdev=52.24 lat (msec): min=11, max=748, avg=70.23, stdev=52.24 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 66], | 70.00th=[ 82], 80.00th=[ 103], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 255], 99.50th=[ 334], 99.90th=[ 384], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 111, per=25.26%, avg=34.61, stdev=22.84, samples=351 iops : min= 1, max= 27, avg= 7.98, stdev= 5.75, samples=351 lat (msec) : 10=1.73%, 20=13.57%, 50=42.58%, 100=25.72%, 250=15.69% lat (msec) : 500=0.68%, 750=0.03% cpu : usr=0.05%, sys=1.42%, ctx=4581, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177984: Wed Aug 26 09:30:31 2026 read: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6052KiB/182816msec) clat (msec): min=5, max=380, avg=47.27, stdev=47.68 lat (msec): min=5, max=380, avg=47.28, stdev=47.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 114], 95.00th=[ 146], | 99.00th=[ 228], 99.50th=[ 271], 99.90th=[ 355], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 152, per=26.49%, avg=34.70, stdev=25.29, samples=339 iops : min= 1, max= 38, avg= 8.01, stdev= 6.36, samples=339 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6236KiB/182816msec); 0 zone resets clat (msec): min=10, max=754, avg=71.11, stdev=55.33 lat (msec): min=10, max=754, avg=71.11, stdev=55.33 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 65], | 70.00th=[ 82], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 266], 99.50th=[ 326], 99.90th=[ 426], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=34.27, stdev=23.17, samples=353 iops : min= 1, max= 27, avg= 7.90, stdev= 5.85, samples=353 lat (msec) : 10=2.08%, 20=14.00%, 50=43.68%, 100=22.72%, 250=16.54% lat (msec) : 500=0.94%, 1000=0.03% cpu : usr=0.05%, sys=1.44%, ctx=4768, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=131KiB/s (134kB/s), 32.6KiB/s-33.2KiB/s (33.3kB/s-34.0kB/s), io=23.4MiB (24.6MB), run=181323-183053msec WRITE: bw=137KiB/s (141kB/s), 34.1KiB/s-34.8KiB/s (34.9kB/s-35.6kB/s), io=24.6MiB (25.7MB), run=181323-183053msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178037: Wed Aug 26 09:31:25 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(5920KiB/39151msec) clat (usec): min=39, max=328842, avg=56976.33, stdev=39003.84 lat (usec): min=39, max=328844, avg=56977.98, stdev=39003.76 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 133], 10.00th=[ 19530], 20.00th=[ 31065], | 30.00th=[ 36963], 40.00th=[ 43254], 50.00th=[ 50594], 60.00th=[ 57934], | 70.00th=[ 65799], 80.00th=[ 80217], 90.00th=[100140], 95.00th=[123208], | 99.00th=[221250], 99.50th=[231736], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 62, max= 345, per=26.03%, avg=151.73, stdev=57.15, samples=75 iops : min= 3, max= 21, avg= 8.69, stdev= 3.67, samples=75 write: IOPS=10, BW=163KiB/s (167kB/s)(6368KiB/39151msec); 0 zone resets clat (usec): min=1457, max=264310, avg=45097.99, stdev=45208.84 lat (usec): min=1459, max=264311, avg=45108.03, stdev=45206.86 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1811], 10.00th=[ 2802], 20.00th=[ 6259], | 30.00th=[ 10814], 40.00th=[ 20579], 50.00th=[ 31589], 60.00th=[ 44303], | 70.00th=[ 60556], 80.00th=[ 82314], 90.00th=[107480], 95.00th=[132645], | 99.00th=[202376], 99.50th=[261096], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 349, per=26.75%, avg=164.25, stdev=73.56, samples=75 iops : min= 1, max= 21, avg= 9.48, stdev= 4.63, samples=75 lat (usec) : 50=0.26%, 100=1.95%, 250=0.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.39%, 4=3.39%, 10=8.59%, 20=6.77%, 50=31.64% lat (msec) : 100=31.90%, 250=10.68%, 500=0.39% cpu : usr=0.08%, sys=4.52%, ctx=1774, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178038: Wed Aug 26 09:31:25 2026 read: IOPS=9, BW=148KiB/s (152kB/s)(5744KiB/38795msec) clat (usec): min=47, max=190949, avg=57481.43, stdev=34138.33 lat (usec): min=48, max=190950, avg=57485.67, stdev=34139.52 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 85], 10.00th=[ 19792], 20.00th=[ 31589], | 30.00th=[ 39584], 40.00th=[ 47449], 50.00th=[ 54264], 60.00th=[ 61080], | 70.00th=[ 69731], 80.00th=[ 79168], 90.00th=[103285], 95.00th=[116917], | 99.00th=[175113], 99.50th=[177210], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 62, max= 255, per=25.42%, avg=148.21, stdev=53.02, samples=76 iops : min= 3, max= 15, avg= 8.46, stdev= 3.36, samples=76 write: IOPS=10, BW=169KiB/s (173kB/s)(6544KiB/38795msec); 0 zone resets clat (usec): min=1461, max=218284, avg=43839.76, stdev=43884.70 lat (usec): min=1463, max=218287, avg=43844.38, stdev=43883.57 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2474], 10.00th=[ 3687], 20.00th=[ 6849], | 30.00th=[ 11469], 40.00th=[ 21103], 50.00th=[ 30540], 60.00th=[ 40109], | 70.00th=[ 54789], 80.00th=[ 71828], 90.00th=[111674], 95.00th=[141558], | 99.00th=[173016], 99.50th=[191890], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 30, max= 416, per=27.26%, avg=167.39, stdev=75.74, samples=76 iops : min= 1, max= 26, avg= 9.68, stdev= 4.87, samples=76 lat (usec) : 50=0.13%, 100=2.34%, 250=0.52%, 750=0.26%, 1000=0.13% lat (msec) : 2=2.08%, 4=4.04%, 10=8.46%, 20=7.68%, 50=30.99% lat (msec) : 100=31.90%, 250=11.46% cpu : usr=0.07%, sys=4.66%, ctx=1745, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178039: Wed Aug 26 09:31:25 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(6256KiB/41031msec) clat (usec): min=51, max=281781, avg=57544.57, stdev=41671.29 lat (usec): min=51, max=281783, avg=57546.26, stdev=41671.25 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 74], 10.00th=[ 14484], 20.00th=[ 27919], | 30.00th=[ 34866], 40.00th=[ 42206], 50.00th=[ 50594], 60.00th=[ 59507], | 70.00th=[ 71828], 80.00th=[ 82314], 90.00th=[102237], 95.00th=[129500], | 99.00th=[244319], 99.50th=[278922], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 317, per=26.22%, avg=152.84, stdev=58.17, samples=80 iops : min= 1, max= 19, avg= 8.76, stdev= 3.69, samples=80 write: IOPS=9, BW=147KiB/s (151kB/s)(6032KiB/41031msec); 0 zone resets clat (usec): min=1573, max=255171, avg=48611.51, stdev=46115.04 lat (usec): min=1576, max=255174, avg=48613.97, stdev=46115.06 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2245], 10.00th=[ 4359], 20.00th=[ 8717], | 30.00th=[ 16319], 40.00th=[ 27657], 50.00th=[ 36439], 60.00th=[ 49546], | 70.00th=[ 60031], 80.00th=[ 82314], 90.00th=[109577], 95.00th=[139461], | 99.00th=[221250], 99.50th=[248513], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 404, per=23.85%, avg=146.44, stdev=67.04, samples=79 iops : min= 1, max= 25, avg= 8.37, stdev= 4.32, samples=79 lat (usec) : 100=3.39%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=1.95%, 4=2.73%, 10=6.90%, 20=7.03%, 50=32.16% lat (msec) : 100=32.68%, 250=11.72%, 500=0.39% cpu : usr=0.05%, sys=4.48%, ctx=1802, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178040: Wed Aug 26 09:31:25 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(6032KiB/37757msec) clat (usec): min=45, max=269850, avg=55989.27, stdev=39002.28 lat (usec): min=46, max=269852, avg=55991.37, stdev=39002.01 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 7308], 20.00th=[ 28705], | 30.00th=[ 36963], 40.00th=[ 42730], 50.00th=[ 49546], 60.00th=[ 55313], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[105382], 95.00th=[124257], | 99.00th=[204473], 99.50th=[223347], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 339, per=27.35%, avg=159.46, stdev=68.48, samples=74 iops : min= 1, max= 21, avg= 9.19, stdev= 4.37, samples=74 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37757msec); 0 zone resets clat (usec): min=1669, max=276148, avg=42058.46, stdev=44002.53 lat (usec): min=1670, max=276148, avg=42062.07, stdev=44002.30 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2474], 10.00th=[ 3884], 20.00th=[ 6783], | 30.00th=[ 11076], 40.00th=[ 18744], 50.00th=[ 28705], 60.00th=[ 38011], | 70.00th=[ 52167], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[128451], | 99.00th=[200279], 99.50th=[235930], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 377, per=26.96%, avg=165.53, stdev=68.79, samples=74 iops : min= 1, max= 23, avg= 9.58, stdev= 4.40, samples=74 lat (usec) : 50=0.13%, 100=4.17%, 250=0.13%, 500=0.26%, 750=0.13% lat (msec) : 2=1.30%, 4=4.17%, 10=8.98%, 20=8.07%, 50=32.68% lat (msec) : 100=29.30%, 250=10.42%, 500=0.26% cpu : usr=0.08%, sys=4.30%, ctx=1662, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=584KiB/s (598kB/s), 148KiB/s-160KiB/s (152kB/s-164kB/s), io=23.4MiB (24.5MB), run=37757-41031msec WRITE: bw=614KiB/s (629kB/s), 147KiB/s-169KiB/s (151kB/s-173kB/s), io=24.6MiB (25.8MB), run=37757-41031msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178042: Wed Aug 26 09:31:38 2026 read: IOPS=6, BW=110KiB/s (112kB/s)(5920KiB/54027msec) clat (msec): min=8, max=360, avg=57.51, stdev=52.42 lat (msec): min=8, max=360, avg=57.54, stdev=52.44 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 77], 90.00th=[ 131], 95.00th=[ 178], | 99.00th=[ 253], 99.50th=[ 292], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 380, per=25.34%, avg=112.26, stdev=75.33, samples=102 iops : min= 1, max= 23, avg= 6.21, stdev= 4.83, samples=102 write: IOPS=7, BW=118KiB/s (121kB/s)(6368KiB/54027msec); 0 zone resets clat (msec): min=13, max=367, avg=82.06, stdev=54.20 lat (msec): min=13, max=367, avg=82.06, stdev=54.20 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 79], | 70.00th=[ 99], 80.00th=[ 121], 90.00th=[ 167], 95.00th=[ 192], | 99.00th=[ 249], 99.50th=[ 266], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 380, per=25.83%, avg=120.38, stdev=72.15, samples=103 iops : min= 1, max= 23, avg= 6.73, stdev= 4.59, samples=103 lat (msec) : 10=0.39%, 20=10.03%, 50=36.46%, 100=31.51%, 250=20.70% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.40%, ctx=1184, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178043: Wed Aug 26 09:31:38 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(5744KiB/54043msec) clat (msec): min=7, max=301, avg=58.14, stdev=54.21 lat (msec): min=7, max=301, avg=58.15, stdev=54.20 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 59], 80.00th=[ 81], 90.00th=[ 140], 95.00th=[ 182], | 99.00th=[ 255], 99.50th=[ 296], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 25, max= 507, per=24.25%, avg=107.44, stdev=81.23, samples=104 iops : min= 1, max= 31, avg= 5.90, stdev= 5.14, samples=104 write: IOPS=7, BW=121KiB/s (124kB/s)(6544KiB/54043msec); 0 zone resets clat (msec): min=14, max=313, avg=80.89, stdev=51.51 lat (msec): min=14, max=313, avg=80.90, stdev=51.51 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 57], 50.00th=[ 66], 60.00th=[ 77], | 70.00th=[ 94], 80.00th=[ 117], 90.00th=[ 161], 95.00th=[ 190], | 99.00th=[ 239], 99.50th=[ 262], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 384, per=26.53%, avg=123.64, stdev=72.31, samples=103 iops : min= 1, max= 24, avg= 6.91, stdev= 4.62, samples=103 lat (msec) : 10=0.26%, 20=8.33%, 50=39.06%, 100=30.47%, 250=20.83% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.44%, ctx=1230, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178044: Wed Aug 26 09:31:38 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(6256KiB/53321msec) clat (msec): min=6, max=259, avg=57.05, stdev=47.82 lat (msec): min=6, max=259, avg=57.05, stdev=47.82 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 81], 90.00th=[ 125], 95.00th=[ 165], | 99.00th=[ 232], 99.50th=[ 253], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 444, per=26.50%, avg=117.40, stdev=81.05, samples=105 iops : min= 1, max= 27, avg= 6.54, stdev= 5.13, samples=105 write: IOPS=7, BW=113KiB/s (116kB/s)(6032KiB/53321msec); 0 zone resets clat (msec): min=15, max=383, avg=82.09, stdev=54.01 lat (msec): min=15, max=383, avg=82.10, stdev=54.01 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 55], 50.00th=[ 68], 60.00th=[ 82], | 70.00th=[ 93], 80.00th=[ 118], 90.00th=[ 159], 95.00th=[ 199], | 99.00th=[ 255], 99.50th=[ 288], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 448, per=24.83%, avg=115.70, stdev=73.42, samples=102 iops : min= 1, max= 28, avg= 6.42, stdev= 4.71, samples=102 lat (msec) : 10=0.78%, 20=8.07%, 50=38.93%, 100=31.90%, 250=19.40% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.62%, ctx=1221, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178045: Wed Aug 26 09:31:38 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6032KiB/52916msec) clat (msec): min=8, max=356, avg=58.87, stdev=52.35 lat (msec): min=8, max=356, avg=58.87, stdev=52.35 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 61], 80.00th=[ 84], 90.00th=[ 140], 95.00th=[ 176], | 99.00th=[ 236], 99.50th=[ 249], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 415, per=26.33%, avg=116.65, stdev=74.70, samples=101 iops : min= 1, max= 25, avg= 6.47, stdev= 4.72, samples=101 write: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/52916msec); 0 zone resets clat (msec): min=15, max=405, avg=78.44, stdev=50.92 lat (msec): min=15, max=405, avg=78.45, stdev=50.92 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 63], 60.00th=[ 78], | 70.00th=[ 94], 80.00th=[ 118], 90.00th=[ 140], 95.00th=[ 171], | 99.00th=[ 279], 99.50th=[ 309], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 480, per=25.62%, avg=119.37, stdev=77.07, samples=103 iops : min= 1, max= 30, avg= 6.65, stdev= 4.92, samples=103 lat (msec) : 10=0.26%, 20=7.81%, 50=41.15%, 100=28.52%, 250=21.35% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.50%, ctx=1189, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=443KiB/s (454kB/s), 106KiB/s-117KiB/s (109kB/s-120kB/s), io=23.4MiB (24.5MB), run=52916-54043msec WRITE: bw=466KiB/s (477kB/s), 113KiB/s-121KiB/s (116kB/s-124kB/s), io=24.6MiB (25.8MB), run=52916-54043msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178060: Wed Aug 26 09:31:55 2026 read: IOPS=1, BW=1703KiB/s (1744kB/s)(7168KiB/4208msec) clat (usec): min=585, max=607375, avg=249573.55, stdev=212845.56 lat (usec): min=586, max=607377, avg=249574.97, stdev=212845.61 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 627], | 30.00th=[214959], 40.00th=[214959], 50.00th=[244319], 60.00th=[304088], | 70.00th=[304088], 80.00th=[375391], 90.00th=[608175], 95.00th=[608175], | 99.00th=[608175], 99.50th=[608175], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 1486, max= 3953, per=61.50%, avg=2364.50, stdev=1087.52, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1217KiB/s (1246kB/s)(5120KiB/4208msec); 0 zone resets clat (msec): min=193, max=890, avg=426.66, stdev=269.16 lat (msec): min=193, max=890, avg=426.74, stdev=269.17 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2031, max= 3976, per=55.80%, avg=3003.50, stdev=1375.32, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=16.67% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=12.22%, ctx=302, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178062: Wed Aug 26 09:31:55 2026 read: IOPS=0, BW=385KiB/s (394kB/s)(2048KiB/5326msec) clat (msec): min=171, max=255, avg=213.40, stdev=59.26 lat (msec): min=171, max=255, avg=213.41, stdev=59.26 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 1492, max= 1988, per=45.25%, avg=1740.00, stdev=350.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1923KiB/s (1969kB/s)(10.0MiB/5326msec); 0 zone resets clat (msec): min=172, max=1042, avg=475.18, stdev=302.04 lat (msec): min=172, max=1042, avg=475.27, stdev=302.04 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 188], | 30.00th=[ 201], 40.00th=[ 284], 50.00th=[ 405], 60.00th=[ 472], | 70.00th=[ 485], 80.00th=[ 592], 90.00th=[ 919], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 2000, max= 4047, per=56.14%, avg=3022.00, stdev=1097.27, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.13%, ctx=184, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178066: Wed Aug 26 09:31:55 2026 read: IOPS=1, BW=1447KiB/s (1481kB/s)(6144KiB/4247msec) clat (usec): min=514, max=308431, avg=111488.80, stdev=137226.97 lat (usec): min=516, max=308433, avg=111490.00, stdev=137226.75 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[111674], | 70.00th=[246416], 80.00th=[246416], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 4047, max= 4063, per=100.00%, avg=4055.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1447KiB/s (1481kB/s)(6144KiB/4247msec); 0 zone resets clat (msec): min=205, max=1318, avg=516.38, stdev=406.73 lat (msec): min=205, max=1319, avg=516.47, stdev=406.77 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 451], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1988, max= 3953, per=46.42%, avg=2498.75, stdev=969.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=25.00% lat (msec) : 250=25.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=12.46%, ctx=210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178067: Wed Aug 26 09:31:55 2026 read: IOPS=1, BW=1197KiB/s (1226kB/s)(5120KiB/4278msec) clat (usec): min=734, max=217405, avg=59987.47, stdev=92411.05 lat (usec): min=735, max=217407, avg=59988.98, stdev=92410.97 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 734], | 30.00th=[ 4948], 40.00th=[ 4948], 50.00th=[ 7570], 60.00th=[ 7570], | 70.00th=[ 69731], 80.00th=[ 69731], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 3976, max= 4000, per=100.00%, avg=3988.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1676KiB/s (1716kB/s)(7168KiB/4278msec); 0 zone resets clat (msec): min=94, max=1100, avg=559.96, stdev=435.74 lat (msec): min=94, max=1101, avg=560.52, stdev=435.75 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 117], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 422], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 986], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1501, max= 4000, per=42.92%, avg=2310.20, stdev=970.82, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 10=16.67%, 100=16.67%, 250=16.67%, 500=16.67%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=9.26%, ctx=104, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3845KiB/s (3938kB/s), 385KiB/s-1703KiB/s (394kB/s-1744kB/s), io=20.0MiB (20.0MB), run=4208-5326msec WRITE: bw=5383KiB/s (5513kB/s), 1217KiB/s-1923KiB/s (1246kB/s-1969kB/s), io=28.0MiB (29.4MB), run=4208-5326msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178061: Wed Aug 26 09:31:55 2026 read: IOPS=1, BW=1732KiB/s (1773kB/s)(7168KiB/4139msec) clat (msec): min=110, max=692, avg=261.47, stdev=209.84 lat (msec): min=110, max=692, avg=261.47, stdev=209.84 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 120], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 182], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 376], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1503, max= 3923, per=59.94%, avg=2247.20, stdev=960.23, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1237KiB/s (1267kB/s)(5120KiB/4139msec); 0 zone resets clat (msec): min=126, max=621, avg=420.08, stdev=245.27 lat (msec): min=126, max=621, avg=420.18, stdev=245.27 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1961, max= 4087, per=51.38%, avg=2697.00, stdev=1204.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=8.33%, 750=33.33% cpu : usr=0.05%, sys=3.75%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178063: Wed Aug 26 09:31:55 2026 read: IOPS=0, BW=404KiB/s (413kB/s)(2048KiB/5075msec) clat (msec): min=104, max=253, avg=178.95, stdev=105.18 lat (msec): min=104, max=253, avg=178.96, stdev=105.18 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 1393, max= 2043, per=45.83%, avg=1718.00, stdev=459.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2018KiB/s (2066kB/s)(10.0MiB/5075msec); 0 zone resets clat (msec): min=158, max=795, avg=468.56, stdev=229.54 lat (msec): min=158, max=795, avg=468.73, stdev=229.60 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 199], | 30.00th=[ 224], 40.00th=[ 342], 50.00th=[ 460], 60.00th=[ 531], | 70.00th=[ 584], 80.00th=[ 676], 90.00th=[ 718], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1393, max= 4087, per=41.54%, avg=2180.29, stdev=870.50, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, 1000=8.33% cpu : usr=0.02%, sys=6.64%, ctx=119, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178064: Wed Aug 26 09:31:55 2026 read: IOPS=1, BW=1125KiB/s (1152kB/s)(6144KiB/5462msec) clat (msec): min=100, max=903, avg=424.78, stdev=320.91 lat (msec): min=100, max=903, avg=424.79, stdev=320.91 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 542], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1988, max= 2043, per=53.86%, avg=2019.20, stdev=20.60, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1125KiB/s (1152kB/s)(6144KiB/5462msec); 0 zone resets clat (msec): min=161, max=1251, avg=456.39, stdev=409.55 lat (msec): min=161, max=1251, avg=457.09, stdev=409.45 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 393], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1446, max= 4031, per=43.68%, avg=2293.00, stdev=1000.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.02%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178065: Wed Aug 26 09:31:55 2026 read: IOPS=1, BW=1281KiB/s (1312kB/s)(5120KiB/3997msec) clat (msec): min=188, max=514, avg=328.30, stdev=118.94 lat (msec): min=188, max=514, avg=328.30, stdev=118.94 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2043, max= 5965, per=100.00%, avg=4004.00, stdev=2773.27, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1793KiB/s (1836kB/s)(7168KiB/3997msec); 0 zone resets clat (msec): min=152, max=620, avg=321.01, stdev=196.02 lat (msec): min=152, max=620, avg=321.15, stdev=196.10 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 167], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 253], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 575], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1783, max= 4168, per=57.50%, avg=3018.25, stdev=1281.15, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 250=33.33%, 500=41.67%, 750=25.00% cpu : usr=0.00%, sys=3.38%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3750KiB/s (3840kB/s), 404KiB/s-1732KiB/s (413kB/s-1773kB/s), io=20.0MiB (20.0MB), run=3997-5462msec WRITE: bw=5249KiB/s (5375kB/s), 1125KiB/s-2018KiB/s (1152kB/s-2066kB/s), io=28.0MiB (29.4MB), run=3997-5462msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178074: Wed Aug 26 09:32:11 2026 read: IOPS=1, BW=4201KiB/s (4302kB/s)(12.0MiB/2925msec) clat (msec): min=734, max=1346, avg=953.72, stdev=340.71 lat (msec): min=734, max=1346, avg=953.73, stdev=340.71 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7861, max= 8062, per=100.00%, avg=7961.50, stdev=142.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.10%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178075: Wed Aug 26 09:32:11 2026 read: IOPS=0, BW=1142KiB/s (1169kB/s)(4096KiB/3588msec) clat (nsec): min=995182k, max=995182k, avg=995182082.00, stdev= 0.00 lat (nsec): min=995184k, max=995184k, avg=995184245.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2283KiB/s (2338kB/s)(8192KiB/3588msec); 0 zone resets clat (msec): min=1089, max=1372, avg=1230.65, stdev=200.04 lat (msec): min=1091, max=1372, avg=1232.18, stdev=198.43 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8062, max= 8062, per=88.28%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.07%, ctx=67, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178078: Wed Aug 26 09:32:11 2026 write: IOPS=0, BW=3518KiB/s (3602kB/s)(12.0MiB/3493msec); 0 zone resets clat (msec): min=445, max=2142, avg=1083.79, stdev=923.27 lat (msec): min=446, max=2142, avg=1084.23, stdev=923.15 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 7968, max= 8000, per=87.43%, avg=7984.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.87%, ctx=86, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178080: Wed Aug 26 09:32:11 2026 write: IOPS=1, BW=5459KiB/s (5590kB/s)(12.0MiB/2251msec); 0 zone resets clat (msec): min=276, max=1462, avg=714.45, stdev=651.02 lat (msec): min=278, max=1462, avg=718.84, stdev=648.06 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 5843, max= 8126, per=76.48%, avg=6984.50, stdev=1614.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.84%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4566KiB/s (4676kB/s), 1142KiB/s-4201KiB/s (1169kB/s-4302kB/s), io=16.0MiB (16.8MB), run=2925-3588msec WRITE: bw=9133KiB/s (9352kB/s), 2283KiB/s-5459KiB/s (2338kB/s-5590kB/s), io=32.0MiB (33.6MB), run=2251-3588msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178076: Wed Aug 26 09:32:11 2026 read: IOPS=1, BW=4865KiB/s (4981kB/s)(12.0MiB/2526msec) clat (msec): min=708, max=861, avg=802.68, stdev=82.23 lat (msec): min=708, max=861, avg=802.69, stdev=82.23 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7846, max= 8126, per=100.00%, avg=7986.00, stdev=197.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.86%, ctx=365, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178077: Wed Aug 26 09:32:11 2026 read: IOPS=0, BW=1489KiB/s (1525kB/s)(4096KiB/2750msec) clat (nsec): min=819483k, max=819483k, avg=819483170.00, stdev= 0.00 lat (nsec): min=819486k, max=819486k, avg=819485955.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2979KiB/s (3050kB/s)(8192KiB/2750msec); 0 zone resets clat (msec): min=584, max=1266, avg=925.35, stdev=482.10 lat (msec): min=584, max=1266, avg=925.83, stdev=482.01 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8078, max= 8078, per=89.37%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.86%, ctx=82, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178079: Wed Aug 26 09:32:11 2026 write: IOPS=0, BW=3390KiB/s (3471kB/s)(12.0MiB/3625msec); 0 zone resets clat (msec): min=531, max=1785, avg=1182.41, stdev=628.48 lat (msec): min=532, max=1788, avg=1184.24, stdev=629.05 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7846, max= 8143, per=88.44%, avg=7994.50, stdev=210.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.31%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178081: Wed Aug 26 09:32:11 2026 write: IOPS=1, BW=4393KiB/s (4499kB/s)(12.0MiB/2797msec); 0 zone resets clat (msec): min=747, max=1079, avg=888.28, stdev=171.58 lat (msec): min=748, max=1081, avg=889.10, stdev=172.37 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7846, max= 8047, per=87.91%, avg=7946.50, stdev=142.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=6.76%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5958KiB/s (6101kB/s), 1489KiB/s-4865KiB/s (1525kB/s-4981kB/s), io=16.0MiB (16.8MB), run=2526-2750msec WRITE: bw=9039KiB/s (9256kB/s), 2979KiB/s-4393KiB/s (3050kB/s-4499kB/s), io=32.0MiB (33.6MB), run=2750-3625msec