== sanity test 398b: DIO and buffer IO race ============== 18:40:14 (1787784014) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.87011 s, 10.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144859: Wed Aug 26 18:42:49 2026 read: IOPS=10, BW=43.7KiB/s (44.7kB/s)(5992KiB/137131msec) clat (usec): min=32, max=717696, avg=45242.11, stdev=41722.24 lat (usec): min=32, max=717697, avg=45243.60, stdev=41722.29 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 101], 20.00th=[ 18482], | 30.00th=[ 24773], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 68682], 90.00th=[ 91751], 95.00th=[109577], | 99.00th=[191890], 99.50th=[229639], 99.90th=[421528], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 119, per=25.26%, avg=43.70, stdev=20.83, samples=267 iops : min= 1, max= 29, avg=10.28, stdev= 5.24, samples=267 write: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6296KiB/137131msec); 0 zone resets clat (usec): min=975, max=288561, avg=43798.61, stdev=46537.27 lat (usec): min=976, max=288563, avg=43801.40, stdev=46536.46 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1729], 20.00th=[ 3687], | 30.00th=[ 8160], 40.00th=[ 17957], 50.00th=[ 30540], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[105382], 95.00th=[133694], | 99.00th=[204473], 99.50th=[229639], 99.90th=[263193], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 150, per=25.25%, avg=45.69, stdev=21.56, samples=268 iops : min= 1, max= 37, avg=10.78, stdev= 5.43, samples=268 lat (usec) : 50=0.81%, 100=4.00%, 250=0.68%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=6.25%, 4=4.72%, 10=6.48%, 20=8.69%, 50=33.50% lat (msec) : 100=25.07%, 250=9.21%, 500=0.23%, 750=0.03% cpu : usr=0.07%, sys=5.16%, ctx=6544, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144860: Wed Aug 26 18:42:49 2026 read: IOPS=10, BW=43.1KiB/s (44.1kB/s)(5940KiB/137803msec) clat (usec): min=27, max=655095, avg=43643.53, stdev=37792.22 lat (usec): min=28, max=655096, avg=43645.03, stdev=37792.07 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 109], 20.00th=[ 18482], | 30.00th=[ 24249], 40.00th=[ 30016], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 53216], 80.00th=[ 65799], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[147850], 99.50th=[189793], 99.90th=[333448], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 112, per=25.07%, avg=43.38, stdev=21.47, samples=267 iops : min= 1, max= 28, avg=10.19, stdev= 5.42, samples=267 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6348KiB/137803msec); 0 zone resets clat (usec): min=991, max=500063, avg=45651.48, stdev=49297.58 lat (usec): min=991, max=500064, avg=45661.89, stdev=49295.16 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1942], 20.00th=[ 4490], | 30.00th=[ 8586], 40.00th=[ 21103], 50.00th=[ 31589], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 78119], 90.00th=[108528], 95.00th=[139461], | 99.00th=[208667], 99.50th=[250610], 99.90th=[333448], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 7, max= 144, per=25.53%, avg=46.21, stdev=22.01, samples=268 iops : min= 1, max= 36, avg=10.92, stdev= 5.56, samples=268 lat (usec) : 50=0.91%, 100=3.84%, 250=0.72%, 500=0.13%, 750=0.20% lat (usec) : 1000=0.10% lat (msec) : 2=5.31%, 4=4.23%, 10=7.06%, 20=8.33%, 50=34.99% lat (msec) : 100=24.28%, 250=9.57%, 500=0.26%, 750=0.07% cpu : usr=0.06%, sys=5.16%, ctx=6674, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144861: Wed Aug 26 18:42:49 2026 read: IOPS=10, BW=43.6KiB/s (44.7kB/s)(6028KiB/138188msec) clat (usec): min=35, max=689951, avg=45294.64, stdev=41165.15 lat (usec): min=35, max=689952, avg=45298.13, stdev=41166.24 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 100], 20.00th=[ 18482], | 30.00th=[ 24773], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 45351], | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[175113], 99.50th=[221250], 99.90th=[404751], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 118, per=25.01%, avg=43.27, stdev=20.43, samples=270 iops : min= 1, max= 29, avg=10.17, stdev= 5.15, samples=270 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6260KiB/138188msec); 0 zone resets clat (usec): min=935, max=369354, avg=44402.76, stdev=46347.08 lat (usec): min=937, max=369356, avg=44406.52, stdev=46346.22 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1926], 20.00th=[ 4293], | 30.00th=[ 8586], 40.00th=[ 20317], 50.00th=[ 33162], 60.00th=[ 44827], | 70.00th=[ 57410], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[132645], | 99.00th=[204473], 99.50th=[227541], 99.90th=[316670], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 110, per=24.80%, avg=44.89, stdev=20.55, samples=270 iops : min= 1, max= 27, avg=10.58, stdev= 5.19, samples=270 lat (usec) : 50=0.62%, 100=4.26%, 250=0.68%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.31%, 4=4.52%, 10=6.35%, 20=9.02%, 50=33.14% lat (msec) : 100=26.50%, 250=8.72%, 500=0.36%, 750=0.03% cpu : usr=0.07%, sys=5.25%, ctx=6742, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144862: Wed Aug 26 18:42:49 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(6052KiB/138140msec) clat (usec): min=32, max=393176, avg=42598.22, stdev=36644.69 lat (usec): min=32, max=393178, avg=42602.86, stdev=36643.58 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 78], 20.00th=[ 17171], | 30.00th=[ 23725], 40.00th=[ 29230], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 52167], 80.00th=[ 64226], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[170918], 99.50th=[217056], 99.90th=[308282], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 104, per=25.44%, avg=44.01, stdev=19.32, samples=266 iops : min= 1, max= 26, avg=10.36, stdev= 4.87, samples=266 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6236KiB/138140msec); 0 zone resets clat (usec): min=909, max=814730, avg=46967.54, stdev=51716.68 lat (usec): min=911, max=814733, avg=46978.00, stdev=51715.41 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1287], 10.00th=[ 2057], 20.00th=[ 4621], | 30.00th=[ 8586], 40.00th=[ 20579], 50.00th=[ 33817], 60.00th=[ 46924], | 70.00th=[ 61604], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[137364], | 99.00th=[204473], 99.50th=[242222], 99.90th=[316670], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 102, per=24.81%, avg=44.90, stdev=18.93, samples=269 iops : min= 1, max= 25, avg=10.58, stdev= 4.75, samples=269 lat (usec) : 50=1.30%, 100=4.43%, 250=0.98%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.98%, 4=4.10%, 10=7.16%, 20=8.79%, 50=33.11% lat (msec) : 100=25.42%, 250=9.18%, 500=0.33%, 1000=0.03% cpu : usr=0.08%, sys=5.05%, ctx=6570, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.1KiB/s-43.8KiB/s (44.1kB/s-44.9kB/s), io=23.4MiB (24.6MB), run=137131-138188msec WRITE: bw=182KiB/s (186kB/s), 45.1KiB/s-46.1KiB/s (46.2kB/s-47.2kB/s), io=24.6MiB (25.7MB), run=137131-138188msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144855: Wed Aug 26 18:45:00 2026 read: IOPS=5, BW=22.4KiB/s (22.9kB/s)(5992KiB/267604msec) clat (msec): min=5, max=734, avg=36.10, stdev=41.99 lat (msec): min=5, max=734, avg=36.11, stdev=41.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 50], 90.00th=[ 82], 95.00th=[ 115], | 99.00th=[ 174], 99.50th=[ 190], 99.90th=[ 592], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 103, per=28.69%, avg=25.54, stdev=17.01, samples=454 iops : min= 1, max= 25, avg= 5.74, stdev= 4.28, samples=454 write: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6296KiB/267604msec); 0 zone resets clat (msec): min=36, max=683, avg=135.39, stdev=70.84 lat (msec): min=36, max=683, avg=135.39, stdev=70.84 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 132], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 380], 99.50th=[ 418], 99.90th=[ 489], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 63, per=25.02%, avg=23.26, stdev=11.37, samples=521 iops : min= 1, max= 15, avg= 5.17, stdev= 2.87, samples=521 lat (msec) : 10=3.35%, 20=18.26%, 50=18.29%, 100=25.07%, 250=31.38% lat (msec) : 500=3.55%, 750=0.10% cpu : usr=0.05%, sys=1.14%, ctx=5239, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144856: Wed Aug 26 18:45:00 2026 read: IOPS=5, BW=22.1KiB/s (22.7kB/s)(5940KiB/268516msec) clat (msec): min=5, max=682, avg=36.01, stdev=41.84 lat (msec): min=5, max=682, avg=36.02, stdev=41.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 48], 90.00th=[ 89], 95.00th=[ 116], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 422], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 111, per=28.86%, avg=25.69, stdev=17.55, samples=447 iops : min= 1, max= 27, avg= 5.77, stdev= 4.39, samples=447 write: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6348KiB/268516msec); 0 zone resets clat (msec): min=32, max=606, avg=135.24, stdev=71.81 lat (msec): min=32, max=606, avg=135.24, stdev=71.81 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 153], 80.00th=[ 178], 90.00th=[ 228], 95.00th=[ 275], | 99.00th=[ 405], 99.50th=[ 460], 99.90th=[ 600], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 55, per=25.10%, avg=23.34, stdev=11.48, samples=524 iops : min= 1, max= 13, avg= 5.19, stdev= 2.91, samples=524 lat (msec) : 10=3.58%, 20=19.73%, 50=16.31%, 100=23.99%, 250=32.71% lat (msec) : 500=3.52%, 750=0.16% cpu : usr=0.05%, sys=1.10%, ctx=5165, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144857: Wed Aug 26 18:45:00 2026 read: IOPS=5, BW=22.4KiB/s (22.9kB/s)(6028KiB/269438msec) clat (msec): min=4, max=428, avg=36.30, stdev=35.99 lat (msec): min=4, max=428, avg=36.30, stdev=35.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 109], | 99.00th=[ 161], 99.50th=[ 207], 99.90th=[ 309], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 111, per=27.78%, avg=24.73, stdev=17.29, samples=469 iops : min= 1, max= 27, avg= 5.55, stdev= 4.35, samples=469 write: IOPS=5, BW=23.2KiB/s (23.8kB/s)(6260KiB/269438msec); 0 zone resets clat (msec): min=35, max=764, avg=136.94, stdev=75.01 lat (msec): min=35, max=764, avg=136.94, stdev=75.01 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 117], 60.00th=[ 131], | 70.00th=[ 153], 80.00th=[ 184], 90.00th=[ 234], 95.00th=[ 284], | 99.00th=[ 397], 99.50th=[ 456], 99.90th=[ 642], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 64, per=24.62%, avg=22.90, stdev=11.55, samples=524 iops : min= 1, max= 16, avg= 5.08, stdev= 2.92, samples=524 lat (msec) : 10=3.12%, 20=18.49%, 50=17.64%, 100=25.16%, 250=31.45% lat (msec) : 500=3.97%, 750=0.13%, 1000=0.03% cpu : usr=0.05%, sys=1.15%, ctx=5104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144858: Wed Aug 26 18:45:00 2026 read: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6052KiB/267417msec) clat (msec): min=5, max=589, avg=35.96, stdev=40.56 lat (msec): min=5, max=589, avg=35.96, stdev=40.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 50], 90.00th=[ 83], 95.00th=[ 111], | 99.00th=[ 184], 99.50th=[ 211], 99.90th=[ 422], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 94, per=29.06%, avg=25.86, stdev=17.13, samples=452 iops : min= 1, max= 23, avg= 5.83, stdev= 4.31, samples=452 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6236KiB/267417msec); 0 zone resets clat (msec): min=37, max=872, avg=136.36, stdev=74.14 lat (msec): min=37, max=872, avg=136.36, stdev=74.14 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 115], 60.00th=[ 130], | 70.00th=[ 153], 80.00th=[ 188], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 376], 99.50th=[ 435], 99.90th=[ 485], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 56, per=24.87%, avg=23.13, stdev=11.50, samples=518 iops : min= 1, max= 14, avg= 5.14, stdev= 2.91, samples=518 lat (msec) : 10=3.58%, 20=19.53%, 50=17.02%, 100=25.59%, 250=29.98% lat (msec) : 500=4.23%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5302, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.1KiB/s (91.3kB/s), 22.1KiB/s-22.6KiB/s (22.7kB/s-23.2kB/s), io=23.4MiB (24.6MB), run=267417-269438msec WRITE: bw=93.3KiB/s (95.5kB/s), 23.2KiB/s-23.6KiB/s (23.8kB/s-24.2kB/s), io=24.6MiB (25.7MB), run=267417-269438msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144912: Wed Aug 26 18:45:38 2026 read: IOPS=14, BW=229KiB/s (235kB/s)(5920KiB/25803msec) clat (usec): min=34, max=220152, avg=34496.57, stdev=27257.03 lat (usec): min=34, max=220153, avg=34497.86, stdev=27257.05 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 101], | 30.00th=[ 22938], 40.00th=[ 29492], 50.00th=[ 32900], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 53216], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[101188], 99.50th=[147850], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 32, max= 479, per=26.62%, avg=228.66, stdev=98.38, samples=50 iops : min= 2, max= 29, avg=13.62, stdev= 6.19, samples=50 write: IOPS=15, BW=247KiB/s (253kB/s)(6368KiB/25803msec); 0 zone resets clat (usec): min=1331, max=225333, avg=32315.01, stdev=35025.77 lat (usec): min=1333, max=225336, avg=32319.14, stdev=35024.09 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1827], 10.00th=[ 2737], 20.00th=[ 4047], | 30.00th=[ 6652], 40.00th=[ 10552], 50.00th=[ 19006], 60.00th=[ 28181], | 70.00th=[ 41157], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[104334], | 99.00th=[158335], 99.50th=[162530], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 125, max= 448, per=27.39%, avg=247.62, stdev=82.98, samples=50 iops : min= 7, max= 28, avg=14.82, stdev= 5.29, samples=50 lat (usec) : 50=0.78%, 100=8.59%, 250=1.04%, 500=0.26%, 750=0.26% lat (msec) : 2=2.99%, 4=7.29%, 10=9.77%, 20=8.20%, 50=36.59% lat (msec) : 100=20.57%, 250=3.65% cpu : usr=0.09%, sys=6.14%, ctx=1413, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144913: Wed Aug 26 18:45:38 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5744KiB/27872msec) clat (usec): min=39, max=222006, avg=37179.07, stdev=32013.48 lat (usec): min=40, max=222007, avg=37180.33, stdev=32013.46 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 90], | 30.00th=[ 22152], 40.00th=[ 28181], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[126354], 99.50th=[214959], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 379, per=24.88%, avg=213.75, stdev=80.06, samples=53 iops : min= 1, max= 23, avg=12.68, stdev= 4.94, samples=53 write: IOPS=14, BW=235KiB/s (240kB/s)(6544KiB/27872msec); 0 zone resets clat (usec): min=1414, max=281073, avg=34633.27, stdev=42423.34 lat (usec): min=1415, max=281075, avg=34636.92, stdev=42423.45 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1844], 10.00th=[ 2737], 20.00th=[ 4621], | 30.00th=[ 6849], 40.00th=[ 10290], 50.00th=[ 17957], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 57934], 90.00th=[ 89654], 95.00th=[126354], | 99.00th=[185598], 99.50th=[206570], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 411, per=25.90%, avg=234.09, stdev=94.75, samples=55 iops : min= 1, max= 25, avg=13.96, stdev= 5.93, samples=55 lat (usec) : 50=0.91%, 100=8.72%, 250=1.17%, 500=0.26% lat (msec) : 2=3.39%, 4=4.95%, 10=12.76%, 20=8.46%, 50=33.59% lat (msec) : 100=20.05%, 250=5.60%, 500=0.13% cpu : usr=0.06%, sys=5.92%, ctx=1464, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144914: Wed Aug 26 18:45:38 2026 read: IOPS=15, BW=241KiB/s (247kB/s)(6256KiB/25931msec) clat (usec): min=34, max=164207, avg=36265.01, stdev=28425.02 lat (usec): min=34, max=164208, avg=36266.36, stdev=28425.06 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 161], | 30.00th=[ 22414], 40.00th=[ 29230], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[116917], 99.50th=[141558], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 64, max= 464, per=28.16%, avg=241.92, stdev=89.49, samples=51 iops : min= 4, max= 29, avg=14.47, stdev= 5.64, samples=51 write: IOPS=14, BW=233KiB/s (238kB/s)(6032KiB/25931msec); 0 zone resets clat (usec): min=1300, max=175134, avg=30977.54, stdev=31172.85 lat (usec): min=1303, max=175139, avg=30979.84, stdev=31172.87 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1663], 10.00th=[ 2769], 20.00th=[ 5407], | 30.00th=[ 7832], 40.00th=[ 12256], 50.00th=[ 19268], 60.00th=[ 30540], | 70.00th=[ 39584], 80.00th=[ 53216], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[126354], 99.50th=[149947], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 30, max= 571, per=25.68%, avg=232.12, stdev=100.15, samples=51 iops : min= 1, max= 35, avg=13.84, stdev= 6.39, samples=51 lat (usec) : 50=1.95%, 100=7.55%, 250=1.04%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.65%, 4=3.39%, 10=11.20%, 20=9.38%, 50=37.50% lat (msec) : 100=20.83%, 250=2.99% cpu : usr=0.07%, sys=6.15%, ctx=1432, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144915: Wed Aug 26 18:45:38 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(6032KiB/24198msec) clat (usec): min=33, max=178879, avg=32853.32, stdev=28317.18 lat (usec): min=33, max=178880, avg=32854.95, stdev=28316.82 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 81], | 30.00th=[ 19006], 40.00th=[ 26346], 50.00th=[ 30802], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 51643], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[139461], 99.50th=[160433], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 94, max= 465, per=29.64%, avg=254.61, stdev=94.68, samples=46 iops : min= 5, max= 29, avg=15.28, stdev= 6.01, samples=46 write: IOPS=16, BW=259KiB/s (265kB/s)(6256KiB/24198msec); 0 zone resets clat (usec): min=1408, max=231882, avg=29127.09, stdev=35653.77 lat (usec): min=1411, max=231883, avg=29130.85, stdev=35655.98 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1696], 10.00th=[ 2278], 20.00th=[ 4424], | 30.00th=[ 6587], 40.00th=[ 8717], 50.00th=[ 13829], 60.00th=[ 21890], | 70.00th=[ 34866], 80.00th=[ 49546], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[187696], 99.50th=[196084], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 62, max= 476, per=28.84%, avg=260.68, stdev=101.10, samples=47 iops : min= 3, max= 29, avg=15.66, stdev= 6.44, samples=47 lat (usec) : 50=2.34%, 100=8.46%, 250=1.17%, 500=0.39%, 750=0.13% lat (msec) : 2=3.78%, 4=6.12%, 10=12.37%, 20=9.77%, 50=35.03% lat (msec) : 100=17.19%, 250=3.26% cpu : usr=0.12%, sys=6.29%, ctx=1351, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=859KiB/s (880kB/s), 206KiB/s-249KiB/s (211kB/s-255kB/s), io=23.4MiB (24.5MB), run=24198-27872msec WRITE: bw=904KiB/s (926kB/s), 233KiB/s-259KiB/s (238kB/s-265kB/s), io=24.6MiB (25.8MB), run=24198-27872msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144916: Wed Aug 26 18:46:22 2026 read: IOPS=5, BW=82.7KiB/s (84.7kB/s)(5920KiB/71567msec) clat (msec): min=7, max=251, avg=36.21, stdev=32.37 lat (msec): min=7, max=251, avg=36.21, stdev=32.37 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 70], 95.00th=[ 104], | 99.00th=[ 180], 99.50th=[ 207], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 318, per=26.64%, avg=88.70, stdev=56.81, samples=132 iops : min= 1, max= 19, avg= 4.84, stdev= 3.64, samples=132 write: IOPS=5, BW=88.0KiB/s (91.1kB/s)(6368KiB/71567msec); 0 zone resets clat (msec): min=45, max=370, avg=145.51, stdev=62.58 lat (msec): min=45, max=370, avg=145.52, stdev=62.58 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 90], | 30.00th=[ 105], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 197], 90.00th=[ 234], 95.00th=[ 264], | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 190, per=25.48%, avg=89.16, stdev=39.72, samples=141 iops : min= 1, max= 11, avg= 4.86, stdev= 2.58, samples=141 lat (msec) : 10=1.04%, 20=13.15%, 50=25.78%, 100=20.31%, 250=36.20% lat (msec) : 500=3.52% cpu : usr=0.03%, sys=1.21%, ctx=1294, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144917: Wed Aug 26 18:46:22 2026 read: IOPS=4, BW=79.0KiB/s (81.9kB/s)(5744KiB/71820msec) clat (msec): min=6, max=169, avg=34.90, stdev=28.58 lat (msec): min=6, max=169, avg=34.90, stdev=28.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 78], 95.00th=[ 104], | 99.00th=[ 142], 99.50th=[ 153], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 31, max= 403, per=28.58%, avg=95.16, stdev=65.74, samples=118 iops : min= 1, max= 25, avg= 5.23, stdev= 4.18, samples=118 write: IOPS=5, BW=91.1KiB/s (93.3kB/s)(6544KiB/71820msec); 0 zone resets clat (msec): min=37, max=481, avg=144.71, stdev=65.78 lat (msec): min=37, max=481, avg=144.72, stdev=65.78 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 133], 60.00th=[ 153], | 70.00th=[ 171], 80.00th=[ 199], 90.00th=[ 232], 95.00th=[ 259], | 99.00th=[ 351], 99.50th=[ 372], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 31, max= 192, per=26.18%, avg=91.61, stdev=39.04, samples=140 iops : min= 1, max= 12, avg= 5.01, stdev= 2.50, samples=140 lat (msec) : 10=1.56%, 20=16.28%, 50=20.83%, 100=20.83%, 250=37.11% lat (msec) : 500=3.39% cpu : usr=0.03%, sys=1.10%, ctx=1220, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Wed Aug 26 18:46:22 2026 read: IOPS=5, BW=88.7KiB/s (90.9kB/s)(6256KiB/70499msec) clat (msec): min=5, max=315, avg=36.96, stdev=33.85 lat (msec): min=5, max=315, avg=36.97, stdev=33.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 72], 95.00th=[ 105], | 99.00th=[ 186], 99.50th=[ 201], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 413, per=31.01%, avg=103.25, stdev=68.88, samples=120 iops : min= 1, max= 25, avg= 5.75, stdev= 4.34, samples=120 write: IOPS=5, BW=85.6KiB/s (87.6kB/s)(6032KiB/70499msec); 0 zone resets clat (msec): min=44, max=496, avg=147.86, stdev=66.98 lat (msec): min=44, max=496, avg=147.86, stdev=66.98 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 93], | 30.00th=[ 108], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 192], 90.00th=[ 243], 95.00th=[ 266], | 99.00th=[ 397], 99.50th=[ 443], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 30, max= 192, per=24.81%, avg=86.85, stdev=36.80, samples=136 iops : min= 1, max= 12, avg= 4.71, stdev= 2.40, samples=136 lat (msec) : 10=1.43%, 20=15.89%, 50=23.70%, 100=19.53%, 250=35.55% lat (msec) : 500=3.91% cpu : usr=0.03%, sys=1.19%, ctx=1368, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Wed Aug 26 18:46:22 2026 read: IOPS=5, BW=84.5KiB/s (86.5kB/s)(6032KiB/71382msec) clat (msec): min=6, max=377, avg=38.16, stdev=38.74 lat (msec): min=6, max=377, avg=38.17, stdev=38.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 117], | 99.00th=[ 205], 99.50th=[ 232], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 287, per=29.40%, avg=97.90, stdev=61.61, samples=120 iops : min= 1, max= 17, avg= 5.42, stdev= 3.90, samples=120 write: IOPS=5, BW=87.6KiB/s (89.7kB/s)(6256KiB/71382msec); 0 zone resets clat (msec): min=39, max=564, avg=144.77, stdev=62.07 lat (msec): min=39, max=564, avg=144.79, stdev=62.06 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 94], | 30.00th=[ 109], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 192], 90.00th=[ 222], 95.00th=[ 255], | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 31, max= 192, per=25.07%, avg=87.76, stdev=38.90, samples=140 iops : min= 1, max= 12, avg= 4.76, stdev= 2.53, samples=140 lat (msec) : 10=2.08%, 20=16.15%, 50=20.83%, 100=18.75%, 250=38.93% lat (msec) : 500=3.12%, 750=0.13% cpu : usr=0.03%, sys=1.10%, ctx=1245, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=334KiB/s (342kB/s), 79.0KiB/s-88.7KiB/s (81.9kB/s-90.9kB/s), io=23.4MiB (24.5MB), run=70499-71820msec WRITE: bw=351KiB/s (359kB/s), 85.6KiB/s-91.1KiB/s (87.6kB/s-93.3kB/s), io=24.6MiB (25.8MB), run=70499-71820msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144940: Wed Aug 26 18:46:37 2026 read: IOPS=1, BW=1575KiB/s (1613kB/s)(7168KiB/4550msec) clat (msec): min=105, max=902, avg=332.59, stdev=312.33 lat (msec): min=105, max=902, avg=332.59, stdev=312.33 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 120], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 174], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 642], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1620, max= 4079, per=79.10%, avg=2943.25, stdev=1299.55, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1125KiB/s (1152kB/s)(5120KiB/4550msec); 0 zone resets clat (msec): min=270, max=584, avg=408.40, stdev=115.89 lat (msec): min=270, max=584, avg=408.48, stdev=115.89 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1831, max= 2039, per=37.64%, avg=1961.00, stdev=98.22, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.87%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Wed Aug 26 18:46:37 2026 read: IOPS=0, BW=372KiB/s (381kB/s)(2048KiB/5503msec) clat (msec): min=102, max=396, avg=249.12, stdev=208.01 lat (msec): min=102, max=396, avg=249.12, stdev=208.01 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1681, max= 1831, per=47.19%, avg=1756.00, stdev=106.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1861KiB/s (1905kB/s)(10.0MiB/5503msec); 0 zone resets clat (msec): min=223, max=1021, avg=487.21, stdev=236.11 lat (msec): min=223, max=1022, avg=487.30, stdev=236.12 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 300], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 535], 80.00th=[ 617], 90.00th=[ 684], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1939, max= 4071, per=49.88%, avg=2598.57, stdev=995.63, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=16.67%, 500=50.00%, 750=25.00%, 2000=8.33% cpu : usr=0.09%, sys=3.14%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144942: Wed Aug 26 18:46:37 2026 read: IOPS=1, BW=1122KiB/s (1149kB/s)(6144KiB/5474msec) clat (msec): min=98, max=575, avg=257.99, stdev=175.32 lat (msec): min=98, max=575, avg=258.02, stdev=175.29 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 271], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2035, max= 3663, per=65.71%, avg=2445.25, stdev=811.86, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1122KiB/s (1149kB/s)(6144KiB/5474msec); 0 zone resets clat (msec): min=207, max=1240, avg=583.10, stdev=412.85 lat (msec): min=207, max=1240, avg=583.26, stdev=412.99 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 600], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 2019, max= 2039, per=38.97%, avg=2030.20, stdev=10.35, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.11%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144943: Wed Aug 26 18:46:37 2026 read: IOPS=0, BW=980KiB/s (1003kB/s)(5120KiB/5226msec) clat (msec): min=125, max=1429, avg=435.33, stdev=558.02 lat (msec): min=125, max=1429, avg=435.34, stdev=558.02 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 3878, max= 4079, per=100.00%, avg=3978.50, stdev=142.13, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1372KiB/s (1405kB/s)(7168KiB/5226msec); 0 zone resets clat (msec): min=322, max=678, avg=423.16, stdev=131.32 lat (msec): min=323, max=678, avg=423.28, stdev=131.28 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 342], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 351], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 523], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1568, max= 4096, per=44.76%, avg=2332.20, stdev=1004.20, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.73%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3722KiB/s (3811kB/s), 372KiB/s-1575KiB/s (381kB/s-1613kB/s), io=20.0MiB (20.0MB), run=4550-5503msec WRITE: bw=5210KiB/s (5335kB/s), 1122KiB/s-1861KiB/s (1149kB/s-1905kB/s), io=28.0MiB (29.4MB), run=4550-5503msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144936: Wed Aug 26 18:46:37 2026 read: IOPS=2, BW=2182KiB/s (2234kB/s)(7168KiB/3285msec) clat (msec): min=213, max=393, avg=264.11, stdev=63.16 lat (msec): min=213, max=393, avg=264.11, stdev=63.16 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 222], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 239], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 292], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2039, max= 4079, per=75.87%, avg=2735.75, stdev=962.25, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1559KiB/s (1596kB/s)(5120KiB/3285msec); 0 zone resets clat (msec): min=140, max=320, avg=268.61, stdev=73.11 lat (msec): min=142, max=320, avg=269.94, stdev=72.59 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1896, max= 4079, per=52.91%, avg=2671.33, stdev=1221.17, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=58.33% cpu : usr=0.00%, sys=14.10%, ctx=233, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144937: Wed Aug 26 18:46:37 2026 read: IOPS=0, BW=361KiB/s (369kB/s)(2048KiB/5678msec) clat (msec): min=154, max=366, avg=260.43, stdev=149.41 lat (msec): min=154, max=366, avg=260.43, stdev=149.41 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1530, max= 2031, per=49.38%, avg=1780.50, stdev=354.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1803KiB/s (1847kB/s)(10.0MiB/5678msec); 0 zone resets clat (msec): min=236, max=1127, avg=482.39, stdev=279.11 lat (msec): min=236, max=1127, avg=482.47, stdev=279.10 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 245], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 347], 60.00th=[ 397], | 70.00th=[ 535], 80.00th=[ 667], 90.00th=[ 676], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1896, max= 4087, per=45.64%, avg=2304.43, stdev=787.74, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=10.48%, ctx=182, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144938: Wed Aug 26 18:46:37 2026 read: IOPS=1, BW=1539KiB/s (1576kB/s)(6144KiB/3992msec) clat (usec): min=387, max=311276, avg=106899.16, stdev=133048.80 lat (usec): min=387, max=311278, avg=106900.28, stdev=133049.02 clat percentiles (usec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 469], | 30.00th=[ 469], 40.00th=[ 586], 50.00th=[ 586], 60.00th=[108528], | 70.00th=[219153], 80.00th=[219153], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2035, max= 4063, per=91.42%, avg=3296.67, stdev=1101.01, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1539KiB/s (1576kB/s)(6144KiB/3992msec); 0 zone resets clat (msec): min=168, max=1158, avg=496.31, stdev=438.30 lat (msec): min=168, max=1158, avg=496.57, stdev=438.17 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 296], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1444, max= 4063, per=45.46%, avg=2295.40, stdev=1017.64, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=41.67%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.00%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144939: Wed Aug 26 18:46:37 2026 read: IOPS=1, BW=1169KiB/s (1197kB/s)(5120KiB/4381msec) clat (usec): min=564, max=289358, avg=169668.48, stdev=153964.23 lat (usec): min=565, max=289360, avg=169669.88, stdev=153964.09 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 1778], 40.00th=[ 1778], 50.00th=[270533], 60.00th=[270533], | 70.00th=[287310], 80.00th=[287310], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 2039, max= 6095, per=100.00%, avg=4067.00, stdev=2868.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1636KiB/s (1675kB/s)(7168KiB/4381msec); 0 zone resets clat (msec): min=143, max=1012, avg=484.04, stdev=270.48 lat (msec): min=143, max=1012, avg=484.85, stdev=269.96 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 313], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 443], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 542], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1460, max= 3792, per=44.03%, avg=2223.20, stdev=908.38, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=50.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=9.32%, ctx=121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3607KiB/s (3693kB/s), 361KiB/s-2182KiB/s (369kB/s-2234kB/s), io=20.0MiB (20.0MB), run=3285-5678msec WRITE: bw=5050KiB/s (5171kB/s), 1539KiB/s-1803KiB/s (1576kB/s-1847kB/s), io=28.0MiB (29.4MB), run=3285-5678msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144953: Wed Aug 26 18:46:53 2026 read: IOPS=0, BW=3584KiB/s (3670kB/s)(12.0MiB/3429msec) clat (msec): min=208, max=1633, avg=1109.95, stdev=784.20 lat (msec): min=208, max=1633, avg=1109.95, stdev=784.20 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.35%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144955: Wed Aug 26 18:46:53 2026 read: IOPS=0, BW=1752KiB/s (1794kB/s)(4096KiB/2338msec) clat (nsec): min=527532k, max=527532k, avg=527532039.00, stdev= 0.00 lat (nsec): min=527535k, max=527535k, avg=527534725.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3504KiB/s (3588kB/s)(8192KiB/2338msec); 0 zone resets clat (msec): min=603, max=1097, avg=850.27, stdev=349.45 lat (msec): min=604, max=1097, avg=850.91, stdev=348.98 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8143, max= 8143, per=77.76%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.30%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144957: Wed Aug 26 18:46:53 2026 write: IOPS=0, BW=3927KiB/s (4021kB/s)(12.0MiB/3129msec); 0 zone resets clat (msec): min=257, max=1399, avg=997.95, stdev=641.81 lat (msec): min=258, max=1399, avg=998.24, stdev=641.81 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8126, max= 8143, per=77.68%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.80%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144960: Wed Aug 26 18:46:53 2026 write: IOPS=1, BW=4953KiB/s (5072kB/s)(12.0MiB/2481msec); 0 zone resets clat (msec): min=317, max=1396, avg=752.33, stdev=569.30 lat (msec): min=317, max=1396, avg=752.64, stdev=569.35 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.44%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4778KiB/s (4893kB/s), 1752KiB/s-3584KiB/s (1794kB/s-3670kB/s), io=16.0MiB (16.8MB), run=2338-3429msec WRITE: bw=10.2MiB/s (10.7MB/s), 3504KiB/s-4953KiB/s (3588kB/s-5072kB/s), io=32.0MiB (33.6MB), run=2338-3129msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Wed Aug 26 18:46:53 2026 read: IOPS=1, BW=4757KiB/s (4871kB/s)(12.0MiB/2583msec) clat (msec): min=657, max=951, avg=833.75, stdev=155.36 lat (msec): min=657, max=951, avg=833.76, stdev=155.36 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.09%, ctx=316, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144954: Wed Aug 26 18:46:53 2026 read: IOPS=0, BW=1261KiB/s (1291kB/s)(4096KiB/3248msec) clat (nsec): min=915648k, max=915648k, avg=915647893.00, stdev= 0.00 lat (nsec): min=915650k, max=915650k, avg=915650450.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2522KiB/s (2583kB/s)(8192KiB/3248msec); 0 zone resets clat (msec): min=557, max=1616, avg=1086.92, stdev=748.54 lat (msec): min=558, max=1616, avg=1087.48, stdev=748.22 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8126, max= 8126, per=98.35%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.87%, ctx=108, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Wed Aug 26 18:46:53 2026 write: IOPS=0, BW=3098KiB/s (3173kB/s)(12.0MiB/3966msec); 0 zone resets clat (msec): min=277, max=1743, avg=1245.11, stdev=838.14 lat (msec): min=278, max=1744, avg=1245.61, stdev=837.84 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8143, max= 8143, per=98.56%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.77%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144958: Wed Aug 26 18:46:53 2026 write: IOPS=1, BW=5340KiB/s (5468kB/s)(12.0MiB/2301msec); 0 zone resets clat (msec): min=337, max=1462, avg=746.39, stdev=622.13 lat (msec): min=337, max=1465, avg=748.13, stdev=623.50 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7406, max= 8192, per=94.40%, avg=7799.00, stdev=555.79, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.74%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5044KiB/s (5165kB/s), 1261KiB/s-4757KiB/s (1291kB/s-4871kB/s), io=16.0MiB (16.8MB), run=2583-3248msec WRITE: bw=8262KiB/s (8461kB/s), 2522KiB/s-5340KiB/s (2583kB/s-5468kB/s), io=32.0MiB (33.6MB), run=2301-3966msec