== sanity test 398b: DIO and buffer IO race ============== 23:29:59 (1789270199) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.56936 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144961: Sat Sep 12 23:32:23 2026 read: IOPS=12, BW=49.4KiB/s (50.5kB/s)(5992KiB/121398msec) clat (usec): min=35, max=327081, avg=39724.85, stdev=30621.95 lat (usec): min=35, max=327083, avg=39730.76, stdev=30624.52 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 125], 20.00th=[ 18482], | 30.00th=[ 23725], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[189793], 99.90th=[242222], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 15, max= 119, per=25.67%, avg=49.29, stdev=20.25, samples=238 iops : min= 3, max= 29, avg=11.66, stdev= 5.07, samples=238 write: IOPS=12, BW=51.9KiB/s (53.1kB/s)(6296KiB/121398msec); 0 zone resets clat (usec): min=980, max=994058, avg=39013.10, stdev=46391.79 lat (usec): min=981, max=994060, avg=39019.37, stdev=46389.81 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1500], 10.00th=[ 2409], 20.00th=[ 5080], | 30.00th=[ 9241], 40.00th=[ 17433], 50.00th=[ 28705], 60.00th=[ 38536], | 70.00th=[ 51119], 80.00th=[ 66323], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[164627], 99.50th=[202376], 99.90th=[526386], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 15, max= 119, per=25.74%, avg=51.74, stdev=21.29, samples=238 iops : min= 3, max= 29, avg=12.27, stdev= 5.38, samples=238 lat (usec) : 50=0.33%, 100=4.17%, 250=0.59%, 500=0.23%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=4.04%, 4=4.65%, 10=7.81%, 20=11.49%, 50=36.33% lat (msec) : 100=24.90%, 250=5.18%, 500=0.07%, 750=0.03%, 1000=0.03% cpu : usr=0.11%, sys=5.91%, ctx=6921, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144962: Sat Sep 12 23:32:23 2026 read: IOPS=12, BW=48.6KiB/s (49.7kB/s)(5940KiB/122321msec) clat (usec): min=34, max=319466, avg=39061.87, stdev=29144.77 lat (usec): min=35, max=319467, avg=39067.10, stdev=29143.88 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 217], 20.00th=[ 19006], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[132645], 99.50th=[160433], 99.90th=[198181], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 142, per=25.05%, avg=48.10, stdev=20.76, samples=240 iops : min= 1, max= 35, avg=11.36, stdev= 5.21, samples=240 write: IOPS=12, BW=51.9KiB/s (53.1kB/s)(6348KiB/122321msec); 0 zone resets clat (usec): min=963, max=1054.1k, avg=40238.37, stdev=47096.62 lat (usec): min=964, max=1054.1k, avg=40243.31, stdev=47095.48 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1450], 10.00th=[ 2057], | 20.00th=[ 4293], 30.00th=[ 8586], 40.00th=[ 19006], | 50.00th=[ 29754], 60.00th=[ 40633], 70.00th=[ 52691], | 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[ 115868], | 99.00th=[ 166724], 99.50th=[ 202376], 99.90th=[ 333448], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 118, per=25.51%, avg=51.27, stdev=20.63, samples=240 iops : min= 1, max= 29, avg=12.17, stdev= 5.20, samples=240 lat (usec) : 50=0.36%, 100=3.87%, 250=0.65%, 500=0.26%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=4.95%, 4=5.08%, 10=6.74%, 20=9.70%, 50=38.38% lat (msec) : 100=23.60%, 250=5.99%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=5.74%, ctx=6848, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144963: Sat Sep 12 23:32:23 2026 read: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6028KiB/124982msec) clat (usec): min=32, max=476908, avg=39427.77, stdev=31547.93 lat (usec): min=32, max=476910, avg=39429.66, stdev=31547.92 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 71], 10.00th=[ 241], 20.00th=[ 18220], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 32900], 60.00th=[ 39584], | 70.00th=[ 48497], 80.00th=[ 59507], 90.00th=[ 77071], 95.00th=[ 89654], | 99.00th=[129500], 99.50th=[166724], 99.90th=[299893], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 127, per=25.24%, avg=48.46, stdev=20.20, samples=243 iops : min= 1, max= 31, avg=11.45, stdev= 5.08, samples=243 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6260KiB/124982msec); 0 zone resets clat (usec): min=967, max=1080.5k, avg=41536.00, stdev=49535.27 lat (usec): min=968, max=1080.5k, avg=41541.31, stdev=49534.32 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1418], 10.00th=[ 2278], | 20.00th=[ 5080], 30.00th=[ 10028], 40.00th=[ 19792], | 50.00th=[ 32375], 60.00th=[ 43779], 70.00th=[ 54789], | 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[ 113771], | 99.00th=[ 173016], 99.50th=[ 204473], 99.90th=[ 666895], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 111, per=24.81%, avg=49.87, stdev=19.35, samples=245 iops : min= 1, max= 27, avg=11.80, stdev= 4.88, samples=245 lat (usec) : 50=0.33%, 100=3.58%, 250=1.04%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.16% lat (msec) : 2=4.56%, 4=4.33%, 10=6.61%, 20=11.07%, 50=36.88% lat (msec) : 100=25.59%, 250=5.40%, 500=0.16%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.69%, ctx=6905, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144964: Sat Sep 12 23:32:23 2026 read: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6052KiB/123246msec) clat (usec): min=34, max=283944, avg=39563.42, stdev=30607.08 lat (usec): min=35, max=283946, avg=39570.89, stdev=30612.33 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 67], 10.00th=[ 96], 20.00th=[ 17957], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[154141], 99.90th=[246416], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 142, per=25.72%, avg=49.39, stdev=21.31, samples=239 iops : min= 1, max= 35, avg=11.69, stdev= 5.38, samples=239 write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6236KiB/123246msec); 0 zone resets clat (usec): min=1011, max=1178.6k, avg=40344.50, stdev=49512.57 lat (usec): min=1013, max=1178.6k, avg=40355.61, stdev=49514.58 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1450], 10.00th=[ 2311], | 20.00th=[ 5080], 30.00th=[ 8848], 40.00th=[ 18220], | 50.00th=[ 29230], 60.00th=[ 40633], 70.00th=[ 53216], | 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[ 113771], | 99.00th=[ 173016], 99.50th=[ 202376], 99.90th=[ 421528], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 116, per=25.16%, avg=50.57, stdev=20.64, samples=240 iops : min= 1, max= 29, avg=11.99, stdev= 5.20, samples=240 lat (usec) : 50=0.59%, 100=4.49%, 250=0.91%, 500=0.10%, 1000=0.16% lat (msec) : 2=4.52%, 4=4.33%, 10=7.71%, 20=9.70%, 50=36.62% lat (msec) : 100=24.87%, 250=5.83%, 500=0.13%, 2000=0.03% cpu : usr=0.10%, sys=5.71%, ctx=6845, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=192KiB/s (197kB/s), 48.2KiB/s-49.4KiB/s (49.4kB/s-50.5kB/s), io=23.4MiB (24.6MB), run=121398-124982msec WRITE: bw=201KiB/s (206kB/s), 50.1KiB/s-51.9KiB/s (51.3kB/s-53.1kB/s), io=24.6MiB (25.7MB), run=121398-124982msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Sat Sep 12 23:34:52 2026 read: IOPS=5, BW=21.0KiB/s (22.5kB/s)(5992KiB/272605msec) clat (msec): min=6, max=850, avg=36.56, stdev=42.64 lat (msec): min=6, max=850, avg=36.56, stdev=42.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 80], 95.00th=[ 104], | 99.00th=[ 176], 99.50th=[ 203], 99.90th=[ 709], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 87, per=27.75%, avg=24.14, stdev=15.98, samples=479 iops : min= 1, max= 21, avg= 5.40, stdev= 4.03, samples=479 write: IOPS=5, BW=23.1KiB/s (23.6kB/s)(6296KiB/272605msec); 0 zone resets clat (msec): min=38, max=510, avg=138.11, stdev=55.83 lat (msec): min=38, max=510, avg=138.11, stdev=55.83 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 129], 60.00th=[ 142], | 70.00th=[ 157], 80.00th=[ 176], 90.00th=[ 209], 95.00th=[ 241], | 99.00th=[ 334], 99.50th=[ 384], 99.90th=[ 472], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 48, per=25.06%, avg=22.81, stdev= 8.73, samples=531 iops : min= 1, max= 12, avg= 5.06, stdev= 2.25, samples=531 lat (msec) : 10=2.67%, 20=16.15%, 50=20.83%, 100=20.08%, 250=38.05% lat (msec) : 500=2.12%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5084, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144957: Sat Sep 12 23:34:52 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5940KiB/273545msec) clat (msec): min=6, max=922, avg=35.77, stdev=41.20 lat (msec): min=6, max=922, avg=35.78, stdev=41.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 103], | 99.00th=[ 178], 99.50th=[ 220], 99.90th=[ 422], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 95, per=27.69%, avg=24.09, stdev=15.77, samples=475 iops : min= 1, max= 23, avg= 5.38, stdev= 3.97, samples=475 write: IOPS=5, BW=23.2KiB/s (23.8kB/s)(6348KiB/273545msec); 0 zone resets clat (msec): min=37, max=502, avg=138.60, stdev=56.48 lat (msec): min=37, max=502, avg=138.60, stdev=56.48 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 213], 95.00th=[ 249], | 99.00th=[ 313], 99.50th=[ 368], 99.90th=[ 414], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 55, per=25.05%, avg=22.79, stdev= 9.09, samples=536 iops : min= 1, max= 13, avg= 5.06, stdev= 2.32, samples=536 lat (msec) : 10=2.12%, 20=17.15%, 50=20.54%, 100=19.82%, 250=37.73% lat (msec) : 500=2.57%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5040, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144958: Sat Sep 12 23:34:52 2026 read: IOPS=5, BW=22.0KiB/s (22.5kB/s)(6028KiB/273837msec) clat (msec): min=6, max=352, avg=36.79, stdev=33.39 lat (msec): min=6, max=352, avg=36.80, stdev=33.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 104], | 99.00th=[ 161], 99.50th=[ 194], 99.90th=[ 326], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 96, per=26.67%, avg=23.20, stdev=15.66, samples=501 iops : min= 1, max= 24, avg= 5.17, stdev= 3.94, samples=501 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6260KiB/273837msec); 0 zone resets clat (msec): min=47, max=1133, avg=139.23, stdev=62.76 lat (msec): min=47, max=1133, avg=139.24, stdev=62.76 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 94], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 128], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 211], 95.00th=[ 249], | 99.00th=[ 326], 99.50th=[ 372], 99.90th=[ 676], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 47, per=24.70%, avg=22.48, stdev= 9.08, samples=536 iops : min= 1, max= 11, avg= 4.98, stdev= 2.31, samples=536 lat (msec) : 10=2.28%, 20=14.81%, 50=21.81%, 100=20.57%, 250=37.96% lat (msec) : 500=2.47%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=1.15%, ctx=5127, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144960: Sat Sep 12 23:34:52 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6052KiB/272574msec) clat (msec): min=6, max=709, avg=35.39, stdev=37.03 lat (msec): min=6, max=709, avg=35.39, stdev=37.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 49], 90.00th=[ 73], 95.00th=[ 102], | 99.00th=[ 165], 99.50th=[ 220], 99.90th=[ 422], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 104, per=28.66%, avg=24.93, stdev=16.61, samples=469 iops : min= 1, max= 26, avg= 5.60, stdev= 4.19, samples=469 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6236KiB/272574msec); 0 zone resets clat (msec): min=42, max=1145, avg=140.19, stdev=62.02 lat (msec): min=42, max=1145, avg=140.19, stdev=62.03 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 130], 60.00th=[ 144], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 213], 95.00th=[ 243], | 99.00th=[ 326], 99.50th=[ 393], 99.90th=[ 493], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 48, per=24.77%, avg=22.54, stdev= 8.97, samples=532 iops : min= 1, max= 12, avg= 5.00, stdev= 2.31, samples=532 lat (msec) : 10=2.73%, 20=15.79%, 50=21.61%, 100=19.01%, 250=38.70% lat (msec) : 500=2.08%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.18%, ctx=5220, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=87.7KiB/s (89.8kB/s), 21.7KiB/s-22.2KiB/s (22.2kB/s-22.7kB/s), io=23.4MiB (24.6MB), run=272574-273837msec WRITE: bw=91.8KiB/s (94.0kB/s), 22.9KiB/s-23.2KiB/s (23.4kB/s-23.8kB/s), io=24.6MiB (25.7MB), run=272574-273837msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145032: Sat Sep 12 23:35:45 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(5920KiB/38869msec) clat (usec): min=40, max=223289, avg=49919.79, stdev=41025.87 lat (usec): min=40, max=223290, avg=49927.64, stdev=41029.27 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 91], | 30.00th=[ 28967], 40.00th=[ 38011], 50.00th=[ 47449], 60.00th=[ 55837], | 70.00th=[ 66847], 80.00th=[ 82314], 90.00th=[107480], 95.00th=[123208], | 99.00th=[160433], 99.50th=[183501], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 29, max= 384, per=27.01%, avg=153.95, stdev=75.50, samples=75 iops : min= 1, max= 24, avg= 8.84, stdev= 4.76, samples=75 write: IOPS=10, BW=164KiB/s (168kB/s)(6368KiB/38869msec); 0 zone resets clat (usec): min=1542, max=605825, avg=50254.59, stdev=64624.25 lat (usec): min=1542, max=605828, avg=50260.89, stdev=64625.46 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2245], 10.00th=[ 3621], 20.00th=[ 6587], | 30.00th=[ 8848], 40.00th=[ 15008], 50.00th=[ 26346], 60.00th=[ 42206], | 70.00th=[ 59507], 80.00th=[ 84411], 90.00th=[126354], 95.00th=[162530], | 99.00th=[304088], 99.50th=[362808], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 31, max= 319, per=28.08%, avg=168.19, stdev=71.28, samples=74 iops : min= 1, max= 19, avg= 9.74, stdev= 4.49, samples=74 lat (usec) : 50=1.17%, 100=8.72%, 250=1.30%, 500=0.13%, 750=0.26% lat (msec) : 2=2.34%, 4=3.52%, 10=11.72%, 20=6.64%, 50=23.44% lat (msec) : 100=26.04%, 250=13.67%, 500=0.91%, 750=0.13% cpu : usr=0.05%, sys=4.20%, ctx=1444, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145033: Sat Sep 12 23:35:45 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(5744KiB/42006msec) clat (usec): min=39, max=525686, avg=57957.58, stdev=50997.66 lat (usec): min=40, max=525687, avg=57959.42, stdev=50997.76 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 63], 10.00th=[ 75], 20.00th=[ 482], | 30.00th=[ 34341], 40.00th=[ 44827], 50.00th=[ 54264], 60.00th=[ 62653], | 70.00th=[ 73925], 80.00th=[ 89654], 90.00th=[115868], 95.00th=[139461], | 99.00th=[217056], 99.50th=[227541], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 29, max= 287, per=24.45%, avg=139.35, stdev=68.97, samples=80 iops : min= 1, max= 17, avg= 7.90, stdev= 4.36, samples=80 write: IOPS=9, BW=156KiB/s (160kB/s)(6544KiB/42006msec); 0 zone resets clat (usec): min=1446, max=417531, avg=51371.81, stdev=62904.69 lat (usec): min=1449, max=417532, avg=51413.69, stdev=62900.45 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2008], 10.00th=[ 3228], 20.00th=[ 6456], | 30.00th=[ 11207], 40.00th=[ 16909], 50.00th=[ 28705], 60.00th=[ 47449], | 70.00th=[ 61604], 80.00th=[ 85459], 90.00th=[117965], 95.00th=[168821], | 99.00th=[320865], 99.50th=[362808], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 31, max= 406, per=26.31%, avg=157.58, stdev=80.49, samples=81 iops : min= 1, max= 25, avg= 9.04, stdev= 5.07, samples=81 lat (usec) : 50=0.65%, 100=7.16%, 250=1.17%, 500=0.39%, 1000=0.13% lat (msec) : 2=2.99%, 4=4.17%, 10=8.33%, 20=8.59%, 50=20.57% lat (msec) : 100=30.73%, 250=13.80%, 500=1.17%, 750=0.13% cpu : usr=0.06%, sys=4.37%, ctx=1591, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145034: Sat Sep 12 23:35:45 2026 read: IOPS=9, BW=158KiB/s (161kB/s)(6256KiB/39693msec) clat (usec): min=35, max=238610, avg=51209.58, stdev=42945.58 lat (usec): min=35, max=238612, avg=51211.40, stdev=42945.33 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 90], | 30.00th=[ 26084], 40.00th=[ 39060], 50.00th=[ 49021], 60.00th=[ 58459], | 70.00th=[ 71828], 80.00th=[ 82314], 90.00th=[103285], 95.00th=[129500], | 99.00th=[179307], 99.50th=[204473], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 381, per=28.00%, avg=159.58, stdev=66.61, samples=77 iops : min= 1, max= 23, avg= 9.18, stdev= 4.21, samples=77 write: IOPS=9, BW=152KiB/s (156kB/s)(6032KiB/39693msec); 0 zone resets clat (usec): min=1516, max=544170, avg=51384.15, stdev=58685.37 lat (usec): min=1517, max=544173, avg=51393.47, stdev=58682.57 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2008], 10.00th=[ 4047], 20.00th=[ 6915], | 30.00th=[ 10421], 40.00th=[ 17171], 50.00th=[ 30540], 60.00th=[ 47449], | 70.00th=[ 67634], 80.00th=[ 94897], 90.00th=[128451], 95.00th=[149947], | 99.00th=[229639], 99.50th=[354419], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 30, max= 408, per=25.41%, avg=152.21, stdev=69.25, samples=77 iops : min= 1, max= 25, avg= 8.73, stdev= 4.37, samples=77 lat (usec) : 50=1.56%, 100=8.98%, 250=1.56%, 750=0.26%, 1000=0.13% lat (msec) : 2=2.47%, 4=2.34%, 10=9.38%, 20=8.20%, 50=21.35% lat (msec) : 100=28.91%, 250=14.45%, 500=0.26%, 750=0.13% cpu : usr=0.06%, sys=4.19%, ctx=1470, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145035: Sat Sep 12 23:35:45 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39054msec) clat (usec): min=33, max=619389, avg=53375.27, stdev=52871.85 lat (usec): min=34, max=619391, avg=53383.29, stdev=52868.97 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 76], 20.00th=[ 99], | 30.00th=[ 28705], 40.00th=[ 39584], 50.00th=[ 49021], 60.00th=[ 58459], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[109577], 95.00th=[122160], | 99.00th=[217056], 99.50th=[287310], 99.90th=[616563], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 31, max= 345, per=28.05%, avg=159.88, stdev=64.52, samples=73 iops : min= 1, max= 21, avg= 9.21, stdev= 4.02, samples=73 write: IOPS=10, BW=160KiB/s (164kB/s)(6256KiB/39054msec); 0 zone resets clat (usec): min=1557, max=369904, avg=47563.44, stdev=52708.51 lat (usec): min=1559, max=369904, avg=47568.21, stdev=52707.47 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2737], 10.00th=[ 5014], 20.00th=[ 8356], | 30.00th=[ 11994], 40.00th=[ 17957], 50.00th=[ 30016], 60.00th=[ 43779], | 70.00th=[ 60031], 80.00th=[ 78119], 90.00th=[113771], 95.00th=[137364], | 99.00th=[267387], 99.50th=[346031], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 31, max= 381, per=27.07%, avg=162.15, stdev=69.67, samples=75 iops : min= 1, max= 23, avg= 9.33, stdev= 4.38, samples=75 lat (usec) : 50=1.30%, 100=8.59%, 250=0.52%, 500=0.52%, 1000=0.26% lat (msec) : 2=1.95%, 4=2.34%, 10=9.38%, 20=10.03%, 50=23.05% lat (msec) : 100=28.91%, 250=12.24%, 500=0.78%, 750=0.13% cpu : usr=0.05%, sys=4.38%, ctx=1497, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=570KiB/s (584kB/s), 137KiB/s-158KiB/s (140kB/s-161kB/s), io=23.4MiB (24.5MB), run=38869-42006msec WRITE: bw=600KiB/s (614kB/s), 152KiB/s-164KiB/s (156kB/s-168kB/s), io=24.6MiB (25.8MB), run=38869-42006msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145027: Sat Sep 12 23:36:30 2026 read: IOPS=4, BW=68.6KiB/s (70.3kB/s)(5920KiB/86245msec) clat (msec): min=7, max=258, avg=46.48, stdev=46.03 lat (msec): min=7, max=258, avg=46.48, stdev=46.03 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 100], 95.00th=[ 146], | 99.00th=[ 228], 99.50th=[ 249], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 29, max= 250, per=29.86%, avg=81.81, stdev=54.37, samples=142 iops : min= 1, max= 15, avg= 4.30, stdev= 3.45, samples=142 write: IOPS=4, BW=73.8KiB/s (75.6kB/s)(6368KiB/86245msec); 0 zone resets clat (msec): min=49, max=675, avg=173.24, stdev=98.11 lat (msec): min=49, max=675, avg=173.25, stdev=98.10 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 101], | 30.00th=[ 111], 40.00th=[ 124], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 192], 80.00th=[ 243], 90.00th=[ 321], 95.00th=[ 380], | 99.00th=[ 502], 99.50th=[ 535], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 29, max= 191, per=26.33%, avg=76.09, stdev=39.95, samples=164 iops : min= 1, max= 11, avg= 3.93, stdev= 2.56, samples=164 lat (msec) : 10=0.65%, 20=12.24%, 50=22.79%, 100=18.10%, 250=36.33% lat (msec) : 500=9.38%, 750=0.52% cpu : usr=0.03%, sys=1.08%, ctx=1306, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145028: Sat Sep 12 23:36:30 2026 read: IOPS=4, BW=65.9KiB/s (67.5kB/s)(5744KiB/87117msec) clat (msec): min=7, max=615, avg=48.95, stdev=60.21 lat (msec): min=7, max=615, avg=48.95, stdev=60.21 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 128], 95.00th=[ 169], | 99.00th=[ 309], 99.50th=[ 380], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 22, max= 350, per=31.61%, avg=86.62, stdev=61.31, samples=129 iops : min= 1, max= 21, avg= 4.63, stdev= 3.84, samples=129 write: IOPS=4, BW=75.1KiB/s (76.9kB/s)(6544KiB/87117msec); 0 zone resets clat (msec): min=45, max=656, avg=169.48, stdev=97.58 lat (msec): min=45, max=656, avg=169.48, stdev=97.59 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 94], | 30.00th=[ 114], 40.00th=[ 128], 50.00th=[ 144], 60.00th=[ 159], | 70.00th=[ 186], 80.00th=[ 234], 90.00th=[ 309], 95.00th=[ 351], | 99.00th=[ 514], 99.50th=[ 550], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 29, max= 192, per=26.79%, avg=77.43, stdev=39.83, samples=164 iops : min= 1, max= 12, avg= 4.02, stdev= 2.57, samples=164 lat (msec) : 10=0.78%, 20=11.59%, 50=23.70%, 100=17.32%, 250=36.98% lat (msec) : 500=8.85%, 750=0.78% cpu : usr=0.04%, sys=1.08%, ctx=1272, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145029: Sat Sep 12 23:36:30 2026 read: IOPS=4, BW=75.6KiB/s (77.4kB/s)(6256KiB/82795msec) clat (msec): min=8, max=560, avg=47.19, stdev=52.65 lat (msec): min=8, max=560, avg=47.20, stdev=52.65 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 100], 95.00th=[ 140], | 99.00th=[ 264], 99.50th=[ 447], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 320, per=32.10%, avg=87.96, stdev=65.90, samples=140 iops : min= 1, max= 20, avg= 4.69, stdev= 4.21, samples=140 write: IOPS=4, BW=72.9KiB/s (74.6kB/s)(6032KiB/82795msec); 0 zone resets clat (msec): min=44, max=674, avg=170.12, stdev=94.60 lat (msec): min=44, max=674, avg=170.12, stdev=94.60 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 100], | 30.00th=[ 114], 40.00th=[ 128], 50.00th=[ 146], 60.00th=[ 167], | 70.00th=[ 190], 80.00th=[ 224], 90.00th=[ 284], 95.00th=[ 359], | 99.00th=[ 506], 99.50th=[ 592], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 30, max= 189, per=26.18%, avg=75.67, stdev=36.17, samples=156 iops : min= 1, max= 11, avg= 3.92, stdev= 2.30, samples=156 lat (msec) : 10=0.65%, 20=13.15%, 50=23.57%, 100=19.01%, 250=35.29% lat (msec) : 500=7.68%, 750=0.65% cpu : usr=0.05%, sys=1.10%, ctx=1247, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145030: Sat Sep 12 23:36:30 2026 read: IOPS=4, BW=70.1KiB/s (71.8kB/s)(6032KiB/86010msec) clat (msec): min=6, max=326, avg=48.82, stdev=50.82 lat (msec): min=6, max=326, avg=48.82, stdev=50.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 116], 95.00th=[ 163], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 281, per=32.02%, avg=87.72, stdev=61.18, samples=134 iops : min= 1, max= 17, avg= 4.66, stdev= 3.91, samples=134 write: IOPS=4, BW=72.7KiB/s (74.5kB/s)(6256KiB/86010msec); 0 zone resets clat (msec): min=32, max=555, avg=172.19, stdev=90.80 lat (msec): min=32, max=555, avg=172.20, stdev=90.80 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 96], | 30.00th=[ 115], 40.00th=[ 129], 50.00th=[ 146], 60.00th=[ 165], | 70.00th=[ 203], 80.00th=[ 249], 90.00th=[ 305], 95.00th=[ 342], | 99.00th=[ 443], 99.50th=[ 514], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 29, max= 223, per=25.78%, avg=74.51, stdev=39.69, samples=164 iops : min= 1, max= 13, avg= 3.84, stdev= 2.51, samples=164 lat (msec) : 10=0.91%, 20=11.72%, 50=23.57%, 100=18.62%, 250=34.64% lat (msec) : 500=10.16%, 750=0.39% cpu : usr=0.05%, sys=1.08%, ctx=1345, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=275KiB/s (282kB/s), 65.9KiB/s-75.6KiB/s (67.5kB/s-77.4kB/s), io=23.4MiB (24.5MB), run=82795-87117msec WRITE: bw=289KiB/s (296kB/s), 72.7KiB/s-75.1KiB/s (74.5kB/s-76.9kB/s), io=24.6MiB (25.8MB), run=82795-87117msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145059: Sat Sep 12 23:36:45 2026 read: IOPS=1, BW=1618KiB/s (1657kB/s)(7168KiB/4430msec) clat (msec): min=5, max=516, avg=257.70, stdev=149.40 lat (msec): min=5, max=516, avg=257.70, stdev=149.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 218], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 257], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 296], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1988, max= 4055, per=69.75%, avg=3009.75, stdev=1153.48, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1156KiB/s (1183kB/s)(5120KiB/4430msec); 0 zone resets clat (msec): min=263, max=782, avg=524.56, stdev=235.60 lat (msec): min=263, max=782, avg=524.85, stdev=235.41 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1961, max= 2035, per=33.23%, avg=2007.50, stdev=32.18, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 10=8.33%, 250=8.33%, 500=50.00%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=11.06%, ctx=252, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145060: Sat Sep 12 23:36:45 2026 read: IOPS=0, BW=432KiB/s (442kB/s)(2048KiB/4746msec) clat (msec): min=261, max=419, avg=340.40, stdev=111.29 lat (msec): min=261, max=419, avg=340.40, stdev=111.29 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1851, max= 2015, per=44.80%, avg=1933.00, stdev=115.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2158KiB/s (2209kB/s)(10.0MiB/4746msec); 0 zone resets clat (msec): min=123, max=648, avg=406.09, stdev=172.15 lat (msec): min=123, max=649, avg=406.37, stdev=172.22 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 194], | 30.00th=[ 296], 40.00th=[ 305], 50.00th=[ 426], 60.00th=[ 464], | 70.00th=[ 481], 80.00th=[ 542], 90.00th=[ 584], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1961, max= 4039, per=37.53%, avg=2267.00, stdev=716.60, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 250=16.67%, 500=58.33%, 750=25.00% cpu : usr=0.00%, sys=12.18%, ctx=236, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145061: Sat Sep 12 23:36:45 2026 read: IOPS=1, BW=1559KiB/s (1597kB/s)(6144KiB/3940msec) clat (usec): min=502, max=263327, avg=87161.42, stdev=134046.20 lat (usec): min=503, max=263329, avg=87162.93, stdev=134046.40 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 644], 50.00th=[ 644], 60.00th=[ 898], | 70.00th=[256902], 80.00th=[256902], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 2035, max= 4055, per=78.18%, avg=3373.67, stdev=1159.38, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1559KiB/s (1597kB/s)(6144KiB/3940msec); 0 zone resets clat (msec): min=225, max=1153, avg=566.64, stdev=333.58 lat (msec): min=225, max=1154, avg=566.74, stdev=333.64 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 527], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1980, max= 4031, per=41.64%, avg=2515.25, stdev=1010.72, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=25.00%, 1000=8.33% lat (msec) : 250=8.33%, 500=25.00%, 750=25.00%, 2000=8.33% cpu : usr=0.08%, sys=9.82%, ctx=130, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145062: Sat Sep 12 23:36:45 2026 read: IOPS=1, BW=1253KiB/s (1283kB/s)(5120KiB/4087msec) clat (usec): min=419, max=246458, avg=50060.44, stdev=109792.75 lat (usec): min=419, max=246461, avg=50061.62, stdev=109793.41 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 420], | 30.00th=[ 494], 40.00th=[ 494], 50.00th=[ 619], 60.00th=[ 619], | 70.00th=[ 2311], 80.00th=[ 2311], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1754KiB/s (1796kB/s)(7168KiB/4087msec); 0 zone resets clat (msec): min=301, max=788, avg=547.28, stdev=172.20 lat (msec): min=301, max=788, avg=547.41, stdev=172.21 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 426], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 506], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 701], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1961, max= 2035, per=33.14%, avg=2002.00, stdev=30.46, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 4=8.33%, 250=8.33%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=7.39%, ctx=155, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4315KiB/s (4419kB/s), 432KiB/s-1618KiB/s (442kB/s-1657kB/s), io=20.0MiB (20.0MB), run=3940-4746msec WRITE: bw=6041KiB/s (6186kB/s), 1156KiB/s-2158KiB/s (1183kB/s-2209kB/s), io=28.0MiB (29.4MB), run=3940-4746msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145054: Sat Sep 12 23:36:46 2026 read: IOPS=1, BW=1479KiB/s (1515kB/s)(7168KiB/4845msec) clat (msec): min=100, max=491, avg=259.36, stdev=143.58 lat (msec): min=100, max=491, avg=259.36, stdev=143.58 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 159], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 218], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 414], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2039, max= 4196, per=98.80%, avg=3335.33, stdev=1142.59, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1057KiB/s (1082kB/s)(5120KiB/4845msec); 0 zone resets clat (msec): min=450, max=755, avg=575.34, stdev=121.64 lat (msec): min=451, max=755, avg=575.48, stdev=121.60 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1946, max= 2031, per=42.35%, avg=2002.00, stdev=40.09, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.36%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145055: Sat Sep 12 23:36:46 2026 read: IOPS=0, BW=338KiB/s (346kB/s)(2048KiB/6065msec) clat (msec): min=205, max=342, avg=273.97, stdev=96.46 lat (msec): min=205, max=342, avg=273.98, stdev=96.46 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1404, max= 2039, per=50.99%, avg=1721.50, stdev=449.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1688KiB/s (1729kB/s)(10.0MiB/6065msec); 0 zone resets clat (msec): min=238, max=1919, avg=535.42, stdev=499.10 lat (msec): min=238, max=1921, avg=535.99, stdev=499.67 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 292], | 30.00th=[ 296], 40.00th=[ 338], 50.00th=[ 355], 60.00th=[ 393], | 70.00th=[ 414], 80.00th=[ 485], 90.00th=[ 634], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1404, max= 4071, per=52.45%, avg=2479.43, stdev=1014.56, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=16.67%, 500=66.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.31%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145056: Sat Sep 12 23:36:46 2026 read: IOPS=1, BW=1535KiB/s (1572kB/s)(6144KiB/4002msec) clat (msec): min=188, max=468, avg=265.46, stdev=113.54 lat (msec): min=188, max=468, avg=265.47, stdev=113.54 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 220], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2000, max= 4063, per=97.10%, avg=3278.00, stdev=1116.37, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1535KiB/s (1572kB/s)(6144KiB/4002msec); 0 zone resets clat (msec): min=252, max=513, avg=394.14, stdev=115.23 lat (msec): min=252, max=513, avg=394.30, stdev=115.25 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 418], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1946, max= 2828, per=45.57%, avg=2154.00, stdev=378.19, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=3.10%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145057: Sat Sep 12 23:36:46 2026 read: IOPS=1, BW=1122KiB/s (1148kB/s)(5120KiB/4565msec) clat (msec): min=154, max=307, avg=204.81, stdev=60.33 lat (msec): min=154, max=307, avg=204.81, stdev=60.33 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 3893, max= 4063, per=100.00%, avg=3978.00, stdev=120.21, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1570KiB/s (1608kB/s)(7168KiB/4565msec); 0 zone resets clat (msec): min=192, max=835, avg=484.27, stdev=190.32 lat (msec): min=192, max=835, avg=484.39, stdev=190.33 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 414], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 485], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 531], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1410, max= 2039, per=39.95%, avg=1888.33, stdev=240.92, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.22%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3377KiB/s (3458kB/s), 338KiB/s-1535KiB/s (346kB/s-1572kB/s), io=20.0MiB (20.0MB), run=4002-6065msec WRITE: bw=4727KiB/s (4841kB/s), 1057KiB/s-1688KiB/s (1082kB/s-1729kB/s), io=28.0MiB (29.4MB), run=4002-6065msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145071: Sat Sep 12 23:37:03 2026 read: IOPS=0, BW=3827KiB/s (3919kB/s)(12.0MiB/3211msec) clat (msec): min=801, max=1098, avg=982.01, stdev=158.56 lat (msec): min=801, max=1098, avg=982.01, stdev=158.56 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7713, max= 8110, per=100.00%, avg=7911.50, stdev=280.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=11.71%, ctx=405, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Sat Sep 12 23:37:03 2026 read: IOPS=0, BW=1016KiB/s (1041kB/s)(4096KiB/4031msec) clat (nsec): min=1126.2M, max=1126.2M, avg=1126170643.00, stdev= 0.00 lat (nsec): min=1126.2M, max=1126.2M, avg=1126173874.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2032KiB/s (2081kB/s)(8192KiB/4031msec); 0 zone resets clat (msec): min=394, max=2231, avg=1312.98, stdev=1299.50 lat (msec): min=397, max=2232, avg=1315.01, stdev=1297.32 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=7.54%, ctx=278, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Sat Sep 12 23:37:03 2026 write: IOPS=0, BW=3154KiB/s (3230kB/s)(12.0MiB/3896msec); 0 zone resets clat (msec): min=639, max=1546, avg=1206.99, stdev=494.35 lat (msec): min=644, max=1548, avg=1209.28, stdev=492.68 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=6.62%, ctx=90, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145074: Sat Sep 12 23:37:03 2026 write: IOPS=0, BW=3240KiB/s (3317kB/s)(12.0MiB/3793msec); 0 zone resets clat (msec): min=411, max=2684, avg=1173.42, stdev=1308.48 lat (msec): min=425, max=2685, avg=1179.15, stdev=1304.11 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.35%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4065KiB/s (4162kB/s), 1016KiB/s-3827KiB/s (1041kB/s-3919kB/s), io=16.0MiB (16.8MB), run=3211-4031msec WRITE: bw=8129KiB/s (8324kB/s), 2032KiB/s-3240KiB/s (2081kB/s-3317kB/s), io=32.0MiB (33.6MB), run=3793-4031msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145075: Sat Sep 12 23:37:04 2026 read: IOPS=0, BW=3275KiB/s (3354kB/s)(12.0MiB/3752msec) clat (msec): min=484, max=2083, avg=1214.48, stdev=808.36 lat (msec): min=484, max=2083, avg=1214.49, stdev=808.36 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.64%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145076: Sat Sep 12 23:37:04 2026 read: IOPS=0, BW=988KiB/s (1011kB/s)(4096KiB/4147msec) clat (nsec): min=1772.8M, max=1772.8M, avg=1772821102.00, stdev= 0.00 lat (nsec): min=1772.8M, max=1772.8M, avg=1772823488.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1770], 5.00th=[ 1770], 10.00th=[ 1770], 20.00th=[ 1770], | 30.00th=[ 1770], 40.00th=[ 1770], 50.00th=[ 1770], 60.00th=[ 1770], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1975KiB/s (2023kB/s)(8192KiB/4147msec); 0 zone resets clat (msec): min=576, max=1730, avg=1153.79, stdev=815.71 lat (msec): min=577, max=1731, avg=1154.70, stdev=815.73 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.99%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145077: Sat Sep 12 23:37:04 2026 write: IOPS=0, BW=2595KiB/s (2657kB/s)(12.0MiB/4736msec); 0 zone resets clat (msec): min=386, max=2725, avg=1545.52, stdev=1169.69 lat (msec): min=387, max=2726, avg=1546.07, stdev=1169.74 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8015, max= 8094, per=100.00%, avg=8054.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.77%, ctx=33, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145078: Sat Sep 12 23:37:04 2026 write: IOPS=0, BW=3196KiB/s (3273kB/s)(12.0MiB/3845msec); 0 zone resets clat (msec): min=461, max=2602, avg=1261.14, stdev=1169.17 lat (msec): min=462, max=2606, avg=1264.63, stdev=1169.61 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 7713, max= 8031, per=100.00%, avg=7872.00, stdev=224.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.02%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3951KiB/s (4046kB/s), 988KiB/s-3275KiB/s (1011kB/s-3354kB/s), io=16.0MiB (16.8MB), run=3752-4147msec WRITE: bw=6919KiB/s (7085kB/s), 1975KiB/s-3196KiB/s (2023kB/s-3273kB/s), io=32.0MiB (33.6MB), run=3845-4736msec