== sanity test 398b: DIO and buffer IO race ============== 21:57:44 (1788919064) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.86876 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152665: Tue Sep 8 22:00:03 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5992KiB/120648msec) clat (usec): min=25, max=762322, avg=39535.62, stdev=34311.65 lat (usec): min=26, max=762323, avg=39537.79, stdev=34312.29 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 2409], 20.00th=[ 18220], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[141558], 99.50th=[183501], 99.90th=[225444], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 134, per=25.29%, avg=49.32, stdev=22.55, samples=238 iops : min= 1, max= 33, avg=11.71, stdev= 5.68, samples=238 write: IOPS=13, BW=52.2KiB/s (53.4kB/s)(6296KiB/120648msec); 0 zone resets clat (usec): min=761, max=573542, avg=38793.73, stdev=44788.52 lat (usec): min=763, max=573542, avg=38797.73, stdev=44788.89 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1336], 20.00th=[ 3326], | 30.00th=[ 7504], 40.00th=[ 17171], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 66847], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[179307], 99.50th=[196084], 99.90th=[463471], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 135, per=25.59%, avg=52.20, stdev=22.33, samples=236 iops : min= 1, max= 33, avg=12.44, stdev= 5.61, samples=236 lat (usec) : 50=0.75%, 100=3.48%, 250=0.29%, 500=0.16%, 1000=0.13% lat (msec) : 2=7.45%, 4=3.87%, 10=6.38%, 20=11.10%, 50=38.09% lat (msec) : 100=22.75%, 250=5.31%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.32%, ctx=6405, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152666: Tue Sep 8 22:00:03 2026 read: IOPS=12, BW=48.5KiB/s (49.6kB/s)(5940KiB/122555msec) clat (usec): min=27, max=335957, avg=39400.74, stdev=29478.27 lat (usec): min=27, max=335958, avg=39402.04, stdev=29478.27 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 11863], 20.00th=[ 18744], | 30.00th=[ 23462], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[137364], 99.50th=[166724], 99.90th=[274727], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 135, per=24.71%, avg=48.19, stdev=20.54, samples=241 iops : min= 1, max= 33, avg=11.43, stdev= 5.17, samples=241 write: IOPS=12, BW=51.8KiB/s (53.0kB/s)(6348KiB/122555msec); 0 zone resets clat (usec): min=864, max=654350, avg=40136.16, stdev=47630.07 lat (usec): min=865, max=654352, avg=40142.07, stdev=47627.68 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1418], 20.00th=[ 3425], | 30.00th=[ 7439], 40.00th=[ 17171], 50.00th=[ 28181], 60.00th=[ 38536], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[206570], 99.50th=[248513], 99.90th=[484443], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 167, per=25.27%, avg=51.56, stdev=24.55, samples=241 iops : min= 1, max= 41, avg=12.28, stdev= 6.19, samples=241 lat (usec) : 50=0.26%, 100=3.45%, 250=0.29%, 750=0.03%, 1000=0.29% lat (msec) : 2=7.00%, 4=4.39%, 10=6.12%, 20=10.90%, 50=38.48% lat (msec) : 100=23.01%, 250=5.44%, 500=0.29%, 750=0.03% cpu : usr=0.07%, sys=5.12%, ctx=6336, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152667: Tue Sep 8 22:00:03 2026 read: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6028KiB/122680msec) clat (usec): min=37, max=365272, avg=38515.69, stdev=29808.84 lat (usec): min=37, max=365273, avg=38517.84, stdev=29808.50 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 285], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 45876], 80.00th=[ 55837], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[133694], 99.50th=[158335], 99.90th=[316670], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 119, per=25.32%, avg=49.38, stdev=21.71, samples=238 iops : min= 1, max= 29, avg=11.73, stdev= 5.48, samples=238 write: IOPS=12, BW=51.0KiB/s (52.3kB/s)(6260KiB/122680msec); 0 zone resets clat (usec): min=780, max=777149, avg=41058.37, stdev=49549.17 lat (usec): min=781, max=777150, avg=41063.21, stdev=49549.01 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1565], 20.00th=[ 3884], | 30.00th=[ 8094], 40.00th=[ 17957], 50.00th=[ 29230], 60.00th=[ 40633], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[122160], | 99.00th=[189793], 99.50th=[217056], 99.90th=[517997], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 7, max= 134, per=24.91%, avg=50.81, stdev=22.11, samples=240 iops : min= 1, max= 33, avg=12.09, stdev= 5.58, samples=240 lat (usec) : 50=0.72%, 100=3.87%, 250=0.29%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=6.32%, 4=3.94%, 10=6.58%, 20=10.32%, 50=39.00% lat (msec) : 100=22.62%, 250=5.63%, 500=0.26%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.06%, ctx=6275, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152668: Tue Sep 8 22:00:03 2026 read: IOPS=12, BW=50.4KiB/s (51.7kB/s)(6052KiB/119961msec) clat (usec): min=34, max=379779, avg=38717.34, stdev=30213.72 lat (usec): min=34, max=379781, avg=38719.63, stdev=30214.22 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 7898], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[132645], 99.50th=[185598], 99.90th=[308282], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 111, per=25.85%, avg=50.42, stdev=21.91, samples=235 iops : min= 1, max= 27, avg=11.99, stdev= 5.53, samples=235 write: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6236KiB/119961msec); 0 zone resets clat (usec): min=753, max=659247, avg=39140.34, stdev=47314.71 lat (usec): min=754, max=659248, avg=39143.05, stdev=47314.42 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1172], 10.00th=[ 1336], 20.00th=[ 3359], | 30.00th=[ 6587], 40.00th=[ 15926], 50.00th=[ 27395], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 66847], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[177210], 99.50th=[208667], 99.90th=[480248], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 166, per=25.21%, avg=51.43, stdev=23.83, samples=237 iops : min= 1, max= 41, avg=12.25, stdev= 6.00, samples=237 lat (usec) : 50=0.75%, 100=3.42%, 250=0.33%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.46% lat (msec) : 2=6.97%, 4=4.17%, 10=6.25%, 20=10.61%, 50=39.13% lat (msec) : 100=21.74%, 250=5.73%, 500=0.26%, 750=0.03% cpu : usr=0.10%, sys=5.19%, ctx=6300, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=196KiB/s (200kB/s), 48.5KiB/s-50.4KiB/s (49.6kB/s-51.7kB/s), io=23.4MiB (24.6MB), run=119961-122680msec WRITE: bw=205KiB/s (210kB/s), 51.0KiB/s-52.2KiB/s (52.3kB/s-53.4kB/s), io=24.6MiB (25.7MB), run=119961-122680msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152661: Tue Sep 8 22:01:56 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(5992KiB/234236msec) clat (msec): min=4, max=748, avg=32.26, stdev=37.60 lat (msec): min=4, max=748, avg=32.27, stdev=37.60 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 95], | 99.00th=[ 163], 99.50th=[ 207], 99.90th=[ 363], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 103, per=28.41%, avg=28.70, stdev=19.49, samples=405 iops : min= 1, max= 25, avg= 6.58, stdev= 4.93, samples=405 write: IOPS=6, BW=26.9KiB/s (27.5kB/s)(6296KiB/234236msec); 0 zone resets clat (msec): min=32, max=677, avg=117.82, stdev=72.85 lat (msec): min=32, max=677, avg=117.82, stdev=72.85 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 48], 10.00th=[ 55], 20.00th=[ 64], | 30.00th=[ 72], 40.00th=[ 82], 50.00th=[ 91], 60.00th=[ 108], | 70.00th=[ 132], 80.00th=[ 169], 90.00th=[ 222], 95.00th=[ 264], | 99.00th=[ 376], 99.50th=[ 409], 99.90th=[ 493], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 71, per=25.37%, avg=26.89, stdev=14.54, samples=453 iops : min= 1, max= 17, avg= 6.12, stdev= 3.70, samples=453 lat (msec) : 10=6.15%, 20=16.99%, 50=21.19%, 100=31.12%, 250=21.16% lat (msec) : 500=3.32%, 750=0.07% cpu : usr=0.05%, sys=1.35%, ctx=5493, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152662: Tue Sep 8 22:01:56 2026 read: IOPS=6, BW=25.2KiB/s (25.8kB/s)(5940KiB/235834msec) clat (msec): min=4, max=653, avg=32.64, stdev=39.53 lat (msec): min=4, max=653, avg=32.64, stdev=39.53 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 70], 95.00th=[ 97], | 99.00th=[ 178], 99.50th=[ 234], 99.90th=[ 477], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 102, per=27.97%, avg=28.25, stdev=19.39, samples=408 iops : min= 1, max= 25, avg= 6.47, stdev= 4.91, samples=408 write: IOPS=6, BW=26.9KiB/s (27.6kB/s)(6348KiB/235834msec); 0 zone resets clat (msec): min=21, max=649, avg=117.79, stdev=72.76 lat (msec): min=21, max=649, avg=117.79, stdev=72.76 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 48], 10.00th=[ 55], 20.00th=[ 66], | 30.00th=[ 74], 40.00th=[ 84], 50.00th=[ 94], 60.00th=[ 107], | 70.00th=[ 128], 80.00th=[ 167], 90.00th=[ 215], 95.00th=[ 266], | 99.00th=[ 368], 99.50th=[ 418], 99.90th=[ 575], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 87, per=25.18%, avg=26.69, stdev=14.65, samples=460 iops : min= 1, max= 21, avg= 6.07, stdev= 3.74, samples=460 lat (msec) : 10=6.45%, 20=16.18%, 50=21.42%, 100=30.86%, 250=21.94% lat (msec) : 500=2.96%, 750=0.20% cpu : usr=0.06%, sys=1.39%, ctx=5540, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152663: Tue Sep 8 22:01:56 2026 read: IOPS=6, BW=25.8KiB/s (26.4kB/s)(6028KiB/233964msec) clat (msec): min=5, max=354, avg=32.21, stdev=33.66 lat (msec): min=5, max=354, avg=32.21, stdev=33.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 70], 95.00th=[ 97], | 99.00th=[ 165], 99.50th=[ 215], 99.90th=[ 313], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 95, per=28.09%, avg=28.38, stdev=18.73, samples=413 iops : min= 1, max= 23, avg= 6.50, stdev= 4.74, samples=413 write: IOPS=6, BW=26.8KiB/s (27.4kB/s)(6260KiB/233964msec); 0 zone resets clat (msec): min=26, max=769, avg=118.22, stdev=74.72 lat (msec): min=26, max=769, avg=118.22, stdev=74.72 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 64], | 30.00th=[ 73], 40.00th=[ 83], 50.00th=[ 93], 60.00th=[ 107], | 70.00th=[ 131], 80.00th=[ 165], 90.00th=[ 220], 95.00th=[ 264], | 99.00th=[ 372], 99.50th=[ 422], 99.90th=[ 667], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 64, per=25.12%, avg=26.63, stdev=14.64, samples=456 iops : min= 1, max= 16, avg= 6.05, stdev= 3.73, samples=456 lat (msec) : 10=5.89%, 20=18.07%, 50=19.92%, 100=31.71%, 250=21.06% lat (msec) : 500=3.22%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.38%, ctx=5523, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152664: Tue Sep 8 22:01:56 2026 read: IOPS=6, BW=25.9KiB/s (26.5kB/s)(6052KiB/233550msec) clat (msec): min=5, max=491, avg=31.10, stdev=33.67 lat (msec): min=5, max=491, avg=31.10, stdev=33.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 66], 95.00th=[ 93], | 99.00th=[ 161], 99.50th=[ 205], 99.90th=[ 330], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 119, per=29.13%, avg=29.42, stdev=19.70, samples=400 iops : min= 1, max= 29, avg= 6.76, stdev= 4.96, samples=400 write: IOPS=6, BW=26.7KiB/s (27.3kB/s)(6236KiB/233550msec); 0 zone resets clat (msec): min=29, max=808, avg=119.35, stdev=72.61 lat (msec): min=29, max=808, avg=119.36, stdev=72.61 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 66], | 30.00th=[ 74], 40.00th=[ 85], 50.00th=[ 94], 60.00th=[ 108], | 70.00th=[ 132], 80.00th=[ 169], 90.00th=[ 224], 95.00th=[ 264], | 99.00th=[ 347], 99.50th=[ 414], 99.90th=[ 575], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 56, per=25.12%, avg=26.63, stdev=13.78, samples=454 iops : min= 1, max= 14, avg= 6.06, stdev= 3.52, samples=454 lat (msec) : 10=6.12%, 20=17.87%, 50=20.44%, 100=30.57%, 250=21.74% lat (msec) : 500=3.12%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.32%, ctx=5400, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=102KiB/s (104kB/s), 25.2KiB/s-25.9KiB/s (25.8kB/s-26.5kB/s), io=23.4MiB (24.6MB), run=233550-235834msec WRITE: bw=107KiB/s (109kB/s), 26.7KiB/s-26.9KiB/s (27.3kB/s-27.6kB/s), io=24.6MiB (25.7MB), run=233550-235834msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152730: Tue Sep 8 22:02:21 2026 read: IOPS=20, BW=330KiB/s (338kB/s)(5920KiB/17947msec) clat (usec): min=34, max=113667, avg=23301.34, stdev=19200.54 lat (usec): min=35, max=113668, avg=23305.70, stdev=19199.41 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 98], | 30.00th=[ 14091], 40.00th=[ 18220], 50.00th=[ 22152], 60.00th=[ 26084], | 70.00th=[ 31327], 80.00th=[ 38011], 90.00th=[ 48497], 95.00th=[ 55837], | 99.00th=[ 83362], 99.50th=[110625], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 127, max= 568, per=25.05%, avg=324.14, stdev=112.23, samples=35 iops : min= 7, max= 35, avg=19.60, stdev= 7.08, samples=35 write: IOPS=22, BW=355KiB/s (363kB/s)(6368KiB/17947msec); 0 zone resets clat (usec): min=1397, max=147425, avg=23180.63, stdev=24993.83 lat (usec): min=1398, max=147429, avg=23183.00, stdev=24993.77 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1795], 10.00th=[ 2212], 20.00th=[ 3294], | 30.00th=[ 5604], 40.00th=[ 8455], 50.00th=[ 12780], 60.00th=[ 19792], | 70.00th=[ 30278], 80.00th=[ 40633], 90.00th=[ 60556], 95.00th=[ 73925], | 99.00th=[100140], 99.50th=[143655], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 126, max= 766, per=25.96%, avg=353.54, stdev=136.30, samples=35 iops : min= 7, max= 47, avg=21.46, stdev= 8.55, samples=35 lat (usec) : 50=1.43%, 100=8.33%, 250=1.43%, 500=0.26%, 750=0.13% lat (msec) : 2=4.43%, 4=8.85%, 10=10.68%, 20=17.84%, 50=33.72% lat (msec) : 100=12.11%, 250=0.78% cpu : usr=0.13%, sys=9.86%, ctx=1470, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152731: Tue Sep 8 22:02:21 2026 read: IOPS=19, BW=310KiB/s (318kB/s)(5744KiB/18500msec) clat (usec): min=34, max=225960, avg=25879.09, stdev=22800.57 lat (usec): min=34, max=225961, avg=25880.99, stdev=22799.53 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 693], | 30.00th=[ 15664], 40.00th=[ 19792], 50.00th=[ 23725], 60.00th=[ 27919], | 70.00th=[ 32637], 80.00th=[ 38536], 90.00th=[ 52167], 95.00th=[ 63701], | 99.00th=[ 84411], 99.50th=[145753], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 142, max= 604, per=24.67%, avg=319.20, stdev=107.84, samples=35 iops : min= 8, max= 37, avg=19.29, stdev= 6.75, samples=35 write: IOPS=22, BW=354KiB/s (362kB/s)(6544KiB/18500msec); 0 zone resets clat (usec): min=1285, max=170085, avg=22288.38, stdev=24883.82 lat (usec): min=1287, max=170088, avg=22290.19, stdev=24883.89 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1762], 10.00th=[ 2147], 20.00th=[ 3589], | 30.00th=[ 5276], 40.00th=[ 8225], 50.00th=[ 12256], 60.00th=[ 19006], | 70.00th=[ 28705], 80.00th=[ 38536], 90.00th=[ 54789], 95.00th=[ 67634], | 99.00th=[125305], 99.50th=[141558], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 93, max= 734, per=25.73%, avg=350.44, stdev=132.74, samples=36 iops : min= 5, max= 45, avg=21.25, stdev= 8.30, samples=36 lat (usec) : 50=1.04%, 100=7.29%, 250=0.65%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.56%, 4=8.20%, 10=11.59%, 20=17.71%, 50=36.46% lat (msec) : 100=10.81%, 250=1.17% cpu : usr=0.09%, sys=9.98%, ctx=1506, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152732: Tue Sep 8 22:02:21 2026 read: IOPS=21, BW=344KiB/s (352kB/s)(6256KiB/18203msec) clat (usec): min=30, max=235954, avg=25123.75, stdev=23361.40 lat (usec): min=30, max=235954, avg=25126.11, stdev=23362.74 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 69], 20.00th=[ 120], | 30.00th=[ 14353], 40.00th=[ 19006], 50.00th=[ 21890], 60.00th=[ 26608], | 70.00th=[ 32637], 80.00th=[ 39584], 90.00th=[ 51643], 95.00th=[ 60031], | 99.00th=[103285], 99.50th=[158335], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 127, max= 574, per=26.65%, avg=344.81, stdev=113.85, samples=36 iops : min= 7, max= 35, avg=20.89, stdev= 7.17, samples=36 write: IOPS=20, BW=331KiB/s (339kB/s)(6032KiB/18203msec); 0 zone resets clat (usec): min=1252, max=137211, avg=21946.25, stdev=24185.00 lat (usec): min=1254, max=137214, avg=21948.27, stdev=24184.91 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1729], 10.00th=[ 2089], 20.00th=[ 3392], | 30.00th=[ 5211], 40.00th=[ 7635], 50.00th=[ 11207], 60.00th=[ 17433], | 70.00th=[ 26084], 80.00th=[ 41681], 90.00th=[ 56886], 95.00th=[ 68682], | 99.00th=[109577], 99.50th=[122160], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 124, max= 704, per=24.27%, avg=330.50, stdev=131.90, samples=36 iops : min= 7, max= 44, avg=19.97, stdev= 8.29, samples=36 lat (usec) : 50=0.91%, 100=8.33%, 250=1.69%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=4.43%, 4=7.29%, 10=11.85%, 20=17.97%, 50=34.24% lat (msec) : 100=11.07%, 250=1.30% cpu : usr=0.11%, sys=9.70%, ctx=1489, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152733: Tue Sep 8 22:02:21 2026 read: IOPS=20, BW=328KiB/s (336kB/s)(6032KiB/18372msec) clat (usec): min=37, max=188547, avg=25527.88, stdev=23485.28 lat (usec): min=37, max=188548, avg=25535.00, stdev=23486.49 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 97], | 30.00th=[ 14091], 40.00th=[ 19792], 50.00th=[ 23200], 60.00th=[ 27657], | 70.00th=[ 32900], 80.00th=[ 39584], 90.00th=[ 53216], 95.00th=[ 66323], | 99.00th=[100140], 99.50th=[139461], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 93, max= 536, per=25.15%, avg=325.44, stdev=106.69, samples=36 iops : min= 5, max= 33, avg=19.67, stdev= 6.71, samples=36 write: IOPS=21, BW=341KiB/s (349kB/s)(6256KiB/18372msec); 0 zone resets clat (usec): min=1079, max=172476, avg=22192.47, stdev=24004.55 lat (usec): min=1080, max=173105, avg=22198.45, stdev=24014.23 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1696], 10.00th=[ 1909], 20.00th=[ 3261], | 30.00th=[ 5211], 40.00th=[ 7439], 50.00th=[ 12256], 60.00th=[ 20579], | 70.00th=[ 29492], 80.00th=[ 39584], 90.00th=[ 55313], 95.00th=[ 67634], | 99.00th=[102237], 99.50th=[132645], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 127, max= 573, per=24.79%, avg=337.61, stdev=112.01, samples=36 iops : min= 7, max= 35, avg=20.44, stdev= 7.02, samples=36 lat (usec) : 50=1.56%, 100=8.46%, 250=2.34%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.99%, 4=6.25%, 10=11.72%, 20=13.41%, 50=37.37% lat (msec) : 100=11.59%, 250=1.04% cpu : usr=0.11%, sys=9.69%, ctx=1461, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1295KiB/s (1326kB/s), 310KiB/s-344KiB/s (318kB/s-352kB/s), io=23.4MiB (24.5MB), run=17947-18500msec WRITE: bw=1362KiB/s (1395kB/s), 331KiB/s-355KiB/s (339kB/s-363kB/s), io=24.6MiB (25.8MB), run=17947-18500msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152735: Tue Sep 8 22:02:49 2026 read: IOPS=8, BW=130KiB/s (134kB/s)(5920KiB/45401msec) clat (msec): min=5, max=188, avg=24.42, stdev=23.77 lat (msec): min=5, max=188, avg=24.43, stdev=23.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 48], 95.00th=[ 69], | 99.00th=[ 144], 99.50th=[ 155], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 383, per=25.88%, avg=134.83, stdev=85.19, samples=87 iops : min= 1, max= 23, avg= 7.75, stdev= 5.35, samples=87 write: IOPS=8, BW=140KiB/s (144kB/s)(6368KiB/45401msec); 0 zone resets clat (msec): min=31, max=289, avg=91.19, stdev=40.59 lat (msec): min=31, max=289, avg=91.19, stdev=40.58 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 58], | 30.00th=[ 67], 40.00th=[ 74], 50.00th=[ 82], 60.00th=[ 89], | 70.00th=[ 100], 80.00th=[ 117], 90.00th=[ 146], 95.00th=[ 186], | 99.00th=[ 226], 99.50th=[ 245], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 254, per=25.50%, avg=140.00, stdev=57.27, samples=90 iops : min= 1, max= 15, avg= 8.07, stdev= 3.69, samples=90 lat (msec) : 10=8.59%, 20=19.92%, 50=19.53%, 100=35.29%, 250=16.54% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.97%, ctx=1405, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152736: Tue Sep 8 22:02:49 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(5744KiB/45893msec) clat (msec): min=5, max=177, avg=25.21, stdev=24.94 lat (msec): min=5, max=180, avg=25.22, stdev=24.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 35], 90.00th=[ 57], 95.00th=[ 75], | 99.00th=[ 133], 99.50th=[ 150], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 26, max= 381, per=25.43%, avg=132.51, stdev=81.38, samples=86 iops : min= 1, max= 23, avg= 7.60, stdev= 5.11, samples=86 write: IOPS=8, BW=143KiB/s (146kB/s)(6544KiB/45893msec); 0 zone resets clat (msec): min=30, max=302, avg=89.55, stdev=44.35 lat (msec): min=30, max=302, avg=89.55, stdev=44.35 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 45], 10.00th=[ 52], 20.00th=[ 58], | 30.00th=[ 65], 40.00th=[ 70], 50.00th=[ 80], 60.00th=[ 86], | 70.00th=[ 95], 80.00th=[ 110], 90.00th=[ 142], 95.00th=[ 190], | 99.00th=[ 249], 99.50th=[ 266], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 32, max= 347, per=26.22%, avg=143.92, stdev=61.68, samples=90 iops : min= 2, max= 21, avg= 8.31, stdev= 3.96, samples=90 lat (msec) : 10=8.07%, 20=20.96%, 50=17.19%, 100=38.54%, 250=14.71% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.94%, ctx=1446, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152737: Tue Sep 8 22:02:49 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(6256KiB/44626msec) clat (msec): min=6, max=142, avg=24.11, stdev=21.26 lat (msec): min=6, max=142, avg=24.12, stdev=21.26 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 48], 95.00th=[ 70], | 99.00th=[ 116], 99.50th=[ 132], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 384, per=27.33%, avg=142.41, stdev=96.69, samples=87 iops : min= 1, max= 24, avg= 8.22, stdev= 6.09, samples=87 write: IOPS=8, BW=135KiB/s (138kB/s)(6032KiB/44626msec); 0 zone resets clat (msec): min=34, max=378, avg=92.90, stdev=46.65 lat (msec): min=34, max=378, avg=92.90, stdev=46.65 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 47], 10.00th=[ 51], 20.00th=[ 60], | 30.00th=[ 67], 40.00th=[ 72], 50.00th=[ 81], 60.00th=[ 88], | 70.00th=[ 99], 80.00th=[ 117], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 284], 99.50th=[ 305], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 256, per=24.43%, avg=134.15, stdev=54.96, samples=88 iops : min= 1, max= 16, avg= 7.70, stdev= 3.57, samples=88 lat (msec) : 10=7.81%, 20=22.79%, 50=20.31%, 100=34.11%, 250=14.32% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=2.00%, ctx=1485, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152738: Tue Sep 8 22:02:49 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45369msec) clat (msec): min=4, max=222, avg=25.27, stdev=26.56 lat (msec): min=4, max=222, avg=25.27, stdev=26.56 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 51], 95.00th=[ 87], | 99.00th=[ 153], 99.50th=[ 163], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 448, per=27.51%, avg=143.30, stdev=82.29, samples=83 iops : min= 1, max= 28, avg= 8.28, stdev= 5.22, samples=83 write: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45369msec); 0 zone resets clat (msec): min=36, max=320, avg=91.19, stdev=45.09 lat (msec): min=36, max=320, avg=91.19, stdev=45.09 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 59], | 30.00th=[ 65], 40.00th=[ 72], 50.00th=[ 80], 60.00th=[ 87], | 70.00th=[ 97], 80.00th=[ 113], 90.00th=[ 150], 95.00th=[ 180], | 99.00th=[ 288], 99.50th=[ 309], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 256, per=25.40%, avg=139.43, stdev=58.72, samples=89 iops : min= 1, max= 16, avg= 8.03, stdev= 3.78, samples=89 lat (msec) : 10=7.29%, 20=23.44%, 50=17.84%, 100=35.55%, 250=15.23% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.90%, ctx=1333, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=522KiB/s (534kB/s), 125KiB/s-140KiB/s (128kB/s-144kB/s), io=23.4MiB (24.5MB), run=44626-45893msec WRITE: bw=549KiB/s (562kB/s), 135KiB/s-143KiB/s (138kB/s-146kB/s), io=24.6MiB (25.8MB), run=44626-45893msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152753: Tue Sep 8 22:02:59 2026 read: IOPS=2, BW=2363KiB/s (2419kB/s)(7168KiB/3034msec) clat (msec): min=87, max=963, avg=274.39, stdev=311.41 lat (msec): min=87, max=963, avg=274.39, stdev=311.41 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 91], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 205], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 266], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 4096, max= 5667, per=100.00%, avg=4881.50, stdev=1110.86, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1688KiB/s (1728kB/s)(5120KiB/3034msec); 0 zone resets clat (msec): min=176, max=235, avg=216.49, stdev=23.79 lat (msec): min=177, max=235, avg=216.61, stdev=23.74 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 2048, max= 3992, per=40.02%, avg=2696.00, stdev=1122.37, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=16.67%, 250=66.67%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.78%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152754: Tue Sep 8 22:02:59 2026 read: IOPS=0, BW=508KiB/s (521kB/s)(2048KiB/4029msec) clat (msec): min=82, max=391, avg=237.11, stdev=218.02 lat (msec): min=82, max=391, avg=237.11, stdev=218.02 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1954, max= 2011, per=41.20%, avg=1982.50, stdev=40.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2542KiB/s (2603kB/s)(10.0MiB/4029msec); 0 zone resets clat (msec): min=134, max=1381, avg=346.61, stdev=379.46 lat (msec): min=134, max=1381, avg=346.76, stdev=379.43 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 142], 40.00th=[ 180], 50.00th=[ 209], 60.00th=[ 226], | 70.00th=[ 243], 80.00th=[ 326], 90.00th=[ 493], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1954, max= 6083, per=60.23%, avg=4057.25, stdev=1686.25, samples=4 iops : min= 1, max= 5, avg= 3.50, stdev= 1.73, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=5.34%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152755: Tue Sep 8 22:02:59 2026 read: IOPS=1, BW=1649KiB/s (1689kB/s)(6144KiB/3726msec) clat (msec): min=65, max=295, avg=153.83, stdev=102.80 lat (msec): min=65, max=295, avg=153.83, stdev=102.80 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 70], | 30.00th=[ 70], 40.00th=[ 79], 50.00th=[ 79], 60.00th=[ 150], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1996, max= 3908, per=51.84%, avg=2494.75, stdev=942.41, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1649KiB/s (1689kB/s)(6144KiB/3726msec); 0 zone resets clat (msec): min=115, max=1521, avg=444.88, stdev=534.55 lat (msec): min=115, max=1521, avg=444.98, stdev=534.55 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 266], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1996, max= 3961, per=37.23%, avg=2508.00, stdev=968.90, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=3.14%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152757: Tue Sep 8 22:02:59 2026 read: IOPS=1, BW=1203KiB/s (1232kB/s)(5120KiB/4256msec) clat (msec): min=57, max=477, avg=244.00, stdev=191.42 lat (msec): min=57, max=477, avg=244.01, stdev=191.42 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1954, max= 4071, per=55.78%, avg=2684.00, stdev=1201.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1684KiB/s (1725kB/s)(7168KiB/4256msec); 0 zone resets clat (msec): min=113, max=1410, avg=407.19, stdev=464.48 lat (msec): min=113, max=1411, avg=407.43, stdev=464.87 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 142], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 209], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 542], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1939, max= 4096, per=44.76%, avg=3015.00, stdev=1233.85, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.11%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4812KiB/s (4928kB/s), 508KiB/s-2363KiB/s (521kB/s-2419kB/s), io=20.0MiB (20.0MB), run=3034-4256msec WRITE: bw=6737KiB/s (6899kB/s), 1649KiB/s-2542KiB/s (1689kB/s-2603kB/s), io=28.0MiB (29.4MB), run=3034-4256msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152756: Tue Sep 8 22:02:59 2026 read: IOPS=2, BW=2171KiB/s (2223kB/s)(7168KiB/3302msec) clat (usec): min=553, max=1278.3k, avg=296974.62, stdev=438339.13 lat (usec): min=554, max=1278.3k, avg=296976.15, stdev=438339.04 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 124257], 30.00th=[ 130548], 40.00th=[ 130548], | 50.00th=[ 147850], 60.00th=[ 160433], 70.00th=[ 160433], | 80.00th=[ 235930], 90.00th=[1283458], 95.00th=[1283458], | 99.00th=[1283458], 99.50th=[1283458], 99.90th=[1283458], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 2043, max= 5829, per=81.98%, avg=3931.67, stdev=1893.01, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1551KiB/s (1588kB/s)(5120KiB/3302msec); 0 zone resets clat (msec): min=64, max=420, avg=235.38, stdev=132.15 lat (msec): min=65, max=420, avg=235.48, stdev=132.16 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1943, max= 4087, per=40.08%, avg=2691.00, stdev=1210.00, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=18.39%, ctx=417, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152758: Tue Sep 8 22:02:59 2026 read: IOPS=0, BW=480KiB/s (491kB/s)(2048KiB/4270msec) clat (usec): min=166430, max=167513, avg=166972.10, stdev=765.61 lat (usec): min=166432, max=167514, avg=166973.23, stdev=765.29 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 167], 95.00th=[ 167], | 99.00th=[ 167], 99.50th=[ 167], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 1988, max= 2043, per=42.02%, avg=2015.50, stdev=38.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2398KiB/s (2456kB/s)(10.0MiB/4270msec); 0 zone resets clat (msec): min=64, max=1532, avg=369.26, stdev=439.16 lat (msec): min=64, max=1532, avg=369.34, stdev=439.16 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 81], | 30.00th=[ 120], 40.00th=[ 123], 50.00th=[ 186], 60.00th=[ 236], | 70.00th=[ 393], 80.00th=[ 426], 90.00th=[ 542], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 2027, max= 4071, per=42.46%, avg=2851.00, stdev=1113.72, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.98%, ctx=119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152759: Tue Sep 8 22:02:59 2026 read: IOPS=1, BW=1613KiB/s (1652kB/s)(6144KiB/3809msec) clat (usec): min=576, max=202078, avg=100565.43, stdev=85397.46 lat (usec): min=577, max=202079, avg=100566.59, stdev=85397.28 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 668], | 30.00th=[ 668], 40.00th=[ 89654], 50.00th=[ 89654], 60.00th=[147850], | 70.00th=[162530], 80.00th=[162530], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 1973, max= 6144, per=70.61%, avg=3386.67, stdev=2388.18, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1613KiB/s (1652kB/s)(6144KiB/3809msec); 0 zone resets clat (msec): min=174, max=1553, avg=495.80, stdev=530.86 lat (msec): min=174, max=1553, avg=496.36, stdev=530.59 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 355], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 1973, max= 2756, per=32.31%, avg=2169.40, stdev=329.27, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=12.29%, ctx=275, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152760: Tue Sep 8 22:02:59 2026 read: IOPS=1, BW=1419KiB/s (1454kB/s)(5120KiB/3607msec) clat (usec): min=455, max=198573, avg=99283.20, stdev=93702.01 lat (usec): min=468, max=198573, avg=99286.61, stdev=93698.81 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 457], | 30.00th=[ 685], 40.00th=[ 685], 50.00th=[126354], 60.00th=[126354], | 70.00th=[170918], 80.00th=[170918], 90.00th=[198181], 95.00th=[198181], | 99.00th=[198181], 99.50th=[198181], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1987KiB/s (2035kB/s)(7168KiB/3607msec); 0 zone resets clat (msec): min=114, max=1577, avg=414.05, stdev=535.78 lat (msec): min=114, max=1577, avg=414.11, stdev=535.78 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 171], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 542], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1389, max= 3946, per=36.63%, avg=2459.33, stdev=1328.37, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=58.33%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.62%, ctx=279, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4796KiB/s (4911kB/s), 480KiB/s-2171KiB/s (491kB/s-2223kB/s), io=20.0MiB (20.0MB), run=3302-4270msec WRITE: bw=6715KiB/s (6876kB/s), 1551KiB/s-2398KiB/s (1588kB/s-2456kB/s), io=28.0MiB (29.4MB), run=3302-4270msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152772: Tue Sep 8 22:03:08 2026 read: IOPS=1, BW=6759KiB/s (6921kB/s)(12.0MiB/1818msec) clat (msec): min=506, max=749, avg=596.14, stdev=133.19 lat (msec): min=506, max=749, avg=596.14, stdev=133.19 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=6.49%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152773: Tue Sep 8 22:03:08 2026 read: IOPS=0, BW=1428KiB/s (1462kB/s)(4096KiB/2869msec) clat (nsec): min=1259.8M, max=1259.8M, avg=1259787276.00, stdev= 0.00 lat (nsec): min=1259.8M, max=1259.8M, avg=1259789663.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2855KiB/s (2924kB/s)(8192KiB/2869msec); 0 zone resets clat (msec): min=767, max=796, avg=782.03, stdev=20.78 lat (msec): min=767, max=797, avg=782.42, stdev=20.71 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8126, max= 8126, per=71.15%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.45%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152774: Tue Sep 8 22:03:08 2026 write: IOPS=1, BW=4660KiB/s (4772kB/s)(12.0MiB/2637msec); 0 zone resets clat (msec): min=225, max=1481, avg=859.47, stdev=627.97 lat (msec): min=226, max=1481, avg=860.05, stdev=627.61 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8175, max= 8175, per=71.58%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.94%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152775: Tue Sep 8 22:03:08 2026 write: IOPS=1, BW=5447KiB/s (5578kB/s)(12.0MiB/2256msec); 0 zone resets clat (msec): min=315, max=1545, avg=739.03, stdev=699.04 lat (msec): min=315, max=1546, avg=739.58, stdev=699.01 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7656, max= 8175, per=69.31%, avg=7915.50, stdev=366.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=5.45%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5711KiB/s (5848kB/s), 1428KiB/s-6759KiB/s (1462kB/s-6921kB/s), io=16.0MiB (16.8MB), run=1818-2869msec WRITE: bw=11.2MiB/s (11.7MB/s), 2855KiB/s-5447KiB/s (2924kB/s-5578kB/s), io=32.0MiB (33.6MB), run=2256-2869msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152768: Tue Sep 8 22:03:08 2026 read: IOPS=1, BW=6505KiB/s (6661kB/s)(12.0MiB/1889msec) clat (msec): min=566, max=596, avg=584.93, stdev=16.14 lat (msec): min=566, max=596, avg=584.93, stdev=16.14 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=26.75%, ctx=612, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152769: Tue Sep 8 22:03:08 2026 read: IOPS=0, BW=1751KiB/s (1793kB/s)(4096KiB/2339msec) clat (nsec): min=580168k, max=580168k, avg=580168095.00, stdev= 0.00 lat (nsec): min=580169k, max=580169k, avg=580169276.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3502KiB/s (3586kB/s)(8192KiB/2339msec); 0 zone resets clat (msec): min=773, max=806, avg=790.24, stdev=23.31 lat (msec): min=774, max=806, avg=790.50, stdev=23.17 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8175, max= 8175, per=74.87%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.89%, ctx=244, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152770: Tue Sep 8 22:03:08 2026 write: IOPS=0, BW=4095KiB/s (4193kB/s)(12.0MiB/3001msec); 0 zone resets clat (msec): min=224, max=2037, avg=957.41, stdev=955.29 lat (msec): min=225, max=2038, avg=958.07, stdev=955.63 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8126, max= 8126, per=74.42%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.10%, sys=5.60%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152771: Tue Sep 8 22:03:08 2026 write: IOPS=1, BW=4901KiB/s (5019kB/s)(12.0MiB/2507msec); 0 zone resets clat (msec): min=489, max=1307, avg=813.36, stdev=434.66 lat (msec): min=489, max=1307, avg=813.77, stdev=434.58 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8126, max= 8175, per=74.65%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.38%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7005KiB/s (7173kB/s), 1751KiB/s-6505KiB/s (1793kB/s-6661kB/s), io=16.0MiB (16.8MB), run=1889-2339msec WRITE: bw=10.7MiB/s (11.2MB/s), 3502KiB/s-4901KiB/s (3586kB/s-5019kB/s), io=32.0MiB (33.6MB), run=2339-3001msec