== sanity test 398b: DIO and buffer IO race ============== 01:21:06 (1786944066) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.13313 s, 16.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154569: Mon Aug 17 01:22:17 2026 read: IOPS=25, BW=101KiB/s (103kB/s)(5992KiB/59437msec) clat (usec): min=27, max=699897, avg=19727.80, stdev=22270.41 lat (usec): min=27, max=699898, avg=19729.98, stdev=22270.81 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 115], 10.00th=[ 8291], 20.00th=[ 10945], | 30.00th=[ 12649], 40.00th=[ 14353], 50.00th=[ 16712], 60.00th=[ 19530], | 70.00th=[ 23200], 80.00th=[ 27132], 90.00th=[ 33817], 95.00th=[ 39584], | 99.00th=[ 63177], 99.50th=[ 90702], 99.90th=[256902], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 176, per=25.66%, avg=100.60, stdev=29.51, samples=118 iops : min= 1, max= 44, avg=24.71, stdev= 7.44, samples=118 write: IOPS=26, BW=106KiB/s (108kB/s)(6296KiB/59437msec); 0 zone resets clat (usec): min=895, max=225534, avg=18814.96, stdev=17913.48 lat (usec): min=896, max=225535, avg=18816.61, stdev=17913.66 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1778], 10.00th=[ 2409], 20.00th=[ 3654], | 30.00th=[ 6063], 40.00th=[ 11207], 50.00th=[ 15664], 60.00th=[ 19268], | 70.00th=[ 23725], 80.00th=[ 30540], 90.00th=[ 39584], 95.00th=[ 49546], | 99.00th=[ 77071], 99.50th=[ 87557], 99.90th=[185598], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 23, max= 182, per=25.93%, avg=106.59, stdev=34.05, samples=117 iops : min= 5, max= 45, avg=26.21, stdev= 8.52, samples=117 lat (usec) : 50=0.29%, 100=1.76%, 250=1.24%, 500=0.20%, 1000=0.07% lat (msec) : 2=3.39%, 4=7.78%, 10=12.04%, 20=35.12%, 50=34.83% lat (msec) : 100=2.90%, 250=0.33%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=16.54%, ctx=7990, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154571: Mon Aug 17 01:22:17 2026 read: IOPS=24, BW=99.1KiB/s (101kB/s)(5940KiB/59933msec) clat (usec): min=28, max=243288, avg=19265.79, stdev=14218.48 lat (usec): min=28, max=243289, avg=19266.88, stdev=14218.48 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 115], 10.00th=[ 8455], 20.00th=[ 10421], | 30.00th=[ 12125], 40.00th=[ 14091], 50.00th=[ 16450], 60.00th=[ 19268], | 70.00th=[ 23200], 80.00th=[ 27657], 90.00th=[ 32900], 95.00th=[ 38536], | 99.00th=[ 60556], 99.50th=[ 92799], 99.90th=[141558], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 189, per=25.25%, avg=98.97, stdev=31.22, samples=119 iops : min= 1, max= 47, avg=24.30, stdev= 7.84, samples=119 write: IOPS=26, BW=106KiB/s (108kB/s)(6348KiB/59933msec); 0 zone resets clat (usec): min=934, max=694442, avg=19573.40, stdev=25507.54 lat (usec): min=935, max=694443, avg=19575.03, stdev=25507.48 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1811], 10.00th=[ 2343], 20.00th=[ 3654], | 30.00th=[ 6063], 40.00th=[ 11338], 50.00th=[ 15533], 60.00th=[ 19792], | 70.00th=[ 23987], 80.00th=[ 30802], 90.00th=[ 40633], 95.00th=[ 51119], | 99.00th=[ 78119], 99.50th=[120062], 99.90th=[221250], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 40, max= 216, per=25.88%, avg=106.37, stdev=31.22, samples=118 iops : min= 10, max= 54, avg=26.16, stdev= 7.88, samples=118 lat (usec) : 50=0.42%, 100=1.69%, 250=1.01%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=3.16%, 4=8.40%, 10=13.15%, 20=33.40%, 50=34.90% lat (msec) : 100=3.19%, 250=0.49%, 750=0.03% cpu : usr=0.10%, sys=16.45%, ctx=7956, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154574: Mon Aug 17 01:22:17 2026 read: IOPS=24, BW=98.6KiB/s (101kB/s)(6028KiB/61163msec) clat (usec): min=21, max=260676, avg=19960.73, stdev=14934.24 lat (usec): min=21, max=260677, avg=19963.16, stdev=14934.00 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 105], 10.00th=[ 8356], 20.00th=[ 10945], | 30.00th=[ 12911], 40.00th=[ 14746], 50.00th=[ 17433], 60.00th=[ 20317], | 70.00th=[ 23987], 80.00th=[ 28967], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 60556], 99.50th=[ 78119], 99.90th=[233833], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 39, max= 191, per=25.27%, avg=99.05, stdev=29.35, samples=120 iops : min= 9, max= 47, avg=24.33, stdev= 7.31, samples=120 write: IOPS=25, BW=102KiB/s (105kB/s)(6260KiB/61163msec); 0 zone resets clat (usec): min=956, max=690305, avg=19689.55, stdev=24329.70 lat (usec): min=957, max=690306, avg=19691.10, stdev=24329.80 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2024], 10.00th=[ 2606], 20.00th=[ 4015], | 30.00th=[ 6587], 40.00th=[ 11994], 50.00th=[ 15664], 60.00th=[ 20055], | 70.00th=[ 25297], 80.00th=[ 31589], 90.00th=[ 40633], 95.00th=[ 48497], | 99.00th=[ 77071], 99.50th=[108528], 99.90th=[204473], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 199, per=24.80%, avg=101.94, stdev=29.45, samples=121 iops : min= 3, max= 49, avg=25.05, stdev= 7.36, samples=121 lat (usec) : 50=0.42%, 100=1.89%, 250=1.30%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=2.54%, 4=7.71%, 10=11.39%, 20=34.28%, 50=36.88% lat (msec) : 100=3.12%, 250=0.29%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=16.04%, ctx=8300, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154575: Mon Aug 17 01:22:17 2026 read: IOPS=24, BW=98.0KiB/s (101kB/s)(6052KiB/61145msec) clat (usec): min=31, max=237037, avg=19895.68, stdev=14174.36 lat (usec): min=33, max=237037, avg=19896.96, stdev=14174.33 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 110], 10.00th=[ 8029], 20.00th=[ 11207], | 30.00th=[ 13173], 40.00th=[ 15008], 50.00th=[ 17957], 60.00th=[ 20579], | 70.00th=[ 23725], 80.00th=[ 27657], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 57934], 99.50th=[ 85459], 99.90th=[173016], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 32, max= 176, per=25.54%, avg=100.11, stdev=26.67, samples=119 iops : min= 8, max= 44, avg=24.59, stdev= 6.68, samples=119 write: IOPS=25, BW=102KiB/s (104kB/s)(6236KiB/61145msec); 0 zone resets clat (usec): min=887, max=787116, avg=19751.92, stdev=26817.13 lat (usec): min=889, max=787118, avg=19754.18, stdev=26817.56 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1811], 10.00th=[ 2409], 20.00th=[ 3687], | 30.00th=[ 6390], 40.00th=[ 11469], 50.00th=[ 15533], 60.00th=[ 19792], | 70.00th=[ 25035], 80.00th=[ 31065], 90.00th=[ 39060], 95.00th=[ 50594], | 99.00th=[ 87557], 99.50th=[107480], 99.90th=[270533], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 8, max= 182, per=24.93%, avg=102.46, stdev=30.18, samples=120 iops : min= 2, max= 45, avg=25.18, stdev= 7.58, samples=120 lat (usec) : 50=0.42%, 100=1.63%, 250=1.37%, 500=0.16%, 1000=0.07% lat (msec) : 2=3.32%, 4=7.81%, 10=11.46%, 20=32.98%, 50=37.21% lat (msec) : 100=3.06%, 250=0.46%, 500=0.03%, 1000=0.03% cpu : usr=0.12%, sys=15.96%, ctx=8135, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=393KiB/s (402kB/s), 98.6KiB/s-101KiB/s (101kB/s-103kB/s), io=23.4MiB (24.6MB), run=59437-61163msec WRITE: bw=411KiB/s (421kB/s), 102KiB/s-106KiB/s (104kB/s-108kB/s), io=24.6MiB (25.7MB), run=59437-61163msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154570: Mon Aug 17 01:23:23 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5992KiB/126789msec) clat (msec): min=4, max=703, avg=20.31, stdev=23.06 lat (msec): min=4, max=703, avg=20.31, stdev=23.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 19], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 47], | 99.00th=[ 81], 99.50th=[ 97], 99.90th=[ 194], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 128, per=25.19%, avg=47.60, stdev=25.13, samples=248 iops : min= 1, max= 32, avg=11.48, stdev= 6.37, samples=248 write: IOPS=12, BW=49.7KiB/s (50.8kB/s)(6296KiB/126789msec); 0 zone resets clat (msec): min=22, max=280, avg=61.07, stdev=25.69 lat (msec): min=22, max=280, avg=61.07, stdev=25.69 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 36], 20.00th=[ 42], | 30.00th=[ 46], 40.00th=[ 51], 50.00th=[ 56], 60.00th=[ 62], | 70.00th=[ 68], 80.00th=[ 78], 90.00th=[ 91], 95.00th=[ 107], | 99.00th=[ 146], 99.50th=[ 163], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 96, per=24.92%, avg=49.35, stdev=16.95, samples=251 iops : min= 1, max= 24, avg=11.92, stdev= 4.32, samples=251 lat (msec) : 10=10.38%, 20=22.10%, 50=34.18%, 100=29.79%, 250=3.42% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.06%, sys=4.05%, ctx=6039, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154572: Mon Aug 17 01:23:23 2026 read: IOPS=11, BW=46.0KiB/s (48.1kB/s)(5940KiB/126453msec) clat (msec): min=4, max=720, avg=19.80, stdev=23.59 lat (msec): min=4, max=720, avg=19.81, stdev=23.59 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 20], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 46], | 99.00th=[ 78], 99.50th=[ 100], 99.90th=[ 218], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 144, per=24.84%, avg=46.96, stdev=25.80, samples=250 iops : min= 1, max= 36, avg=11.32, stdev= 6.52, samples=250 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6348KiB/126453msec); 0 zone resets clat (msec): min=22, max=239, avg=60.99, stdev=24.24 lat (msec): min=22, max=239, avg=60.99, stdev=24.24 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 37], 20.00th=[ 43], | 30.00th=[ 47], 40.00th=[ 51], 50.00th=[ 56], 60.00th=[ 62], | 70.00th=[ 68], 80.00th=[ 77], 90.00th=[ 92], 95.00th=[ 107], | 99.00th=[ 134], 99.50th=[ 182], 99.90th=[ 211], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 7, max= 96, per=25.25%, avg=49.99, stdev=16.50, samples=251 iops : min= 1, max= 24, avg=12.08, stdev= 4.22, samples=251 lat (msec) : 10=9.41%, 20=24.93%, 50=32.16%, 100=29.85%, 250=3.61% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=4.10%, ctx=6057, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154573: Mon Aug 17 01:23:23 2026 read: IOPS=11, BW=47.8KiB/s (48.0kB/s)(6028KiB/126045msec) clat (msec): min=4, max=193, avg=20.42, stdev=15.64 lat (msec): min=4, max=193, avg=20.42, stdev=15.64 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 51], | 99.00th=[ 83], 99.50th=[ 111], 99.90th=[ 131], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 7, max= 135, per=25.29%, avg=47.79, stdev=24.32, samples=249 iops : min= 1, max= 33, avg=11.53, stdev= 6.17, samples=249 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6260KiB/126045msec); 0 zone resets clat (msec): min=21, max=812, avg=60.72, stdev=31.05 lat (msec): min=21, max=812, avg=60.72, stdev=31.05 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 33], 10.00th=[ 36], 20.00th=[ 42], | 30.00th=[ 46], 40.00th=[ 51], 50.00th=[ 56], 60.00th=[ 62], | 70.00th=[ 68], 80.00th=[ 77], 90.00th=[ 89], 95.00th=[ 103], | 99.00th=[ 144], 99.50th=[ 180], 99.90th=[ 275], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 96, per=24.98%, avg=49.46, stdev=17.18, samples=250 iops : min= 1, max= 24, avg=11.94, stdev= 4.40, samples=250 lat (msec) : 10=9.34%, 20=23.50%, 50=33.53%, 100=30.24%, 250=3.29% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=4.05%, ctx=6020, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154576: Mon Aug 17 01:23:23 2026 read: IOPS=12, BW=48.1KiB/s (49.2kB/s)(6052KiB/125894msec) clat (msec): min=4, max=156, avg=19.43, stdev=14.26 lat (msec): min=4, max=156, avg=19.43, stdev=14.26 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 46], | 99.00th=[ 74], 99.50th=[ 100], 99.90th=[ 128], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 7, max= 127, per=25.55%, avg=48.29, stdev=24.78, samples=247 iops : min= 1, max= 31, avg=11.66, stdev= 6.25, samples=247 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6236KiB/125894msec); 0 zone resets clat (msec): min=22, max=776, avg=61.74, stdev=30.99 lat (msec): min=22, max=776, avg=61.74, stdev=30.99 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 42], | 30.00th=[ 47], 40.00th=[ 52], 50.00th=[ 56], 60.00th=[ 62], | 70.00th=[ 69], 80.00th=[ 79], 90.00th=[ 92], 95.00th=[ 107], | 99.00th=[ 142], 99.50th=[ 180], 99.90th=[ 284], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 96, per=24.92%, avg=49.34, stdev=16.58, samples=249 iops : min= 1, max= 24, avg=11.92, stdev= 4.26, samples=249 lat (msec) : 10=10.51%, 20=22.88%, 50=33.24%, 100=29.39%, 250=3.87% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=4.10%, ctx=6090, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=189KiB/s (194kB/s), 46.0KiB/s-48.1KiB/s (48.1kB/s-49.2kB/s), io=23.4MiB (24.6MB), run=125894-126789msec WRITE: bw=198KiB/s (203kB/s), 49.5KiB/s-50.2KiB/s (50.7kB/s-51.4kB/s), io=24.6MiB (25.7MB), run=125894-126789msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154614: Mon Aug 17 01:23:42 2026 read: IOPS=27, BW=440KiB/s (450kB/s)(5920KiB/13463msec) clat (usec): min=48, max=68087, avg=18444.37, stdev=12933.12 lat (usec): min=49, max=68088, avg=18445.32, stdev=12933.07 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 75], 10.00th=[ 100], 20.00th=[ 7635], | 30.00th=[13435], 40.00th=[15795], 50.00th=[17695], 60.00th=[20055], | 70.00th=[24249], 80.00th=[27395], 90.00th=[34866], 95.00th=[42730], | 99.00th=[54789], 99.50th=[62653], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 192, max= 608, per=25.12%, avg=431.12, stdev=107.74, samples=26 iops : min= 12, max= 38, avg=26.38, stdev= 6.72, samples=26 write: IOPS=29, BW=473KiB/s (484kB/s)(6368KiB/13463msec); 0 zone resets clat (usec): min=1155, max=88406, avg=16643.09, stdev=15738.84 lat (usec): min=1157, max=88408, avg=16645.37, stdev=15739.16 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2606], 10.00th=[ 3228], 20.00th=[ 4424], | 30.00th=[ 5473], 40.00th=[ 7373], 50.00th=[11731], 60.00th=[16450], | 70.00th=[20317], 80.00th=[27132], 90.00th=[39584], 95.00th=[49021], | 99.00th=[78119], 99.50th=[86508], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 159, max= 672, per=26.12%, avg=471.81, stdev=110.34, samples=26 iops : min= 9, max= 42, avg=28.92, stdev= 7.01, samples=26 lat (usec) : 50=0.39%, 100=4.56%, 250=4.04%, 500=0.26%, 1000=0.13% lat (msec) : 2=0.91%, 4=8.33%, 10=16.28%, 20=29.95%, 50=32.29% lat (msec) : 100=2.86% cpu : usr=0.11%, sys=21.33%, ctx=1938, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154615: Mon Aug 17 01:23:42 2026 read: IOPS=25, BW=412KiB/s (422kB/s)(5744KiB/13952msec) clat (usec): min=48, max=95698, avg=19043.29, stdev=12374.90 lat (usec): min=49, max=95699, avg=19044.47, stdev=12374.88 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 87], 10.00th=[ 108], 20.00th=[11076], | 30.00th=[13829], 40.00th=[15533], 50.00th=[18220], 60.00th=[20579], | 70.00th=[23987], 80.00th=[27919], 90.00th=[34341], 95.00th=[38536], | 99.00th=[62129], 99.50th=[63701], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 149, max= 736, per=24.10%, avg=413.48, stdev=124.08, samples=27 iops : min= 9, max= 46, avg=25.30, stdev= 7.81, samples=27 write: IOPS=29, BW=469KiB/s (480kB/s)(6544KiB/13952msec); 0 zone resets clat (usec): min=1541, max=109312, avg=17337.16, stdev=15854.20 lat (usec): min=1543, max=109315, avg=17339.11, stdev=15854.16 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2606], 10.00th=[ 3392], 20.00th=[ 4621], | 30.00th=[ 6259], 40.00th=[ 9110], 50.00th=[ 13435], 60.00th=[ 17171], | 70.00th=[ 21103], 80.00th=[ 27132], 90.00th=[ 38011], 95.00th=[ 46924], | 99.00th=[ 72877], 99.50th=[ 83362], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 315, max= 640, per=25.87%, avg=467.26, stdev=87.70, samples=27 iops : min= 19, max= 40, avg=28.67, stdev= 5.51, samples=27 lat (usec) : 50=0.26%, 100=3.26%, 250=2.73%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=7.68%, 10=14.97%, 20=32.42%, 50=35.03% lat (msec) : 100=2.34%, 250=0.26% cpu : usr=0.11%, sys=21.17%, ctx=2078, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154616: Mon Aug 17 01:23:42 2026 read: IOPS=28, BW=453KiB/s (464kB/s)(6256KiB/13815msec) clat (usec): min=37, max=71476, avg=17662.43, stdev=12779.58 lat (usec): min=38, max=71477, avg=17663.40, stdev=12779.59 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 68], 10.00th=[ 98], 20.00th=[ 225], | 30.00th=[12518], 40.00th=[14746], 50.00th=[17171], 60.00th=[19530], | 70.00th=[23462], 80.00th=[27919], 90.00th=[33162], 95.00th=[37487], | 99.00th=[56886], 99.50th=[67634], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 209, max= 827, per=26.36%, avg=452.30, stdev=121.08, samples=27 iops : min= 13, max= 51, avg=27.74, stdev= 7.49, samples=27 write: IOPS=27, BW=437KiB/s (447kB/s)(6032KiB/13815msec); 0 zone resets clat (usec): min=1104, max=131546, avg=18275.90, stdev=17191.83 lat (usec): min=1104, max=131548, avg=18277.82, stdev=17191.80 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2900], 10.00th=[ 3523], 20.00th=[ 4686], | 30.00th=[ 6521], 40.00th=[ 10421], 50.00th=[ 14222], 60.00th=[ 17695], | 70.00th=[ 23462], 80.00th=[ 28705], 90.00th=[ 37487], 95.00th=[ 47973], | 99.00th=[ 87557], 99.50th=[122160], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 222, max= 664, per=23.79%, avg=429.67, stdev=104.35, samples=27 iops : min= 13, max= 41, avg=26.30, stdev= 6.69, samples=27 lat (usec) : 50=0.65%, 100=5.08%, 250=4.69%, 500=0.26% lat (msec) : 2=1.30%, 4=5.86%, 10=12.89%, 20=32.68%, 50=33.85% lat (msec) : 100=2.34%, 250=0.39% cpu : usr=0.17%, sys=20.46%, ctx=2082, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154617: Mon Aug 17 01:23:42 2026 read: IOPS=27, BW=444KiB/s (454kB/s)(6032KiB/13594msec) clat (usec): min=43, max=114795, avg=19251.21, stdev=14262.32 lat (usec): min=44, max=114797, avg=19252.12, stdev=14262.36 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 85], 10.00th=[ 106], 20.00th=[ 9634], | 30.00th=[ 13173], 40.00th=[ 15664], 50.00th=[ 18220], 60.00th=[ 21103], | 70.00th=[ 24249], 80.00th=[ 28181], 90.00th=[ 34341], 95.00th=[ 41157], | 99.00th=[ 67634], 99.50th=[ 86508], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 254, max= 632, per=25.56%, avg=438.58, stdev=90.48, samples=26 iops : min= 15, max= 39, avg=26.85, stdev= 5.75, samples=26 write: IOPS=28, BW=460KiB/s (471kB/s)(6256KiB/13594msec); 0 zone resets clat (usec): min=1598, max=85940, avg=16158.04, stdev=14447.40 lat (usec): min=1601, max=85942, avg=16160.47, stdev=14447.91 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2376], 10.00th=[ 3261], 20.00th=[ 4490], | 30.00th=[ 5800], 40.00th=[ 8094], 50.00th=[11338], 60.00th=[15008], | 70.00th=[21103], 80.00th=[26084], 90.00th=[36439], 95.00th=[43779], | 99.00th=[65799], 99.50th=[80217], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 220, max= 664, per=25.35%, avg=457.88, stdev=107.00, samples=26 iops : min= 13, max= 41, avg=28.04, stdev= 6.71, samples=26 lat (usec) : 50=0.26%, 100=3.78%, 250=4.30%, 500=0.39% lat (msec) : 2=0.91%, 4=5.99%, 10=17.71%, 20=28.65%, 50=34.90% lat (msec) : 100=2.99%, 250=0.13% cpu : usr=0.18%, sys=21.36%, ctx=2108, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1717KiB/s (1758kB/s), 412KiB/s-453KiB/s (422kB/s-464kB/s), io=23.4MiB (24.5MB), run=13463-13952msec WRITE: bw=1806KiB/s (1850kB/s), 437KiB/s-473KiB/s (447kB/s-484kB/s), io=24.6MiB (25.8MB), run=13463-13952msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154609: Mon Aug 17 01:23:58 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5920KiB/28931msec) clat (msec): min=5, max=137, avg=19.05, stdev=16.15 lat (msec): min=5, max=137, avg=19.05, stdev=16.15 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 50], | 99.00th=[ 87], 99.50th=[ 110], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 415, per=25.09%, avg=202.70, stdev=89.73, samples=57 iops : min= 3, max= 25, avg=12.14, stdev= 5.58, samples=57 write: IOPS=13, BW=220KiB/s (225kB/s)(6368KiB/28931msec); 0 zone resets clat (msec): min=22, max=188, avg=54.80, stdev=23.28 lat (msec): min=22, max=188, avg=54.80, stdev=23.28 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 55], | 70.00th=[ 62], 80.00th=[ 69], 90.00th=[ 86], 95.00th=[ 101], | 99.00th=[ 138], 99.50th=[ 140], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 63, max= 415, per=25.81%, avg=219.35, stdev=86.03, samples=57 iops : min= 3, max= 25, avg=13.18, stdev= 5.43, samples=57 lat (msec) : 10=13.02%, 20=21.74%, 50=36.72%, 100=25.65%, 250=2.86% cpu : usr=0.07%, sys=5.27%, ctx=1611, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154610: Mon Aug 17 01:23:58 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(5744KiB/29624msec) clat (msec): min=4, max=127, avg=18.14, stdev=15.66 lat (msec): min=4, max=127, avg=18.14, stdev=15.66 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 87], 99.50th=[ 96], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 53, max= 446, per=23.91%, avg=193.22, stdev=107.04, samples=58 iops : min= 3, max= 27, avg=11.55, stdev= 6.77, samples=58 write: IOPS=13, BW=221KiB/s (226kB/s)(6544KiB/29624msec); 0 zone resets clat (msec): min=21, max=180, avg=56.39, stdev=25.46 lat (msec): min=21, max=180, avg=56.40, stdev=25.46 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 50], 60.00th=[ 56], | 70.00th=[ 64], 80.00th=[ 73], 90.00th=[ 90], 95.00th=[ 110], | 99.00th=[ 140], 99.50th=[ 167], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 95, max= 384, per=25.72%, avg=218.64, stdev=79.96, samples=58 iops : min= 5, max= 24, avg=13.14, stdev= 5.07, samples=58 lat (msec) : 10=16.41%, 20=18.62%, 50=36.59%, 100=24.74%, 250=3.65% cpu : usr=0.07%, sys=5.02%, ctx=1542, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154611: Mon Aug 17 01:23:58 2026 read: IOPS=14, BW=224KiB/s (229kB/s)(6256KiB/27928msec) clat (msec): min=4, max=135, avg=18.48, stdev=16.06 lat (msec): min=4, max=135, avg=18.48, stdev=16.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 57], | 99.00th=[ 83], 99.50th=[ 88], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 31, max= 574, per=27.91%, avg=225.53, stdev=125.44, samples=55 iops : min= 1, max= 35, avg=13.56, stdev= 7.91, samples=55 write: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27928msec); 0 zone resets clat (msec): min=23, max=152, avg=54.69, stdev=23.85 lat (msec): min=23, max=152, avg=54.70, stdev=23.85 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 56], | 70.00th=[ 62], 80.00th=[ 71], 90.00th=[ 86], 95.00th=[ 106], | 99.00th=[ 136], 99.50th=[ 144], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 31, max= 416, per=25.31%, avg=215.15, stdev=85.01, samples=55 iops : min= 1, max= 26, avg=12.91, stdev= 5.40, samples=55 lat (msec) : 10=18.62%, 20=18.62%, 50=35.16%, 100=24.61%, 250=2.99% cpu : usr=0.09%, sys=5.40%, ctx=1585, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154612: Mon Aug 17 01:23:58 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29083msec) clat (msec): min=4, max=120, avg=19.42, stdev=17.80 lat (msec): min=4, max=120, avg=19.42, stdev=17.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 41], 95.00th=[ 63], | 99.00th=[ 91], 99.50th=[ 117], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 31, max= 448, per=25.48%, avg=205.91, stdev=103.53, samples=57 iops : min= 1, max= 28, avg=12.33, stdev= 6.56, samples=57 write: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29083msec); 0 zone resets clat (msec): min=20, max=174, avg=55.43, stdev=23.10 lat (msec): min=20, max=174, avg=55.43, stdev=23.10 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 50], 60.00th=[ 57], | 70.00th=[ 63], 80.00th=[ 73], 90.00th=[ 86], 95.00th=[ 102], | 99.00th=[ 133], 99.50th=[ 150], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 63, max= 352, per=25.20%, avg=214.19, stdev=83.40, samples=57 iops : min= 3, max= 22, avg=12.84, stdev= 5.27, samples=57 lat (msec) : 10=16.15%, 20=18.88%, 50=36.59%, 100=25.39%, 250=2.99% cpu : usr=0.07%, sys=5.05%, ctx=1544, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=809KiB/s (828kB/s), 194KiB/s-224KiB/s (199kB/s-229kB/s), io=23.4MiB (24.5MB), run=27928-29624msec WRITE: bw=851KiB/s (871kB/s), 215KiB/s-221KiB/s (220kB/s-226kB/s), io=24.6MiB (25.8MB), run=27928-29624msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154627: Mon Aug 17 01:24:08 2026 read: IOPS=1, BW=1554KiB/s (1592kB/s)(7168KiB/4612msec) clat (msec): min=76, max=1833, avg=430.91, stdev=625.68 lat (msec): min=76, max=1833, avg=430.95, stdev=625.66 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 109], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 245], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 338], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1774, max= 4087, per=56.17%, avg=2365.40, stdev=968.70, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1110KiB/s (1137kB/s)(5120KiB/4612msec); 0 zone resets clat (msec): min=185, max=598, avg=315.65, stdev=175.34 lat (msec): min=185, max=598, avg=315.71, stdev=175.33 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1892, max= 2043, per=33.97%, avg=2002.25, stdev=73.72, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=28.63%, ctx=1128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154628: Mon Aug 17 01:24:08 2026 read: IOPS=0, BW=421KiB/s (431kB/s)(2048KiB/4863msec) clat (msec): min=188, max=242, avg=215.57, stdev=37.78 lat (msec): min=188, max=242, avg=215.57, stdev=37.78 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1790, max= 2031, per=45.37%, avg=1910.50, stdev=170.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2106KiB/s (2156kB/s)(10.0MiB/4863msec); 0 zone resets clat (msec): min=136, max=1885, avg=434.20, stdev=547.15 lat (msec): min=136, max=1885, avg=434.30, stdev=547.14 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 169], | 30.00th=[ 178], 40.00th=[ 199], 50.00th=[ 205], 60.00th=[ 209], | 70.00th=[ 236], 80.00th=[ 309], 90.00th=[ 818], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 2031, max= 5896, per=67.00%, avg=3949.75, stdev=1582.77, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 250=75.00%, 500=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=28.65%, ctx=206, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154629: Mon Aug 17 01:24:08 2026 read: IOPS=1, BW=1590KiB/s (1628kB/s)(6144KiB/3864msec) clat (usec): min=562, max=203837, avg=82945.38, stdev=94590.29 lat (usec): min=563, max=203838, avg=82946.42, stdev=94590.14 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 652], | 30.00th=[ 652], 40.00th=[ 930], 50.00th=[ 930], 60.00th=[114820], | 70.00th=[177210], 80.00th=[177210], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 4087, max= 6131, per=100.00%, avg=5109.00, stdev=1445.33, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1590KiB/s (1628kB/s)(6144KiB/3864msec); 0 zone resets clat (msec): min=129, max=2169, avg=547.33, stdev=803.89 lat (msec): min=129, max=2169, avg=547.38, stdev=803.90 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 215], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1892, max= 3574, per=40.51%, avg=2388.00, stdev=793.86, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=58.33%, 500=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=23.22%, ctx=276, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154630: Mon Aug 17 01:24:08 2026 read: IOPS=1, BW=1249KiB/s (1279kB/s)(5120KiB/4100msec) clat (msec): min=94, max=351, avg=169.08, stdev=107.80 lat (msec): min=94, max=351, avg=169.08, stdev=107.80 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 113], 60.00th=[ 113], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2043, max= 6131, per=97.06%, avg=4087.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1748KiB/s (1790kB/s)(7168KiB/4100msec); 0 zone resets clat (msec): min=161, max=1997, avg=458.82, stdev=680.32 lat (msec): min=161, max=1997, avg=458.91, stdev=680.34 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 186], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 284], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 1787, max= 3785, per=40.96%, avg=2414.50, stdev=921.60, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=26.20%, ctx=484, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4211KiB/s (4312kB/s), 421KiB/s-1590KiB/s (431kB/s-1628kB/s), io=20.0MiB (20.0MB), run=3864-4863msec WRITE: bw=5896KiB/s (6037kB/s), 1110KiB/s-2106KiB/s (1137kB/s-2156kB/s), io=28.0MiB (29.4MB), run=3864-4863msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154632: Mon Aug 17 01:24:08 2026 read: IOPS=1, BW=1346KiB/s (1378kB/s)(7168KiB/5325msec) clat (msec): min=37, max=1717, avg=595.64, stdev=695.75 lat (msec): min=37, max=1717, avg=595.65, stdev=695.75 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 45], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 266], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 1452], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1932, max= 4015, per=65.04%, avg=2501.50, stdev=1010.16, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=962KiB/s (985kB/s)(5120KiB/5325msec); 0 zone resets clat (msec): min=63, max=604, avg=186.64, stdev=234.43 lat (msec): min=63, max=604, avg=186.71, stdev=234.42 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 84], 60.00th=[ 84], | 70.00th=[ 115], 80.00th=[ 115], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2039, max= 4015, per=56.22%, avg=3027.00, stdev=1397.24, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=16.67%, 100=25.00%, 250=16.67%, 500=16.67%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.02%, sys=4.28%, ctx=88, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154633: Mon Aug 17 01:24:08 2026 read: IOPS=0, BW=398KiB/s (407kB/s)(2048KiB/5149msec) clat (msec): min=208, max=218, avg=213.54, stdev= 7.15 lat (msec): min=208, max=218, avg=213.54, stdev= 7.15 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1787, max= 2039, per=49.74%, avg=1913.00, stdev=178.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1989KiB/s (2036kB/s)(10.0MiB/5149msec); 0 zone resets clat (msec): min=94, max=2298, avg=460.32, stdev=672.75 lat (msec): min=94, max=2298, avg=460.42, stdev=672.74 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 102], | 30.00th=[ 131], 40.00th=[ 150], 50.00th=[ 180], 60.00th=[ 247], | 70.00th=[ 284], 80.00th=[ 401], 90.00th=[ 718], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1932, max= 6023, per=67.21%, avg=3618.40, stdev=1696.25, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.37%, ctx=148, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154634: Mon Aug 17 01:24:08 2026 read: IOPS=1, BW=1231KiB/s (1260kB/s)(6144KiB/4993msec) clat (msec): min=51, max=613, avg=207.15, stdev=222.00 lat (msec): min=51, max=613, avg=207.15, stdev=222.00 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 73], 50.00th=[ 73], 60.00th=[ 120], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1932, max= 4079, per=69.53%, avg=2674.00, stdev=1217.41, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1231KiB/s (1260kB/s)(6144KiB/4993msec); 0 zone resets clat (msec): min=64, max=2772, avg=604.59, stdev=1067.05 lat (msec): min=64, max=2772, avg=604.65, stdev=1067.05 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 236], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1932, max= 3670, per=47.13%, avg=2537.67, stdev=981.42, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=41.67%, 250=25.00%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.21%, ctx=81, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154635: Mon Aug 17 01:24:08 2026 read: IOPS=1, BW=1038KiB/s (1063kB/s)(5120KiB/4934msec) clat (msec): min=62, max=335, avg=162.82, stdev=130.57 lat (msec): min=62, max=335, avg=162.82, stdev=130.57 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 81], 60.00th=[ 81], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 4023, max= 4079, per=100.00%, avg=4051.00, stdev=39.60, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1453KiB/s (1488kB/s)(7168KiB/4934msec); 0 zone resets clat (msec): min=87, max=2681, avg=557.91, stdev=939.69 lat (msec): min=87, max=2681, avg=557.98, stdev=939.69 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 146], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 220], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 321], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1828, max= 3864, per=45.24%, avg=2435.50, stdev=956.92, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.80%, ctx=447, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3846KiB/s (3938kB/s), 398KiB/s-1346KiB/s (407kB/s-1378kB/s), io=20.0MiB (20.0MB), run=4934-5325msec WRITE: bw=5384KiB/s (5514kB/s), 962KiB/s-1989KiB/s (985kB/s-2036kB/s), io=28.0MiB (29.4MB), run=4934-5325msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154641: Mon Aug 17 01:24:16 2026 read: IOPS=1, BW=6635KiB/s (6794kB/s)(12.0MiB/1852msec) clat (msec): min=211, max=916, avg=597.82, stdev=357.01 lat (msec): min=211, max=916, avg=597.82, stdev=357.01 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7876, max= 7876, per=89.03%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=9.99%, ctx=74, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154642: Mon Aug 17 01:24:16 2026 read: IOPS=0, BW=2643KiB/s (2706kB/s)(4096KiB/1550msec) clat (nsec): min=116082k, max=116082k, avg=116081788.00, stdev= 0.00 lat (nsec): min=116084k, max=116084k, avg=116083946.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 116], | 70.00th=[ 116], 80.00th=[ 116], 90.00th=[ 116], 95.00th=[ 116], | 99.00th=[ 116], 99.50th=[ 116], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 7447, max= 7447, per=84.18%, avg=7447.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5285KiB/s (5412kB/s)(8192KiB/1550msec); 0 zone resets clat (msec): min=477, max=940, avg=709.32, stdev=327.22 lat (msec): min=479, max=941, avg=710.22, stdev=326.47 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7876, max= 7876, per=40.50%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.62%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154643: Mon Aug 17 01:24:16 2026 write: IOPS=1, BW=7293KiB/s (7468kB/s)(12.0MiB/1685msec); 0 zone resets clat (msec): min=254, max=912, avg=549.56, stdev=334.44 lat (msec): min=254, max=912, avg=549.95, stdev=334.41 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7953, max= 8159, per=41.43%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=12.05%, ctx=76, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154644: Mon Aug 17 01:24:16 2026 write: IOPS=2, BW=10.5MiB/s (11.0MB/s)(12.0MiB/1139msec); 0 zone resets clat (msec): min=207, max=572, avg=361.43, stdev=189.05 lat (msec): min=208, max=572, avg=361.92, stdev=188.86 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7876, max= 8078, per=41.02%, avg=7977.00, stdev=142.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=16.08%, ctx=69, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8847KiB/s (9059kB/s), 2643KiB/s-6635KiB/s (2706kB/s-6794kB/s), io=16.0MiB (16.8MB), run=1550-1852msec WRITE: bw=18.0MiB/s (19.9MB/s), 5285KiB/s-10.5MiB/s (5412kB/s-11.0MB/s), io=32.0MiB (33.6MB), run=1139-1685msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154646: Mon Aug 17 01:24:17 2026 read: IOPS=1, BW=7685KiB/s (7869kB/s)(12.0MiB/1599msec) clat (msec): min=456, max=603, avg=512.22, stdev=79.97 lat (msec): min=456, max=603, avg=512.22, stdev=79.97 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 5557, max= 8175, per=90.24%, avg=6866.00, stdev=1851.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=36.61%, ctx=995, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154647: Mon Aug 17 01:24:17 2026 read: IOPS=0, BW=1902KiB/s (1948kB/s)(4096KiB/2153msec) clat (nsec): min=491447k, max=491447k, avg=491446605.00, stdev= 0.00 lat (nsec): min=491449k, max=491449k, avg=491449472.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 5512, max= 5512, per=72.44%, avg=5512.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3805KiB/s (3896kB/s)(8192KiB/2153msec); 0 zone resets clat (msec): min=436, max=1190, avg=813.71, stdev=532.79 lat (msec): min=437, max=1190, avg=814.11, stdev=532.81 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8175, max= 8175, per=55.51%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=12.78%, ctx=354, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154648: Mon Aug 17 01:24:17 2026 write: IOPS=1, BW=5523KiB/s (5655kB/s)(12.0MiB/2225msec); 0 zone resets clat (msec): min=232, max=1143, avg=732.32, stdev=461.83 lat (msec): min=232, max=1143, avg=732.66, stdev=461.69 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7984, max= 8192, per=54.92%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.35%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154649: Mon Aug 17 01:24:17 2026 write: IOPS=1, BW=6298KiB/s (6449kB/s)(12.0MiB/1951msec); 0 zone resets clat (msec): min=165, max=1029, avg=641.20, stdev=438.38 lat (msec): min=166, max=1029, avg=641.52, stdev=438.41 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8175, max= 8175, per=55.51%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.64%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7610KiB/s (7792kB/s), 1902KiB/s-7685KiB/s (1948kB/s-7869kB/s), io=16.0MiB (16.8MB), run=1599-2153msec WRITE: bw=14.4MiB/s (15.1MB/s), 3805KiB/s-6298KiB/s (3896kB/s-6449kB/s), io=32.0MiB (33.6MB), run=1951-2225msec