== sanity test 398b: DIO and buffer IO race ============== 01:05:16 (1762495516) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.66024 s, 10.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182100: Fri Nov 7 01:07:00 2025 read: IOPS=16, BW=67.6KiB/s (69.2kB/s)(5992KiB/88642msec) clat (usec): min=95, max=748452, avg=32961.53, stdev=27507.40 lat (usec): min=95, max=748454, avg=32964.54, stdev=27507.96 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 5014], 10.00th=[ 13304], 20.00th=[ 17433], | 30.00th=[ 20841], 40.00th=[ 24773], 50.00th=[ 29230], 60.00th=[ 33817], | 70.00th=[ 38536], 80.00th=[ 45351], 90.00th=[ 56361], 95.00th=[ 66847], | 99.00th=[105382], 99.50th=[123208], 99.90th=[206570], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 24, max= 119, per=25.28%, avg=67.74, stdev=19.93, samples=174 iops : min= 6, max= 29, avg=16.34, stdev= 5.01, samples=174 write: IOPS=17, BW=71.0KiB/s (72.7kB/s)(6296KiB/88642msec); 0 zone resets clat (usec): min=811, max=223809, avg=24667.98, stdev=24310.34 lat (usec): min=812, max=223811, avg=24671.81, stdev=24308.30 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1106], 10.00th=[ 1205], 20.00th=[ 2343], | 30.00th=[ 5866], 40.00th=[ 13435], 50.00th=[ 20055], 60.00th=[ 25560], | 70.00th=[ 31327], 80.00th=[ 42206], 90.00th=[ 56361], 95.00th=[ 69731], | 99.00th=[ 98042], 99.50th=[123208], 99.90th=[191890], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 159, per=25.43%, avg=71.21, stdev=23.98, samples=174 iops : min= 1, max= 39, avg=17.21, stdev= 6.00, samples=174 lat (usec) : 100=0.03%, 250=1.79%, 500=0.33%, 750=0.03%, 1000=0.59% lat (msec) : 2=8.98%, 4=3.74%, 10=5.79%, 20=17.94%, 50=45.80% lat (msec) : 100=13.90%, 250=1.04%, 750=0.03% cpu : usr=0.09%, sys=7.59%, ctx=6569, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182102: Fri Nov 7 01:07:00 2025 read: IOPS=16, BW=67.4KiB/s (69.0kB/s)(5940KiB/88135msec) clat (usec): min=103, max=263151, avg=31830.08, stdev=20672.61 lat (usec): min=104, max=263152, avg=31831.16, stdev=20672.65 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 8225], 10.00th=[ 13304], 20.00th=[ 17433], | 30.00th=[ 20841], 40.00th=[ 24511], 50.00th=[ 28181], 60.00th=[ 32113], | 70.00th=[ 37487], 80.00th=[ 43779], 90.00th=[ 54264], 95.00th=[ 64226], | 99.00th=[108528], 99.50th=[126354], 99.90th=[173016], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 5, max= 119, per=25.02%, avg=67.05, stdev=20.91, samples=174 iops : min= 1, max= 29, avg=16.17, stdev= 5.23, samples=174 write: IOPS=18, BW=72.0KiB/s (73.8kB/s)(6348KiB/88135msec); 0 zone resets clat (usec): min=844, max=720261, avg=25531.19, stdev=30580.17 lat (usec): min=845, max=720263, avg=25532.93, stdev=30579.92 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1106], 10.00th=[ 1188], 20.00th=[ 1844], | 30.00th=[ 5014], 40.00th=[ 11600], 50.00th=[ 19006], 60.00th=[ 25035], | 70.00th=[ 34341], 80.00th=[ 45351], 90.00th=[ 60031], 95.00th=[ 72877], | 99.00th=[106431], 99.50th=[124257], 99.90th=[156238], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 15, max= 165, per=25.75%, avg=72.09, stdev=26.76, samples=173 iops : min= 3, max= 41, avg=17.45, stdev= 6.76, samples=173 lat (usec) : 250=1.76%, 500=0.20%, 750=0.07%, 1000=0.78% lat (msec) : 2=10.06%, 4=3.58%, 10=5.60%, 20=18.29%, 50=45.02% lat (msec) : 100=13.41%, 250=1.17%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=7.26%, ctx=6367, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182103: Fri Nov 7 01:07:00 2025 read: IOPS=16, BW=67.7KiB/s (69.3kB/s)(6028KiB/89028msec) clat (usec): min=106, max=746378, avg=32477.68, stdev=26338.07 lat (usec): min=106, max=746379, avg=32479.96, stdev=26336.75 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 8160], 10.00th=[ 13042], 20.00th=[ 17433], | 30.00th=[ 21103], 40.00th=[ 24511], 50.00th=[ 28705], 60.00th=[ 33162], | 70.00th=[ 38536], 80.00th=[ 45876], 90.00th=[ 54789], 95.00th=[ 66323], | 99.00th=[ 94897], 99.50th=[102237], 99.90th=[158335], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 5, max= 150, per=25.06%, avg=67.15, stdev=23.64, samples=175 iops : min= 1, max= 37, avg=16.21, stdev= 5.95, samples=175 write: IOPS=17, BW=70.3KiB/s (72.0kB/s)(6260KiB/89028msec); 0 zone resets clat (usec): min=837, max=233843, avg=25392.24, stdev=25341.26 lat (usec): min=837, max=233845, avg=25398.85, stdev=25337.36 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1106], 10.00th=[ 1221], 20.00th=[ 2311], | 30.00th=[ 5407], 40.00th=[ 12780], 50.00th=[ 19530], 60.00th=[ 25822], | 70.00th=[ 34341], 80.00th=[ 43779], 90.00th=[ 58459], 95.00th=[ 73925], | 99.00th=[105382], 99.50th=[122160], 99.90th=[173016], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 16, max= 151, per=24.87%, avg=69.62, stdev=24.19, samples=175 iops : min= 4, max= 37, avg=16.83, stdev= 6.09, samples=175 lat (usec) : 250=2.02%, 500=0.29%, 750=0.03%, 1000=0.62% lat (msec) : 2=8.72%, 4=3.78%, 10=6.61%, 20=16.86%, 50=46.13% lat (msec) : 100=13.87%, 250=1.04%, 750=0.03% cpu : usr=0.09%, sys=7.38%, ctx=6603, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182106: Fri Nov 7 01:07:00 2025 read: IOPS=16, BW=67.6KiB/s (69.2kB/s)(6052KiB/89533msec) clat (usec): min=119, max=223160, avg=32484.35, stdev=21224.31 lat (usec): min=120, max=223161, avg=32485.45, stdev=21224.32 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 2573], 10.00th=[ 13304], 20.00th=[ 17433], | 30.00th=[ 20579], 40.00th=[ 24511], 50.00th=[ 28443], 60.00th=[ 33162], | 70.00th=[ 39060], 80.00th=[ 45876], 90.00th=[ 56361], 95.00th=[ 68682], | 99.00th=[107480], 99.50th=[133694], 99.90th=[168821], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 15, max= 134, per=25.10%, avg=67.27, stdev=21.77, samples=175 iops : min= 3, max= 33, avg=16.23, stdev= 5.49, samples=175 write: IOPS=17, BW=69.6KiB/s (71.3kB/s)(6236KiB/89533msec); 0 zone resets clat (usec): min=894, max=737954, avg=25680.86, stdev=30610.38 lat (usec): min=895, max=737957, avg=25682.28, stdev=30610.40 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1090], 10.00th=[ 1205], 20.00th=[ 2212], | 30.00th=[ 5669], 40.00th=[ 13304], 50.00th=[ 19792], 60.00th=[ 26346], | 70.00th=[ 32900], 80.00th=[ 42206], 90.00th=[ 57410], 95.00th=[ 74974], | 99.00th=[105382], 99.50th=[124257], 99.90th=[158335], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 5, max= 151, per=24.68%, avg=69.10, stdev=24.72, samples=176 iops : min= 1, max= 37, avg=16.68, stdev= 6.21, samples=176 lat (usec) : 250=1.79%, 500=0.42%, 750=0.10%, 1000=0.59% lat (msec) : 2=9.18%, 4=3.16%, 10=6.32%, 20=18.10%, 50=45.31% lat (msec) : 100=13.61%, 250=1.40%, 750=0.03% cpu : usr=0.10%, sys=7.56%, ctx=6554, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=268KiB/s (275kB/s), 67.4KiB/s-67.7KiB/s (69.0kB/s-69.3kB/s), io=23.4MiB (24.6MB), run=88135-89533msec WRITE: bw=281KiB/s (288kB/s), 69.6KiB/s-72.0KiB/s (71.3kB/s-73.8kB/s), io=24.6MiB (25.7MB), run=88135-89533msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182099: Fri Nov 7 01:07:33 2025 read: IOPS=12, BW=49.2KiB/s (50.3kB/s)(5992KiB/121881msec) clat (msec): min=4, max=756, avg=31.52, stdev=32.81 lat (msec): min=4, max=756, avg=31.52, stdev=32.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 69], 95.00th=[ 89], | 99.00th=[ 133], 99.50th=[ 161], 99.90th=[ 209], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 174, per=25.00%, avg=48.99, stdev=31.79, samples=239 iops : min= 1, max= 43, avg=11.60, stdev= 8.00, samples=239 write: IOPS=12, BW=51.7KiB/s (52.9kB/s)(6296KiB/121881msec); 0 zone resets clat (msec): min=8, max=310, avg=47.22, stdev=31.22 lat (msec): min=8, max=310, avg=47.22, stdev=31.22 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 87], 95.00th=[ 106], | 99.00th=[ 159], 99.50th=[ 182], 99.90th=[ 268], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 138, per=24.98%, avg=51.47, stdev=29.82, samples=239 iops : min= 1, max= 34, avg=12.22, stdev= 7.52, samples=239 lat (msec) : 10=5.57%, 20=23.05%, 50=45.08%, 100=21.52%, 250=4.69% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=2.51%, ctx=5007, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182101: Fri Nov 7 01:07:33 2025 read: IOPS=12, BW=48.7KiB/s (49.9kB/s)(5940KiB/121931msec) clat (msec): min=5, max=644, avg=30.87, stdev=31.99 lat (msec): min=5, max=644, avg=30.87, stdev=31.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 91], | 99.00th=[ 134], 99.50th=[ 165], 99.90th=[ 226], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 166, per=25.02%, avg=49.04, stdev=32.52, samples=237 iops : min= 1, max= 41, avg=11.61, stdev= 8.17, samples=237 write: IOPS=13, BW=52.1KiB/s (53.3kB/s)(6348KiB/121931msec); 0 zone resets clat (msec): min=7, max=308, avg=47.73, stdev=32.75 lat (msec): min=7, max=308, avg=47.73, stdev=32.75 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 90], 95.00th=[ 108], | 99.00th=[ 165], 99.50th=[ 207], 99.90th=[ 284], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 151, per=25.16%, avg=51.83, stdev=31.61, samples=239 iops : min= 1, max= 37, avg=12.31, stdev= 7.95, samples=239 lat (msec) : 10=6.41%, 20=24.19%, 50=42.51%, 100=21.71%, 250=5.05% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.07%, sys=2.43%, ctx=4896, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182104: Fri Nov 7 01:07:33 2025 read: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6028KiB/120529msec) clat (msec): min=4, max=277, avg=30.98, stdev=28.00 lat (msec): min=4, max=277, avg=30.98, stdev=28.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 66], 95.00th=[ 90], | 99.00th=[ 134], 99.50th=[ 165], 99.90th=[ 234], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 182, per=25.68%, avg=50.33, stdev=31.06, samples=234 iops : min= 1, max= 45, avg=11.94, stdev= 7.83, samples=234 write: IOPS=12, BW=51.9KiB/s (53.2kB/s)(6260KiB/120529msec); 0 zone resets clat (msec): min=8, max=670, avg=46.98, stdev=33.73 lat (msec): min=8, max=670, avg=46.99, stdev=33.73 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 68], 90.00th=[ 86], 95.00th=[ 104], | 99.00th=[ 150], 99.50th=[ 184], 99.90th=[ 253], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 143, per=25.05%, avg=51.59, stdev=30.99, samples=237 iops : min= 1, max= 35, avg=12.25, stdev= 7.80, samples=237 lat (msec) : 10=5.18%, 20=24.45%, 50=43.88%, 100=21.97%, 250=4.43% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=2.37%, ctx=4799, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182105: Fri Nov 7 01:07:33 2025 read: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6052KiB/120888msec) clat (msec): min=4, max=227, avg=30.32, stdev=26.33 lat (msec): min=4, max=227, avg=30.32, stdev=26.33 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 65], 95.00th=[ 84], | 99.00th=[ 140], 99.50th=[ 159], 99.90th=[ 190], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 167, per=25.59%, avg=50.15, stdev=32.38, samples=236 iops : min= 1, max= 41, avg=11.89, stdev= 8.15, samples=236 write: IOPS=12, BW=51.6KiB/s (52.8kB/s)(6236KiB/120888msec); 0 zone resets clat (msec): min=7, max=705, avg=47.90, stdev=35.96 lat (msec): min=7, max=705, avg=47.91, stdev=35.96 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 68], 90.00th=[ 87], 95.00th=[ 107], | 99.00th=[ 157], 99.50th=[ 209], 99.90th=[ 284], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 151, per=24.86%, avg=51.22, stdev=29.61, samples=238 iops : min= 1, max= 37, avg=12.15, stdev= 7.46, samples=238 lat (msec) : 10=6.15%, 20=23.08%, 50=44.82%, 100=21.65%, 250=4.10% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.07%, sys=2.52%, ctx=4823, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=197KiB/s (202kB/s), 48.7KiB/s-50.1KiB/s (49.9kB/s-51.3kB/s), io=23.4MiB (24.6MB), run=120529-121931msec WRITE: bw=206KiB/s (211kB/s), 51.6KiB/s-52.1KiB/s (52.8kB/s-53.3kB/s), io=24.6MiB (25.7MB), run=120529-121931msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182148: Fri Nov 7 01:08:10 2025 read: IOPS=13, BW=216KiB/s (221kB/s)(5920KiB/27402msec) clat (usec): min=106, max=190591, avg=38787.19, stdev=27117.58 lat (usec): min=106, max=190592, avg=38788.32, stdev=27117.61 clat percentiles (usec): | 1.00th=[ 124], 5.00th=[ 161], 10.00th=[ 2606], 20.00th=[ 20317], | 30.00th=[ 25035], 40.00th=[ 29492], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 45876], 80.00th=[ 55837], 90.00th=[ 69731], 95.00th=[ 92799], | 99.00th=[132645], 99.50th=[135267], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 94, max= 349, per=25.56%, avg=216.74, stdev=61.29, samples=53 iops : min= 5, max= 21, avg=12.85, stdev= 3.85, samples=53 write: IOPS=14, BW=232KiB/s (238kB/s)(6368KiB/27402msec); 0 zone resets clat (usec): min=1243, max=180045, avg=31962.60, stdev=31452.78 lat (usec): min=1246, max=180047, avg=31968.71, stdev=31454.57 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1565], 10.00th=[ 1696], 20.00th=[ 3195], | 30.00th=[ 9634], 40.00th=[ 16909], 50.00th=[ 23200], 60.00th=[ 28967], | 70.00th=[ 42206], 80.00th=[ 56361], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[131597], 99.50th=[145753], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 62, max= 411, per=26.23%, avg=233.96, stdev=86.93, samples=53 iops : min= 3, max= 25, avg=13.96, stdev= 5.40, samples=53 lat (usec) : 250=4.30%, 500=0.13%, 750=0.13% lat (msec) : 2=8.72%, 4=2.73%, 10=4.95%, 20=11.72%, 50=42.19% lat (msec) : 100=20.83%, 250=4.30% cpu : usr=0.05%, sys=6.51%, ctx=1640, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182149: Fri Nov 7 01:08:10 2025 read: IOPS=12, BW=203KiB/s (208kB/s)(5744KiB/28242msec) clat (usec): min=92, max=167788, avg=41126.55, stdev=27803.50 lat (usec): min=92, max=167789, avg=41127.66, stdev=27803.50 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 172], 10.00th=[ 14091], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 73925], 95.00th=[100140], | 99.00th=[132645], 99.50th=[135267], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 351, per=24.08%, avg=204.20, stdev=77.50, samples=54 iops : min= 1, max= 21, avg=12.06, stdev= 4.83, samples=54 write: IOPS=14, BW=232KiB/s (237kB/s)(6544KiB/28242msec); 0 zone resets clat (usec): min=1292, max=197439, avg=32223.29, stdev=32464.64 lat (usec): min=1295, max=197442, avg=32304.99, stdev=32828.56 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1631], 10.00th=[ 1729], 20.00th=[ 3851], | 30.00th=[ 9634], 40.00th=[ 15401], 50.00th=[ 22414], 60.00th=[ 32375], | 70.00th=[ 42206], 80.00th=[ 55313], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[160433], 99.50th=[164627], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 480, per=25.71%, avg=229.31, stdev=93.63, samples=54 iops : min= 1, max= 30, avg=13.61, stdev= 5.89, samples=54 lat (usec) : 100=0.13%, 250=2.99% lat (msec) : 2=8.72%, 4=2.08%, 10=5.99%, 20=14.19%, 50=40.36% lat (msec) : 100=21.22%, 250=4.30% cpu : usr=0.08%, sys=6.45%, ctx=1732, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182150: Fri Nov 7 01:08:10 2025 read: IOPS=14, BW=227KiB/s (232kB/s)(6256KiB/27613msec) clat (usec): min=122, max=209109, avg=39286.83, stdev=27980.50 lat (usec): min=122, max=209111, avg=39288.07, stdev=27980.54 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 157], 10.00th=[ 5866], 20.00th=[ 21103], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 48497], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 90702], | 99.00th=[143655], 99.50th=[170918], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 63, max= 444, per=26.82%, avg=227.42, stdev=90.67, samples=53 iops : min= 3, max= 27, avg=13.55, stdev= 5.68, samples=53 write: IOPS=13, BW=218KiB/s (224kB/s)(6032KiB/27613msec); 0 zone resets clat (usec): min=1280, max=170039, avg=31844.24, stdev=29913.72 lat (usec): min=1281, max=170042, avg=31851.47, stdev=29920.60 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1565], 10.00th=[ 1680], 20.00th=[ 3392], | 30.00th=[ 9110], 40.00th=[ 19006], 50.00th=[ 26084], 60.00th=[ 32113], | 70.00th=[ 42730], 80.00th=[ 53216], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[119014], 99.50th=[166724], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 447, per=24.21%, avg=215.94, stdev=94.47, samples=53 iops : min= 1, max= 27, avg=12.79, stdev= 5.94, samples=53 lat (usec) : 250=4.43%, 500=0.13%, 750=0.13% lat (msec) : 2=8.59%, 4=2.08%, 10=5.47%, 20=9.90%, 50=43.36% lat (msec) : 100=22.53%, 250=3.39% cpu : usr=0.09%, sys=6.35%, ctx=1662, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182151: Fri Nov 7 01:08:10 2025 read: IOPS=14, BW=227KiB/s (232kB/s)(6032KiB/26571msec) clat (usec): min=117, max=191503, avg=38840.87, stdev=27152.86 lat (usec): min=117, max=191503, avg=38842.02, stdev=27152.83 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 161], 10.00th=[ 424], 20.00th=[ 19006], | 30.00th=[ 24511], 40.00th=[ 30016], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 56886], 90.00th=[ 70779], 95.00th=[ 82314], | 99.00th=[126354], 99.50th=[189793], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 56, max= 405, per=26.59%, avg=225.51, stdev=84.61, samples=51 iops : min= 3, max= 25, avg=13.45, stdev= 5.33, samples=51 write: IOPS=14, BW=235KiB/s (241kB/s)(6256KiB/26571msec); 0 zone resets clat (usec): min=1256, max=199412, avg=30140.10, stdev=31534.93 lat (usec): min=1259, max=199414, avg=30143.30, stdev=31534.16 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1598], 10.00th=[ 1713], 20.00th=[ 4490], | 30.00th=[ 8717], 40.00th=[ 13829], 50.00th=[ 19530], 60.00th=[ 26608], | 70.00th=[ 34866], 80.00th=[ 52167], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[129500], 99.50th=[158335], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 89, max= 479, per=26.17%, avg=233.41, stdev=101.31, samples=51 iops : min= 5, max= 29, avg=13.90, stdev= 6.32, samples=51 lat (usec) : 250=4.56%, 500=0.39%, 1000=0.13% lat (msec) : 2=8.07%, 4=2.21%, 10=7.42%, 20=13.80%, 50=38.28% lat (msec) : 100=21.48%, 250=3.65% cpu : usr=0.07%, sys=6.42%, ctx=1599, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=848KiB/s (868kB/s), 203KiB/s-227KiB/s (208kB/s-232kB/s), io=23.4MiB (24.5MB), run=26571-28242msec WRITE: bw=892KiB/s (914kB/s), 218KiB/s-235KiB/s (224kB/s-241kB/s), io=24.6MiB (25.8MB), run=26571-28242msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182144: Fri Nov 7 01:08:18 2025 read: IOPS=10, BW=166KiB/s (170kB/s)(5920KiB/35707msec) clat (msec): min=6, max=160, avg=36.03, stdev=31.66 lat (msec): min=6, max=160, avg=36.04, stdev=31.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 30], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 86], 95.00th=[ 106], | 99.00th=[ 150], 99.50th=[ 159], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 31, max= 574, per=25.23%, avg=166.01, stdev=108.84, samples=70 iops : min= 1, max= 35, avg= 9.61, stdev= 6.88, samples=70 write: IOPS=11, BW=178KiB/s (183kB/s)(6368KiB/35707msec); 0 zone resets clat (msec): min=9, max=266, avg=56.08, stdev=38.22 lat (msec): min=9, max=266, avg=56.08, stdev=38.22 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 82], 90.00th=[ 105], 95.00th=[ 136], | 99.00th=[ 205], 99.50th=[ 215], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 29, max= 447, per=25.79%, avg=178.46, stdev=103.76, samples=70 iops : min= 1, max= 27, avg=10.40, stdev= 6.54, samples=70 lat (msec) : 10=3.12%, 20=22.53%, 50=41.54%, 100=23.57%, 250=9.11% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=1.99%, ctx=1183, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182145: Fri Nov 7 01:08:18 2025 read: IOPS=9, BW=158KiB/s (162kB/s)(5744KiB/36295msec) clat (msec): min=6, max=198, avg=36.78, stdev=32.88 lat (msec): min=6, max=198, avg=36.78, stdev=32.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 59], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 159], 99.50th=[ 167], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 30, max= 479, per=23.98%, avg=157.82, stdev=110.13, samples=71 iops : min= 1, max= 29, avg= 9.08, stdev= 6.94, samples=71 write: IOPS=11, BW=180KiB/s (185kB/s)(6544KiB/36295msec); 0 zone resets clat (msec): min=12, max=199, avg=55.93, stdev=37.03 lat (msec): min=12, max=199, avg=55.93, stdev=37.03 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 108], 95.00th=[ 134], | 99.00th=[ 182], 99.50th=[ 184], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 510, per=26.04%, avg=180.17, stdev=111.53, samples=71 iops : min= 1, max= 31, avg=10.49, stdev= 7.02, samples=71 lat (msec) : 10=3.39%, 20=19.27%, 50=43.23%, 100=24.35%, 250=9.77% cpu : usr=0.06%, sys=1.99%, ctx=1191, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182146: Fri Nov 7 01:08:18 2025 read: IOPS=10, BW=173KiB/s (177kB/s)(6256KiB/36138msec) clat (msec): min=7, max=208, avg=36.57, stdev=31.10 lat (msec): min=7, max=208, avg=36.57, stdev=31.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 84], 95.00th=[ 105], | 99.00th=[ 144], 99.50th=[ 150], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 540, per=26.26%, avg=172.80, stdev=126.68, samples=70 iops : min= 1, max= 33, avg=10.04, stdev= 8.00, samples=70 write: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36138msec); 0 zone resets clat (msec): min=11, max=276, avg=57.26, stdev=40.14 lat (msec): min=11, max=276, avg=57.26, stdev=40.14 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 87], 90.00th=[ 112], 95.00th=[ 144], | 99.00th=[ 190], 99.50th=[ 241], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 510, per=23.76%, avg=164.39, stdev=99.57, samples=70 iops : min= 1, max= 31, avg= 9.51, stdev= 6.30, samples=70 lat (msec) : 10=2.34%, 20=21.61%, 50=42.58%, 100=23.96%, 250=9.38% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.01%, ctx=1205, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182147: Fri Nov 7 01:08:18 2025 read: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36370msec) clat (msec): min=6, max=221, avg=37.76, stdev=34.07 lat (msec): min=6, max=221, avg=37.76, stdev=34.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 40], 80.00th=[ 58], 90.00th=[ 88], 95.00th=[ 111], | 99.00th=[ 176], 99.50th=[ 190], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 27, max= 448, per=24.97%, avg=164.30, stdev=109.98, samples=71 iops : min= 1, max= 28, avg= 9.51, stdev= 6.96, samples=71 write: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36370msec); 0 zone resets clat (msec): min=12, max=239, avg=56.23, stdev=38.66 lat (msec): min=12, max=239, avg=56.24, stdev=38.66 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 134], | 99.00th=[ 190], 99.50th=[ 207], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 62, max= 505, per=24.74%, avg=171.17, stdev=105.95, samples=71 iops : min= 3, max= 31, avg= 9.94, stdev= 6.66, samples=71 lat (msec) : 10=3.39%, 20=17.71%, 50=45.83%, 100=23.57%, 250=9.51% cpu : usr=0.05%, sys=1.87%, ctx=1195, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=659KiB/s (674kB/s), 158KiB/s-173KiB/s (162kB/s-177kB/s), io=23.4MiB (24.5MB), run=35707-36370msec WRITE: bw=693KiB/s (710kB/s), 167KiB/s-180KiB/s (171kB/s-185kB/s), io=24.6MiB (25.8MB), run=35707-36370msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182166: Fri Nov 7 01:08:29 2025 read: IOPS=2, BW=2344KiB/s (2400kB/s)(7168KiB/3058msec) clat (usec): min=683, max=247642, avg=165685.13, stdev=80188.64 lat (usec): min=684, max=247644, avg=165686.75, stdev=80189.00 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[147850], | 30.00th=[166724], 40.00th=[166724], 50.00th=[179307], 60.00th=[189793], | 70.00th=[189793], 80.00th=[225444], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 1988, max= 4938, per=52.91%, avg=2991.33, stdev=1686.13, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1674KiB/s (1714kB/s)(5120KiB/3058msec); 0 zone resets clat (msec): min=138, max=917, avg=378.16, stdev=312.58 lat (msec): min=138, max=917, avg=378.23, stdev=312.56 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 2031, max= 2048, per=25.80%, avg=2042.33, stdev= 9.81, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=16.67%, 1000=8.33% cpu : usr=0.03%, sys=21.98%, ctx=311, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182167: Fri Nov 7 01:08:29 2025 read: IOPS=0, BW=565KiB/s (579kB/s)(2048KiB/3622msec) clat (msec): min=25, max=233, avg=129.66, stdev=146.77 lat (msec): min=25, max=233, avg=129.66, stdev=146.77 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 26], 10.00th=[ 26], 20.00th=[ 26], | 30.00th=[ 26], 40.00th=[ 26], 50.00th=[ 26], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 1580, max= 2031, per=31.93%, avg=1805.50, stdev=318.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2827KiB/s (2895kB/s)(10.0MiB/3622msec); 0 zone resets clat (msec): min=166, max=548, avg=336.03, stdev=140.35 lat (msec): min=166, max=548, avg=336.10, stdev=140.34 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 213], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 266], 60.00th=[ 342], | 70.00th=[ 414], 80.00th=[ 468], 90.00th=[ 510], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2031, max= 4096, per=35.83%, avg=2836.40, stdev=1095.92, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 50=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=24.14%, ctx=138, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182168: Fri Nov 7 01:08:29 2025 read: IOPS=2, BW=2511KiB/s (2571kB/s)(6144KiB/2447msec) clat (usec): min=780, max=235863, avg=77989.97, stdev=94978.48 lat (usec): min=781, max=235865, avg=77991.33, stdev=94978.68 clat percentiles (usec): | 1.00th=[ 783], 5.00th=[ 783], 10.00th=[ 783], 20.00th=[ 1369], | 30.00th=[ 1369], 40.00th=[ 2474], 50.00th=[ 2474], 60.00th=[107480], | 70.00th=[120062], 80.00th=[120062], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 3976, max= 6095, per=89.06%, avg=5035.50, stdev=1498.36, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2511KiB/s (2571kB/s)(6144KiB/2447msec); 0 zone resets clat (msec): min=173, max=610, avg=329.01, stdev=180.09 lat (msec): min=173, max=610, avg=329.14, stdev=180.05 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 347], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2048, max= 4063, per=39.25%, avg=3107.00, stdev=1011.44, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=24.53%, ctx=195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182169: Fri Nov 7 01:08:29 2025 read: IOPS=1, BW=1777KiB/s (1820kB/s)(5120KiB/2881msec) clat (usec): min=742, max=412408, avg=160117.85, stdev=177997.95 lat (usec): min=744, max=412410, avg=160119.15, stdev=177998.01 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 742], | 30.00th=[ 783], 40.00th=[ 783], 50.00th=[122160], 60.00th=[122160], | 70.00th=[265290], 80.00th=[265290], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 4063, max= 4096, per=72.15%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2488KiB/s (2548kB/s)(7168KiB/2881msec); 0 zone resets clat (msec): min=168, max=489, avg=296.84, stdev=110.99 lat (msec): min=168, max=489, avg=296.93, stdev=111.01 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 288], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 347], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1703, max= 4096, per=37.53%, avg=2970.75, stdev=1304.53, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=58.33% cpu : usr=0.00%, sys=24.62%, ctx=155, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5654KiB/s (5790kB/s), 565KiB/s-2511KiB/s (579kB/s-2571kB/s), io=20.0MiB (20.0MB), run=2447-3622msec WRITE: bw=7916KiB/s (8106kB/s), 1674KiB/s-2827KiB/s (1714kB/s-2895kB/s), io=28.0MiB (29.4MB), run=2447-3622msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182161: Fri Nov 7 01:08:30 2025 read: IOPS=2, BW=2351KiB/s (2407kB/s)(7168KiB/3049msec) clat (msec): min=118, max=575, avg=218.75, stdev=162.62 lat (msec): min=118, max=575, avg=218.76, stdev=162.62 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 123], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 169], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 239], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2039, max= 4023, per=62.37%, avg=3270.67, stdev=1075.35, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1679KiB/s (1720kB/s)(5120KiB/3049msec); 0 zone resets clat (msec): min=80, max=772, avg=288.63, stdev=287.67 lat (msec): min=80, max=772, avg=288.72, stdev=287.68 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2011, max= 5965, per=54.32%, avg=3988.00, stdev=2795.90, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=8.14%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182162: Fri Nov 7 01:08:30 2025 read: IOPS=0, BW=552KiB/s (566kB/s)(2048KiB/3707msec) clat (msec): min=93, max=118, avg=105.95, stdev=17.70 lat (msec): min=93, max=118, avg=105.95, stdev=17.70 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 94], 60.00th=[ 118], | 70.00th=[ 118], 80.00th=[ 118], 90.00th=[ 118], 95.00th=[ 118], | 99.00th=[ 118], 99.50th=[ 118], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 1939, max= 1980, per=37.37%, avg=1959.50, stdev=28.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2762KiB/s (2829kB/s)(10.0MiB/3707msec); 0 zone resets clat (msec): min=113, max=733, avg=344.29, stdev=241.65 lat (msec): min=113, max=734, avg=344.39, stdev=241.64 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 146], | 30.00th=[ 148], 40.00th=[ 157], 50.00th=[ 220], 60.00th=[ 275], | 70.00th=[ 363], 80.00th=[ 600], 90.00th=[ 693], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1980, max= 4023, per=40.52%, avg=2974.83, stdev=1082.07, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=25.00% cpu : usr=0.05%, sys=11.04%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182163: Fri Nov 7 01:08:30 2025 read: IOPS=1, BW=1573KiB/s (1611kB/s)(6144KiB/3905msec) clat (msec): min=112, max=791, avg=330.59, stdev=244.92 lat (msec): min=112, max=791, avg=330.60, stdev=244.92 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 313], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1992, max= 3992, per=63.22%, avg=3315.00, stdev=1145.86, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1573KiB/s (1611kB/s)(6144KiB/3905msec); 0 zone resets clat (msec): min=142, max=637, avg=309.29, stdev=194.82 lat (msec): min=142, max=637, avg=309.39, stdev=194.84 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 243], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1992, max= 3778, per=33.29%, avg=2444.25, stdev=889.20, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=6.35%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182164: Fri Nov 7 01:08:30 2025 read: IOPS=1, BW=2024KiB/s (2072kB/s)(5120KiB/2530msec) clat (msec): min=99, max=524, avg=212.35, stdev=176.94 lat (msec): min=99, max=524, avg=212.35, stdev=176.94 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1980, max= 6119, per=77.22%, avg=4049.50, stdev=2926.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2833KiB/s (2901kB/s)(7168KiB/2530msec); 0 zone resets clat (msec): min=95, max=411, avg=205.11, stdev=120.13 lat (msec): min=95, max=411, avg=205.21, stdev=120.15 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 108], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 136], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 305], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1980, max= 5657, per=43.80%, avg=3216.00, stdev=2114.02, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=8.94%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5245KiB/s (5370kB/s), 552KiB/s-2351KiB/s (566kB/s-2407kB/s), io=20.0MiB (20.0MB), run=2530-3905msec WRITE: bw=7342KiB/s (7519kB/s), 1573KiB/s-2833KiB/s (1611kB/s-2901kB/s), io=28.0MiB (29.4MB), run=2530-3905msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182180: Fri Nov 7 01:08:42 2025 read: IOPS=1, BW=5616KiB/s (5751kB/s)(12.0MiB/2188msec) clat (msec): min=641, max=774, avg=700.96, stdev=67.58 lat (msec): min=641, max=774, avg=700.96, stdev=67.58 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=12.39%, ctx=715, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182181: Fri Nov 7 01:08:42 2025 read: IOPS=0, BW=1837KiB/s (1881kB/s)(4096KiB/2230msec) clat (nsec): min=716314k, max=716314k, avg=716314161.00, stdev= 0.00 lat (nsec): min=716317k, max=716317k, avg=716317173.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3674KiB/s (3762kB/s)(8192KiB/2230msec); 0 zone resets clat (msec): min=613, max=895, avg=754.58, stdev=199.16 lat (msec): min=614, max=895, avg=755.00, stdev=199.17 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8126, max= 8126, per=64.11%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=9.15%, ctx=234, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182182: Fri Nov 7 01:08:42 2025 write: IOPS=1, BW=4754KiB/s (4868kB/s)(12.0MiB/2585msec); 0 zone resets clat (msec): min=186, max=1527, avg=859.96, stdev=670.82 lat (msec): min=186, max=1528, avg=860.30, stdev=670.87 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8126, max= 8126, per=64.11%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=5.30%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182183: Fri Nov 7 01:08:42 2025 write: IOPS=1, BW=4989KiB/s (5109kB/s)(12.0MiB/2463msec); 0 zone resets clat (msec): min=492, max=1449, avg=819.12, stdev=546.16 lat (msec): min=493, max=1453, avg=820.76, stdev=548.34 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 6481, max= 8175, per=57.81%, avg=7328.00, stdev=1197.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.12%, sys=5.81%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7347KiB/s (7523kB/s), 1837KiB/s-5616KiB/s (1881kB/s-5751kB/s), io=16.0MiB (16.8MB), run=2188-2230msec WRITE: bw=12.4MiB/s (12.0MB/s), 3674KiB/s-4989KiB/s (3762kB/s-5109kB/s), io=32.0MiB (33.6MB), run=2230-2585msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182175: Fri Nov 7 01:08:42 2025 read: IOPS=1, BW=4384KiB/s (4489kB/s)(12.0MiB/2803msec) clat (msec): min=731, max=1141, avg=883.13, stdev=225.06 lat (msec): min=731, max=1141, avg=883.13, stdev=225.06 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=5.14%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182177: Fri Nov 7 01:08:42 2025 read: IOPS=0, BW=1282KiB/s (1312kB/s)(4096KiB/3196msec) clat (nsec): min=1529.7M, max=1529.7M, avg=1529659439.00, stdev= 0.00 lat (nsec): min=1529.7M, max=1529.7M, avg=1529660738.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1536], 5.00th=[ 1536], 10.00th=[ 1536], 20.00th=[ 1536], | 30.00th=[ 1536], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2563KiB/s (2625kB/s)(8192KiB/3196msec); 0 zone resets clat (msec): min=275, max=1214, avg=745.25, stdev=664.10 lat (msec): min=275, max=1215, avg=745.53, stdev=664.15 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=5.29%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182178: Fri Nov 7 01:08:42 2025 write: IOPS=1, BW=7241KiB/s (7415kB/s)(12.0MiB/1697msec); 0 zone resets clat (msec): min=433, max=636, avg=537.38, stdev=101.66 lat (msec): min=434, max=637, avg=537.62, stdev=101.58 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 6234, max= 8094, per=69.88%, avg=7164.00, stdev=1315.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=9.43%, ctx=102, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182179: Fri Nov 7 01:08:42 2025 write: IOPS=1, BW=4415KiB/s (4521kB/s)(12.0MiB/2783msec); 0 zone resets clat (msec): min=255, max=2064, avg=866.99, stdev=1037.50 lat (msec): min=255, max=2065, avg=867.83, stdev=1037.05 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 5970, max= 8094, per=68.59%, avg=7032.00, stdev=1501.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.04%, sys=6.25%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5126KiB/s (5249kB/s), 1282KiB/s-4384KiB/s (1312kB/s-4489kB/s), io=16.0MiB (16.8MB), run=2803-3196msec WRITE: bw=10.0MiB/s (10.5MB/s), 2563KiB/s-7241KiB/s (2625kB/s-7415kB/s), io=32.0MiB (33.6MB), run=1697-3196msec