== sanity test 398b: DIO and buffer IO race ============== 06:27:49 (1768303669) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.04973 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146086: Tue Jan 13 06:30:05 2026 read: IOPS=12, BW=51.7KiB/s (52.9kB/s)(5992KiB/116008msec) clat (usec): min=107, max=630175, avg=37863.05, stdev=32999.77 lat (usec): min=107, max=630176, avg=37864.38, stdev=32999.81 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 165], 10.00th=[ 247], 20.00th=[ 16909], | 30.00th=[ 21627], 40.00th=[ 27132], 50.00th=[ 32637], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[152044], 99.90th=[438305], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 136, per=24.89%, avg=51.26, stdev=21.93, samples=228 iops : min= 1, max= 34, avg=12.17, stdev= 5.52, samples=228 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6296KiB/116008msec); 0 zone resets clat (usec): min=726, max=298081, avg=37584.64, stdev=38836.61 lat (usec): min=726, max=298083, avg=37588.49, stdev=38836.22 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1385], 20.00th=[ 4178], | 30.00th=[ 8717], 40.00th=[ 17695], 50.00th=[ 27395], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 65799], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[164627], 99.50th=[225444], 99.90th=[291505], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 164, per=24.95%, avg=53.88, stdev=23.03, samples=228 iops : min= 1, max= 41, avg=12.83, stdev= 5.81, samples=228 lat (usec) : 250=4.88%, 500=0.52%, 750=0.16%, 1000=0.39% lat (msec) : 2=7.00%, 4=3.19%, 10=7.03%, 20=11.23%, 50=37.40% lat (msec) : 100=23.54%, 250=4.49%, 500=0.13%, 750=0.03% cpu : usr=0.10%, sys=5.48%, ctx=6335, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146087: Tue Jan 13 06:30:05 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(5940KiB/115391msec) clat (usec): min=95, max=803445, avg=38512.71, stdev=38342.45 lat (usec): min=95, max=803446, avg=38514.04, stdev=38342.53 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 169], 10.00th=[ 1500], 20.00th=[ 17695], | 30.00th=[ 22676], 40.00th=[ 27657], 50.00th=[ 32113], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 56361], 90.00th=[ 70779], 95.00th=[ 84411], | 99.00th=[130548], 99.50th=[183501], 99.90th=[591397], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 6, max= 116, per=24.85%, avg=51.19, stdev=21.95, samples=227 iops : min= 1, max= 29, avg=12.15, stdev= 5.52, samples=227 write: IOPS=13, BW=55.0KiB/s (56.3kB/s)(6348KiB/115391msec); 0 zone resets clat (usec): min=928, max=298406, avg=36576.66, stdev=37735.28 lat (usec): min=930, max=298406, avg=36592.14, stdev=37731.20 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 3425], | 30.00th=[ 7439], 40.00th=[ 15139], 50.00th=[ 26084], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 65274], 90.00th=[ 87557], 95.00th=[106431], | 99.00th=[160433], 99.50th=[185598], 99.90th=[250610], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 183, per=25.48%, avg=55.03, stdev=23.65, samples=226 iops : min= 1, max= 45, avg=13.12, stdev= 5.98, samples=226 lat (usec) : 100=0.10%, 250=4.13%, 500=0.36%, 750=0.10%, 1000=0.13% lat (msec) : 2=7.75%, 4=3.78%, 10=7.10%, 20=11.13%, 50=37.76% lat (msec) : 100=23.18%, 250=4.30%, 500=0.13%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.40%, ctx=6231, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146088: Tue Jan 13 06:30:05 2026 read: IOPS=13, BW=52.5KiB/s (53.7kB/s)(6028KiB/114848msec) clat (usec): min=107, max=343883, avg=37314.26, stdev=30543.57 lat (usec): min=107, max=343884, avg=37319.94, stdev=30544.98 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 176], 10.00th=[ 1909], 20.00th=[ 17695], | 30.00th=[ 22414], 40.00th=[ 27395], 50.00th=[ 31851], 60.00th=[ 36963], | 70.00th=[ 44827], 80.00th=[ 54264], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[152044], 99.50th=[193987], 99.90th=[337642], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 112, per=25.36%, avg=52.24, stdev=22.61, samples=226 iops : min= 1, max= 28, avg=12.41, stdev= 5.70, samples=226 write: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6260KiB/114848msec); 0 zone resets clat (usec): min=851, max=698773, avg=37343.20, stdev=41760.25 lat (usec): min=853, max=698775, avg=37347.75, stdev=41758.99 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3228], | 30.00th=[ 7898], 40.00th=[ 16581], 50.00th=[ 27132], 60.00th=[ 36439], | 70.00th=[ 46924], 80.00th=[ 65274], 90.00th=[ 88605], 95.00th=[113771], | 99.00th=[170918], 99.50th=[187696], 99.90th=[225444], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 119, per=25.12%, avg=54.26, stdev=22.62, samples=226 iops : min= 1, max= 29, avg=12.92, stdev= 5.72, samples=226 lat (usec) : 250=4.00%, 500=0.36%, 750=0.10%, 1000=0.39% lat (msec) : 2=8.30%, 4=3.45%, 10=6.09%, 20=11.20%, 50=39.88% lat (msec) : 100=21.29%, 250=4.79%, 500=0.13%, 750=0.03% cpu : usr=0.09%, sys=5.37%, ctx=6266, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146089: Tue Jan 13 06:30:05 2026 read: IOPS=13, BW=52.9KiB/s (54.2kB/s)(6052KiB/114406msec) clat (usec): min=102, max=460198, avg=37254.22, stdev=30740.34 lat (usec): min=102, max=460199, avg=37259.66, stdev=30741.70 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 174], 10.00th=[ 453], 20.00th=[ 17957], | 30.00th=[ 22938], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[111674], 99.50th=[128451], 99.90th=[379585], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 7, max= 119, per=25.56%, avg=52.66, stdev=20.93, samples=225 iops : min= 1, max= 29, avg=12.52, stdev= 5.28, samples=225 write: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6236KiB/114406msec); 0 zone resets clat (usec): min=741, max=738579, avg=37125.34, stdev=43112.06 lat (usec): min=742, max=738581, avg=37128.51, stdev=43113.19 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1352], 20.00th=[ 3228], | 30.00th=[ 7046], 40.00th=[ 14877], 50.00th=[ 25035], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 63177], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[179307], 99.50th=[193987], 99.90th=[387974], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 151, per=25.25%, avg=54.54, stdev=22.61, samples=224 iops : min= 1, max= 37, avg=12.98, stdev= 5.70, samples=224 lat (usec) : 250=4.30%, 500=0.72%, 750=0.33%, 1000=0.42% lat (msec) : 2=7.26%, 4=4.10%, 10=6.61%, 20=10.84%, 50=38.64% lat (msec) : 100=21.58%, 250=5.01%, 500=0.16%, 750=0.03% cpu : usr=0.09%, sys=5.29%, ctx=6210, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=207KiB/s (212kB/s), 51.5KiB/s-52.9KiB/s (52.7kB/s-54.2kB/s), io=23.4MiB (24.6MB), run=114406-116008msec WRITE: bw=217KiB/s (222kB/s), 54.3KiB/s-55.0KiB/s (55.6kB/s-56.3kB/s), io=24.6MiB (25.7MB), run=114406-116008msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146081: Tue Jan 13 06:32:59 2026 read: IOPS=5, BW=20.7KiB/s (21.1kB/s)(5992KiB/290109msec) clat (msec): min=5, max=712, avg=39.26, stdev=37.21 lat (msec): min=5, max=712, avg=39.26, stdev=37.21 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 60], 90.00th=[ 80], 95.00th=[ 104], | 99.00th=[ 161], 99.50th=[ 199], 99.90th=[ 363], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 87, per=28.16%, avg=23.09, stdev=15.77, samples=499 iops : min= 1, max= 21, avg= 5.13, stdev= 3.99, samples=499 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6296KiB/290109msec); 0 zone resets clat (msec): min=36, max=819, avg=146.68, stdev=67.62 lat (msec): min=36, max=819, avg=146.68, stdev=67.62 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 133], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 234], 95.00th=[ 271], | 99.00th=[ 363], 99.50th=[ 435], 99.90th=[ 542], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 56, per=24.85%, avg=21.37, stdev= 9.68, samples=565 iops : min= 1, max= 14, avg= 4.71, stdev= 2.46, samples=565 lat (msec) : 10=2.73%, 20=14.29%, 50=18.88%, 100=22.88%, 250=37.30% lat (msec) : 500=3.74%, 750=0.13%, 1000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5641, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146082: Tue Jan 13 06:32:59 2026 read: IOPS=5, BW=20.5KiB/s (20.0kB/s)(5940KiB/289731msec) clat (msec): min=6, max=712, avg=38.58, stdev=38.48 lat (msec): min=6, max=712, avg=38.59, stdev=38.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 77], 95.00th=[ 99], | 99.00th=[ 176], 99.50th=[ 207], 99.90th=[ 510], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 79, per=28.46%, avg=23.34, stdev=15.38, samples=490 iops : min= 1, max= 19, avg= 5.21, stdev= 3.88, samples=490 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6348KiB/289731msec); 0 zone resets clat (msec): min=40, max=438, avg=146.20, stdev=64.28 lat (msec): min=40, max=438, avg=146.21, stdev=64.28 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 134], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 234], 95.00th=[ 275], | 99.00th=[ 347], 99.50th=[ 384], 99.90th=[ 418], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 55, per=25.03%, avg=21.53, stdev= 9.29, samples=566 iops : min= 1, max= 13, avg= 4.75, stdev= 2.39, samples=566 lat (msec) : 10=2.86%, 20=14.23%, 50=19.27%, 100=23.11%, 250=36.65% lat (msec) : 500=3.81%, 750=0.07% cpu : usr=0.04%, sys=1.22%, ctx=5589, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146083: Tue Jan 13 06:32:59 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6028KiB/290294msec) clat (msec): min=5, max=304, avg=40.38, stdev=33.78 lat (msec): min=5, max=304, avg=40.38, stdev=33.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 62], 90.00th=[ 84], 95.00th=[ 102], | 99.00th=[ 159], 99.50th=[ 211], 99.90th=[ 288], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 135, per=28.00%, avg=22.96, stdev=15.35, samples=506 iops : min= 1, max= 33, avg= 5.11, stdev= 3.87, samples=506 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6260KiB/290294msec); 0 zone resets clat (msec): min=37, max=810, avg=146.32, stdev=68.51 lat (msec): min=37, max=810, avg=146.33, stdev=68.51 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 190], 90.00th=[ 234], 95.00th=[ 271], | 99.00th=[ 376], 99.50th=[ 414], 99.90th=[ 527], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 55, per=24.66%, avg=21.21, stdev= 9.75, samples=567 iops : min= 1, max= 13, avg= 4.67, stdev= 2.49, samples=567 lat (msec) : 10=2.60%, 20=13.18%, 50=19.69%, 100=24.54%, 250=36.10% lat (msec) : 500=3.74%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5749, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146084: Tue Jan 13 06:32:59 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6052KiB/289638msec) clat (msec): min=4, max=500, avg=39.56, stdev=36.29 lat (msec): min=4, max=500, avg=39.56, stdev=36.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 81], 95.00th=[ 100], | 99.00th=[ 169], 99.50th=[ 215], 99.90th=[ 380], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 80, per=28.39%, avg=23.28, stdev=15.55, samples=501 iops : min= 1, max= 20, avg= 5.19, stdev= 3.91, samples=501 write: IOPS=5, BW=21.5KiB/s (22.0kB/s)(6236KiB/289638msec); 0 zone resets clat (msec): min=28, max=836, avg=147.11, stdev=68.85 lat (msec): min=28, max=836, avg=147.12, stdev=68.85 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 93], | 30.00th=[ 106], 40.00th=[ 120], 50.00th=[ 133], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 197], 90.00th=[ 232], 95.00th=[ 268], | 99.00th=[ 363], 99.50th=[ 401], 99.90th=[ 810], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 55, per=24.67%, avg=21.22, stdev= 9.55, samples=564 iops : min= 1, max= 13, avg= 4.67, stdev= 2.44, samples=564 lat (msec) : 10=3.06%, 20=14.52%, 50=18.46%, 100=24.02%, 250=36.52% lat (msec) : 500=3.32%, 750=0.03%, 1000=0.07% cpu : usr=0.04%, sys=1.21%, ctx=5577, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=82.7KiB/s (84.7kB/s), 20.5KiB/s-20.9KiB/s (20.0kB/s-21.4kB/s), io=23.4MiB (24.6MB), run=289638-290294msec WRITE: bw=86.6KiB/s (88.7kB/s), 21.5KiB/s-21.9KiB/s (22.0kB/s-22.4kB/s), io=24.6MiB (25.7MB), run=289638-290294msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146147: Tue Jan 13 06:33:35 2026 read: IOPS=14, BW=235KiB/s (240kB/s)(5920KiB/25230msec) clat (usec): min=108, max=219247, avg=33620.23, stdev=34267.36 lat (usec): min=108, max=219249, avg=33625.04, stdev=34265.95 clat percentiles (usec): | 1.00th=[ 113], 5.00th=[ 133], 10.00th=[ 145], 20.00th=[ 174], | 30.00th=[ 2671], 40.00th=[ 22676], 50.00th=[ 29754], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 56886], 90.00th=[ 68682], 95.00th=[ 91751], | 99.00th=[193987], 99.50th=[198181], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 96, max= 448, per=24.89%, avg=229.51, stdev=84.00, samples=49 iops : min= 6, max= 28, avg=13.65, stdev= 5.33, samples=49 write: IOPS=15, BW=252KiB/s (258kB/s)(6368KiB/25230msec); 0 zone resets clat (usec): min=1058, max=256744, avg=31988.16, stdev=37636.70 lat (usec): min=1059, max=256746, avg=31990.45, stdev=37636.46 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1582], 10.00th=[ 1762], 20.00th=[ 3425], | 30.00th=[ 6521], 40.00th=[ 10945], 50.00th=[ 16909], 60.00th=[ 28705], | 70.00th=[ 39060], 80.00th=[ 56886], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[179307], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 63, max= 480, per=25.76%, avg=249.86, stdev=101.09, samples=49 iops : min= 3, max= 30, avg=14.94, stdev= 6.39, samples=49 lat (usec) : 250=11.85%, 500=1.04%, 750=0.52%, 1000=0.13% lat (msec) : 2=7.29%, 4=5.99%, 10=7.81%, 20=10.42%, 50=29.56% lat (msec) : 100=20.70%, 250=4.43%, 500=0.26% cpu : usr=0.07%, sys=5.92%, ctx=1247, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146148: Tue Jan 13 06:33:35 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(5744KiB/25975msec) clat (usec): min=97, max=165898, avg=34845.25, stdev=29336.25 lat (usec): min=98, max=165899, avg=34868.64, stdev=29313.17 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 141], 10.00th=[ 161], 20.00th=[ 273], | 30.00th=[ 19792], 40.00th=[ 25297], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[116917], 99.50th=[133694], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 31, max= 479, per=23.83%, avg=219.73, stdev=93.29, samples=51 iops : min= 1, max= 29, avg=13.04, stdev= 5.86, samples=51 write: IOPS=15, BW=252KiB/s (258kB/s)(6544KiB/25975msec); 0 zone resets clat (usec): min=1228, max=232993, avg=32505.23, stdev=35883.94 lat (usec): min=1230, max=232996, avg=32507.60, stdev=35883.75 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1647], 10.00th=[ 1844], 20.00th=[ 4555], | 30.00th=[ 6849], 40.00th=[ 10814], 50.00th=[ 19006], 60.00th=[ 28705], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[141558], 99.50th=[160433], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 63, max= 666, per=25.98%, avg=252.02, stdev=108.66, samples=51 iops : min= 3, max= 41, avg=15.06, stdev= 6.81, samples=51 lat (usec) : 100=0.13%, 250=9.11%, 500=1.17%, 750=0.13% lat (msec) : 2=6.25%, 4=3.78%, 10=10.68%, 20=10.94%, 50=32.81% lat (msec) : 100=20.31%, 250=4.69% cpu : usr=0.10%, sys=6.01%, ctx=1364, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146149: Tue Jan 13 06:33:35 2026 read: IOPS=15, BW=247KiB/s (253kB/s)(6256KiB/25336msec) clat (usec): min=96, max=178407, avg=32986.00, stdev=28928.11 lat (usec): min=96, max=178408, avg=32987.23, stdev=28928.07 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 137], 10.00th=[ 157], 20.00th=[ 188], | 30.00th=[ 14877], 40.00th=[ 24249], 50.00th=[ 31065], 60.00th=[ 37487], | 70.00th=[ 45876], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[111674], 99.50th=[121111], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 61, max= 504, per=26.81%, avg=247.16, stdev=106.61, samples=50 iops : min= 3, max= 31, avg=14.78, stdev= 6.74, samples=50 write: IOPS=14, BW=238KiB/s (244kB/s)(6032KiB/25336msec); 0 zone resets clat (usec): min=1393, max=208451, avg=32459.76, stdev=35257.43 lat (usec): min=1395, max=208454, avg=32490.22, stdev=35275.38 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1598], 10.00th=[ 2024], 20.00th=[ 4178], | 30.00th=[ 7373], 40.00th=[ 11469], 50.00th=[ 18482], 60.00th=[ 30540], | 70.00th=[ 40633], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[147850], 99.50th=[181404], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 473, per=24.47%, avg=237.40, stdev=91.19, samples=50 iops : min= 1, max= 29, avg=14.18, stdev= 5.81, samples=50 lat (usec) : 100=0.13%, 250=11.59%, 500=1.30%, 750=0.52%, 1000=0.13% lat (msec) : 2=5.08%, 4=5.08%, 10=9.38%, 20=9.38%, 50=33.33% lat (msec) : 100=20.18%, 250=3.91% cpu : usr=0.07%, sys=5.95%, ctx=1328, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146150: Tue Jan 13 06:33:35 2026 read: IOPS=15, BW=244KiB/s (250kB/s)(6032KiB/24678msec) clat (usec): min=103, max=273294, avg=33860.47, stdev=34679.90 lat (usec): min=104, max=273295, avg=33861.69, stdev=34679.93 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 137], 10.00th=[ 149], 20.00th=[ 186], | 30.00th=[ 8979], 40.00th=[ 22414], 50.00th=[ 29230], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 84411], | 99.00th=[185598], 99.50th=[252707], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 61, max= 447, per=26.25%, avg=242.00, stdev=100.34, samples=48 iops : min= 3, max= 27, avg=14.42, stdev= 6.33, samples=48 write: IOPS=15, BW=254KiB/s (260kB/s)(6256KiB/24678msec); 0 zone resets clat (usec): min=1158, max=242291, avg=30027.88, stdev=36083.59 lat (usec): min=1159, max=242293, avg=30033.41, stdev=36081.18 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1500], 10.00th=[ 1762], 20.00th=[ 3228], | 30.00th=[ 5276], 40.00th=[ 8094], 50.00th=[ 14615], 60.00th=[ 24773], | 70.00th=[ 38536], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[183501], 99.50th=[235930], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 63, max= 504, per=25.92%, avg=251.44, stdev=95.85, samples=48 iops : min= 3, max= 31, avg=15.04, stdev= 6.04, samples=48 lat (usec) : 250=12.37%, 500=0.91%, 750=0.13%, 1000=0.13% lat (msec) : 2=7.68%, 4=5.08%, 10=10.68%, 20=9.64%, 50=28.39% lat (msec) : 100=21.22%, 250=3.52%, 500=0.26% cpu : usr=0.09%, sys=6.48%, ctx=1316, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=922KiB/s (944kB/s), 221KiB/s-247KiB/s (226kB/s-253kB/s), io=23.4MiB (24.5MB), run=24678-25975msec WRITE: bw=970KiB/s (993kB/s), 238KiB/s-254KiB/s (244kB/s-260kB/s), io=24.6MiB (25.8MB), run=24678-25975msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146152: Tue Jan 13 06:34:24 2026 read: IOPS=4, BW=79.7KiB/s (81.6kB/s)(5920KiB/74253msec) clat (msec): min=7, max=214, avg=41.26, stdev=32.55 lat (msec): min=7, max=214, avg=41.27, stdev=32.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 59], 90.00th=[ 77], 95.00th=[ 109], | 99.00th=[ 165], 99.50th=[ 190], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 29, max= 378, per=27.52%, avg=88.34, stdev=59.99, samples=132 iops : min= 1, max= 23, avg= 4.80, stdev= 3.78, samples=132 write: IOPS=5, BW=85.8KiB/s (87.8kB/s)(6368KiB/74253msec); 0 zone resets clat (msec): min=49, max=545, avg=148.02, stdev=63.72 lat (msec): min=49, max=545, avg=148.02, stdev=63.72 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 74], 10.00th=[ 81], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 192], 90.00th=[ 228], 95.00th=[ 279], | 99.00th=[ 355], 99.50th=[ 439], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 25, max= 160, per=25.59%, avg=86.49, stdev=34.19, samples=145 iops : min= 1, max= 10, avg= 4.67, stdev= 2.17, samples=145 lat (msec) : 10=2.34%, 20=10.81%, 50=22.79%, 100=21.35%, 250=39.06% lat (msec) : 500=3.52%, 750=0.13% cpu : usr=0.04%, sys=1.33%, ctx=1419, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146153: Tue Jan 13 06:34:24 2026 read: IOPS=4, BW=77.1KiB/s (78.0kB/s)(5744KiB/74480msec) clat (msec): min=5, max=250, avg=39.89, stdev=33.10 lat (msec): min=5, max=250, avg=39.89, stdev=33.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 59], 90.00th=[ 75], 95.00th=[ 103], | 99.00th=[ 176], 99.50th=[ 199], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 25, max= 286, per=27.30%, avg=87.64, stdev=58.14, samples=128 iops : min= 1, max= 17, avg= 4.73, stdev= 3.67, samples=128 write: IOPS=5, BW=87.9KiB/s (89.0kB/s)(6544KiB/74480msec); 0 zone resets clat (msec): min=32, max=462, avg=146.94, stdev=61.57 lat (msec): min=32, max=462, avg=146.95, stdev=61.57 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 122], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 188], 90.00th=[ 230], 95.00th=[ 266], | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 31, max= 192, per=26.09%, avg=88.17, stdev=34.39, samples=145 iops : min= 1, max= 12, avg= 4.77, stdev= 2.23, samples=145 lat (msec) : 10=2.08%, 20=12.50%, 50=20.05%, 100=22.01%, 250=39.19% lat (msec) : 500=4.17% cpu : usr=0.03%, sys=1.29%, ctx=1437, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146154: Tue Jan 13 06:34:24 2026 read: IOPS=5, BW=85.9KiB/s (87.9kB/s)(6256KiB/72851msec) clat (msec): min=8, max=277, avg=41.09, stdev=34.17 lat (msec): min=8, max=277, avg=41.09, stdev=34.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 59], 90.00th=[ 79], 95.00th=[ 111], | 99.00th=[ 169], 99.50th=[ 224], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 413, per=30.08%, avg=96.55, stdev=63.92, samples=128 iops : min= 1, max= 25, avg= 5.32, stdev= 4.03, samples=128 write: IOPS=5, BW=82.8KiB/s (84.8kB/s)(6032KiB/72851msec); 0 zone resets clat (msec): min=43, max=417, avg=150.37, stdev=67.71 lat (msec): min=43, max=417, avg=150.39, stdev=67.71 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 133], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 253], 95.00th=[ 296], | 99.00th=[ 384], 99.50th=[ 397], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 29, max= 191, per=24.73%, avg=83.59, stdev=32.86, samples=142 iops : min= 1, max= 11, avg= 4.49, stdev= 2.09, samples=142 lat (msec) : 10=1.56%, 20=12.76%, 50=23.44%, 100=20.57%, 250=36.59% lat (msec) : 500=5.08% cpu : usr=0.04%, sys=1.37%, ctx=1550, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146155: Tue Jan 13 06:34:24 2026 read: IOPS=5, BW=83.9KiB/s (85.9kB/s)(6032KiB/71929msec) clat (msec): min=7, max=247, avg=40.04, stdev=32.01 lat (msec): min=7, max=247, avg=40.04, stdev=32.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 78], 95.00th=[ 97], | 99.00th=[ 176], 99.50th=[ 194], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 29, max= 286, per=29.16%, avg=93.60, stdev=57.95, samples=126 iops : min= 1, max= 17, avg= 5.12, stdev= 3.67, samples=126 write: IOPS=5, BW=86.0KiB/s (89.1kB/s)(6256KiB/71929msec); 0 zone resets clat (msec): min=36, max=393, avg=145.22, stdev=65.74 lat (msec): min=36, max=393, avg=145.24, stdev=65.74 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 104], 40.00th=[ 113], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 236], 95.00th=[ 288], | 99.00th=[ 355], 99.50th=[ 376], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 160, per=25.77%, avg=87.11, stdev=36.91, samples=141 iops : min= 1, max= 10, avg= 4.71, stdev= 2.37, samples=141 lat (msec) : 10=1.43%, 20=11.85%, 50=24.22%, 100=22.92%, 250=34.77% lat (msec) : 500=4.82% cpu : usr=0.04%, sys=1.42%, ctx=1557, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=322KiB/s (329kB/s), 77.1KiB/s-85.9KiB/s (78.0kB/s-87.9kB/s), io=23.4MiB (24.5MB), run=71929-74480msec WRITE: bw=338KiB/s (346kB/s), 82.8KiB/s-87.9KiB/s (84.8kB/s-89.0kB/s), io=24.6MiB (25.8MB), run=71929-74480msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146174: Tue Jan 13 06:34:41 2026 read: IOPS=1, BW=1359KiB/s (1391kB/s)(7168KiB/5276msec) clat (usec): min=641, max=2061.6k, avg=418362.20, stdev=735568.92 lat (usec): min=643, max=2061.6k, avg=418364.10, stdev=735569.20 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], | 20.00th=[ 652], 30.00th=[ 98042], 40.00th=[ 98042], | 50.00th=[ 177210], 60.00th=[ 240124], 70.00th=[ 240124], | 80.00th=[ 350225], 90.00th=[2055209], 95.00th=[2055209], | 99.00th=[2055209], 99.50th=[2055209], 99.90th=[2055209], | 99.95th=[2055209], 99.99th=[2055209] bw ( KiB/s): min= 1822, max= 4063, per=76.53%, avg=2482.75, stdev=1057.76, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=970KiB/s (994kB/s)(5120KiB/5276msec); 0 zone resets clat (msec): min=229, max=1019, avg=450.77, stdev=324.35 lat (msec): min=229, max=1019, avg=450.88, stdev=324.36 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1822, max= 2019, per=42.98%, avg=1952.00, stdev=112.60, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.18%, ctx=343, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146175: Tue Jan 13 06:34:41 2026 read: IOPS=0, BW=324KiB/s (332kB/s)(2048KiB/6312msec) clat (msec): min=194, max=311, avg=252.64, stdev=82.59 lat (msec): min=194, max=311, avg=252.65, stdev=82.59 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1600, max= 2015, per=55.72%, avg=1807.50, stdev=293.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1622KiB/s (1661kB/s)(10.0MiB/6312msec); 0 zone resets clat (msec): min=72, max=2488, avg=574.18, stdev=700.81 lat (msec): min=72, max=2488, avg=574.29, stdev=700.82 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 157], | 30.00th=[ 215], 40.00th=[ 232], 50.00th=[ 363], 60.00th=[ 430], | 70.00th=[ 485], 80.00th=[ 642], 90.00th=[ 659], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1906, max= 4047, per=68.90%, avg=3129.40, stdev=1081.86, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=7.27%, ctx=157, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146176: Tue Jan 13 06:34:41 2026 read: IOPS=1, BW=1143KiB/s (1171kB/s)(6144KiB/5373msec) clat (usec): min=990, max=328869, avg=154018.50, stdev=153724.51 lat (usec): min=992, max=328872, avg=154020.36, stdev=153724.59 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 3097], | 30.00th=[ 3097], 40.00th=[ 49021], 50.00th=[ 49021], 60.00th=[231736], | 70.00th=[308282], 80.00th=[308282], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2011, max= 6059, per=100.00%, avg=3361.67, stdev=2335.96, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1143KiB/s (1171kB/s)(6144KiB/5373msec); 0 zone resets clat (msec): min=189, max=2602, avg=735.87, stdev=949.88 lat (msec): min=189, max=2602, avg=735.98, stdev=949.86 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 317], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1822, max= 3160, per=49.60%, avg=2253.00, stdev=611.48, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 50=8.33%, 250=33.33%, 500=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.46%, ctx=163, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146177: Tue Jan 13 06:34:41 2026 read: IOPS=0, BW=1007KiB/s (1031kB/s)(5120KiB/5084msec) clat (usec): min=673, max=260101, avg=69210.57, stdev=112159.69 lat (usec): min=674, max=260102, avg=69212.35, stdev=112159.71 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 1401], 40.00th=[ 1401], 50.00th=[ 2606], 60.00th=[ 2606], | 70.00th=[ 81265], 80.00th=[ 81265], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1410KiB/s (1444kB/s)(7168KiB/5084msec); 0 zone resets clat (msec): min=163, max=2476, avg=665.19, stdev=814.97 lat (msec): min=163, max=2476, avg=665.56, stdev=814.89 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 213], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 359], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 651], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1577, max= 4031, per=62.04%, avg=2817.75, stdev=1201.68, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=16.67%, 500=33.33% lat (msec) : 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=7.10%, ctx=144, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3245KiB/s (3322kB/s), 324KiB/s-1359KiB/s (332kB/s-1391kB/s), io=20.0MiB (20.0MB), run=5084-6312msec WRITE: bw=4542KiB/s (4651kB/s), 970KiB/s-1622KiB/s (994kB/s-1661kB/s), io=28.0MiB (29.4MB), run=5084-6312msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146179: Tue Jan 13 06:34:42 2026 read: IOPS=1, BW=1029KiB/s (1053kB/s)(7168KiB/6968msec) clat (msec): min=86, max=1774, avg=694.21, stdev=774.18 lat (msec): min=86, max=1774, avg=694.21, stdev=774.18 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 89], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 133], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 1687], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 1976, max= 4047, per=83.77%, avg=2416.80, stdev=911.55, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=735KiB/s (752kB/s)(5120KiB/6968msec); 0 zone resets clat (msec): min=271, max=573, avg=403.51, stdev=124.42 lat (msec): min=271, max=573, avg=403.60, stdev=124.41 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2011, max= 2031, per=50.07%, avg=2023.00, stdev= 8.64, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=2.37%, ctx=80, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146180: Tue Jan 13 06:34:42 2026 read: IOPS=0, BW=298KiB/s (305kB/s)(2048KiB/6867msec) clat (usec): min=83439, max=85883, avg=84661.61, stdev=1728.23 lat (usec): min=83441, max=85885, avg=84663.52, stdev=1728.15 clat percentiles (usec): | 1.00th=[83362], 5.00th=[83362], 10.00th=[83362], 20.00th=[83362], | 30.00th=[83362], 40.00th=[83362], 50.00th=[83362], 60.00th=[85459], | 70.00th=[85459], 80.00th=[85459], 90.00th=[85459], 95.00th=[85459], | 99.00th=[85459], 99.50th=[85459], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 1793, max= 2023, per=66.14%, avg=1908.00, stdev=162.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1491KiB/s (1527kB/s)(10.0MiB/6867msec); 0 zone resets clat (msec): min=223, max=2856, avg=658.48, stdev=803.21 lat (msec): min=223, max=2856, avg=658.71, stdev=803.24 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 236], | 30.00th=[ 247], 40.00th=[ 288], 50.00th=[ 321], 60.00th=[ 368], | 70.00th=[ 510], 80.00th=[ 600], 90.00th=[ 936], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1976, max= 4063, per=64.28%, avg=2596.86, stdev=996.32, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.05%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146181: Tue Jan 13 06:34:42 2026 read: IOPS=0, BW=955KiB/s (978kB/s)(6144KiB/6433msec) clat (msec): min=86, max=447, avg=255.48, stdev=130.58 lat (msec): min=86, max=447, avg=255.48, stdev=130.58 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 279], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1984, max= 4055, per=87.36%, avg=2520.25, stdev=1023.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=955KiB/s (978kB/s)(6144KiB/6433msec); 0 zone resets clat (msec): min=190, max=2730, avg=815.09, stdev=957.15 lat (msec): min=190, max=2730, avg=815.32, stdev=957.14 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 542], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 2011, max= 4063, per=67.73%, avg=2736.25, stdev=966.25, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.13%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146182: Tue Jan 13 06:34:42 2026 read: IOPS=0, BW=721KiB/s (739kB/s)(5120KiB/7097msec) clat (msec): min=112, max=423, avg=226.10, stdev=130.29 lat (msec): min=112, max=423, avg=226.10, stdev=130.29 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 4023, max= 4047, per=100.00%, avg=4035.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=1010KiB/s (1034kB/s)(7168KiB/7097msec); 0 zone resets clat (msec): min=285, max=2725, avg=835.67, stdev=854.69 lat (msec): min=285, max=2726, avg=835.76, stdev=854.70 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 317], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 584], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 844], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1771, max= 2043, per=48.65%, avg=1965.60, stdev=111.76, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.86%, ctx=127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2886KiB/s (2955kB/s), 298KiB/s-1029KiB/s (305kB/s-1053kB/s), io=20.0MiB (20.0MB), run=6433-7097msec WRITE: bw=4040KiB/s (4137kB/s), 735KiB/s-1491KiB/s (752kB/s-1527kB/s), io=28.0MiB (29.4MB), run=6433-7097msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146188: Tue Jan 13 06:34:56 2026 read: IOPS=0, BW=4031KiB/s (4128kB/s)(12.0MiB/3048msec) clat (msec): min=770, max=1425, avg=990.06, stdev=376.89 lat (msec): min=770, max=1425, avg=990.07, stdev=376.89 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.75%, ctx=208, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146189: Tue Jan 13 06:34:56 2026 read: IOPS=0, BW=1563KiB/s (1601kB/s)(4096KiB/2620msec) clat (nsec): min=878928k, max=878928k, avg=878927829.00, stdev= 0.00 lat (nsec): min=878931k, max=878931k, avg=878930993.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3127KiB/s (3202kB/s)(8192KiB/2620msec); 0 zone resets clat (msec): min=406, max=1231, avg=819.09, stdev=583.63 lat (msec): min=406, max=1232, avg=819.46, stdev=583.55 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8110, max= 8110, per=95.41%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.87%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146190: Tue Jan 13 06:34:56 2026 write: IOPS=0, BW=3188KiB/s (3264kB/s)(12.0MiB/3855msec); 0 zone resets clat (msec): min=845, max=1599, avg=1244.43, stdev=378.95 lat (msec): min=846, max=1599, avg=1244.97, stdev=378.80 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7713, max= 8110, per=93.08%, avg=7911.50, stdev=280.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.58%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146191: Tue Jan 13 06:34:56 2026 write: IOPS=1, BW=6420KiB/s (6574kB/s)(12.0MiB/1914msec); 0 zone resets clat (msec): min=501, max=701, avg=608.97, stdev=101.27 lat (msec): min=501, max=702, avg=609.38, stdev=101.33 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8110, max= 8110, per=95.41%, avg=8110.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.10%, sys=6.17%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5375KiB/s (5504kB/s), 1563KiB/s-4031KiB/s (1601kB/s-4128kB/s), io=16.0MiB (16.8MB), run=2620-3048msec WRITE: bw=8500KiB/s (8704kB/s), 3127KiB/s-6420KiB/s (3202kB/s-6574kB/s), io=32.0MiB (33.6MB), run=1914-3855msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146194: Tue Jan 13 06:34:56 2026 read: IOPS=1, BW=4427KiB/s (4533kB/s)(12.0MiB/2776msec) clat (msec): min=577, max=1282, avg=911.30, stdev=353.82 lat (msec): min=577, max=1282, avg=911.30, stdev=353.82 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.42%, ctx=34, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146195: Tue Jan 13 06:34:56 2026 read: IOPS=0, BW=1746KiB/s (1788kB/s)(4096KiB/2346msec) clat (nsec): min=867834k, max=867834k, avg=867834373.00, stdev= 0.00 lat (nsec): min=867836k, max=867836k, avg=867835912.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3492KiB/s (3576kB/s)(8192KiB/2346msec); 0 zone resets clat (msec): min=577, max=898, avg=738.22, stdev=227.37 lat (msec): min=577, max=899, avg=738.62, stdev=227.46 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8047, max= 8047, per=61.42%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.56%, ctx=33, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146196: Tue Jan 13 06:34:56 2026 write: IOPS=1, BW=4913KiB/s (5031kB/s)(12.0MiB/2501msec); 0 zone resets clat (msec): min=509, max=1234, avg=827.91, stdev=370.52 lat (msec): min=510, max=1235, avg=829.19, stdev=370.15 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8047, max= 8110, per=61.66%, avg=8078.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=3.80%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146197: Tue Jan 13 06:34:56 2026 write: IOPS=1, BW=6589KiB/s (6747kB/s)(12.0MiB/1865msec); 0 zone resets clat (msec): min=388, max=920, avg=620.82, stdev=272.31 lat (msec): min=389, max=920, avg=621.26, stdev=272.25 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 5673, max= 8047, per=52.36%, avg=6860.00, stdev=1678.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=4.56%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5902KiB/s (6044kB/s), 1746KiB/s-4427KiB/s (1788kB/s-4533kB/s), io=16.0MiB (16.8MB), run=2346-2776msec WRITE: bw=12.8MiB/s (13.4MB/s), 3492KiB/s-6589KiB/s (3576kB/s-6747kB/s), io=32.0MiB (33.6MB), run=1865-2501msec