== sanity test 398b: DIO and buffer IO race ============== 15:43:07 (1780342987) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.95413 s, 8.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180862: Mon Jun 1 15:45:32 2026 read: IOPS=11, BW=47.6KiB/s (48.7kB/s)(5992KiB/125880msec) clat (usec): min=47, max=1097.5k, avg=46218.79, stdev=39036.00 lat (usec): min=48, max=1097.5k, avg=46221.18, stdev=39036.65 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 12256], 10.00th=[ 18220], | 20.00th=[ 23987], 30.00th=[ 29754], 40.00th=[ 35390], | 50.00th=[ 40633], 60.00th=[ 45876], 70.00th=[ 53740], | 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[ 143655], 99.50th=[ 166724], 99.90th=[ 270533], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 5, max= 103, per=24.78%, avg=47.09, stdev=18.30, samples=247 iops : min= 1, max= 25, avg=11.10, stdev= 4.62, samples=247 write: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6296KiB/125880msec); 0 zone resets clat (usec): min=1093, max=288270, avg=35590.85, stdev=36822.06 lat (usec): min=1094, max=288272, avg=35593.34, stdev=36821.61 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1532], 10.00th=[ 2212], 20.00th=[ 4555], | 30.00th=[ 8225], 40.00th=[ 16057], 50.00th=[ 25560], 60.00th=[ 34341], | 70.00th=[ 45351], 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[160433], 99.50th=[181404], 99.90th=[270533], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 144, per=25.01%, avg=49.77, stdev=20.85, samples=246 iops : min= 1, max= 36, avg=11.78, stdev= 5.26, samples=246 lat (usec) : 50=0.03%, 100=1.43%, 250=0.26%, 500=0.10%, 750=0.03% lat (msec) : 2=4.52%, 4=4.79%, 10=7.94%, 20=8.79%, 50=41.31% lat (msec) : 100=25.52%, 250=5.14%, 500=0.10%, 2000=0.03% cpu : usr=0.09%, sys=5.89%, ctx=6986, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180864: Mon Jun 1 15:45:32 2026 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(5940KiB/125198msec) clat (usec): min=37, max=353292, avg=46029.15, stdev=28203.45 lat (usec): min=37, max=353294, avg=46030.98, stdev=28203.19 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 15795], 10.00th=[ 19792], 20.00th=[ 25035], | 30.00th=[ 29754], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 54264], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 93848], | 99.00th=[145753], 99.50th=[166724], 99.90th=[258999], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 5, max= 88, per=24.79%, avg=47.10, stdev=17.17, samples=246 iops : min= 1, max= 22, avg=11.10, stdev= 4.33, samples=246 write: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6348KiB/125198msec); 0 zone resets clat (usec): min=1218, max=1031.2k, avg=35453.58, stdev=42731.49 lat (usec): min=1219, max=1031.2k, avg=35464.11, stdev=42750.46 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1565], 10.00th=[ 2573], | 20.00th=[ 5145], 30.00th=[ 9110], 40.00th=[ 17695], | 50.00th=[ 25560], 60.00th=[ 34341], 70.00th=[ 44827], | 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[ 100140], | 99.00th=[ 154141], 99.50th=[ 185598], 99.90th=[ 304088], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 112, per=25.24%, avg=50.24, stdev=20.00, samples=246 iops : min= 1, max= 28, avg=11.89, stdev= 5.05, samples=246 lat (usec) : 50=0.23%, 100=0.75%, 250=0.16%, 500=0.03%, 750=0.03% lat (msec) : 2=3.97%, 4=3.87%, 10=8.46%, 20=9.54%, 50=42.06% lat (msec) : 100=26.50%, 250=4.26%, 500=0.10%, 2000=0.03% cpu : usr=0.10%, sys=5.78%, ctx=6964, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180865: Mon Jun 1 15:45:32 2026 read: IOPS=12, BW=48.4KiB/s (49.5kB/s)(6028KiB/124633msec) clat (usec): min=43, max=1106.3k, avg=47217.05, stdev=40140.39 lat (usec): min=44, max=1106.3k, avg=47221.00, stdev=40140.13 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11600], 10.00th=[ 18220], | 20.00th=[ 24773], 30.00th=[ 30016], 40.00th=[ 35390], | 50.00th=[ 41157], 60.00th=[ 47973], 70.00th=[ 55837], | 80.00th=[ 66323], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[ 135267], 99.50th=[ 185598], 99.90th=[ 383779], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 5, max= 95, per=25.35%, avg=48.16, stdev=17.66, samples=244 iops : min= 1, max= 23, avg=11.38, stdev= 4.45, samples=244 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6260KiB/124633msec); 0 zone resets clat (usec): min=1148, max=264672, avg=33864.23, stdev=34777.71 lat (usec): min=1149, max=264674, avg=33869.20, stdev=34777.83 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1532], 10.00th=[ 2343], 20.00th=[ 4555], | 30.00th=[ 7701], 40.00th=[ 15401], 50.00th=[ 23987], 60.00th=[ 32113], | 70.00th=[ 43254], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[105382], | 99.00th=[154141], 99.50th=[173016], 99.90th=[217056], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 127, per=25.05%, avg=49.84, stdev=21.54, samples=245 iops : min= 1, max= 31, avg=11.80, stdev= 5.42, samples=245 lat (usec) : 50=0.29%, 100=1.60%, 250=0.20%, 1000=0.03% lat (msec) : 2=4.39%, 4=4.59%, 10=8.24%, 20=9.31%, 50=40.17% lat (msec) : 100=26.43%, 250=4.59%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=5.77%, ctx=6953, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180867: Mon Jun 1 15:45:32 2026 read: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6052KiB/125437msec) clat (usec): min=41, max=302777, avg=45269.62, stdev=29006.36 lat (usec): min=42, max=302778, avg=45271.59, stdev=29006.17 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11994], 10.00th=[ 17957], 20.00th=[ 23462], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 54264], 80.00th=[ 63701], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[131597], 99.50th=[183501], 99.90th=[278922], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 103, per=25.39%, avg=48.23, stdev=17.07, samples=244 iops : min= 1, max= 25, avg=11.39, stdev= 4.29, samples=244 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6236KiB/125437msec); 0 zone resets clat (usec): min=1121, max=989077, avg=36193.67, stdev=41664.66 lat (usec): min=1123, max=989079, avg=36198.48, stdev=41663.78 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1549], 10.00th=[ 2376], 20.00th=[ 4752], | 30.00th=[ 9503], 40.00th=[ 18482], 50.00th=[ 27132], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[141558], 99.50th=[164627], 99.90th=[333448], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 126, per=24.96%, avg=49.67, stdev=21.13, samples=244 iops : min= 1, max= 31, avg=11.75, stdev= 5.32, samples=244 lat (usec) : 50=0.13%, 100=1.73%, 250=0.16%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.26%, 4=4.59%, 10=6.93%, 20=9.96%, 50=39.71% lat (msec) : 100=27.93%, 250=4.36%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.69%, ctx=6902, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=191KiB/s (195kB/s), 47.4KiB/s-48.4KiB/s (48.6kB/s-49.5kB/s), io=23.4MiB (24.6MB), run=124633-125880msec WRITE: bw=200KiB/s (205kB/s), 49.7KiB/s-50.7KiB/s (50.9kB/s-51.9kB/s), io=24.6MiB (25.7MB), run=124633-125880msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180861: Mon Jun 1 15:46:05 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(5992KiB/158998msec) clat (msec): min=5, max=1080, avg=42.51, stdev=46.33 lat (msec): min=5, max=1080, avg=42.51, stdev=46.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 100], 95.00th=[ 125], | 99.00th=[ 182], 99.50th=[ 205], 99.90th=[ 271], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 136, per=25.23%, avg=37.84, stdev=27.48, samples=308 iops : min= 1, max= 34, avg= 8.79, stdev= 6.90, samples=308 write: IOPS=9, BW=39.6KiB/s (40.5kB/s)(6296KiB/158998msec); 0 zone resets clat (msec): min=11, max=433, avg=60.27, stdev=44.50 lat (msec): min=11, max=433, avg=60.27, stdev=44.50 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 91], 90.00th=[ 122], 95.00th=[ 148], | 99.00th=[ 209], 99.50th=[ 249], 99.90th=[ 338], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 135, per=25.18%, avg=39.53, stdev=26.33, samples=310 iops : min= 1, max= 33, avg= 9.21, stdev= 6.62, samples=310 lat (msec) : 10=2.28%, 20=17.64%, 50=44.56%, 100=22.46%, 250=12.76% lat (msec) : 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=2.40%, ctx=5216, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180863: Mon Jun 1 15:46:05 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(5940KiB/159151msec) clat (msec): min=5, max=949, avg=41.16, stdev=42.97 lat (msec): min=5, max=949, avg=41.16, stdev=42.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 93], 95.00th=[ 120], | 99.00th=[ 178], 99.50th=[ 199], 99.90th=[ 247], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 151, per=25.42%, avg=38.14, stdev=28.46, samples=303 iops : min= 1, max= 37, avg= 8.86, stdev= 7.14, samples=303 write: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6348KiB/159151msec); 0 zone resets clat (msec): min=12, max=326, avg=61.47, stdev=44.39 lat (msec): min=12, max=326, avg=61.48, stdev=44.39 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 73], 80.00th=[ 95], 90.00th=[ 125], 95.00th=[ 148], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 309], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 111, per=25.32%, avg=39.75, stdev=25.35, samples=310 iops : min= 1, max= 27, avg= 9.26, stdev= 6.36, samples=310 lat (msec) : 10=2.02%, 20=17.90%, 50=44.53%, 100=22.04%, 250=13.25% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=2.44%, ctx=5141, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180866: Mon Jun 1 15:46:05 2026 read: IOPS=9, BW=37.8KiB/s (38.8kB/s)(6028KiB/159271msec) clat (msec): min=5, max=241, avg=41.87, stdev=37.63 lat (msec): min=5, max=241, avg=41.88, stdev=37.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 95], 95.00th=[ 120], | 99.00th=[ 184], 99.50th=[ 197], 99.90th=[ 228], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 7, max= 151, per=25.54%, avg=38.31, stdev=27.48, samples=307 iops : min= 1, max= 37, avg= 8.91, stdev= 6.91, samples=307 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6260KiB/159271msec); 0 zone resets clat (msec): min=12, max=985, avg=61.16, stdev=51.03 lat (msec): min=12, max=985, avg=61.16, stdev=51.03 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 56], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 224], 99.50th=[ 271], 99.90th=[ 426], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 119, per=24.84%, avg=39.01, stdev=27.47, samples=313 iops : min= 1, max= 29, avg= 9.08, stdev= 6.90, samples=313 lat (msec) : 10=2.44%, 20=18.20%, 50=43.65%, 100=23.01%, 250=12.34% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.07%, sys=2.38%, ctx=5075, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180868: Mon Jun 1 15:46:05 2026 read: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6052KiB/158141msec) clat (msec): min=6, max=261, avg=42.12, stdev=38.55 lat (msec): min=6, max=261, avg=42.12, stdev=38.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 99], 95.00th=[ 129], | 99.00th=[ 178], 99.50th=[ 203], 99.90th=[ 241], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 135, per=25.91%, avg=38.86, stdev=28.17, samples=303 iops : min= 1, max= 33, avg= 9.04, stdev= 7.07, samples=303 write: IOPS=9, BW=39.4KiB/s (40.4kB/s)(6236KiB/158141msec); 0 zone resets clat (msec): min=10, max=969, avg=60.27, stdev=50.29 lat (msec): min=10, max=969, avg=60.28, stdev=50.29 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 121], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 251], 99.90th=[ 372], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 119, per=25.28%, avg=39.69, stdev=26.97, samples=305 iops : min= 1, max= 29, avg= 9.26, stdev= 6.78, samples=305 lat (msec) : 10=2.21%, 20=18.20%, 50=44.63%, 100=22.17%, 250=12.50% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=2.46%, ctx=5161, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=151KiB/s (154kB/s), 37.3KiB/s-38.3KiB/s (38.2kB/s-39.2kB/s), io=23.4MiB (24.6MB), run=158141-159271msec WRITE: bw=158KiB/s (162kB/s), 39.3KiB/s-39.9KiB/s (40.2kB/s-40.8kB/s), io=24.6MiB (25.7MB), run=158141-159271msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180908: Mon Jun 1 15:46:46 2026 read: IOPS=11, BW=191KiB/s (196kB/s)(5920KiB/30996msec) clat (usec): min=38, max=161648, avg=42338.85, stdev=26766.09 lat (usec): min=38, max=161649, avg=42341.57, stdev=26767.49 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 66], 10.00th=[ 2089], 20.00th=[ 23725], | 30.00th=[ 27919], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 52167], 80.00th=[ 63177], 90.00th=[ 77071], 95.00th=[ 86508], | 99.00th=[135267], 99.50th=[147850], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 63, max= 414, per=25.36%, avg=190.69, stdev=72.82, samples=61 iops : min= 3, max= 25, avg=11.10, stdev= 4.54, samples=61 write: IOPS=12, BW=205KiB/s (210kB/s)(6368KiB/30996msec); 0 zone resets clat (usec): min=1621, max=214608, avg=37896.48, stdev=36914.95 lat (usec): min=1623, max=214610, avg=37901.74, stdev=36914.32 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2474], 10.00th=[ 3621], 20.00th=[ 5342], | 30.00th=[ 8848], 40.00th=[ 17433], 50.00th=[ 26870], 60.00th=[ 38536], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[166724], 99.50th=[187696], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 63, max= 446, per=26.02%, avg=205.84, stdev=88.82, samples=61 iops : min= 3, max= 27, avg=12.05, stdev= 5.61, samples=61 lat (usec) : 50=0.13%, 100=3.91%, 250=0.39%, 750=0.26% lat (msec) : 2=0.91%, 4=4.95%, 10=11.33%, 20=7.29%, 50=38.93% lat (msec) : 100=26.56%, 250=5.34% cpu : usr=0.06%, sys=7.02%, ctx=1877, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180910: Mon Jun 1 15:46:46 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(5744KiB/30985msec) clat (usec): min=39, max=176958, avg=45307.60, stdev=27220.95 lat (usec): min=39, max=176960, avg=45309.43, stdev=27220.53 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 14484], 20.00th=[ 23987], | 30.00th=[ 30802], 40.00th=[ 38011], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 57934], 80.00th=[ 64226], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[126354], 99.50th=[145753], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 63, max= 319, per=24.99%, avg=187.95, stdev=63.62, samples=60 iops : min= 3, max= 19, avg=10.93, stdev= 4.01, samples=60 write: IOPS=13, BW=211KiB/s (216kB/s)(6544KiB/30985msec); 0 zone resets clat (usec): min=1760, max=174953, avg=35783.97, stdev=32806.13 lat (usec): min=1761, max=174956, avg=35791.29, stdev=32804.00 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2409], 10.00th=[ 3589], 20.00th=[ 6587], | 30.00th=[ 10028], 40.00th=[ 19006], 50.00th=[ 28181], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[135267], 99.50th=[141558], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 507, per=26.58%, avg=210.21, stdev=93.44, samples=61 iops : min= 1, max= 31, avg=12.34, stdev= 5.85, samples=61 lat (usec) : 50=0.13%, 100=2.86%, 250=0.78%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=0.91%, 4=5.08%, 10=10.03%, 20=8.85%, 50=37.63% lat (msec) : 100=28.13%, 250=5.08% cpu : usr=0.08%, sys=7.24%, ctx=1849, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180911: Mon Jun 1 15:46:46 2026 read: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31838msec) clat (usec): min=27, max=233333, avg=45784.16, stdev=32941.51 lat (usec): min=27, max=233334, avg=45785.63, stdev=32941.47 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 62], 10.00th=[ 99], 20.00th=[ 22676], | 30.00th=[ 28181], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 50070], | 70.00th=[ 58459], 80.00th=[ 66847], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[154141], 99.50th=[204473], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 62, max= 383, per=26.08%, avg=196.15, stdev=75.86, samples=62 iops : min= 3, max= 23, avg=11.45, stdev= 4.73, samples=62 write: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31838msec); 0 zone resets clat (usec): min=1580, max=185397, avg=36388.10, stdev=33719.91 lat (usec): min=1582, max=185401, avg=36391.59, stdev=33720.15 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2278], 10.00th=[ 3851], 20.00th=[ 6652], | 30.00th=[ 11338], 40.00th=[ 20317], 50.00th=[ 27657], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[149947], 99.50th=[164627], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 62, max= 443, per=23.99%, avg=189.79, stdev=72.03, samples=61 iops : min= 3, max= 27, avg=11.05, stdev= 4.58, samples=61 lat (usec) : 50=0.52%, 100=4.69%, 250=0.78%, 500=0.13% lat (msec) : 2=1.56%, 4=3.65%, 10=9.38%, 20=7.29%, 50=39.32% lat (msec) : 100=27.47%, 250=5.21% cpu : usr=0.08%, sys=6.84%, ctx=1850, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180912: Mon Jun 1 15:46:46 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30408msec) clat (usec): min=40, max=286881, avg=43311.37, stdev=31918.90 lat (usec): min=40, max=286882, avg=43312.98, stdev=31919.16 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 66], 10.00th=[ 90], 20.00th=[ 21103], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 65799], 90.00th=[ 78119], 95.00th=[ 89654], | 99.00th=[158335], 99.50th=[183501], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 63, max= 383, per=26.26%, avg=197.48, stdev=77.41, samples=60 iops : min= 3, max= 23, avg=11.53, stdev= 4.83, samples=60 write: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30408msec); 0 zone resets clat (usec): min=1625, max=178570, avg=35440.57, stdev=34162.54 lat (usec): min=1627, max=178573, avg=35446.89, stdev=34158.73 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2933], 10.00th=[ 3982], 20.00th=[ 6390], | 30.00th=[ 9896], 40.00th=[ 17695], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 58459], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[162530], 99.50th=[175113], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 445, per=26.06%, avg=206.13, stdev=91.22, samples=60 iops : min= 1, max= 27, avg=12.07, stdev= 5.70, samples=60 lat (usec) : 50=0.52%, 100=4.95%, 250=1.17%, 500=0.39%, 750=0.13% lat (msec) : 2=1.17%, 4=4.43%, 10=10.03%, 20=8.46%, 50=38.41% lat (msec) : 100=25.91%, 250=4.30%, 500=0.13% cpu : usr=0.07%, sys=6.79%, ctx=1842, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=752KiB/s (770kB/s), 185KiB/s-198KiB/s (190kB/s-203kB/s), io=23.4MiB (24.5MB), run=30408-31838msec WRITE: bw=792KiB/s (811kB/s), 189KiB/s-211KiB/s (194kB/s-216kB/s), io=24.6MiB (25.8MB), run=30408-31838msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180905: Mon Jun 1 15:46:58 2026 read: IOPS=8, BW=138KiB/s (142kB/s)(5920KiB/42752msec) clat (msec): min=7, max=300, avg=45.46, stdev=36.81 lat (msec): min=7, max=300, avg=45.47, stdev=36.81 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 91], 95.00th=[ 136], | 99.00th=[ 186], 99.50th=[ 199], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 352, per=24.97%, avg=138.07, stdev=74.41, samples=83 iops : min= 1, max= 22, avg= 7.83, stdev= 4.76, samples=83 write: IOPS=9, BW=149KiB/s (153kB/s)(6368KiB/42752msec); 0 zone resets clat (msec): min=15, max=223, avg=65.00, stdev=38.55 lat (msec): min=15, max=223, avg=65.01, stdev=38.55 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 118], 95.00th=[ 150], | 99.00th=[ 190], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 30, max= 382, per=25.39%, avg=147.52, stdev=74.71, samples=84 iops : min= 1, max= 23, avg= 8.42, stdev= 4.70, samples=84 lat (msec) : 10=0.39%, 20=8.33%, 50=51.56%, 100=27.21%, 250=12.37% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.48%, ctx=1260, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180906: Mon Jun 1 15:46:58 2026 read: IOPS=8, BW=133KiB/s (137kB/s)(5744KiB/43032msec) clat (msec): min=7, max=225, avg=45.86, stdev=37.27 lat (msec): min=7, max=225, avg=45.86, stdev=37.27 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 106], 95.00th=[ 131], | 99.00th=[ 171], 99.50th=[ 190], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 27, max= 416, per=24.74%, avg=136.83, stdev=81.46, samples=83 iops : min= 1, max= 26, avg= 7.75, stdev= 5.18, samples=83 write: IOPS=9, BW=152KiB/s (156kB/s)(6544KiB/43032msec); 0 zone resets clat (msec): min=15, max=250, avg=64.59, stdev=38.35 lat (msec): min=15, max=250, avg=64.60, stdev=38.35 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 93], 90.00th=[ 120], 95.00th=[ 142], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 351, per=26.06%, avg=151.42, stdev=75.34, samples=85 iops : min= 1, max= 21, avg= 8.66, stdev= 4.74, samples=85 lat (msec) : 10=0.26%, 20=11.33%, 50=47.40%, 100=26.69%, 250=14.19% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.44%, ctx=1286, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180907: Mon Jun 1 15:46:58 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(6256KiB/43303msec) clat (msec): min=9, max=183, avg=44.50, stdev=34.72 lat (msec): min=9, max=183, avg=44.50, stdev=34.72 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 101], 95.00th=[ 126], | 99.00th=[ 159], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 413, per=26.19%, avg=144.82, stdev=94.37, samples=85 iops : min= 1, max= 25, avg= 8.25, stdev= 5.94, samples=85 write: IOPS=8, BW=139KiB/s (143kB/s)(6032KiB/43303msec); 0 zone resets clat (msec): min=19, max=303, avg=68.03, stdev=44.45 lat (msec): min=19, max=303, avg=68.04, stdev=44.45 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 78], 80.00th=[ 96], 90.00th=[ 124], 95.00th=[ 150], | 99.00th=[ 249], 99.50th=[ 253], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 414, per=23.63%, avg=137.29, stdev=68.39, samples=85 iops : min= 1, max= 25, avg= 7.78, stdev= 4.33, samples=85 lat (msec) : 10=0.13%, 20=10.42%, 50=50.26%, 100=25.00%, 250=13.80% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=2.53%, ctx=1310, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180909: Mon Jun 1 15:46:58 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43148msec) clat (msec): min=8, max=198, avg=43.88, stdev=33.23 lat (msec): min=8, max=198, avg=43.88, stdev=33.23 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 121], | 99.00th=[ 167], 99.50th=[ 178], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 351, per=25.68%, avg=142.04, stdev=76.93, samples=83 iops : min= 1, max= 21, avg= 8.08, stdev= 4.81, samples=83 write: IOPS=9, BW=145KiB/s (148kB/s)(6256KiB/43148msec); 0 zone resets clat (msec): min=17, max=309, avg=67.75, stdev=42.92 lat (msec): min=17, max=309, avg=67.75, stdev=42.92 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 78], 80.00th=[ 93], 90.00th=[ 129], 95.00th=[ 155], | 99.00th=[ 230], 99.50th=[ 271], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 384, per=25.21%, avg=146.46, stdev=74.52, samples=84 iops : min= 1, max= 24, avg= 8.36, stdev= 4.70, samples=84 lat (msec) : 10=0.26%, 20=8.98%, 50=49.22%, 100=29.17%, 250=11.98% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=2.58%, ctx=1361, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=553KiB/s (566kB/s), 133KiB/s-144KiB/s (137kB/s-148kB/s), io=23.4MiB (24.5MB), run=42752-43303msec WRITE: bw=582KiB/s (596kB/s), 139KiB/s-152KiB/s (143kB/s-156kB/s), io=24.6MiB (25.8MB), run=42752-43303msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180931: Mon Jun 1 15:47:14 2026 read: IOPS=2, BW=2081KiB/s (2131kB/s)(7168KiB/3444msec) clat (usec): min=524, max=753221, avg=230874.65, stdev=255863.10 lat (usec): min=526, max=753223, avg=230876.27, stdev=255863.05 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 553], | 30.00th=[145753], 40.00th=[145753], 50.00th=[179307], 60.00th=[244319], | 70.00th=[244319], 80.00th=[291505], 90.00th=[750781], 95.00th=[750781], | 99.00th=[750781], 99.50th=[750781], 99.90th=[750781], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 1444, max= 4079, per=59.36%, avg=2296.80, stdev=1023.99, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1487KiB/s (1522kB/s)(5120KiB/3444msec); 0 zone resets clat (msec): min=139, max=532, avg=347.89, stdev=159.90 lat (msec): min=139, max=532, avg=347.95, stdev=159.88 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1996, max= 4096, per=49.92%, avg=2703.67, stdev=1205.85, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=15.16%, ctx=264, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180932: Mon Jun 1 15:47:14 2026 read: IOPS=0, BW=387KiB/s (396kB/s)(2048KiB/5293msec) clat (usec): min=566, max=643677, avg=322122.36, stdev=454748.01 lat (usec): min=568, max=643680, avg=322124.40, stdev=454748.87 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 570], 40.00th=[ 570], 50.00th=[ 570], 60.00th=[641729], | 70.00th=[641729], 80.00th=[641729], 90.00th=[641729], 95.00th=[641729], | 99.00th=[641729], 99.50th=[641729], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 2039, max= 2039, per=52.70%, avg=2039.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1935KiB/s (1981kB/s)(10.0MiB/5293msec); 0 zone resets clat (msec): min=144, max=947, avg=426.80, stdev=258.87 lat (msec): min=144, max=947, avg=426.87, stdev=258.88 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 161], | 30.00th=[ 209], 40.00th=[ 292], 50.00th=[ 321], 60.00th=[ 426], | 70.00th=[ 510], 80.00th=[ 550], 90.00th=[ 718], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1996, max= 4096, per=52.40%, avg=2837.80, stdev=1122.84, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=25.00%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=11.85%, ctx=117, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180933: Mon Jun 1 15:47:14 2026 read: IOPS=1, BW=1884KiB/s (1929kB/s)(6144KiB/3262msec) clat (usec): min=726, max=230102, avg=113376.45, stdev=104042.38 lat (usec): min=728, max=230104, avg=113377.89, stdev=104042.17 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 725], 10.00th=[ 725], 20.00th=[ 1795], | 30.00th=[ 1795], 40.00th=[ 66847], 50.00th=[ 66847], 60.00th=[164627], | 70.00th=[214959], 80.00th=[214959], 90.00th=[229639], 95.00th=[229639], | 99.00th=[229639], 99.50th=[229639], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 2019, max= 4096, per=86.22%, avg=3336.00, stdev=1145.06, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1884KiB/s (1929kB/s)(6144KiB/3262msec); 0 zone resets clat (msec): min=72, max=1042, avg=370.26, stdev=348.66 lat (msec): min=72, max=1042, avg=370.33, stdev=348.66 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 305], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1458, max= 4096, per=42.68%, avg=2311.60, stdev=1025.46, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=16.67%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.03%, sys=14.08%, ctx=205, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180934: Mon Jun 1 15:47:14 2026 read: IOPS=1, BW=1089KiB/s (1115kB/s)(5120KiB/4701msec) clat (usec): min=487, max=704174, avg=248419.90, stdev=289409.30 lat (usec): min=489, max=704175, avg=248421.46, stdev=289409.27 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[225444], 60.00th=[225444], | 70.00th=[312476], 80.00th=[312476], 90.00th=[700449], 95.00th=[700449], | 99.00th=[700449], 99.50th=[700449], 99.90th=[700449], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 2019, max= 6119, per=100.00%, avg=4069.00, stdev=2899.14, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1525KiB/s (1561kB/s)(7168KiB/4701msec); 0 zone resets clat (msec): min=157, max=1023, avg=443.38, stdev=331.09 lat (msec): min=158, max=1025, avg=443.79, stdev=331.35 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 186], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 249], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 667], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1473, max= 2048, per=34.79%, avg=1884.00, stdev=274.82, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=41.67%, 500=8.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=11.94%, ctx=137, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3869KiB/s (3962kB/s), 387KiB/s-2081KiB/s (396kB/s-2131kB/s), io=20.0MiB (20.0MB), run=3262-5293msec WRITE: bw=5417KiB/s (5547kB/s), 1487KiB/s-1935KiB/s (1522kB/s-1981kB/s), io=28.0MiB (29.4MB), run=3262-5293msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180927: Mon Jun 1 15:47:14 2026 read: IOPS=2, BW=2129KiB/s (2180kB/s)(7168KiB/3367msec) clat (msec): min=91, max=553, avg=211.44, stdev=161.19 lat (msec): min=91, max=553, avg=211.44, stdev=161.19 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 102], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 150], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 243], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2031, max= 5976, per=100.00%, avg=4026.00, stdev=1972.88, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1521KiB/s (1557kB/s)(5120KiB/3367msec); 0 zone resets clat (msec): min=127, max=604, avg=369.31, stdev=229.91 lat (msec): min=127, max=604, avg=369.41, stdev=229.94 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1969, max= 2035, per=41.19%, avg=2008.75, stdev=30.77, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=4.75%, ctx=55, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180928: Mon Jun 1 15:47:14 2026 read: IOPS=0, BW=404KiB/s (414kB/s)(2048KiB/5064msec) clat (msec): min=106, max=119, avg=113.11, stdev= 9.17 lat (msec): min=106, max=119, avg=113.11, stdev= 9.17 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 121], | 70.00th=[ 121], 80.00th=[ 121], 90.00th=[ 121], 95.00th=[ 121], | 99.00th=[ 121], 99.50th=[ 121], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 2035, max= 2039, per=58.48%, avg=2037.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2022KiB/s (2071kB/s)(10.0MiB/5064msec); 0 zone resets clat (msec): min=151, max=1016, avg=461.03, stdev=282.54 lat (msec): min=151, max=1016, avg=461.13, stdev=282.54 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 178], | 30.00th=[ 259], 40.00th=[ 262], 50.00th=[ 372], 60.00th=[ 409], | 70.00th=[ 531], 80.00th=[ 659], 90.00th=[ 776], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1969, max= 5437, per=52.99%, avg=2584.50, stdev=1397.68, samples=6 iops : min= 1, max= 5, avg= 1.67, stdev= 1.63, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.90%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180929: Mon Jun 1 15:47:14 2026 read: IOPS=1, BW=1410KiB/s (1444kB/s)(6144KiB/4358msec) clat (msec): min=103, max=1086, avg=346.97, stdev=373.95 lat (msec): min=103, max=1086, avg=346.97, stdev=373.95 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 288], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2035, max= 4047, per=96.63%, avg=3365.67, stdev=1152.50, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1410KiB/s (1444kB/s)(6144KiB/4358msec); 0 zone resets clat (msec): min=129, max=927, avg=371.03, stdev=307.76 lat (msec): min=129, max=927, avg=371.14, stdev=307.75 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 239], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1946, max= 2900, per=44.83%, avg=2186.20, stdev=400.84, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=4.29%, ctx=98, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180930: Mon Jun 1 15:47:14 2026 read: IOPS=0, BW=871KiB/s (892kB/s)(5120KiB/5879msec) clat (msec): min=75, max=1027, avg=488.84, stdev=438.53 lat (msec): min=75, max=1027, avg=488.84, stdev=438.53 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 2023, max= 4071, per=77.80%, avg=2709.67, stdev=1178.96, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1219KiB/s (1249kB/s)(7168KiB/5879msec); 0 zone resets clat (msec): min=126, max=1219, avg=468.68, stdev=411.00 lat (msec): min=126, max=1219, avg=469.00, stdev=410.92 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 144], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 271], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 844], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1372, max= 6119, per=55.33%, avg=2698.40, stdev=1931.77, samples=5 iops : min= 1, max= 5, avg= 2.00, stdev= 1.73, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 1000=16.67%, 2000=16.67% cpu : usr=0.00%, sys=4.61%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3484KiB/s (3567kB/s), 404KiB/s-2129KiB/s (414kB/s-2180kB/s), io=20.0MiB (20.0MB), run=3367-5879msec WRITE: bw=4877KiB/s (4994kB/s), 1219KiB/s-2022KiB/s (1249kB/s-2071kB/s), io=28.0MiB (29.4MB), run=3367-5879msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180941: Mon Jun 1 15:47:29 2026 read: IOPS=0, BW=3654KiB/s (3742kB/s)(12.0MiB/3363msec) clat (msec): min=369, max=1635, avg=1059.41, stdev=640.65 lat (msec): min=369, max=1635, avg=1059.42, stdev=640.65 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7907, max= 8047, per=100.00%, avg=7977.00, stdev=98.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.16%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180943: Mon Jun 1 15:47:29 2026 read: IOPS=0, BW=1318KiB/s (1350kB/s)(4096KiB/3108msec) clat (nsec): min=425102k, max=425102k, avg=425101883.00, stdev= 0.00 lat (nsec): min=425105k, max=425105k, avg=425104652.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 6272, max= 6272, per=100.00%, avg=6272.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2636KiB/s (2699kB/s)(8192KiB/3108msec); 0 zone resets clat (msec): min=866, max=1755, avg=1310.87, stdev=628.42 lat (msec): min=867, max=1755, avg=1311.81, stdev=627.66 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8078, max= 8078, per=76.62%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.13%, sys=4.31%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180945: Mon Jun 1 15:47:29 2026 write: IOPS=1, BW=4553KiB/s (4662kB/s)(12.0MiB/2699msec); 0 zone resets clat (msec): min=399, max=1309, avg=879.24, stdev=457.00 lat (msec): min=399, max=1309, avg=880.74, stdev=457.09 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7907, max= 8110, per=75.96%, avg=8008.50, stdev=143.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.63%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180947: Mon Jun 1 15:47:29 2026 write: IOPS=1, BW=4230KiB/s (4331kB/s)(12.0MiB/2905msec); 0 zone resets clat (msec): min=398, max=1543, avg=904.90, stdev=583.74 lat (msec): min=398, max=1543, avg=905.22, stdev=583.80 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7907, max= 8110, per=75.96%, avg=8008.50, stdev=143.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.55%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4872KiB/s (4989kB/s), 1318KiB/s-3654KiB/s (1350kB/s-3742kB/s), io=16.0MiB (16.8MB), run=3108-3363msec WRITE: bw=10.3MiB/s (10.8MB/s), 2636KiB/s-4553KiB/s (2699kB/s-4662kB/s), io=32.0MiB (33.6MB), run=2699-3108msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180942: Mon Jun 1 15:47:29 2026 read: IOPS=1, BW=5411KiB/s (5541kB/s)(12.0MiB/2271msec) clat (msec): min=652, max=849, avg=742.92, stdev=99.58 lat (msec): min=652, max=849, avg=742.92, stdev=99.58 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.81%, ctx=408, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180944: Mon Jun 1 15:47:29 2026 read: IOPS=0, BW=1198KiB/s (1226kB/s)(4096KiB/3420msec) clat (nsec): min=474016k, max=474016k, avg=474015842.00, stdev= 0.00 lat (nsec): min=474018k, max=474018k, avg=474018427.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2395KiB/s (2453kB/s)(8192KiB/3420msec); 0 zone resets clat (msec): min=876, max=1907, avg=1392.02, stdev=729.10 lat (msec): min=878, max=1907, avg=1393.14, stdev=727.96 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 1905], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8192, max= 8192, per=87.56%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.80%, ctx=109, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180946: Mon Jun 1 15:47:29 2026 write: IOPS=0, BW=3509KiB/s (3593kB/s)(12.0MiB/3502msec); 0 zone resets clat (msec): min=220, max=1847, avg=1124.08, stdev=828.01 lat (msec): min=222, max=1847, avg=1124.67, stdev=827.55 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8192, max= 8192, per=87.56%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.26%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180948: Mon Jun 1 15:47:29 2026 write: IOPS=1, BW=5444KiB/s (5575kB/s)(12.0MiB/2257msec); 0 zone resets clat (msec): min=556, max=943, avg=691.39, stdev=218.67 lat (msec): min=556, max=943, avg=691.67, stdev=218.57 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8031, max= 8192, per=86.70%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.62%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4791KiB/s (4906kB/s), 1198KiB/s-5411KiB/s (1226kB/s-5541kB/s), io=16.0MiB (16.8MB), run=2271-3420msec WRITE: bw=9357KiB/s (9582kB/s), 2395KiB/s-5444KiB/s (2453kB/s-5575kB/s), io=32.0MiB (33.6MB), run=2257-3502msec