== sanity test 398b: DIO and buffer IO race ============== 03:26:55 (1775201215) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.74513 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182940: Fri Apr 3 03:29:31 2026 read: IOPS=11, BW=44.8KiB/s (45.9kB/s)(5992KiB/133678msec) clat (usec): min=34, max=250587, avg=48070.43, stdev=29464.03 lat (usec): min=34, max=250589, avg=48071.90, stdev=29464.09 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 13042], 10.00th=[ 19530], 20.00th=[ 25297], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[164627], 99.90th=[240124], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 7, max= 93, per=24.78%, avg=44.35, stdev=16.84, samples=262 iops : min= 1, max= 23, avg=10.43, stdev= 4.24, samples=262 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6296KiB/133678msec); 0 zone resets clat (usec): min=1153, max=937636, avg=38857.24, stdev=44238.61 lat (usec): min=1156, max=937638, avg=38862.80, stdev=44243.43 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1434], 10.00th=[ 2147], 20.00th=[ 4686], | 30.00th=[ 9634], 40.00th=[ 19268], 50.00th=[ 28181], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[164627], 99.50th=[191890], 99.90th=[258999], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 126, per=24.94%, avg=46.88, stdev=20.00, samples=261 iops : min= 1, max= 31, avg=11.07, stdev= 5.03, samples=261 lat (usec) : 50=0.10%, 100=1.40%, 250=0.07%, 500=0.03%, 750=0.03% lat (msec) : 2=4.75%, 4=4.65%, 10=6.58%, 20=8.43%, 50=39.13% lat (msec) : 100=28.35%, 250=6.38%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.31%, ctx=6725, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182943: Fri Apr 3 03:29:31 2026 read: IOPS=11, BW=44.7KiB/s (45.8kB/s)(5940KiB/132823msec) clat (usec): min=39, max=318794, avg=48521.91, stdev=29185.57 lat (usec): min=39, max=318795, avg=48523.42, stdev=29185.74 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 14877], 10.00th=[ 20055], 20.00th=[ 25822], | 30.00th=[ 30540], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 58459], 80.00th=[ 68682], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[139461], 99.50th=[156238], 99.90th=[242222], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 5, max= 95, per=24.75%, avg=44.30, stdev=16.47, samples=261 iops : min= 1, max= 23, avg=10.42, stdev= 4.13, samples=261 write: IOPS=11, BW=47.8KiB/s (48.9kB/s)(6348KiB/132823msec); 0 zone resets clat (usec): min=1027, max=994468, avg=37999.74, stdev=45401.01 lat (usec): min=1027, max=994470, avg=38004.88, stdev=45403.55 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1401], 10.00th=[ 1860], 20.00th=[ 4490], | 30.00th=[ 8848], 40.00th=[ 17957], 50.00th=[ 28443], 60.00th=[ 36963], | 70.00th=[ 46924], 80.00th=[ 63701], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[170918], 99.50th=[229639], 99.90th=[316670], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 111, per=25.22%, avg=47.42, stdev=19.75, samples=261 iops : min= 1, max= 27, avg=11.21, stdev= 4.96, samples=261 lat (usec) : 50=0.07%, 100=1.17%, 250=0.10%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.47%, 4=4.20%, 10=6.93%, 20=8.30%, 50=39.68% lat (msec) : 100=27.93%, 250=5.96%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=5.42%, ctx=6606, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182944: Fri Apr 3 03:29:31 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6028KiB/129368msec) clat (usec): min=47, max=276015, avg=47080.85, stdev=29278.99 lat (usec): min=48, max=276017, avg=47088.63, stdev=29274.23 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11338], 10.00th=[ 18220], 20.00th=[ 25297], | 30.00th=[ 30802], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 56361], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[ 96994], | 99.00th=[147850], 99.50th=[160433], 99.90th=[231736], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 103, per=25.96%, avg=46.47, stdev=16.68, samples=253 iops : min= 1, max= 25, avg=10.96, stdev= 4.20, samples=253 write: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6260KiB/129368msec); 0 zone resets clat (usec): min=1084, max=997273, avg=36990.44, stdev=44375.32 lat (usec): min=1084, max=997276, avg=36993.68, stdev=44374.40 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1418], 10.00th=[ 1762], 20.00th=[ 4293], | 30.00th=[ 7767], 40.00th=[ 15926], 50.00th=[ 27919], 60.00th=[ 35914], | 70.00th=[ 47449], 80.00th=[ 62653], 90.00th=[ 85459], 95.00th=[108528], | 99.00th=[166724], 99.50th=[204473], 99.90th=[263193], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 133, per=25.64%, avg=48.20, stdev=19.31, samples=253 iops : min= 1, max= 33, avg=11.40, stdev= 4.90, samples=253 lat (usec) : 50=0.10%, 100=1.63%, 250=0.33%, 500=0.03%, 750=0.07% lat (msec) : 2=5.92%, 4=3.78%, 10=7.26%, 20=8.72%, 50=39.13% lat (msec) : 100=27.60%, 250=5.34%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.41%, ctx=6717, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182946: Fri Apr 3 03:29:31 2026 read: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6052KiB/133307msec) clat (usec): min=31, max=1021.5k, avg=49590.04, stdev=40398.73 lat (usec): min=31, max=1021.5k, avg=49593.42, stdev=40398.46 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 13173], 10.00th=[ 20317], | 20.00th=[ 26346], 30.00th=[ 31065], 40.00th=[ 36439], | 50.00th=[ 42730], 60.00th=[ 49021], 70.00th=[ 57934], | 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[ 106431], | 99.00th=[ 164627], 99.50th=[ 187696], 99.90th=[ 367002], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 102, per=25.28%, avg=45.26, stdev=16.33, samples=261 iops : min= 1, max= 25, avg=10.65, stdev= 4.11, samples=261 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6236KiB/133307msec); 0 zone resets clat (usec): min=1168, max=219912, avg=37101.18, stdev=36882.14 lat (usec): min=1170, max=219913, avg=37106.67, stdev=36883.05 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1418], 10.00th=[ 2212], 20.00th=[ 4883], | 30.00th=[ 9372], 40.00th=[ 18220], 50.00th=[ 26870], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 62653], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[160433], 99.50th=[187696], 99.90th=[210764], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 111, per=24.71%, avg=46.46, stdev=19.63, samples=262 iops : min= 1, max= 27, avg=10.95, stdev= 4.93, samples=262 lat (usec) : 50=0.26%, 100=1.37%, 250=0.23%, 500=0.07%, 750=0.03% lat (msec) : 2=4.62%, 4=4.00%, 10=7.19%, 20=8.11%, 50=40.36% lat (msec) : 100=27.05%, 250=6.64%, 500=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.25%, ctx=6702, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=180KiB/s (184kB/s), 44.7KiB/s-46.6KiB/s (45.8kB/s-47.7kB/s), io=23.4MiB (24.6MB), run=129368-133678msec WRITE: bw=188KiB/s (193kB/s), 46.8KiB/s-48.4KiB/s (47.9kB/s-49.6kB/s), io=24.6MiB (25.7MB), run=129368-133678msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182939: Fri Apr 3 03:30:16 2026 read: IOPS=8, BW=33.7KiB/s (34.5kB/s)(5992KiB/178013msec) clat (msec): min=7, max=882, avg=45.83, stdev=44.44 lat (msec): min=7, max=882, avg=45.83, stdev=44.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 99], 95.00th=[ 126], | 99.00th=[ 201], 99.50th=[ 234], 99.90th=[ 275], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 134, per=25.50%, avg=34.17, stdev=22.40, samples=341 iops : min= 1, max= 33, avg= 7.88, stdev= 5.64, samples=341 write: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6296KiB/178013msec); 0 zone resets clat (msec): min=14, max=416, avg=69.16, stdev=46.10 lat (msec): min=14, max=416, avg=69.17, stdev=46.10 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 101], 90.00th=[ 129], 95.00th=[ 161], | 99.00th=[ 230], 99.50th=[ 262], 99.90th=[ 363], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 96, per=24.99%, avg=35.24, stdev=20.63, samples=347 iops : min= 1, max= 24, avg= 8.15, stdev= 5.19, samples=347 lat (msec) : 10=1.14%, 20=10.81%, 50=46.91%, 100=26.27%, 250=14.32% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.06%, sys=2.13%, ctx=4912, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182941: Fri Apr 3 03:30:16 2026 read: IOPS=8, BW=33.3KiB/s (34.1kB/s)(5940KiB/178194msec) clat (msec): min=6, max=970, avg=44.88, stdev=44.42 lat (msec): min=6, max=970, avg=44.88, stdev=44.42 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 96], 95.00th=[ 124], | 99.00th=[ 188], 99.50th=[ 224], 99.90th=[ 288], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 128, per=25.24%, avg=33.82, stdev=22.65, samples=341 iops : min= 1, max= 32, avg= 7.79, stdev= 5.69, samples=341 write: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6348KiB/178194msec); 0 zone resets clat (msec): min=17, max=381, avg=69.97, stdev=46.08 lat (msec): min=17, max=381, avg=69.97, stdev=46.08 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 81], 80.00th=[ 102], 90.00th=[ 134], 95.00th=[ 163], | 99.00th=[ 234], 99.50th=[ 268], 99.90th=[ 355], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 102, per=24.93%, avg=35.15, stdev=20.50, samples=350 iops : min= 1, max= 25, avg= 8.12, stdev= 5.15, samples=350 lat (msec) : 10=0.78%, 20=10.64%, 50=47.20%, 100=26.53%, 250=14.32% lat (msec) : 500=0.49%, 1000=0.03% cpu : usr=0.06%, sys=2.11%, ctx=4994, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182942: Fri Apr 3 03:30:16 2026 read: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6028KiB/176876msec) clat (msec): min=7, max=293, avg=45.15, stdev=38.03 lat (msec): min=7, max=293, avg=45.15, stdev=38.03 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 99], 95.00th=[ 127], | 99.00th=[ 182], 99.50th=[ 199], 99.90th=[ 284], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 120, per=25.65%, avg=34.37, stdev=21.10, samples=341 iops : min= 1, max= 30, avg= 7.92, stdev= 5.30, samples=341 write: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6260KiB/176876msec); 0 zone resets clat (msec): min=16, max=1022, avg=69.26, stdev=50.80 lat (msec): min=16, max=1022, avg=69.27, stdev=50.79 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 100], 90.00th=[ 129], 95.00th=[ 157], | 99.00th=[ 224], 99.50th=[ 275], 99.90th=[ 422], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 95, per=25.11%, avg=35.40, stdev=20.39, samples=344 iops : min= 1, max= 23, avg= 8.19, stdev= 5.13, samples=344 lat (msec) : 10=0.68%, 20=10.87%, 50=47.30%, 100=26.50%, 250=14.19% lat (msec) : 500=0.42%, 2000=0.03% cpu : usr=0.07%, sys=2.19%, ctx=5025, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182945: Fri Apr 3 03:30:16 2026 read: IOPS=8, BW=33.9KiB/s (34.8kB/s)(6052KiB/178292msec) clat (msec): min=5, max=415, avg=46.07, stdev=41.39 lat (msec): min=5, max=415, avg=46.08, stdev=41.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 67], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 230], 99.90th=[ 271], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 124, per=25.84%, avg=34.63, stdev=22.46, samples=339 iops : min= 1, max= 31, avg= 7.98, stdev= 5.65, samples=339 write: IOPS=8, BW=34.0KiB/s (35.8kB/s)(6236KiB/178292msec); 0 zone resets clat (msec): min=14, max=1013, avg=69.37, stdev=51.93 lat (msec): min=14, max=1013, avg=69.38, stdev=51.93 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 243], 99.50th=[ 271], 99.90th=[ 384], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 103, per=24.74%, avg=34.89, stdev=19.97, samples=346 iops : min= 1, max= 25, avg= 8.05, stdev= 5.00, samples=346 lat (msec) : 10=1.04%, 20=11.43%, 50=46.26%, 100=25.94%, 250=14.75% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.06%, sys=2.17%, ctx=4999, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=135KiB/s (138kB/s), 33.3KiB/s-34.1KiB/s (34.1kB/s-34.9kB/s), io=23.4MiB (24.6MB), run=176876-178292msec WRITE: bw=141KiB/s (144kB/s), 34.0KiB/s-35.6KiB/s (35.8kB/s-36.5kB/s), io=24.6MiB (25.7MB), run=176876-178292msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182997: Fri Apr 3 03:31:10 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(5920KiB/40144msec) clat (usec): min=44, max=273655, avg=58124.97, stdev=42697.83 lat (usec): min=44, max=273658, avg=58126.63, stdev=42697.88 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 69], 10.00th=[ 110], 20.00th=[ 26870], | 30.00th=[ 36963], 40.00th=[ 42730], 50.00th=[ 52691], 60.00th=[ 60031], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[109577], 95.00th=[139461], | 99.00th=[233833], 99.50th=[258999], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 318, per=25.66%, avg=146.76, stdev=61.78, samples=79 iops : min= 1, max= 19, avg= 8.38, stdev= 3.96, samples=79 write: IOPS=9, BW=159KiB/s (162kB/s)(6368KiB/40144msec); 0 zone resets clat (usec): min=1508, max=275132, avg=46599.45, stdev=44853.09 lat (usec): min=1514, max=275136, avg=46603.72, stdev=44853.57 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2089], 10.00th=[ 4424], 20.00th=[ 8848], | 30.00th=[ 15139], 40.00th=[ 23200], 50.00th=[ 32900], 60.00th=[ 46924], | 70.00th=[ 58983], 80.00th=[ 77071], 90.00th=[106431], 95.00th=[143655], | 99.00th=[204473], 99.50th=[235930], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 382, per=26.34%, avg=158.56, stdev=75.81, samples=79 iops : min= 1, max= 23, avg= 9.13, stdev= 4.78, samples=79 lat (usec) : 50=0.39%, 100=4.04%, 250=1.04% lat (msec) : 2=2.34%, 4=2.60%, 10=7.16%, 20=8.33%, 50=29.95% lat (msec) : 100=31.12%, 250=12.63%, 500=0.39% cpu : usr=0.06%, sys=5.18%, ctx=1697, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182998: Fri Apr 3 03:31:10 2026 read: IOPS=8, BW=137KiB/s (141kB/s)(5744KiB/41851msec) clat (usec): min=48, max=296289, avg=60617.63, stdev=40206.77 lat (usec): min=49, max=296291, avg=60621.55, stdev=40208.38 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 83], 10.00th=[ 19792], 20.00th=[ 31851], | 30.00th=[ 39060], 40.00th=[ 46924], 50.00th=[ 54264], 60.00th=[ 63177], | 70.00th=[ 71828], 80.00th=[ 84411], 90.00th=[107480], 95.00th=[135267], | 99.00th=[200279], 99.50th=[246416], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 379, per=23.65%, avg=135.28, stdev=70.67, samples=82 iops : min= 1, max= 23, avg= 7.66, stdev= 4.51, samples=82 write: IOPS=9, BW=156KiB/s (160kB/s)(6544KiB/41851msec); 0 zone resets clat (usec): min=1564, max=319338, avg=48921.68, stdev=50414.85 lat (usec): min=1566, max=319339, avg=48924.99, stdev=50415.58 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2343], 10.00th=[ 4178], 20.00th=[ 7898], | 30.00th=[ 14615], 40.00th=[ 22676], 50.00th=[ 34866], 60.00th=[ 44827], | 70.00th=[ 59507], 80.00th=[ 80217], 90.00th=[115868], 95.00th=[143655], | 99.00th=[229639], 99.50th=[261096], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 350, per=25.67%, avg=154.56, stdev=66.78, samples=82 iops : min= 1, max= 21, avg= 8.87, stdev= 4.22, samples=82 lat (usec) : 50=0.13%, 100=2.60%, 250=0.39%, 500=0.13% lat (msec) : 2=1.69%, 4=3.52%, 10=7.68%, 20=8.20%, 50=30.47% lat (msec) : 100=31.64%, 250=13.02%, 500=0.52% cpu : usr=0.05%, sys=5.21%, ctx=1768, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182999: Fri Apr 3 03:31:10 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(6256KiB/41048msec) clat (usec): min=43, max=304130, avg=58097.02, stdev=40603.86 lat (usec): min=43, max=304131, avg=58098.57, stdev=40603.87 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 18482], 20.00th=[ 28181], | 30.00th=[ 35390], 40.00th=[ 43254], 50.00th=[ 49021], 60.00th=[ 58459], | 70.00th=[ 71828], 80.00th=[ 87557], 90.00th=[107480], 95.00th=[131597], | 99.00th=[202376], 99.50th=[258999], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 416, per=26.61%, avg=152.23, stdev=67.35, samples=81 iops : min= 1, max= 26, avg= 8.73, stdev= 4.32, samples=81 write: IOPS=9, BW=147KiB/s (150kB/s)(6032KiB/41048msec); 0 zone resets clat (usec): min=1737, max=207212, avg=48503.25, stdev=44551.74 lat (usec): min=1739, max=207214, avg=48505.93, stdev=44551.75 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2638], 10.00th=[ 4686], 20.00th=[ 9503], | 30.00th=[ 17171], 40.00th=[ 26870], 50.00th=[ 37487], 60.00th=[ 46400], | 70.00th=[ 58983], 80.00th=[ 79168], 90.00th=[116917], 95.00th=[147850], | 99.00th=[183501], 99.50th=[196084], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 318, per=24.50%, avg=147.51, stdev=63.61, samples=80 iops : min= 1, max= 19, avg= 8.43, stdev= 4.04, samples=80 lat (usec) : 50=0.26%, 100=3.39%, 250=0.26%, 500=0.26% lat (msec) : 2=1.43%, 4=3.39%, 10=6.51%, 20=5.60%, 50=36.46% lat (msec) : 100=29.04%, 250=13.15%, 500=0.26% cpu : usr=0.07%, sys=5.44%, ctx=1778, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183000: Fri Apr 3 03:31:10 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(6032KiB/38580msec) clat (usec): min=40, max=254889, avg=58417.76, stdev=42507.17 lat (usec): min=41, max=254891, avg=58420.81, stdev=42509.02 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 70], 10.00th=[ 108], 20.00th=[ 25822], | 30.00th=[ 35390], 40.00th=[ 45351], 50.00th=[ 53740], 60.00th=[ 61604], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[113771], 95.00th=[129500], | 99.00th=[210764], 99.50th=[240124], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 416, per=27.11%, avg=155.09, stdev=69.69, samples=76 iops : min= 1, max= 26, avg= 8.92, stdev= 4.44, samples=76 write: IOPS=10, BW=162KiB/s (166kB/s)(6256KiB/38580msec); 0 zone resets clat (usec): min=1747, max=249155, avg=42140.50, stdev=39893.99 lat (usec): min=1750, max=249158, avg=42143.25, stdev=39894.13 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2278], 10.00th=[ 4015], 20.00th=[ 7767], | 30.00th=[ 12387], 40.00th=[ 21627], 50.00th=[ 31065], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[185598], 99.50th=[223347], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 408, per=27.30%, avg=164.33, stdev=77.61, samples=75 iops : min= 1, max= 25, avg= 9.49, stdev= 4.94, samples=75 lat (usec) : 50=0.52%, 100=4.17%, 250=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.82%, 4=3.52%, 10=6.90%, 20=10.03%, 50=28.13% lat (msec) : 100=33.46%, 250=10.55%, 500=0.13% cpu : usr=0.06%, sys=5.44%, ctx=1724, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=572KiB/s (586kB/s), 137KiB/s-156KiB/s (141kB/s-160kB/s), io=23.4MiB (24.5MB), run=38580-41851msec WRITE: bw=602KiB/s (617kB/s), 147KiB/s-162KiB/s (150kB/s-166kB/s), io=24.6MiB (25.8MB), run=38580-41851msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182992: Fri Apr 3 03:31:22 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(5920KiB/55559msec) clat (msec): min=8, max=339, avg=57.14, stdev=51.00 lat (msec): min=8, max=339, avg=57.15, stdev=51.00 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 48], | 70.00th=[ 58], 80.00th=[ 79], 90.00th=[ 125], 95.00th=[ 169], | 99.00th=[ 271], 99.50th=[ 296], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 318, per=25.37%, avg=109.34, stdev=65.65, samples=104 iops : min= 1, max= 19, avg= 5.98, stdev= 4.13, samples=104 write: IOPS=7, BW=115KiB/s (117kB/s)(6368KiB/55559msec); 0 zone resets clat (msec): min=18, max=319, avg=85.87, stdev=53.67 lat (msec): min=18, max=319, avg=85.87, stdev=53.67 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 36], 20.00th=[ 44], | 30.00th=[ 52], 40.00th=[ 61], 50.00th=[ 70], 60.00th=[ 83], | 70.00th=[ 99], 80.00th=[ 123], 90.00th=[ 159], 95.00th=[ 197], | 99.00th=[ 284], 99.50th=[ 313], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 318, per=26.17%, avg=118.55, stdev=62.34, samples=104 iops : min= 1, max= 19, avg= 6.55, stdev= 3.93, samples=104 lat (msec) : 10=0.13%, 20=7.03%, 50=36.85%, 100=34.64%, 250=19.66% lat (msec) : 500=1.69% cpu : usr=0.04%, sys=1.85%, ctx=1259, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182993: Fri Apr 3 03:31:22 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(5744KiB/55266msec) clat (msec): min=8, max=342, avg=57.11, stdev=52.13 lat (msec): min=8, max=342, avg=57.12, stdev=52.13 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 74], 90.00th=[ 138], 95.00th=[ 167], | 99.00th=[ 284], 99.50th=[ 300], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 377, per=25.52%, avg=109.98, stdev=66.98, samples=102 iops : min= 1, max= 23, avg= 6.01, stdev= 4.25, samples=102 write: IOPS=7, BW=118KiB/s (121kB/s)(6544KiB/55266msec); 0 zone resets clat (msec): min=16, max=359, avg=84.79, stdev=57.73 lat (msec): min=16, max=359, avg=84.80, stdev=57.73 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 49], 40.00th=[ 57], 50.00th=[ 66], 60.00th=[ 79], | 70.00th=[ 95], 80.00th=[ 124], 90.00th=[ 167], 95.00th=[ 197], | 99.00th=[ 292], 99.50th=[ 347], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 349, per=26.48%, avg=119.93, stdev=70.54, samples=107 iops : min= 1, max= 21, avg= 6.64, stdev= 4.44, samples=107 lat (msec) : 10=0.13%, 20=6.51%, 50=41.02%, 100=30.86%, 250=19.53% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.82%, ctx=1228, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182994: Fri Apr 3 03:31:22 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(6256KiB/55120msec) clat (msec): min=9, max=363, avg=56.40, stdev=45.76 lat (msec): min=9, max=363, avg=56.40, stdev=45.77 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 82], 90.00th=[ 115], 95.00th=[ 163], | 99.00th=[ 220], 99.50th=[ 259], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 381, per=27.03%, avg=116.50, stdev=77.58, samples=105 iops : min= 1, max= 23, avg= 6.43, stdev= 4.88, samples=105 write: IOPS=6, BW=109KiB/s (112kB/s)(6032KiB/55120msec); 0 zone resets clat (msec): min=21, max=348, avg=86.96, stdev=56.29 lat (msec): min=21, max=348, avg=86.97, stdev=56.28 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 81], | 70.00th=[ 104], 80.00th=[ 130], 90.00th=[ 171], 95.00th=[ 199], | 99.00th=[ 271], 99.50th=[ 313], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 351, per=24.56%, avg=111.25, stdev=57.50, samples=104 iops : min= 1, max= 21, avg= 6.10, stdev= 3.61, samples=104 lat (msec) : 10=0.13%, 20=5.60%, 50=40.62%, 100=31.12%, 250=21.48% lat (msec) : 500=1.04% cpu : usr=0.07%, sys=2.14%, ctx=1262, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182995: Fri Apr 3 03:31:22 2026 read: IOPS=6, BW=111KiB/s (113kB/s)(6032KiB/54557msec) clat (msec): min=8, max=289, avg=54.25, stdev=41.73 lat (msec): min=8, max=289, avg=54.25, stdev=41.73 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 57], 80.00th=[ 75], 90.00th=[ 113], 95.00th=[ 144], | 99.00th=[ 197], 99.50th=[ 275], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 411, per=25.90%, avg=111.65, stdev=78.41, samples=105 iops : min= 1, max= 25, avg= 6.16, stdev= 4.95, samples=105 write: IOPS=7, BW=115KiB/s (117kB/s)(6256KiB/54557msec); 0 zone resets clat (msec): min=19, max=354, avg=86.69, stdev=56.81 lat (msec): min=19, max=354, avg=86.71, stdev=56.80 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 44], | 30.00th=[ 53], 40.00th=[ 61], 50.00th=[ 68], 60.00th=[ 83], | 70.00th=[ 96], 80.00th=[ 125], 90.00th=[ 159], 95.00th=[ 201], | 99.00th=[ 317], 99.50th=[ 347], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 286, per=25.42%, avg=115.17, stdev=64.53, samples=106 iops : min= 1, max= 17, avg= 6.39, stdev= 4.08, samples=106 lat (msec) : 10=0.13%, 20=5.86%, 50=37.89%, 100=35.29%, 250=19.40% lat (msec) : 500=1.43% cpu : usr=0.07%, sys=2.05%, ctx=1281, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=431KiB/s (441kB/s), 104KiB/s-113KiB/s (106kB/s-116kB/s), io=23.4MiB (24.5MB), run=54557-55559msec WRITE: bw=454KiB/s (464kB/s), 109KiB/s-118KiB/s (112kB/s-121kB/s), io=24.6MiB (25.8MB), run=54557-55559msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183014: Fri Apr 3 03:31:39 2026 read: IOPS=1, BW=1534KiB/s (1570kB/s)(7168KiB/4674msec) clat (msec): min=15, max=554, avg=284.32, stdev=156.48 lat (msec): min=15, max=554, avg=284.32, stdev=156.48 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 16], 10.00th=[ 16], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 309], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1484, max= 4039, per=83.55%, avg=2899.25, stdev=1331.16, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1095KiB/s (1122kB/s)(5120KiB/4674msec); 0 zone resets clat (msec): min=221, max=883, avg=455.97, stdev=254.94 lat (msec): min=221, max=883, avg=456.80, stdev=254.79 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1988, max= 2043, per=41.59%, avg=2020.25, stdev=24.51, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 20=8.33%, 250=8.33%, 500=66.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.68%, ctx=254, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183015: Fri Apr 3 03:31:39 2026 read: IOPS=0, BW=363KiB/s (372kB/s)(2048KiB/5639msec) clat (msec): min=189, max=393, avg=291.39, stdev=144.21 lat (msec): min=189, max=393, avg=291.39, stdev=144.21 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1510, max= 2035, per=51.08%, avg=1772.50, stdev=371.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1816KiB/s (1860kB/s)(10.0MiB/5639msec); 0 zone resets clat (msec): min=206, max=1087, avg=501.15, stdev=273.01 lat (msec): min=206, max=1088, avg=501.44, stdev=273.00 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 211], | 30.00th=[ 338], 40.00th=[ 376], 50.00th=[ 409], 60.00th=[ 510], | 70.00th=[ 514], 80.00th=[ 542], 90.00th=[ 818], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1510, max= 4039, per=51.46%, avg=2499.71, stdev=1028.73, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.96%, ctx=136, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183016: Fri Apr 3 03:31:39 2026 read: IOPS=1, BW=1254KiB/s (1284kB/s)(6144KiB/4898msec) clat (usec): min=594, max=644650, avg=271789.38, stdev=248875.58 lat (usec): min=596, max=644650, avg=271790.72, stdev=248875.04 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[252707], 50.00th=[252707], 60.00th=[312476], | 70.00th=[417334], 80.00th=[417334], 90.00th=[641729], 95.00th=[641729], | 99.00th=[641729], 99.50th=[641729], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 1961, max= 2043, per=57.59%, avg=1998.20, stdev=31.54, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1254KiB/s (1284kB/s)(6144KiB/4898msec); 0 zone resets clat (msec): min=206, max=976, avg=516.29, stdev=297.60 lat (msec): min=206, max=976, avg=516.62, stdev=297.52 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 472], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1481, max= 3923, per=47.35%, avg=2300.20, stdev=938.12, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=8.33%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=9.94%, ctx=168, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183017: Fri Apr 3 03:31:39 2026 read: IOPS=0, BW=868KiB/s (888kB/s)(5120KiB/5901msec) clat (usec): min=578, max=893921, avg=278757.88, stdev=362901.19 lat (usec): min=580, max=893921, avg=278759.17, stdev=362900.66 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 21103], 40.00th=[ 21103], 50.00th=[210764], 60.00th=[210764], | 70.00th=[267387], 80.00th=[267387], 90.00th=[893387], 95.00th=[893387], | 99.00th=[893387], 99.50th=[893387], 99.90th=[893387], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 2035, max= 5953, per=100.00%, avg=3994.00, stdev=2770.44, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1215KiB/s (1244kB/s)(7168KiB/5901msec); 0 zone resets clat (msec): min=242, max=1018, avg=596.73, stdev=297.13 lat (msec): min=243, max=1018, avg=596.84, stdev=297.13 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 271], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 550], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 902], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 2015, max= 4071, per=58.44%, avg=2839.00, stdev=1117.41, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=16.67%, 500=25.00%, 750=16.67%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=8.05%, ctx=140, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3471KiB/s (3554kB/s), 363KiB/s-1534KiB/s (372kB/s-1570kB/s), io=20.0MiB (20.0MB), run=4674-5901msec WRITE: bw=4859KiB/s (4975kB/s), 1095KiB/s-1816KiB/s (1122kB/s-1860kB/s), io=28.0MiB (29.4MB), run=4674-5901msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183019: Fri Apr 3 03:31:39 2026 read: IOPS=1, BW=1255KiB/s (1285kB/s)(7168KiB/5710msec) clat (msec): min=75, max=1261, avg=448.46, stdev=404.12 lat (msec): min=75, max=1261, avg=448.46, stdev=404.12 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 239], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 693], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1414, max= 4015, per=68.61%, avg=2265.40, stdev=1008.66, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=897KiB/s (918kB/s)(5120KiB/5710msec); 0 zone resets clat (msec): min=235, max=627, avg=463.45, stdev=145.00 lat (msec): min=235, max=638, avg=465.69, stdev=148.06 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1935, max= 2027, per=42.60%, avg=1969.50, stdev=41.68, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=25.00%, 2000=8.33% cpu : usr=0.04%, sys=3.54%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183020: Fri Apr 3 03:31:39 2026 read: IOPS=0, BW=330KiB/s (338kB/s)(2048KiB/6202msec) clat (msec): min=247, max=399, avg=323.63, stdev=107.66 lat (msec): min=247, max=399, avg=323.63, stdev=107.66 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1783, max= 1921, per=56.09%, avg=1852.00, stdev=97.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1651KiB/s (1691kB/s)(10.0MiB/6202msec); 0 zone resets clat (msec): min=105, max=910, avg=549.04, stdev=247.71 lat (msec): min=105, max=910, avg=549.22, stdev=247.68 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 317], | 30.00th=[ 372], 40.00th=[ 426], 50.00th=[ 567], 60.00th=[ 584], | 70.00th=[ 684], 80.00th=[ 693], 90.00th=[ 835], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1961, max= 2043, per=43.31%, avg=2002.00, stdev=27.78, samples=7 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=7 lat (msec) : 250=16.67%, 500=33.33%, 750=33.33%, 1000=16.67% cpu : usr=0.02%, sys=4.29%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183021: Fri Apr 3 03:31:39 2026 read: IOPS=1, BW=1057KiB/s (1082kB/s)(6144KiB/5814msec) clat (msec): min=106, max=617, avg=308.95, stdev=213.59 lat (msec): min=106, max=617, avg=308.95, stdev=213.59 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1935, max= 2003, per=59.46%, avg=1963.50, stdev=31.00, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1057KiB/s (1082kB/s)(6144KiB/5814msec); 0 zone resets clat (msec): min=190, max=981, avg=601.53, stdev=274.59 lat (msec): min=191, max=981, avg=602.21, stdev=274.28 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 684], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1868, max= 2027, per=42.84%, avg=1980.40, stdev=66.59, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=4.59%, ctx=126, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183022: Fri Apr 3 03:31:39 2026 read: IOPS=0, BW=907KiB/s (929kB/s)(5120KiB/5644msec) clat (msec): min=200, max=1336, avg=493.08, stdev=480.64 lat (msec): min=200, max=1336, avg=493.08, stdev=480.64 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1943, max= 4007, per=79.98%, avg=2641.00, stdev=1183.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1270KiB/s (1301kB/s)(7168KiB/5644msec); 0 zone resets clat (msec): min=165, max=655, avg=433.99, stdev=217.97 lat (msec): min=165, max=656, avg=434.16, stdev=218.05 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 188], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 634], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1422, max= 4055, per=49.52%, avg=2289.20, stdev=1017.83, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, 2000=8.33% cpu : usr=0.00%, sys=2.87%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3302KiB/s (3381kB/s), 330KiB/s-1255KiB/s (338kB/s-1285kB/s), io=20.0MiB (20.0MB), run=5644-6202msec WRITE: bw=4623KiB/s (4734kB/s), 897KiB/s-1651KiB/s (918kB/s-1691kB/s), io=28.0MiB (29.4MB), run=5644-6202msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183029: Fri Apr 3 03:31:57 2026 read: IOPS=1, BW=6266KiB/s (6417kB/s)(12.0MiB/1961msec) clat (msec): min=288, max=933, avg=638.07, stdev=326.11 lat (msec): min=288, max=933, avg=638.07, stdev=326.11 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7599, max= 8094, per=100.00%, avg=7846.50, stdev=350.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.92%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183030: Fri Apr 3 03:31:57 2026 read: IOPS=0, BW=915KiB/s (937kB/s)(4096KiB/4478msec) clat (nsec): min=1641.6M, max=1641.6M, avg=1641643445.00, stdev= 0.00 lat (nsec): min=1641.6M, max=1641.6M, avg=1641645869.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1636], 5.00th=[ 1636], 10.00th=[ 1636], 20.00th=[ 1636], | 30.00th=[ 1636], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1829KiB/s (1873kB/s)(8192KiB/4478msec); 0 zone resets clat (msec): min=568, max=2212, avg=1390.37, stdev=1162.96 lat (msec): min=568, max=2212, avg=1390.79, stdev=1162.76 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.48%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183031: Fri Apr 3 03:31:57 2026 write: IOPS=0, BW=2833KiB/s (2901kB/s)(12.0MiB/4337msec); 0 zone resets clat (msec): min=772, max=2001, avg=1407.40, stdev=615.40 lat (msec): min=773, max=2001, avg=1408.09, stdev=614.94 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.00%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183032: Fri Apr 3 03:31:57 2026 write: IOPS=1, BW=5067KiB/s (5189kB/s)(12.0MiB/2425msec); 0 zone resets clat (msec): min=270, max=1791, avg=791.46, stdev=866.71 lat (msec): min=276, max=1792, avg=794.04, stdev=864.89 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7656, max= 8159, per=100.00%, avg=7907.50, stdev=355.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.62%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3659KiB/s (3747kB/s), 915KiB/s-6266KiB/s (937kB/s-6417kB/s), io=16.0MiB (16.8MB), run=1961-4478msec WRITE: bw=7318KiB/s (7493kB/s), 1829KiB/s-5067KiB/s (1873kB/s-5189kB/s), io=32.0MiB (33.6MB), run=2425-4478msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183034: Fri Apr 3 03:31:57 2026 read: IOPS=1, BW=4472KiB/s (4579kB/s)(12.0MiB/2748msec) clat (msec): min=831, max=1012, avg=915.76, stdev=90.99 lat (msec): min=831, max=1012, avg=915.76, stdev=90.99 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8000, max= 8031, per=100.00%, avg=8015.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.00%, ctx=206, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183035: Fri Apr 3 03:31:57 2026 read: IOPS=0, BW=1296KiB/s (1327kB/s)(4096KiB/3161msec) clat (nsec): min=848824k, max=848824k, avg=848824444.00, stdev= 0.00 lat (nsec): min=848827k, max=848827k, avg=848826776.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2592KiB/s (2654kB/s)(8192KiB/3161msec); 0 zone resets clat (msec): min=1132, max=1169, avg=1150.81, stdev=26.50 lat (msec): min=1132, max=1171, avg=1151.87, stdev=27.40 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8031, max= 8031, per=89.66%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.19%, sys=3.20%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183036: Fri Apr 3 03:31:57 2026 write: IOPS=0, BW=3359KiB/s (3440kB/s)(12.0MiB/3658msec); 0 zone resets clat (msec): min=390, max=2153, avg=1218.28, stdev=886.19 lat (msec): min=391, max=2153, avg=1218.90, stdev=885.97 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8000, max= 8000, per=89.32%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.06%, ctx=37, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183037: Fri Apr 3 03:31:57 2026 write: IOPS=0, BW=3930KiB/s (4024kB/s)(12.0MiB/3127msec); 0 zone resets clat (msec): min=689, max=1647, avg=1041.56, stdev=527.08 lat (msec): min=689, max=1648, avg=1042.04, stdev=527.16 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8000, max= 8078, per=89.75%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=3.55%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5183KiB/s (5308kB/s), 1296KiB/s-4472KiB/s (1327kB/s-4579kB/s), io=16.0MiB (16.8MB), run=2748-3161msec WRITE: bw=8958KiB/s (9173kB/s), 2592KiB/s-3930KiB/s (2654kB/s-4024kB/s), io=32.0MiB (33.6MB), run=3127-3658msec