== sanity test 398b: DIO and buffer IO race ============== 16:07:13 (1778357233) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.94885 s, 17.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192514: Sat May 9 16:08:16 2026 read: IOPS=28, BW=113KiB/s (116kB/s)(5992KiB/53046msec) clat (usec): min=31, max=308822, avg=18650.53, stdev=12157.93 lat (usec): min=31, max=308823, avg=18651.25, stdev=12157.98 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 7373], 10.00th=[ 8717], 20.00th=[ 10683], | 30.00th=[ 12518], 40.00th=[ 14484], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 21627], 80.00th=[ 25297], 90.00th=[ 30802], 95.00th=[ 35914], | 99.00th=[ 51119], 99.50th=[ 59507], 99.90th=[ 64226], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 39, max= 191, per=25.02%, avg=112.84, stdev=28.23, samples=105 iops : min= 9, max= 47, avg=27.85, stdev= 7.10, samples=105 write: IOPS=29, BW=119KiB/s (122kB/s)(6296KiB/53046msec); 0 zone resets clat (usec): min=728, max=102850, avg=15926.38, stdev=12592.13 lat (usec): min=729, max=102851, avg=15927.94, stdev=12591.46 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2507], 10.00th=[ 3064], 20.00th=[ 4293], | 30.00th=[ 7177], 40.00th=[ 10421], 50.00th=[ 12911], 60.00th=[ 16057], | 70.00th=[ 20055], 80.00th=[ 25035], 90.00th=[ 34341], 95.00th=[ 40109], | 99.00th=[ 54264], 99.50th=[ 60556], 99.90th=[ 96994], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 39, max= 192, per=25.07%, avg=118.34, stdev=32.46, samples=105 iops : min= 9, max= 48, avg=29.23, stdev= 8.19, samples=105 lat (usec) : 50=0.10%, 100=0.42%, 250=0.52%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.55% lat (msec) : 2=1.01%, 4=7.78%, 10=17.02%, 20=38.96%, 50=32.36% lat (msec) : 100=1.14%, 250=0.03%, 500=0.03% cpu : usr=0.07%, sys=24.94%, ctx=9100, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192515: Sat May 9 16:08:16 2026 read: IOPS=27, BW=112KiB/s (114kB/s)(5940KiB/53197msec) clat (usec): min=35, max=315445, avg=19130.36, stdev=13085.24 lat (usec): min=35, max=315446, avg=19131.05, stdev=13085.26 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 7570], 10.00th=[ 8848], 20.00th=[ 10683], | 30.00th=[ 12256], 40.00th=[ 14222], 50.00th=[ 16712], 60.00th=[ 19268], | 70.00th=[ 22152], 80.00th=[ 25822], 90.00th=[ 31589], 95.00th=[ 39060], | 99.00th=[ 55837], 99.50th=[ 66323], 99.90th=[ 98042], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 32, max= 176, per=24.77%, avg=111.70, stdev=31.74, samples=105 iops : min= 8, max= 44, avg=27.56, stdev= 8.04, samples=105 write: IOPS=29, BW=119KiB/s (122kB/s)(6348KiB/53197msec); 0 zone resets clat (usec): min=792, max=103959, avg=15589.40, stdev=11963.54 lat (usec): min=793, max=103960, avg=15590.19, stdev=11963.56 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2507], 10.00th=[ 3163], 20.00th=[ 4555], | 30.00th=[ 7373], 40.00th=[ 10552], 50.00th=[ 13042], 60.00th=[ 15795], | 70.00th=[ 19268], 80.00th=[ 25297], 90.00th=[ 32375], 95.00th=[ 38536], | 99.00th=[ 54789], 99.50th=[ 60031], 99.90th=[ 68682], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 40, max= 279, per=25.17%, avg=118.79, stdev=36.93, samples=105 iops : min= 10, max= 69, avg=29.33, stdev= 9.28, samples=105 lat (usec) : 50=0.10%, 100=0.42%, 250=0.42%, 500=0.03%, 1000=0.49% lat (msec) : 2=0.94%, 4=7.65%, 10=17.15%, 20=39.94%, 50=31.38% lat (msec) : 100=1.40%, 250=0.03%, 500=0.03% cpu : usr=0.09%, sys=24.90%, ctx=9382, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192516: Sat May 9 16:08:16 2026 read: IOPS=28, BW=115KiB/s (117kB/s)(6028KiB/52591msec) clat (usec): min=31, max=65194, avg=18335.15, stdev=9542.61 lat (usec): min=32, max=65194, avg=18335.83, stdev=9542.65 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 7570], 10.00th=[ 8717], 20.00th=[10552], | 30.00th=[12125], 40.00th=[14353], 50.00th=[16909], 60.00th=[19268], | 70.00th=[21627], 80.00th=[24773], 90.00th=[31065], 95.00th=[36963], | 99.00th=[49021], 99.50th=[53216], 99.90th=[64226], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 47, max= 192, per=25.42%, avg=114.66, stdev=29.64, samples=104 iops : min= 11, max= 48, avg=28.30, stdev= 7.53, samples=104 write: IOPS=29, BW=119KiB/s (122kB/s)(6260KiB/52591msec); 0 zone resets clat (usec): min=771, max=319660, avg=15923.01, stdev=14765.37 lat (usec): min=772, max=319661, avg=15924.52, stdev=14765.65 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 2343], 10.00th=[ 3032], 20.00th=[ 3916], | 30.00th=[ 6587], 40.00th=[ 10159], 50.00th=[ 12387], 60.00th=[ 15664], | 70.00th=[ 20579], 80.00th=[ 25560], 90.00th=[ 33817], 95.00th=[ 39584], | 99.00th=[ 53740], 99.50th=[ 60031], 99.90th=[108528], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 48, max= 223, per=25.22%, avg=119.05, stdev=36.26, samples=104 iops : min= 12, max= 55, avg=29.40, stdev= 9.08, samples=104 lat (usec) : 50=0.16%, 100=0.36%, 250=0.88%, 1000=0.68% lat (msec) : 2=1.11%, 4=8.66%, 10=16.44%, 20=37.47%, 50=33.04% lat (msec) : 100=1.14%, 250=0.03%, 500=0.03% cpu : usr=0.10%, sys=24.86%, ctx=9006, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192517: Sat May 9 16:08:16 2026 read: IOPS=28, BW=114KiB/s (117kB/s)(6052KiB/53194msec) clat (usec): min=42, max=89539, avg=18555.69, stdev=10044.18 lat (usec): min=43, max=89539, avg=18556.42, stdev=10044.20 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 7177], 10.00th=[ 8717], 20.00th=[10683], | 30.00th=[12518], 40.00th=[14615], 50.00th=[16581], 60.00th=[19268], | 70.00th=[21890], 80.00th=[25297], 90.00th=[31851], 95.00th=[36963], | 99.00th=[51643], 99.50th=[55837], 99.90th=[86508], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 31, max= 207, per=25.20%, avg=113.65, stdev=32.42, samples=105 iops : min= 7, max= 51, avg=28.05, stdev= 8.14, samples=105 write: IOPS=29, BW=117KiB/s (120kB/s)(6236KiB/53194msec); 0 zone resets clat (usec): min=764, max=323846, avg=16079.33, stdev=14469.82 lat (usec): min=765, max=323848, avg=16080.12, stdev=14469.83 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 2376], 10.00th=[ 3163], 20.00th=[ 4424], | 30.00th=[ 7963], 40.00th=[ 10683], 50.00th=[ 13042], 60.00th=[ 16057], | 70.00th=[ 20055], 80.00th=[ 25297], 90.00th=[ 32375], 95.00th=[ 39060], | 99.00th=[ 52691], 99.50th=[ 58983], 99.90th=[101188], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 47, max= 200, per=24.81%, avg=117.09, stdev=32.78, samples=105 iops : min= 11, max= 50, avg=28.90, stdev= 8.23, samples=105 lat (usec) : 50=0.03%, 100=0.39%, 250=0.81%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.52% lat (msec) : 2=1.30%, 4=7.36%, 10=16.21%, 20=39.94%, 50=32.03% lat (msec) : 100=1.27%, 250=0.03%, 500=0.03% cpu : usr=0.08%, sys=24.73%, ctx=9357, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=451KiB/s (462kB/s), 112KiB/s-115KiB/s (114kB/s-117kB/s), io=23.4MiB (24.6MB), run=52591-53197msec WRITE: bw=473KiB/s (484kB/s), 117KiB/s-119KiB/s (120kB/s-122kB/s), io=24.6MiB (25.7MB), run=52591-53197msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192509: Sat May 9 16:08:25 2026 read: IOPS=23, BW=95.2KiB/s (97.5kB/s)(5992KiB/62928msec) clat (msec): min=2, max=359, avg=18.20, stdev=16.28 lat (msec): min=2, max=359, avg=18.20, stdev=16.28 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 67], 99.50th=[ 70], 99.90th=[ 116], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 16, max= 384, per=25.06%, avg=95.48, stdev=63.47, samples=124 iops : min= 4, max= 96, avg=23.54, stdev=15.92, samples=124 write: IOPS=25, BW=100KiB/s (102kB/s)(6296KiB/62928msec); 0 zone resets clat (msec): min=4, max=124, avg=22.48, stdev=15.31 lat (msec): min=4, max=124, avg=22.48, stdev=15.31 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 73], 99.50th=[ 81], 99.90th=[ 117], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 23, max= 335, per=25.24%, avg=100.44, stdev=62.05, samples=124 iops : min= 5, max= 83, avg=24.78, stdev=15.57, samples=124 lat (msec) : 4=0.59%, 10=26.95%, 20=34.05%, 50=34.05%, 100=4.23% lat (msec) : 250=0.10%, 500=0.03% cpu : usr=0.07%, sys=13.31%, ctx=6457, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192510: Sat May 9 16:08:25 2026 read: IOPS=23, BW=94.3KiB/s (96.5kB/s)(5940KiB/63009msec) clat (msec): min=2, max=367, avg=18.11, stdev=16.66 lat (msec): min=2, max=367, avg=18.11, stdev=16.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 38], 95.00th=[ 47], | 99.00th=[ 70], 99.50th=[ 75], 99.90th=[ 90], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 352, per=24.79%, avg=94.44, stdev=62.70, samples=124 iops : min= 7, max= 88, avg=23.28, stdev=15.72, samples=124 write: IOPS=25, BW=101KiB/s (103kB/s)(6348KiB/63009msec); 0 zone resets clat (msec): min=4, max=123, avg=22.59, stdev=15.70 lat (msec): min=4, max=123, avg=22.59, stdev=15.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 72], 99.50th=[ 84], 99.90th=[ 121], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 39, max= 351, per=25.25%, avg=100.51, stdev=62.24, samples=124 iops : min= 9, max= 87, avg=24.80, stdev=15.62, samples=124 lat (msec) : 4=0.65%, 10=27.47%, 20=34.15%, 50=32.81%, 100=4.79% lat (msec) : 250=0.10%, 500=0.03% cpu : usr=0.07%, sys=13.37%, ctx=6423, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192511: Sat May 9 16:08:25 2026 read: IOPS=23, BW=95.8KiB/s (98.1kB/s)(6028KiB/62927msec) clat (msec): min=2, max=104, avg=18.17, stdev=14.21 lat (msec): min=2, max=104, avg=18.17, stdev=14.21 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 69], 99.50th=[ 79], 99.90th=[ 101], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 23, max= 367, per=25.26%, avg=96.25, stdev=63.37, samples=124 iops : min= 5, max= 91, avg=23.73, stdev=15.90, samples=124 write: IOPS=24, BW=99.5KiB/s (102kB/s)(6260KiB/62927msec); 0 zone resets clat (msec): min=4, max=371, avg=22.54, stdev=17.66 lat (msec): min=4, max=371, avg=22.54, stdev=17.66 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 73], 99.50th=[ 80], 99.90th=[ 103], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 23, max= 384, per=25.07%, avg=99.80, stdev=64.13, samples=124 iops : min= 5, max= 96, avg=24.62, stdev=16.08, samples=124 lat (msec) : 4=0.88%, 10=27.41%, 20=33.59%, 50=33.24%, 100=4.75% lat (msec) : 250=0.10%, 500=0.03% cpu : usr=0.06%, sys=13.40%, ctx=6501, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192512: Sat May 9 16:08:25 2026 read: IOPS=24, BW=96.3KiB/s (98.6kB/s)(6052KiB/62877msec) clat (usec): min=2904, max=87667, avg=18029.13, stdev=13622.30 lat (usec): min=2904, max=87668, avg=18029.71, stdev=13622.30 clat percentiles (usec): | 1.00th=[ 3687], 5.00th=[ 4752], 10.00th=[ 5211], 20.00th=[ 6718], | 30.00th=[ 9503], 40.00th=[11863], 50.00th=[13829], 60.00th=[16712], | 70.00th=[20317], 80.00th=[26608], 90.00th=[38011], 95.00th=[45876], | 99.00th=[65274], 99.50th=[72877], 99.90th=[85459], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 32, max= 407, per=25.42%, avg=96.84, stdev=63.36, samples=124 iops : min= 8, max= 101, avg=23.88, stdev=15.89, samples=124 write: IOPS=24, BW=99.2KiB/s (102kB/s)(6236KiB/62877msec); 0 zone resets clat (msec): min=4, max=373, avg=22.66, stdev=17.63 lat (msec): min=4, max=373, avg=22.66, stdev=17.63 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 73], 99.50th=[ 82], 99.90th=[ 121], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 40, max= 352, per=25.01%, avg=99.54, stdev=62.30, samples=124 iops : min= 10, max= 88, avg=24.56, stdev=15.64, samples=124 lat (msec) : 4=0.75%, 10=27.41%, 20=32.91%, 50=34.21%, 100=4.62% lat (msec) : 250=0.07%, 500=0.03% cpu : usr=0.06%, sys=13.53%, ctx=6439, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=381KiB/s (390kB/s), 94.3KiB/s-96.3KiB/s (96.5kB/s-98.6kB/s), io=23.4MiB (24.6MB), run=62877-63009msec WRITE: bw=399KiB/s (409kB/s), 99.2KiB/s-101KiB/s (102kB/s-103kB/s), io=24.6MiB (25.7MB), run=62877-63009msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192542: Sat May 9 16:08:53 2026 read: IOPS=18, BW=292KiB/s (299kB/s)(5920KiB/20254msec) clat (usec): min=59, max=100239, avg=27871.79, stdev=14708.81 lat (usec): min=59, max=100239, avg=27872.52, stdev=14708.71 clat percentiles (usec): | 1.00th=[ 131], 5.00th=[ 258], 10.00th=[ 12256], 20.00th=[ 17695], | 30.00th=[ 19792], 40.00th=[ 23462], 50.00th=[ 26084], 60.00th=[ 28443], | 70.00th=[ 32375], 80.00th=[ 39060], 90.00th=[ 45351], 95.00th=[ 52691], | 99.00th=[ 82314], 99.50th=[ 89654], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 159, max= 606, per=25.69%, avg=291.31, stdev=91.20, samples=39 iops : min= 9, max= 37, avg=17.54, stdev= 5.70, samples=39 write: IOPS=19, BW=314KiB/s (322kB/s)(6368KiB/20254msec); 0 zone resets clat (usec): min=1604, max=85843, avg=24712.89, stdev=14747.37 lat (usec): min=1606, max=85844, avg=24714.37, stdev=14747.33 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5473], 10.00th=[ 7635], 20.00th=[11207], | 30.00th=[15401], 40.00th=[18220], 50.00th=[22414], 60.00th=[25297], | 70.00th=[31327], 80.00th=[36439], 90.00th=[44827], 95.00th=[53216], | 99.00th=[66847], 99.50th=[74974], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 127, max= 573, per=26.56%, avg=316.90, stdev=94.67, samples=39 iops : min= 7, max= 35, avg=19.15, stdev= 5.94, samples=39 lat (usec) : 100=0.13%, 250=2.21%, 500=0.26% lat (msec) : 2=0.13%, 10=9.51%, 20=25.78%, 50=55.60%, 100=6.25% lat (msec) : 250=0.13% cpu : usr=0.04%, sys=28.94%, ctx=3224, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192544: Sat May 9 16:08:53 2026 read: IOPS=17, BW=272KiB/s (279kB/s)(5744KiB/21116msec) clat (usec): min=71, max=136583, avg=29377.43, stdev=16156.22 lat (usec): min=72, max=136584, avg=29378.00, stdev=16156.23 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 449], 10.00th=[ 12911], 20.00th=[ 16909], | 30.00th=[ 20317], 40.00th=[ 24511], 50.00th=[ 28181], 60.00th=[ 31851], | 70.00th=[ 35390], 80.00th=[ 40109], 90.00th=[ 47449], 95.00th=[ 55837], | 99.00th=[ 77071], 99.50th=[ 88605], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 63, max= 477, per=23.89%, avg=270.93, stdev=98.41, samples=41 iops : min= 3, max= 29, avg=16.27, stdev= 6.22, samples=41 write: IOPS=19, BW=310KiB/s (317kB/s)(6544KiB/21116msec); 0 zone resets clat (usec): min=1132, max=104662, avg=25622.19, stdev=16422.71 lat (usec): min=1133, max=104663, avg=25647.64, stdev=16468.87 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 49], 95.00th=[ 59], | 99.00th=[ 77], 99.50th=[ 78], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 158, max= 669, per=25.58%, avg=305.12, stdev=123.94, samples=41 iops : min= 9, max= 41, avg=18.41, stdev= 7.72, samples=41 lat (usec) : 100=0.13%, 250=1.56%, 500=0.65% lat (msec) : 2=0.26%, 4=0.65%, 10=8.46%, 20=25.52%, 50=54.30% lat (msec) : 100=8.20%, 250=0.26% cpu : usr=0.04%, sys=28.74%, ctx=3358, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192546: Sat May 9 16:08:53 2026 read: IOPS=19, BW=308KiB/s (315kB/s)(6256KiB/20323msec) clat (usec): min=62, max=110767, avg=27034.60, stdev=14585.16 lat (usec): min=62, max=110768, avg=27035.27, stdev=14585.20 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 412], 10.00th=[ 12125], 20.00th=[ 15795], | 30.00th=[ 19268], 40.00th=[ 22152], 50.00th=[ 25560], 60.00th=[ 28705], | 70.00th=[ 32637], 80.00th=[ 36963], 90.00th=[ 45351], 95.00th=[ 52167], | 99.00th=[ 69731], 99.50th=[ 82314], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 95, max= 605, per=27.15%, avg=307.92, stdev=116.76, samples=40 iops : min= 5, max= 37, avg=18.58, stdev= 7.36, samples=40 write: IOPS=18, BW=297KiB/s (304kB/s)(6032KiB/20323msec); 0 zone resets clat (usec): min=1653, max=72116, avg=25797.65, stdev=15777.83 lat (usec): min=1654, max=72117, avg=25798.97, stdev=15777.93 clat percentiles (usec): | 1.00th=[ 3392], 5.00th=[ 5800], 10.00th=[ 8094], 20.00th=[11600], | 30.00th=[15139], 40.00th=[18482], 50.00th=[21890], 60.00th=[26608], | 70.00th=[31327], 80.00th=[40109], 90.00th=[50070], 95.00th=[57410], | 99.00th=[66847], 99.50th=[70779], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 158, max= 477, per=24.71%, avg=294.83, stdev=89.26, samples=40 iops : min= 9, max= 29, avg=17.75, stdev= 5.58, samples=40 lat (usec) : 100=0.39%, 250=1.43%, 500=0.78% lat (msec) : 2=0.39%, 4=0.91%, 10=7.16%, 20=27.73%, 50=53.26% lat (msec) : 100=7.81%, 250=0.13% cpu : usr=0.08%, sys=28.69%, ctx=3222, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192548: Sat May 9 16:08:53 2026 read: IOPS=18, BW=297KiB/s (304kB/s)(6032KiB/20338msec) clat (usec): min=75, max=90357, avg=27716.00, stdev=14558.79 lat (usec): min=76, max=90358, avg=27716.68, stdev=14558.95 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 235], 10.00th=[11731], 20.00th=[15664], | 30.00th=[20055], 40.00th=[23987], 50.00th=[26870], 60.00th=[30278], | 70.00th=[33817], 80.00th=[39060], 90.00th=[45876], 95.00th=[52167], | 99.00th=[66323], 99.50th=[80217], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 96, max= 541, per=26.21%, avg=297.18, stdev=104.17, samples=40 iops : min= 6, max= 33, avg=17.90, stdev= 6.50, samples=40 write: IOPS=19, BW=308KiB/s (315kB/s)(6256KiB/20338msec); 0 zone resets clat (usec): min=1618, max=83065, avg=24976.09, stdev=16157.77 lat (usec): min=1620, max=83066, avg=24977.35, stdev=16157.79 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 6456], 10.00th=[ 8029], 20.00th=[10421], | 30.00th=[13173], 40.00th=[17433], 50.00th=[21365], 60.00th=[26084], | 70.00th=[30540], 80.00th=[36963], 90.00th=[49546], 95.00th=[57410], | 99.00th=[71828], 99.50th=[71828], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 127, max= 701, per=25.87%, avg=308.68, stdev=108.76, samples=40 iops : min= 7, max= 43, avg=18.63, stdev= 6.81, samples=40 lat (usec) : 100=0.13%, 250=2.60%, 500=0.52% lat (msec) : 2=0.26%, 4=0.65%, 10=9.64%, 20=24.48%, 50=52.99% lat (msec) : 100=8.72% cpu : usr=0.06%, sys=28.69%, ctx=3179, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1134KiB/s (1162kB/s), 272KiB/s-308KiB/s (279kB/s-315kB/s), io=23.4MiB (24.5MB), run=20254-21116msec WRITE: bw=1193KiB/s (1222kB/s), 297KiB/s-314KiB/s (304kB/s-322kB/s), io=24.6MiB (25.8MB), run=20254-21116msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192543: Sat May 9 16:08:54 2026 read: IOPS=16, BW=263KiB/s (269kB/s)(5920KiB/22547msec) clat (msec): min=3, max=110, avg=26.86, stdev=18.73 lat (msec): min=3, max=110, avg=26.86, stdev=18.73 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 54], 95.00th=[ 65], | 99.00th=[ 88], 99.50th=[ 106], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 126, max= 768, per=23.84%, avg=252.70, stdev=140.77, samples=44 iops : min= 7, max= 48, avg=15.25, stdev= 8.97, samples=44 write: IOPS=17, BW=282KiB/s (289kB/s)(6368KiB/22547msec); 0 zone resets clat (msec): min=5, max=104, avg=31.48, stdev=19.58 lat (msec): min=5, max=104, avg=31.49, stdev=19.58 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 63], 95.00th=[ 72], | 99.00th=[ 88], 99.50th=[ 92], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 127, max= 768, per=24.87%, avg=277.25, stdev=145.25, samples=44 iops : min= 7, max= 48, avg=16.80, stdev= 9.21, samples=44 lat (msec) : 4=0.26%, 10=10.94%, 20=28.39%, 50=45.18%, 100=14.84% lat (msec) : 250=0.39% cpu : usr=0.08%, sys=15.20%, ctx=2049, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192545: Sat May 9 16:08:54 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(5744KiB/22362msec) clat (msec): min=4, max=108, avg=25.94, stdev=18.07 lat (msec): min=4, max=108, avg=25.95, stdev=18.07 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 50], 95.00th=[ 64], | 99.00th=[ 97], 99.50th=[ 107], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 94, max= 736, per=24.07%, avg=255.14, stdev=117.51, samples=44 iops : min= 5, max= 46, avg=15.41, stdev= 7.49, samples=44 write: IOPS=18, BW=293KiB/s (300kB/s)(6544KiB/22362msec); 0 zone resets clat (msec): min=7, max=118, avg=31.79, stdev=19.90 lat (msec): min=7, max=118, avg=31.79, stdev=19.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 71], | 99.00th=[ 104], 99.50th=[ 112], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 96, max= 896, per=26.14%, avg=291.41, stdev=172.79, samples=44 iops : min= 6, max= 56, avg=17.68, stdev=10.94, samples=44 lat (msec) : 10=8.98%, 20=30.60%, 50=47.92%, 100=11.59%, 250=0.91% cpu : usr=0.06%, sys=15.52%, ctx=2056, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192547: Sat May 9 16:08:54 2026 read: IOPS=17, BW=277KiB/s (284kB/s)(6256KiB/22586msec) clat (msec): min=3, max=109, avg=27.31, stdev=19.73 lat (msec): min=3, max=109, avg=27.31, stdev=19.73 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 56], 95.00th=[ 71], | 99.00th=[ 92], 99.50th=[ 95], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 95, max= 992, per=25.63%, avg=271.73, stdev=178.94, samples=44 iops : min= 5, max= 62, avg=16.45, stdev=11.36, samples=44 write: IOPS=16, BW=267KiB/s (273kB/s)(6032KiB/22586msec); 0 zone resets clat (msec): min=4, max=106, avg=31.23, stdev=19.47 lat (msec): min=4, max=106, avg=31.24, stdev=19.47 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 68], | 99.00th=[ 95], 99.50th=[ 102], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 94, max= 608, per=22.73%, avg=253.43, stdev=108.30, samples=44 iops : min= 5, max= 38, avg=15.30, stdev= 6.92, samples=44 lat (msec) : 4=0.39%, 10=11.72%, 20=29.30%, 50=43.62%, 100=14.58% lat (msec) : 250=0.39% cpu : usr=0.07%, sys=14.94%, ctx=1982, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192549: Sat May 9 16:08:54 2026 read: IOPS=16, BW=269KiB/s (275kB/s)(6032KiB/22439msec) clat (msec): min=5, max=113, avg=26.36, stdev=19.64 lat (msec): min=5, max=113, avg=26.36, stdev=19.64 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 56], 95.00th=[ 67], | 99.00th=[ 94], 99.50th=[ 99], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 64, max= 832, per=25.06%, avg=265.68, stdev=159.23, samples=44 iops : min= 4, max= 52, avg=16.07, stdev=10.09, samples=44 write: IOPS=17, BW=279KiB/s (285kB/s)(6256KiB/22439msec); 0 zone resets clat (msec): min=7, max=103, avg=31.78, stdev=19.46 lat (msec): min=7, max=103, avg=31.79, stdev=19.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 60], 95.00th=[ 68], | 99.00th=[ 90], 99.50th=[ 93], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 126, max= 896, per=24.77%, avg=276.23, stdev=137.33, samples=44 iops : min= 7, max= 56, avg=16.75, stdev= 8.70, samples=44 lat (msec) : 10=11.46%, 20=30.86%, 50=41.15%, 100=16.28%, 250=0.26% cpu : usr=0.05%, sys=15.36%, ctx=2040, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1060KiB/s (1086kB/s), 257KiB/s-277KiB/s (263kB/s-284kB/s), io=23.4MiB (24.5MB), run=22362-22586msec WRITE: bw=1116KiB/s (1143kB/s), 267KiB/s-293KiB/s (273kB/s-300kB/s), io=24.6MiB (25.8MB), run=22362-22586msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192558: Sat May 9 16:09:05 2026 read: IOPS=1, BW=1767KiB/s (1810kB/s)(7168KiB/4056msec) clat (msec): min=76, max=795, avg=249.84, stdev=268.92 lat (msec): min=76, max=795, avg=249.84, stdev=268.92 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 126], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 422], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1835, max= 4096, per=64.54%, avg=2980.67, stdev=1130.81, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1262KiB/s (1293kB/s)(5120KiB/4056msec); 0 zone resets clat (msec): min=89, max=849, avg=453.33, stdev=359.21 lat (msec): min=89, max=850, avg=453.39, stdev=359.22 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 2019, max= 4096, per=42.08%, avg=2721.00, stdev=1190.87, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=16.67%, 1000=25.00% cpu : usr=0.00%, sys=12.18%, ctx=136, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192559: Sat May 9 16:09:05 2026 read: IOPS=0, BW=462KiB/s (473kB/s)(2048KiB/4434msec) clat (msec): min=41, max=284, avg=163.13, stdev=171.74 lat (msec): min=41, max=284, avg=163.13, stdev=171.74 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 42], | 30.00th=[ 42], 40.00th=[ 42], 50.00th=[ 42], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1440, max= 2048, per=37.77%, avg=1744.00, stdev=429.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2309KiB/s (2365kB/s)(10.0MiB/4434msec); 0 zone resets clat (msec): min=87, max=1418, avg=409.19, stdev=397.99 lat (msec): min=87, max=1418, avg=409.28, stdev=398.01 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 90], | 30.00th=[ 144], 40.00th=[ 220], 50.00th=[ 268], 60.00th=[ 338], | 70.00th=[ 418], 80.00th=[ 443], 90.00th=[ 667], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1440, max= 6144, per=47.39%, avg=3064.20, stdev=1911.50, samples=5 iops : min= 1, max= 6, avg= 2.60, stdev= 2.07, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=41.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=22.85%, ctx=233, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192560: Sat May 9 16:09:05 2026 read: IOPS=1, BW=1401KiB/s (1435kB/s)(6144KiB/4384msec) clat (msec): min=55, max=643, avg=257.36, stdev=244.59 lat (msec): min=55, max=643, avg=257.36, stdev=244.59 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 146], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2019, max= 4096, per=55.28%, avg=2552.75, stdev=1028.92, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=1, BW=1401KiB/s (1435kB/s)(6144KiB/4384msec); 0 zone resets clat (msec): min=127, max=1282, avg=457.13, stdev=453.32 lat (msec): min=127, max=1282, avg=457.77, stdev=452.99 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 236], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1835, max= 3002, per=34.54%, avg=2233.25, stdev=522.24, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.05%, sys=16.36%, ctx=170, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192562: Sat May 9 16:09:05 2026 read: IOPS=1, BW=1166KiB/s (1194kB/s)(5120KiB/4391msec) clat (msec): min=61, max=1296, avg=371.55, stdev=528.91 lat (msec): min=61, max=1296, avg=371.55, stdev=528.91 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 89], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 4096, max= 4096, per=88.70%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1632KiB/s (1672kB/s)(7168KiB/4391msec); 0 zone resets clat (msec): min=69, max=685, avg=346.35, stdev=273.33 lat (msec): min=69, max=685, avg=346.43, stdev=273.33 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 86], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 239], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 634], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1454, max= 4096, per=44.99%, avg=2909.25, stdev=1359.44, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 100=41.67%, 250=16.67%, 500=8.33%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=11.87%, ctx=117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4619KiB/s (4730kB/s), 462KiB/s-1767KiB/s (473kB/s-1810kB/s), io=20.0MiB (20.0MB), run=4056-4434msec WRITE: bw=6466KiB/s (6622kB/s), 1262KiB/s-2309KiB/s (1293kB/s-2365kB/s), io=28.0MiB (29.4MB), run=4056-4434msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192561: Sat May 9 16:09:05 2026 read: IOPS=1, BW=1688KiB/s (1728kB/s)(7168KiB/4247msec) clat (usec): min=474, max=747452, avg=270353.45, stdev=324818.59 lat (usec): min=475, max=747453, avg=270354.62, stdev=324818.51 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 652], | 30.00th=[ 725], 40.00th=[ 725], 50.00th=[152044], 60.00th=[304088], | 70.00th=[304088], 80.00th=[683672], 90.00th=[750781], 95.00th=[750781], | 99.00th=[750781], 99.50th=[750781], 99.90th=[750781], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 2048, max= 4096, per=71.84%, avg=3256.00, stdev=1072.45, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1206KiB/s (1234kB/s)(5120KiB/4247msec); 0 zone resets clat (msec): min=125, max=983, avg=387.16, stdev=352.99 lat (msec): min=125, max=983, avg=387.23, stdev=353.01 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 2048, max= 2048, per=32.27%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=38.06%, ctx=862, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192563: Sat May 9 16:09:05 2026 read: IOPS=0, BW=453KiB/s (464kB/s)(2048KiB/4518msec) clat (msec): min=184, max=231, avg=207.75, stdev=32.91 lat (msec): min=184, max=231, avg=207.75, stdev=32.91 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 1514, max= 2048, per=39.30%, avg=1781.00, stdev=377.60, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2266KiB/s (2321kB/s)(10.0MiB/4518msec); 0 zone resets clat (msec): min=37, max=1125, avg=405.41, stdev=351.17 lat (msec): min=37, max=1125, avg=405.50, stdev=351.15 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 40], | 30.00th=[ 40], 40.00th=[ 292], 50.00th=[ 313], 60.00th=[ 401], | 70.00th=[ 439], 80.00th=[ 625], 90.00th=[ 743], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2039, max= 3624, per=37.21%, avg=2361.40, stdev=705.83, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 0.71, samples=5 lat (msec) : 50=25.00%, 250=16.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=38.94%, ctx=245, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192564: Sat May 9 16:09:05 2026 read: IOPS=1, BW=1605KiB/s (1644kB/s)(6144KiB/3828msec) clat (usec): min=504, max=310122, avg=123187.41, stdev=148617.06 lat (usec): min=504, max=310123, avg=123188.51, stdev=148617.07 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[ 594], 50.00th=[ 594], 60.00th=[130548], | 70.00th=[295699], 80.00th=[295699], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 3961, max= 6144, per=100.00%, avg=5052.50, stdev=1543.61, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1605KiB/s (1644kB/s)(6144KiB/3828msec); 0 zone resets clat (msec): min=159, max=1114, avg=497.44, stdev=357.96 lat (msec): min=159, max=1114, avg=497.49, stdev=357.97 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 592], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 2048, max= 6144, per=62.07%, avg=3938.67, stdev=2066.05, samples=3 iops : min= 2, max= 6, avg= 3.67, stdev= 2.08, samples=3 lat (usec) : 750=25.00% lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.03%, sys=38.25%, ctx=284, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192565: Sat May 9 16:09:05 2026 read: IOPS=1, BW=1466KiB/s (1501kB/s)(5120KiB/3492msec) clat (usec): min=660, max=253754, avg=151809.23, stdev=97912.46 lat (usec): min=661, max=253754, avg=151810.52, stdev=97912.26 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[127402], 40.00th=[127402], 50.00th=[158335], 60.00th=[158335], | 70.00th=[219153], 80.00th=[219153], 90.00th=[252707], 95.00th=[252707], | 99.00th=[252707], 99.50th=[252707], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 3961, max= 4096, per=88.89%, avg=4028.50, stdev=95.46, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2053KiB/s (2102kB/s)(7168KiB/3492msec); 0 zone resets clat (msec): min=202, max=692, avg=388.19, stdev=180.59 lat (msec): min=202, max=692, avg=388.27, stdev=180.59 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 209], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 338], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 498], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1497, max= 4096, per=44.38%, avg=2816.25, stdev=1241.08, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=56.40%, ctx=224, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4533KiB/s (4642kB/s), 453KiB/s-1688KiB/s (464kB/s-1728kB/s), io=20.0MiB (20.0MB), run=3492-4518msec WRITE: bw=6346KiB/s (6498kB/s), 1206KiB/s-2266KiB/s (1234kB/s-2321kB/s), io=28.0MiB (29.4MB), run=3492-4518msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192576: Sat May 9 16:09:15 2026 read: IOPS=1, BW=6006KiB/s (6150kB/s)(12.0MiB/2046msec) clat (msec): min=541, max=713, avg=643.16, stdev=90.09 lat (msec): min=541, max=713, avg=643.16, stdev=90.09 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=43.52%, ctx=2071, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192577: Sat May 9 16:09:15 2026 read: IOPS=0, BW=2402KiB/s (2460kB/s)(4096KiB/1705msec) clat (nsec): min=713760k, max=713760k, avg=713759866.00, stdev= 0.00 lat (nsec): min=713761k, max=713761k, avg=713761061.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4805KiB/s (4920kB/s)(8192KiB/1705msec); 0 zone resets clat (msec): min=356, max=564, avg=460.58, stdev=146.95 lat (msec): min=356, max=564, avg=460.91, stdev=147.05 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 8192, max= 8192, per=54.03%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=28.17%, ctx=686, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192578: Sat May 9 16:09:15 2026 write: IOPS=1, BW=5686KiB/s (5823kB/s)(12.0MiB/2161msec); 0 zone resets clat (msec): min=560, max=827, avg=667.19, stdev=141.03 lat (msec): min=561, max=827, avg=667.50, stdev=141.00 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8062, max= 8192, per=53.60%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=30.42%, ctx=152, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192579: Sat May 9 16:09:15 2026 write: IOPS=1, BW=5891KiB/s (6032kB/s)(12.0MiB/2086msec); 0 zone resets clat (msec): min=160, max=1365, avg=670.16, stdev=623.39 lat (msec): min=160, max=1365, avg=670.43, stdev=623.40 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 6234, max= 8192, per=47.57%, avg=7213.00, stdev=1384.52, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.45%, ctx=103, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8008KiB/s (8200kB/s), 2402KiB/s-6006KiB/s (2460kB/s-6150kB/s), io=16.0MiB (16.8MB), run=1705-2046msec WRITE: bw=14.8MiB/s (15.5MB/s), 4805KiB/s-5891KiB/s (4920kB/s-6032kB/s), io=32.0MiB (33.6MB), run=1705-2161msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192572: Sat May 9 16:09:15 2026 read: IOPS=1, BW=5080KiB/s (5202kB/s)(12.0MiB/2419msec) clat (msec): min=80, max=1298, avg=742.45, stdev=615.49 lat (msec): min=80, max=1298, avg=742.45, stdev=615.49 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.48%, ctx=78, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192573: Sat May 9 16:09:15 2026 read: IOPS=1, BW=4400KiB/s (4505kB/s)(4096KiB/931msec) clat (nsec): min=281908k, max=281908k, avg=281908172.00, stdev= 0.00 lat (nsec): min=281910k, max=281910k, avg=281910082.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 5688, max= 5688, per=83.98%, avg=5688.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=2, BW=8799KiB/s (9010kB/s)(8192KiB/931msec); 0 zone resets clat (msec): min=119, max=361, avg=240.48, stdev=170.65 lat (msec): min=120, max=361, avg=240.76, stdev=170.67 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 121], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=28.28%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192574: Sat May 9 16:09:15 2026 write: IOPS=1, BW=5180KiB/s (5305kB/s)(12.0MiB/2372msec); 0 zone resets clat (msec): min=134, max=1096, avg=719.78, stdev=513.41 lat (msec): min=135, max=1096, avg=720.10, stdev=513.39 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8192, max= 8192, per=59.30%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.75%, ctx=64, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192575: Sat May 9 16:09:15 2026 write: IOPS=1, BW=6819KiB/s (6983kB/s)(12.0MiB/1802msec); 0 zone resets clat (msec): min=209, max=1066, avg=533.24, stdev=465.46 lat (msec): min=210, max=1066, avg=533.53, stdev=465.45 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8159, max= 8175, per=59.12%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=20.54%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6773KiB/s (6936kB/s), 4400KiB/s-5080KiB/s (4505kB/s-5202kB/s), io=16.0MiB (16.8MB), run=931-2419msec WRITE: bw=13.5MiB/s (14.1MB/s), 5180KiB/s-8799KiB/s (5305kB/s-9010kB/s), io=32.0MiB (33.6MB), run=931-2372msec