== sanity test 398b: DIO and buffer IO race ============== 14:57:06 (1773687426) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.98315 s, 16.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152334: Mon Mar 16 14:58:08 2026 read: IOPS=29, BW=117KiB/s (119kB/s)(5992KiB/51405msec) clat (usec): min=155, max=397672, avg=17863.07, stdev=14801.38 lat (usec): min=155, max=397673, avg=17864.09, stdev=14801.37 clat percentiles (usec): | 1.00th=[ 281], 5.00th=[ 807], 10.00th=[ 7767], 20.00th=[ 9765], | 30.00th=[ 11338], 40.00th=[ 13304], 50.00th=[ 15401], 60.00th=[ 17695], | 70.00th=[ 20841], 80.00th=[ 25035], 90.00th=[ 30278], 95.00th=[ 35390], | 99.00th=[ 65799], 99.50th=[ 73925], 99.90th=[ 93848], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 26, max= 199, per=25.36%, avg=116.38, stdev=29.27, samples=102 iops : min= 6, max= 49, avg=28.65, stdev= 7.33, samples=102 write: IOPS=30, BW=122KiB/s (125kB/s)(6296KiB/51405msec); 0 zone resets clat (usec): min=708, max=81137, avg=15572.78, stdev=12797.48 lat (usec): min=708, max=81138, avg=15574.04, stdev=12797.48 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1991], 10.00th=[ 2606], 20.00th=[ 3654], | 30.00th=[ 5932], 40.00th=[ 9765], 50.00th=[12649], 60.00th=[16319], | 70.00th=[20317], 80.00th=[25297], 90.00th=[33424], 95.00th=[40109], | 99.00th=[56886], 99.50th=[64750], 99.90th=[79168], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 6, max= 192, per=25.41%, avg=122.23, stdev=33.19, samples=102 iops : min= 1, max= 48, avg=30.11, stdev= 8.35, samples=102 lat (usec) : 250=0.46%, 500=0.78%, 750=1.17%, 1000=0.55% lat (msec) : 2=2.38%, 4=9.21%, 10=16.83%, 20=36.98%, 50=29.95% lat (msec) : 100=1.66%, 500=0.03% cpu : usr=0.16%, sys=24.40%, ctx=8509, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152335: Mon Mar 16 14:58:08 2026 read: IOPS=28, BW=115KiB/s (118kB/s)(5940KiB/51747msec) clat (usec): min=123, max=90834, avg=17513.89, stdev=10249.65 lat (usec): min=123, max=90835, avg=17515.61, stdev=10249.32 clat percentiles (usec): | 1.00th=[ 293], 5.00th=[ 996], 10.00th=[ 7963], 20.00th=[ 9765], | 30.00th=[11469], 40.00th=[13435], 50.00th=[15795], 60.00th=[18220], | 70.00th=[21103], 80.00th=[24511], 90.00th=[29754], 95.00th=[36963], | 99.00th=[50594], 99.50th=[54789], 99.90th=[72877], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 13, max= 184, per=24.95%, avg=114.54, stdev=33.10, samples=102 iops : min= 3, max= 46, avg=28.19, stdev= 8.32, samples=102 write: IOPS=30, BW=123KiB/s (126kB/s)(6348KiB/51747msec); 0 zone resets clat (usec): min=640, max=388245, avg=16118.54, stdev=16515.76 lat (usec): min=641, max=388246, avg=16120.89, stdev=16516.12 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2114], 10.00th=[ 2802], 20.00th=[ 3752], | 30.00th=[ 5932], 40.00th=[ 9634], 50.00th=[ 12780], 60.00th=[ 16188], | 70.00th=[ 20317], 80.00th=[ 26346], 90.00th=[ 34341], 95.00th=[ 40109], | 99.00th=[ 61604], 99.50th=[ 69731], 99.90th=[119014], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 48, max= 191, per=25.31%, avg=121.76, stdev=27.89, samples=102 iops : min= 12, max= 47, avg=30.00, stdev= 6.96, samples=102 lat (usec) : 250=0.33%, 500=1.07%, 750=0.75%, 1000=0.68% lat (msec) : 2=1.99%, 4=9.05%, 10=17.87%, 20=36.04%, 50=30.60% lat (msec) : 100=1.50%, 250=0.10%, 500=0.03% cpu : usr=0.11%, sys=24.70%, ctx=8531, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152336: Mon Mar 16 14:58:08 2026 read: IOPS=29, BW=117KiB/s (119kB/s)(6028KiB/51688msec) clat (usec): min=125, max=105442, avg=17124.31, stdev=10604.64 lat (usec): min=125, max=105443, avg=17125.42, stdev=10604.67 clat percentiles (usec): | 1.00th=[ 293], 5.00th=[ 660], 10.00th=[ 7373], 20.00th=[ 9634], | 30.00th=[ 11207], 40.00th=[ 13042], 50.00th=[ 15139], 60.00th=[ 17695], | 70.00th=[ 20579], 80.00th=[ 23987], 90.00th=[ 29754], 95.00th=[ 34866], | 99.00th=[ 53740], 99.50th=[ 61604], 99.90th=[ 76022], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 48, max= 199, per=25.62%, avg=117.59, stdev=29.23, samples=101 iops : min= 12, max= 49, avg=28.95, stdev= 7.31, samples=101 write: IOPS=30, BW=121KiB/s (124kB/s)(6260KiB/51688msec); 0 zone resets clat (usec): min=695, max=434463, avg=16448.02, stdev=17159.79 lat (usec): min=696, max=434465, avg=16449.22, stdev=17159.84 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 2114], 10.00th=[ 2769], 20.00th=[ 3818], | 30.00th=[ 5997], 40.00th=[ 10290], 50.00th=[ 13173], 60.00th=[ 16712], | 70.00th=[ 21103], 80.00th=[ 26346], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 60031], 99.50th=[ 72877], 99.90th=[115868], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 19, max= 184, per=25.06%, avg=120.56, stdev=32.26, samples=102 iops : min= 4, max= 46, avg=29.69, stdev= 8.14, samples=102 lat (usec) : 250=0.46%, 500=1.07%, 750=1.20%, 1000=0.52% lat (msec) : 2=2.57%, 4=8.40%, 10=16.63%, 20=37.40%, 50=29.95% lat (msec) : 100=1.66%, 250=0.10%, 500=0.03% cpu : usr=0.13%, sys=24.43%, ctx=8416, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152337: Mon Mar 16 14:58:08 2026 read: IOPS=28, BW=116KiB/s (119kB/s)(6052KiB/52259msec) clat (usec): min=196, max=131922, avg=17571.03, stdev=11450.98 lat (usec): min=197, max=131923, avg=17571.95, stdev=11451.04 clat percentiles (usec): | 1.00th=[ 363], 5.00th=[ 619], 10.00th=[ 7570], 20.00th=[ 9634], | 30.00th=[ 11338], 40.00th=[ 13173], 50.00th=[ 15401], 60.00th=[ 17957], | 70.00th=[ 20841], 80.00th=[ 24511], 90.00th=[ 30802], 95.00th=[ 36963], | 99.00th=[ 57934], 99.50th=[ 71828], 99.90th=[103285], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 47, max= 192, per=25.23%, avg=115.80, stdev=29.13, samples=102 iops : min= 11, max= 48, avg=28.51, stdev= 7.30, samples=102 write: IOPS=29, BW=119KiB/s (122kB/s)(6236KiB/52259msec); 0 zone resets clat (usec): min=806, max=444334, avg=16366.14, stdev=17757.50 lat (usec): min=808, max=444335, avg=16373.18, stdev=17758.48 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1827], 10.00th=[ 2671], 20.00th=[ 3687], | 30.00th=[ 5997], 40.00th=[ 9503], 50.00th=[ 12911], 60.00th=[ 16450], | 70.00th=[ 20317], 80.00th=[ 26346], 90.00th=[ 34341], 95.00th=[ 42206], | 99.00th=[ 62129], 99.50th=[ 79168], 99.90th=[114820], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 13, max= 223, per=24.63%, avg=118.46, stdev=32.89, samples=103 iops : min= 3, max= 55, avg=29.17, stdev= 8.22, samples=103 lat (usec) : 250=0.20%, 500=1.40%, 750=1.14%, 1000=0.65% lat (msec) : 2=2.57%, 4=7.94%, 10=17.81%, 20=36.49%, 50=29.75% lat (msec) : 100=1.86%, 250=0.16%, 500=0.03% cpu : usr=0.14%, sys=24.22%, ctx=8594, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=459KiB/s (471kB/s), 115KiB/s-117KiB/s (118kB/s-119kB/s), io=23.4MiB (24.6MB), run=51405-52259msec WRITE: bw=481KiB/s (493kB/s), 119KiB/s-123KiB/s (122kB/s-126kB/s), io=24.6MiB (25.7MB), run=51405-52259msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152329: Mon Mar 16 14:58:37 2026 read: IOPS=18, BW=73.6KiB/s (75.4kB/s)(5992KiB/81410msec) clat (msec): min=2, max=406, avg=14.63, stdev=16.91 lat (msec): min=2, max=406, avg=14.63, stdev=16.91 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 32], 95.00th=[ 43], | 99.00th=[ 71], 99.50th=[ 75], 99.90th=[ 116], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 8, max= 232, per=25.10%, avg=73.54, stdev=43.96, samples=162 iops : min= 2, max= 58, avg=18.11, stdev=11.07, samples=162 write: IOPS=19, BW=77.3KiB/s (79.2kB/s)(6296KiB/81410msec); 0 zone resets clat (msec): min=13, max=166, avg=37.67, stdev=19.89 lat (msec): min=13, max=166, avg=37.67, stdev=19.89 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 64], 95.00th=[ 78], | 99.00th=[ 108], 99.50th=[ 132], 99.90th=[ 165], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 23, max= 168, per=25.29%, avg=77.65, stdev=37.10, samples=161 iops : min= 5, max= 42, avg=19.14, stdev= 9.39, samples=161 lat (msec) : 4=1.17%, 10=26.27%, 20=15.20%, 50=44.82%, 100=11.75% lat (msec) : 250=0.75%, 500=0.03% cpu : usr=0.09%, sys=7.96%, ctx=5826, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152330: Mon Mar 16 14:58:37 2026 read: IOPS=18, BW=72.7KiB/s (74.4kB/s)(5940KiB/81740msec) clat (msec): min=3, max=402, avg=14.73, stdev=17.42 lat (msec): min=3, max=402, avg=14.73, stdev=17.42 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 68], 99.50th=[ 100], 99.90th=[ 122], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 6, max= 199, per=24.70%, avg=72.36, stdev=42.85, samples=162 iops : min= 1, max= 49, avg=17.81, stdev=10.76, samples=162 write: IOPS=19, BW=77.7KiB/s (79.5kB/s)(6348KiB/81740msec); 0 zone resets clat (msec): min=13, max=166, avg=37.60, stdev=18.96 lat (msec): min=13, max=166, avg=37.60, stdev=18.96 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 62], 95.00th=[ 75], | 99.00th=[ 104], 99.50th=[ 120], 99.90th=[ 163], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 6, max= 160, per=25.12%, avg=77.10, stdev=36.13, samples=162 iops : min= 1, max= 40, avg=19.00, stdev= 9.17, samples=162 lat (msec) : 4=0.91%, 10=26.60%, 20=15.59%, 50=44.73%, 100=11.30% lat (msec) : 250=0.85%, 500=0.03% cpu : usr=0.09%, sys=7.92%, ctx=5815, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152331: Mon Mar 16 14:58:37 2026 read: IOPS=18, BW=74.3KiB/s (76.0kB/s)(6028KiB/81181msec) clat (msec): min=3, max=168, avg=14.58, stdev=14.44 lat (msec): min=3, max=168, avg=14.58, stdev=14.44 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 41], | 99.00th=[ 69], 99.50th=[ 85], 99.90th=[ 157], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 15, max= 216, per=25.45%, avg=74.58, stdev=40.85, samples=160 iops : min= 3, max= 54, avg=18.37, stdev=10.32, samples=160 write: IOPS=19, BW=77.1KiB/s (78.0kB/s)(6260KiB/81181msec); 0 zone resets clat (msec): min=14, max=421, avg=37.71, stdev=21.16 lat (msec): min=14, max=421, avg=37.71, stdev=21.16 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 75], | 99.00th=[ 104], 99.50th=[ 115], 99.90th=[ 153], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 13, max= 152, per=25.03%, avg=76.83, stdev=36.36, samples=161 iops : min= 3, max= 38, avg=18.93, stdev= 9.19, samples=161 lat (msec) : 4=1.27%, 10=25.10%, 20=16.70%, 50=45.38%, 100=10.77% lat (msec) : 250=0.75%, 500=0.03% cpu : usr=0.09%, sys=8.02%, ctx=5879, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152332: Mon Mar 16 14:58:37 2026 read: IOPS=18, BW=74.2KiB/s (76.0kB/s)(6052KiB/81533msec) clat (msec): min=3, max=123, avg=14.52, stdev=14.10 lat (msec): min=3, max=123, avg=14.52, stdev=14.10 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 44], | 99.00th=[ 66], 99.50th=[ 78], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 8, max= 216, per=25.45%, avg=74.57, stdev=43.39, samples=161 iops : min= 2, max= 54, avg=18.37, stdev=10.97, samples=161 write: IOPS=19, BW=76.5KiB/s (78.3kB/s)(6236KiB/81533msec); 0 zone resets clat (msec): min=14, max=421, avg=38.08, stdev=20.84 lat (msec): min=14, max=421, avg=38.08, stdev=20.84 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 52], 90.00th=[ 63], 95.00th=[ 72], | 99.00th=[ 101], 99.50th=[ 120], 99.90th=[ 161], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 6, max= 152, per=24.81%, avg=76.17, stdev=36.04, samples=162 iops : min= 1, max= 38, avg=18.77, stdev= 9.11, samples=162 lat (msec) : 4=0.88%, 10=26.86%, 20=14.84%, 50=44.73%, 100=12.08% lat (msec) : 250=0.59%, 500=0.03% cpu : usr=0.10%, sys=7.78%, ctx=5635, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=294KiB/s (301kB/s), 72.7KiB/s-74.3KiB/s (74.4kB/s-76.0kB/s), io=23.4MiB (24.6MB), run=81181-81740msec WRITE: bw=308KiB/s (315kB/s), 76.5KiB/s-77.7KiB/s (78.3kB/s-79.5kB/s), io=24.6MiB (25.7MB), run=81181-81740msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152370: Mon Mar 16 14:58:55 2026 read: IOPS=29, BW=474KiB/s (486kB/s)(5920KiB/12481msec) clat (usec): min=200, max=79856, avg=16726.21, stdev=10879.28 lat (usec): min=201, max=79856, avg=16726.95, stdev=10879.30 clat percentiles (usec): | 1.00th=[ 281], 5.00th=[ 482], 10.00th=[ 652], 20.00th=[ 9896], | 30.00th=[12125], 40.00th=[13829], 50.00th=[15401], 60.00th=[17433], | 70.00th=[20055], 80.00th=[23462], 90.00th=[28705], 95.00th=[34866], | 99.00th=[57934], 99.50th=[67634], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 254, max= 640, per=25.24%, avg=469.63, stdev=103.25, samples=24 iops : min= 15, max= 40, avg=29.00, stdev= 6.65, samples=24 write: IOPS=31, BW=510KiB/s (522kB/s)(6368KiB/12481msec); 0 zone resets clat (usec): min=1085, max=86162, avg=15740.55, stdev=13081.31 lat (usec): min=1086, max=86163, avg=15741.89, stdev=13081.41 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 3130], 10.00th=[ 4080], 20.00th=[ 5014], | 30.00th=[ 6652], 40.00th=[ 9110], 50.00th=[11731], 60.00th=[15533], | 70.00th=[19530], 80.00th=[25560], 90.00th=[31589], 95.00th=[41157], | 99.00th=[72877], 99.50th=[84411], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 224, max= 736, per=26.06%, avg=510.17, stdev=121.92, samples=24 iops : min= 14, max= 46, avg=31.54, stdev= 7.64, samples=24 lat (usec) : 250=0.39%, 500=2.21%, 750=2.73%, 1000=0.26% lat (msec) : 2=1.30%, 4=4.17%, 10=21.48%, 20=37.37%, 50=28.52% lat (msec) : 100=1.56% cpu : usr=0.10%, sys=27.22%, ctx=2297, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152371: Mon Mar 16 14:58:55 2026 read: IOPS=28, BW=454KiB/s (465kB/s)(5744KiB/12654msec) clat (usec): min=200, max=69986, avg=18441.89, stdev=9885.60 lat (usec): min=200, max=69986, avg=18442.64, stdev=9885.62 clat percentiles (usec): | 1.00th=[ 293], 5.00th=[ 562], 10.00th=[ 7963], 20.00th=[11600], | 30.00th=[13173], 40.00th=[15533], 50.00th=[17695], 60.00th=[19792], | 70.00th=[21890], 80.00th=[24773], 90.00th=[31327], 95.00th=[35914], | 99.00th=[54789], 99.50th=[58459], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 252, max= 704, per=24.52%, avg=456.33, stdev=112.21, samples=24 iops : min= 15, max= 44, avg=28.17, stdev= 7.09, samples=24 write: IOPS=32, BW=517KiB/s (530kB/s)(6544KiB/12654msec); 0 zone resets clat (usec): min=1322, max=58538, avg=14548.01, stdev=11175.41 lat (usec): min=1322, max=58540, avg=14550.86, stdev=11177.13 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 3163], 10.00th=[ 3851], 20.00th=[ 4752], | 30.00th=[ 6194], 40.00th=[ 9110], 50.00th=[11600], 60.00th=[13829], | 70.00th=[18220], 80.00th=[23462], 90.00th=[30802], 95.00th=[36963], | 99.00th=[47973], 99.50th=[55313], 99.90th=[58459], 99.95th=[58459], | 99.99th=[58459] bw ( KiB/s): min= 254, max= 704, per=25.97%, avg=508.54, stdev=101.79, samples=24 iops : min= 15, max= 44, avg=31.42, stdev= 6.47, samples=24 lat (usec) : 250=0.26%, 500=1.56%, 750=1.56% lat (msec) : 2=0.91%, 4=4.95%, 10=20.57%, 20=38.02%, 50=30.99% lat (msec) : 100=1.17% cpu : usr=0.11%, sys=27.27%, ctx=2431, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152372: Mon Mar 16 14:58:55 2026 read: IOPS=30, BW=486KiB/s (498kB/s)(6256KiB/12866msec) clat (usec): min=140, max=74670, avg=17578.62, stdev=10169.89 lat (usec): min=141, max=74671, avg=17579.36, stdev=10169.92 clat percentiles (usec): | 1.00th=[ 302], 5.00th=[ 537], 10.00th=[ 6521], 20.00th=[10814], | 30.00th=[12518], 40.00th=[14484], 50.00th=[16450], 60.00th=[18744], | 70.00th=[21365], 80.00th=[25035], 90.00th=[30278], 95.00th=[34866], | 99.00th=[50070], 99.50th=[58983], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 318, max= 702, per=26.03%, avg=484.36, stdev=113.97, samples=25 iops : min= 19, max= 43, avg=29.92, stdev= 7.30, samples=25 write: IOPS=29, BW=469KiB/s (480kB/s)(6032KiB/12866msec); 0 zone resets clat (usec): min=1666, max=99480, avg=15643.45, stdev=12563.37 lat (usec): min=1668, max=99482, avg=15645.13, stdev=12563.39 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 3589], 10.00th=[ 4113], 20.00th=[ 4948], | 30.00th=[ 7111], 40.00th=[10028], 50.00th=[12780], 60.00th=[14877], | 70.00th=[18744], 80.00th=[24249], 90.00th=[32900], 95.00th=[39584], | 99.00th=[56361], 99.50th=[76022], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 254, max= 697, per=23.37%, avg=457.56, stdev=120.26, samples=25 iops : min= 15, max= 43, avg=28.24, stdev= 7.57, samples=25 lat (usec) : 250=0.39%, 500=0.91%, 750=2.86%, 1000=0.52% lat (msec) : 2=0.78%, 4=4.30%, 10=18.62%, 20=40.23%, 50=30.08% lat (msec) : 100=1.30% cpu : usr=0.12%, sys=26.97%, ctx=2427, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152373: Mon Mar 16 14:58:55 2026 read: IOPS=29, BW=479KiB/s (491kB/s)(6032KiB/12585msec) clat (usec): min=146, max=84456, avg=17290.90, stdev=12288.85 lat (usec): min=147, max=84457, avg=17291.63, stdev=12288.89 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 553], 10.00th=[ 644], 20.00th=[ 9896], | 30.00th=[11994], 40.00th=[13960], 50.00th=[15926], 60.00th=[18220], | 70.00th=[20841], 80.00th=[24249], 90.00th=[29754], 95.00th=[37487], | 99.00th=[66847], 99.50th=[81265], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 182, max= 731, per=25.26%, avg=470.08, stdev=128.20, samples=24 iops : min= 11, max= 45, avg=29.04, stdev= 7.97, samples=24 write: IOPS=31, BW=497KiB/s (509kB/s)(6256KiB/12585msec); 0 zone resets clat (usec): min=1124, max=110837, avg=15235.58, stdev=12967.64 lat (usec): min=1125, max=110838, avg=15236.94, stdev=12967.74 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 3195], 10.00th=[ 4080], 20.00th=[ 4883], | 30.00th=[ 6325], 40.00th=[ 8586], 50.00th=[ 11600], 60.00th=[ 14877], | 70.00th=[ 19530], 80.00th=[ 24249], 90.00th=[ 30016], 95.00th=[ 38011], | 99.00th=[ 64750], 99.50th=[ 89654], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 234, max= 736, per=25.01%, avg=489.71, stdev=135.28, samples=24 iops : min= 14, max= 46, avg=30.25, stdev= 8.55, samples=24 lat (usec) : 250=0.26%, 500=1.43%, 750=3.91%, 1000=0.39% lat (msec) : 2=1.56%, 4=4.82%, 10=20.31%, 20=36.85%, 50=28.39% lat (msec) : 100=1.95%, 250=0.13% cpu : usr=0.11%, sys=27.00%, ctx=2274, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1862KiB/s (1906kB/s), 454KiB/s-486KiB/s (465kB/s-498kB/s), io=23.4MiB (24.5MB), run=12481-12866msec WRITE: bw=1959KiB/s (2006kB/s), 469KiB/s-517KiB/s (480kB/s-530kB/s), io=24.6MiB (25.8MB), run=12481-12866msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152365: Mon Mar 16 14:59:03 2026 read: IOPS=18, BW=295KiB/s (302kB/s)(5920KiB/20080msec) clat (usec): min=3628, max=90141, avg=15665.22, stdev=15235.68 lat (usec): min=3630, max=90142, avg=15666.08, stdev=15235.62 clat percentiles (usec): | 1.00th=[ 4015], 5.00th=[ 4686], 10.00th=[ 5211], 20.00th=[ 5866], | 30.00th=[ 6915], 40.00th=[ 8291], 50.00th=[ 9765], 60.00th=[11994], | 70.00th=[14877], 80.00th=[22414], 90.00th=[33817], 95.00th=[49021], | 99.00th=[81265], 99.50th=[88605], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 63, max= 736, per=24.54%, avg=289.13, stdev=146.42, samples=39 iops : min= 3, max= 46, avg=17.72, stdev= 9.33, samples=39 write: IOPS=19, BW=317KiB/s (325kB/s)(6368KiB/20080msec); 0 zone resets clat (msec): min=15, max=108, avg=35.74, stdev=16.03 lat (msec): min=15, max=108, avg=35.74, stdev=16.03 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 69], | 99.00th=[ 92], 99.50th=[ 103], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 159, max= 608, per=25.42%, avg=315.00, stdev=136.92, samples=39 iops : min= 9, max= 38, avg=19.36, stdev= 8.76, samples=39 lat (msec) : 4=0.39%, 10=23.96%, 20=16.80%, 50=48.18%, 100=10.42% lat (msec) : 250=0.26% cpu : usr=0.10%, sys=9.07%, ctx=1532, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152366: Mon Mar 16 14:59:03 2026 read: IOPS=17, BW=283KiB/s (289kB/s)(5744KiB/20324msec) clat (usec): min=3216, max=99304, avg=15068.76, stdev=14589.27 lat (usec): min=3216, max=99305, avg=15069.60, stdev=14589.19 clat percentiles (usec): | 1.00th=[ 3851], 5.00th=[ 4359], 10.00th=[ 4948], 20.00th=[ 5866], | 30.00th=[ 6652], 40.00th=[ 7701], 50.00th=[ 8848], 60.00th=[11863], | 70.00th=[14746], 80.00th=[22414], 90.00th=[33162], 95.00th=[50070], | 99.00th=[66323], 99.50th=[91751], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 52, max= 640, per=23.84%, avg=280.88, stdev=163.74, samples=40 iops : min= 3, max= 40, avg=17.22, stdev=10.38, samples=40 write: IOPS=20, BW=322KiB/s (330kB/s)(6544KiB/20324msec); 0 zone resets clat (msec): min=13, max=107, avg=36.33, stdev=16.48 lat (msec): min=13, max=107, avg=36.34, stdev=16.48 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 49], 90.00th=[ 60], 95.00th=[ 71], | 99.00th=[ 88], 99.50th=[ 99], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 127, max= 576, per=25.73%, avg=318.80, stdev=135.84, samples=40 iops : min= 7, max= 36, avg=19.60, stdev= 8.69, samples=40 lat (msec) : 4=1.04%, 10=24.74%, 20=14.97%, 50=48.31%, 100=10.68% lat (msec) : 250=0.26% cpu : usr=0.11%, sys=8.79%, ctx=1443, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152367: Mon Mar 16 14:59:03 2026 read: IOPS=19, BW=311KiB/s (318kB/s)(6256KiB/20147msec) clat (usec): min=4022, max=89364, avg=15335.70, stdev=14070.26 lat (usec): min=4023, max=89364, avg=15336.66, stdev=14070.22 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 4948], 10.00th=[ 5276], 20.00th=[ 6063], | 30.00th=[ 6915], 40.00th=[ 7832], 50.00th=[ 9110], 60.00th=[11600], | 70.00th=[15533], 80.00th=[22676], 90.00th=[35390], 95.00th=[44303], | 99.00th=[68682], 99.50th=[81265], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 127, max= 832, per=26.34%, avg=310.26, stdev=175.81, samples=39 iops : min= 7, max= 52, avg=19.05, stdev=11.19, samples=39 write: IOPS=18, BW=299KiB/s (307kB/s)(6032KiB/20147msec); 0 zone resets clat (msec): min=15, max=107, avg=37.40, stdev=18.18 lat (msec): min=15, max=107, avg=37.40, stdev=18.18 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 47], 90.00th=[ 66], 95.00th=[ 77], | 99.00th=[ 101], 99.50th=[ 107], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 126, max= 576, per=23.70%, avg=293.69, stdev=134.26, samples=39 iops : min= 7, max= 36, avg=18.03, stdev= 8.59, samples=39 lat (msec) : 10=27.34%, 20=14.45%, 50=47.27%, 100=10.42%, 250=0.52% cpu : usr=0.08%, sys=9.32%, ctx=1550, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152368: Mon Mar 16 14:59:03 2026 read: IOPS=18, BW=298KiB/s (305kB/s)(6032KiB/20256msec) clat (usec): min=3586, max=99356, avg=15765.06, stdev=15378.37 lat (usec): min=3587, max=99356, avg=15765.99, stdev=15378.29 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 4817], 10.00th=[ 5211], 20.00th=[ 6128], | 30.00th=[ 7111], 40.00th=[ 8094], 50.00th=[ 9765], 60.00th=[11863], | 70.00th=[15270], 80.00th=[21890], 90.00th=[35390], 95.00th=[50594], | 99.00th=[78119], 99.50th=[93848], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 96, max= 736, per=25.07%, avg=295.32, stdev=144.19, samples=40 iops : min= 6, max= 46, avg=18.12, stdev= 9.23, samples=40 write: IOPS=19, BW=309KiB/s (316kB/s)(6256KiB/20256msec); 0 zone resets clat (msec): min=14, max=113, avg=36.54, stdev=17.71 lat (msec): min=14, max=113, avg=36.54, stdev=17.71 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 47], 90.00th=[ 64], 95.00th=[ 71], | 99.00th=[ 106], 99.50th=[ 108], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 128, max= 640, per=24.84%, avg=307.82, stdev=141.47, samples=40 iops : min= 8, max= 40, avg=18.90, stdev= 9.05, samples=40 lat (msec) : 4=0.39%, 10=25.26%, 20=17.19%, 50=46.09%, 100=10.42% lat (msec) : 250=0.65% cpu : usr=0.10%, sys=9.04%, ctx=1539, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1179KiB/s (1207kB/s), 283KiB/s-311KiB/s (289kB/s-318kB/s), io=23.4MiB (24.5MB), run=20080-20324msec WRITE: bw=1240KiB/s (1270kB/s), 299KiB/s-322KiB/s (307kB/s-330kB/s), io=24.6MiB (25.8MB), run=20080-20324msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152381: Mon Mar 16 14:59:12 2026 read: IOPS=2, BW=2690KiB/s (2754kB/s)(7168KiB/2665msec) clat (usec): min=1160, max=255122, avg=148857.97, stdev=91571.19 lat (usec): min=1160, max=255124, avg=148859.30, stdev=91571.31 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1156], 10.00th=[ 1156], 20.00th=[ 71828], | 30.00th=[113771], 40.00th=[113771], 50.00th=[170918], 60.00th=[193987], | 70.00th=[193987], 80.00th=[235930], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 1878, max= 4830, per=52.30%, avg=2888.33, stdev=1682.00, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1921KiB/s (1967kB/s)(5120KiB/2665msec); 0 zone resets clat (msec): min=145, max=533, avg=323.04, stdev=140.49 lat (msec): min=145, max=533, avg=323.11, stdev=140.49 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1878, max= 5907, per=50.34%, avg=3892.50, stdev=2848.93, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 2=8.33%, 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=51.99%, ctx=457, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152382: Mon Mar 16 14:59:12 2026 read: IOPS=0, BW=552KiB/s (566kB/s)(2048KiB/3708msec) clat (msec): min=117, max=265, avg=191.61, stdev=104.99 lat (msec): min=117, max=265, avg=191.61, stdev=104.99 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 1605, max= 2048, per=33.07%, avg=1826.50, stdev=313.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2762KiB/s (2828kB/s)(10.0MiB/3708msec); 0 zone resets clat (msec): min=111, max=747, avg=321.14, stdev=186.13 lat (msec): min=112, max=747, avg=321.23, stdev=186.13 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 138], | 30.00th=[ 205], 40.00th=[ 209], 50.00th=[ 309], 60.00th=[ 313], | 70.00th=[ 334], 80.00th=[ 376], 90.00th=[ 472], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2048, max= 3938, per=38.12%, avg=2947.75, stdev=1041.57, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=41.62%, ctx=293, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152383: Mon Mar 16 14:59:12 2026 read: IOPS=1, BW=1881KiB/s (1926kB/s)(6144KiB/3267msec) clat (usec): min=1008, max=314474, avg=140120.72, stdev=123461.50 lat (usec): min=1010, max=314476, avg=140122.25, stdev=123461.09 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1012], 10.00th=[ 1012], 20.00th=[ 1614], | 30.00th=[ 1614], 40.00th=[125305], 50.00th=[125305], 60.00th=[196084], | 70.00th=[204473], 80.00th=[204473], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 1957, max= 4096, per=45.58%, avg=2517.50, stdev=1053.11, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1881KiB/s (1926kB/s)(6144KiB/3267msec); 0 zone resets clat (msec): min=112, max=1044, avg=396.08, stdev=357.64 lat (msec): min=112, max=1044, avg=396.15, stdev=357.63 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 368], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1957, max= 4096, per=36.64%, avg=2832.75, stdev=1022.48, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 2=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=29.27%, ctx=320, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152384: Mon Mar 16 14:59:12 2026 read: IOPS=1, BW=1993KiB/s (2041kB/s)(5120KiB/2569msec) clat (usec): min=876, max=334203, avg=141803.82, stdev=141991.55 lat (usec): min=877, max=334205, avg=141805.05, stdev=141992.13 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 873], 10.00th=[ 873], 20.00th=[ 873], | 30.00th=[ 1139], 40.00th=[ 1139], 50.00th=[185598], 60.00th=[185598], | 70.00th=[187696], 80.00th=[187696], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 3915, max= 3938, per=71.09%, avg=3926.50, stdev=16.26, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2790KiB/s (2857kB/s)(7168KiB/2569msec); 0 zone resets clat (msec): min=152, max=425, avg=259.68, stdev=92.33 lat (msec): min=152, max=425, avg=259.75, stdev=92.33 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 197], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 232], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 330], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1615, max= 3757, per=30.06%, avg=2324.50, stdev=969.00, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=57.09%, ctx=947, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5523KiB/s (5656kB/s), 552KiB/s-2690KiB/s (566kB/s-2754kB/s), io=20.0MiB (20.0MB), run=2569-3708msec WRITE: bw=7732KiB/s (7918kB/s), 1881KiB/s-2790KiB/s (1926kB/s-2857kB/s), io=28.0MiB (29.4MB), run=2569-3708msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152386: Mon Mar 16 14:59:12 2026 read: IOPS=1, BW=2010KiB/s (2058kB/s)(7168KiB/3567msec) clat (msec): min=64, max=908, avg=357.13, stdev=329.23 lat (msec): min=64, max=908, avg=357.13, stdev=329.23 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 92], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 182], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 617], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1721, max= 4096, per=44.57%, avg=2436.50, stdev=1113.16, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1435KiB/s (1470kB/s)(5120KiB/3567msec); 0 zone resets clat (msec): min=78, max=382, avg=199.45, stdev=121.81 lat (msec): min=78, max=382, avg=199.56, stdev=121.83 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 2019, max= 6144, per=53.33%, avg=4081.50, stdev=2916.82, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 100=33.33%, 250=33.33%, 500=8.33%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=12.11%, ctx=127, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152387: Mon Mar 16 14:59:12 2026 read: IOPS=0, BW=547KiB/s (560kB/s)(2048KiB/3746msec) clat (msec): min=146, max=344, avg=245.59, stdev=139.44 lat (msec): min=146, max=344, avg=245.59, stdev=139.44 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1695, max= 2048, per=34.23%, avg=1871.50, stdev=249.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2734KiB/s (2799kB/s)(10.0MiB/3746msec); 0 zone resets clat (msec): min=53, max=1087, avg=317.00, stdev=320.11 lat (msec): min=53, max=1087, avg=317.10, stdev=320.11 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 77], | 30.00th=[ 94], 40.00th=[ 118], 50.00th=[ 201], 60.00th=[ 241], | 70.00th=[ 296], 80.00th=[ 401], 90.00th=[ 609], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1910, max= 4096, per=42.30%, avg=3237.80, stdev=1150.39, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.30, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=15.49%, ctx=654, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152388: Mon Mar 16 14:59:12 2026 read: IOPS=1, BW=1709KiB/s (1750kB/s)(6144KiB/3595msec) clat (msec): min=52, max=352, avg=131.23, stdev=111.34 lat (msec): min=52, max=352, avg=131.23, stdev=111.34 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 109], | 70.00th=[ 112], 80.00th=[ 112], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2019, max= 6144, per=62.26%, avg=3403.67, stdev=2373.24, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 write: IOPS=1, BW=1709KiB/s (1750kB/s)(6144KiB/3595msec); 0 zone resets clat (msec): min=103, max=1213, avg=455.92, stdev=405.34 lat (msec): min=103, max=1213, avg=456.01, stdev=405.33 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 2019, max= 3413, per=31.12%, avg=2382.00, stdev=687.47, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=11.66%, ctx=109, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152389: Mon Mar 16 14:59:12 2026 read: IOPS=1, BW=1391KiB/s (1424kB/s)(5120KiB/3682msec) clat (msec): min=48, max=170, avg=93.29, stdev=50.86 lat (msec): min=48, max=170, avg=93.29, stdev=50.86 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 53], 40.00th=[ 53], 50.00th=[ 78], 60.00th=[ 78], | 70.00th=[ 117], 80.00th=[ 117], 90.00th=[ 171], 95.00th=[ 171], | 99.00th=[ 171], 99.50th=[ 171], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1947KiB/s (1993kB/s)(7168KiB/3682msec); 0 zone resets clat (msec): min=131, max=1372, avg=450.47, stdev=448.03 lat (msec): min=131, max=1372, avg=450.57, stdev=448.07 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 157], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 239], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 642], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1723, max= 2048, per=25.60%, avg=1959.50, stdev=158.26, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=50.00%, 500=8.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=13.56%, ctx=295, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5467KiB/s (5598kB/s), 547KiB/s-2010KiB/s (560kB/s-2058kB/s), io=20.0MiB (20.0MB), run=3567-3746msec WRITE: bw=7654KiB/s (7838kB/s), 1435KiB/s-2734KiB/s (1470kB/s-2799kB/s), io=28.0MiB (29.4MB), run=3567-3746msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152396: Mon Mar 16 14:59:20 2026 read: IOPS=1, BW=7787KiB/s (7974kB/s)(12.0MiB/1578msec) clat (msec): min=460, max=562, avg=501.80, stdev=53.88 lat (msec): min=460, max=562, avg=501.81, stdev=53.88 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 5736, max= 8175, per=80.07%, avg=6955.50, stdev=1724.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=14.27%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152397: Mon Mar 16 14:59:20 2026 read: IOPS=0, BW=2172KiB/s (2224kB/s)(4096KiB/1886msec) clat (nsec): min=315731k, max=315731k, avg=315731115.00, stdev= 0.00 lat (nsec): min=315733k, max=315733k, avg=315732580.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 5893, max= 5893, per=67.84%, avg=5893.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4344KiB/s (4448kB/s)(8192KiB/1886msec); 0 zone resets clat (msec): min=635, max=889, avg=762.59, stdev=179.22 lat (msec): min=636, max=890, avg=763.40, stdev=179.97 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8175, max= 8175, per=47.05%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=12.47%, ctx=50, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152398: Mon Mar 16 14:59:20 2026 write: IOPS=1, BW=6752KiB/s (6914kB/s)(12.0MiB/1820msec); 0 zone resets clat (msec): min=148, max=831, avg=587.34, stdev=380.93 lat (msec): min=148, max=832, avg=587.74, stdev=380.95 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8175, max= 8175, per=47.05%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.80%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152399: Mon Mar 16 14:59:20 2026 write: IOPS=1, BW=7782KiB/s (7969kB/s)(12.0MiB/1579msec); 0 zone resets clat (msec): min=202, max=1049, avg=508.44, stdev=470.30 lat (msec): min=202, max=1050, avg=508.70, stdev=470.31 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min=11570, max=11570, per=66.59%, avg=11570.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.91%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8687KiB/s (8896kB/s), 2172KiB/s-7787KiB/s (2224kB/s-7974kB/s), io=16.0MiB (16.8MB), run=1578-1886msec WRITE: bw=16.0MiB/s (17.8MB/s), 4344KiB/s-7782KiB/s (4448kB/s-7969kB/s), io=32.0MiB (33.6MB), run=1579-1886msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152400: Mon Mar 16 14:59:21 2026 read: IOPS=2, BW=8545KiB/s (8750kB/s)(12.0MiB/1438msec) clat (msec): min=450, max=506, avg=472.46, stdev=29.51 lat (msec): min=450, max=506, avg=472.46, stdev=29.51 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 6077, max= 7742, per=92.48%, avg=6909.50, stdev=1177.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=40.78%, ctx=1855, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152401: Mon Mar 16 14:59:21 2026 read: IOPS=0, BW=1868KiB/s (1913kB/s)(4096KiB/2193msec) clat (nsec): min=443569k, max=443569k, avg=443568771.00, stdev= 0.00 lat (nsec): min=443571k, max=443571k, avg=443570520.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 6041, max= 6041, per=80.86%, avg=6041.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3736KiB/s (3825kB/s)(8192KiB/2193msec); 0 zone resets clat (msec): min=821, max=840, avg=830.57, stdev=13.44 lat (msec): min=821, max=840, avg=830.89, stdev=13.46 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8175, max= 8175, per=54.71%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=15.51%, ctx=769, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152402: Mon Mar 16 14:59:21 2026 write: IOPS=1, BW=5637KiB/s (5772kB/s)(12.0MiB/2180msec); 0 zone resets clat (msec): min=238, max=960, avg=688.72, stdev=392.43 lat (msec): min=238, max=960, avg=689.00, stdev=392.54 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7742, max= 7742, per=51.81%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.05%, sys=10.51%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152403: Mon Mar 16 14:59:21 2026 write: IOPS=1, BW=7429KiB/s (7608kB/s)(12.0MiB/1654msec); 0 zone resets clat (msec): min=144, max=952, avg=528.68, stdev=404.98 lat (msec): min=145, max=952, avg=528.98, stdev=404.94 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 6380, max= 6380, per=42.70%, avg=6380.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=18.33%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7471KiB/s (7650kB/s), 1868KiB/s-8545KiB/s (1913kB/s-8750kB/s), io=16.0MiB (16.8MB), run=1438-2193msec WRITE: bw=14.6MiB/s (15.3MB/s), 3736KiB/s-7429KiB/s (3825kB/s-7608kB/s), io=32.0MiB (33.6MB), run=1654-2193msec