== sanity test 398b: DIO and buffer IO race ============== 17:32:48 (1779312768) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.94304 s, 17.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148430: Wed May 20 17:34:25 2026 read: IOPS=17, BW=68.0KiB/s (70.6kB/s)(5992KiB/86867msec) clat (usec): min=34, max=575435, avg=28530.51, stdev=29510.65 lat (usec): min=34, max=575435, avg=28531.46, stdev=29510.64 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 6456], 20.00th=[ 11863], | 30.00th=[ 15139], 40.00th=[ 18482], 50.00th=[ 22152], 60.00th=[ 27395], | 70.00th=[ 34341], 80.00th=[ 42206], 90.00th=[ 55837], 95.00th=[ 68682], | 99.00th=[104334], 99.50th=[121111], 99.90th=[522191], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 183, per=24.86%, avg=68.37, stdev=32.79, samples=172 iops : min= 1, max= 45, avg=16.48, stdev= 8.26, samples=172 write: IOPS=18, BW=72.5KiB/s (74.2kB/s)(6296KiB/86867msec); 0 zone resets clat (usec): min=879, max=288052, avg=27880.55, stdev=29819.74 lat (usec): min=880, max=288053, avg=27885.75, stdev=29822.13 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1991], 20.00th=[ 3326], | 30.00th=[ 6128], 40.00th=[ 12911], 50.00th=[ 19530], 60.00th=[ 26608], | 70.00th=[ 34341], 80.00th=[ 46924], 90.00th=[ 65274], 95.00th=[ 84411], | 99.00th=[143655], 99.50th=[154141], 99.90th=[258999], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 6, max= 192, per=24.95%, avg=71.87, stdev=32.69, samples=172 iops : min= 1, max= 48, avg=17.36, stdev= 8.24, samples=172 lat (usec) : 50=1.07%, 100=2.86%, 250=0.36%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.11%, 4=6.77%, 10=8.95%, 20=22.33%, 50=36.85% lat (msec) : 100=13.51%, 250=1.69%, 500=0.10%, 750=0.07% cpu : usr=0.07%, sys=7.92%, ctx=6990, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148431: Wed May 20 17:34:25 2026 read: IOPS=17, BW=68.1KiB/s (69.8kB/s)(5940KiB/87167msec) clat (usec): min=31, max=633781, avg=28955.13, stdev=29111.88 lat (usec): min=32, max=633782, avg=28956.34, stdev=29111.92 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 7898], 20.00th=[ 12518], | 30.00th=[ 16057], 40.00th=[ 19268], 50.00th=[ 22938], 60.00th=[ 27395], | 70.00th=[ 33424], 80.00th=[ 41157], 90.00th=[ 54789], 95.00th=[ 67634], | 99.00th=[122160], 99.50th=[175113], 99.90th=[258999], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 176, per=24.43%, avg=67.18, stdev=31.35, samples=172 iops : min= 1, max= 44, avg=16.19, stdev= 7.89, samples=172 write: IOPS=18, BW=72.8KiB/s (74.6kB/s)(6348KiB/87167msec); 0 zone resets clat (usec): min=744, max=265979, avg=27692.54, stdev=30027.32 lat (usec): min=744, max=265980, avg=27695.24, stdev=30028.53 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1319], 10.00th=[ 1729], 20.00th=[ 2900], | 30.00th=[ 6063], 40.00th=[ 11731], 50.00th=[ 18744], 60.00th=[ 26084], | 70.00th=[ 35390], 80.00th=[ 46400], 90.00th=[ 65799], 95.00th=[ 86508], | 99.00th=[129500], 99.50th=[160433], 99.90th=[227541], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 15, max= 168, per=24.82%, avg=71.49, stdev=31.99, samples=172 iops : min= 3, max= 42, avg=17.26, stdev= 8.09, samples=172 lat (usec) : 50=1.17%, 100=2.25%, 250=0.52%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=6.18%, 4=6.18%, 10=8.89%, 20=21.09%, 50=38.09% lat (msec) : 100=12.73%, 250=2.34%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=7.95%, ctx=6901, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148432: Wed May 20 17:34:25 2026 read: IOPS=17, BW=69.7KiB/s (71.4kB/s)(6028KiB/86475msec) clat (usec): min=31, max=637805, avg=28069.68, stdev=28414.71 lat (usec): min=31, max=637806, avg=28071.58, stdev=28415.62 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 7111], 20.00th=[ 12256], | 30.00th=[ 15270], 40.00th=[ 18220], 50.00th=[ 22938], 60.00th=[ 27657], | 70.00th=[ 33424], 80.00th=[ 40633], 90.00th=[ 52691], 95.00th=[ 66323], | 99.00th=[ 95945], 99.50th=[117965], 99.90th=[442500], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 15, max= 199, per=25.14%, avg=69.12, stdev=31.45, samples=171 iops : min= 3, max= 49, avg=16.67, stdev= 7.92, samples=171 write: IOPS=18, BW=72.4KiB/s (74.1kB/s)(6260KiB/86475msec); 0 zone resets clat (usec): min=868, max=381171, avg=28076.21, stdev=30322.96 lat (usec): min=868, max=381172, avg=28080.14, stdev=30324.37 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1303], 10.00th=[ 1876], 20.00th=[ 3326], | 30.00th=[ 6325], 40.00th=[ 11863], 50.00th=[ 18482], 60.00th=[ 27132], | 70.00th=[ 35914], 80.00th=[ 49546], 90.00th=[ 67634], 95.00th=[ 85459], | 99.00th=[128451], 99.50th=[141558], 99.90th=[250610], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 15, max= 160, per=24.86%, avg=71.60, stdev=30.49, samples=171 iops : min= 3, max= 40, avg=17.29, stdev= 7.69, samples=171 lat (usec) : 50=0.72%, 100=2.96%, 250=0.36%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=5.79%, 4=5.79%, 10=9.70%, 20=21.78%, 50=36.65% lat (msec) : 100=13.96%, 250=1.76%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=7.83%, ctx=6976, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148433: Wed May 20 17:34:25 2026 read: IOPS=17, BW=70.5KiB/s (72.2kB/s)(6052KiB/85784msec) clat (usec): min=20, max=406970, avg=26914.64, stdev=23112.69 lat (usec): min=20, max=406971, avg=26921.46, stdev=23117.21 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 758], 20.00th=[ 11469], | 30.00th=[ 15270], 40.00th=[ 18744], 50.00th=[ 22152], 60.00th=[ 26870], | 70.00th=[ 31589], 80.00th=[ 39584], 90.00th=[ 54264], 95.00th=[ 66847], | 99.00th=[ 91751], 99.50th=[119014], 99.90th=[212861], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 183, per=25.66%, avg=70.56, stdev=32.37, samples=169 iops : min= 1, max= 45, avg=17.03, stdev= 8.18, samples=169 write: IOPS=18, BW=72.7KiB/s (74.4kB/s)(6236KiB/85784msec); 0 zone resets clat (usec): min=823, max=616016, avg=28748.14, stdev=35232.61 lat (usec): min=824, max=616017, avg=28749.31, stdev=35232.64 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1303], 10.00th=[ 1811], 20.00th=[ 3326], | 30.00th=[ 6915], 40.00th=[ 13173], 50.00th=[ 20055], 60.00th=[ 26870], | 70.00th=[ 35914], 80.00th=[ 47449], 90.00th=[ 65274], 95.00th=[ 88605], | 99.00th=[132645], 99.50th=[147850], 99.90th=[450888], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 175, per=25.09%, avg=72.26, stdev=32.99, samples=170 iops : min= 1, max= 43, avg=17.46, stdev= 8.30, samples=170 lat (usec) : 50=1.24%, 100=2.99%, 250=0.59%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.42% lat (msec) : 2=5.73%, 4=5.76%, 10=8.95%, 20=21.16%, 50=37.79% lat (msec) : 100=13.41%, 250=1.73%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=7.90%, ctx=6850, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=275KiB/s (282kB/s), 68.1KiB/s-70.5KiB/s (69.8kB/s-72.2kB/s), io=23.4MiB (24.6MB), run=85784-87167msec WRITE: bw=288KiB/s (295kB/s), 72.4KiB/s-72.8KiB/s (74.1kB/s-74.6kB/s), io=24.6MiB (25.7MB), run=85784-87167msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148435: Wed May 20 17:35:53 2026 read: IOPS=8, BW=34.4KiB/s (35.2kB/s)(5992KiB/174409msec) clat (msec): min=3, max=587, avg=23.12, stdev=28.50 lat (msec): min=3, max=587, avg=23.12, stdev=28.50 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 50], 95.00th=[ 68], | 99.00th=[ 121], 99.50th=[ 140], 99.90th=[ 376], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 136, per=26.40%, avg=36.16, stdev=24.07, samples=324 iops : min= 1, max= 34, avg= 8.45, stdev= 6.04, samples=324 write: IOPS=9, BW=36.1KiB/s (36.0kB/s)(6296KiB/174409msec); 0 zone resets clat (msec): min=21, max=465, avg=88.75, stdev=49.58 lat (msec): min=21, max=465, avg=88.75, stdev=49.58 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 53], | 30.00th=[ 61], 40.00th=[ 68], 50.00th=[ 75], 60.00th=[ 85], | 70.00th=[ 97], 80.00th=[ 117], 90.00th=[ 148], 95.00th=[ 188], | 99.00th=[ 275], 99.50th=[ 317], 99.90th=[ 451], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 88, per=24.97%, avg=35.71, stdev=16.50, samples=344 iops : min= 1, max= 22, avg= 8.33, stdev= 4.18, samples=344 lat (msec) : 4=0.07%, 10=11.75%, 20=21.06%, 50=19.99%, 100=31.80% lat (msec) : 250=14.49%, 500=0.81%, 750=0.03% cpu : usr=0.05%, sys=1.93%, ctx=5322, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148436: Wed May 20 17:35:53 2026 read: IOPS=8, BW=33.0KiB/s (34.8kB/s)(5940KiB/174908msec) clat (msec): min=4, max=639, avg=23.47, stdev=28.26 lat (msec): min=4, max=639, avg=23.47, stdev=28.26 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 50], 95.00th=[ 72], | 99.00th=[ 116], 99.50th=[ 153], 99.90th=[ 317], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 119, per=26.04%, avg=35.68, stdev=22.83, samples=325 iops : min= 1, max= 29, avg= 8.33, stdev= 5.71, samples=325 write: IOPS=9, BW=36.3KiB/s (37.2kB/s)(6348KiB/174908msec); 0 zone resets clat (msec): min=20, max=506, avg=88.19, stdev=48.86 lat (msec): min=20, max=506, avg=88.19, stdev=48.86 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 37], 10.00th=[ 44], 20.00th=[ 53], | 30.00th=[ 60], 40.00th=[ 68], 50.00th=[ 77], 60.00th=[ 87], | 70.00th=[ 99], 80.00th=[ 116], 90.00th=[ 150], 95.00th=[ 182], | 99.00th=[ 264], 99.50th=[ 313], 99.90th=[ 464], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 88, per=25.09%, avg=35.88, stdev=16.59, samples=345 iops : min= 1, max= 22, avg= 8.38, stdev= 4.20, samples=345 lat (msec) : 10=11.23%, 20=20.70%, 50=20.87%, 100=31.48%, 250=15.04% lat (msec) : 500=0.62%, 750=0.07% cpu : usr=0.05%, sys=1.89%, ctx=5247, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148437: Wed May 20 17:35:53 2026 read: IOPS=8, BW=34.5KiB/s (35.3kB/s)(6028KiB/174834msec) clat (msec): min=4, max=362, avg=24.56, stdev=27.33 lat (msec): min=4, max=362, avg=24.56, stdev=27.33 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 52], 95.00th=[ 75], | 99.00th=[ 124], 99.50th=[ 163], 99.90th=[ 309], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 118, per=26.05%, avg=35.68, stdev=22.85, samples=330 iops : min= 1, max= 29, avg= 8.34, stdev= 5.75, samples=330 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6260KiB/174834msec); 0 zone resets clat (msec): min=23, max=732, avg=88.00, stdev=50.34 lat (msec): min=23, max=732, avg=88.00, stdev=50.34 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 54], | 30.00th=[ 61], 40.00th=[ 68], 50.00th=[ 75], 60.00th=[ 84], | 70.00th=[ 95], 80.00th=[ 113], 90.00th=[ 146], 95.00th=[ 182], | 99.00th=[ 275], 99.50th=[ 305], 99.90th=[ 472], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 96, per=24.84%, avg=35.53, stdev=16.60, samples=344 iops : min= 1, max= 24, avg= 8.29, stdev= 4.20, samples=344 lat (msec) : 10=10.06%, 20=21.55%, 50=20.51%, 100=33.72%, 250=13.31% lat (msec) : 500=0.81%, 750=0.03% cpu : usr=0.05%, sys=1.96%, ctx=5306, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148438: Wed May 20 17:35:53 2026 read: IOPS=8, BW=34.7KiB/s (35.6kB/s)(6052KiB/174197msec) clat (msec): min=4, max=213, avg=23.47, stdev=22.61 lat (msec): min=4, max=213, avg=23.47, stdev=22.61 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 53], 95.00th=[ 72], | 99.00th=[ 117], 99.50th=[ 140], 99.90th=[ 180], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 7, max= 127, per=26.59%, avg=36.43, stdev=23.22, samples=324 iops : min= 1, max= 31, avg= 8.51, stdev= 5.83, samples=324 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6236KiB/174197msec); 0 zone resets clat (msec): min=20, max=693, avg=88.90, stdev=51.70 lat (msec): min=20, max=693, avg=88.90, stdev=51.70 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 39], 10.00th=[ 45], 20.00th=[ 53], | 30.00th=[ 60], 40.00th=[ 67], 50.00th=[ 75], 60.00th=[ 85], | 70.00th=[ 97], 80.00th=[ 114], 90.00th=[ 157], 95.00th=[ 194], | 99.00th=[ 266], 99.50th=[ 300], 99.90th=[ 477], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 96, per=24.70%, avg=35.32, stdev=16.14, samples=343 iops : min= 1, max= 24, avg= 8.24, stdev= 4.10, samples=343 lat (msec) : 10=10.19%, 20=21.94%, 50=20.83%, 100=32.32%, 250=14.13% lat (msec) : 500=0.55%, 750=0.03% cpu : usr=0.06%, sys=1.90%, ctx=5416, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=137KiB/s (141kB/s), 33.0KiB/s-34.7KiB/s (34.8kB/s-35.6kB/s), io=23.4MiB (24.6MB), run=174197-174908msec WRITE: bw=144KiB/s (147kB/s), 35.8KiB/s-36.3KiB/s (36.7kB/s-37.2kB/s), io=24.6MiB (25.7MB), run=174197-174908msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148474: Wed May 20 17:36:19 2026 read: IOPS=18, BW=303KiB/s (310kB/s)(5920KiB/19560msec) clat (usec): min=34, max=212022, avg=27224.50, stdev=26405.75 lat (usec): min=35, max=212023, avg=27228.59, stdev=26407.13 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 194], | 30.00th=[ 15008], 40.00th=[ 19006], 50.00th=[ 23462], 60.00th=[ 28181], | 70.00th=[ 34341], 80.00th=[ 42206], 90.00th=[ 55837], 95.00th=[ 70779], | 99.00th=[110625], 99.50th=[208667], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 95, max= 728, per=26.44%, avg=313.30, stdev=143.55, samples=37 iops : min= 5, max= 45, avg=18.92, stdev= 8.91, samples=37 write: IOPS=20, BW=326KiB/s (333kB/s)(6368KiB/19560msec); 0 zone resets clat (usec): min=1159, max=231585, avg=23193.98, stdev=28932.03 lat (usec): min=1161, max=231587, avg=23198.64, stdev=28932.72 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2180], 10.00th=[ 2900], 20.00th=[ 4228], | 30.00th=[ 5735], 40.00th=[ 8291], 50.00th=[ 12911], 60.00th=[ 19268], | 70.00th=[ 26870], 80.00th=[ 39060], 90.00th=[ 53740], 95.00th=[ 70779], | 99.00th=[158335], 99.50th=[221250], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 27, max= 670, per=26.35%, avg=328.58, stdev=155.72, samples=38 iops : min= 1, max= 41, avg=19.87, stdev= 9.75, samples=38 lat (usec) : 50=1.17%, 100=6.77%, 250=1.82%, 500=0.26%, 750=0.39% lat (msec) : 2=1.95%, 4=7.94%, 10=13.67%, 20=18.10%, 50=35.42% lat (msec) : 100=10.94%, 250=1.56% cpu : usr=0.12%, sys=10.48%, ctx=1594, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148475: Wed May 20 17:36:19 2026 read: IOPS=17, BW=284KiB/s (291kB/s)(5744KiB/20197msec) clat (usec): min=25, max=295615, avg=29309.15, stdev=26017.57 lat (usec): min=26, max=295617, avg=29311.79, stdev=26016.85 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 65], 10.00th=[ 86], 20.00th=[ 12780], | 30.00th=[ 16909], 40.00th=[ 20841], 50.00th=[ 25035], 60.00th=[ 30540], | 70.00th=[ 37487], 80.00th=[ 44303], 90.00th=[ 56361], 95.00th=[ 65799], | 99.00th=[108528], 99.50th=[166724], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 27, max= 505, per=24.11%, avg=285.72, stdev=124.46, samples=39 iops : min= 1, max= 31, avg=17.18, stdev= 7.80, samples=39 write: IOPS=20, BW=324KiB/s (332kB/s)(6544KiB/20197msec); 0 zone resets clat (usec): min=1257, max=310888, avg=22909.52, stdev=27600.19 lat (usec): min=1259, max=310891, avg=22912.61, stdev=27600.57 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2212], 10.00th=[ 2966], 20.00th=[ 4146], | 30.00th=[ 6390], 40.00th=[ 9634], 50.00th=[ 14746], 60.00th=[ 20317], | 70.00th=[ 27395], 80.00th=[ 36439], 90.00th=[ 52691], 95.00th=[ 64226], | 99.00th=[139461], 99.50th=[149947], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 81, max= 601, per=25.95%, avg=323.64, stdev=124.22, samples=39 iops : min= 5, max= 37, avg=19.56, stdev= 7.76, samples=39 lat (usec) : 50=0.78%, 100=4.69%, 250=1.04%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.56%, 4=8.59%, 10=12.37%, 20=20.18%, 50=37.89% lat (msec) : 100=11.07%, 250=1.30%, 500=0.26% cpu : usr=0.08%, sys=10.40%, ctx=1664, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148476: Wed May 20 17:36:19 2026 read: IOPS=21, BW=339KiB/s (347kB/s)(6256KiB/18441msec) clat (usec): min=41, max=153547, avg=26160.20, stdev=21856.05 lat (usec): min=41, max=153549, avg=26162.04, stdev=21856.24 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 68], 10.00th=[ 84], 20.00th=[ 1582], | 30.00th=[ 16057], 40.00th=[ 19792], 50.00th=[ 23725], 60.00th=[ 28181], | 70.00th=[ 33162], 80.00th=[ 38536], 90.00th=[ 52691], 95.00th=[ 64226], | 99.00th=[ 99091], 99.50th=[137364], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 127, max= 574, per=28.93%, avg=342.83, stdev=134.18, samples=36 iops : min= 7, max= 35, avg=20.75, stdev= 8.39, samples=36 write: IOPS=20, BW=327KiB/s (335kB/s)(6032KiB/18441msec); 0 zone resets clat (usec): min=1149, max=288670, avg=21543.38, stdev=29894.21 lat (usec): min=1151, max=288671, avg=21545.83, stdev=29894.24 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2073], 10.00th=[ 2769], 20.00th=[ 4015], | 30.00th=[ 5669], 40.00th=[ 8160], 50.00th=[ 12518], 60.00th=[ 16188], | 70.00th=[ 22676], 80.00th=[ 31851], 90.00th=[ 50070], 95.00th=[ 68682], | 99.00th=[130548], 99.50th=[258999], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 63, max= 600, per=26.01%, avg=324.33, stdev=119.56, samples=36 iops : min= 3, max= 37, avg=19.61, stdev= 7.47, samples=36 lat (usec) : 50=0.65%, 100=6.25%, 250=2.21%, 500=0.39%, 750=0.39% lat (msec) : 2=2.73%, 4=7.42%, 10=13.15%, 20=19.79%, 50=36.33% lat (msec) : 100=9.24%, 250=1.17%, 500=0.26% cpu : usr=0.05%, sys=11.05%, ctx=1589, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148477: Wed May 20 17:36:19 2026 read: IOPS=20, BW=330KiB/s (338kB/s)(6032KiB/18267msec) clat (usec): min=37, max=156983, avg=26412.75, stdev=23095.99 lat (usec): min=37, max=156985, avg=26415.51, stdev=23095.58 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 78], 20.00th=[ 7177], | 30.00th=[ 14877], 40.00th=[ 18744], 50.00th=[ 23200], 60.00th=[ 26870], | 70.00th=[ 32900], 80.00th=[ 41157], 90.00th=[ 53216], 95.00th=[ 66323], | 99.00th=[112722], 99.50th=[130548], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 95, max= 697, per=27.83%, avg=329.78, stdev=123.30, samples=36 iops : min= 5, max= 43, avg=19.94, stdev= 7.71, samples=36 write: IOPS=21, BW=342KiB/s (351kB/s)(6256KiB/18267msec); 0 zone resets clat (usec): min=1109, max=189861, avg=20907.69, stdev=25308.21 lat (usec): min=1110, max=189863, avg=20910.92, stdev=25308.31 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1893], 10.00th=[ 2376], 20.00th=[ 3490], | 30.00th=[ 4555], 40.00th=[ 7242], 50.00th=[ 10421], 60.00th=[ 16712], | 70.00th=[ 24511], 80.00th=[ 33162], 90.00th=[ 57410], 95.00th=[ 72877], | 99.00th=[112722], 99.50th=[181404], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 95, max= 576, per=27.49%, avg=342.86, stdev=122.14, samples=36 iops : min= 5, max= 36, avg=20.75, stdev= 7.67, samples=36 lat (usec) : 50=0.65%, 100=6.12%, 250=2.47%, 500=0.13%, 750=0.26% lat (msec) : 2=3.12%, 4=10.42%, 10=11.72%, 20=19.01%, 50=34.38% lat (msec) : 100=10.03%, 250=1.69% cpu : usr=0.11%, sys=10.86%, ctx=1611, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1186KiB/s (1214kB/s), 284KiB/s-339KiB/s (291kB/s-347kB/s), io=23.4MiB (24.5MB), run=18267-20197msec WRITE: bw=1248KiB/s (1278kB/s), 324KiB/s-342KiB/s (332kB/s-351kB/s), io=24.6MiB (25.8MB), run=18267-20197msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148479: Wed May 20 17:36:44 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(5920KiB/44106msec) clat (msec): min=5, max=253, avg=28.54, stdev=33.11 lat (msec): min=5, max=253, avg=28.55, stdev=33.11 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 35], 90.00th=[ 61], 95.00th=[ 102], | 99.00th=[ 174], 99.50th=[ 226], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 31, max= 448, per=26.24%, avg=138.80, stdev=85.85, samples=84 iops : min= 1, max= 28, avg= 7.98, stdev= 5.47, samples=84 write: IOPS=9, BW=144KiB/s (148kB/s)(6368KiB/44106msec); 0 zone resets clat (msec): min=28, max=279, avg=83.81, stdev=41.67 lat (msec): min=28, max=279, avg=83.82, stdev=41.67 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 41], 10.00th=[ 47], 20.00th=[ 54], | 30.00th=[ 59], 40.00th=[ 66], 50.00th=[ 72], 60.00th=[ 81], | 70.00th=[ 92], 80.00th=[ 104], 90.00th=[ 144], 95.00th=[ 167], | 99.00th=[ 251], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 26, max= 256, per=26.18%, avg=145.80, stdev=64.23, samples=86 iops : min= 1, max= 16, avg= 8.41, stdev= 4.12, samples=86 lat (msec) : 10=7.81%, 20=20.70%, 50=20.44%, 100=36.85%, 250=13.54% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=2.29%, ctx=1323, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148480: Wed May 20 17:36:44 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5744KiB/45227msec) clat (msec): min=5, max=178, avg=25.01, stdev=23.80 lat (msec): min=5, max=178, avg=25.01, stdev=23.80 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 52], 95.00th=[ 69], | 99.00th=[ 136], 99.50th=[ 161], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 26, max= 415, per=25.59%, avg=135.37, stdev=86.93, samples=83 iops : min= 1, max= 25, avg= 7.78, stdev= 5.47, samples=83 write: IOPS=9, BW=145KiB/s (148kB/s)(6544KiB/45227msec); 0 zone resets clat (msec): min=31, max=419, avg=88.28, stdev=47.29 lat (msec): min=31, max=419, avg=88.28, stdev=47.29 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 44], 10.00th=[ 50], 20.00th=[ 57], | 30.00th=[ 64], 40.00th=[ 68], 50.00th=[ 78], 60.00th=[ 86], | 70.00th=[ 95], 80.00th=[ 108], 90.00th=[ 138], 95.00th=[ 182], | 99.00th=[ 279], 99.50th=[ 330], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 31, max= 288, per=25.78%, avg=143.58, stdev=58.21, samples=89 iops : min= 1, max= 18, avg= 8.28, stdev= 3.75, samples=89 lat (msec) : 10=5.86%, 20=22.40%, 50=19.66%, 100=37.89%, 250=13.15% lat (msec) : 500=1.04% cpu : usr=0.06%, sys=2.10%, ctx=1385, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148481: Wed May 20 17:36:44 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(6256KiB/44195msec) clat (msec): min=5, max=267, avg=25.08, stdev=28.21 lat (msec): min=5, max=267, avg=25.08, stdev=28.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 46], 95.00th=[ 84], | 99.00th=[ 165], 99.50th=[ 174], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 479, per=27.52%, avg=145.59, stdev=103.08, samples=85 iops : min= 1, max= 29, avg= 8.40, stdev= 6.52, samples=85 write: IOPS=8, BW=136KiB/s (140kB/s)(6032KiB/44195msec); 0 zone resets clat (msec): min=35, max=338, avg=90.98, stdev=47.02 lat (msec): min=35, max=338, avg=90.99, stdev=47.02 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 45], 10.00th=[ 53], 20.00th=[ 59], | 30.00th=[ 65], 40.00th=[ 71], 50.00th=[ 80], 60.00th=[ 88], | 70.00th=[ 96], 80.00th=[ 110], 90.00th=[ 150], 95.00th=[ 182], | 99.00th=[ 300], 99.50th=[ 326], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 224, per=24.33%, avg=135.51, stdev=56.88, samples=87 iops : min= 1, max= 14, avg= 7.76, stdev= 3.62, samples=87 lat (msec) : 10=8.72%, 20=23.31%, 50=18.36%, 100=34.77%, 250=13.80% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=2.42%, ctx=1484, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148482: Wed May 20 17:36:44 2026 read: IOPS=8, BW=135KiB/s (138kB/s)(6032KiB/44603msec) clat (msec): min=5, max=229, avg=25.55, stdev=27.09 lat (msec): min=5, max=229, avg=25.55, stdev=27.09 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 54], 95.00th=[ 75], | 99.00th=[ 159], 99.50th=[ 165], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 352, per=26.50%, avg=140.18, stdev=79.23, samples=84 iops : min= 1, max= 22, avg= 8.05, stdev= 5.05, samples=84 write: IOPS=8, BW=140KiB/s (144kB/s)(6256KiB/44603msec); 0 zone resets clat (msec): min=29, max=407, avg=88.68, stdev=45.88 lat (msec): min=29, max=407, avg=88.68, stdev=45.88 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 42], 10.00th=[ 48], 20.00th=[ 56], | 30.00th=[ 64], 40.00th=[ 70], 50.00th=[ 78], 60.00th=[ 88], | 70.00th=[ 97], 80.00th=[ 113], 90.00th=[ 140], 95.00th=[ 184], | 99.00th=[ 247], 99.50th=[ 330], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 31, max= 286, per=25.04%, avg=139.50, stdev=59.36, samples=88 iops : min= 1, max= 17, avg= 8.02, stdev= 3.82, samples=88 lat (msec) : 10=9.11%, 20=21.48%, 50=19.40%, 100=33.98%, 250=15.63% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.28%, ctx=1380, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=530KiB/s (542kB/s), 127KiB/s-142KiB/s (130kB/s-145kB/s), io=23.4MiB (24.5MB), run=44106-45227msec WRITE: bw=557KiB/s (571kB/s), 136KiB/s-145KiB/s (140kB/s-148kB/s), io=24.6MiB (25.8MB), run=44106-45227msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148497: Wed May 20 17:36:55 2026 read: IOPS=1, BW=1650KiB/s (1690kB/s)(7168KiB/4343msec) clat (msec): min=53, max=223, avg=121.32, stdev=71.43 lat (msec): min=53, max=223, avg=121.32, stdev=71.43 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 62], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 94], 60.00th=[ 122], | 70.00th=[ 122], 80.00th=[ 220], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 2019, max= 7861, per=92.72%, avg=3976.00, stdev=3364.54, samples=3 iops : min= 1, max= 7, avg= 3.33, stdev= 3.21, samples=3 write: IOPS=1, BW=1179KiB/s (1207kB/s)(5120KiB/4343msec); 0 zone resets clat (msec): min=120, max=1689, avg=689.87, stdev=664.01 lat (msec): min=120, max=1689, avg=689.95, stdev=664.02 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1965, max= 4039, per=44.68%, avg=2682.33, stdev=1175.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.09%, sys=4.77%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148498: Wed May 20 17:36:55 2026 read: IOPS=0, BW=429KiB/s (439kB/s)(2048KiB/4776msec) clat (msec): min=92, max=252, avg=172.85, stdev=113.12 lat (msec): min=92, max=252, avg=172.86, stdev=113.12 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 93], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 1892, max= 2019, per=45.60%, avg=1955.50, stdev=89.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2144KiB/s (2196kB/s)(10.0MiB/4776msec); 0 zone resets clat (msec): min=104, max=1218, avg=436.87, stdev=419.74 lat (msec): min=104, max=1218, avg=436.97, stdev=419.72 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 125], | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 268], 60.00th=[ 275], | 70.00th=[ 351], 80.00th=[ 550], 90.00th=[ 1167], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1996, max= 4079, per=42.82%, avg=2570.57, stdev=934.07, samples=7 iops : min= 1, max= 3, avg= 1.86, stdev= 0.90, samples=7 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=5.21%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148499: Wed May 20 17:36:55 2026 read: IOPS=1, BW=1459KiB/s (1494kB/s)(6144KiB/4210msec) clat (msec): min=51, max=1119, avg=408.29, stdev=379.02 lat (msec): min=51, max=1119, avg=408.29, stdev=379.02 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 426], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1996, max= 4039, per=58.90%, avg=2525.50, stdev=1009.22, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1459KiB/s (1494kB/s)(6144KiB/4210msec); 0 zone resets clat (msec): min=105, max=682, avg=287.62, stdev=219.55 lat (msec): min=105, max=682, avg=287.73, stdev=219.54 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 203], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2019, max= 5988, per=50.38%, avg=3024.50, stdev=1975.71, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.75%, ctx=162, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148500: Wed May 20 17:36:55 2026 read: IOPS=1, BW=1154KiB/s (1182kB/s)(5120KiB/4435msec) clat (msec): min=63, max=165, avg=123.31, stdev=42.47 lat (msec): min=63, max=165, avg=123.31, stdev=42.47 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 125], 60.00th=[ 125], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 167], 95.00th=[ 167], | 99.00th=[ 167], 99.50th=[ 167], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 4039, max= 4039, per=94.19%, avg=4039.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1616KiB/s (1655kB/s)(7168KiB/4435msec); 0 zone resets clat (msec): min=129, max=1372, avg=543.05, stdev=492.67 lat (msec): min=130, max=1372, avg=543.14, stdev=492.69 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 136], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 368], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 1070], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 2019, max= 3856, per=41.53%, avg=2492.75, stdev=908.94, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=4.40%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4288KiB/s (4391kB/s), 429KiB/s-1650KiB/s (439kB/s-1690kB/s), io=20.0MiB (20.0MB), run=4210-4776msec WRITE: bw=6003KiB/s (6147kB/s), 1179KiB/s-2144KiB/s (1207kB/s-2196kB/s), io=28.0MiB (29.4MB), run=4210-4776msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148502: Wed May 20 17:36:56 2026 read: IOPS=1, BW=1796KiB/s (1839kB/s)(7168KiB/3992msec) clat (usec): min=518, max=654825, avg=234801.26, stdev=213322.15 lat (usec): min=519, max=654826, avg=234802.38, stdev=213322.13 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 63177], | 30.00th=[173016], 40.00th=[173016], 50.00th=[185598], 60.00th=[254804], | 70.00th=[254804], 80.00th=[308282], 90.00th=[658506], 95.00th=[658506], | 99.00th=[658506], 99.50th=[658506], 99.90th=[658506], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 1906, max= 3396, per=49.71%, avg=2284.60, stdev=624.02, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1283KiB/s (1313kB/s)(5120KiB/3992msec); 0 zone resets clat (msec): min=121, max=1313, avg=469.19, stdev=507.39 lat (msec): min=121, max=1313, avg=469.27, stdev=507.41 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2043, max= 6119, per=63.43%, avg=4081.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=12.83%, ctx=725, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148503: Wed May 20 17:36:56 2026 read: IOPS=0, BW=460KiB/s (471kB/s)(2048KiB/4456msec) clat (msec): min=124, max=204, avg=164.24, stdev=56.39 lat (msec): min=124, max=204, avg=164.24, stdev=56.39 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 205], 95.00th=[ 205], | 99.00th=[ 205], 99.50th=[ 205], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 1643, max= 2039, per=40.06%, avg=1841.00, stdev=280.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2298KiB/s (2353kB/s)(10.0MiB/4456msec); 0 zone resets clat (msec): min=107, max=1217, avg=412.37, stdev=404.72 lat (msec): min=108, max=1217, avg=412.54, stdev=404.68 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 174], | 30.00th=[ 176], 40.00th=[ 197], 50.00th=[ 241], 60.00th=[ 271], | 70.00th=[ 309], 80.00th=[ 317], 90.00th=[ 1116], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 2039, max= 6131, per=49.95%, avg=3213.80, stdev=1802.14, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 2000=16.67% cpu : usr=0.04%, sys=14.84%, ctx=113, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148504: Wed May 20 17:36:56 2026 read: IOPS=1, BW=1992KiB/s (2040kB/s)(6144KiB/3084msec) clat (usec): min=495, max=215831, avg=118136.86, stdev=95840.12 lat (usec): min=497, max=215832, avg=118137.98, stdev=95839.87 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[125305], 50.00th=[125305], 60.00th=[173016], | 70.00th=[191890], 80.00th=[191890], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 2039, max= 5720, per=84.41%, avg=3879.50, stdev=2602.86, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1992KiB/s (2040kB/s)(6144KiB/3084msec); 0 zone resets clat (msec): min=116, max=1243, avg=395.51, stdev=419.45 lat (msec): min=116, max=1243, avg=395.61, stdev=419.44 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 257], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2039, max= 3813, per=47.05%, avg=3027.33, stdev=904.20, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.03%, sys=17.97%, ctx=283, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148505: Wed May 20 17:36:56 2026 read: IOPS=1, BW=1178KiB/s (1206kB/s)(5120KiB/4347msec) clat (usec): min=521, max=1477.7k, avg=321154.67, stdev=648750.13 lat (usec): min=522, max=1477.7k, avg=321155.85, stdev=648749.97 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], | 20.00th=[ 523], 30.00th=[ 816], 40.00th=[ 816], | 50.00th=[ 2114], 60.00th=[ 2114], 70.00th=[ 124257], | 80.00th=[ 124257], 90.00th=[1484784], 95.00th=[1484784], | 99.00th=[1484784], 99.50th=[1484784], 99.90th=[1484784], | 99.95th=[1484784], 99.99th=[1484784] bw ( KiB/s): min= 2039, max= 6131, per=88.88%, avg=4085.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1649KiB/s (1689kB/s)(7168KiB/4347msec); 0 zone resets clat (msec): min=65, max=1084, avg=390.71, stdev=367.41 lat (msec): min=65, max=1084, avg=390.80, stdev=367.40 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 115], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 236], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 651], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1723, max= 4087, per=37.92%, avg=2439.75, stdev=1105.96, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=8.33%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=10.91%, ctx=294, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4596KiB/s (4706kB/s), 460KiB/s-1992KiB/s (471kB/s-2040kB/s), io=20.0MiB (20.0MB), run=3084-4456msec WRITE: bw=6434KiB/s (6589kB/s), 1283KiB/s-2298KiB/s (1313kB/s-2353kB/s), io=28.0MiB (29.4MB), run=3084-4456msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148511: Wed May 20 17:37:04 2026 read: IOPS=1, BW=6380KiB/s (6533kB/s)(12.0MiB/1926msec) clat (msec): min=469, max=632, avg=577.13, stdev=92.91 lat (msec): min=469, max=632, avg=577.13, stdev=92.91 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8159, max= 8192, per=96.11%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=29.45%, ctx=590, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148512: Wed May 20 17:37:04 2026 read: IOPS=0, BW=2296KiB/s (2351kB/s)(4096KiB/1784msec) clat (nsec): min=466500k, max=466500k, avg=466499885.00, stdev= 0.00 lat (nsec): min=466501k, max=466501k, avg=466500822.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 8159, max= 8159, per=95.92%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4592KiB/s (4702kB/s)(8192KiB/1784msec); 0 zone resets clat (msec): min=261, max=936, avg=598.60, stdev=477.17 lat (msec): min=261, max=936, avg=599.00, stdev=477.26 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8159, max= 8159, per=55.53%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=11.22%, ctx=175, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148513: Wed May 20 17:37:04 2026 write: IOPS=1, BW=5510KiB/s (5643kB/s)(12.0MiB/2230msec); 0 zone resets clat (msec): min=589, max=833, avg=710.15, stdev=122.02 lat (msec): min=589, max=833, avg=710.38, stdev=122.05 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8159, max= 8175, per=55.58%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=12.70%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148514: Wed May 20 17:37:04 2026 write: IOPS=1, BW=7613KiB/s (7796kB/s)(12.0MiB/1614msec); 0 zone resets clat (msec): min=192, max=1035, avg=487.52, stdev=474.80 lat (msec): min=192, max=1035, avg=487.95, stdev=474.74 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7447, max= 8159, per=53.10%, avg=7803.00, stdev=503.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.97%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8507KiB/s (8711kB/s), 2296KiB/s-6380KiB/s (2351kB/s-6533kB/s), io=16.0MiB (16.8MB), run=1784-1926msec WRITE: bw=14.3MiB/s (15.0MB/s), 4592KiB/s-7613KiB/s (4702kB/s-7796kB/s), io=32.0MiB (33.6MB), run=1614-2230msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148515: Wed May 20 17:37:05 2026 read: IOPS=1, BW=5469KiB/s (5600kB/s)(12.0MiB/2247msec) clat (msec): min=418, max=949, avg=738.80, stdev=282.38 lat (msec): min=418, max=949, avg=738.80, stdev=282.38 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.94%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148516: Wed May 20 17:37:05 2026 read: IOPS=0, BW=1913KiB/s (1959kB/s)(4096KiB/2141msec) clat (nsec): min=1041.9M, max=1041.9M, avg=1041927257.00, stdev= 0.00 lat (nsec): min=1041.9M, max=1041.9M, avg=1041929794.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3826KiB/s (3918kB/s)(8192KiB/2141msec); 0 zone resets clat (msec): min=241, max=692, avg=466.92, stdev=319.20 lat (msec): min=241, max=693, avg=467.39, stdev=319.39 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8192, max= 8192, per=59.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.25%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148517: Wed May 20 17:37:05 2026 write: IOPS=1, BW=5146KiB/s (5269kB/s)(12.0MiB/2388msec); 0 zone resets clat (msec): min=439, max=941, avg=747.67, stdev=269.98 lat (msec): min=439, max=942, avg=748.34, stdev=269.95 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8192, max= 8192, per=59.70%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.03%, ctx=52, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148518: Wed May 20 17:37:05 2026 write: IOPS=1, BW=7190KiB/s (7363kB/s)(12.0MiB/1709msec); 0 zone resets clat (msec): min=266, max=1044, avg=539.09, stdev=437.81 lat (msec): min=266, max=1044, avg=539.54, stdev=437.78 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7353, max= 8143, per=56.47%, avg=7748.00, stdev=558.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.67%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7291KiB/s (7466kB/s), 1913KiB/s-5469KiB/s (1959kB/s-5600kB/s), io=16.0MiB (16.8MB), run=2141-2247msec WRITE: bw=13.4MiB/s (14.1MB/s), 3826KiB/s-7190KiB/s (3918kB/s-7363kB/s), io=32.0MiB (33.6MB), run=1709-2388msec