== sanity test 398b: DIO and buffer IO race ============== 22:51:26 (1775875886) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.61709 s, 13.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147185: Fri Apr 10 22:52:47 2026 read: IOPS=21, BW=87.8KiB/s (89.9kB/s)(5992KiB/68230msec) clat (usec): min=31, max=655790, avg=23466.36, stdev=21946.99 lat (usec): min=32, max=655791, avg=23468.34, stdev=21947.00 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 106], 10.00th=[ 9110], 20.00th=[ 12125], | 30.00th=[ 14615], 40.00th=[ 17171], 50.00th=[ 20317], 60.00th=[ 23725], | 70.00th=[ 27919], 80.00th=[ 33424], 90.00th=[ 40633], 95.00th=[ 47973], | 99.00th=[ 73925], 99.50th=[ 87557], 99.90th=[114820], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 8, max= 167, per=25.86%, avg=87.39, stdev=26.23, samples=135 iops : min= 2, max= 41, avg=21.34, stdev= 6.61, samples=135 write: IOPS=23, BW=92.3KiB/s (94.5kB/s)(6296KiB/68230msec); 0 zone resets clat (usec): min=903, max=273103, avg=20857.39, stdev=21408.52 lat (usec): min=904, max=273105, avg=20861.52, stdev=21409.55 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1565], 10.00th=[ 2114], 20.00th=[ 3359], | 30.00th=[ 5866], 40.00th=[ 10290], 50.00th=[ 15270], 60.00th=[ 20317], | 70.00th=[ 26608], 80.00th=[ 34866], 90.00th=[ 46400], 95.00th=[ 57934], | 99.00th=[ 94897], 99.50th=[120062], 99.90th=[170918], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 15, max= 151, per=25.96%, avg=91.91, stdev=29.12, samples=135 iops : min= 3, max= 37, avg=22.47, stdev= 7.28, samples=135 lat (usec) : 50=0.13%, 100=2.25%, 250=0.59%, 500=0.07%, 1000=0.16% lat (msec) : 2=4.49%, 4=7.32%, 10=11.20%, 20=28.26%, 50=39.19% lat (msec) : 100=5.76%, 250=0.52%, 500=0.03%, 750=0.03% cpu : usr=0.15%, sys=12.34%, ctx=7550, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147186: Fri Apr 10 22:52:47 2026 read: IOPS=20, BW=83.7KiB/s (85.7kB/s)(5940KiB/70939msec) clat (usec): min=37, max=175007, avg=23535.12, stdev=16005.35 lat (usec): min=37, max=175008, avg=23536.77, stdev=16005.33 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 141], 10.00th=[ 9503], 20.00th=[ 12649], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 23462], | 70.00th=[ 27657], 80.00th=[ 33424], 90.00th=[ 42206], 95.00th=[ 49546], | 99.00th=[ 78119], 99.50th=[ 92799], 99.90th=[158335], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 8, max= 151, per=24.59%, avg=83.12, stdev=26.74, samples=140 iops : min= 2, max= 37, avg=20.26, stdev= 6.68, samples=140 write: IOPS=22, BW=89.5KiB/s (91.6kB/s)(6348KiB/70939msec); 0 zone resets clat (usec): min=787, max=638900, avg=22499.66, stdev=26543.48 lat (usec): min=787, max=638903, avg=22502.27, stdev=26543.14 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1729], 10.00th=[ 2147], 20.00th=[ 3785], | 30.00th=[ 6587], 40.00th=[ 12125], 50.00th=[ 16909], 60.00th=[ 22414], | 70.00th=[ 27132], 80.00th=[ 35914], 90.00th=[ 49546], 95.00th=[ 62129], | 99.00th=[103285], 99.50th=[128451], 99.90th=[173016], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 8, max= 192, per=24.98%, avg=88.44, stdev=27.83, samples=140 iops : min= 2, max= 48, avg=21.60, stdev= 6.97, samples=140 lat (usec) : 50=0.39%, 100=1.66%, 250=0.65%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.23%, 4=6.67%, 10=9.70%, 20=29.10%, 50=40.20% lat (msec) : 100=6.48%, 250=0.72%, 750=0.03% cpu : usr=0.14%, sys=11.97%, ctx=7604, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147187: Fri Apr 10 22:52:47 2026 read: IOPS=21, BW=85.2KiB/s (87.2kB/s)(6028KiB/70779msec) clat (usec): min=32, max=300263, avg=22691.42, stdev=16764.30 lat (usec): min=32, max=300264, avg=22705.97, stdev=16767.18 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 87], 10.00th=[ 8291], 20.00th=[ 11994], | 30.00th=[ 14615], 40.00th=[ 17171], 50.00th=[ 19792], 60.00th=[ 22938], | 70.00th=[ 26870], 80.00th=[ 32113], 90.00th=[ 40633], 95.00th=[ 48497], | 99.00th=[ 70779], 99.50th=[ 88605], 99.90th=[183501], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 8, max= 159, per=25.00%, avg=84.51, stdev=25.97, samples=140 iops : min= 2, max= 39, avg=20.61, stdev= 6.45, samples=140 write: IOPS=22, BW=88.4KiB/s (90.6kB/s)(6260KiB/70779msec); 0 zone resets clat (usec): min=749, max=605107, avg=23198.73, stdev=25939.20 lat (usec): min=750, max=605109, avg=23203.05, stdev=25938.22 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1631], 10.00th=[ 2073], 20.00th=[ 3818], | 30.00th=[ 6915], 40.00th=[ 12911], 50.00th=[ 18220], 60.00th=[ 23987], | 70.00th=[ 29492], 80.00th=[ 38536], 90.00th=[ 50070], 95.00th=[ 60556], | 99.00th=[ 89654], 99.50th=[112722], 99.90th=[231736], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 38, max= 182, per=24.77%, avg=87.69, stdev=27.54, samples=140 iops : min= 9, max= 45, avg=21.41, stdev= 6.90, samples=140 lat (usec) : 50=0.55%, 100=2.44%, 250=0.75%, 500=0.20%, 750=0.07% lat (msec) : 2=4.69%, 4=6.02%, 10=9.15%, 20=27.90%, 50=40.82% lat (msec) : 100=6.84%, 250=0.52%, 500=0.03%, 750=0.03% cpu : usr=0.15%, sys=12.03%, ctx=7569, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147188: Fri Apr 10 22:52:47 2026 read: IOPS=21, BW=87.6KiB/s (89.7kB/s)(6052KiB/69058msec) clat (usec): min=37, max=178512, avg=23522.47, stdev=16677.45 lat (usec): min=38, max=178513, avg=23525.81, stdev=16677.18 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 119], 10.00th=[ 9110], 20.00th=[ 12387], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 20055], 60.00th=[ 23987], | 70.00th=[ 27395], 80.00th=[ 32900], 90.00th=[ 41157], 95.00th=[ 51643], | 99.00th=[ 79168], 99.50th=[100140], 99.90th=[166724], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 8, max= 167, per=25.83%, avg=87.31, stdev=26.05, samples=137 iops : min= 2, max= 41, avg=21.33, stdev= 6.52, samples=137 write: IOPS=22, BW=90.3KiB/s (92.5kB/s)(6236KiB/69058msec); 0 zone resets clat (usec): min=748, max=629519, avg=21302.74, stdev=25005.58 lat (usec): min=749, max=629521, avg=21304.87, stdev=25005.68 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1565], 10.00th=[ 2073], 20.00th=[ 3556], | 30.00th=[ 6456], 40.00th=[ 10814], 50.00th=[ 15533], 60.00th=[ 20841], | 70.00th=[ 27132], 80.00th=[ 35390], 90.00th=[ 48497], 95.00th=[ 59507], | 99.00th=[ 84411], 99.50th=[ 98042], 99.90th=[168821], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 15, max= 166, per=25.39%, avg=89.89, stdev=29.01, samples=137 iops : min= 3, max= 41, avg=21.96, stdev= 7.25, samples=137 lat (usec) : 50=0.20%, 100=1.79%, 250=0.88%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.72%, 4=6.51%, 10=11.13%, 20=28.42%, 50=38.77% lat (msec) : 100=6.80%, 250=0.46%, 750=0.03% cpu : usr=0.12%, sys=12.25%, ctx=7460, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=338KiB/s (347kB/s), 83.7KiB/s-87.8KiB/s (85.7kB/s-89.9kB/s), io=23.4MiB (24.6MB), run=68230-70939msec WRITE: bw=354KiB/s (363kB/s), 88.4KiB/s-92.3KiB/s (90.6kB/s-94.5kB/s), io=24.6MiB (25.7MB), run=68230-70939msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147190: Fri Apr 10 22:53:59 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5992KiB/140622msec) clat (msec): min=4, max=683, avg=22.28, stdev=25.19 lat (msec): min=4, max=683, avg=22.29, stdev=25.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 41], 95.00th=[ 54], | 99.00th=[ 90], 99.50th=[ 161], 99.90th=[ 207], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 135, per=25.43%, avg=42.73, stdev=23.76, samples=275 iops : min= 1, max= 33, avg=10.13, stdev= 5.95, samples=275 write: IOPS=11, BW=44.8KiB/s (45.8kB/s)(6296KiB/140622msec); 0 zone resets clat (msec): min=23, max=227, avg=68.05, stdev=28.74 lat (msec): min=23, max=227, avg=68.05, stdev=28.74 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 62], 60.00th=[ 68], | 70.00th=[ 77], 80.00th=[ 87], 90.00th=[ 106], 95.00th=[ 123], | 99.00th=[ 171], 99.50th=[ 203], 99.90th=[ 224], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 95, per=25.22%, avg=44.39, stdev=16.55, samples=278 iops : min= 1, max= 23, avg=10.54, stdev= 4.17, samples=278 lat (msec) : 10=9.83%, 20=20.25%, 50=30.37%, 100=32.91%, 250=6.61% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=3.04%, ctx=5572, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147191: Fri Apr 10 22:53:59 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(5940KiB/142435msec) clat (msec): min=4, max=679, avg=22.64, stdev=26.15 lat (msec): min=4, max=679, avg=22.64, stdev=26.15 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 44], 95.00th=[ 57], | 99.00th=[ 106], 99.50th=[ 148], 99.90th=[ 207], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 119, per=24.93%, avg=41.88, stdev=24.48, samples=278 iops : min= 1, max= 29, avg= 9.92, stdev= 6.16, samples=278 write: IOPS=11, BW=44.6KiB/s (45.6kB/s)(6348KiB/142435msec); 0 zone resets clat (msec): min=24, max=310, avg=68.48, stdev=28.87 lat (msec): min=24, max=310, avg=68.48, stdev=28.87 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 56], 50.00th=[ 62], 60.00th=[ 69], | 70.00th=[ 78], 80.00th=[ 87], 90.00th=[ 107], 95.00th=[ 125], | 99.00th=[ 174], 99.50th=[ 188], 99.90th=[ 220], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=44.11, stdev=16.24, samples=282 iops : min= 1, max= 25, avg=10.48, stdev= 4.08, samples=282 lat (msec) : 10=10.22%, 20=19.69%, 50=29.46%, 100=33.82%, 250=6.74% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.00%, ctx=5623, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147192: Fri Apr 10 22:53:59 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6028KiB/141514msec) clat (msec): min=4, max=192, avg=22.23, stdev=18.32 lat (msec): min=4, max=192, avg=22.24, stdev=18.32 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 57], | 99.00th=[ 89], 99.50th=[ 105], 99.90th=[ 182], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 7, max= 134, per=25.41%, avg=42.69, stdev=23.81, samples=277 iops : min= 1, max= 33, avg=10.12, stdev= 5.94, samples=277 write: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6260KiB/141514msec); 0 zone resets clat (msec): min=23, max=722, avg=68.93, stdev=33.50 lat (msec): min=23, max=722, avg=68.93, stdev=33.50 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 35], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 69], | 70.00th=[ 78], 80.00th=[ 88], 90.00th=[ 108], 95.00th=[ 123], | 99.00th=[ 169], 99.50th=[ 194], 99.90th=[ 321], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 104, per=24.89%, avg=43.81, stdev=16.90, samples=280 iops : min= 1, max= 26, avg=10.40, stdev= 4.26, samples=280 lat (msec) : 10=9.47%, 20=20.80%, 50=29.13%, 100=33.89%, 250=6.61% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=3.06%, ctx=5578, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147193: Fri Apr 10 22:53:59 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6052KiB/141866msec) clat (msec): min=4, max=194, avg=21.95, stdev=19.24 lat (msec): min=4, max=194, avg=21.95, stdev=19.24 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 58], | 99.00th=[ 99], 99.50th=[ 125], 99.90th=[ 192], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 7, max= 159, per=25.71%, avg=43.19, stdev=24.06, samples=275 iops : min= 1, max= 39, avg=10.24, stdev= 6.05, samples=275 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6236KiB/141866msec); 0 zone resets clat (msec): min=22, max=729, avg=69.62, stdev=34.54 lat (msec): min=22, max=729, avg=69.62, stdev=34.54 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 36], 10.00th=[ 41], 20.00th=[ 47], | 30.00th=[ 52], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 69], | 70.00th=[ 77], 80.00th=[ 89], 90.00th=[ 108], 95.00th=[ 126], | 99.00th=[ 180], 99.50th=[ 209], 99.90th=[ 321], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8, max= 88, per=24.74%, avg=43.53, stdev=15.93, samples=281 iops : min= 2, max= 22, avg=10.33, stdev= 3.99, samples=281 lat (msec) : 10=9.83%, 20=21.19%, 50=29.17%, 100=32.65%, 250=7.06% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=3.05%, ctx=5602, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=169KiB/s (173kB/s), 41.7KiB/s-42.7KiB/s (42.7kB/s-43.7kB/s), io=23.4MiB (24.6MB), run=140622-142435msec WRITE: bw=177KiB/s (181kB/s), 43.0KiB/s-44.8KiB/s (45.0kB/s-45.8kB/s), io=24.6MiB (25.7MB), run=140622-142435msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147226: Fri Apr 10 22:54:24 2026 read: IOPS=20, BW=332KiB/s (340kB/s)(5920KiB/17818msec) clat (usec): min=19, max=138520, avg=24676.24, stdev=20017.73 lat (usec): min=19, max=138521, avg=24677.46, stdev=20017.80 clat percentiles (usec): | 1.00th=[ 34], 5.00th=[ 50], 10.00th=[ 67], 20.00th=[ 190], | 30.00th=[ 16581], 40.00th=[ 19530], 50.00th=[ 22676], 60.00th=[ 27395], | 70.00th=[ 31589], 80.00th=[ 38011], 90.00th=[ 48497], 95.00th=[ 58983], | 99.00th=[ 83362], 99.50th=[126354], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 158, max= 605, per=25.47%, avg=332.83, stdev=96.44, samples=35 iops : min= 9, max= 37, avg=20.14, stdev= 6.15, samples=35 write: IOPS=22, BW=357KiB/s (366kB/s)(6368KiB/17818msec); 0 zone resets clat (usec): min=1116, max=167129, avg=21438.38, stdev=20801.65 lat (usec): min=1117, max=167132, avg=21442.48, stdev=20802.98 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1975], 10.00th=[ 2671], 20.00th=[ 4080], | 30.00th=[ 6259], 40.00th=[ 9241], 50.00th=[ 15664], 60.00th=[ 20579], | 70.00th=[ 28181], 80.00th=[ 37487], 90.00th=[ 50070], 95.00th=[ 58459], | 99.00th=[ 84411], 99.50th=[115868], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 192, max= 701, per=26.07%, avg=358.40, stdev=116.08, samples=35 iops : min= 12, max= 43, avg=21.77, stdev= 7.20, samples=35 lat (usec) : 20=0.13%, 50=2.34%, 100=4.95%, 250=2.73%, 500=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.12%, 4=7.03%, 10=12.11%, 20=17.45%, 50=39.97% lat (msec) : 100=9.24%, 250=0.65% cpu : usr=0.10%, sys=12.03%, ctx=1672, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147227: Fri Apr 10 22:54:24 2026 read: IOPS=19, BW=313KiB/s (321kB/s)(5744KiB/18323msec) clat (usec): min=35, max=128748, avg=25165.72, stdev=19299.62 lat (usec): min=35, max=128750, avg=25169.10, stdev=19299.30 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 61], 10.00th=[ 75], 20.00th=[ 10421], | 30.00th=[ 16909], 40.00th=[ 19268], 50.00th=[ 22938], 60.00th=[ 28181], | 70.00th=[ 32637], 80.00th=[ 39584], 90.00th=[ 46400], 95.00th=[ 56361], | 99.00th=[101188], 99.50th=[113771], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 30, max= 510, per=23.83%, avg=311.47, stdev=120.42, samples=36 iops : min= 1, max= 31, avg=18.78, stdev= 7.53, samples=36 write: IOPS=22, BW=357KiB/s (366kB/s)(6544KiB/18323msec); 0 zone resets clat (usec): min=1282, max=208815, avg=22067.97, stdev=25537.33 lat (usec): min=1284, max=208817, avg=22079.61, stdev=25537.29 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1893], 10.00th=[ 2606], 20.00th=[ 3949], | 30.00th=[ 5735], 40.00th=[ 8160], 50.00th=[ 12387], 60.00th=[ 18220], | 70.00th=[ 24249], 80.00th=[ 35914], 90.00th=[ 56886], 95.00th=[ 71828], | 99.00th=[111674], 99.50th=[125305], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 90, max= 604, per=25.81%, avg=354.86, stdev=129.51, samples=36 iops : min= 5, max= 37, avg=21.53, stdev= 8.09, samples=36 lat (usec) : 50=0.78%, 100=5.86%, 250=1.30%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.99%, 4=8.07%, 10=13.54%, 20=19.66%, 50=36.46% lat (msec) : 100=9.24%, 250=1.43% cpu : usr=0.12%, sys=11.79%, ctx=1682, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147229: Fri Apr 10 22:54:24 2026 read: IOPS=21, BW=348KiB/s (357kB/s)(6256KiB/17967msec) clat (usec): min=36, max=126223, avg=24130.22, stdev=18568.16 lat (usec): min=37, max=126224, avg=24131.80, stdev=18568.61 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 59], 10.00th=[ 72], 20.00th=[ 2868], | 30.00th=[ 15795], 40.00th=[ 19530], 50.00th=[ 23462], 60.00th=[ 26870], | 70.00th=[ 31589], 80.00th=[ 36963], 90.00th=[ 44303], 95.00th=[ 51119], | 99.00th=[ 88605], 99.50th=[108528], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 160, max= 541, per=26.71%, avg=349.09, stdev=83.45, samples=35 iops : min= 10, max= 33, avg=21.17, stdev= 5.21, samples=35 write: IOPS=20, BW=336KiB/s (344kB/s)(6032KiB/17967msec); 0 zone resets clat (usec): min=1384, max=101071, avg=22453.32, stdev=19679.96 lat (usec): min=1385, max=101073, avg=22455.90, stdev=19679.76 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2073], 10.00th=[ 3195], 20.00th=[ 4752], | 30.00th=[ 7242], 40.00th=[ 12387], 50.00th=[ 17957], 60.00th=[ 22676], | 70.00th=[ 29754], 80.00th=[ 37487], 90.00th=[ 47973], 95.00th=[ 57410], | 99.00th=[ 93848], 99.50th=[ 99091], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 126, max= 608, per=24.14%, avg=331.94, stdev=104.56, samples=35 iops : min= 7, max= 38, avg=20.09, stdev= 6.63, samples=35 lat (usec) : 50=1.04%, 100=6.90%, 250=1.82%, 500=0.13%, 750=0.13% lat (msec) : 2=2.21%, 4=5.08%, 10=10.55%, 20=20.31%, 50=44.40% lat (msec) : 100=6.90%, 250=0.52% cpu : usr=0.13%, sys=11.82%, ctx=1740, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147231: Fri Apr 10 22:54:24 2026 read: IOPS=21, BW=342KiB/s (350kB/s)(6032KiB/17661msec) clat (usec): min=21, max=104989, avg=22314.65, stdev=17524.40 lat (usec): min=21, max=104990, avg=22315.85, stdev=17524.34 clat percentiles (usec): | 1.00th=[ 35], 5.00th=[ 54], 10.00th=[ 67], 20.00th=[ 118], | 30.00th=[ 14484], 40.00th=[ 17957], 50.00th=[ 22676], 60.00th=[ 25822], | 70.00th=[ 29230], 80.00th=[ 36439], 90.00th=[ 43254], 95.00th=[ 50594], | 99.00th=[ 70779], 99.50th=[104334], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 91, max= 544, per=26.12%, avg=341.37, stdev=115.13, samples=35 iops : min= 5, max= 34, avg=20.69, stdev= 7.32, samples=35 write: IOPS=22, BW=354KiB/s (363kB/s)(6256KiB/17661msec); 0 zone resets clat (usec): min=1254, max=167581, avg=23176.18, stdev=22862.19 lat (usec): min=1256, max=167581, avg=23186.91, stdev=22863.37 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1926], 10.00th=[ 2442], 20.00th=[ 4293], | 30.00th=[ 6325], 40.00th=[ 10683], 50.00th=[ 15533], 60.00th=[ 21627], | 70.00th=[ 29754], 80.00th=[ 40633], 90.00th=[ 54789], 95.00th=[ 67634], | 99.00th=[100140], 99.50th=[109577], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 121, max= 576, per=25.82%, avg=355.00, stdev=105.91, samples=35 iops : min= 7, max= 36, avg=21.54, stdev= 6.69, samples=35 lat (usec) : 50=1.69%, 100=6.90%, 250=2.34%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.73%, 4=7.16%, 10=10.94%, 20=18.88%, 50=39.71% lat (msec) : 100=8.20%, 250=0.78% cpu : usr=0.12%, sys=11.47%, ctx=1657, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1307KiB/s (1339kB/s), 313KiB/s-348KiB/s (321kB/s-357kB/s), io=23.4MiB (24.5MB), run=17661-18323msec WRITE: bw=1375KiB/s (1408kB/s), 336KiB/s-357KiB/s (344kB/s-366kB/s), io=24.6MiB (25.8MB), run=17661-18323msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147228: Fri Apr 10 22:54:45 2026 read: IOPS=9, BW=153KiB/s (157kB/s)(5920KiB/38648msec) clat (msec): min=5, max=184, avg=23.99, stdev=20.84 lat (msec): min=5, max=184, avg=23.99, stdev=20.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 49], 95.00th=[ 71], | 99.00th=[ 103], 99.50th=[ 128], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 320, per=24.86%, avg=151.16, stdev=81.53, samples=76 iops : min= 1, max= 20, avg= 8.70, stdev= 5.24, samples=76 write: IOPS=10, BW=165KiB/s (169kB/s)(6368KiB/38648msec); 0 zone resets clat (msec): min=26, max=286, avg=74.30, stdev=33.57 lat (msec): min=26, max=286, avg=74.31, stdev=33.57 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 39], 10.00th=[ 43], 20.00th=[ 48], | 30.00th=[ 55], 40.00th=[ 61], 50.00th=[ 66], 60.00th=[ 70], | 70.00th=[ 82], 80.00th=[ 99], 90.00th=[ 120], 95.00th=[ 138], | 99.00th=[ 190], 99.50th=[ 218], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 287, per=25.61%, avg=163.88, stdev=66.89, samples=76 iops : min= 1, max= 17, avg= 9.49, stdev= 4.24, samples=76 lat (msec) : 10=6.90%, 20=22.14%, 50=26.69%, 100=34.24%, 250=9.90% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=3.08%, ctx=1414, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147230: Fri Apr 10 22:54:45 2026 read: IOPS=9, BW=146KiB/s (150kB/s)(5744KiB/39332msec) clat (msec): min=5, max=184, avg=24.59, stdev=23.66 lat (msec): min=5, max=184, avg=24.60, stdev=23.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 55], 95.00th=[ 81], | 99.00th=[ 121], 99.50th=[ 138], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 29, max= 509, per=24.68%, avg=150.07, stdev=97.16, samples=76 iops : min= 1, max= 31, avg= 8.61, stdev= 6.12, samples=76 write: IOPS=10, BW=166KiB/s (170kB/s)(6544KiB/39332msec); 0 zone resets clat (msec): min=30, max=205, avg=74.15, stdev=33.36 lat (msec): min=30, max=205, avg=74.16, stdev=33.36 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 39], 10.00th=[ 42], 20.00th=[ 47], | 30.00th=[ 53], 40.00th=[ 58], 50.00th=[ 66], 60.00th=[ 74], | 70.00th=[ 82], 80.00th=[ 94], 90.00th=[ 122], 95.00th=[ 148], | 99.00th=[ 184], 99.50th=[ 197], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 63, max= 319, per=25.90%, avg=165.73, stdev=67.50, samples=78 iops : min= 3, max= 19, avg= 9.60, stdev= 4.30, samples=78 lat (msec) : 10=9.11%, 20=20.44%, 50=25.26%, 100=35.29%, 250=9.90% cpu : usr=0.09%, sys=2.80%, ctx=1402, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147232: Fri Apr 10 22:54:45 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6256KiB/38118msec) clat (msec): min=5, max=143, avg=21.82, stdev=18.74 lat (msec): min=5, max=143, avg=21.82, stdev=18.74 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 43], 95.00th=[ 62], | 99.00th=[ 106], 99.50th=[ 115], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 479, per=27.53%, avg=167.41, stdev=100.92, samples=74 iops : min= 1, max= 29, avg= 9.72, stdev= 6.34, samples=74 write: IOPS=9, BW=158KiB/s (162kB/s)(6032KiB/38118msec); 0 zone resets clat (msec): min=28, max=233, avg=77.88, stdev=37.14 lat (msec): min=28, max=233, avg=77.88, stdev=37.14 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 37], 10.00th=[ 42], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 68], 60.00th=[ 73], | 70.00th=[ 85], 80.00th=[ 100], 90.00th=[ 131], 95.00th=[ 161], | 99.00th=[ 209], 99.50th=[ 222], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 288, per=24.48%, avg=156.67, stdev=66.12, samples=75 iops : min= 1, max= 18, avg= 9.04, stdev= 4.23, samples=75 lat (msec) : 10=8.59%, 20=26.30%, 50=22.27%, 100=32.55%, 250=10.29% cpu : usr=0.09%, sys=2.87%, ctx=1453, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147233: Fri Apr 10 22:54:45 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(6032KiB/38478msec) clat (msec): min=5, max=117, avg=23.74, stdev=21.24 lat (msec): min=5, max=117, avg=23.75, stdev=21.24 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 32], 90.00th=[ 55], 95.00th=[ 71], | 99.00th=[ 114], 99.50th=[ 117], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 31, max= 352, per=26.55%, avg=161.41, stdev=89.17, samples=73 iops : min= 1, max= 22, avg= 9.34, stdev= 5.57, samples=73 write: IOPS=10, BW=163KiB/s (166kB/s)(6256KiB/38478msec); 0 zone resets clat (msec): min=26, max=201, avg=75.39, stdev=31.75 lat (msec): min=26, max=201, avg=75.40, stdev=31.75 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 41], 10.00th=[ 46], 20.00th=[ 51], | 30.00th=[ 56], 40.00th=[ 61], 50.00th=[ 67], 60.00th=[ 75], | 70.00th=[ 85], 80.00th=[ 95], 90.00th=[ 117], 95.00th=[ 148], | 99.00th=[ 180], 99.50th=[ 199], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 63, max= 286, per=25.33%, avg=162.11, stdev=64.60, samples=76 iops : min= 3, max= 17, avg= 9.38, stdev= 4.11, samples=76 lat (msec) : 10=8.20%, 20=23.83%, 50=21.35%, 100=37.37%, 250=9.24% cpu : usr=0.08%, sys=2.87%, ctx=1340, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=609KiB/s (624kB/s), 146KiB/s-164KiB/s (150kB/s-168kB/s), io=23.4MiB (24.5MB), run=38118-39332msec WRITE: bw=641KiB/s (656kB/s), 158KiB/s-166KiB/s (162kB/s-170kB/s), io=24.6MiB (25.8MB), run=38118-39332msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147244: Fri Apr 10 22:54:55 2026 read: IOPS=2, BW=2561KiB/s (2622kB/s)(7168KiB/2799msec) clat (msec): min=60, max=336, avg=144.01, stdev=100.12 lat (msec): min=60, max=336, avg=144.01, stdev=100.12 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 84], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 97], 60.00th=[ 114], | 70.00th=[ 114], 80.00th=[ 226], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2043, max= 5965, per=73.83%, avg=4021.00, stdev=1961.22, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1829KiB/s (1873kB/s)(5120KiB/2799msec); 0 zone resets clat (msec): min=166, max=563, avg=354.55, stdev=172.97 lat (msec): min=166, max=563, avg=354.66, stdev=172.94 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2027, max= 4087, per=35.64%, avg=2717.67, stdev=1185.89, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=8.76%, ctx=93, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147245: Fri Apr 10 22:54:55 2026 read: IOPS=0, BW=545KiB/s (558kB/s)(2048KiB/3760msec) clat (msec): min=66, max=111, avg=88.80, stdev=32.16 lat (msec): min=66, max=111, avg=88.80, stdev=32.16 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 66], 60.00th=[ 112], | 70.00th=[ 112], 80.00th=[ 112], 90.00th=[ 112], 95.00th=[ 112], | 99.00th=[ 112], 99.50th=[ 112], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 1851, max= 2043, per=35.75%, avg=1947.00, stdev=135.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2723KiB/s (2789kB/s)(10.0MiB/3760msec); 0 zone resets clat (msec): min=96, max=1075, avg=354.04, stdev=298.05 lat (msec): min=96, max=1075, avg=354.20, stdev=298.06 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 104], | 30.00th=[ 128], 40.00th=[ 207], 50.00th=[ 224], 60.00th=[ 262], | 70.00th=[ 460], 80.00th=[ 477], 90.00th=[ 514], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2027, max= 6131, per=39.32%, avg=2998.50, stdev=1672.71, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=8.86%, ctx=79, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147246: Fri Apr 10 22:54:55 2026 read: IOPS=2, BW=2158KiB/s (2210kB/s)(6144KiB/2847msec) clat (msec): min=90, max=371, avg=206.41, stdev=130.37 lat (msec): min=90, max=371, avg=206.41, stdev=130.37 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 127], 50.00th=[ 127], 60.00th=[ 167], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2043, max= 4087, per=62.34%, avg=3395.00, stdev=1170.98, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2158KiB/s (2210kB/s)(6144KiB/2847msec); 0 zone resets clat (msec): min=97, max=647, avg=263.80, stdev=199.60 lat (msec): min=97, max=647, avg=263.93, stdev=199.56 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 226], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2043, max= 5896, per=43.64%, avg=3327.33, stdev=2224.53, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=8.33%, ctx=89, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147247: Fri Apr 10 22:54:55 2026 read: IOPS=1, BW=1614KiB/s (1652kB/s)(5120KiB/3173msec) clat (msec): min=99, max=595, avg=248.05, stdev=199.59 lat (msec): min=99, max=595, avg=248.05, stdev=199.59 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 4087, max= 4087, per=75.05%, avg=4087.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2259KiB/s (2313kB/s)(7168KiB/3173msec); 0 zone resets clat (msec): min=118, max=544, avg=274.77, stdev=175.01 lat (msec): min=118, max=544, avg=274.92, stdev=175.03 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 134], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 186], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 468], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2027, max= 4096, per=37.28%, avg=2842.40, stdev=1104.22, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=7.91%, ctx=88, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5447KiB/s (5578kB/s), 545KiB/s-2561KiB/s (558kB/s-2622kB/s), io=20.0MiB (20.0MB), run=2799-3760msec WRITE: bw=7626KiB/s (7809kB/s), 1829KiB/s-2723KiB/s (1873kB/s-2789kB/s), io=28.0MiB (29.4MB), run=2799-3760msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147249: Fri Apr 10 22:54:55 2026 read: IOPS=2, BW=2646KiB/s (2709kB/s)(7168KiB/2709msec) clat (msec): min=26, max=434, avg=199.79, stdev=133.53 lat (msec): min=26, max=434, avg=199.79, stdev=133.53 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 27], 10.00th=[ 27], 20.00th=[ 107], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 203], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 257], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2043, max= 4537, per=49.40%, avg=2874.33, stdev=1439.91, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1890KiB/s (1935kB/s)(5120KiB/2709msec); 0 zone resets clat (msec): min=94, max=494, avg=261.60, stdev=148.58 lat (msec): min=94, max=494, avg=261.71, stdev=148.60 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2043, max= 3946, per=32.87%, avg=2677.33, stdev=1098.70, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=30.24%, ctx=499, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147250: Fri Apr 10 22:54:55 2026 read: IOPS=0, BW=582KiB/s (596kB/s)(2048KiB/3520msec) clat (msec): min=107, max=509, avg=308.81, stdev=284.37 lat (msec): min=107, max=509, avg=308.81, stdev=284.37 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1556, max= 1973, per=30.33%, avg=1764.50, stdev=294.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2909KiB/s (2979kB/s)(10.0MiB/3520msec); 0 zone resets clat (msec): min=143, max=923, avg=289.93, stdev=230.81 lat (msec): min=143, max=923, avg=290.05, stdev=230.77 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 159], | 30.00th=[ 169], 40.00th=[ 197], 50.00th=[ 209], 60.00th=[ 230], | 70.00th=[ 236], 80.00th=[ 288], 90.00th=[ 347], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1973, max= 6131, per=39.80%, avg=3242.00, stdev=1851.42, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=66.67%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=24.13%, ctx=223, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147251: Fri Apr 10 22:54:55 2026 read: IOPS=1, BW=1889KiB/s (1935kB/s)(6144KiB/3252msec) clat (usec): min=444, max=279066, avg=182948.50, stdev=100431.77 lat (usec): min=444, max=279069, avg=182950.33, stdev=100432.43 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[154141], | 30.00th=[154141], 40.00th=[181404], 50.00th=[181404], 60.00th=[233833], | 70.00th=[250610], 80.00th=[250610], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2043, max= 4087, per=57.73%, avg=3358.67, stdev=1141.58, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1889KiB/s (1935kB/s)(6144KiB/3252msec); 0 zone resets clat (msec): min=160, max=596, avg=358.16, stdev=179.92 lat (msec): min=160, max=596, avg=358.25, stdev=179.91 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 472], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1976, max= 3025, per=27.33%, avg=2226.00, stdev=447.60, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=24.67%, ctx=340, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147252: Fri Apr 10 22:54:55 2026 read: IOPS=1, BW=1799KiB/s (1842kB/s)(5120KiB/2846msec) clat (usec): min=439, max=401428, avg=136856.44, stdev=190930.79 lat (usec): min=441, max=401428, avg=136857.93, stdev=190930.29 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 441], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 1844], 60.00th=[ 1844], | 70.00th=[278922], 80.00th=[278922], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2519KiB/s (2579kB/s)(7168KiB/2846msec); 0 zone resets clat (msec): min=129, max=501, avg=308.33, stdev=143.96 lat (msec): min=129, max=501, avg=308.49, stdev=143.99 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 194], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 296], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 493], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1546, max= 4087, per=29.63%, avg=2413.00, stdev=1137.52, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.04%, sys=24.92%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5818KiB/s (5958kB/s), 582KiB/s-2646KiB/s (596kB/s-2709kB/s), io=20.0MiB (20.0MB), run=2709-3520msec WRITE: bw=8145KiB/s (8341kB/s), 1889KiB/s-2909KiB/s (1935kB/s-2979kB/s), io=28.0MiB (29.4MB), run=2709-3520msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147257: Fri Apr 10 22:55:04 2026 read: IOPS=1, BW=6966KiB/s (7133kB/s)(12.0MiB/1764msec) clat (msec): min=510, max=606, avg=545.24, stdev=53.31 lat (msec): min=510, max=606, avg=545.24, stdev=53.31 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8175, max= 8192, per=97.96%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=26.77%, ctx=798, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147258: Fri Apr 10 22:55:04 2026 read: IOPS=0, BW=2089KiB/s (2139kB/s)(4096KiB/1961msec) clat (nsec): min=608887k, max=608887k, avg=608886724.00, stdev= 0.00 lat (nsec): min=608889k, max=608889k, avg=608889413.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8175, max= 8175, per=97.86%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4177KiB/s (4278kB/s)(8192KiB/1961msec); 0 zone resets clat (msec): min=342, max=964, avg=653.71, stdev=439.69 lat (msec): min=343, max=964, avg=654.40, stdev=439.06 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8175, max= 8175, per=50.97%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=12.45%, ctx=148, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147259: Fri Apr 10 22:55:04 2026 write: IOPS=1, BW=6015KiB/s (6159kB/s)(12.0MiB/2043msec); 0 zone resets clat (msec): min=223, max=1019, avg=657.04, stdev=402.94 lat (msec): min=223, max=1020, avg=657.61, stdev=403.13 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8175, max= 8175, per=50.97%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.54%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147260: Fri Apr 10 22:55:04 2026 write: IOPS=1, BW=8042KiB/s (8235kB/s)(12.0MiB/1528msec); 0 zone resets clat (msec): min=214, max=974, avg=485.16, stdev=424.60 lat (msec): min=214, max=974, avg=485.99, stdev=424.15 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min=14760, max=14760, per=92.03%, avg=14760.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=10.22%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8355KiB/s (8555kB/s), 2089KiB/s-6966KiB/s (2139kB/s-7133kB/s), io=16.0MiB (16.8MB), run=1764-1961msec WRITE: bw=15.7MiB/s (16.4MB/s), 4177KiB/s-8042KiB/s (4278kB/s-8235kB/s), io=32.0MiB (33.6MB), run=1528-2043msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147262: Fri Apr 10 22:55:04 2026 read: IOPS=1, BW=5948KiB/s (6090kB/s)(12.0MiB/2066msec) clat (msec): min=237, max=970, avg=687.65, stdev=393.85 lat (msec): min=237, max=970, avg=687.66, stdev=393.85 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.73%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147263: Fri Apr 10 22:55:04 2026 read: IOPS=0, BW=1971KiB/s (2018kB/s)(4096KiB/2078msec) clat (nsec): min=750195k, max=750195k, avg=750194702.00, stdev= 0.00 lat (nsec): min=750199k, max=750199k, avg=750199147.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3942KiB/s (4037kB/s)(8192KiB/2078msec); 0 zone resets clat (msec): min=450, max=869, avg=659.77, stdev=296.46 lat (msec): min=450, max=869, avg=660.17, stdev=296.50 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8126, max= 8126, per=51.53%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.88%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147264: Fri Apr 10 22:55:04 2026 write: IOPS=1, BW=6423KiB/s (6578kB/s)(12.0MiB/1913msec); 0 zone resets clat (msec): min=184, max=1090, avg=636.21, stdev=453.25 lat (msec): min=184, max=1091, avg=636.75, stdev=453.30 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 6420, max= 6420, per=40.71%, avg=6420.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.21%, sys=6.85%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147265: Fri Apr 10 22:55:04 2026 write: IOPS=1, BW=8000KiB/s (8192kB/s)(12.0MiB/1536msec); 0 zone resets clat (msec): min=317, max=646, avg=493.01, stdev=165.64 lat (msec): min=319, max=646, avg=494.13, stdev=164.60 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 5801, max= 8143, per=44.21%, avg=6972.00, stdev=1656.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.20%, sys=17.33%, ctx=93, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7885KiB/s (8074kB/s), 1971KiB/s-5948KiB/s (2018kB/s-6090kB/s), io=16.0MiB (16.8MB), run=2066-2078msec WRITE: bw=15.4MiB/s (16.1MB/s), 3942KiB/s-8000KiB/s (4037kB/s-8192kB/s), io=32.0MiB (33.6MB), run=1536-2078msec