== sanity test 398b: DIO and buffer IO race ============== 23:16:40 (1764735400) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.96937 s, 12.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160466: Tue Dec 2 23:18:01 2025 read: IOPS=22, BW=89.6KiB/s (91.7kB/s)(5992KiB/66878msec) clat (usec): min=84, max=345249, avg=21753.14, stdev=19096.74 lat (usec): min=84, max=345250, avg=21754.14, stdev=19096.76 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 180], 10.00th=[ 351], 20.00th=[ 10683], | 30.00th=[ 13173], 40.00th=[ 15664], 50.00th=[ 18744], 60.00th=[ 21890], | 70.00th=[ 26346], 80.00th=[ 32113], 90.00th=[ 40109], 95.00th=[ 49021], | 99.00th=[ 74974], 99.50th=[ 91751], 99.90th=[274727], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 28, max= 152, per=25.86%, avg=89.49, stdev=25.80, samples=132 iops : min= 7, max= 38, avg=21.80, stdev= 6.47, samples=132 write: IOPS=23, BW=94.1KiB/s (96.4kB/s)(6296KiB/66878msec); 0 zone resets clat (usec): min=861, max=192177, avg=21726.90, stdev=21002.21 lat (usec): min=862, max=192179, avg=21728.56, stdev=21002.54 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1106], 10.00th=[ 1336], 20.00th=[ 2442], | 30.00th=[ 4948], 40.00th=[ 11076], 50.00th=[ 17171], 60.00th=[ 22676], | 70.00th=[ 29492], 80.00th=[ 38536], 90.00th=[ 50594], 95.00th=[ 61080], | 99.00th=[ 85459], 99.50th=[101188], 99.90th=[139461], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 11, max= 173, per=25.96%, avg=93.97, stdev=28.04, samples=132 iops : min= 2, max= 43, avg=22.91, stdev= 7.02, samples=132 lat (usec) : 100=0.07%, 250=3.45%, 500=1.82%, 750=0.33%, 1000=0.68% lat (msec) : 2=7.94%, 4=5.86%, 10=8.76%, 20=25.68%, 50=37.92% lat (msec) : 100=6.97%, 250=0.46%, 500=0.07% cpu : usr=0.11%, sys=11.75%, ctx=6549, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160467: Tue Dec 2 23:18:01 2025 read: IOPS=21, BW=86.8KiB/s (88.9kB/s)(5940KiB/68424msec) clat (usec): min=99, max=432696, avg=22144.52, stdev=19773.41 lat (usec): min=99, max=432697, avg=22146.00, stdev=19773.14 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 180], 10.00th=[ 306], 20.00th=[ 10421], | 30.00th=[ 13435], 40.00th=[ 16188], 50.00th=[ 19006], 60.00th=[ 22152], | 70.00th=[ 27132], 80.00th=[ 33817], 90.00th=[ 41681], 95.00th=[ 49021], | 99.00th=[ 79168], 99.50th=[ 98042], 99.90th=[185598], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 5, max= 151, per=25.01%, avg=86.53, stdev=27.57, samples=135 iops : min= 1, max= 37, avg=21.04, stdev= 6.86, samples=135 write: IOPS=23, BW=92.8KiB/s (95.0kB/s)(6348KiB/68424msec); 0 zone resets clat (usec): min=918, max=243875, avg=22337.03, stdev=22455.31 lat (usec): min=918, max=243875, avg=22338.64, stdev=22456.58 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1188], 10.00th=[ 1516], 20.00th=[ 2638], | 30.00th=[ 5276], 40.00th=[ 11600], 50.00th=[ 17695], 60.00th=[ 22414], | 70.00th=[ 28705], 80.00th=[ 37487], 90.00th=[ 51643], 95.00th=[ 63701], | 99.00th=[ 91751], 99.50th=[111674], 99.90th=[177210], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 11, max= 166, per=25.49%, avg=92.27, stdev=29.09, samples=135 iops : min= 2, max= 41, avg=22.49, stdev= 7.32, samples=135 lat (usec) : 100=0.03%, 250=3.78%, 500=2.18%, 750=0.13%, 1000=0.29% lat (msec) : 2=7.49%, 4=5.96%, 10=8.66%, 20=25.81%, 50=37.92% lat (msec) : 100=7.16%, 250=0.55%, 500=0.03% cpu : usr=0.12%, sys=11.57%, ctx=6639, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160468: Tue Dec 2 23:18:01 2025 read: IOPS=21, BW=87.0KiB/s (89.1kB/s)(6028KiB/69262msec) clat (usec): min=90, max=162846, avg=21193.81, stdev=15934.45 lat (usec): min=91, max=162848, avg=21195.93, stdev=15934.13 clat percentiles (usec): | 1.00th=[ 130], 5.00th=[ 172], 10.00th=[ 347], 20.00th=[ 10552], | 30.00th=[ 13304], 40.00th=[ 15664], 50.00th=[ 18482], 60.00th=[ 21103], | 70.00th=[ 25822], 80.00th=[ 32375], 90.00th=[ 39584], 95.00th=[ 46924], | 99.00th=[ 77071], 99.50th=[ 88605], 99.90th=[128451], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 5, max= 191, per=25.07%, avg=86.76, stdev=31.04, samples=137 iops : min= 1, max= 47, avg=21.10, stdev= 7.76, samples=137 write: IOPS=22, BW=90.4KiB/s (92.6kB/s)(6260KiB/69262msec); 0 zone resets clat (usec): min=798, max=472712, avg=23789.59, stdev=25908.00 lat (usec): min=799, max=472715, avg=23796.32, stdev=25904.89 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1172], 10.00th=[ 1582], 20.00th=[ 2802], | 30.00th=[ 6194], 40.00th=[ 12911], 50.00th=[ 18482], 60.00th=[ 23987], | 70.00th=[ 30540], 80.00th=[ 39584], 90.00th=[ 52691], 95.00th=[ 65799], | 99.00th=[103285], 99.50th=[127402], 99.90th=[219153], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 17, max= 207, per=24.87%, avg=90.03, stdev=27.49, samples=137 iops : min= 4, max= 51, avg=21.93, stdev= 6.88, samples=137 lat (usec) : 100=0.03%, 250=3.68%, 500=1.99%, 750=0.10%, 1000=0.52% lat (msec) : 2=6.90%, 4=5.63%, 10=8.11%, 20=27.54%, 50=37.60% lat (msec) : 100=7.13%, 250=0.75%, 500=0.03% cpu : usr=0.11%, sys=11.46%, ctx=6665, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160469: Tue Dec 2 23:18:01 2025 read: IOPS=22, BW=89.0KiB/s (91.2kB/s)(6052KiB/67973msec) clat (usec): min=99, max=348838, avg=21503.08, stdev=18085.65 lat (usec): min=99, max=348839, avg=21504.67, stdev=18085.56 clat percentiles (usec): | 1.00th=[ 126], 5.00th=[ 172], 10.00th=[ 289], 20.00th=[ 10290], | 30.00th=[ 13042], 40.00th=[ 15795], 50.00th=[ 18482], 60.00th=[ 21890], | 70.00th=[ 26608], 80.00th=[ 32375], 90.00th=[ 41681], 95.00th=[ 48497], | 99.00th=[ 76022], 99.50th=[100140], 99.90th=[128451], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 23, max= 160, per=25.84%, avg=89.42, stdev=27.27, samples=133 iops : min= 5, max= 40, avg=21.77, stdev= 6.88, samples=133 write: IOPS=22, BW=91.7KiB/s (93.9kB/s)(6236KiB/67973msec); 0 zone resets clat (usec): min=870, max=513732, avg=22686.37, stdev=25644.31 lat (usec): min=870, max=513733, avg=22688.58, stdev=25644.21 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1467], 20.00th=[ 2442], | 30.00th=[ 4752], 40.00th=[ 11076], 50.00th=[ 17171], 60.00th=[ 22676], | 70.00th=[ 29230], 80.00th=[ 39060], 90.00th=[ 51643], 95.00th=[ 64226], | 99.00th=[ 93848], 99.50th=[122160], 99.90th=[204473], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 17, max= 166, per=25.25%, avg=91.41, stdev=28.99, samples=134 iops : min= 4, max= 41, avg=22.28, stdev= 7.24, samples=134 lat (usec) : 100=0.03%, 250=4.07%, 500=2.02%, 750=0.33%, 1000=0.52% lat (msec) : 2=7.88%, 4=5.96%, 10=8.56%, 20=25.42%, 50=37.66% lat (msec) : 100=6.87%, 250=0.62%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=11.39%, ctx=6492, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=347KiB/s (355kB/s), 86.8KiB/s-89.6KiB/s (88.9kB/s-91.7kB/s), io=23.4MiB (24.6MB), run=66878-69262msec WRITE: bw=363KiB/s (372kB/s), 90.4KiB/s-94.1KiB/s (92.6kB/s-96.4kB/s), io=24.6MiB (25.7MB), run=66878-69262msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160461: Tue Dec 2 23:19:44 2025 read: IOPS=8, BW=34.0KiB/s (35.8kB/s)(5992KiB/171231msec) clat (msec): min=4, max=673, avg=20.82, stdev=24.10 lat (msec): min=4, max=673, avg=20.82, stdev=24.10 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 78], 99.50th=[ 89], 99.90th=[ 275], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 112, per=25.78%, avg=35.84, stdev=22.54, samples=327 iops : min= 1, max= 28, avg= 8.37, stdev= 5.68, samples=327 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6296KiB/171231msec); 0 zone resets clat (msec): min=27, max=313, avg=88.80, stdev=36.06 lat (msec): min=27, max=313, avg=88.80, stdev=36.06 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 44], 10.00th=[ 51], 20.00th=[ 59], | 30.00th=[ 67], 40.00th=[ 74], 50.00th=[ 83], 60.00th=[ 91], | 70.00th=[ 102], 80.00th=[ 115], 90.00th=[ 136], 95.00th=[ 155], | 99.00th=[ 203], 99.50th=[ 226], 99.90th=[ 309], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 79, per=25.05%, avg=36.32, stdev=13.36, samples=339 iops : min= 1, max= 19, avg= 8.48, stdev= 3.42, samples=339 lat (msec) : 10=11.85%, 20=21.06%, 50=17.94%, 100=32.81%, 250=16.15% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.05%, sys=2.10%, ctx=5518, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160462: Tue Dec 2 23:19:44 2025 read: IOPS=8, BW=34.4KiB/s (35.2kB/s)(5940KiB/172565msec) clat (msec): min=4, max=752, avg=20.53, stdev=25.67 lat (msec): min=4, max=752, avg=20.53, stdev=25.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 78], 99.50th=[ 93], 99.90th=[ 226], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 120, per=25.67%, avg=35.68, stdev=22.62, samples=325 iops : min= 1, max= 30, avg= 8.33, stdev= 5.70, samples=325 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6348KiB/172565msec); 0 zone resets clat (msec): min=26, max=325, avg=89.34, stdev=35.91 lat (msec): min=26, max=325, avg=89.34, stdev=35.91 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 45], 10.00th=[ 51], 20.00th=[ 60], | 30.00th=[ 67], 40.00th=[ 75], 50.00th=[ 83], 60.00th=[ 92], | 70.00th=[ 103], 80.00th=[ 117], 90.00th=[ 136], 95.00th=[ 153], | 99.00th=[ 201], 99.50th=[ 234], 99.90th=[ 321], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 72, per=24.99%, avg=36.24, stdev=12.93, samples=341 iops : min= 1, max= 18, avg= 8.47, stdev= 3.29, samples=341 lat (msec) : 10=12.11%, 20=21.48%, 50=16.99%, 100=32.39%, 250=16.80% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=1.99%, ctx=5395, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160463: Tue Dec 2 23:19:44 2025 read: IOPS=8, BW=34.0KiB/s (35.8kB/s)(6028KiB/172361msec) clat (msec): min=4, max=276, avg=21.55, stdev=19.68 lat (msec): min=4, max=276, avg=21.55, stdev=19.68 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 53], | 99.00th=[ 87], 99.50th=[ 113], 99.90th=[ 251], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 119, per=25.67%, avg=35.68, stdev=22.28, samples=330 iops : min= 1, max= 29, avg= 8.33, stdev= 5.61, samples=330 write: IOPS=9, BW=36.3KiB/s (37.2kB/s)(6260KiB/172361msec); 0 zone resets clat (msec): min=29, max=785, avg=89.20, stdev=39.68 lat (msec): min=29, max=785, avg=89.20, stdev=39.68 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 45], 10.00th=[ 50], 20.00th=[ 59], | 30.00th=[ 67], 40.00th=[ 75], 50.00th=[ 84], 60.00th=[ 92], | 70.00th=[ 103], 80.00th=[ 116], 90.00th=[ 136], 95.00th=[ 153], | 99.00th=[ 203], 99.50th=[ 228], 99.90th=[ 351], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 71, per=24.68%, avg=35.79, stdev=13.44, samples=341 iops : min= 1, max= 17, avg= 8.35, stdev= 3.42, samples=341 lat (msec) : 10=11.46%, 20=20.57%, 50=19.69%, 100=31.48%, 250=16.60% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.05%, sys=2.08%, ctx=5644, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160464: Tue Dec 2 23:19:44 2025 read: IOPS=8, BW=35.2KiB/s (36.0kB/s)(6052KiB/172007msec) clat (msec): min=4, max=230, avg=20.98, stdev=19.38 lat (msec): min=4, max=230, avg=20.98, stdev=19.38 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 45], 95.00th=[ 56], | 99.00th=[ 87], 99.50th=[ 115], 99.90th=[ 205], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 7, max= 111, per=26.16%, avg=36.36, stdev=21.80, samples=325 iops : min= 1, max= 27, avg= 8.50, stdev= 5.50, samples=325 write: IOPS=9, BW=36.3KiB/s (37.1kB/s)(6236KiB/172007msec); 0 zone resets clat (msec): min=25, max=784, avg=89.79, stdev=39.85 lat (msec): min=25, max=784, avg=89.80, stdev=39.85 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 61], | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 83], 60.00th=[ 91], | 70.00th=[ 102], 80.00th=[ 114], 90.00th=[ 138], 95.00th=[ 157], | 99.00th=[ 199], 99.50th=[ 243], 99.90th=[ 351], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 72, per=24.67%, avg=35.76, stdev=13.22, samples=340 iops : min= 1, max= 18, avg= 8.35, stdev= 3.38, samples=340 lat (msec) : 10=12.99%, 20=20.41%, 50=16.57%, 100=33.89%, 250=15.98% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=2.01%, ctx=5585, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=139KiB/s (142kB/s), 34.4KiB/s-35.2KiB/s (35.2kB/s-36.0kB/s), io=23.4MiB (24.6MB), run=171231-172565msec WRITE: bw=146KiB/s (149kB/s), 36.3KiB/s-36.8KiB/s (37.1kB/s-37.7kB/s), io=24.6MiB (25.7MB), run=171231-172565msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160509: Tue Dec 2 23:20:06 2025 read: IOPS=24, BW=399KiB/s (409kB/s)(5920KiB/14825msec) clat (usec): min=110, max=129312, avg=19735.67, stdev=17382.01 lat (usec): min=110, max=129313, avg=19736.85, stdev=17381.96 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 155], 10.00th=[ 176], 20.00th=[ 322], | 30.00th=[ 11994], 40.00th=[ 15926], 50.00th=[ 18220], 60.00th=[ 21627], | 70.00th=[ 25035], 80.00th=[ 32375], 90.00th=[ 40109], 95.00th=[ 47449], | 99.00th=[ 76022], 99.50th=[109577], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 253, max= 638, per=26.28%, avg=396.28, stdev=89.57, samples=29 iops : min= 15, max= 39, avg=24.00, stdev= 5.62, samples=29 write: IOPS=26, BW=430KiB/s (440kB/s)(6368KiB/14825msec); 0 zone resets clat (usec): min=1395, max=133775, avg=18784.33, stdev=19851.55 lat (usec): min=1396, max=133777, avg=18786.73, stdev=19851.84 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1795], 10.00th=[ 2147], 20.00th=[ 3195], | 30.00th=[ 4883], 40.00th=[ 7308], 50.00th=[ 11600], 60.00th=[ 18220], | 70.00th=[ 23725], 80.00th=[ 32637], 90.00th=[ 42730], 95.00th=[ 55313], | 99.00th=[101188], 99.50th=[131597], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 222, max= 670, per=26.97%, avg=427.79, stdev=119.91, samples=29 iops : min= 13, max= 41, avg=26.00, stdev= 7.56, samples=29 lat (usec) : 250=7.42%, 500=4.17%, 750=0.26%, 1000=0.26% lat (msec) : 2=4.95%, 4=8.98%, 10=11.72%, 20=21.35%, 50=34.77% lat (msec) : 100=5.34%, 250=0.78% cpu : usr=0.13%, sys=14.04%, ctx=1483, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160510: Tue Dec 2 23:20:06 2025 read: IOPS=22, BW=362KiB/s (370kB/s)(5744KiB/15880msec) clat (usec): min=96, max=187164, avg=20649.82, stdev=18866.04 lat (usec): min=96, max=187165, avg=20651.13, stdev=18865.99 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 159], 10.00th=[ 188], 20.00th=[ 355], | 30.00th=[ 11863], 40.00th=[ 15926], 50.00th=[ 18744], 60.00th=[ 22152], | 70.00th=[ 27395], 80.00th=[ 31589], 90.00th=[ 41681], 95.00th=[ 50070], | 99.00th=[ 79168], 99.50th=[106431], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 95, max= 637, per=23.81%, avg=359.03, stdev=157.40, samples=31 iops : min= 5, max= 39, avg=21.65, stdev= 9.85, samples=31 write: IOPS=25, BW=412KiB/s (422kB/s)(6544KiB/15880msec); 0 zone resets clat (usec): min=1465, max=160957, avg=20482.96, stdev=20933.46 lat (usec): min=1467, max=160959, avg=20486.02, stdev=20932.90 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1909], 10.00th=[ 2474], 20.00th=[ 3752], | 30.00th=[ 5604], 40.00th=[ 9241], 50.00th=[ 14091], 60.00th=[ 20317], | 70.00th=[ 25822], 80.00th=[ 34341], 90.00th=[ 47973], 95.00th=[ 57410], | 99.00th=[ 87557], 99.50th=[108528], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 62, max= 764, per=25.76%, avg=408.55, stdev=131.75, samples=31 iops : min= 3, max= 47, avg=24.77, stdev= 8.29, samples=31 lat (usec) : 100=0.13%, 250=6.90%, 500=3.26%, 750=0.52%, 1000=0.13% lat (msec) : 2=3.78%, 4=9.38%, 10=10.81%, 20=22.14%, 50=35.68% lat (msec) : 100=6.51%, 250=0.78% cpu : usr=0.19%, sys=14.06%, ctx=1537, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160511: Tue Dec 2 23:20:06 2025 read: IOPS=25, BW=400KiB/s (410kB/s)(6256KiB/15624msec) clat (usec): min=103, max=97511, avg=20348.59, stdev=16382.03 lat (usec): min=103, max=97511, avg=20349.94, stdev=16381.76 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 165], 10.00th=[ 210], 20.00th=[ 383], | 30.00th=[12780], 40.00th=[16712], 50.00th=[19006], 60.00th=[22676], | 70.00th=[27132], 80.00th=[33162], 90.00th=[41681], 95.00th=[46924], | 99.00th=[69731], 99.50th=[89654], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 157, max= 603, per=26.61%, avg=401.27, stdev=109.84, samples=30 iops : min= 9, max= 37, avg=24.30, stdev= 6.92, samples=30 write: IOPS=24, BW=386KiB/s (395kB/s)(6032KiB/15624msec); 0 zone resets clat (usec): min=1335, max=189420, avg=20157.19, stdev=20255.50 lat (usec): min=1335, max=189422, avg=20159.43, stdev=20255.46 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1729], 10.00th=[ 2343], 20.00th=[ 3884], | 30.00th=[ 5473], 40.00th=[ 8979], 50.00th=[ 13698], 60.00th=[ 19530], | 70.00th=[ 27132], 80.00th=[ 35914], 90.00th=[ 47973], 95.00th=[ 55313], | 99.00th=[ 73925], 99.50th=[ 91751], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 127, max= 604, per=23.92%, avg=379.43, stdev=116.92, samples=30 iops : min= 7, max= 37, avg=22.93, stdev= 7.36, samples=30 lat (usec) : 250=6.12%, 500=5.34%, 750=0.65%, 1000=0.39% lat (msec) : 2=4.43%, 4=6.25%, 10=11.46%, 20=22.14%, 50=36.59% lat (msec) : 100=6.51%, 250=0.13% cpu : usr=0.13%, sys=14.26%, ctx=1652, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160512: Tue Dec 2 23:20:06 2025 read: IOPS=24, BW=395KiB/s (404kB/s)(6032KiB/15290msec) clat (usec): min=109, max=138290, avg=19618.05, stdev=17517.62 lat (usec): min=109, max=138291, avg=19619.18, stdev=17517.56 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 155], 10.00th=[ 174], 20.00th=[ 322], | 30.00th=[ 4228], 40.00th=[ 14877], 50.00th=[ 18220], 60.00th=[ 22414], | 70.00th=[ 27657], 80.00th=[ 34341], 90.00th=[ 40633], 95.00th=[ 46924], | 99.00th=[ 69731], 99.50th=[ 87557], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 188, max= 730, per=25.95%, avg=391.30, stdev=133.39, samples=30 iops : min= 11, max= 45, avg=23.70, stdev= 8.34, samples=30 write: IOPS=25, BW=409KiB/s (419kB/s)(6256KiB/15290msec); 0 zone resets clat (usec): min=1401, max=122974, avg=19970.32, stdev=19284.24 lat (usec): min=1401, max=122978, avg=19972.97, stdev=19284.03 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1844], 10.00th=[ 2278], 20.00th=[ 4293], | 30.00th=[ 5735], 40.00th=[ 8979], 50.00th=[ 13435], 60.00th=[ 20055], | 70.00th=[ 26084], 80.00th=[ 34341], 90.00th=[ 44303], 95.00th=[ 56361], | 99.00th=[ 85459], 99.50th=[ 99091], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 220, max= 701, per=25.84%, avg=409.90, stdev=110.75, samples=30 iops : min= 13, max= 43, avg=24.87, stdev= 6.95, samples=30 lat (usec) : 250=7.81%, 500=5.21%, 750=0.65%, 1000=0.39% lat (msec) : 2=4.17%, 4=6.25%, 10=12.50%, 20=19.79%, 50=37.50% lat (msec) : 100=5.47%, 250=0.26% cpu : usr=0.22%, sys=14.25%, ctx=1493, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1508KiB/s (1545kB/s), 362KiB/s-400KiB/s (370kB/s-410kB/s), io=23.4MiB (24.5MB), run=14825-15880msec WRITE: bw=1587KiB/s (1625kB/s), 386KiB/s-430KiB/s (395kB/s-440kB/s), io=24.6MiB (25.8MB), run=14825-15880msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160514: Tue Dec 2 23:20:29 2025 read: IOPS=9, BW=155KiB/s (158kB/s)(5920KiB/38264msec) clat (msec): min=4, max=176, avg=21.41, stdev=21.43 lat (msec): min=4, max=176, avg=21.41, stdev=21.43 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 45], 95.00th=[ 63], | 99.00th=[ 128], 99.50th=[ 150], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 31, max= 416, per=24.85%, avg=155.34, stdev=90.92, samples=73 iops : min= 1, max= 26, avg= 9.07, stdev= 5.84, samples=73 write: IOPS=10, BW=166KiB/s (170kB/s)(6368KiB/38264msec); 0 zone resets clat (msec): min=24, max=251, avg=75.82, stdev=37.89 lat (msec): min=24, max=251, avg=75.82, stdev=37.89 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 38], 20.00th=[ 45], | 30.00th=[ 51], 40.00th=[ 58], 50.00th=[ 65], 60.00th=[ 79], | 70.00th=[ 91], 80.00th=[ 104], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 215], 99.50th=[ 228], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 26, max= 319, per=24.95%, avg=164.19, stdev=75.73, samples=75 iops : min= 1, max= 19, avg= 9.61, stdev= 4.86, samples=75 lat (msec) : 10=12.37%, 20=21.48%, 50=26.04%, 100=27.47%, 250=12.50% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=3.03%, ctx=1501, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160515: Tue Dec 2 23:20:29 2025 read: IOPS=9, BW=151KiB/s (155kB/s)(5744KiB/37947msec) clat (msec): min=4, max=172, avg=20.97, stdev=18.99 lat (msec): min=4, max=172, avg=20.97, stdev=18.99 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 39], 95.00th=[ 59], | 99.00th=[ 103], 99.50th=[ 140], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 27, max= 480, per=24.75%, avg=154.68, stdev=105.30, samples=73 iops : min= 1, max= 30, avg= 9.03, stdev= 6.66, samples=73 write: IOPS=10, BW=172KiB/s (177kB/s)(6544KiB/37947msec); 0 zone resets clat (msec): min=20, max=271, avg=73.95, stdev=37.25 lat (msec): min=20, max=271, avg=73.95, stdev=37.25 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 38], 20.00th=[ 44], | 30.00th=[ 50], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 73], | 70.00th=[ 87], 80.00th=[ 107], 90.00th=[ 126], 95.00th=[ 146], | 99.00th=[ 182], 99.50th=[ 186], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 62, max= 352, per=26.10%, avg=171.73, stdev=79.22, samples=75 iops : min= 3, max= 22, avg=10.09, stdev= 5.09, samples=75 lat (msec) : 10=11.59%, 20=19.40%, 50=29.43%, 100=27.34%, 250=12.11% lat (msec) : 500=0.13% cpu : usr=0.10%, sys=3.07%, ctx=1564, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160516: Tue Dec 2 23:20:29 2025 read: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37446msec) clat (msec): min=4, max=237, avg=20.89, stdev=22.04 lat (msec): min=4, max=237, avg=20.89, stdev=22.04 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 25], 90.00th=[ 38], 95.00th=[ 61], | 99.00th=[ 128], 99.50th=[ 140], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 510, per=26.88%, avg=168.03, stdev=120.48, samples=74 iops : min= 1, max= 31, avg= 9.86, stdev= 7.59, samples=74 write: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37446msec); 0 zone resets clat (msec): min=25, max=212, avg=77.47, stdev=40.00 lat (msec): min=25, max=212, avg=77.47, stdev=40.00 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 67], 60.00th=[ 79], | 70.00th=[ 91], 80.00th=[ 110], 90.00th=[ 138], 95.00th=[ 161], | 99.00th=[ 207], 99.50th=[ 209], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 320, per=24.76%, avg=162.92, stdev=72.32, samples=73 iops : min= 1, max= 20, avg= 9.55, stdev= 4.67, samples=73 lat (msec) : 10=12.89%, 20=22.79%, 50=26.56%, 100=25.00%, 250=12.76% cpu : usr=0.07%, sys=3.19%, ctx=1532, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160517: Tue Dec 2 23:20:29 2025 read: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37690msec) clat (msec): min=5, max=121, avg=19.92, stdev=17.26 lat (msec): min=5, max=121, avg=19.92, stdev=17.26 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 40], 95.00th=[ 59], | 99.00th=[ 93], 99.50th=[ 107], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 31, max= 416, per=26.11%, avg=163.17, stdev=101.23, samples=72 iops : min= 1, max= 26, avg= 9.56, stdev= 6.50, samples=72 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37690msec); 0 zone resets clat (msec): min=22, max=250, avg=76.60, stdev=41.76 lat (msec): min=22, max=250, avg=76.60, stdev=41.76 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 56], 50.00th=[ 66], 60.00th=[ 75], | 70.00th=[ 88], 80.00th=[ 102], 90.00th=[ 130], 95.00th=[ 165], | 99.00th=[ 226], 99.50th=[ 249], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 63, max= 352, per=25.14%, avg=165.42, stdev=77.43, samples=74 iops : min= 3, max= 22, avg= 9.70, stdev= 4.97, samples=74 lat (msec) : 10=11.98%, 20=23.57%, 50=25.13%, 100=28.26%, 250=10.94% lat (msec) : 500=0.13% cpu : usr=0.09%, sys=3.01%, ctx=1502, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=626KiB/s (641kB/s), 151KiB/s-167KiB/s (155kB/s-171kB/s), io=23.4MiB (24.5MB), run=37446-38264msec WRITE: bw=659KiB/s (674kB/s), 161KiB/s-172KiB/s (165kB/s-177kB/s), io=24.6MiB (25.8MB), run=37446-38264msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160527: Tue Dec 2 23:20:39 2025 read: IOPS=1, BW=1593KiB/s (1631kB/s)(7168KiB/4501msec) clat (usec): min=853, max=1359.0k, avg=484682.29, stdev=578051.60 lat (usec): min=854, max=1359.0k, avg=484683.72, stdev=578051.44 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], | 20.00th=[ 109577], 30.00th=[ 145753], 40.00th=[ 145753], | 50.00th=[ 164627], 60.00th=[ 337642], 70.00th=[ 337642], | 80.00th=[1283458], 90.00th=[1367344], 95.00th=[1367344], | 99.00th=[1367344], 99.50th=[1367344], 99.90th=[1367344], | 99.95th=[1367344], 99.99th=[1367344] bw ( KiB/s): min= 1939, max= 3792, per=68.44%, avg=3114.00, stdev=1021.60, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1138KiB/s (1165kB/s)(5120KiB/4501msec); 0 zone resets clat (msec): min=95, max=303, avg=192.58, stdev=75.63 lat (msec): min=95, max=303, avg=192.68, stdev=75.67 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1896, max= 4015, per=41.08%, avg=2616.67, stdev=1211.18, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 2000=16.67% cpu : usr=0.00%, sys=17.67%, ctx=644, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160528: Tue Dec 2 23:20:39 2025 read: IOPS=0, BW=655KiB/s (670kB/s)(2048KiB/3128msec) clat (usec): min=893, max=89515, avg=45204.13, stdev=62665.12 lat (usec): min=894, max=89518, avg=45206.67, stdev=62666.62 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 898], | 30.00th=[ 898], 40.00th=[ 898], 50.00th=[ 898], 60.00th=[89654], | 70.00th=[89654], 80.00th=[89654], 90.00th=[89654], 95.00th=[89654], | 99.00th=[89654], 99.50th=[89654], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 1799, max= 1939, per=41.08%, avg=1869.00, stdev=98.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3274KiB/s (3352kB/s)(10.0MiB/3128msec); 0 zone resets clat (msec): min=123, max=463, avg=268.63, stdev=112.80 lat (msec): min=123, max=463, avg=268.72, stdev=112.81 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 128], | 30.00th=[ 184], 40.00th=[ 194], 50.00th=[ 262], 60.00th=[ 279], | 70.00th=[ 313], 80.00th=[ 359], 90.00th=[ 380], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 3792, max= 4096, per=62.12%, avg=3957.25, stdev=146.09, samples=4 iops : min= 3, max= 4, avg= 3.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=50.00% cpu : usr=0.00%, sys=33.29%, ctx=247, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160530: Tue Dec 2 23:20:39 2025 read: IOPS=2, BW=2229KiB/s (2282kB/s)(6144KiB/2757msec) clat (usec): min=919, max=331887, avg=103428.97, stdev=125266.28 lat (usec): min=920, max=331888, avg=103430.12, stdev=125266.23 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], 20.00th=[ 1074], | 30.00th=[ 1074], 40.00th=[ 46924], 50.00th=[ 46924], 60.00th=[ 92799], | 70.00th=[147850], 80.00th=[147850], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 1896, max= 6095, per=73.55%, avg=3346.33, stdev=2381.63, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2229KiB/s (2282kB/s)(6144KiB/2757msec); 0 zone resets clat (msec): min=117, max=747, avg=350.17, stdev=246.41 lat (msec): min=117, max=747, avg=350.25, stdev=246.40 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 255], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1896, max= 3624, per=37.67%, avg=2399.75, stdev=818.99, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 50=8.33%, 100=8.33%, 250=33.33%, 500=16.67% lat (msec) : 750=16.67% cpu : usr=0.00%, sys=25.58%, ctx=176, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160531: Tue Dec 2 23:20:39 2025 read: IOPS=1, BW=1211KiB/s (1240kB/s)(5120KiB/4228msec) clat (usec): min=669, max=1360.5k, avg=343175.57, stdev=575581.13 lat (usec): min=670, max=1360.5k, avg=343177.01, stdev=575581.08 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], | 20.00th=[ 668], 30.00th=[ 758], 40.00th=[ 758], | 50.00th=[ 160433], 60.00th=[ 160433], 70.00th=[ 191890], | 80.00th=[ 191890], 90.00th=[1367344], 95.00th=[1367344], | 99.00th=[1367344], 99.50th=[1367344], 99.90th=[1367344], | 99.95th=[1367344], 99.99th=[1367344] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1695KiB/s (1736kB/s)(7168KiB/4228msec); 0 zone resets clat (msec): min=168, max=967, avg=343.17, stdev=291.38 lat (msec): min=169, max=967, avg=343.27, stdev=291.35 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 171], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 211], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 443], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1805, max= 4096, per=43.11%, avg=2746.20, stdev=1102.21, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=58.33%, 500=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=21.74%, ctx=450, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4550KiB/s (4659kB/s), 655KiB/s-2229KiB/s (670kB/s-2282kB/s), io=20.0MiB (20.0MB), run=2757-4501msec WRITE: bw=6370KiB/s (6523kB/s), 1138KiB/s-3274KiB/s (1165kB/s-3352kB/s), io=28.0MiB (29.4MB), run=2757-4501msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160532: Tue Dec 2 23:20:39 2025 read: IOPS=1, BW=1562KiB/s (1600kB/s)(7168KiB/4588msec) clat (msec): min=32, max=907, avg=491.69, stdev=355.92 lat (msec): min=32, max=907, avg=491.69, stdev=355.92 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 148], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 567], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 852], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1848, max= 4039, per=53.64%, avg=2393.80, stdev=923.06, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1116KiB/s (1143kB/s)(5120KiB/4588msec); 0 zone resets clat (msec): min=85, max=424, avg=199.63, stdev=130.38 lat (msec): min=85, max=424, avg=199.75, stdev=130.36 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 178], 80.00th=[ 178], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2023, max= 4039, per=40.57%, avg=2535.25, stdev=1002.55, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=8.33%, 750=16.67% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=5.47%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160533: Tue Dec 2 23:20:39 2025 read: IOPS=0, BW=562KiB/s (576kB/s)(2048KiB/3643msec) clat (msec): min=108, max=231, avg=170.14, stdev=86.52 lat (msec): min=108, max=231, avg=170.14, stdev=86.52 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 1828, max= 2031, per=43.23%, avg=1929.50, stdev=143.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2811KiB/s (2878kB/s)(10.0MiB/3643msec); 0 zone resets clat (msec): min=101, max=834, avg=299.45, stdev=279.11 lat (msec): min=101, max=834, avg=299.57, stdev=279.11 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 122], | 30.00th=[ 146], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 167], | 70.00th=[ 232], 80.00th=[ 296], 90.00th=[ 802], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2031, max= 6059, per=58.42%, avg=3650.40, stdev=1684.11, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.79, samples=5 lat (msec) : 250=75.00%, 500=8.33%, 1000=16.67% cpu : usr=0.08%, sys=10.21%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160534: Tue Dec 2 23:20:39 2025 read: IOPS=1, BW=1356KiB/s (1389kB/s)(6144KiB/4531msec) clat (msec): min=57, max=1010, avg=325.11, stdev=346.30 lat (msec): min=57, max=1010, avg=325.12, stdev=346.30 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 249], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 2031, max= 4023, per=60.48%, avg=2699.00, stdev=1146.63, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1356KiB/s (1389kB/s)(6144KiB/4531msec); 0 zone resets clat (msec): min=99, max=763, avg=422.44, stdev=250.35 lat (msec): min=99, max=763, avg=422.56, stdev=250.35 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 527], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2019, max= 4087, per=40.75%, avg=2546.25, stdev=1027.24, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=5.87%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160535: Tue Dec 2 23:20:39 2025 read: IOPS=1, BW=1189KiB/s (1218kB/s)(5120KiB/4305msec) clat (msec): min=100, max=855, avg=333.30, stdev=316.74 lat (msec): min=100, max=855, avg=333.30, stdev=316.74 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2031, max= 4023, per=60.48%, avg=2699.00, stdev=1146.63, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1665KiB/s (1705kB/s)(7168KiB/4305msec); 0 zone resets clat (msec): min=121, max=832, avg=352.77, stdev=243.96 lat (msec): min=121, max=832, avg=352.86, stdev=243.94 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 182], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 284], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 447], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2043, max= 6059, per=56.70%, avg=3543.25, stdev=1918.83, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 1000=16.67% cpu : usr=0.00%, sys=7.55%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4464KiB/s (4571kB/s), 562KiB/s-1562KiB/s (576kB/s-1600kB/s), io=20.0MiB (20.0MB), run=3643-4588msec WRITE: bw=6249KiB/s (6399kB/s), 1116KiB/s-2811KiB/s (1143kB/s-2878kB/s), io=28.0MiB (29.4MB), run=3643-4588msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160546: Tue Dec 2 23:20:48 2025 read: IOPS=1, BW=7484KiB/s (7663kB/s)(12.0MiB/1642msec) clat (msec): min=526, max=583, avg=545.54, stdev=32.62 lat (msec): min=526, max=583, avg=545.55, stdev=32.62 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7288, max= 8175, per=92.55%, avg=7731.50, stdev=627.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=35.83%, ctx=1001, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160547: Tue Dec 2 23:20:48 2025 read: IOPS=0, BW=2089KiB/s (2139kB/s)(4096KiB/1961msec) clat (nsec): min=515672k, max=515672k, avg=515672122.00, stdev= 0.00 lat (nsec): min=515674k, max=515674k, avg=515674121.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7488, max= 7488, per=89.63%, avg=7488.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4177KiB/s (4278kB/s)(8192KiB/1961msec); 0 zone resets clat (msec): min=497, max=945, avg=721.32, stdev=317.12 lat (msec): min=497, max=946, avg=721.85, stdev=317.18 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8175, max= 8175, per=48.93%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=7.65%, ctx=259, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160548: Tue Dec 2 23:20:48 2025 write: IOPS=1, BW=6923KiB/s (7089kB/s)(12.0MiB/1775msec); 0 zone resets clat (msec): min=479, max=682, avg=590.73, stdev=102.85 lat (msec): min=479, max=682, avg=591.21, stdev=102.85 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8175, max= 8192, per=48.98%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=20.57%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160549: Tue Dec 2 23:20:48 2025 write: IOPS=1, BW=7385KiB/s (7562kB/s)(12.0MiB/1664msec); 0 zone resets clat (msec): min=238, max=1011, avg=552.80, stdev=405.89 lat (msec): min=239, max=1011, avg=553.18, stdev=405.90 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7641, max= 8192, per=47.38%, avg=7916.50, stdev=389.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.94%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8355KiB/s (8555kB/s), 2089KiB/s-7484KiB/s (2139kB/s-7663kB/s), io=16.0MiB (16.8MB), run=1642-1961msec WRITE: bw=16.3MiB/s (17.1MB/s), 4177KiB/s-7385KiB/s (4278kB/s-7562kB/s), io=32.0MiB (33.6MB), run=1664-1961msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160541: Tue Dec 2 23:20:48 2025 read: IOPS=2, BW=9958KiB/s (10.2MB/s)(12.0MiB/1234msec) clat (msec): min=164, max=528, avg=396.49, stdev=201.30 lat (msec): min=164, max=528, avg=396.49, stdev=201.30 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 6032, max= 8110, per=79.50%, avg=7071.00, stdev=1469.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=14.27%, ctx=38, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160542: Tue Dec 2 23:20:48 2025 read: IOPS=0, BW=2224KiB/s (2277kB/s)(4096KiB/1842msec) clat (nsec): min=382430k, max=382430k, avg=382430105.00, stdev= 0.00 lat (nsec): min=382434k, max=382434k, avg=382433505.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 5988, max= 5988, per=67.33%, avg=5988.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4447KiB/s (4554kB/s)(8192KiB/1842msec); 0 zone resets clat (msec): min=641, max=766, avg=703.83, stdev=88.37 lat (msec): min=641, max=766, avg=704.33, stdev=88.41 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8110, max= 8110, per=56.38%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=8.53%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160543: Tue Dec 2 23:20:48 2025 write: IOPS=1, BW=5394KiB/s (5524kB/s)(12.0MiB/2278msec); 0 zone resets clat (msec): min=153, max=1701, avg=746.42, stdev=835.33 lat (msec): min=153, max=1704, avg=747.71, stdev=836.88 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.04%, sys=8.12%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160544: Tue Dec 2 23:20:48 2025 write: IOPS=2, BW=9854KiB/s (10.1MB/s)(12.0MiB/1247msec); 0 zone resets clat (msec): min=173, max=784, avg=400.62, stdev=333.93 lat (msec): min=173, max=784, avg=401.09, stdev=334.06 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min=11736, max=11736, per=81.59%, avg=11736.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.08%, sys=13.64%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8895KiB/s (9108kB/s), 2224KiB/s-9958KiB/s (2277kB/s-10.2MB/s), io=16.0MiB (16.8MB), run=1234-1842msec WRITE: bw=14.0MiB/s (14.7MB/s), 4447KiB/s-9854KiB/s (4554kB/s-10.1MB/s), io=32.0MiB (33.6MB), run=1247-2278msec