== sanity test 398b: DIO and buffer IO race ============== 01:06:05 (1786943165) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.15743 s, 9.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188399: Mon Aug 17 01:08:30 2026 read: IOPS=11, BW=46.0KiB/s (48.1kB/s)(5992KiB/127578msec) clat (usec): min=46, max=999913, avg=47218.15, stdev=37989.05 lat (usec): min=47, max=999915, avg=47221.71, stdev=37988.42 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11863], 10.00th=[ 17695], | 20.00th=[ 24511], 30.00th=[ 30278], 40.00th=[ 35390], | 50.00th=[ 40633], 60.00th=[ 47973], 70.00th=[ 55313], | 80.00th=[ 65799], 90.00th=[ 83362], 95.00th=[ 98042], | 99.00th=[ 158335], 99.50th=[ 185598], 99.90th=[ 223347], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 103, per=25.11%, avg=47.20, stdev=16.84, samples=248 iops : min= 1, max= 25, avg=11.15, stdev= 4.24, samples=248 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6296KiB/127578msec); 0 zone resets clat (usec): min=1174, max=409304, avg=35772.71, stdev=35851.05 lat (usec): min=1176, max=409305, avg=35776.36, stdev=35849.58 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1549], 10.00th=[ 2409], 20.00th=[ 4817], | 30.00th=[ 9110], 40.00th=[ 18482], 50.00th=[ 26870], 60.00th=[ 34866], | 70.00th=[ 46924], 80.00th=[ 62129], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[147850], 99.50th=[181404], 99.90th=[270533], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 118, per=24.87%, avg=48.99, stdev=21.64, samples=251 iops : min= 1, max= 29, avg=11.59, stdev= 5.41, samples=251 lat (usec) : 50=0.07%, 100=1.46%, 250=0.20%, 500=0.03% lat (msec) : 2=4.30%, 4=4.26%, 10=7.71%, 20=9.64%, 50=40.07% lat (msec) : 100=27.34%, 250=4.82%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.25%, ctx=7075, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188400: Mon Aug 17 01:08:30 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5940KiB/125560msec) clat (usec): min=32, max=999630, avg=46262.55, stdev=37401.55 lat (usec): min=32, max=999631, avg=46265.37, stdev=37402.76 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11863], 10.00th=[ 17171], | 20.00th=[ 24773], 30.00th=[ 29230], 40.00th=[ 34866], | 50.00th=[ 40633], 60.00th=[ 46924], 70.00th=[ 54264], | 80.00th=[ 64750], 90.00th=[ 80217], 95.00th=[ 93848], | 99.00th=[ 154141], 99.50th=[ 170918], 99.90th=[ 267387], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 103, per=24.96%, avg=46.93, stdev=18.18, samples=247 iops : min= 1, max= 25, avg=11.08, stdev= 4.58, samples=247 write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6348KiB/125560msec); 0 zone resets clat (usec): min=1128, max=233761, avg=35573.50, stdev=35396.81 lat (usec): min=1129, max=233762, avg=35577.53, stdev=35398.07 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1565], 10.00th=[ 2442], 20.00th=[ 4883], | 30.00th=[ 8848], 40.00th=[ 18220], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[152044], 99.50th=[175113], 99.90th=[229639], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 143, per=25.46%, avg=50.15, stdev=22.72, samples=247 iops : min= 1, max= 35, avg=11.89, stdev= 5.68, samples=247 lat (usec) : 50=0.13%, 100=1.50%, 250=0.13%, 750=0.03% lat (msec) : 2=4.30%, 4=4.69%, 10=7.62%, 20=9.70%, 50=40.66% lat (msec) : 100=26.33%, 250=4.85%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.22%, ctx=6930, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188401: Mon Aug 17 01:08:30 2026 read: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6028KiB/126696msec) clat (usec): min=35, max=904373, avg=45087.78, stdev=35030.07 lat (usec): min=35, max=904374, avg=45091.22, stdev=35029.30 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12649], 10.00th=[ 18220], 20.00th=[ 23987], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[126354], 99.50th=[160433], 99.90th=[295699], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 111, per=25.11%, avg=47.20, stdev=18.44, samples=249 iops : min= 1, max= 27, avg=11.15, stdev= 4.63, samples=249 write: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6260KiB/126696msec); 0 zone resets clat (usec): min=1203, max=370888, avg=37268.78, stdev=36352.91 lat (usec): min=1204, max=370890, avg=37272.45, stdev=36353.67 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1614], 10.00th=[ 2769], 20.00th=[ 5211], | 30.00th=[ 10290], 40.00th=[ 19792], 50.00th=[ 28705], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[147850], 99.50th=[173016], 99.90th=[287310], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 15, max= 119, per=24.86%, avg=48.98, stdev=19.87, samples=249 iops : min= 3, max= 29, avg=11.60, stdev= 4.98, samples=249 lat (usec) : 50=0.20%, 100=1.30%, 250=0.13%, 500=0.10%, 750=0.07% lat (msec) : 2=3.81%, 4=3.87%, 10=7.58%, 20=9.73%, 50=42.06% lat (msec) : 100=26.30%, 250=4.72%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.13%, ctx=7060, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188402: Mon Aug 17 01:08:30 2026 read: IOPS=12, BW=48.3KiB/s (49.5kB/s)(6052KiB/125205msec) clat (usec): min=35, max=981524, avg=46318.28, stdev=37507.19 lat (usec): min=35, max=981525, avg=46320.81, stdev=37506.83 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12780], 10.00th=[ 18220], 20.00th=[ 23725], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 47449], | 70.00th=[ 54789], 80.00th=[ 64226], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[154141], 99.50th=[187696], 99.90th=[270533], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 112, per=25.66%, avg=48.24, stdev=17.76, samples=245 iops : min= 1, max= 28, avg=11.40, stdev= 4.46, samples=245 write: IOPS=12, BW=49.8KiB/s (51.0kB/s)(6236KiB/125205msec); 0 zone resets clat (usec): min=1184, max=246498, avg=35084.90, stdev=36116.88 lat (usec): min=1184, max=246500, avg=35089.87, stdev=36115.89 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1500], 10.00th=[ 2147], 20.00th=[ 4424], | 30.00th=[ 8225], 40.00th=[ 15664], 50.00th=[ 24249], 60.00th=[ 33162], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[149947], 99.50th=[170918], 99.90th=[221250], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 127, per=25.19%, avg=49.62, stdev=21.88, samples=245 iops : min= 1, max= 31, avg=11.76, stdev= 5.51, samples=245 lat (usec) : 50=0.07%, 100=1.79%, 250=0.20%, 500=0.03% lat (msec) : 2=4.52%, 4=4.98%, 10=7.39%, 20=9.80%, 50=40.33% lat (msec) : 100=25.72%, 250=5.11%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.17%, ctx=7009, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (193kB/s), 46.0KiB/s-48.3KiB/s (48.1kB/s-49.5kB/s), io=23.4MiB (24.6MB), run=125205-127578msec WRITE: bw=197KiB/s (202kB/s), 49.3KiB/s-50.6KiB/s (50.5kB/s-51.8kB/s), io=24.6MiB (25.7MB), run=125205-127578msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188404: Mon Aug 17 01:09:10 2026 read: IOPS=9, BW=36.1KiB/s (36.0kB/s)(5992KiB/165904msec) clat (msec): min=6, max=999, avg=43.69, stdev=45.11 lat (msec): min=6, max=999, avg=43.70, stdev=45.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 130], | 99.00th=[ 182], 99.50th=[ 207], 99.90th=[ 253], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 127, per=25.76%, avg=36.83, stdev=24.93, samples=317 iops : min= 1, max= 31, avg= 8.53, stdev= 6.25, samples=317 write: IOPS=9, BW=37.9KiB/s (38.9kB/s)(6296KiB/165904msec); 0 zone resets clat (msec): min=11, max=334, avg=63.70, stdev=42.98 lat (msec): min=11, max=334, avg=63.70, stdev=42.98 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 93], 90.00th=[ 123], 95.00th=[ 144], | 99.00th=[ 213], 99.50th=[ 255], 99.90th=[ 326], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 111, per=25.13%, avg=37.70, stdev=22.10, samples=325 iops : min= 1, max= 27, avg= 8.75, stdev= 5.55, samples=325 lat (msec) : 10=2.05%, 20=13.18%, 50=46.58%, 100=25.29%, 250=12.57% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=2.14%, ctx=5048, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188405: Mon Aug 17 01:09:10 2026 read: IOPS=8, BW=35.5KiB/s (36.3kB/s)(5940KiB/167466msec) clat (msec): min=6, max=950, avg=43.19, stdev=44.21 lat (msec): min=6, max=950, avg=43.20, stdev=44.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 95], 95.00th=[ 123], | 99.00th=[ 190], 99.50th=[ 239], 99.90th=[ 292], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=36.31, stdev=24.32, samples=318 iops : min= 1, max= 29, avg= 8.40, stdev= 6.09, samples=318 write: IOPS=9, BW=37.9KiB/s (38.8kB/s)(6348KiB/167466msec); 0 zone resets clat (msec): min=12, max=503, avg=65.00, stdev=46.46 lat (msec): min=12, max=503, avg=65.01, stdev=46.46 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 74], 80.00th=[ 92], 90.00th=[ 127], 95.00th=[ 155], | 99.00th=[ 236], 99.50th=[ 268], 99.90th=[ 393], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 127, per=25.03%, avg=37.54, stdev=22.54, samples=329 iops : min= 1, max= 31, avg= 8.71, stdev= 5.66, samples=329 lat (msec) : 10=1.33%, 20=14.29%, 50=46.09%, 100=25.07%, 250=12.66% lat (msec) : 500=0.49%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=2.13%, ctx=5087, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188406: Mon Aug 17 01:09:10 2026 read: IOPS=9, BW=36.3KiB/s (37.2kB/s)(6028KiB/165971msec) clat (msec): min=5, max=256, avg=44.28, stdev=37.34 lat (msec): min=5, max=256, avg=44.28, stdev=37.34 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 94], 95.00th=[ 128], | 99.00th=[ 176], 99.50th=[ 192], 99.90th=[ 245], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 159, per=25.38%, avg=36.29, stdev=23.52, samples=323 iops : min= 1, max= 39, avg= 8.39, stdev= 5.89, samples=323 write: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6260KiB/165971msec); 0 zone resets clat (msec): min=11, max=979, avg=63.32, stdev=48.93 lat (msec): min=11, max=979, avg=63.32, stdev=48.93 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 90], 90.00th=[ 120], 95.00th=[ 148], | 99.00th=[ 213], 99.50th=[ 253], 99.90th=[ 368], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 127, per=24.87%, avg=37.31, stdev=22.67, samples=326 iops : min= 1, max= 31, avg= 8.65, stdev= 5.70, samples=326 lat (msec) : 10=1.76%, 20=13.48%, 50=45.48%, 100=26.82%, 250=12.17% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.05%, sys=2.09%, ctx=5004, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188407: Mon Aug 17 01:09:10 2026 read: IOPS=9, BW=36.6KiB/s (37.4kB/s)(6052KiB/165576msec) clat (msec): min=6, max=298, avg=43.66, stdev=37.96 lat (msec): min=6, max=298, avg=43.66, stdev=37.96 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 124], | 99.00th=[ 188], 99.50th=[ 230], 99.90th=[ 266], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 143, per=25.85%, avg=36.97, stdev=24.11, samples=318 iops : min= 1, max= 35, avg= 8.57, stdev= 6.05, samples=318 write: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6236KiB/165576msec); 0 zone resets clat (msec): min=10, max=968, avg=63.74, stdev=50.37 lat (msec): min=10, max=968, avg=63.75, stdev=50.37 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 122], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 249], 99.90th=[ 514], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 111, per=25.02%, avg=37.53, stdev=22.61, samples=323 iops : min= 1, max= 27, avg= 8.70, stdev= 5.67, samples=323 lat (msec) : 10=1.76%, 20=13.77%, 50=46.35%, 100=25.20%, 250=12.60% lat (msec) : 500=0.26%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=2.16%, ctx=4954, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=143KiB/s (147kB/s), 35.5KiB/s-36.6KiB/s (36.3kB/s-37.4kB/s), io=23.4MiB (24.6MB), run=165576-167466msec WRITE: bw=150KiB/s (154kB/s), 37.7KiB/s-37.9KiB/s (38.6kB/s-38.9kB/s), io=24.6MiB (25.7MB), run=165576-167466msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188447: Mon Aug 17 01:09:49 2026 read: IOPS=12, BW=205KiB/s (209kB/s)(5920KiB/28947msec) clat (usec): min=35, max=199083, avg=42268.15, stdev=29627.57 lat (usec): min=35, max=199084, avg=42269.47, stdev=29627.58 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 5538], 20.00th=[ 20579], | 30.00th=[ 27395], 40.00th=[ 32900], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 49546], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[139461], 99.50th=[183501], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 95, max= 476, per=24.61%, avg=203.54, stdev=67.26, samples=57 iops : min= 5, max= 29, avg=11.91, stdev= 4.26, samples=57 write: IOPS=13, BW=220KiB/s (225kB/s)(6368KiB/28947msec); 0 zone resets clat (usec): min=1679, max=171438, avg=32991.83, stdev=29287.58 lat (usec): min=1679, max=171439, avg=33013.28, stdev=29271.37 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2671], 10.00th=[ 3916], 20.00th=[ 6915], | 30.00th=[ 11731], 40.00th=[ 18220], 50.00th=[ 26084], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 54789], 90.00th=[ 71828], 95.00th=[ 91751], | 99.00th=[130548], 99.50th=[152044], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 505, per=25.19%, avg=219.19, stdev=91.67, samples=57 iops : min= 1, max= 31, avg=12.89, stdev= 5.78, samples=57 lat (usec) : 50=0.52%, 100=3.39%, 250=0.26%, 1000=0.13% lat (msec) : 2=0.91%, 4=4.69%, 10=9.24%, 20=11.85%, 50=42.45% lat (msec) : 100=22.92%, 250=3.65% cpu : usr=0.10%, sys=6.27%, ctx=1835, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188449: Mon Aug 17 01:09:49 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5744KiB/28029msec) clat (usec): min=54, max=170836, avg=40248.22, stdev=26158.48 lat (usec): min=55, max=170838, avg=40252.37, stdev=26156.75 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 83], 10.00th=[ 14222], 20.00th=[ 21627], | 30.00th=[ 26608], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 47449], 80.00th=[ 57410], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[141558], 99.50th=[162530], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 63, max= 382, per=24.59%, avg=203.38, stdev=85.56, samples=55 iops : min= 3, max= 23, avg=11.91, stdev= 5.37, samples=55 write: IOPS=14, BW=233KiB/s (239kB/s)(6544KiB/28029msec); 0 zone resets clat (usec): min=1747, max=199361, avg=32826.96, stdev=32366.80 lat (usec): min=1749, max=199365, avg=32841.30, stdev=32390.50 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2442], 10.00th=[ 3654], 20.00th=[ 5669], | 30.00th=[ 8717], 40.00th=[ 15139], 50.00th=[ 24511], 60.00th=[ 32113], | 70.00th=[ 43254], 80.00th=[ 56886], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[152044], 99.50th=[160433], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 94, max= 415, per=26.65%, avg=231.82, stdev=79.83, samples=55 iops : min= 5, max= 25, avg=13.69, stdev= 5.02, samples=55 lat (usec) : 100=2.86%, 250=0.91% lat (msec) : 2=1.17%, 4=5.08%, 10=11.33%, 20=10.55%, 50=42.71% lat (msec) : 100=22.40%, 250=2.99% cpu : usr=0.06%, sys=6.73%, ctx=1867, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188450: Mon Aug 17 01:09:49 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(6256KiB/28336msec) clat (usec): min=39, max=156997, avg=38167.91, stdev=24310.46 lat (usec): min=40, max=156998, avg=38169.55, stdev=24310.71 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 110], 20.00th=[ 21103], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 55313], 90.00th=[ 66323], 95.00th=[ 78119], | 99.00th=[123208], 99.50th=[128451], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 31, max= 380, per=26.70%, avg=220.77, stdev=78.66, samples=56 iops : min= 1, max= 23, avg=13.00, stdev= 4.96, samples=56 write: IOPS=13, BW=213KiB/s (218kB/s)(6032KiB/28336msec); 0 zone resets clat (usec): min=1819, max=180317, avg=35373.48, stdev=32083.10 lat (usec): min=1822, max=180320, avg=35377.88, stdev=32085.15 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 2638], 10.00th=[ 3752], 20.00th=[ 7570], | 30.00th=[ 12125], 40.00th=[ 19792], 50.00th=[ 27395], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[149947], 99.50th=[158335], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 94, max= 351, per=24.40%, avg=212.32, stdev=65.10, samples=56 iops : min= 5, max= 21, avg=12.46, stdev= 4.06, samples=56 lat (usec) : 50=0.13%, 100=4.69%, 250=0.65%, 500=0.13% lat (msec) : 2=0.52%, 4=5.08%, 10=8.07%, 20=10.03%, 50=43.49% lat (msec) : 100=23.57%, 250=3.65% cpu : usr=0.07%, sys=6.66%, ctx=1803, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188451: Mon Aug 17 01:09:49 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28173msec) clat (usec): min=41, max=190308, avg=41947.27, stdev=28632.43 lat (usec): min=41, max=190309, avg=41948.73, stdev=28632.38 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 68], 10.00th=[ 217], 20.00th=[ 20841], | 30.00th=[ 26870], 40.00th=[ 31065], 50.00th=[ 38011], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 89654], | 99.00th=[135267], 99.50th=[139461], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 62, max= 379, per=25.85%, avg=213.82, stdev=80.17, samples=55 iops : min= 3, max= 23, avg=12.56, stdev= 5.07, samples=55 write: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28173msec); 0 zone resets clat (usec): min=1581, max=153634, avg=30998.78, stdev=29665.19 lat (usec): min=1583, max=153636, avg=31001.07, stdev=29665.27 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2573], 10.00th=[ 3490], 20.00th=[ 5800], | 30.00th=[ 8586], 40.00th=[ 15139], 50.00th=[ 22676], 60.00th=[ 29754], | 70.00th=[ 41157], 80.00th=[ 53216], 90.00th=[ 69731], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 93, max= 414, per=25.70%, avg=223.60, stdev=82.85, samples=55 iops : min= 5, max= 25, avg=13.18, stdev= 5.19, samples=55 lat (usec) : 50=0.65%, 100=3.91%, 250=0.39%, 500=0.13% lat (msec) : 2=1.82%, 4=4.69%, 10=10.42%, 20=11.07%, 50=40.23% lat (msec) : 100=23.05%, 250=3.65% cpu : usr=0.09%, sys=7.08%, ctx=1885, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=827KiB/s (847kB/s), 205KiB/s-221KiB/s (209kB/s-226kB/s), io=23.4MiB (24.5MB), run=28029-28947msec WRITE: bw=871KiB/s (891kB/s), 213KiB/s-233KiB/s (218kB/s-239kB/s), io=24.6MiB (25.8MB), run=28029-28947msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188452: Mon Aug 17 01:09:59 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(5920KiB/39531msec) clat (msec): min=8, max=249, avg=40.09, stdev=33.31 lat (msec): min=8, max=249, avg=40.10, stdev=33.31 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 111], | 99.00th=[ 182], 99.50th=[ 222], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 448, per=24.69%, avg=149.15, stdev=90.59, samples=78 iops : min= 1, max= 28, avg= 8.56, stdev= 5.74, samples=78 write: IOPS=10, BW=161KiB/s (165kB/s)(6368KiB/39531msec); 0 zone resets clat (msec): min=13, max=263, avg=61.84, stdev=40.32 lat (msec): min=13, max=263, avg=61.86, stdev=40.33 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 90], 90.00th=[ 112], 95.00th=[ 144], | 99.00th=[ 197], 99.50th=[ 249], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 29, max= 380, per=25.25%, avg=160.31, stdev=84.71, samples=78 iops : min= 1, max= 23, avg= 9.26, stdev= 5.39, samples=78 lat (msec) : 10=0.91%, 20=13.15%, 50=50.00%, 100=24.35%, 250=11.46% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.49%, ctx=1328, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188453: Mon Aug 17 01:09:59 2026 read: IOPS=9, BW=145KiB/s (148kB/s)(5744KiB/39637msec) clat (msec): min=8, max=212, avg=42.83, stdev=34.83 lat (msec): min=8, max=212, avg=42.83, stdev=34.83 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 91], 95.00th=[ 122], | 99.00th=[ 167], 99.50th=[ 197], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 411, per=25.06%, avg=151.39, stdev=87.10, samples=74 iops : min= 1, max= 25, avg= 8.70, stdev= 5.51, samples=74 write: IOPS=10, BW=165KiB/s (169kB/s)(6544KiB/39637msec); 0 zone resets clat (msec): min=15, max=246, avg=58.20, stdev=37.15 lat (msec): min=15, max=246, avg=58.21, stdev=37.16 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 107], 95.00th=[ 131], | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 62, max= 407, per=26.50%, avg=168.28, stdev=86.24, samples=76 iops : min= 3, max= 25, avg= 9.76, stdev= 5.47, samples=76 lat (msec) : 10=0.39%, 20=13.41%, 50=48.83%, 100=27.34%, 250=10.03% cpu : usr=0.05%, sys=2.53%, ctx=1334, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188454: Mon Aug 17 01:09:59 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38798msec) clat (msec): min=6, max=164, avg=40.88, stdev=31.40 lat (msec): min=6, max=164, avg=40.88, stdev=31.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 85], 95.00th=[ 110], | 99.00th=[ 157], 99.50th=[ 163], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 31, max= 537, per=27.11%, avg=163.77, stdev=107.13, samples=75 iops : min= 1, max= 33, avg= 9.47, stdev= 6.78, samples=75 write: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38798msec); 0 zone resets clat (msec): min=13, max=243, avg=60.00, stdev=39.69 lat (msec): min=13, max=243, avg=60.00, stdev=39.69 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 199], 99.50th=[ 236], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 443, per=24.12%, avg=153.18, stdev=82.70, samples=76 iops : min= 1, max= 27, avg= 8.80, stdev= 5.24, samples=76 lat (msec) : 10=1.04%, 20=14.19%, 50=49.22%, 100=25.13%, 250=10.42% cpu : usr=0.05%, sys=2.42%, ctx=1304, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188455: Mon Aug 17 01:09:59 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39135msec) clat (msec): min=7, max=256, avg=40.68, stdev=31.70 lat (msec): min=7, max=256, avg=40.69, stdev=31.70 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 87], 95.00th=[ 110], | 99.00th=[ 142], 99.50th=[ 169], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 447, per=25.46%, avg=153.80, stdev=89.85, samples=76 iops : min= 1, max= 27, avg= 8.84, stdev= 5.67, samples=76 write: IOPS=9, BW=160KiB/s (164kB/s)(6256KiB/39135msec); 0 zone resets clat (msec): min=15, max=233, avg=60.25, stdev=39.46 lat (msec): min=15, max=233, avg=60.25, stdev=39.46 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 57], | 70.00th=[ 66], 80.00th=[ 85], 90.00th=[ 121], 95.00th=[ 144], | 99.00th=[ 194], 99.50th=[ 207], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 60, max= 474, per=25.25%, avg=160.37, stdev=86.69, samples=76 iops : min= 3, max= 29, avg= 9.26, stdev= 5.52, samples=76 lat (msec) : 10=1.43%, 20=11.85%, 50=50.52%, 100=24.48%, 250=11.59% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.46%, ctx=1321, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=604KiB/s (619kB/s), 145KiB/s-161KiB/s (148kB/s-165kB/s), io=23.4MiB (24.5MB), run=38798-39637msec WRITE: bw=636KiB/s (651kB/s), 155KiB/s-165KiB/s (159kB/s-169kB/s), io=24.6MiB (25.8MB), run=38798-39637msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188466: Mon Aug 17 01:10:12 2026 read: IOPS=2, BW=2424KiB/s (2482kB/s)(7168KiB/2957msec) clat (usec): min=651, max=242584, avg=173822.55, stdev=84721.03 lat (usec): min=652, max=242585, avg=173824.05, stdev=84721.09 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[125305], | 30.00th=[204473], 40.00th=[204473], 50.00th=[204473], 60.00th=[219153], | 70.00th=[219153], 80.00th=[219153], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 2035, max= 4071, per=73.67%, avg=3380.67, stdev=1165.51, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1731KiB/s (1773kB/s)(5120KiB/2957msec); 0 zone resets clat (msec): min=154, max=694, avg=343.25, stdev=206.70 lat (msec): min=154, max=694, avg=343.49, stdev=207.03 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1976, max= 4079, per=41.97%, avg=2696.67, stdev=1197.50, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=23.99%, ctx=328, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188467: Mon Aug 17 01:10:12 2026 read: IOPS=0, BW=459KiB/s (470kB/s)(2048KiB/4462msec) clat (msec): min=135, max=206, avg=170.53, stdev=50.22 lat (msec): min=135, max=206, avg=170.53, stdev=50.22 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 2031, max= 2048, per=44.44%, avg=2039.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2295KiB/s (2350kB/s)(10.0MiB/4462msec); 0 zone resets clat (msec): min=210, max=749, avg=407.48, stdev=178.15 lat (msec): min=210, max=749, avg=407.60, stdev=178.13 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 249], | 30.00th=[ 253], 40.00th=[ 279], 50.00th=[ 305], 60.00th=[ 430], | 70.00th=[ 477], 80.00th=[ 535], 90.00th=[ 592], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1969, max= 4087, per=41.63%, avg=2674.83, stdev=1037.54, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=25.00% cpu : usr=0.07%, sys=19.52%, ctx=255, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188468: Mon Aug 17 01:10:12 2026 read: IOPS=1, BW=1967KiB/s (2014kB/s)(6144KiB/3124msec) clat (usec): min=1131, max=231591, avg=149329.08, stdev=83017.27 lat (usec): min=1132, max=231592, avg=149330.56, stdev=83017.47 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1139], 10.00th=[ 1139], 20.00th=[133694], | 30.00th=[133694], 40.00th=[147850], 50.00th=[147850], 60.00th=[158335], | 70.00th=[223347], 80.00th=[223347], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 1965, max= 3938, per=54.45%, avg=2498.50, stdev=960.42, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1967KiB/s (2014kB/s)(6144KiB/3124msec); 0 zone resets clat (msec): min=180, max=519, avg=365.56, stdev=151.72 lat (msec): min=180, max=523, avg=366.36, stdev=152.47 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 481], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1950, max= 3992, per=39.04%, avg=2508.25, stdev=990.19, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 2=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.06%, sys=21.29%, ctx=250, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188469: Mon Aug 17 01:10:12 2026 read: IOPS=1, BW=1648KiB/s (1688kB/s)(5120KiB/3106msec) clat (usec): min=492, max=89332, avg=18617.57, stdev=39533.80 lat (usec): min=493, max=89333, avg=18618.70, stdev=39533.76 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 494], | 30.00th=[ 570], 40.00th=[ 570], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1680], 80.00th=[ 1680], 90.00th=[89654], 95.00th=[89654], | 99.00th=[89654], 99.50th=[89654], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2308KiB/s (2363kB/s)(7168KiB/3106msec); 0 zone resets clat (msec): min=141, max=894, avg=426.55, stdev=289.08 lat (msec): min=141, max=894, avg=426.65, stdev=289.09 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 165], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 347], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 743], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2039, max= 6107, per=62.77%, avg=4033.00, stdev=2035.18, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=16.67%, 100=8.33%, 250=16.67%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=15.14%, ctx=220, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4590KiB/s (4700kB/s), 459KiB/s-2424KiB/s (470kB/s-2482kB/s), io=20.0MiB (20.0MB), run=2957-4462msec WRITE: bw=6426KiB/s (6580kB/s), 1731KiB/s-2308KiB/s (1773kB/s-2363kB/s), io=28.0MiB (29.4MB), run=2957-4462msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188471: Mon Aug 17 01:10:12 2026 read: IOPS=1, BW=1829KiB/s (1873kB/s)(7168KiB/3919msec) clat (msec): min=76, max=1124, avg=261.34, stdev=382.94 lat (msec): min=76, max=1124, avg=261.34, stdev=382.94 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 111], 60.00th=[ 130], | 70.00th=[ 130], 80.00th=[ 203], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2003, max= 5333, per=80.84%, avg=3697.67, stdev=1665.79, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1306KiB/s (1338kB/s)(5120KiB/3919msec); 0 zone resets clat (msec): min=137, max=844, avg=410.91, stdev=296.55 lat (msec): min=137, max=844, avg=411.06, stdev=296.61 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2003, max= 4031, per=41.90%, avg=2683.00, stdev=1167.42, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=5.56%, ctx=117, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188472: Mon Aug 17 01:10:12 2026 read: IOPS=0, BW=457KiB/s (468kB/s)(2048KiB/4477msec) clat (msec): min=387, max=628, avg=507.92, stdev=170.43 lat (msec): min=387, max=628, avg=507.92, stdev=170.43 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1858, max= 2015, per=42.34%, avg=1936.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2287KiB/s (2342kB/s)(10.0MiB/4477msec); 0 zone resets clat (msec): min=125, max=675, avg=344.07, stdev=199.59 lat (msec): min=125, max=675, avg=344.24, stdev=199.64 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 136], | 30.00th=[ 142], 40.00th=[ 218], 50.00th=[ 292], 60.00th=[ 305], | 70.00th=[ 468], 80.00th=[ 502], 90.00th=[ 584], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1878, max= 6131, per=47.10%, avg=3016.17, stdev=1732.70, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.02%, sys=7.15%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188473: Mon Aug 17 01:10:12 2026 read: IOPS=1, BW=1559KiB/s (1597kB/s)(6144KiB/3940msec) clat (msec): min=99, max=590, avg=270.42, stdev=223.96 lat (msec): min=99, max=590, avg=270.42, stdev=223.96 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 169], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2015, max= 4031, per=58.92%, avg=2695.00, stdev=1157.07, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1559KiB/s (1597kB/s)(6144KiB/3940msec); 0 zone resets clat (msec): min=154, max=606, avg=384.76, stdev=170.66 lat (msec): min=154, max=606, avg=384.87, stdev=170.65 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 468], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1878, max= 3716, per=37.52%, avg=2403.00, stdev=877.52, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=5.53%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188474: Mon Aug 17 01:10:12 2026 read: IOPS=1, BW=1145KiB/s (1173kB/s)(5120KiB/4470msec) clat (msec): min=93, max=578, avg=305.39, stdev=241.15 lat (msec): min=93, max=578, avg=305.39, stdev=241.15 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 211], 60.00th=[ 211], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2003, max= 4087, per=59.07%, avg=2701.67, stdev=1199.75, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1604KiB/s (1642kB/s)(7168KiB/4470msec); 0 zone resets clat (msec): min=117, max=1154, avg=414.95, stdev=368.13 lat (msec): min=117, max=1154, avg=415.08, stdev=368.11 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 180], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 207], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 592], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1878, max= 4087, per=46.98%, avg=3008.75, stdev=1214.72, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=6.74%, ctx=129, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4574KiB/s (4684kB/s), 457KiB/s-1829KiB/s (468kB/s-1873kB/s), io=20.0MiB (20.0MB), run=3919-4477msec WRITE: bw=6404KiB/s (6558kB/s), 1306KiB/s-2287KiB/s (1338kB/s-2342kB/s), io=28.0MiB (29.4MB), run=3919-4477msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188482: Mon Aug 17 01:10:23 2026 read: IOPS=1, BW=5005KiB/s (5125kB/s)(12.0MiB/2455msec) clat (msec): min=197, max=1372, avg=767.13, stdev=588.49 lat (msec): min=197, max=1372, avg=767.13, stdev=588.49 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.09%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188484: Mon Aug 17 01:10:23 2026 read: IOPS=0, BW=1634KiB/s (1674kB/s)(4096KiB/2506msec) clat (nsec): min=868193k, max=868193k, avg=868193482.00, stdev= 0.00 lat (nsec): min=868196k, max=868196k, avg=868196050.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3269KiB/s (3347kB/s)(8192KiB/2506msec); 0 zone resets clat (msec): min=672, max=913, avg=792.78, stdev=170.60 lat (msec): min=672, max=913, avg=793.08, stdev=170.53 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8110, max= 8110, per=72.20%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.51%, ctx=50, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188486: Mon Aug 17 01:10:23 2026 write: IOPS=1, BW=4213KiB/s (4314kB/s)(12.0MiB/2917msec); 0 zone resets clat (msec): min=261, max=1640, avg=911.14, stdev=693.04 lat (msec): min=262, max=1641, avg=911.73, stdev=693.00 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8159, max= 8175, per=72.71%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.25%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188488: Mon Aug 17 01:10:23 2026 write: IOPS=1, BW=6194KiB/s (6342kB/s)(12.0MiB/1984msec); 0 zone resets clat (msec): min=263, max=1143, avg=643.79, stdev=452.38 lat (msec): min=267, max=1145, avg=646.08, stdev=451.34 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 6150, max= 8031, per=63.12%, avg=7090.50, stdev=1330.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.86%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6538KiB/s (6695kB/s), 1634KiB/s-5005KiB/s (1674kB/s-5125kB/s), io=16.0MiB (16.8MB), run=2455-2506msec WRITE: bw=10.0MiB/s (11.5MB/s), 3269KiB/s-6194KiB/s (3347kB/s-6342kB/s), io=32.0MiB (33.6MB), run=1984-2917msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188481: Mon Aug 17 01:10:24 2026 read: IOPS=1, BW=5120KiB/s (5243kB/s)(12.0MiB/2400msec) clat (msec): min=687, max=873, avg=768.77, stdev=94.84 lat (msec): min=687, max=873, avg=768.78, stdev=94.84 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.55%, ctx=549, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188483: Mon Aug 17 01:10:24 2026 read: IOPS=0, BW=2025KiB/s (2073kB/s)(4096KiB/2023msec) clat (nsec): min=791321k, max=791321k, avg=791320990.00, stdev= 0.00 lat (nsec): min=791324k, max=791324k, avg=791323541.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4049KiB/s (4147kB/s)(8192KiB/2023msec); 0 zone resets clat (msec): min=431, max=716, avg=574.03, stdev=201.04 lat (msec): min=432, max=716, avg=574.53, stdev=200.98 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8062, max= 8062, per=74.85%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=9.64%, ctx=255, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188485: Mon Aug 17 01:10:24 2026 write: IOPS=0, BW=4039KiB/s (4136kB/s)(12.0MiB/3042msec); 0 zone resets clat (msec): min=170, max=2300, avg=971.51, stdev=1158.75 lat (msec): min=170, max=2300, avg=971.97, stdev=1158.94 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8175, max= 8175, per=75.90%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.08%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188487: Mon Aug 17 01:10:24 2026 write: IOPS=1, BW=4658KiB/s (4770kB/s)(12.0MiB/2638msec); 0 zone resets clat (msec): min=718, max=979, avg=833.95, stdev=133.28 lat (msec): min=718, max=981, avg=834.96, stdev=133.84 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8047, max= 8062, per=74.78%, avg=8054.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.56%, ctx=131, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6827KiB/s (6991kB/s), 2025KiB/s-5120KiB/s (2073kB/s-5243kB/s), io=16.0MiB (16.8MB), run=2023-2400msec WRITE: bw=10.5MiB/s (11.0MB/s), 4039KiB/s-4658KiB/s (4136kB/s-4770kB/s), io=32.0MiB (33.6MB), run=2023-3042msec