== sanity test 398b: DIO and buffer IO race ============== 01:32:59 (1784698379) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.11507 s, 16.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147159: Wed Jul 22 01:34:15 2026 read: IOPS=22, BW=91.2KiB/s (93.4kB/s)(5992KiB/65721msec) clat (usec): min=35, max=655571, avg=22732.30, stdev=23553.45 lat (usec): min=35, max=655573, avg=22733.71, stdev=23553.48 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 143], 10.00th=[ 9110], 20.00th=[ 11863], | 30.00th=[ 14222], 40.00th=[ 16450], 50.00th=[ 19006], 60.00th=[ 22414], | 70.00th=[ 26346], 80.00th=[ 31327], 90.00th=[ 38011], 95.00th=[ 45351], | 99.00th=[ 87557], 99.50th=[111674], 99.90th=[191890], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 159, per=25.06%, avg=90.72, stdev=27.69, samples=130 iops : min= 1, max= 39, avg=22.20, stdev= 6.93, samples=130 write: IOPS=23, BW=95.8KiB/s (98.1kB/s)(6296KiB/65721msec); 0 zone resets clat (usec): min=985, max=229474, avg=19944.70, stdev=20263.10 lat (usec): min=986, max=229476, avg=19946.74, stdev=20263.17 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1926], 10.00th=[ 2769], 20.00th=[ 4146], | 30.00th=[ 6194], 40.00th=[ 10814], 50.00th=[ 15533], 60.00th=[ 19792], | 70.00th=[ 25297], 80.00th=[ 32375], 90.00th=[ 43254], 95.00th=[ 54264], | 99.00th=[ 79168], 99.50th=[121111], 99.90th=[225444], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 40, max= 175, per=25.35%, avg=96.07, stdev=29.63, samples=129 iops : min= 10, max= 43, avg=23.54, stdev= 7.39, samples=129 lat (usec) : 50=0.16%, 100=1.24%, 250=1.73%, 500=0.26%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=2.77%, 4=7.10%, 10=12.47%, 20=31.05%, 50=38.28% lat (msec) : 100=4.26%, 250=0.55%, 750=0.03% cpu : usr=0.14%, sys=17.28%, ctx=8100, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147160: Wed Jul 22 01:34:15 2026 read: IOPS=22, BW=89.8KiB/s (91.9kB/s)(5940KiB/66177msec) clat (usec): min=48, max=198389, avg=21869.12, stdev=16105.20 lat (usec): min=49, max=198389, avg=21870.71, stdev=16104.92 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 165], 10.00th=[ 9110], 20.00th=[ 11731], | 30.00th=[ 13960], 40.00th=[ 15795], 50.00th=[ 18482], 60.00th=[ 21627], | 70.00th=[ 25822], 80.00th=[ 31065], 90.00th=[ 37487], 95.00th=[ 45876], | 99.00th=[ 83362], 99.50th=[ 99091], 99.90th=[187696], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 167, per=24.59%, avg=89.00, stdev=27.23, samples=131 iops : min= 1, max= 41, avg=21.77, stdev= 6.79, samples=131 write: IOPS=23, BW=95.9KiB/s (98.2kB/s)(6348KiB/66177msec); 0 zone resets clat (usec): min=1112, max=643437, avg=21054.29, stdev=25236.58 lat (usec): min=1113, max=643438, avg=21057.54, stdev=25237.53 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 2114], 10.00th=[ 2802], 20.00th=[ 4359], | 30.00th=[ 6783], 40.00th=[ 11731], 50.00th=[ 16188], 60.00th=[ 20841], | 70.00th=[ 26346], 80.00th=[ 33424], 90.00th=[ 44827], 95.00th=[ 54789], | 99.00th=[ 89654], 99.50th=[108528], 99.90th=[250610], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 23, max= 191, per=25.18%, avg=95.45, stdev=28.45, samples=130 iops : min= 5, max= 47, avg=23.39, stdev= 7.16, samples=130 lat (usec) : 50=0.07%, 100=1.04%, 250=1.79%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=2.02%, 4=7.36%, 10=12.70%, 20=31.41%, 50=38.05% lat (msec) : 100=4.75%, 250=0.49%, 500=0.03%, 750=0.03% cpu : usr=0.14%, sys=17.21%, ctx=8332, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147161: Wed Jul 22 01:34:15 2026 read: IOPS=22, BW=91.8KiB/s (93.0kB/s)(6028KiB/65691msec) clat (usec): min=49, max=247065, avg=22074.12, stdev=16479.36 lat (usec): min=49, max=247067, avg=22076.10, stdev=16479.53 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 153], 10.00th=[ 8848], 20.00th=[ 11994], | 30.00th=[ 14484], 40.00th=[ 16581], 50.00th=[ 19006], 60.00th=[ 22152], | 70.00th=[ 25560], 80.00th=[ 31065], 90.00th=[ 39060], 95.00th=[ 45351], | 99.00th=[ 82314], 99.50th=[ 91751], 99.90th=[240124], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 8, max= 168, per=25.37%, avg=91.85, stdev=28.06, samples=129 iops : min= 2, max= 42, avg=22.49, stdev= 6.98, samples=129 write: IOPS=23, BW=95.3KiB/s (97.6kB/s)(6260KiB/65691msec); 0 zone resets clat (usec): min=1157, max=670887, avg=20542.36, stdev=25151.66 lat (usec): min=1157, max=670889, avg=20545.26, stdev=25152.64 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2089], 10.00th=[ 2769], 20.00th=[ 4228], | 30.00th=[ 6849], 40.00th=[ 12387], 50.00th=[ 16057], 60.00th=[ 20317], | 70.00th=[ 25297], 80.00th=[ 32637], 90.00th=[ 42730], 95.00th=[ 50594], | 99.00th=[ 85459], 99.50th=[108528], 99.90th=[229639], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 15, max= 152, per=25.10%, avg=95.13, stdev=31.18, samples=129 iops : min= 3, max= 38, avg=23.31, stdev= 7.75, samples=129 lat (usec) : 50=0.03%, 100=1.69%, 250=1.53%, 500=0.07%, 750=0.13% lat (msec) : 2=2.15%, 4=7.32%, 10=11.72%, 20=31.64%, 50=39.58% lat (msec) : 100=3.68%, 250=0.42%, 750=0.03% cpu : usr=0.14%, sys=17.48%, ctx=8235, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147162: Wed Jul 22 01:34:15 2026 read: IOPS=23, BW=93.4KiB/s (95.7kB/s)(6052KiB/64779msec) clat (usec): min=45, max=219024, avg=21570.38, stdev=14687.56 lat (usec): min=46, max=219026, avg=21572.20, stdev=14687.17 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 127], 10.00th=[ 8586], 20.00th=[ 11600], | 30.00th=[ 13960], 40.00th=[ 16188], 50.00th=[ 18744], 60.00th=[ 21890], | 70.00th=[ 26084], 80.00th=[ 30802], 90.00th=[ 39060], 95.00th=[ 47449], | 99.00th=[ 64750], 99.50th=[ 81265], 99.90th=[112722], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 152, per=25.90%, avg=93.76, stdev=25.09, samples=127 iops : min= 7, max= 38, avg=22.96, stdev= 6.21, samples=127 write: IOPS=24, BW=96.3KiB/s (98.6kB/s)(6236KiB/64779msec); 0 zone resets clat (usec): min=979, max=629441, avg=20445.67, stdev=23806.23 lat (usec): min=980, max=629442, avg=20448.14, stdev=23805.88 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2114], 10.00th=[ 2835], 20.00th=[ 4490], | 30.00th=[ 6456], 40.00th=[ 11469], 50.00th=[ 15926], 60.00th=[ 20317], | 70.00th=[ 26084], 80.00th=[ 32900], 90.00th=[ 44303], 95.00th=[ 53740], | 99.00th=[ 77071], 99.50th=[ 98042], 99.90th=[189793], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 14, max= 175, per=25.33%, avg=96.00, stdev=26.85, samples=128 iops : min= 3, max= 43, avg=23.52, stdev= 6.74, samples=128 lat (usec) : 50=0.03%, 100=1.79%, 250=1.73%, 500=0.20%, 1000=0.07% lat (msec) : 2=2.25%, 4=6.67%, 10=13.02%, 20=30.92%, 50=38.09% lat (msec) : 100=4.95%, 250=0.26%, 750=0.03% cpu : usr=0.15%, sys=17.48%, ctx=8213, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=363KiB/s (372kB/s), 89.8KiB/s-93.4KiB/s (91.9kB/s-95.7kB/s), io=23.4MiB (24.6MB), run=64779-66177msec WRITE: bw=380KiB/s (389kB/s), 95.3KiB/s-96.3KiB/s (97.6kB/s-98.6kB/s), io=24.6MiB (25.7MB), run=64779-66177msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147163: Wed Jul 22 01:34:58 2026 read: IOPS=13, BW=54.6KiB/s (55.9kB/s)(5992KiB/109827msec) clat (msec): min=4, max=665, avg=18.29, stdev=24.30 lat (msec): min=4, max=665, avg=18.30, stdev=24.30 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 54], | 99.00th=[ 86], 99.50th=[ 102], 99.90th=[ 176], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 167, per=25.12%, avg=54.76, stdev=35.40, samples=215 iops : min= 1, max= 41, avg=13.32, stdev= 8.93, samples=215 write: IOPS=14, BW=57.3KiB/s (58.7kB/s)(6296KiB/109827msec); 0 zone resets clat (msec): min=18, max=271, avg=52.20, stdev=30.70 lat (msec): min=18, max=271, avg=52.21, stdev=30.70 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 30], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 60], 80.00th=[ 75], 90.00th=[ 95], 95.00th=[ 113], | 99.00th=[ 148], 99.50th=[ 171], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 128, per=24.99%, avg=56.98, stdev=30.39, samples=217 iops : min= 1, max= 32, avg=13.87, stdev= 7.70, samples=217 lat (msec) : 10=22.01%, 20=14.19%, 50=42.15%, 100=17.02%, 250=4.52% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=5.63%, ctx=6044, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147164: Wed Jul 22 01:34:58 2026 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(5940KiB/109806msec) clat (msec): min=3, max=629, avg=18.03, stdev=23.68 lat (msec): min=3, max=629, avg=18.03, stdev=23.68 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 40], 95.00th=[ 54], | 99.00th=[ 90], 99.50th=[ 120], 99.90th=[ 182], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 160, per=25.31%, avg=55.17, stdev=35.94, samples=212 iops : min= 1, max= 40, avg=13.42, stdev= 9.08, samples=212 write: IOPS=14, BW=57.8KiB/s (59.2kB/s)(6348KiB/109806msec); 0 zone resets clat (msec): min=16, max=275, avg=52.16, stdev=31.46 lat (msec): min=16, max=275, avg=52.17, stdev=31.46 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 75], 90.00th=[ 95], 95.00th=[ 114], | 99.00th=[ 157], 99.50th=[ 182], 99.90th=[ 257], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 15, max= 128, per=25.20%, avg=57.46, stdev=30.81, samples=217 iops : min= 3, max= 32, avg=13.99, stdev= 7.80, samples=217 lat (msec) : 4=0.03%, 10=21.48%, 20=15.23%, 50=41.15%, 100=17.29% lat (msec) : 250=4.72%, 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=5.61%, ctx=6095, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147165: Wed Jul 22 01:34:58 2026 read: IOPS=13, BW=55.2KiB/s (56.5kB/s)(6028KiB/109230msec) clat (msec): min=3, max=202, avg=18.54, stdev=18.48 lat (msec): min=3, max=202, avg=18.54, stdev=18.48 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 28], 90.00th=[ 42], 95.00th=[ 54], | 99.00th=[ 89], 99.50th=[ 118], 99.90th=[ 150], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 7, max= 175, per=25.47%, avg=55.53, stdev=34.67, samples=214 iops : min= 1, max= 43, avg=13.51, stdev= 8.77, samples=214 write: IOPS=14, BW=57.3KiB/s (58.7kB/s)(6260KiB/109230msec); 0 zone resets clat (msec): min=18, max=661, avg=51.79, stdev=33.61 lat (msec): min=18, max=661, avg=51.79, stdev=33.61 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 30], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 74], 90.00th=[ 93], 95.00th=[ 107], | 99.00th=[ 150], 99.50th=[ 209], 99.90th=[ 271], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 120, per=25.04%, avg=57.09, stdev=30.79, samples=216 iops : min= 3, max= 30, avg=13.90, stdev= 7.79, samples=216 lat (msec) : 4=0.10%, 10=20.57%, 20=15.30%, 50=42.58%, 100=17.61% lat (msec) : 250=3.78%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.55%, ctx=5880, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147166: Wed Jul 22 01:34:58 2026 read: IOPS=13, BW=55.5KiB/s (56.9kB/s)(6052KiB/108982msec) clat (msec): min=4, max=216, avg=17.59, stdev=17.62 lat (msec): min=4, max=216, avg=17.59, stdev=17.62 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 53], | 99.00th=[ 81], 99.50th=[ 103], 99.90th=[ 155], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 7, max= 192, per=26.07%, avg=56.83, stdev=35.69, samples=211 iops : min= 1, max= 48, avg=13.84, stdev= 8.99, samples=211 write: IOPS=14, BW=57.2KiB/s (58.6kB/s)(6236KiB/108982msec); 0 zone resets clat (msec): min=18, max=661, avg=52.68, stdev=34.85 lat (msec): min=18, max=661, avg=52.68, stdev=34.85 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 30], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 77], 90.00th=[ 95], 95.00th=[ 109], | 99.00th=[ 176], 99.50th=[ 205], 99.90th=[ 275], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 119, per=25.06%, avg=57.13, stdev=30.28, samples=216 iops : min= 3, max= 29, avg=13.91, stdev= 7.67, samples=216 lat (msec) : 10=22.27%, 20=14.88%, 50=41.02%, 100=17.61%, 250=4.10% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.10%, sys=5.56%, ctx=6021, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=219KiB/s (224kB/s), 54.1KiB/s-55.5KiB/s (55.4kB/s-56.9kB/s), io=23.4MiB (24.6MB), run=108982-109827msec WRITE: bw=229KiB/s (234kB/s), 57.2KiB/s-57.8KiB/s (58.6kB/s-59.2kB/s), io=24.6MiB (25.7MB), run=108982-109827msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147202: Wed Jul 22 01:35:18 2026 read: IOPS=26, BW=426KiB/s (436kB/s)(5920KiB/13899msec) clat (usec): min=54, max=69902, avg=18397.77, stdev=11384.53 lat (usec): min=55, max=69904, avg=18398.98, stdev=11384.45 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 135], 10.00th=[ 302], 20.00th=[10814], | 30.00th=[12780], 40.00th=[15533], 50.00th=[17433], 60.00th=[19006], | 70.00th=[21627], 80.00th=[25297], 90.00th=[31589], 95.00th=[37487], | 99.00th=[62129], 99.50th=[65274], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 286, max= 636, per=25.33%, avg=417.26, stdev=105.93, samples=27 iops : min= 17, max= 39, avg=25.52, stdev= 6.65, samples=27 write: IOPS=28, BW=458KiB/s (469kB/s)(6368KiB/13899msec); 0 zone resets clat (usec): min=1265, max=79094, avg=17629.85, stdev=13467.82 lat (usec): min=1267, max=79096, avg=17631.80, stdev=13467.87 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 3261], 10.00th=[ 4424], 20.00th=[ 5932], | 30.00th=[ 8979], 40.00th=[11731], 50.00th=[14222], 60.00th=[17171], | 70.00th=[21627], 80.00th=[28443], 90.00th=[35914], 95.00th=[42730], | 99.00th=[65799], 99.50th=[71828], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 222, max= 638, per=26.21%, avg=454.15, stdev=107.86, samples=27 iops : min= 13, max= 39, avg=27.81, stdev= 6.87, samples=27 lat (usec) : 100=1.43%, 250=3.12%, 500=0.26% lat (msec) : 2=1.04%, 4=2.99%, 10=16.41%, 20=40.23%, 50=32.16% lat (msec) : 100=2.34% cpu : usr=0.14%, sys=27.50%, ctx=2587, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147203: Wed Jul 22 01:35:18 2026 read: IOPS=24, BW=395KiB/s (405kB/s)(5744KiB/14537msec) clat (usec): min=74, max=79005, avg=19158.27, stdev=11507.86 lat (usec): min=75, max=79006, avg=19160.21, stdev=11507.83 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 126], 10.00th=[ 400], 20.00th=[10945], | 30.00th=[13566], 40.00th=[15926], 50.00th=[17957], 60.00th=[20317], | 70.00th=[23462], 80.00th=[27395], 90.00th=[32637], 95.00th=[37487], | 99.00th=[58459], 99.50th=[64750], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 55, max= 672, per=23.56%, avg=388.11, stdev=131.92, samples=28 iops : min= 3, max= 42, avg=23.71, stdev= 8.41, samples=28 write: IOPS=28, BW=450KiB/s (461kB/s)(6544KiB/14537msec); 0 zone resets clat (usec): min=1491, max=79526, avg=18418.93, stdev=14588.57 lat (usec): min=1492, max=79528, avg=18420.81, stdev=14588.66 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 3621], 10.00th=[ 4293], 20.00th=[ 5735], | 30.00th=[ 8291], 40.00th=[11994], 50.00th=[14091], 60.00th=[17433], | 70.00th=[21627], 80.00th=[30016], 90.00th=[40109], 95.00th=[47449], | 99.00th=[65799], 99.50th=[69731], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 221, max= 640, per=25.11%, avg=435.14, stdev=117.65, samples=28 iops : min= 13, max= 40, avg=26.64, stdev= 7.52, samples=28 lat (usec) : 100=0.78%, 250=3.65%, 500=0.26% lat (msec) : 2=0.65%, 4=3.91%, 10=15.76%, 20=37.11%, 50=34.51% lat (msec) : 100=3.39% cpu : usr=0.19%, sys=26.66%, ctx=2589, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147204: Wed Jul 22 01:35:18 2026 read: IOPS=27, BW=443KiB/s (454kB/s)(6256KiB/14111msec) clat (usec): min=68, max=74275, avg=19882.24, stdev=12525.50 lat (usec): min=70, max=74275, avg=19883.43, stdev=12525.58 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 139], 10.00th=[ 8717], 20.00th=[11863], | 30.00th=[13304], 40.00th=[15533], 50.00th=[18220], 60.00th=[20841], | 70.00th=[23725], 80.00th=[27395], 90.00th=[33817], 95.00th=[41157], | 99.00th=[67634], 99.50th=[73925], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 286, max= 604, per=26.96%, avg=444.07, stdev=87.64, samples=27 iops : min= 17, max= 37, avg=27.22, stdev= 5.44, samples=27 write: IOPS=26, BW=427KiB/s (438kB/s)(6032KiB/14111msec); 0 zone resets clat (usec): min=1401, max=75918, avg=16673.88, stdev=12547.61 lat (usec): min=1403, max=75920, avg=16675.98, stdev=12547.64 clat percentiles (usec): | 1.00th=[ 2089], 5.00th=[ 3261], 10.00th=[ 4178], 20.00th=[ 5276], | 30.00th=[ 8029], 40.00th=[10683], 50.00th=[13698], 60.00th=[16909], | 70.00th=[21365], 80.00th=[26084], 90.00th=[33424], 95.00th=[40109], | 99.00th=[58983], 99.50th=[71828], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 191, max= 672, per=24.07%, avg=417.15, stdev=129.82, samples=27 iops : min= 11, max= 42, avg=25.52, stdev= 8.24, samples=27 lat (usec) : 100=1.04%, 250=3.12%, 500=0.39% lat (msec) : 2=0.39%, 4=3.91%, 10=16.41%, 20=37.24%, 50=34.90% lat (msec) : 100=2.60% cpu : usr=0.13%, sys=27.00%, ctx=2553, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147205: Wed Jul 22 01:35:18 2026 read: IOPS=27, BW=445KiB/s (455kB/s)(6032KiB/13568msec) clat (usec): min=40, max=61187, avg=18962.14, stdev=11117.80 lat (usec): min=41, max=61188, avg=18963.22, stdev=11117.82 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 109], 10.00th=[ 192], 20.00th=[11207], | 30.00th=[13435], 40.00th=[15795], 50.00th=[18744], 60.00th=[20841], | 70.00th=[23987], 80.00th=[27657], 90.00th=[31851], 95.00th=[34866], | 99.00th=[55837], 99.50th=[58983], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 286, max= 699, per=26.63%, avg=438.65, stdev=92.04, samples=26 iops : min= 17, max= 43, avg=26.88, stdev= 5.77, samples=26 write: IOPS=28, BW=461KiB/s (472kB/s)(6256KiB/13568msec); 0 zone resets clat (usec): min=1213, max=70717, avg=16099.97, stdev=12284.89 lat (usec): min=1214, max=70720, avg=16102.47, stdev=12285.00 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 3326], 10.00th=[ 4228], 20.00th=[ 5997], | 30.00th=[ 7635], 40.00th=[10159], 50.00th=[13829], 60.00th=[15926], | 70.00th=[19006], 80.00th=[24511], 90.00th=[31589], 95.00th=[41681], | 99.00th=[62653], 99.50th=[67634], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 286, max= 670, per=26.43%, avg=458.00, stdev=95.66, samples=26 iops : min= 17, max= 41, avg=28.08, stdev= 6.08, samples=26 lat (usec) : 50=0.26%, 100=1.43%, 250=3.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.65%, 4=3.78%, 10=17.45%, 20=35.68%, 50=34.90% lat (msec) : 100=1.82% cpu : usr=0.17%, sys=27.63%, ctx=2581, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1648KiB/s (1687kB/s), 395KiB/s-445KiB/s (405kB/s-455kB/s), io=23.4MiB (24.5MB), run=13568-14537msec WRITE: bw=1734KiB/s (1775kB/s), 427KiB/s-461KiB/s (438kB/s-472kB/s), io=24.6MiB (25.8MB), run=13568-14537msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147198: Wed Jul 22 01:35:28 2026 read: IOPS=15, BW=247KiB/s (253kB/s)(5920KiB/23952msec) clat (usec): min=4572, max=97267, avg=17317.89, stdev=14157.29 lat (usec): min=4573, max=97268, avg=17319.11, stdev=14157.22 clat percentiles (usec): | 1.00th=[ 5407], 5.00th=[ 6194], 10.00th=[ 6783], 20.00th=[ 7635], | 30.00th=[ 8848], 40.00th=[10159], 50.00th=[11600], 60.00th=[13960], | 70.00th=[19268], 80.00th=[25822], 90.00th=[33424], 95.00th=[48497], | 99.00th=[72877], 99.50th=[82314], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 95, max= 541, per=24.73%, avg=242.87, stdev=103.51, samples=47 iops : min= 5, max= 33, avg=14.81, stdev= 6.52, samples=47 write: IOPS=16, BW=266KiB/s (272kB/s)(6368KiB/23952msec); 0 zone resets clat (msec): min=20, max=138, avg=44.00, stdev=16.37 lat (msec): min=20, max=138, avg=44.01, stdev=16.37 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 35], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 44], | 70.00th=[ 48], 80.00th=[ 53], 90.00th=[ 66], 95.00th=[ 79], | 99.00th=[ 101], 99.50th=[ 118], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 127, max= 415, per=25.59%, avg=264.30, stdev=82.68, samples=47 iops : min= 7, max= 25, avg=16.15, stdev= 5.39, samples=47 lat (msec) : 10=18.62%, 20=15.76%, 50=50.91%, 100=14.32%, 250=0.39% cpu : usr=0.10%, sys=8.49%, ctx=1676, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147199: Wed Jul 22 01:35:28 2026 read: IOPS=14, BW=236KiB/s (241kB/s)(5744KiB/24389msec) clat (msec): min=4, max=105, avg=17.09, stdev=15.75 lat (msec): min=4, max=105, avg=17.09, stdev=15.75 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 35], 95.00th=[ 53], | 99.00th=[ 77], 99.50th=[ 99], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 55, max= 608, per=23.82%, avg=233.94, stdev=127.04, samples=48 iops : min= 3, max= 38, avg=14.25, stdev= 8.07, samples=48 write: IOPS=16, BW=268KiB/s (275kB/s)(6544KiB/24389msec); 0 zone resets clat (msec): min=16, max=160, avg=44.32, stdev=18.44 lat (msec): min=16, max=160, avg=44.32, stdev=18.44 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 44], | 70.00th=[ 48], 80.00th=[ 55], 90.00th=[ 68], 95.00th=[ 77], | 99.00th=[ 108], 99.50th=[ 125], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 95, max= 448, per=25.63%, avg=264.71, stdev=89.56, samples=48 iops : min= 5, max= 28, avg=16.17, stdev= 5.80, samples=48 lat (msec) : 10=21.22%, 20=14.71%, 50=47.40%, 100=15.36%, 250=1.30% cpu : usr=0.07%, sys=8.33%, ctx=1677, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147200: Wed Jul 22 01:35:28 2026 read: IOPS=16, BW=264KiB/s (271kB/s)(6256KiB/23658msec) clat (usec): min=4844, max=79166, avg=17488.12, stdev=14691.60 lat (usec): min=4846, max=79168, avg=17489.41, stdev=14691.53 clat percentiles (usec): | 1.00th=[ 5342], 5.00th=[ 5932], 10.00th=[ 6521], 20.00th=[ 7898], | 30.00th=[ 8586], 40.00th=[ 9896], 50.00th=[11076], 60.00th=[13960], | 70.00th=[17695], 80.00th=[25035], 90.00th=[38011], 95.00th=[54264], | 99.00th=[72877], 99.50th=[73925], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 95, max= 672, per=26.99%, avg=265.06, stdev=137.92, samples=47 iops : min= 5, max= 42, avg=16.19, stdev= 8.74, samples=47 write: IOPS=15, BW=255KiB/s (261kB/s)(6032KiB/23658msec); 0 zone resets clat (msec): min=22, max=128, avg=44.20, stdev=17.95 lat (msec): min=22, max=128, avg=44.20, stdev=17.95 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 44], | 70.00th=[ 48], 80.00th=[ 55], 90.00th=[ 68], 95.00th=[ 84], | 99.00th=[ 121], 99.50th=[ 125], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 126, max= 416, per=24.68%, avg=254.89, stdev=87.14, samples=47 iops : min= 7, max= 26, avg=15.55, stdev= 5.63, samples=47 lat (msec) : 10=20.83%, 20=16.41%, 50=47.01%, 100=14.97%, 250=0.78% cpu : usr=0.13%, sys=8.61%, ctx=1684, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147201: Wed Jul 22 01:35:28 2026 read: IOPS=15, BW=251KiB/s (257kB/s)(6032KiB/24018msec) clat (msec): min=4, max=117, avg=17.96, stdev=15.91 lat (msec): min=4, max=117, avg=17.96, stdev=15.90 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 84], 99.50th=[ 113], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 64, max= 573, per=25.25%, avg=247.94, stdev=110.35, samples=47 iops : min= 4, max= 35, avg=15.13, stdev= 6.94, samples=47 write: IOPS=16, BW=260KiB/s (267kB/s)(6256KiB/24018msec); 0 zone resets clat (msec): min=21, max=137, avg=43.97, stdev=16.17 lat (msec): min=21, max=137, avg=43.97, stdev=16.17 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 35], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 43], | 70.00th=[ 47], 80.00th=[ 53], 90.00th=[ 64], 95.00th=[ 80], | 99.00th=[ 101], 99.50th=[ 129], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 95, max= 448, per=25.06%, avg=258.89, stdev=90.76, samples=47 iops : min= 5, max= 28, avg=15.81, stdev= 5.89, samples=47 lat (msec) : 10=20.96%, 20=14.19%, 50=50.26%, 100=13.93%, 250=0.65% cpu : usr=0.12%, sys=8.55%, ctx=1661, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=982KiB/s (1006kB/s), 236KiB/s-264KiB/s (241kB/s-271kB/s), io=23.4MiB (24.5MB), run=23658-24389msec WRITE: bw=1033KiB/s (1058kB/s), 255KiB/s-268KiB/s (261kB/s-275kB/s), io=24.6MiB (25.8MB), run=23658-24389msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147213: Wed Jul 22 01:35:35 2026 read: IOPS=4, BW=4425KiB/s (4531kB/s)(7168KiB/1620msec) clat (msec): min=34, max=178, avg=78.16, stdev=55.12 lat (msec): min=34, max=178, avg=78.16, stdev=55.12 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 39], | 30.00th=[ 51], 40.00th=[ 51], 50.00th=[ 54], 60.00th=[ 59], | 70.00th=[ 59], 80.00th=[ 133], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 2043, max= 8935, per=62.08%, avg=5489.00, stdev=4873.38, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 write: IOPS=3, BW=3160KiB/s (3236kB/s)(5120KiB/1620msec); 0 zone resets clat (msec): min=64, max=331, avg=203.83, stdev=119.97 lat (msec): min=65, max=331, avg=203.95, stdev=119.97 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1946, max= 4087, per=25.87%, avg=3202.33, stdev=1117.84, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 50=25.00%, 100=25.00%, 250=33.33%, 500=16.67% cpu : usr=0.00%, sys=17.48%, ctx=119, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147214: Wed Jul 22 01:35:35 2026 read: IOPS=0, BW=884KiB/s (906kB/s)(2048KiB/2316msec) clat (msec): min=42, max=438, avg=240.90, stdev=279.92 lat (msec): min=42, max=438, avg=240.90, stdev=279.92 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 43], 40.00th=[ 43], 50.00th=[ 43], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1765, max= 2043, per=21.53%, avg=1904.00, stdev=196.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=4, BW=4421KiB/s (4528kB/s)(10.0MiB/2316msec); 0 zone resets clat (msec): min=90, max=408, avg=176.03, stdev=111.36 lat (msec): min=90, max=408, avg=176.14, stdev=111.37 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 93], | 30.00th=[ 104], 40.00th=[ 107], 50.00th=[ 108], 60.00th=[ 128], | 70.00th=[ 157], 80.00th=[ 251], 90.00th=[ 317], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1946, max= 7062, per=34.25%, avg=4239.50, stdev=2635.14, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.63, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=13.95%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147215: Wed Jul 22 01:35:35 2026 read: IOPS=2, BW=2937KiB/s (3007kB/s)(6144KiB/2092msec) clat (msec): min=61, max=185, avg=123.72, stdev=49.05 lat (msec): min=61, max=185, avg=123.72, stdev=49.05 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 153], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 1946, max= 4087, per=36.06%, avg=3188.00, stdev=1110.95, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2937KiB/s (3007kB/s)(6144KiB/2092msec); 0 zone resets clat (msec): min=73, max=391, avg=221.18, stdev=138.83 lat (msec): min=73, max=392, avg=221.32, stdev=138.89 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 279], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1946, max= 5296, per=25.00%, avg=3095.00, stdev=1906.74, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=33.33%, 250=41.67%, 500=25.00% cpu : usr=0.05%, sys=10.86%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147216: Wed Jul 22 01:35:35 2026 read: IOPS=2, BW=2515KiB/s (2575kB/s)(5120KiB/2036msec) clat (msec): min=70, max=382, avg=151.25, stdev=132.39 lat (msec): min=70, max=382, avg=151.25, stdev=132.39 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 91], 60.00th=[ 91], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1783, max= 3893, per=29.10%, avg=2573.00, stdev=1150.52, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=3, BW=3521KiB/s (3605kB/s)(7168KiB/2036msec); 0 zone resets clat (msec): min=67, max=537, avg=177.38, stdev=167.28 lat (msec): min=67, max=537, avg=177.51, stdev=167.25 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 88], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 112], 60.00th=[ 116], | 70.00th=[ 116], 80.00th=[ 228], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7135, max= 7135, per=57.64%, avg=7135.00, stdev= 0.00, samples=1 iops : min= 6, max= 6, avg= 6.00, stdev= 0.00, samples=1 lat (msec) : 100=50.00%, 250=33.33%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=15.04%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8843KiB/s (9055kB/s), 884KiB/s-4425KiB/s (906kB/s-4531kB/s), io=20.0MiB (20.0MB), run=1620-2316msec WRITE: bw=12.1MiB/s (12.7MB/s), 2937KiB/s-4421KiB/s (3007kB/s-4528kB/s), io=28.0MiB (29.4MB), run=1620-2316msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147218: Wed Jul 22 01:35:36 2026 read: IOPS=3, BW=3106KiB/s (3180kB/s)(7168KiB/2308msec) clat (usec): min=519, max=241125, avg=128279.75, stdev=119979.98 lat (usec): min=520, max=241126, avg=128281.12, stdev=119979.89 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 627], | 30.00th=[ 652], 40.00th=[ 652], 50.00th=[202376], 60.00th=[225444], | 70.00th=[225444], 80.00th=[227541], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 1935, max= 4096, per=36.95%, avg=2986.50, stdev=1183.60, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=2, BW=2218KiB/s (2272kB/s)(5120KiB/2308msec); 0 zone resets clat (msec): min=201, max=418, avg=281.56, stdev=86.00 lat (msec): min=201, max=418, avg=281.62, stdev=85.97 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1992, max= 5807, per=34.47%, avg=3899.50, stdev=2697.61, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=25.00% lat (msec) : 250=58.33%, 500=16.67% cpu : usr=0.09%, sys=42.48%, ctx=572, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147219: Wed Jul 22 01:35:36 2026 read: IOPS=0, BW=836KiB/s (856kB/s)(2048KiB/2450msec) clat (msec): min=127, max=201, avg=164.24, stdev=52.57 lat (msec): min=127, max=201, avg=164.24, stdev=52.57 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 203], 95.00th=[ 203], | 99.00th=[ 203], 99.50th=[ 203], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 1389, max= 2048, per=21.26%, avg=1718.50, stdev=465.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=4, BW=4180KiB/s (4280kB/s)(10.0MiB/2450msec); 0 zone resets clat (msec): min=103, max=320, avg=211.91, stdev=78.00 lat (msec): min=104, max=320, avg=212.01, stdev=77.99 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 129], | 30.00th=[ 138], 40.00th=[ 182], 50.00th=[ 211], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 288], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 2778, max= 5807, per=36.98%, avg=4184.00, stdev=1243.03, samples=4 iops : min= 2, max= 5, avg= 3.50, stdev= 1.29, samples=4 lat (msec) : 250=75.00%, 500=25.00% cpu : usr=0.00%, sys=51.86%, ctx=617, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147220: Wed Jul 22 01:35:36 2026 read: IOPS=2, BW=2899KiB/s (2969kB/s)(6144KiB/2119msec) clat (usec): min=458, max=251342, avg=98472.38, stdev=111383.85 lat (usec): min=460, max=251343, avg=98473.62, stdev=111383.62 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 490], | 30.00th=[ 490], 40.00th=[ 791], 50.00th=[ 791], 60.00th=[168821], | 70.00th=[168821], 80.00th=[168821], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 2048, max= 6083, per=50.30%, avg=4065.50, stdev=2853.18, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2899KiB/s (2969kB/s)(6144KiB/2119msec); 0 zone resets clat (msec): min=168, max=506, avg=254.33, stdev=131.42 lat (msec): min=168, max=507, avg=254.43, stdev=131.51 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 201], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2048, max= 4055, per=26.12%, avg=2955.33, stdev=1017.23, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=44.90%, ctx=264, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147221: Wed Jul 22 01:35:36 2026 read: IOPS=1, BW=2021KiB/s (2069kB/s)(5120KiB/2534msec) clat (usec): min=380, max=260416, avg=98062.56, stdev=134045.78 lat (usec): min=380, max=260417, avg=98063.47, stdev=134045.67 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 379], 10.00th=[ 379], 20.00th=[ 379], | 30.00th=[ 570], 40.00th=[ 570], 50.00th=[ 611], 60.00th=[ 611], | 70.00th=[227541], 80.00th=[227541], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7742, max= 7742, per=95.79%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2829KiB/s (2897kB/s)(7168KiB/2534msec); 0 zone resets clat (msec): min=85, max=630, avg=291.52, stdev=228.13 lat (msec): min=85, max=630, avg=291.60, stdev=228.14 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 90], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 201], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 489], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1408, max= 4055, per=22.13%, avg=2503.67, stdev=1381.08, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=25.00%, 250=16.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=32.14%, ctx=357, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8082KiB/s (8276kB/s), 836KiB/s-3106KiB/s (856kB/s-3180kB/s), io=20.0MiB (20.0MB), run=2119-2534msec WRITE: bw=11.0MiB/s (11.6MB/s), 2218KiB/s-4180KiB/s (2272kB/s-4280kB/s), io=28.0MiB (29.4MB), run=2119-2534msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147226: Wed Jul 22 01:35:44 2026 read: IOPS=1, BW=6321KiB/s (6473kB/s)(12.0MiB/1944msec) clat (msec): min=512, max=685, avg=575.66, stdev=95.31 lat (msec): min=512, max=685, avg=575.67, stdev=95.31 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8159, max= 8192, per=97.02%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=50.33%, ctx=1565, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147227: Wed Jul 22 01:35:44 2026 read: IOPS=0, BW=2188KiB/s (2241kB/s)(4096KiB/1872msec) clat (nsec): min=512697k, max=512697k, avg=512697308.00, stdev= 0.00 lat (nsec): min=512700k, max=512700k, avg=512700498.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 8159, max= 8159, per=96.82%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4376KiB/s (4481kB/s)(8192KiB/1872msec); 0 zone resets clat (msec): min=213, max=929, avg=571.27, stdev=505.96 lat (msec): min=213, max=929, avg=571.63, stdev=506.02 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8159, max= 8159, per=54.23%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=25.17%, ctx=391, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147228: Wed Jul 22 01:35:44 2026 write: IOPS=1, BW=5642KiB/s (5777kB/s)(12.0MiB/2178msec); 0 zone resets clat (msec): min=649, max=681, avg=665.33, stdev=15.80 lat (msec): min=650, max=682, avg=665.92, stdev=16.04 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8159, max= 8192, per=54.34%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.05%, sys=36.10%, ctx=145, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147229: Wed Jul 22 01:35:44 2026 write: IOPS=1, BW=6540KiB/s (6697kB/s)(12.0MiB/1879msec); 0 zone resets clat (msec): min=189, max=1229, avg=560.84, stdev=580.34 lat (msec): min=190, max=1229, avg=561.33, stdev=580.15 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min=11603, max=11603, per=77.13%, avg=11603.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=20.39%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8428KiB/s (8630kB/s), 2188KiB/s-6321KiB/s (2241kB/s-6473kB/s), io=16.0MiB (16.8MB), run=1872-1944msec WRITE: bw=14.7MiB/s (15.4MB/s), 4376KiB/s-6540KiB/s (4481kB/s-6697kB/s), io=32.0MiB (33.6MB), run=1872-2178msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147231: Wed Jul 22 01:35:44 2026 read: IOPS=1, BW=5413KiB/s (5543kB/s)(12.0MiB/2270msec) clat (msec): min=70, max=1207, avg=755.80, stdev=603.63 lat (msec): min=70, max=1207, avg=755.81, stdev=603.63 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 70], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.61%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147232: Wed Jul 22 01:35:44 2026 read: IOPS=0, BW=2014KiB/s (2062kB/s)(4096KiB/2034msec) clat (nsec): min=814914k, max=814914k, avg=814914355.00, stdev= 0.00 lat (nsec): min=814917k, max=814917k, avg=814917079.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4028KiB/s (4124kB/s)(8192KiB/2034msec); 0 zone resets clat (msec): min=296, max=914, avg=605.89, stdev=436.99 lat (msec): min=297, max=915, avg=606.30, stdev=436.90 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8159, max= 8159, per=54.03%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.28%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147233: Wed Jul 22 01:35:44 2026 write: IOPS=1, BW=5663KiB/s (5799kB/s)(12.0MiB/2170msec); 0 zone resets clat (msec): min=321, max=1066, avg=722.27, stdev=375.86 lat (msec): min=321, max=1066, avg=722.64, stdev=375.71 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8126, max= 8159, per=53.92%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.04%, ctx=118, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147234: Wed Jul 22 01:35:44 2026 write: IOPS=1, BW=6430KiB/s (6584kB/s)(12.0MiB/1911msec); 0 zone resets clat (msec): min=287, max=1304, avg=636.27, stdev=578.73 lat (msec): min=288, max=1304, avg=636.62, stdev=578.74 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min=13234, max=13234, per=87.64%, avg=13234.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.45%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7218KiB/s (7391kB/s), 2014KiB/s-5413KiB/s (2062kB/s-5543kB/s), io=16.0MiB (16.8MB), run=2034-2270msec WRITE: bw=14.7MiB/s (15.5MB/s), 4028KiB/s-6430KiB/s (4124kB/s-6584kB/s), io=32.0MiB (33.6MB), run=1911-2170msec