== sanity test 398b: DIO and buffer IO race ============== 02:33:52 (1761287632) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.34142 s, 9.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191305: Fri Oct 24 02:35:47 2025 read: IOPS=15, BW=60.7KiB/s (62.1kB/s)(5992KiB/98757msec) clat (usec): min=116, max=695459, avg=35891.02, stdev=27940.46 lat (usec): min=116, max=695460, avg=35892.73, stdev=27940.24 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 502], 10.00th=[ 13698], 20.00th=[ 18482], | 30.00th=[ 22414], 40.00th=[ 26608], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 50594], 90.00th=[ 63701], 95.00th=[ 76022], | 99.00th=[106431], 99.50th=[141558], 99.90th=[191890], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 158, per=25.26%, avg=60.61, stdev=19.53, samples=194 iops : min= 3, max= 39, avg=14.54, stdev= 4.92, samples=194 write: IOPS=15, BW=63.8KiB/s (65.3kB/s)(6296KiB/98757msec); 0 zone resets clat (usec): min=804, max=240939, avg=28478.21, stdev=29300.62 lat (usec): min=805, max=240940, avg=28481.33, stdev=29299.38 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1123], 10.00th=[ 1237], 20.00th=[ 2442], | 30.00th=[ 6194], 40.00th=[ 14091], 50.00th=[ 21890], 60.00th=[ 27919], | 70.00th=[ 36439], 80.00th=[ 49021], 90.00th=[ 66847], 95.00th=[ 83362], | 99.00th=[123208], 99.50th=[154141], 99.90th=[219153], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 23, max= 156, per=25.24%, avg=63.60, stdev=24.70, samples=194 iops : min= 5, max= 39, avg=15.29, stdev= 6.22, samples=194 lat (usec) : 250=2.08%, 500=0.33%, 750=0.10%, 1000=0.29% lat (msec) : 2=9.11%, 4=3.22%, 10=5.92%, 20=14.94%, 50=43.78% lat (msec) : 100=18.36%, 250=1.82%, 750=0.03% cpu : usr=0.09%, sys=6.92%, ctx=6436, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191306: Fri Oct 24 02:35:47 2025 read: IOPS=15, BW=60.2KiB/s (61.6kB/s)(5940KiB/98688msec) clat (usec): min=120, max=704022, avg=36783.52, stdev=28153.97 lat (usec): min=120, max=704025, avg=36785.90, stdev=28154.51 clat percentiles (usec): | 1.00th=[ 149], 5.00th=[ 9634], 10.00th=[ 15008], 20.00th=[ 19268], | 30.00th=[ 22938], 40.00th=[ 27132], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 44303], 80.00th=[ 52167], 90.00th=[ 63701], 95.00th=[ 73925], | 99.00th=[112722], 99.50th=[149947], 99.90th=[179307], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 15, max= 120, per=25.00%, avg=59.99, stdev=19.48, samples=193 iops : min= 3, max= 30, avg=14.39, stdev= 4.90, samples=193 write: IOPS=16, BW=64.3KiB/s (65.9kB/s)(6348KiB/98688msec); 0 zone resets clat (usec): min=851, max=277056, avg=27680.94, stdev=29782.29 lat (usec): min=852, max=277057, avg=27683.67, stdev=29781.18 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1106], 10.00th=[ 1205], 20.00th=[ 2040], | 30.00th=[ 5473], 40.00th=[ 12387], 50.00th=[ 20055], 60.00th=[ 27132], | 70.00th=[ 35390], 80.00th=[ 47973], 90.00th=[ 66323], 95.00th=[ 83362], | 99.00th=[126354], 99.50th=[160433], 99.90th=[250610], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 8, max= 135, per=25.38%, avg=63.96, stdev=23.72, samples=193 iops : min= 2, max= 33, avg=15.38, stdev= 5.97, samples=193 lat (usec) : 250=1.82%, 500=0.16%, 750=0.07%, 1000=0.59% lat (msec) : 2=9.70%, 4=3.65%, 10=5.70%, 20=14.71%, 50=42.81% lat (msec) : 100=19.04%, 250=1.66%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=6.77%, ctx=6418, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191307: Fri Oct 24 02:35:47 2025 read: IOPS=15, BW=60.5KiB/s (61.9kB/s)(6028KiB/99683msec) clat (usec): min=110, max=182673, avg=36589.24, stdev=22970.56 lat (usec): min=111, max=182675, avg=36590.99, stdev=22970.27 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 693], 10.00th=[ 14091], 20.00th=[ 19530], | 30.00th=[ 23462], 40.00th=[ 27919], 50.00th=[ 32637], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 51119], 90.00th=[ 64226], 95.00th=[ 78119], | 99.00th=[117965], 99.50th=[128451], 99.90th=[158335], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 7, max= 143, per=25.06%, avg=60.15, stdev=21.18, samples=195 iops : min= 1, max= 35, avg=14.42, stdev= 5.32, samples=195 write: IOPS=15, BW=62.8KiB/s (64.3kB/s)(6260KiB/99683msec); 0 zone resets clat (usec): min=901, max=740397, avg=28401.42, stdev=34170.09 lat (usec): min=903, max=740399, avg=28403.64, stdev=34170.63 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1106], 10.00th=[ 1188], 20.00th=[ 1909], | 30.00th=[ 5407], 40.00th=[ 13304], 50.00th=[ 21103], 60.00th=[ 28967], | 70.00th=[ 36963], 80.00th=[ 49021], 90.00th=[ 64750], 95.00th=[ 84411], | 99.00th=[125305], 99.50th=[147850], 99.90th=[299893], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 143, per=24.72%, avg=62.29, stdev=23.63, samples=195 iops : min= 1, max= 35, avg=14.96, stdev= 5.95, samples=195 lat (usec) : 250=2.15%, 500=0.29%, 750=0.03%, 1000=0.65% lat (msec) : 2=9.73%, 4=3.03%, 10=5.73%, 20=13.87%, 50=44.47% lat (msec) : 100=17.68%, 250=2.31%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=6.81%, ctx=6451, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191308: Fri Oct 24 02:35:47 2025 read: IOPS=15, BW=61.3KiB/s (62.7kB/s)(6052KiB/98782msec) clat (usec): min=110, max=183136, avg=36307.08, stdev=23126.66 lat (usec): min=111, max=183136, avg=36308.89, stdev=23126.23 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 289], 10.00th=[ 13566], 20.00th=[ 19006], | 30.00th=[ 22938], 40.00th=[ 27132], 50.00th=[ 32113], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 63177], 95.00th=[ 74974], | 99.00th=[120062], 99.50th=[133694], 99.90th=[175113], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 7, max= 133, per=25.51%, avg=61.23, stdev=21.76, samples=194 iops : min= 1, max= 33, avg=14.70, stdev= 5.47, samples=194 write: IOPS=15, BW=63.1KiB/s (64.6kB/s)(6236KiB/98782msec); 0 zone resets clat (usec): min=818, max=727013, avg=28024.15, stdev=33565.23 lat (usec): min=818, max=727015, avg=28029.85, stdev=33564.44 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 2212], | 30.00th=[ 5538], 40.00th=[ 12518], 50.00th=[ 20579], 60.00th=[ 27657], | 70.00th=[ 35914], 80.00th=[ 47973], 90.00th=[ 65274], 95.00th=[ 84411], | 99.00th=[120062], 99.50th=[139461], 99.90th=[225444], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 15, max= 151, per=25.05%, avg=63.12, stdev=21.88, samples=194 iops : min= 3, max= 37, avg=15.18, stdev= 5.47, samples=194 lat (usec) : 250=2.38%, 500=0.46%, 1000=0.46% lat (msec) : 2=9.51%, 4=3.45%, 10=5.96%, 20=13.93%, 50=43.16% lat (msec) : 100=18.59%, 250=2.08%, 750=0.03% cpu : usr=0.11%, sys=6.88%, ctx=6414, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=241KiB/s (247kB/s), 60.2KiB/s-61.3KiB/s (61.6kB/s-62.7kB/s), io=23.4MiB (24.6MB), run=98688-99683msec WRITE: bw=252KiB/s (258kB/s), 62.8KiB/s-64.3KiB/s (64.3kB/s-65.9kB/s), io=24.6MiB (25.7MB), run=98688-99683msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191300: Fri Oct 24 02:36:25 2025 read: IOPS=10, BW=43.4KiB/s (44.5kB/s)(5992KiB/137976msec) clat (msec): min=5, max=787, avg=35.55, stdev=35.61 lat (msec): min=5, max=787, avg=35.55, stdev=35.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 97], | 99.00th=[ 144], 99.50th=[ 182], 99.90th=[ 275], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 127, per=25.27%, avg=43.72, stdev=26.55, samples=266 iops : min= 1, max= 31, avg=10.27, stdev= 6.68, samples=266 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6296KiB/137976msec); 0 zone resets clat (msec): min=11, max=300, avg=53.60, stdev=34.21 lat (msec): min=11, max=300, avg=53.61, stdev=34.21 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 62], 80.00th=[ 79], 90.00th=[ 100], 95.00th=[ 120], | 99.00th=[ 174], 99.50th=[ 205], 99.90th=[ 279], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 119, per=25.15%, avg=45.53, stdev=25.21, samples=269 iops : min= 1, max= 29, avg=10.73, stdev= 6.37, samples=269 lat (msec) : 10=2.57%, 20=18.82%, 50=47.43%, 100=24.06%, 250=6.97% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=2.32%, ctx=4926, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191301: Fri Oct 24 02:36:26 2025 read: IOPS=10, BW=43.0KiB/s (44.1kB/s)(5940KiB/138045msec) clat (msec): min=4, max=799, avg=34.91, stdev=36.16 lat (msec): min=4, max=799, avg=34.91, stdev=36.16 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 97], | 99.00th=[ 148], 99.50th=[ 176], 99.90th=[ 271], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 142, per=25.21%, avg=43.61, stdev=27.34, samples=266 iops : min= 1, max= 35, avg=10.24, stdev= 6.88, samples=266 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6348KiB/138045msec); 0 zone resets clat (msec): min=12, max=259, avg=54.11, stdev=34.78 lat (msec): min=12, max=259, avg=54.11, stdev=34.78 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 99], 95.00th=[ 124], | 99.00th=[ 178], 99.50th=[ 207], 99.90th=[ 251], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 7, max= 134, per=25.38%, avg=45.94, stdev=24.89, samples=270 iops : min= 1, max= 33, avg=10.83, stdev= 6.29, samples=270 lat (msec) : 10=2.64%, 20=19.73%, 50=47.69%, 100=22.79%, 250=7.06% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=2.45%, ctx=4925, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191302: Fri Oct 24 02:36:26 2025 read: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6028KiB/138520msec) clat (msec): min=5, max=301, avg=35.40, stdev=31.48 lat (msec): min=5, max=301, avg=35.40, stdev=31.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 157], 99.50th=[ 182], 99.90th=[ 259], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 150, per=25.12%, avg=43.46, stdev=26.58, samples=271 iops : min= 1, max= 37, avg=10.21, stdev= 6.71, samples=271 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6260KiB/138520msec); 0 zone resets clat (msec): min=8, max=826, avg=54.20, stdev=40.31 lat (msec): min=8, max=826, avg=54.20, stdev=40.31 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 78], 90.00th=[ 102], 95.00th=[ 122], | 99.00th=[ 171], 99.50th=[ 213], 99.90th=[ 388], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 151, per=24.84%, avg=44.96, stdev=25.91, samples=272 iops : min= 1, max= 37, avg=10.58, stdev= 6.53, samples=272 lat (msec) : 10=2.34%, 20=18.98%, 50=48.63%, 100=22.23%, 250=7.62% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=2.34%, ctx=4917, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191303: Fri Oct 24 02:36:26 2025 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6052KiB/137455msec) clat (msec): min=4, max=298, avg=34.56, stdev=30.40 lat (msec): min=4, max=298, avg=34.57, stdev=30.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 144], 99.50th=[ 180], 99.90th=[ 236], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 150, per=25.71%, avg=44.49, stdev=27.88, samples=265 iops : min= 1, max= 37, avg=10.46, stdev= 7.03, samples=265 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6236KiB/137455msec); 0 zone resets clat (msec): min=9, max=825, avg=54.40, stdev=41.33 lat (msec): min=9, max=825, avg=54.41, stdev=41.33 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 78], 90.00th=[ 102], 95.00th=[ 124], | 99.00th=[ 190], 99.50th=[ 243], 99.90th=[ 388], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 119, per=24.98%, avg=45.21, stdev=25.15, samples=268 iops : min= 1, max= 29, avg=10.65, stdev= 6.35, samples=268 lat (msec) : 10=2.99%, 20=18.98%, 50=48.14%, 100=22.04%, 250=7.65% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=2.34%, ctx=4889, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=173KiB/s (178kB/s), 43.0KiB/s-44.0KiB/s (44.1kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=137455-138520msec WRITE: bw=181KiB/s (186kB/s), 45.2KiB/s-45.0KiB/s (46.3kB/s-47.1kB/s), io=24.6MiB (25.7MB), run=137455-138520msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191344: Fri Oct 24 02:37:03 2025 read: IOPS=13, BW=211KiB/s (216kB/s)(5920KiB/28122msec) clat (usec): min=109, max=142390, avg=39026.86, stdev=24842.08 lat (usec): min=109, max=142392, avg=39028.07, stdev=24842.11 clat percentiles (usec): | 1.00th=[ 125], 5.00th=[ 163], 10.00th=[ 2540], 20.00th=[ 19268], | 30.00th=[ 24511], 40.00th=[ 32375], 50.00th=[ 36963], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 55837], 90.00th=[ 67634], 95.00th=[ 86508], | 99.00th=[114820], 99.50th=[124257], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 60, max= 381, per=24.51%, avg=208.62, stdev=79.28, samples=55 iops : min= 3, max= 23, avg=12.29, stdev= 5.04, samples=55 write: IOPS=14, BW=226KiB/s (232kB/s)(6368KiB/28122msec); 0 zone resets clat (usec): min=1264, max=234668, avg=33558.24, stdev=33750.47 lat (usec): min=1267, max=234670, avg=33576.43, stdev=33755.96 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1680], 10.00th=[ 1909], 20.00th=[ 3884], | 30.00th=[ 8291], 40.00th=[ 14746], 50.00th=[ 24511], 60.00th=[ 33424], | 70.00th=[ 43254], 80.00th=[ 58983], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[135267], 99.50th=[173016], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 92, max= 447, per=25.69%, avg=230.15, stdev=82.70, samples=54 iops : min= 5, max= 27, avg=13.65, stdev= 5.21, samples=54 lat (usec) : 250=4.04%, 500=0.52% lat (msec) : 2=5.34%, 4=5.60%, 10=6.25%, 20=11.98%, 50=39.06% lat (msec) : 100=23.18%, 250=4.04% cpu : usr=0.11%, sys=7.27%, ctx=1677, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191345: Fri Oct 24 02:37:03 2025 read: IOPS=13, BW=211KiB/s (216kB/s)(5744KiB/27219msec) clat (usec): min=126, max=161076, avg=39472.79, stdev=25848.71 lat (usec): min=127, max=161077, avg=39477.22, stdev=25846.67 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 174], 10.00th=[ 8979], 20.00th=[ 19792], | 30.00th=[ 25560], 40.00th=[ 31065], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 57934], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[128451], 99.50th=[135267], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 30, max= 404, per=24.67%, avg=209.91, stdev=65.70, samples=53 iops : min= 1, max= 25, avg=12.38, stdev= 4.15, samples=53 write: IOPS=15, BW=240KiB/s (246kB/s)(6544KiB/27219msec); 0 zone resets clat (usec): min=1376, max=181499, avg=30979.82, stdev=29381.36 lat (usec): min=1377, max=181501, avg=30990.91, stdev=29385.40 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1663], 10.00th=[ 1926], 20.00th=[ 4948], | 30.00th=[ 9110], 40.00th=[ 16909], 50.00th=[ 23987], 60.00th=[ 30802], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[120062], 99.50th=[127402], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 405, per=26.67%, avg=238.92, stdev=90.83, samples=53 iops : min= 3, max= 25, avg=14.21, stdev= 5.75, samples=53 lat (usec) : 250=3.52%, 500=0.65%, 750=0.13% lat (msec) : 2=5.34%, 4=3.91%, 10=8.59%, 20=11.72%, 50=41.02% lat (msec) : 100=22.14%, 250=2.99% cpu : usr=0.10%, sys=7.72%, ctx=1752, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191346: Fri Oct 24 02:37:03 2025 read: IOPS=14, BW=228KiB/s (233kB/s)(6256KiB/27495msec) clat (usec): min=111, max=177059, avg=41376.50, stdev=29500.82 lat (usec): min=111, max=177060, avg=41377.75, stdev=29500.73 clat percentiles (usec): | 1.00th=[ 131], 5.00th=[ 188], 10.00th=[ 2057], 20.00th=[ 20055], | 30.00th=[ 25297], 40.00th=[ 30016], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 73925], 95.00th=[ 98042], | 99.00th=[154141], 99.50th=[158335], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 63, max= 436, per=26.73%, avg=227.48, stdev=77.13, samples=54 iops : min= 3, max= 27, avg=13.48, stdev= 4.83, samples=54 write: IOPS=13, BW=219KiB/s (225kB/s)(6032KiB/27495msec); 0 zone resets clat (usec): min=1398, max=200604, avg=29829.45, stdev=30300.59 lat (usec): min=1399, max=200606, avg=29836.98, stdev=30296.46 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1647], 10.00th=[ 1745], 20.00th=[ 4228], | 30.00th=[ 8455], 40.00th=[ 15008], 50.00th=[ 20841], 60.00th=[ 29492], | 70.00th=[ 38536], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 91751], | 99.00th=[147850], 99.50th=[170918], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 91, max= 404, per=24.41%, avg=218.70, stdev=89.34, samples=54 iops : min= 5, max= 25, avg=12.94, stdev= 5.69, samples=54 lat (usec) : 250=4.04%, 500=0.52%, 750=0.13%, 1000=0.26% lat (msec) : 2=6.77%, 4=3.39%, 10=6.64%, 20=11.72%, 50=41.02% lat (msec) : 100=21.61%, 250=3.91% cpu : usr=0.09%, sys=7.16%, ctx=1725, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191347: Fri Oct 24 02:37:03 2025 read: IOPS=13, BW=222KiB/s (228kB/s)(6032KiB/27132msec) clat (usec): min=130, max=146018, avg=38288.14, stdev=25877.70 lat (usec): min=130, max=146018, avg=38312.62, stdev=25883.81 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 169], 10.00th=[ 212], 20.00th=[ 20579], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[115868], 99.50th=[132645], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 63, max= 436, per=25.95%, avg=220.87, stdev=73.71, samples=53 iops : min= 3, max= 27, avg=13.09, stdev= 4.72, samples=53 write: IOPS=14, BW=231KiB/s (236kB/s)(6256KiB/27132msec); 0 zone resets clat (usec): min=1132, max=260486, avg=31946.45, stdev=32288.07 lat (usec): min=1133, max=260488, avg=31957.16, stdev=32280.60 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1680], 10.00th=[ 1778], 20.00th=[ 4178], | 30.00th=[ 9896], 40.00th=[ 17171], 50.00th=[ 24249], 60.00th=[ 31589], | 70.00th=[ 39584], 80.00th=[ 52167], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[147850], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 61, max= 413, per=25.73%, avg=230.53, stdev=78.55, samples=53 iops : min= 3, max= 25, avg=13.68, stdev= 4.93, samples=53 lat (usec) : 250=5.08%, 500=0.78%, 750=0.39%, 1000=0.13% lat (msec) : 2=7.03%, 4=2.99%, 10=5.86%, 20=10.03%, 50=42.45% lat (msec) : 100=21.74%, 250=3.39%, 500=0.13% cpu : usr=0.05%, sys=7.55%, ctx=1683, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=852KiB/s (872kB/s), 211KiB/s-228KiB/s (216kB/s-233kB/s), io=23.4MiB (24.5MB), run=27132-28122msec WRITE: bw=896KiB/s (918kB/s), 219KiB/s-240KiB/s (225kB/s-246kB/s), io=24.6MiB (25.8MB), run=27132-28122msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191348: Fri Oct 24 02:37:13 2025 read: IOPS=9, BW=159KiB/s (163kB/s)(5920KiB/37151msec) clat (msec): min=5, max=222, avg=37.52, stdev=36.55 lat (msec): min=5, max=222, avg=37.52, stdev=36.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 85], 95.00th=[ 122], | 99.00th=[ 192], 99.50th=[ 205], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 415, per=24.34%, avg=155.04, stdev=97.63, samples=72 iops : min= 1, max= 25, avg= 8.85, stdev= 6.15, samples=72 write: IOPS=10, BW=171KiB/s (176kB/s)(6368KiB/37151msec); 0 zone resets clat (msec): min=11, max=238, avg=57.93, stdev=40.65 lat (msec): min=11, max=238, avg=57.94, stdev=40.65 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 53], | 70.00th=[ 70], 80.00th=[ 90], 90.00th=[ 120], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 232], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 22, max= 444, per=25.25%, avg=169.18, stdev=108.56, samples=72 iops : min= 1, max= 27, avg= 9.75, stdev= 6.83, samples=72 lat (msec) : 10=2.73%, 20=19.14%, 50=46.61%, 100=20.31%, 250=11.20% cpu : usr=0.05%, sys=2.33%, ctx=1210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191349: Fri Oct 24 02:37:13 2025 read: IOPS=9, BW=153KiB/s (157kB/s)(5744KiB/37568msec) clat (msec): min=6, max=250, avg=37.05, stdev=35.20 lat (msec): min=6, max=250, avg=37.05, stdev=35.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 84], 95.00th=[ 116], | 99.00th=[ 190], 99.50th=[ 226], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 22, max= 448, per=24.56%, avg=156.42, stdev=104.74, samples=71 iops : min= 1, max= 28, avg= 8.94, stdev= 6.60, samples=71 write: IOPS=10, BW=174KiB/s (178kB/s)(6544KiB/37568msec); 0 zone resets clat (msec): min=11, max=225, avg=58.55, stdev=38.82 lat (msec): min=11, max=225, avg=58.55, stdev=38.82 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 113], 95.00th=[ 146], | 99.00th=[ 197], 99.50th=[ 203], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 44, max= 416, per=26.02%, avg=174.35, stdev=97.08, samples=72 iops : min= 2, max= 26, avg=10.07, stdev= 6.12, samples=72 lat (msec) : 10=1.69%, 20=18.88%, 50=46.35%, 100=23.18%, 250=9.77% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.24%, ctx=1226, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191350: Fri Oct 24 02:37:13 2025 read: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36849msec) clat (msec): min=6, max=250, avg=36.98, stdev=35.48 lat (msec): min=6, max=250, avg=36.98, stdev=35.48 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 77], 95.00th=[ 121], | 99.00th=[ 169], 99.50th=[ 226], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 30, max= 537, per=26.76%, avg=170.43, stdev=120.87, samples=72 iops : min= 1, max= 33, avg= 9.82, stdev= 7.61, samples=72 write: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36849msec); 0 zone resets clat (msec): min=10, max=333, avg=59.08, stdev=43.44 lat (msec): min=10, max=333, avg=59.08, stdev=43.44 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 89], 90.00th=[ 118], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 309], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 414, per=24.13%, avg=161.64, stdev=100.02, samples=72 iops : min= 1, max= 25, avg= 9.28, stdev= 6.28, samples=72 lat (msec) : 10=2.73%, 20=19.66%, 50=46.09%, 100=20.57%, 250=10.55% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.25%, ctx=1235, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191351: Fri Oct 24 02:37:13 2025 read: IOPS=10, BW=162KiB/s (166kB/s)(6032KiB/37213msec) clat (msec): min=6, max=248, avg=38.70, stdev=37.83 lat (msec): min=6, max=248, avg=38.71, stdev=37.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 57], 90.00th=[ 94], 95.00th=[ 121], | 99.00th=[ 180], 99.50th=[ 190], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 22, max= 447, per=25.69%, avg=163.62, stdev=108.27, samples=72 iops : min= 1, max= 27, avg= 9.39, stdev= 6.79, samples=72 write: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37213msec); 0 zone resets clat (msec): min=9, max=336, avg=57.38, stdev=43.73 lat (msec): min=9, max=336, avg=57.39, stdev=43.72 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 117], 95.00th=[ 142], | 99.00th=[ 209], 99.50th=[ 300], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 416, per=25.16%, avg=168.56, stdev=113.90, samples=73 iops : min= 1, max= 26, avg= 9.71, stdev= 7.18, samples=73 lat (msec) : 10=3.12%, 20=22.14%, 50=42.32%, 100=20.83%, 250=11.33% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.09%, ctx=1211, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=638KiB/s (653kB/s), 153KiB/s-170KiB/s (157kB/s-174kB/s), io=23.4MiB (24.5MB), run=36849-37568msec WRITE: bw=671KiB/s (687kB/s), 164KiB/s-174KiB/s (168kB/s-178kB/s), io=24.6MiB (25.8MB), run=36849-37568msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191368: Fri Oct 24 02:37:27 2025 read: IOPS=2, BW=2330KiB/s (2386kB/s)(7168KiB/3076msec) clat (usec): min=939, max=502366, avg=204489.34, stdev=175638.13 lat (usec): min=939, max=502367, avg=204490.49, stdev=175638.02 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 938], 10.00th=[ 938], 20.00th=[ 7373], | 30.00th=[173016], 40.00th=[173016], 50.00th=[173016], 60.00th=[287310], | 70.00th=[287310], 80.00th=[287310], 90.00th=[501220], 95.00th=[501220], | 99.00th=[501220], 99.50th=[501220], 99.90th=[501220], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 2000, max= 4000, per=63.59%, avg=2852.75, stdev=994.07, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1664KiB/s (1704kB/s)(5120KiB/3076msec); 0 zone resets clat (msec): min=138, max=562, avg=328.53, stdev=191.36 lat (msec): min=138, max=562, avg=328.59, stdev=191.36 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1961, max= 2043, per=31.86%, avg=2001.00, stdev=33.50, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 10=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=17.04%, ctx=258, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191369: Fri Oct 24 02:37:27 2025 read: IOPS=0, BW=449KiB/s (459kB/s)(2048KiB/4565msec) clat (msec): min=363, max=584, avg=473.98, stdev=156.21 lat (msec): min=363, max=584, avg=473.98, stdev=156.21 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2000, max= 2043, per=45.06%, avg=2021.50, stdev=30.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2243KiB/s (2297kB/s)(10.0MiB/4565msec); 0 zone resets clat (msec): min=187, max=747, avg=361.07, stdev=166.90 lat (msec): min=187, max=747, avg=361.17, stdev=166.88 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 190], | 30.00th=[ 218], 40.00th=[ 313], 50.00th=[ 321], 60.00th=[ 355], | 70.00th=[ 384], 80.00th=[ 422], 90.00th=[ 477], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1928, max= 4000, per=50.62%, avg=3178.80, stdev=1090.54, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 750=16.67% cpu : usr=0.02%, sys=14.68%, ctx=180, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191370: Fri Oct 24 02:37:27 2025 read: IOPS=1, BW=1849KiB/s (1894kB/s)(6144KiB/3322msec) clat (usec): min=1024, max=269576, avg=171421.41, stdev=99561.31 lat (usec): min=1025, max=269577, avg=171422.55, stdev=99561.07 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1029], 10.00th=[ 1029], 20.00th=[120062], | 30.00th=[120062], 40.00th=[166724], 50.00th=[166724], 60.00th=[229639], | 70.00th=[242222], 80.00th=[242222], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1961, max= 4000, per=55.75%, avg=2501.00, stdev=999.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1849KiB/s (1894kB/s)(6144KiB/3322msec); 0 zone resets clat (msec): min=236, max=656, avg=382.04, stdev=170.90 lat (msec): min=237, max=656, avg=382.10, stdev=170.87 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 359], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1961, max= 3407, per=36.48%, avg=2290.80, stdev=624.91, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=15.93%, ctx=109, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191371: Fri Oct 24 02:37:27 2025 read: IOPS=1, BW=1325KiB/s (1357kB/s)(5120KiB/3863msec) clat (usec): min=552, max=255776, avg=101554.45, stdev=106905.37 lat (usec): min=553, max=255776, avg=101555.29, stdev=106905.21 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 570], 40.00th=[ 570], 50.00th=[111674], 60.00th=[111674], | 70.00th=[139461], 80.00th=[139461], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 4000, max= 4087, per=90.14%, avg=4043.50, stdev=61.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1856KiB/s (1900kB/s)(7168KiB/3863msec); 0 zone resets clat (msec): min=184, max=920, avg=477.59, stdev=285.45 lat (msec): min=184, max=920, avg=477.67, stdev=285.44 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 199], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 456], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 676], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 2000, max= 4087, per=48.12%, avg=3021.75, stdev=1180.35, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=12.82%, ctx=211, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4486KiB/s (4594kB/s), 449KiB/s-2330KiB/s (459kB/s-2386kB/s), io=20.0MiB (20.0MB), run=3076-4565msec WRITE: bw=6281KiB/s (6432kB/s), 1664KiB/s-2243KiB/s (1704kB/s-2297kB/s), io=28.0MiB (29.4MB), run=3076-4565msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191363: Fri Oct 24 02:37:27 2025 read: IOPS=1, BW=1763KiB/s (1805kB/s)(7168KiB/4066msec) clat (msec): min=90, max=708, avg=234.31, stdev=215.62 lat (msec): min=90, max=708, avg=234.31, stdev=215.62 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 100], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 182], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 243], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2023, max= 5647, per=99.91%, avg=3892.33, stdev=1814.72, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1259KiB/s (1289kB/s)(5120KiB/4066msec); 0 zone resets clat (msec): min=337, max=725, avg=459.36, stdev=162.86 lat (msec): min=337, max=725, avg=459.44, stdev=162.85 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2011, max= 2048, per=37.14%, avg=2026.25, stdev=15.56, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=5.34%, ctx=100, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191364: Fri Oct 24 02:37:27 2025 read: IOPS=0, BW=436KiB/s (446kB/s)(2048KiB/4702msec) clat (msec): min=130, max=212, avg=171.56, stdev=58.18 lat (msec): min=130, max=212, avg=171.56, stdev=58.17 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 213], 95.00th=[ 213], | 99.00th=[ 213], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 1988, max= 2023, per=51.48%, avg=2005.50, stdev=24.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2178KiB/s (2230kB/s)(10.0MiB/4702msec); 0 zone resets clat (msec): min=116, max=1081, avg=429.35, stdev=264.90 lat (msec): min=116, max=1081, avg=429.44, stdev=264.91 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 215], | 30.00th=[ 288], 40.00th=[ 313], 50.00th=[ 347], 60.00th=[ 409], | 70.00th=[ 485], 80.00th=[ 489], 90.00th=[ 550], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1988, max= 4015, per=47.23%, avg=2576.29, stdev=956.96, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.72%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191365: Fri Oct 24 02:37:27 2025 read: IOPS=1, BW=1169KiB/s (1197kB/s)(6144KiB/5256msec) clat (msec): min=183, max=786, avg=381.52, stdev=243.70 lat (msec): min=183, max=786, avg=381.52, stdev=243.70 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 317], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2011, max= 3938, per=64.30%, avg=2505.00, stdev=955.46, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1169KiB/s (1197kB/s)(6144KiB/5256msec); 0 zone resets clat (msec): min=119, max=1106, avg=492.27, stdev=418.46 lat (msec): min=119, max=1106, avg=492.36, stdev=418.45 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 502], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1969, max= 3856, per=43.57%, avg=2376.60, stdev=827.48, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=8.33%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.36%, ctx=67, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191366: Fri Oct 24 02:37:27 2025 read: IOPS=1, BW=1294KiB/s (1325kB/s)(5120KiB/3958msec) clat (msec): min=88, max=851, avg=289.26, stdev=323.86 lat (msec): min=88, max=851, avg=289.26, stdev=323.86 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 116], 60.00th=[ 116], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 4007, max= 4023, per=100.00%, avg=4015.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1811KiB/s (1854kB/s)(7168KiB/3958msec); 0 zone resets clat (msec): min=102, max=614, avg=344.76, stdev=218.35 lat (msec): min=102, max=614, avg=344.85, stdev=218.35 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 117], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 264], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 592], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2000, max= 4096, per=46.39%, avg=2530.50, stdev=1043.72, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.13%, ctx=55, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3896KiB/s (3990kB/s), 436KiB/s-1763KiB/s (446kB/s-1805kB/s), io=20.0MiB (20.0MB), run=3958-5256msec WRITE: bw=5455KiB/s (5586kB/s), 1169KiB/s-2178KiB/s (1197kB/s-2230kB/s), io=28.0MiB (29.4MB), run=3958-5256msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191378: Fri Oct 24 02:37:46 2025 read: IOPS=0, BW=1765KiB/s (1807kB/s)(12.0MiB/6964msec) clat (msec): min=1117, max=4642, avg=2318.49, stdev=2013.32 lat (msec): min=1117, max=4642, avg=2318.49, stdev=2013.32 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 7953, max= 8175, per=100.00%, avg=8064.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.08%, ctx=683, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191379: Fri Oct 24 02:37:46 2025 read: IOPS=0, BW=478KiB/s (490kB/s)(4096KiB/8566msec) clat (nsec): min=4685.3M, max=4685.3M, avg=4685316418.00, stdev= 0.00 lat (nsec): min=4685.3M, max=4685.3M, avg=4685318628.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4665], 5.00th=[ 4665], 10.00th=[ 4665], 20.00th=[ 4665], | 30.00th=[ 4665], 40.00th=[ 4665], 50.00th=[ 4665], 60.00th=[ 4665], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=956KiB/s (979kB/s)(8192KiB/8566msec); 0 zone resets clat (msec): min=1659, max=2116, avg=1888.00, stdev=322.72 lat (msec): min=1660, max=2117, avg=1889.02, stdev=323.68 clat percentiles (msec): | 1.00th=[ 1653], 5.00th=[ 1653], 10.00th=[ 1653], 20.00th=[ 1653], | 30.00th=[ 1653], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 2123], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.06%, sys=2.64%, ctx=480, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191380: Fri Oct 24 02:37:46 2025 write: IOPS=0, BW=1634KiB/s (1673kB/s)(12.0MiB/7521msec); 0 zone resets clat (msec): min=1233, max=4831, avg=2480.09, stdev=2037.75 lat (msec): min=1233, max=4832, avg=2480.40, stdev=2037.79 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 4799], 80.00th=[ 4799], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 7953, max= 8175, per=100.00%, avg=8064.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.69%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191381: Fri Oct 24 02:37:46 2025 write: IOPS=0, BW=1675KiB/s (1715kB/s)(12.0MiB/7335msec); 0 zone resets clat (msec): min=358, max=6588, avg=2435.49, stdev=3596.39 lat (msec): min=358, max=6588, avg=2436.02, stdev=3596.31 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 6611], 80.00th=[ 6611], 90.00th=[ 6611], 95.00th=[ 6611], | 99.00th=[ 6611], 99.50th=[ 6611], 99.90th=[ 6611], 99.95th=[ 6611], | 99.99th=[ 6611] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=0.98%, ctx=32, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1913KiB/s (1959kB/s), 478KiB/s-1765KiB/s (490kB/s-1807kB/s), io=16.0MiB (16.8MB), run=6964-8566msec WRITE: bw=3825KiB/s (3917kB/s), 956KiB/s-1675KiB/s (979kB/s-1715kB/s), io=32.0MiB (33.6MB), run=7335-8566msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191383: Fri Oct 24 02:37:47 2025 read: IOPS=0, BW=1530KiB/s (1567kB/s)(12.0MiB/8032msec) clat (msec): min=674, max=5801, avg=2674.72, stdev=2743.13 lat (msec): min=674, max=5801, avg=2674.72, stdev=2743.14 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 5805], 80.00th=[ 5805], 90.00th=[ 5805], 95.00th=[ 5805], | 99.00th=[ 5805], 99.50th=[ 5805], 99.90th=[ 5805], 99.95th=[ 5805], | 99.99th=[ 5805] bw ( KiB/s): min= 7757, max= 8047, per=100.00%, avg=7902.00, stdev=205.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.01%, sys=1.71%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191384: Fri Oct 24 02:37:47 2025 read: IOPS=0, BW=506KiB/s (518kB/s)(4096KiB/8093msec) clat (nsec): min=6118.3M, max=6118.3M, avg=6118263763.00, stdev= 0.00 lat (nsec): min=6118.3M, max=6118.3M, avg=6118265808.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 6141], 5.00th=[ 6141], 10.00th=[ 6141], 20.00th=[ 6141], | 30.00th=[ 6141], 40.00th=[ 6141], 50.00th=[ 6141], 60.00th=[ 6141], | 70.00th=[ 6141], 80.00th=[ 6141], 90.00th=[ 6141], 95.00th=[ 6141], | 99.00th=[ 6141], 99.50th=[ 6141], 99.90th=[ 6141], 99.95th=[ 6141], | 99.99th=[ 6141] bw ( KiB/s): min= 7670, max= 7670, per=100.00%, avg=7670.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1012KiB/s (1037kB/s)(8192KiB/8093msec); 0 zone resets clat (msec): min=839, max=1133, avg=986.47, stdev=208.33 lat (msec): min=839, max=1134, avg=986.83, stdev=208.29 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.35%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191385: Fri Oct 24 02:37:47 2025 write: IOPS=0, BW=1600KiB/s (1638kB/s)(12.0MiB/7682msec); 0 zone resets clat (msec): min=971, max=4864, avg=2559.91, stdev=2043.15 lat (msec): min=971, max=4864, avg=2560.18, stdev=2043.12 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 7801, max= 7846, per=100.00%, avg=7823.50, stdev=31.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=1.50%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191386: Fri Oct 24 02:37:47 2025 write: IOPS=0, BW=1715KiB/s (1756kB/s)(12.0MiB/7165msec); 0 zone resets clat (msec): min=1190, max=4588, avg=2365.88, stdev=1925.73 lat (msec): min=1190, max=4590, avg=2366.97, stdev=1927.02 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 4597], 80.00th=[ 4597], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 7670, max= 7876, per=100.00%, avg=7773.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.10%, sys=2.36%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2024KiB/s (2073kB/s), 506KiB/s-1530KiB/s (518kB/s-1567kB/s), io=16.0MiB (16.8MB), run=8032-8093msec WRITE: bw=4049KiB/s (4146kB/s), 1012KiB/s-1715KiB/s (1037kB/s-1756kB/s), io=32.0MiB (33.6MB), run=7165-8093msec