== sanity test 398b: DIO and buffer IO race ============== 00:41:00 (1786423260) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.40187 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=142946: Tue Aug 11 00:45:12 2026 read: IOPS=6, BW=26.0KiB/s (26.6kB/s)(5992KiB/230404msec) clat (usec): min=35, max=904156, avg=75346.55, stdev=57611.73 lat (usec): min=35, max=904158, avg=75352.17, stdev=57614.30 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 139], 20.00th=[ 34866], | 30.00th=[ 44827], 40.00th=[ 54789], 50.00th=[ 65799], 60.00th=[ 78119], | 70.00th=[ 94897], 80.00th=[113771], 90.00th=[143655], 95.00th=[168821], | 99.00th=[250610], 99.50th=[283116], 99.90th=[471860], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 6, max= 77, per=25.77%, avg=26.55, stdev=13.72, samples=430 iops : min= 1, max= 19, avg= 5.97, stdev= 3.48, samples=430 write: IOPS=6, BW=27.3KiB/s (27.0kB/s)(6296KiB/230404msec); 0 zone resets clat (usec): min=1280, max=633606, avg=74363.64, stdev=75198.29 lat (usec): min=1282, max=633607, avg=74382.60, stdev=75192.89 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 2999], 10.00th=[ 5473], 20.00th=[ 10159], | 30.00th=[ 18482], 40.00th=[ 37487], 50.00th=[ 55313], 60.00th=[ 74974], | 70.00th=[ 96994], 80.00th=[124257], 90.00th=[170918], 95.00th=[214959], | 99.00th=[333448], 99.50th=[383779], 99.90th=[608175], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 79, per=25.27%, avg=27.29, stdev=13.94, samples=441 iops : min= 1, max= 19, avg= 6.15, stdev= 3.51, samples=441 lat (usec) : 50=0.42%, 100=4.26%, 250=0.33%, 500=0.20%, 1000=0.03% lat (msec) : 2=1.69%, 4=2.12%, 10=6.48%, 20=6.67%, 50=19.47% lat (msec) : 100=30.57%, 250=25.78%, 500=1.86%, 750=0.10%, 1000=0.03% cpu : usr=0.06%, sys=3.08%, ctx=7059, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142947: Tue Aug 11 00:45:12 2026 read: IOPS=6, BW=25.8KiB/s (26.4kB/s)(5940KiB/230015msec) clat (usec): min=32, max=724742, avg=75707.47, stdev=56537.52 lat (usec): min=32, max=724743, avg=75723.69, stdev=56540.53 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 889], 20.00th=[ 36963], | 30.00th=[ 47449], 40.00th=[ 55837], 50.00th=[ 65274], 60.00th=[ 77071], | 70.00th=[ 92799], 80.00th=[113771], 90.00th=[141558], 95.00th=[166724], | 99.00th=[263193], 99.50th=[316670], 99.90th=[488637], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 95, per=25.21%, avg=25.97, stdev=13.97, samples=438 iops : min= 1, max= 23, avg= 5.82, stdev= 3.52, samples=438 write: IOPS=6, BW=27.6KiB/s (28.3kB/s)(6348KiB/230015msec); 0 zone resets clat (usec): min=1192, max=673191, avg=73847.04, stdev=72189.86 lat (usec): min=1193, max=673191, avg=73853.84, stdev=72188.29 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2966], 10.00th=[ 5080], 20.00th=[ 10552], | 30.00th=[ 18220], 40.00th=[ 38536], 50.00th=[ 57410], 60.00th=[ 77071], | 70.00th=[ 98042], 80.00th=[123208], 90.00th=[166724], 95.00th=[210764], | 99.00th=[325059], 99.50th=[367002], 99.90th=[455082], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 79, per=25.63%, avg=27.68, stdev=13.41, samples=440 iops : min= 1, max= 19, avg= 6.24, stdev= 3.39, samples=440 lat (usec) : 50=0.26%, 100=4.17%, 250=0.26%, 500=0.07%, 1000=0.13% lat (msec) : 2=1.92%, 4=2.31%, 10=5.89%, 20=6.90%, 50=17.94% lat (msec) : 100=32.55%, 250=25.59%, 500=1.95%, 750=0.07% cpu : usr=0.05%, sys=3.11%, ctx=7106, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142948: Tue Aug 11 00:45:12 2026 read: IOPS=6, BW=26.0KiB/s (26.7kB/s)(6028KiB/231520msec) clat (usec): min=32, max=480899, avg=74854.06, stdev=53921.71 lat (usec): min=32, max=480901, avg=74857.72, stdev=53922.47 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 1385], 20.00th=[ 34866], | 30.00th=[ 45351], 40.00th=[ 55313], 50.00th=[ 65274], 60.00th=[ 77071], | 70.00th=[ 92799], 80.00th=[111674], 90.00th=[143655], 95.00th=[170918], | 99.00th=[231736], 99.50th=[312476], 99.90th=[429917], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 79, per=25.70%, avg=26.47, stdev=14.07, samples=435 iops : min= 1, max= 19, avg= 5.95, stdev= 3.55, samples=435 write: IOPS=6, BW=27.0KiB/s (27.7kB/s)(6260KiB/231520msec); 0 zone resets clat (usec): min=1230, max=890949, avg=75580.37, stdev=79420.87 lat (usec): min=1232, max=890952, avg=75586.92, stdev=79424.02 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2868], 10.00th=[ 6063], 20.00th=[ 11338], | 30.00th=[ 19530], 40.00th=[ 38536], 50.00th=[ 56886], 60.00th=[ 74974], | 70.00th=[ 96994], 80.00th=[124257], 90.00th=[170918], 95.00th=[217056], | 99.00th=[341836], 99.50th=[408945], 99.90th=[859833], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 6, max= 80, per=25.18%, avg=27.19, stdev=14.06, samples=439 iops : min= 1, max= 20, avg= 6.12, stdev= 3.55, samples=439 lat (usec) : 50=0.36%, 100=3.65%, 250=0.26%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=1.73%, 4=1.82%, 10=5.89%, 20=6.87%, 50=19.47% lat (msec) : 100=32.98%, 250=24.45%, 500=1.95%, 750=0.03%, 1000=0.07% cpu : usr=0.05%, sys=2.98%, ctx=6968, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142949: Tue Aug 11 00:45:12 2026 read: IOPS=6, BW=26.3KiB/s (26.0kB/s)(6052KiB/229884msec) clat (usec): min=34, max=477551, avg=74988.44, stdev=54446.60 lat (usec): min=34, max=477552, avg=74994.44, stdev=54445.49 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 65], 10.00th=[ 90], 20.00th=[ 35390], | 30.00th=[ 45876], 40.00th=[ 55837], 50.00th=[ 65274], 60.00th=[ 79168], | 70.00th=[ 94897], 80.00th=[114820], 90.00th=[141558], 95.00th=[166724], | 99.00th=[252707], 99.50th=[283116], 99.90th=[362808], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 71, per=26.05%, avg=26.83, stdev=13.12, samples=433 iops : min= 1, max= 17, avg= 6.03, stdev= 3.30, samples=433 write: IOPS=6, BW=27.1KiB/s (27.8kB/s)(6236KiB/229884msec); 0 zone resets clat (usec): min=1223, max=814885, avg=74357.40, stdev=74071.34 lat (usec): min=1224, max=814889, avg=74371.97, stdev=74074.09 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 2671], 10.00th=[ 4948], 20.00th=[ 10159], | 30.00th=[ 20055], 40.00th=[ 38536], 50.00th=[ 56886], 60.00th=[ 73925], | 70.00th=[ 95945], 80.00th=[126354], 90.00th=[170918], 95.00th=[210764], | 99.00th=[316670], 99.50th=[367002], 99.90th=[557843], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 6, max= 79, per=25.25%, avg=27.27, stdev=14.19, samples=439 iops : min= 1, max= 19, avg= 6.15, stdev= 3.60, samples=439 lat (usec) : 50=0.68%, 100=4.46%, 250=0.29%, 500=0.07%, 750=0.20% lat (usec) : 1000=0.07% lat (msec) : 2=2.08%, 4=2.44%, 10=5.66%, 20=5.63%, 50=18.29% lat (msec) : 100=32.32%, 250=25.98%, 500=1.73%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=3.05%, ctx=7028, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=104KiB/s (106kB/s), 25.8KiB/s-26.3KiB/s (26.4kB/s-26.0kB/s), io=23.4MiB (24.6MB), run=229884-231520msec WRITE: bw=109KiB/s (111kB/s), 27.0KiB/s-27.6KiB/s (27.7kB/s-28.3kB/s), io=24.6MiB (25.7MB), run=229884-231520msec rand-rw: (groupid=0, jobs=1): err= 0: pid=142941: Tue Aug 11 00:49:04 2026 read: IOPS=3, BW=12.9KiB/s (13.2kB/s)(5992KiB/463363msec) clat (msec): min=8, max=1011, avg=65.87, stdev=68.38 lat (msec): min=8, max=1011, avg=65.88, stdev=68.38 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 91], 90.00th=[ 140], 95.00th=[ 186], | 99.00th=[ 351], 99.50th=[ 393], 99.90th=[ 701], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 72, per=34.25%, avg=17.47, stdev=11.90, samples=653 iops : min= 1, max= 18, avg= 3.73, stdev= 3.02, samples=653 write: IOPS=3, BW=13.6KiB/s (13.9kB/s)(6296KiB/463363msec); 0 zone resets clat (msec): min=50, max=931, avg=231.26, stdev=118.21 lat (msec): min=50, max=931, avg=231.26, stdev=118.20 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 103], 10.00th=[ 120], 20.00th=[ 140], | 30.00th=[ 161], 40.00th=[ 180], 50.00th=[ 201], 60.00th=[ 228], | 70.00th=[ 257], 80.00th=[ 305], 90.00th=[ 388], 95.00th=[ 460], | 99.00th=[ 625], 99.50th=[ 726], 99.90th=[ 927], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 6, max= 32, per=26.04%, avg=14.06, stdev= 6.49, samples=842 iops : min= 1, max= 8, avg= 2.88, stdev= 1.69, samples=842 lat (msec) : 10=0.13%, 20=4.56%, 50=23.54%, 100=14.32%, 250=39.84% lat (msec) : 500=15.89%, 750=1.46%, 1000=0.23%, 2000=0.03% cpu : usr=0.03%, sys=0.94%, ctx=5471, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142942: Tue Aug 11 00:49:04 2026 read: IOPS=3, BW=12.8KiB/s (13.1kB/s)(5940KiB/463221msec) clat (msec): min=9, max=827, avg=65.20, stdev=65.08 lat (msec): min=9, max=827, avg=65.21, stdev=65.08 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 67], 80.00th=[ 92], 90.00th=[ 136], 95.00th=[ 186], | 99.00th=[ 330], 99.50th=[ 409], 99.90th=[ 506], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 6, max= 71, per=33.80%, avg=17.24, stdev=12.18, samples=656 iops : min= 1, max= 17, avg= 3.68, stdev= 3.10, samples=656 write: IOPS=3, BW=13.7KiB/s (14.0kB/s)(6348KiB/463221msec); 0 zone resets clat (msec): min=57, max=1087, avg=230.45, stdev=119.58 lat (msec): min=57, max=1087, avg=230.46, stdev=119.58 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 97], 10.00th=[ 116], 20.00th=[ 142], | 30.00th=[ 161], 40.00th=[ 180], 50.00th=[ 201], 60.00th=[ 226], | 70.00th=[ 259], 80.00th=[ 305], 90.00th=[ 384], 95.00th=[ 468], | 99.00th=[ 659], 99.50th=[ 760], 99.90th=[ 919], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 6, max= 39, per=26.23%, avg=14.17, stdev= 6.66, samples=844 iops : min= 1, max= 9, avg= 2.90, stdev= 1.73, samples=844 lat (msec) : 10=0.10%, 20=4.20%, 50=23.60%, 100=15.01%, 250=39.32% lat (msec) : 500=15.82%, 750=1.66%, 1000=0.26%, 2000=0.03% cpu : usr=0.03%, sys=0.94%, ctx=5616, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142943: Tue Aug 11 00:49:04 2026 read: IOPS=3, BW=12.0KiB/s (13.3kB/s)(6028KiB/463855msec) clat (msec): min=8, max=672, avg=67.44, stdev=63.48 lat (msec): min=8, max=672, avg=67.45, stdev=63.48 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 93], 90.00th=[ 144], 95.00th=[ 184], | 99.00th=[ 317], 99.50th=[ 393], 99.90th=[ 542], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 78, per=33.40%, avg=17.04, stdev=11.41, samples=672 iops : min= 1, max= 19, avg= 3.63, stdev= 2.90, samples=672 write: IOPS=3, BW=13.5KiB/s (13.8kB/s)(6260KiB/463855msec); 0 zone resets clat (msec): min=58, max=1076, avg=231.03, stdev=119.53 lat (msec): min=58, max=1076, avg=231.04, stdev=119.53 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 102], 10.00th=[ 116], 20.00th=[ 138], | 30.00th=[ 159], 40.00th=[ 180], 50.00th=[ 203], 60.00th=[ 230], | 70.00th=[ 262], 80.00th=[ 300], 90.00th=[ 384], 95.00th=[ 472], | 99.00th=[ 634], 99.50th=[ 693], 99.90th=[ 969], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 6, max= 32, per=25.80%, avg=13.93, stdev= 6.73, samples=845 iops : min= 1, max= 8, avg= 2.84, stdev= 1.75, samples=845 lat (msec) : 10=0.03%, 20=3.61%, 50=22.88%, 100=16.41%, 250=39.06% lat (msec) : 500=15.89%, 750=1.95%, 1000=0.13%, 2000=0.03% cpu : usr=0.03%, sys=0.93%, ctx=5698, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142944: Tue Aug 11 00:49:04 2026 read: IOPS=3, BW=13.1KiB/s (13.4kB/s)(6052KiB/462636msec) clat (msec): min=8, max=876, avg=64.94, stdev=65.54 lat (msec): min=8, max=876, avg=64.95, stdev=65.55 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 88], 90.00th=[ 144], 95.00th=[ 192], | 99.00th=[ 326], 99.50th=[ 359], 99.90th=[ 600], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 6, max= 92, per=34.60%, avg=17.65, stdev=12.69, samples=653 iops : min= 1, max= 23, avg= 3.77, stdev= 3.22, samples=653 write: IOPS=3, BW=13.5KiB/s (13.8kB/s)(6236KiB/462636msec); 0 zone resets clat (msec): min=53, max=939, avg=233.30, stdev=122.92 lat (msec): min=53, max=939, avg=233.32, stdev=122.93 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 100], 10.00th=[ 117], 20.00th=[ 140], | 30.00th=[ 161], 40.00th=[ 182], 50.00th=[ 201], 60.00th=[ 226], | 70.00th=[ 262], 80.00th=[ 313], 90.00th=[ 393], 95.00th=[ 485], | 99.00th=[ 667], 99.50th=[ 776], 99.90th=[ 927], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 6, max= 39, per=26.32%, avg=14.21, stdev= 6.69, samples=827 iops : min= 1, max= 9, avg= 2.91, stdev= 1.74, samples=827 lat (msec) : 10=0.10%, 20=5.18%, 50=23.50%, 100=14.71%, 250=38.51% lat (msec) : 500=15.53%, 750=2.15%, 1000=0.33% cpu : usr=0.03%, sys=0.95%, ctx=5622, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=51.8KiB/s (53.0kB/s), 12.8KiB/s-13.1KiB/s (13.1kB/s-13.4kB/s), io=23.4MiB (24.6MB), run=462636-463855msec WRITE: bw=54.2KiB/s (55.5kB/s), 13.5KiB/s-13.7KiB/s (13.8kB/s-14.0kB/s), io=24.6MiB (25.7MB), run=462636-463855msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143039: Tue Aug 11 00:50:10 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5920KiB/49002msec) clat (usec): min=36, max=265134, avg=65433.32, stdev=50722.40 lat (usec): min=37, max=265135, avg=65437.80, stdev=50725.03 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 237], | 30.00th=[ 37487], 40.00th=[ 52167], 50.00th=[ 64226], 60.00th=[ 77071], | 70.00th=[ 86508], 80.00th=[100140], 90.00th=[130548], 95.00th=[154141], | 99.00th=[214959], 99.50th=[265290], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 345, per=27.20%, avg=125.12, stdev=60.10, samples=92 iops : min= 1, max= 21, avg= 7.03, stdev= 3.77, samples=92 write: IOPS=8, BW=130KiB/s (133kB/s)(6368KiB/49002msec); 0 zone resets clat (usec): min=1754, max=645602, avg=61627.32, stdev=64800.95 lat (usec): min=1756, max=645605, avg=61631.18, stdev=64801.33 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 19], 40.00th=[ 28], 50.00th=[ 43], 60.00th=[ 62], | 70.00th=[ 81], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 176], | 99.00th=[ 234], 99.50th=[ 485], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 31, max= 351, per=28.11%, avg=136.03, stdev=63.47, samples=91 iops : min= 1, max= 21, avg= 7.71, stdev= 4.00, samples=91 lat (usec) : 50=0.78%, 100=7.42%, 250=1.56%, 500=0.13%, 750=0.13% lat (msec) : 2=0.13%, 4=1.95%, 10=6.12%, 20=9.51%, 50=18.49% lat (msec) : 100=33.46%, 250=19.53%, 500=0.65%, 750=0.13% cpu : usr=0.06%, sys=3.41%, ctx=1716, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143040: Tue Aug 11 00:50:10 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(5744KiB/52065msec) clat (usec): min=39, max=626188, avg=72317.29, stdev=59244.55 lat (usec): min=39, max=626189, avg=72325.38, stdev=59244.67 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 77], 10.00th=[ 96], 20.00th=[ 30802], | 30.00th=[ 43779], 40.00th=[ 55837], 50.00th=[ 67634], 60.00th=[ 78119], | 70.00th=[ 89654], 80.00th=[111674], 90.00th=[139461], 95.00th=[164627], | 99.00th=[240124], 99.50th=[316670], 99.90th=[624952], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 31, max= 307, per=24.87%, avg=114.42, stdev=55.79, samples=97 iops : min= 1, max= 19, avg= 6.36, stdev= 3.58, samples=97 write: IOPS=7, BW=126KiB/s (129kB/s)(6544KiB/52065msec); 0 zone resets clat (usec): min=1640, max=457636, avg=62190.29, stdev=67165.95 lat (usec): min=1642, max=457638, avg=62197.62, stdev=67166.08 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 24], 50.00th=[ 39], 60.00th=[ 58], | 70.00th=[ 80], 80.00th=[ 105], 90.00th=[ 153], 95.00th=[ 192], | 99.00th=[ 305], 99.50th=[ 372], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 31, max= 318, per=26.16%, avg=126.61, stdev=65.18, samples=100 iops : min= 1, max= 19, avg= 7.12, stdev= 4.11, samples=100 lat (usec) : 50=0.39%, 100=4.56%, 250=1.95%, 500=0.13%, 750=0.26% lat (msec) : 2=0.39%, 4=1.30%, 10=7.16%, 20=11.20%, 50=18.75% lat (msec) : 100=31.12%, 250=21.35%, 500=1.30%, 750=0.13% cpu : usr=0.06%, sys=3.53%, ctx=1802, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143041: Tue Aug 11 00:50:10 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49739msec) clat (usec): min=45, max=385057, avg=73899.55, stdev=55780.74 lat (usec): min=46, max=385059, avg=73901.74, stdev=55780.26 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 80], 10.00th=[ 90], 20.00th=[ 32113], | 30.00th=[ 48497], 40.00th=[ 61080], 50.00th=[ 69731], 60.00th=[ 79168], | 70.00th=[ 92799], 80.00th=[108528], 90.00th=[135267], 95.00th=[164627], | 99.00th=[256902], 99.50th=[287310], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 25, max= 252, per=27.45%, avg=126.28, stdev=56.10, samples=97 iops : min= 1, max= 15, avg= 7.09, stdev= 3.52, samples=97 write: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49739msec); 0 zone resets clat (msec): min=2, max=388, avg=54.27, stdev=55.03 lat (msec): min=2, max=388, avg=54.28, stdev=55.03 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 7], 20.00th=[ 12], | 30.00th=[ 17], 40.00th=[ 25], 50.00th=[ 36], 60.00th=[ 51], | 70.00th=[ 72], 80.00th=[ 89], 90.00th=[ 117], 95.00th=[ 165], | 99.00th=[ 243], 99.50th=[ 262], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 31, max= 314, per=24.83%, avg=120.19, stdev=58.28, samples=97 iops : min= 1, max= 19, avg= 6.72, stdev= 3.71, samples=97 lat (usec) : 50=0.26%, 100=5.73%, 250=1.82%, 500=0.39%, 750=0.39% lat (msec) : 2=0.39%, 4=3.26%, 10=6.51%, 20=8.33%, 50=18.36% lat (msec) : 100=33.20%, 250=20.44%, 500=0.91% cpu : usr=0.05%, sys=3.55%, ctx=1798, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143042: Tue Aug 11 00:50:10 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48646msec) clat (usec): min=34, max=299858, avg=74606.31, stdev=55151.52 lat (usec): min=34, max=299860, avg=74612.82, stdev=55153.62 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 77], 10.00th=[ 91], 20.00th=[ 28443], | 30.00th=[ 46924], 40.00th=[ 58983], 50.00th=[ 67634], 60.00th=[ 82314], | 70.00th=[ 96994], 80.00th=[117965], 90.00th=[139461], 95.00th=[177210], | 99.00th=[265290], 99.50th=[270533], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 287, per=27.06%, avg=124.49, stdev=60.47, samples=94 iops : min= 1, max= 17, avg= 6.98, stdev= 3.84, samples=94 write: IOPS=8, BW=129KiB/s (132kB/s)(6256KiB/48646msec); 0 zone resets clat (msec): min=2, max=280, avg=52.18, stdev=53.35 lat (msec): min=2, max=280, avg=52.19, stdev=53.35 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 21], 50.00th=[ 34], 60.00th=[ 50], | 70.00th=[ 66], 80.00th=[ 88], 90.00th=[ 130], 95.00th=[ 174], | 99.00th=[ 224], 99.50th=[ 271], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 288, per=26.90%, avg=130.21, stdev=68.72, samples=94 iops : min= 1, max= 18, avg= 7.35, stdev= 4.38, samples=94 lat (usec) : 50=0.39%, 100=4.95%, 250=1.69%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=0.39%, 4=3.65%, 10=6.51%, 20=10.16%, 50=17.97% lat (msec) : 100=31.64%, 250=20.83%, 500=0.91% cpu : usr=0.05%, sys=3.63%, ctx=1757, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=460KiB/s (471kB/s), 110KiB/s-126KiB/s (113kB/s-129kB/s), io=23.4MiB (24.5MB), run=48646-52065msec WRITE: bw=484KiB/s (496kB/s), 121KiB/s-130KiB/s (124kB/s-133kB/s), io=24.6MiB (25.8MB), run=48646-52065msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143043: Tue Aug 11 00:51:09 2026 read: IOPS=3, BW=53.0KiB/s (55.3kB/s)(5920KiB/109685msec) clat (msec): min=10, max=518, avg=68.05, stdev=71.01 lat (msec): min=10, max=518, avg=68.05, stdev=71.01 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 91], 90.00th=[ 153], 95.00th=[ 224], | 99.00th=[ 368], 99.50th=[ 426], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 29, max= 224, per=31.97%, avg=69.37, stdev=43.06, samples=165 iops : min= 1, max= 14, avg= 3.55, stdev= 2.75, samples=165 write: IOPS=3, BW=58.1KiB/s (59.5kB/s)(6368KiB/109685msec); 0 zone resets clat (msec): min=46, max=715, avg=210.31, stdev=104.30 lat (msec): min=46, max=715, avg=210.32, stdev=104.30 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 90], 10.00th=[ 104], 20.00th=[ 124], | 30.00th=[ 144], 40.00th=[ 169], 50.00th=[ 188], 60.00th=[ 211], | 70.00th=[ 239], 80.00th=[ 279], 90.00th=[ 359], 95.00th=[ 418], | 99.00th=[ 567], 99.50th=[ 676], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 29, max= 159, per=27.82%, avg=63.44, stdev=28.69, samples=195 iops : min= 1, max= 9, avg= 3.17, stdev= 1.89, samples=195 lat (msec) : 20=6.12%, 50=22.53%, 100=15.49%, 250=40.10%, 500=14.84% lat (msec) : 750=0.91% cpu : usr=0.03%, sys=1.05%, ctx=1403, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143044: Tue Aug 11 00:51:09 2026 read: IOPS=3, BW=52.2KiB/s (53.4kB/s)(5744KiB/110079msec) clat (msec): min=8, max=429, avg=64.79, stdev=62.78 lat (msec): min=8, max=429, avg=64.80, stdev=62.78 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 66], 80.00th=[ 91], 90.00th=[ 155], 95.00th=[ 222], | 99.00th=[ 305], 99.50th=[ 355], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 25, max= 285, per=32.49%, avg=70.51, stdev=46.77, samples=158 iops : min= 1, max= 17, avg= 3.63, stdev= 3.00, samples=158 write: IOPS=3, BW=59.4KiB/s (60.9kB/s)(6544KiB/110079msec); 0 zone resets clat (msec): min=46, max=660, avg=211.53, stdev=107.36 lat (msec): min=46, max=660, avg=211.56, stdev=107.36 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 81], 10.00th=[ 97], 20.00th=[ 125], | 30.00th=[ 146], 40.00th=[ 167], 50.00th=[ 186], 60.00th=[ 218], | 70.00th=[ 247], 80.00th=[ 284], 90.00th=[ 347], 95.00th=[ 409], | 99.00th=[ 592], 99.50th=[ 609], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 29, max= 223, per=27.78%, avg=63.34, stdev=31.98, samples=201 iops : min= 1, max= 13, avg= 3.16, stdev= 2.10, samples=201 lat (msec) : 10=0.13%, 20=4.17%, 50=24.09%, 100=15.89%, 250=38.67% lat (msec) : 500=15.49%, 750=1.56% cpu : usr=0.04%, sys=1.07%, ctx=1450, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143045: Tue Aug 11 00:51:09 2026 read: IOPS=3, BW=58.4KiB/s (59.8kB/s)(6256KiB/107079msec) clat (msec): min=11, max=440, avg=62.18, stdev=57.52 lat (msec): min=11, max=440, avg=62.18, stdev=57.52 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 61], 80.00th=[ 80], 90.00th=[ 123], 95.00th=[ 182], | 99.00th=[ 321], 99.50th=[ 388], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 29, max= 256, per=34.51%, avg=74.90, stdev=46.87, samples=164 iops : min= 1, max= 16, avg= 3.89, stdev= 3.00, samples=164 write: IOPS=3, BW=56.3KiB/s (57.7kB/s)(6032KiB/107079msec); 0 zone resets clat (msec): min=59, max=916, avg=217.83, stdev=108.59 lat (msec): min=59, max=916, avg=217.85, stdev=108.59 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 96], 10.00th=[ 110], 20.00th=[ 129], | 30.00th=[ 153], 40.00th=[ 171], 50.00th=[ 192], 60.00th=[ 220], | 70.00th=[ 247], 80.00th=[ 296], 90.00th=[ 363], 95.00th=[ 422], | 99.00th=[ 550], 99.50th=[ 634], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 29, max= 128, per=25.37%, avg=57.84, stdev=27.92, samples=202 iops : min= 1, max= 8, avg= 2.82, stdev= 1.84, samples=202 lat (msec) : 20=3.91%, 50=25.91%, 100=16.67%, 250=38.15%, 500=14.32% lat (msec) : 750=0.91%, 1000=0.13% cpu : usr=0.04%, sys=1.09%, ctx=1410, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143046: Tue Aug 11 00:51:09 2026 read: IOPS=3, BW=55.8KiB/s (57.1kB/s)(6032KiB/108181msec) clat (msec): min=9, max=438, avg=62.21, stdev=58.03 lat (msec): min=9, max=438, avg=62.21, stdev=58.03 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 84], 90.00th=[ 129], 95.00th=[ 169], | 99.00th=[ 321], 99.50th=[ 355], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 29, max= 254, per=34.37%, avg=74.58, stdev=49.30, samples=156 iops : min= 1, max= 15, avg= 3.88, stdev= 3.10, samples=156 write: IOPS=3, BW=57.8KiB/s (59.2kB/s)(6256KiB/108181msec); 0 zone resets clat (msec): min=60, max=931, avg=214.23, stdev=108.07 lat (msec): min=60, max=931, avg=214.25, stdev=108.07 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 90], 10.00th=[ 109], 20.00th=[ 129], | 30.00th=[ 153], 40.00th=[ 171], 50.00th=[ 194], 60.00th=[ 213], | 70.00th=[ 245], 80.00th=[ 275], 90.00th=[ 334], 95.00th=[ 393], | 99.00th=[ 592], 99.50th=[ 768], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 29, max= 191, per=26.88%, avg=61.29, stdev=29.62, samples=199 iops : min= 1, max= 11, avg= 3.04, stdev= 1.92, samples=199 lat (msec) : 10=0.13%, 20=4.69%, 50=24.48%, 100=15.23%, 250=39.97% lat (msec) : 500=14.32%, 750=0.91%, 1000=0.26% cpu : usr=0.03%, sys=1.05%, ctx=1376, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=218KiB/s (223kB/s), 52.2KiB/s-58.4KiB/s (53.4kB/s-59.8kB/s), io=23.4MiB (24.5MB), run=107079-110079msec WRITE: bw=229KiB/s (234kB/s), 56.3KiB/s-59.4KiB/s (57.7kB/s-60.9kB/s), io=24.6MiB (25.8MB), run=107079-110079msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143075: Tue Aug 11 00:51:37 2026 read: IOPS=0, BW=686KiB/s (702kB/s)(7168KiB/10451msec) clat (msec): min=14, max=551, avg=340.14, stdev=177.38 lat (msec): min=14, max=551, avg=340.14, stdev=177.38 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 15], 10.00th=[ 15], 20.00th=[ 284], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 305], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 489], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1530, max= 4087, per=100.00%, avg=2924.75, stdev=1351.30, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=490KiB/s (502kB/s)(5120KiB/10451msec); 0 zone resets clat (msec): min=104, max=4819, avg=1599.31, stdev=2076.94 lat (msec): min=105, max=4819, avg=1599.41, stdev=2076.92 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 1950, max= 4063, per=100.00%, avg=2513.75, stdev=1033.48, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 20=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=4.75%, ctx=206, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143076: Tue Aug 11 00:51:37 2026 read: IOPS=0, BW=164KiB/s (168kB/s)(2048KiB/12515msec) clat (msec): min=211, max=2846, avg=1528.87, stdev=1862.76 lat (msec): min=211, max=2846, avg=1528.87, stdev=1862.76 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 2836], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1980, max= 1984, per=100.00%, avg=1982.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=818KiB/s (838kB/s)(10.0MiB/12515msec); 0 zone resets clat (msec): min=115, max=4428, avg=922.28, stdev=1306.20 lat (msec): min=116, max=4428, avg=922.82, stdev=1306.21 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 153], | 30.00th=[ 178], 40.00th=[ 194], 50.00th=[ 422], 60.00th=[ 472], | 70.00th=[ 818], 80.00th=[ 1011], 90.00th=[ 1435], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 1984, max= 3968, per=100.00%, avg=2958.50, stdev=1040.92, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=41.67%, 500=16.67%, 1000=8.33%, 2000=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=4.90%, ctx=233, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143077: Tue Aug 11 00:51:37 2026 read: IOPS=0, BW=527KiB/s (539kB/s)(6144KiB/11663msec) clat (msec): min=214, max=5231, avg=1138.99, stdev=2006.90 lat (msec): min=214, max=5231, avg=1139.00, stdev=2006.90 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 414], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 2031, max= 4015, per=100.00%, avg=3335.67, stdev=1130.20, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=527KiB/s (539kB/s)(6144KiB/11663msec); 0 zone resets clat (msec): min=215, max=2375, avg=717.97, stdev=830.84 lat (msec): min=216, max=2376, avg=718.16, stdev=830.79 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 523], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1950, max= 4079, per=100.00%, avg=2400.20, stdev=938.74, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.01%, sys=5.32%, ctx=693, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143080: Tue Aug 11 00:51:37 2026 read: IOPS=0, BW=471KiB/s (482kB/s)(5120KiB/10875msec) clat (usec): min=487, max=233873, avg=48128.12, stdev=103843.32 lat (usec): min=487, max=233873, avg=48129.12, stdev=103843.12 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 1713], 60.00th=[ 1713], | 70.00th=[ 3884], 80.00th=[ 3884], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=0, BW=659KiB/s (675kB/s)(7168KiB/10875msec); 0 zone resets clat (msec): min=199, max=4544, avg=1485.32, stdev=1721.69 lat (msec): min=199, max=4546, avg=1486.06, stdev=1722.20 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 215], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 810], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 3306], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 2003, max= 4079, per=100.00%, avg=2436.60, stdev=918.25, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=8.33%, 1000=16.67% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=3.38%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1636KiB/s (1676kB/s), 164KiB/s-686KiB/s (168kB/s-702kB/s), io=20.0MiB (20.0MB), run=10451-12515msec WRITE: bw=2291KiB/s (2346kB/s), 490KiB/s-818KiB/s (502kB/s-838kB/s), io=28.0MiB (29.4MB), run=10451-12515msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143078: Tue Aug 11 00:51:39 2026 read: IOPS=0, BW=597KiB/s (611kB/s)(7168KiB/12012msec) clat (msec): min=170, max=435, avg=287.80, stdev=115.99 lat (msec): min=170, max=435, avg=287.81, stdev=115.99 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 178], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 236], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 422], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1428, max= 4031, per=100.00%, avg=2303.20, stdev=999.20, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=426KiB/s (436kB/s)(5120KiB/12012msec); 0 zone resets clat (msec): min=492, max=4852, avg=1976.00, stdev=1986.49 lat (msec): min=492, max=4852, avg=1976.32, stdev=1986.31 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 1928, max= 2039, per=97.10%, avg=2012.80, stdev=48.19, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=1.57%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143079: Tue Aug 11 00:51:39 2026 read: IOPS=0, BW=148KiB/s (152kB/s)(2048KiB/13831msec) clat (msec): min=334, max=2397, avg=1366.21, stdev=1458.49 lat (msec): min=334, max=2397, avg=1366.21, stdev=1458.49 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1914, max= 1928, per=100.00%, avg=1921.00, stdev= 9.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=740KiB/s (758kB/s)(10.0MiB/13831msec); 0 zone resets clat (msec): min=202, max=5829, avg=1021.75, stdev=1706.27 lat (msec): min=202, max=5830, avg=1021.87, stdev=1706.27 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 230], | 30.00th=[ 305], 40.00th=[ 338], 50.00th=[ 447], 60.00th=[ 531], | 70.00th=[ 617], 80.00th=[ 776], 90.00th=[ 944], 95.00th=[ 5805], | 99.00th=[ 5805], 99.50th=[ 5805], 99.90th=[ 5805], 99.95th=[ 5805], | 99.99th=[ 5805] bw ( KiB/s): min= 1928, max= 4079, per=100.00%, avg=2296.86, stdev=787.30, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=16.67%, >=2000=16.67% cpu : usr=0.03%, sys=1.86%, ctx=148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143081: Tue Aug 11 00:51:39 2026 read: IOPS=0, BW=517KiB/s (530kB/s)(6144KiB/11875msec) clat (msec): min=100, max=2216, avg=492.20, stdev=845.62 lat (msec): min=100, max=2216, avg=492.21, stdev=845.62 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1939, max= 4096, per=100.00%, avg=3368.67, stdev=1238.19, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=517KiB/s (530kB/s)(6144KiB/11875msec); 0 zone resets clat (msec): min=242, max=3559, avg=1396.15, stdev=1291.49 lat (msec): min=247, max=3559, avg=1397.24, stdev=1290.47 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 1003], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 1914, max= 2031, per=95.47%, avg=1979.00, stdev=49.98, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=50.00%, 500=8.33%, 1000=8.33%, 2000=8.33%, >=2000=25.00% cpu : usr=0.00%, sys=1.73%, ctx=94, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143082: Tue Aug 11 00:51:39 2026 read: IOPS=0, BW=378KiB/s (387kB/s)(5120KiB/13540msec) clat (msec): min=219, max=571, avg=371.09, stdev=137.78 lat (msec): min=219, max=571, avg=371.09, stdev=137.78 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1928, max= 4079, per=100.00%, avg=2674.00, stdev=1217.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=529KiB/s (542kB/s)(7168KiB/13540msec); 0 zone resets clat (msec): min=350, max=4879, avg=1547.10, stdev=1719.42 lat (msec): min=350, max=4879, avg=1547.51, stdev=1719.27 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 439], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 726], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 2937], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 2011, max= 4079, per=100.00%, avg=2370.33, stdev=837.14, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=8.33%, 500=41.67%, 750=25.00%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.31%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1481KiB/s (1516kB/s), 148KiB/s-597KiB/s (152kB/s-611kB/s), io=20.0MiB (20.0MB), run=11875-13831msec WRITE: bw=2073KiB/s (2123kB/s), 426KiB/s-740KiB/s (436kB/s-758kB/s), io=28.0MiB (29.4MB), run=11875-13831msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143091: Tue Aug 11 00:51:58 2026 read: IOPS=0, BW=2562KiB/s (2623kB/s)(12.0MiB/4797msec) clat (msec): min=1110, max=2383, avg=1557.82, stdev=716.02 lat (msec): min=1110, max=2383, avg=1557.82, stdev=716.01 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 7876, max= 8159, per=100.00%, avg=8017.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=8.05%, ctx=230, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143092: Tue Aug 11 00:51:58 2026 read: IOPS=0, BW=719KiB/s (736kB/s)(4096KiB/5698msec) clat (nsec): min=1265.1M, max=1265.1M, avg=1265058368.00, stdev= 0.00 lat (nsec): min=1265.1M, max=1265.1M, avg=1265062335.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1438KiB/s (1472kB/s)(8192KiB/5698msec); 0 zone resets clat (msec): min=1405, max=2897, avg=2151.57, stdev=1055.31 lat (msec): min=1406, max=2898, avg=2152.46, stdev=1054.71 clat percentiles (msec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 2903], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 7301, max= 7301, per=100.00%, avg=7301.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.86%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143093: Tue Aug 11 00:51:58 2026 write: IOPS=0, BW=2135KiB/s (2186kB/s)(12.0MiB/5756msec); 0 zone resets clat (msec): min=554, max=2878, avg=1871.12, stdev=1192.43 lat (msec): min=555, max=2879, avg=1883.34, stdev=1197.10 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 2165], 50.00th=[ 2165], 60.00th=[ 2165], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 7656, max= 8047, per=100.00%, avg=7851.50, stdev=276.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.35%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143094: Tue Aug 11 00:51:58 2026 write: IOPS=0, BW=2771KiB/s (2837kB/s)(12.0MiB/4435msec); 0 zone resets clat (msec): min=661, max=2773, avg=1447.71, stdev=1154.45 lat (msec): min=662, max=2773, avg=1448.91, stdev=1153.91 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.16%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2875KiB/s (2944kB/s), 719KiB/s-2562KiB/s (736kB/s-2623kB/s), io=16.0MiB (16.8MB), run=4797-5698msec WRITE: bw=5693KiB/s (5829kB/s), 1438KiB/s-2771KiB/s (1472kB/s-2837kB/s), io=32.0MiB (33.6MB), run=4435-5756msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143095: Tue Aug 11 00:51:59 2026 read: IOPS=0, BW=1968KiB/s (2015kB/s)(12.0MiB/6244msec) clat (msec): min=584, max=2946, avg=2050.18, stdev=1280.13 lat (msec): min=584, max=2946, avg=2050.18, stdev=1280.13 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 2635], 50.00th=[ 2635], 60.00th=[ 2635], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.31%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143096: Tue Aug 11 00:51:59 2026 read: IOPS=0, BW=636KiB/s (651kB/s)(4096KiB/6438msec) clat (nsec): min=2459.5M, max=2459.5M, avg=2459491354.00, stdev= 0.00 lat (nsec): min=2459.5M, max=2459.5M, avg=2459494811.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2467], 5.00th=[ 2467], 10.00th=[ 2467], 20.00th=[ 2467], | 30.00th=[ 2467], 40.00th=[ 2467], 50.00th=[ 2467], 60.00th=[ 2467], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 7543, max= 7543, per=100.00%, avg=7543.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1272KiB/s (1303kB/s)(8192KiB/6438msec); 0 zone resets clat (msec): min=1352, max=2556, avg=1954.93, stdev=851.27 lat (msec): min=1360, max=2557, avg=1959.14, stdev=845.97 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 2567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.62%, ctx=34, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143097: Tue Aug 11 00:51:59 2026 write: IOPS=0, BW=3614KiB/s (3701kB/s)(12.0MiB/3400msec); 0 zone resets clat (msec): min=1054, max=1204, avg=1122.02, stdev=76.19 lat (msec): min=1054, max=1204, avg=1122.44, stdev=76.20 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7543, max= 8126, per=100.00%, avg=7834.50, stdev=412.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.18%, ctx=40, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143098: Tue Aug 11 00:51:59 2026 write: IOPS=0, BW=2520KiB/s (2580kB/s)(12.0MiB/4877msec); 0 zone resets clat (msec): min=479, max=2439, avg=1567.50, stdev=997.49 lat (msec): min=483, max=2440, avg=1570.50, stdev=996.57 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 1787], 50.00th=[ 1787], 60.00th=[ 1787], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 7876, max= 8175, per=100.00%, avg=8025.50, stdev=211.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.73%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2545KiB/s (2606kB/s), 636KiB/s-1968KiB/s (651kB/s-2015kB/s), io=16.0MiB (16.8MB), run=6244-6438msec WRITE: bw=5090KiB/s (5212kB/s), 1272KiB/s-3614KiB/s (1303kB/s-3701kB/s), io=32.0MiB (33.6MB), run=3400-6438msec