== sanity test 398b: DIO and buffer IO race ============== 03:52:50 (1788594770) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.28182 s, 6.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174247: Sat Sep 5 03:55:27 2026 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(5992KiB/132264msec) clat (usec): min=31, max=354597, avg=40994.32, stdev=32749.82 lat (usec): min=31, max=354598, avg=41000.95, stdev=32748.83 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 77], 20.00th=[ 17957], | 30.00th=[ 23462], 40.00th=[ 28181], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50594], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[139461], 99.50th=[175113], 99.90th=[274727], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 7, max= 111, per=25.42%, avg=45.50, stdev=21.19, samples=257 iops : min= 1, max= 27, avg=10.76, stdev= 5.34, samples=257 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6296KiB/132264msec); 0 zone resets clat (usec): min=905, max=880518, avg=44647.39, stdev=52201.57 lat (usec): min=907, max=880520, avg=44649.71, stdev=52200.97 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1434], 20.00th=[ 3949], | 30.00th=[ 9110], 40.00th=[ 20579], 50.00th=[ 32375], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[101188], 95.00th=[128451], | 99.00th=[206570], 99.50th=[261096], 99.90th=[467665], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 111, per=25.20%, avg=47.37, stdev=20.30, samples=259 iops : min= 1, max= 27, avg=11.24, stdev= 5.08, samples=259 lat (usec) : 50=0.68%, 100=4.92%, 250=0.49%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=6.09%, 4=4.13%, 10=5.73%, 20=9.11%, 50=35.12% lat (msec) : 100=25.62%, 250=7.29%, 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=5.07%, ctx=6279, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174250: Sat Sep 5 03:55:27 2026 read: IOPS=11, BW=44.8KiB/s (45.9kB/s)(5940KiB/132629msec) clat (usec): min=31, max=935913, avg=41621.93, stdev=40408.83 lat (usec): min=31, max=936085, avg=41623.87, stdev=40411.09 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 74], 20.00th=[ 17695], | 30.00th=[ 23462], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[143655], 99.50th=[177210], 99.90th=[429917], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 118, per=25.25%, avg=45.19, stdev=20.71, samples=257 iops : min= 1, max= 29, avg=10.67, stdev= 5.20, samples=257 write: IOPS=11, BW=47.9KiB/s (49.0kB/s)(6348KiB/132629msec); 0 zone resets clat (usec): min=945, max=491570, avg=44193.08, stdev=47002.08 lat (usec): min=946, max=491570, avg=44204.32, stdev=47006.81 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1385], 20.00th=[ 4228], | 30.00th=[ 8586], 40.00th=[ 20579], 50.00th=[ 32113], 60.00th=[ 45351], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[105382], 95.00th=[132645], | 99.00th=[208667], 99.50th=[240124], 99.90th=[354419], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 7, max= 166, per=25.41%, avg=47.76, stdev=21.36, samples=260 iops : min= 1, max= 41, avg=11.33, stdev= 5.38, samples=260 lat (usec) : 50=0.59%, 100=5.01%, 250=0.29%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.97%, 4=3.16%, 10=6.41%, 20=8.79%, 50=35.32% lat (msec) : 100=24.90%, 250=8.04%, 500=0.23%, 1000=0.03% cpu : usr=0.09%, sys=5.03%, ctx=6348, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174252: Sat Sep 5 03:55:27 2026 read: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6028KiB/133544msec) clat (usec): min=30, max=448200, avg=41056.93, stdev=36438.77 lat (usec): min=30, max=448202, avg=41059.34, stdev=36438.17 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 72], 20.00th=[ 18482], | 30.00th=[ 24249], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[242222], 99.90th=[392168], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 119, per=25.20%, avg=45.12, stdev=21.06, samples=260 iops : min= 1, max= 29, avg=10.67, stdev= 5.30, samples=260 write: IOPS=11, BW=46.9KiB/s (48.0kB/s)(6260KiB/133544msec); 0 zone resets clat (usec): min=940, max=1229.6k, avg=45417.79, stdev=54295.58 lat (usec): min=941, max=1229.6k, avg=45430.79, stdev=54288.08 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1369], | 20.00th=[ 4228], 30.00th=[ 9241], 40.00th=[ 20841], | 50.00th=[ 33817], 60.00th=[ 45876], 70.00th=[ 58983], | 80.00th=[ 78119], 90.00th=[ 104334], 95.00th=[ 131597], | 99.00th=[ 198181], 99.50th=[ 231736], 99.90th=[ 371196], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 134, per=24.92%, avg=46.85, stdev=20.50, samples=260 iops : min= 1, max= 33, avg=11.10, stdev= 5.14, samples=260 lat (usec) : 50=0.94%, 100=4.72%, 250=0.36%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=6.71%, 4=3.35%, 10=6.02%, 20=8.59%, 50=36.30% lat (msec) : 100=24.64%, 250=7.71%, 500=0.36%, 2000=0.03% cpu : usr=0.07%, sys=5.16%, ctx=6349, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174253: Sat Sep 5 03:55:27 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6052KiB/129352msec) clat (usec): min=31, max=996495, avg=41235.19, stdev=40794.18 lat (usec): min=31, max=996497, avg=41239.05, stdev=40792.87 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 75], 20.00th=[ 18220], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[143655], 99.50th=[204473], 99.90th=[304088], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 103, per=26.20%, avg=46.89, stdev=19.18, samples=252 iops : min= 1, max= 25, avg=11.11, stdev= 4.81, samples=252 write: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6236KiB/129352msec); 0 zone resets clat (usec): min=956, max=426700, avg=42562.63, stdev=43601.54 lat (usec): min=957, max=426702, avg=42564.74, stdev=43601.10 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1434], 20.00th=[ 4621], | 30.00th=[ 9503], 40.00th=[ 19792], 50.00th=[ 32113], 60.00th=[ 43254], | 70.00th=[ 56886], 80.00th=[ 72877], 90.00th=[100140], 95.00th=[124257], | 99.00th=[177210], 99.50th=[221250], 99.90th=[375391], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 15, max= 140, per=25.62%, avg=48.17, stdev=19.72, samples=252 iops : min= 3, max= 35, avg=11.43, stdev= 4.99, samples=252 lat (usec) : 50=0.62%, 100=5.08%, 250=0.42%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=6.05%, 4=3.03%, 10=7.19%, 20=8.79%, 50=36.30% lat (msec) : 100=24.97%, 250=6.93%, 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=4.93%, ctx=6261, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=180KiB/s (184kB/s), 44.8KiB/s-46.8KiB/s (45.9kB/s-47.9kB/s), io=23.4MiB (24.6MB), run=129352-133544msec WRITE: bw=188KiB/s (193kB/s), 46.9KiB/s-48.2KiB/s (48.0kB/s-49.4kB/s), io=24.6MiB (25.7MB), run=129352-133544msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174248: Sat Sep 5 03:58:12 2026 read: IOPS=5, BW=20.0KiB/s (20.5kB/s)(5992KiB/299084msec) clat (msec): min=5, max=849, avg=38.30, stdev=46.16 lat (msec): min=5, max=849, avg=38.32, stdev=46.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 194], 99.50th=[ 296], 99.90th=[ 558], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 93, per=28.69%, avg=22.95, stdev=15.58, samples=503 iops : min= 1, max= 23, avg= 5.11, stdev= 3.93, samples=503 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6296KiB/299084msec); 0 zone resets clat (msec): min=41, max=620, avg=153.17, stdev=69.18 lat (msec): min=41, max=620, avg=153.17, stdev=69.18 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 199], 90.00th=[ 245], 95.00th=[ 292], | 99.00th=[ 388], 99.50th=[ 426], 99.90th=[ 502], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 48, per=24.85%, avg=20.87, stdev= 9.16, samples=578 iops : min= 1, max= 12, avg= 4.58, stdev= 2.35, samples=578 lat (msec) : 10=2.21%, 20=15.36%, 50=21.61%, 100=18.00%, 250=37.83% lat (msec) : 500=4.82%, 750=0.13%, 1000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5017, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174249: Sat Sep 5 03:58:12 2026 read: IOPS=4, BW=19.0KiB/s (20.4kB/s)(5940KiB/297702msec) clat (msec): min=6, max=982, avg=37.80, stdev=44.18 lat (msec): min=6, max=982, avg=37.80, stdev=44.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 84], 95.00th=[ 111], | 99.00th=[ 174], 99.50th=[ 199], 99.90th=[ 550], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 95, per=28.74%, avg=23.00, stdev=15.69, samples=497 iops : min= 1, max= 23, avg= 5.11, stdev= 3.93, samples=497 write: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6348KiB/297702msec); 0 zone resets clat (msec): min=43, max=720, avg=151.91, stdev=68.43 lat (msec): min=43, max=720, avg=151.91, stdev=68.43 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 171], 80.00th=[ 201], 90.00th=[ 247], 95.00th=[ 288], | 99.00th=[ 359], 99.50th=[ 397], 99.90th=[ 527], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 55, per=24.94%, avg=20.95, stdev= 9.20, samples=581 iops : min= 1, max= 13, avg= 4.60, stdev= 2.35, samples=581 lat (msec) : 10=1.92%, 20=15.23%, 50=21.81%, 100=18.33%, 250=37.86% lat (msec) : 500=4.72%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.08%, ctx=5148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174251: Sat Sep 5 03:58:12 2026 read: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6028KiB/298556msec) clat (msec): min=5, max=555, avg=38.11, stdev=36.28 lat (msec): min=5, max=555, avg=38.11, stdev=36.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 107], | 99.00th=[ 184], 99.50th=[ 207], 99.90th=[ 313], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 119, per=28.36%, avg=22.69, stdev=15.76, samples=511 iops : min= 1, max= 29, avg= 5.04, stdev= 3.97, samples=511 write: IOPS=5, BW=20.0KiB/s (21.5kB/s)(6260KiB/298556msec); 0 zone resets clat (msec): min=48, max=1197, avg=153.75, stdev=74.34 lat (msec): min=48, max=1197, avg=153.75, stdev=74.34 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 205], 90.00th=[ 247], 95.00th=[ 288], | 99.00th=[ 388], 99.50th=[ 439], 99.90th=[ 617], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 48, per=24.43%, avg=20.52, stdev= 9.25, samples=584 iops : min= 1, max= 12, avg= 4.49, stdev= 2.37, samples=584 lat (msec) : 10=2.02%, 20=14.19%, 50=22.59%, 100=18.91%, 250=37.53% lat (msec) : 500=4.62%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174254: Sat Sep 5 03:58:12 2026 read: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6052KiB/299145msec) clat (msec): min=5, max=284, avg=37.00, stdev=35.03 lat (msec): min=5, max=284, avg=37.00, stdev=35.03 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 180], 99.50th=[ 226], 99.90th=[ 253], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 103, per=29.41%, avg=23.53, stdev=15.92, samples=496 iops : min= 1, max= 25, avg= 5.26, stdev= 4.02, samples=496 write: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6236KiB/299145msec); 0 zone resets clat (msec): min=38, max=1048, avg=155.58, stdev=74.58 lat (msec): min=38, max=1048, avg=155.58, stdev=74.58 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 73], 10.00th=[ 85], 20.00th=[ 101], | 30.00th=[ 113], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 205], 90.00th=[ 251], 95.00th=[ 292], | 99.00th=[ 388], 99.50th=[ 439], 99.90th=[ 726], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 48, per=24.40%, avg=20.49, stdev= 9.01, samples=583 iops : min= 1, max= 12, avg= 4.49, stdev= 2.31, samples=583 lat (msec) : 10=2.44%, 20=16.63%, 50=20.51%, 100=16.47%, 250=38.70% lat (msec) : 500=5.11%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5166, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=80.3KiB/s (82.2kB/s), 19.0KiB/s-20.2KiB/s (20.4kB/s-20.7kB/s), io=23.4MiB (24.6MB), run=297702-299145msec WRITE: bw=84.0KiB/s (86.1kB/s), 20.8KiB/s-21.3KiB/s (21.3kB/s-21.8kB/s), io=24.6MiB (25.7MB), run=297702-299145msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174310: Sat Sep 5 03:58:55 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(5920KiB/30457msec) clat (usec): min=35, max=274001, avg=38525.88, stdev=39957.33 lat (usec): min=35, max=274002, avg=38531.35, stdev=39953.56 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 44], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 85], 40.00th=[ 23725], 50.00th=[ 34341], 60.00th=[ 42730], | 70.00th=[ 49546], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[114820], | 99.00th=[166724], 99.50th=[187696], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 32, max= 440, per=26.60%, avg=197.66, stdev=84.15, samples=59 iops : min= 2, max= 27, avg=11.64, stdev= 5.33, samples=59 write: IOPS=13, BW=209KiB/s (214kB/s)(6368KiB/30457msec); 0 zone resets clat (usec): min=1409, max=556892, avg=40236.10, stdev=50479.17 lat (usec): min=1411, max=556895, avg=40239.02, stdev=50479.10 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1680], 10.00th=[ 2540], 20.00th=[ 5669], | 30.00th=[ 8455], 40.00th=[ 13304], 50.00th=[ 20579], 60.00th=[ 33817], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[102237], 95.00th=[137364], | 99.00th=[191890], 99.50th=[244319], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 30, max= 379, per=26.68%, avg=208.60, stdev=88.58, samples=60 iops : min= 1, max= 23, avg=12.33, stdev= 5.61, samples=60 lat (usec) : 50=2.86%, 100=12.63%, 250=0.78%, 500=0.26%, 750=0.13% lat (msec) : 2=3.91%, 4=3.91%, 10=10.03%, 20=8.98%, 50=26.30% lat (msec) : 100=21.35%, 250=8.59%, 500=0.13%, 750=0.13% cpu : usr=0.12%, sys=5.16%, ctx=1250, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174311: Sat Sep 5 03:58:55 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5744KiB/31465msec) clat (usec): min=38, max=214253, avg=39734.29, stdev=36473.03 lat (usec): min=38, max=214254, avg=39735.32, stdev=36472.99 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 61], 20.00th=[ 70], | 30.00th=[ 1598], 40.00th=[ 29754], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[149947], 99.50th=[177210], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 30, max= 339, per=24.57%, avg=182.55, stdev=74.46, samples=62 iops : min= 1, max= 21, avg=10.68, stdev= 4.72, samples=62 write: IOPS=12, BW=208KiB/s (213kB/s)(6544KiB/31465msec); 0 zone resets clat (usec): min=1324, max=369521, avg=41414.80, stdev=50052.68 lat (usec): min=1324, max=369523, avg=41418.60, stdev=50052.69 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1729], 10.00th=[ 2089], 20.00th=[ 5014], | 30.00th=[ 8717], 40.00th=[ 12387], 50.00th=[ 22414], 60.00th=[ 34866], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[105382], 95.00th=[128451], | 99.00th=[206570], 99.50th=[312476], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 62, max= 479, per=26.54%, avg=207.52, stdev=92.07, samples=62 iops : min= 3, max= 29, avg=12.26, stdev= 5.79, samples=62 lat (usec) : 50=1.30%, 100=11.59%, 250=0.91%, 1000=0.13% lat (msec) : 2=5.08%, 4=4.95%, 10=8.72%, 20=7.81%, 50=26.69% lat (msec) : 100=23.96%, 250=8.46%, 500=0.39% cpu : usr=0.10%, sys=5.34%, ctx=1380, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174312: Sat Sep 5 03:58:55 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(6256KiB/32209msec) clat (usec): min=32, max=191074, avg=41221.86, stdev=39294.84 lat (usec): min=32, max=191075, avg=41223.10, stdev=39294.73 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 61], 20.00th=[ 72], | 30.00th=[ 2311], 40.00th=[ 28443], 50.00th=[ 36963], 60.00th=[ 45876], | 70.00th=[ 55837], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[166724], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 383, per=26.55%, avg=197.29, stdev=77.60, samples=62 iops : min= 1, max= 23, avg=11.61, stdev= 4.89, samples=62 write: IOPS=11, BW=187KiB/s (192kB/s)(6032KiB/32209msec); 0 zone resets clat (usec): min=1324, max=321326, avg=42528.52, stdev=48867.10 lat (usec): min=1326, max=321329, avg=42537.87, stdev=48862.66 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1713], 10.00th=[ 2245], 20.00th=[ 5473], | 30.00th=[ 8160], 40.00th=[ 13829], 50.00th=[ 22414], 60.00th=[ 38536], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[105382], 95.00th=[129500], | 99.00th=[229639], 99.50th=[287310], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 62, max= 383, per=23.49%, avg=183.68, stdev=79.83, samples=63 iops : min= 3, max= 23, avg=10.75, stdev= 5.05, samples=63 lat (usec) : 50=2.21%, 100=11.59%, 250=0.52%, 500=0.39%, 750=0.13% lat (msec) : 2=4.95%, 4=3.12%, 10=9.38%, 20=8.07%, 50=24.48% lat (msec) : 100=25.26%, 250=9.51%, 500=0.39% cpu : usr=0.09%, sys=5.21%, ctx=1390, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174313: Sat Sep 5 03:58:55 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29704msec) clat (usec): min=33, max=208414, avg=36797.43, stdev=36388.95 lat (usec): min=33, max=208415, avg=36799.35, stdev=36388.40 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 67], | 30.00th=[ 99], 40.00th=[ 22676], 50.00th=[ 34866], 60.00th=[ 44827], | 70.00th=[ 55313], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[166724], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 409, per=27.15%, avg=201.69, stdev=86.99, samples=58 iops : min= 1, max= 25, avg=11.90, stdev= 5.41, samples=58 write: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29704msec); 0 zone resets clat (usec): min=1398, max=358580, avg=40133.80, stdev=45487.43 lat (usec): min=1400, max=358583, avg=40137.30, stdev=45487.91 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1778], 10.00th=[ 2474], 20.00th=[ 5604], | 30.00th=[ 8717], 40.00th=[ 12518], 50.00th=[ 20841], 60.00th=[ 35914], | 70.00th=[ 52167], 80.00th=[ 71828], 90.00th=[100140], 95.00th=[130548], | 99.00th=[179307], 99.50th=[214959], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 63, max= 446, per=26.92%, avg=210.50, stdev=74.24, samples=58 iops : min= 3, max= 27, avg=12.45, stdev= 4.74, samples=58 lat (usec) : 50=2.86%, 100=12.24%, 250=1.82%, 500=0.52% lat (msec) : 2=4.69%, 4=2.86%, 10=11.07%, 20=7.68%, 50=22.92% lat (msec) : 100=25.91%, 250=7.29%, 500=0.13% cpu : usr=0.08%, sys=5.48%, ctx=1310, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=744KiB/s (761kB/s), 183KiB/s-203KiB/s (187kB/s-208kB/s), io=23.4MiB (24.5MB), run=29704-32209msec WRITE: bw=782KiB/s (801kB/s), 187KiB/s-211KiB/s (192kB/s-216kB/s), io=24.6MiB (25.8MB), run=29704-32209msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174315: Sat Sep 5 03:59:44 2026 read: IOPS=4, BW=72.6KiB/s (74.3kB/s)(5920KiB/81576msec) clat (msec): min=8, max=374, avg=44.34, stdev=45.04 lat (msec): min=8, max=374, avg=44.35, stdev=45.04 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 100], 95.00th=[ 140], | 99.00th=[ 224], 99.50th=[ 268], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 347, per=29.21%, avg=85.58, stdev=57.35, samples=135 iops : min= 1, max= 21, avg= 4.54, stdev= 3.63, samples=135 write: IOPS=4, BW=78.1KiB/s (79.9kB/s)(6368KiB/81576msec); 0 zone resets clat (msec): min=53, max=720, avg=163.52, stdev=90.04 lat (msec): min=53, max=720, avg=163.52, stdev=90.04 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 79], 10.00th=[ 89], 20.00th=[ 102], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 169], 80.00th=[ 207], 90.00th=[ 275], 95.00th=[ 363], | 99.00th=[ 493], 99.50th=[ 625], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 30, max= 160, per=26.48%, avg=81.56, stdev=36.81, samples=153 iops : min= 1, max= 10, avg= 4.31, stdev= 2.38, samples=153 lat (msec) : 10=0.91%, 20=11.46%, 50=25.00%, 100=15.76%, 250=38.93% lat (msec) : 500=7.55%, 750=0.39% cpu : usr=0.04%, sys=1.26%, ctx=1381, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174316: Sat Sep 5 03:59:44 2026 read: IOPS=4, BW=71.5KiB/s (73.2kB/s)(5744KiB/80350msec) clat (msec): min=8, max=304, avg=42.18, stdev=39.21 lat (msec): min=8, max=304, avg=42.18, stdev=39.21 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 89], 95.00th=[ 138], | 99.00th=[ 182], 99.50th=[ 266], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 29, max= 382, per=29.78%, avg=87.25, stdev=58.18, samples=130 iops : min= 1, max= 23, avg= 4.68, stdev= 3.65, samples=130 write: IOPS=5, BW=81.4KiB/s (83.4kB/s)(6544KiB/80350msec); 0 zone resets clat (msec): min=43, max=500, avg=158.66, stdev=78.54 lat (msec): min=43, max=500, avg=158.66, stdev=78.54 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 75], 10.00th=[ 85], 20.00th=[ 100], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 211], 90.00th=[ 266], 95.00th=[ 326], | 99.00th=[ 409], 99.50th=[ 426], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 29, max= 160, per=27.17%, avg=83.68, stdev=37.59, samples=154 iops : min= 1, max= 10, avg= 4.44, stdev= 2.44, samples=154 lat (msec) : 10=0.52%, 20=12.24%, 50=24.48%, 100=16.93%, 250=38.67% lat (msec) : 500=7.03%, 750=0.13% cpu : usr=0.05%, sys=1.21%, ctx=1380, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174317: Sat Sep 5 03:59:44 2026 read: IOPS=4, BW=79.4KiB/s (81.3kB/s)(6256KiB/78781msec) clat (msec): min=7, max=283, avg=38.76, stdev=32.65 lat (msec): min=7, max=283, avg=38.76, stdev=32.65 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 81], 95.00th=[ 100], | 99.00th=[ 176], 99.50th=[ 251], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 348, per=33.22%, avg=97.34, stdev=68.42, samples=127 iops : min= 1, max= 21, avg= 5.30, stdev= 4.31, samples=127 write: IOPS=4, BW=76.6KiB/s (78.4kB/s)(6032KiB/78781msec); 0 zone resets clat (msec): min=47, max=723, avg=167.77, stdev=96.88 lat (msec): min=47, max=723, avg=167.78, stdev=96.88 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 99], | 30.00th=[ 111], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 157], | 70.00th=[ 176], 80.00th=[ 218], 90.00th=[ 296], 95.00th=[ 368], | 99.00th=[ 489], 99.50th=[ 550], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 29, max= 160, per=25.01%, avg=77.03, stdev=36.76, samples=154 iops : min= 1, max= 10, avg= 4.01, stdev= 2.36, samples=154 lat (msec) : 10=1.04%, 20=13.67%, 50=25.78%, 100=18.49%, 250=33.07% lat (msec) : 500=7.55%, 750=0.39% cpu : usr=0.04%, sys=1.14%, ctx=1404, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174318: Sat Sep 5 03:59:44 2026 read: IOPS=4, BW=74.3KiB/s (76.1kB/s)(6032KiB/81142msec) clat (msec): min=7, max=323, avg=41.72, stdev=38.65 lat (msec): min=7, max=323, avg=41.72, stdev=38.65 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 130], | 99.00th=[ 218], 99.50th=[ 264], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 349, per=31.00%, avg=90.84, stdev=57.99, samples=129 iops : min= 1, max= 21, avg= 4.91, stdev= 3.65, samples=129 write: IOPS=4, BW=77.1KiB/s (78.9kB/s)(6256KiB/81142msec); 0 zone resets clat (msec): min=50, max=547, avg=166.26, stdev=82.71 lat (msec): min=50, max=547, avg=166.26, stdev=82.71 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 79], 10.00th=[ 89], 20.00th=[ 102], | 30.00th=[ 114], 40.00th=[ 128], 50.00th=[ 144], 60.00th=[ 159], | 70.00th=[ 188], 80.00th=[ 224], 90.00th=[ 271], 95.00th=[ 334], | 99.00th=[ 456], 99.50th=[ 493], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 160, per=25.85%, avg=79.63, stdev=35.54, samples=154 iops : min= 1, max= 10, avg= 4.19, stdev= 2.32, samples=154 lat (msec) : 10=0.78%, 20=12.63%, 50=25.13%, 100=16.02%, 250=37.89% lat (msec) : 500=7.42%, 750=0.13% cpu : usr=0.04%, sys=1.09%, ctx=1366, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=294KiB/s (301kB/s), 71.5KiB/s-79.4KiB/s (73.2kB/s-81.3kB/s), io=23.4MiB (24.5MB), run=78781-81576msec WRITE: bw=309KiB/s (316kB/s), 76.6KiB/s-81.4KiB/s (78.4kB/s-83.4kB/s), io=24.6MiB (25.8MB), run=78781-81576msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174337: Sat Sep 5 03:59:59 2026 read: IOPS=1, BW=1716KiB/s (1757kB/s)(7168KiB/4178msec) clat (msec): min=99, max=275, avg=191.54, stdev=66.86 lat (msec): min=99, max=275, avg=191.54, stdev=66.86 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 116], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 213], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 247], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2023, max= 3038, per=60.19%, avg=2286.00, stdev=501.44, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=1, BW=1225KiB/s (1255kB/s)(5120KiB/4178msec); 0 zone resets clat (msec): min=337, max=970, avg=547.36, stdev=250.66 lat (msec): min=338, max=970, avg=547.46, stdev=250.65 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2003, max= 4096, per=50.92%, avg=2707.33, stdev=1202.66, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.07%, ctx=82, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174338: Sat Sep 5 03:59:59 2026 read: IOPS=0, BW=380KiB/s (389kB/s)(2048KiB/5392msec) clat (msec): min=125, max=219, avg=172.17, stdev=66.26 lat (msec): min=125, max=219, avg=172.17, stdev=66.26 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1473, max= 2048, per=46.35%, avg=1760.50, stdev=406.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1899KiB/s (1945kB/s)(10.0MiB/5392msec); 0 zone resets clat (msec): min=178, max=1101, avg=500.50, stdev=272.87 lat (msec): min=179, max=1101, avg=500.66, stdev=272.85 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 257], | 30.00th=[ 271], 40.00th=[ 388], 50.00th=[ 397], 60.00th=[ 506], | 70.00th=[ 575], 80.00th=[ 617], 90.00th=[ 726], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1473, max= 4087, per=55.56%, avg=2954.00, stdev=1237.19, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=33.33%, 2000=8.33% cpu : usr=0.02%, sys=4.04%, ctx=81, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174339: Sat Sep 5 03:59:59 2026 read: IOPS=1, BW=1142KiB/s (1170kB/s)(6144KiB/5378msec) clat (msec): min=124, max=590, avg=258.02, stdev=171.70 lat (msec): min=124, max=590, avg=258.03, stdev=171.70 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 224], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2035, max= 4023, per=66.72%, avg=2534.00, stdev=992.67, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1142KiB/s (1170kB/s)(6144KiB/5378msec); 0 zone resets clat (msec): min=224, max=1311, avg=619.60, stdev=412.02 lat (msec): min=224, max=1311, avg=619.74, stdev=411.99 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 634], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1539, max= 2048, per=36.49%, avg=1940.00, stdev=224.23, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.76%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174340: Sat Sep 5 03:59:59 2026 read: IOPS=1, BW=1139KiB/s (1167kB/s)(5120KiB/4494msec) clat (msec): min=112, max=694, avg=265.83, stdev=242.05 lat (msec): min=112, max=694, avg=265.84, stdev=242.05 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2003, max= 4023, per=70.86%, avg=2691.33, stdev=1153.48, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1595KiB/s (1633kB/s)(7168KiB/4494msec); 0 zone resets clat (msec): min=203, max=666, avg=436.26, stdev=188.74 lat (msec): min=203, max=667, avg=437.05, stdev=189.13 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 262], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 485], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 625], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1558, max= 4071, per=44.14%, avg=2347.00, stdev=985.70, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=33.33% cpu : usr=0.07%, sys=3.69%, ctx=134, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3798KiB/s (3889kB/s), 380KiB/s-1716KiB/s (389kB/s-1757kB/s), io=20.0MiB (20.0MB), run=4178-5392msec WRITE: bw=5318KiB/s (5445kB/s), 1142KiB/s-1899KiB/s (1170kB/s-1945kB/s), io=28.0MiB (29.4MB), run=4178-5392msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174342: Sat Sep 5 03:59:59 2026 read: IOPS=1, BW=1830KiB/s (1873kB/s)(7168KiB/3918msec) clat (usec): min=545, max=358625, avg=163650.36, stdev=131784.13 lat (usec): min=547, max=358626, avg=163651.78, stdev=131784.02 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 4817], | 30.00th=[128451], 40.00th=[128451], 50.00th=[181404], 60.00th=[200279], | 70.00th=[200279], 80.00th=[270533], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 1969, max= 4063, per=76.04%, avg=3005.00, stdev=1163.77, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1307KiB/s (1338kB/s)(5120KiB/3918msec); 0 zone resets clat (msec): min=371, max=821, avg=553.84, stdev=170.67 lat (msec): min=371, max=821, avg=553.92, stdev=170.66 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2027, max= 4087, per=49.13%, avg=2717.67, stdev=1185.89, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=11.72%, ctx=132, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174343: Sat Sep 5 03:59:59 2026 read: IOPS=0, BW=395KiB/s (405kB/s)(2048KiB/5182msec) clat (msec): min=243, max=273, avg=258.14, stdev=21.06 lat (msec): min=243, max=273, avg=258.14, stdev=21.06 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1818, max= 2043, per=48.85%, avg=1930.50, stdev=159.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1976KiB/s (2023kB/s)(10.0MiB/5182msec); 0 zone resets clat (msec): min=175, max=966, avg=466.20, stdev=267.19 lat (msec): min=175, max=966, avg=466.31, stdev=267.18 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 236], | 30.00th=[ 284], 40.00th=[ 292], 50.00th=[ 334], 60.00th=[ 414], | 70.00th=[ 527], 80.00th=[ 592], 90.00th=[ 852], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2003, max= 4079, per=54.70%, avg=3025.83, stdev=1098.95, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=11.45%, ctx=134, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174344: Sat Sep 5 03:59:59 2026 read: IOPS=1, BW=1788KiB/s (1831kB/s)(6144KiB/3437msec) clat (usec): min=526, max=315361, avg=136941.17, stdev=144101.49 lat (usec): min=527, max=315361, avg=136942.32, stdev=144101.04 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 26346], 50.00th=[ 26346], 60.00th=[210764], | 70.00th=[267387], 80.00th=[267387], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 2000, max= 3961, per=67.51%, avg=2668.00, stdev=1119.98, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1788KiB/s (1831kB/s)(6144KiB/3437msec); 0 zone resets clat (msec): min=129, max=769, avg=434.79, stdev=217.02 lat (msec): min=129, max=769, avg=434.87, stdev=217.02 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 468], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1980, max= 4063, per=45.58%, avg=2521.50, stdev=1028.00, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=12.14%, ctx=140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174345: Sat Sep 5 03:59:59 2026 read: IOPS=1, BW=1238KiB/s (1268kB/s)(5120KiB/4135msec) clat (usec): min=556, max=344099, avg=70039.42, stdev=153210.48 lat (usec): min=557, max=344101, avg=70040.64, stdev=153210.54 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 996], 60.00th=[ 996], | 70.00th=[ 3851], 80.00th=[ 3851], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1733KiB/s (1775kB/s)(7168KiB/4135msec); 0 zone resets clat (msec): min=207, max=929, avg=539.76, stdev=294.64 lat (msec): min=207, max=929, avg=539.85, stdev=294.65 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 275], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 443], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 810], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1376, max= 2035, per=34.18%, avg=1890.60, stdev=288.03, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 4=8.33%, 250=8.33%, 500=33.33%, 1000=25.00% cpu : usr=0.05%, sys=9.02%, ctx=168, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3952KiB/s (4047kB/s), 395KiB/s-1830KiB/s (405kB/s-1873kB/s), io=20.0MiB (20.0MB), run=3437-5182msec WRITE: bw=5533KiB/s (5666kB/s), 1307KiB/s-1976KiB/s (1338kB/s-2023kB/s), io=28.0MiB (29.4MB), run=3437-5182msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174352: Sat Sep 5 04:00:18 2026 read: IOPS=0, BW=2837KiB/s (2905kB/s)(12.0MiB/4331msec) clat (msec): min=1206, max=1581, avg=1406.21, stdev=189.03 lat (msec): min=1206, max=1581, avg=1406.22, stdev=189.03 clat percentiles (msec): | 1.00th=[ 1200], 5.00th=[ 1200], 10.00th=[ 1200], 20.00th=[ 1200], | 30.00th=[ 1200], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.05%, sys=8.18%, ctx=238, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174353: Sat Sep 5 04:00:18 2026 read: IOPS=0, BW=960KiB/s (983kB/s)(4096KiB/4267msec) clat (nsec): min=1440.1M, max=1440.1M, avg=1440114348.00, stdev= 0.00 lat (nsec): min=1440.1M, max=1440.1M, avg=1440128430.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1920KiB/s (1966kB/s)(8192KiB/4267msec); 0 zone resets clat (msec): min=541, max=2085, avg=1313.45, stdev=1091.77 lat (msec): min=543, max=2085, avg=1314.43, stdev=1090.92 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 2089], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=1.97%, ctx=138, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174354: Sat Sep 5 04:00:18 2026 write: IOPS=0, BW=4068KiB/s (4165kB/s)(12.0MiB/3021msec); 0 zone resets clat (msec): min=743, max=1165, avg=922.58, stdev=218.40 lat (msec): min=743, max=1166, avg=923.05, stdev=218.31 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.54%, ctx=44, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174356: Sat Sep 5 04:00:18 2026 write: IOPS=0, BW=3127KiB/s (3202kB/s)(12.0MiB/3930msec); 0 zone resets clat (msec): min=708, max=2127, avg=1223.44, stdev=785.26 lat (msec): min=710, max=2127, avg=1224.43, stdev=784.66 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.57%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3783KiB/s (3874kB/s), 960KiB/s-2837KiB/s (983kB/s-2905kB/s), io=16.0MiB (16.8MB), run=4267-4331msec WRITE: bw=7679KiB/s (7864kB/s), 1920KiB/s-4068KiB/s (1966kB/s-4165kB/s), io=32.0MiB (33.6MB), run=3021-4267msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174355: Sat Sep 5 04:00:20 2026 read: IOPS=0, BW=2779KiB/s (2846kB/s)(12.0MiB/4421msec) clat (msec): min=697, max=1898, avg=1447.93, stdev=654.48 lat (msec): min=697, max=1898, avg=1447.93, stdev=654.48 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8015, max= 8031, per=100.00%, avg=8023.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.04%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174357: Sat Sep 5 04:00:20 2026 read: IOPS=0, BW=755KiB/s (773kB/s)(4096KiB/5428msec) clat (nsec): min=2333.3M, max=2333.3M, avg=2333297179.00, stdev= 0.00 lat (nsec): min=2333.3M, max=2333.3M, avg=2333299690.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2333], 5.00th=[ 2333], 10.00th=[ 2333], 20.00th=[ 2333], | 30.00th=[ 2333], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1509KiB/s (1545kB/s)(8192KiB/5428msec); 0 zone resets clat (msec): min=948, max=1750, avg=1349.56, stdev=567.13 lat (msec): min=948, max=1751, avg=1350.23, stdev=567.53 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=1.88%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174358: Sat Sep 5 04:00:20 2026 write: IOPS=0, BW=2430KiB/s (2488kB/s)(12.0MiB/5057msec); 0 zone resets clat (msec): min=562, max=2167, avg=1594.94, stdev=895.93 lat (msec): min=566, max=2171, avg=1597.43, stdev=895.06 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 2056], 50.00th=[ 2056], 60.00th=[ 2056], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7984, max= 8159, per=100.00%, avg=8071.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.65%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174359: Sat Sep 5 04:00:20 2026 write: IOPS=0, BW=2309KiB/s (2364kB/s)(12.0MiB/5322msec); 0 zone resets clat (msec): min=508, max=3385, avg=1690.17, stdev=1505.58 lat (msec): min=508, max=3385, avg=1690.55, stdev=1505.57 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 7984, max= 8126, per=100.00%, avg=8055.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.84%, ctx=70, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3018KiB/s (3091kB/s), 755KiB/s-2779KiB/s (773kB/s-2846kB/s), io=16.0MiB (16.8MB), run=4421-5428msec WRITE: bw=6037KiB/s (6182kB/s), 1509KiB/s-2430KiB/s (1545kB/s-2488kB/s), io=32.0MiB (33.6MB), run=5057-5428msec