== sanity test 398b: DIO and buffer IO race ============== 20:17:42 (1788567462) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.6471 s, 5.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178952: Fri Sep 4 20:20:48 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(5992KiB/158965msec) clat (usec): min=31, max=1307.8k, avg=57978.65, stdev=52218.28 lat (usec): min=31, max=1307.8k, avg=57982.33, stdev=52217.63 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 611], 10.00th=[ 17695], | 20.00th=[ 26870], 30.00th=[ 34341], 40.00th=[ 41157], | 50.00th=[ 48497], 60.00th=[ 57410], 70.00th=[ 67634], | 80.00th=[ 80217], 90.00th=[ 104334], 95.00th=[ 137364], | 99.00th=[ 214959], 99.50th=[ 254804], 99.90th=[ 383779], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 6, max= 87, per=25.34%, avg=37.75, stdev=17.58, samples=307 iops : min= 1, max= 21, avg= 8.78, stdev= 4.44, samples=307 write: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6296KiB/158965msec); 0 zone resets clat (usec): min=871, max=397604, avg=45448.94, stdev=50617.48 lat (usec): min=873, max=397607, avg=45452.99, stdev=50615.78 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 3916], | 30.00th=[ 8717], 40.00th=[ 20055], 50.00th=[ 31065], 60.00th=[ 42730], | 70.00th=[ 56361], 80.00th=[ 76022], 90.00th=[113771], 95.00th=[141558], | 99.00th=[212861], 99.50th=[287310], 99.90th=[371196], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 123, per=25.30%, avg=39.48, stdev=20.09, samples=309 iops : min= 1, max= 30, avg= 9.20, stdev= 5.05, samples=309 lat (usec) : 50=0.26%, 100=2.02%, 250=0.13%, 750=0.07%, 1000=0.10% lat (msec) : 2=7.03%, 4=3.22%, 10=6.05%, 20=7.32%, 50=32.98% lat (msec) : 100=28.65%, 250=11.56%, 500=0.59%, 2000=0.03% cpu : usr=0.05%, sys=3.82%, ctx=6030, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178953: Fri Sep 4 20:20:48 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(5940KiB/157149msec) clat (usec): min=40, max=375343, avg=57342.75, stdev=40955.62 lat (usec): min=41, max=375344, avg=57344.15, stdev=40955.61 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10683], 10.00th=[ 17695], 20.00th=[ 26870], | 30.00th=[ 33424], 40.00th=[ 40109], 50.00th=[ 48497], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[106431], 95.00th=[129500], | 99.00th=[200279], 99.50th=[254804], 99.90th=[362808], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 6, max= 119, per=25.54%, avg=38.06, stdev=19.32, samples=302 iops : min= 1, max= 29, avg= 8.85, stdev= 4.88, samples=302 write: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6348KiB/157149msec); 0 zone resets clat (usec): min=794, max=1231.6k, avg=44994.98, stdev=58687.71 lat (usec): min=795, max=1231.6k, avg=44997.25, stdev=58687.63 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1287], | 20.00th=[ 3261], 30.00th=[ 7504], 40.00th=[ 16581], | 50.00th=[ 28443], 60.00th=[ 41157], 70.00th=[ 56361], | 80.00th=[ 77071], 90.00th=[ 111674], 95.00th=[ 143655], | 99.00th=[ 229639], 99.50th=[ 246416], 99.90th=[ 492831], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 103, per=25.93%, avg=40.46, stdev=18.96, samples=303 iops : min= 1, max= 25, avg= 9.46, stdev= 4.77, samples=303 lat (usec) : 50=0.33%, 100=1.76%, 750=0.03%, 1000=0.29% lat (msec) : 2=7.03%, 4=4.07%, 10=6.18%, 20=8.14%, 50=30.99% lat (msec) : 100=29.10%, 250=11.56%, 500=0.49%, 2000=0.03% cpu : usr=0.06%, sys=3.87%, ctx=6054, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178955: Fri Sep 4 20:20:48 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6028KiB/160911msec) clat (usec): min=35, max=353997, avg=58137.63, stdev=43288.49 lat (usec): min=35, max=353998, avg=58139.47, stdev=43288.07 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 75], 10.00th=[ 17433], 20.00th=[ 25560], | 30.00th=[ 32900], 40.00th=[ 40109], 50.00th=[ 49021], 60.00th=[ 58459], | 70.00th=[ 70779], 80.00th=[ 86508], 90.00th=[108528], 95.00th=[133694], | 99.00th=[231736], 99.50th=[258999], 99.90th=[299893], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 7, max= 95, per=25.31%, avg=37.71, stdev=16.03, samples=310 iops : min= 1, max= 23, avg= 8.75, stdev= 4.04, samples=310 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6260KiB/160911msec); 0 zone resets clat (usec): min=677, max=1257.5k, avg=46444.09, stdev=59569.90 lat (usec): min=677, max=1257.5k, avg=46452.81, stdev=59571.39 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1156], 10.00th=[ 1287], | 20.00th=[ 3523], 30.00th=[ 7898], 40.00th=[ 19268], | 50.00th=[ 32113], 60.00th=[ 44303], 70.00th=[ 58459], | 80.00th=[ 80217], 90.00th=[ 109577], 95.00th=[ 145753], | 99.00th=[ 219153], 99.50th=[ 240124], 99.90th=[ 599786], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 103, per=25.16%, avg=39.26, stdev=20.64, samples=309 iops : min= 1, max= 25, avg= 9.17, stdev= 5.21, samples=309 lat (usec) : 50=0.65%, 100=2.08%, 250=0.10%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.42% lat (msec) : 2=6.97%, 4=3.48%, 10=6.35%, 20=6.51%, 50=31.48% lat (msec) : 100=29.10%, 250=12.21%, 500=0.42%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=3.95%, ctx=6158, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178957: Fri Sep 4 20:20:48 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6052KiB/160951msec) clat (usec): min=35, max=349630, avg=57070.23, stdev=41266.51 lat (usec): min=35, max=349632, avg=57072.22, stdev=41266.76 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 17957], 20.00th=[ 26870], | 30.00th=[ 33162], 40.00th=[ 40633], 50.00th=[ 49021], 60.00th=[ 57934], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[105382], 95.00th=[128451], | 99.00th=[200279], 99.50th=[258999], 99.90th=[329253], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 103, per=25.49%, avg=37.98, stdev=17.78, samples=309 iops : min= 1, max= 25, avg= 8.83, stdev= 4.47, samples=309 write: IOPS=9, BW=38.7KiB/s (39.7kB/s)(6236KiB/160951msec); 0 zone resets clat (usec): min=637, max=1380.0k, avg=47481.37, stdev=62186.61 lat (usec): min=638, max=1380.0k, avg=47485.00, stdev=62188.31 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1270], | 20.00th=[ 3392], 30.00th=[ 8029], 40.00th=[ 19530], | 50.00th=[ 31065], 60.00th=[ 44303], 70.00th=[ 60556], | 80.00th=[ 83362], 90.00th=[ 113771], 95.00th=[ 145753], | 99.00th=[ 221250], 99.50th=[ 246416], 99.90th=[ 608175], | 99.95th=[1384121], 99.99th=[1384121] bw ( KiB/s): min= 7, max= 103, per=24.98%, avg=38.97, stdev=18.94, samples=310 iops : min= 1, max= 25, avg= 9.08, stdev= 4.77, samples=310 lat (usec) : 50=0.81%, 100=2.34%, 250=0.03%, 750=0.07%, 1000=0.20% lat (msec) : 2=7.45%, 4=3.48%, 10=5.73%, 20=6.32%, 50=31.15% lat (msec) : 100=29.72%, 250=12.21%, 500=0.42%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=3.81%, ctx=5979, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 37.5KiB/s-37.8KiB/s (38.4kB/s-38.7kB/s), io=23.4MiB (24.6MB), run=157149-160951msec WRITE: bw=156KiB/s (160kB/s), 38.7KiB/s-40.4KiB/s (39.7kB/s-41.4kB/s), io=24.6MiB (25.7MB), run=157149-160951msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178950: Fri Sep 4 20:21:38 2026 read: IOPS=7, BW=28.6KiB/s (29.3kB/s)(5992KiB/209598msec) clat (msec): min=5, max=1268, avg=55.47, stdev=62.00 lat (msec): min=5, max=1268, avg=55.48, stdev=62.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 31], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 61], 80.00th=[ 81], 90.00th=[ 117], 95.00th=[ 155], | 99.00th=[ 284], 99.50th=[ 321], 99.90th=[ 642], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 135, per=26.43%, avg=29.87, stdev=22.03, samples=387 iops : min= 1, max= 33, avg= 6.78, stdev= 5.54, samples=387 write: IOPS=7, BW=30.0KiB/s (30.8kB/s)(6296KiB/209598msec); 0 zone resets clat (msec): min=9, max=526, avg=80.01, stdev=61.48 lat (msec): min=9, max=526, avg=80.01, stdev=61.48 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 74], | 70.00th=[ 92], 80.00th=[ 120], 90.00th=[ 163], 95.00th=[ 205], | 99.00th=[ 300], 99.50th=[ 351], 99.90th=[ 447], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 110, per=25.78%, avg=30.67, stdev=21.01, samples=396 iops : min= 1, max= 27, avg= 6.98, stdev= 5.29, samples=396 lat (msec) : 10=1.89%, 20=10.58%, 50=40.07%, 100=27.38%, 250=18.36% lat (msec) : 500=1.63%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.26%, ctx=4587, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178951: Fri Sep 4 20:21:38 2026 read: IOPS=7, BW=28.1KiB/s (28.8kB/s)(5940KiB/211259msec) clat (msec): min=4, max=1296, avg=56.20, stdev=66.09 lat (msec): min=4, max=1298, avg=56.22, stdev=66.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 78], 90.00th=[ 131], 95.00th=[ 169], | 99.00th=[ 271], 99.50th=[ 347], 99.90th=[ 667], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 103, per=26.45%, avg=29.89, stdev=21.96, samples=384 iops : min= 1, max= 25, avg= 6.78, stdev= 5.54, samples=384 write: IOPS=7, BW=30.0KiB/s (30.8kB/s)(6348KiB/211259msec); 0 zone resets clat (msec): min=9, max=605, avg=80.16, stdev=63.42 lat (msec): min=9, max=605, avg=80.17, stdev=63.42 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 73], | 70.00th=[ 90], 80.00th=[ 122], 90.00th=[ 163], 95.00th=[ 209], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 126, per=25.58%, avg=30.44, stdev=21.62, samples=403 iops : min= 1, max= 31, avg= 6.92, stdev= 5.44, samples=403 lat (msec) : 10=1.92%, 20=10.68%, 50=40.43%, 100=26.14%, 250=18.91% lat (msec) : 500=1.76%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=4616, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178954: Fri Sep 4 20:21:38 2026 read: IOPS=7, BW=28.8KiB/s (29.5kB/s)(6028KiB/209493msec) clat (msec): min=4, max=481, avg=55.12, stdev=52.30 lat (msec): min=4, max=481, avg=55.13, stdev=52.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 47], | 70.00th=[ 62], 80.00th=[ 80], 90.00th=[ 122], 95.00th=[ 159], | 99.00th=[ 255], 99.50th=[ 292], 99.90th=[ 460], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 163, per=26.45%, avg=29.89, stdev=21.97, samples=389 iops : min= 1, max= 40, avg= 6.78, stdev= 5.52, samples=389 write: IOPS=7, BW=29.9KiB/s (30.6kB/s)(6260KiB/209493msec); 0 zone resets clat (msec): min=10, max=1263, avg=80.41, stdev=69.88 lat (msec): min=10, max=1263, avg=80.41, stdev=69.88 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 90], 80.00th=[ 122], 90.00th=[ 163], 95.00th=[ 207], | 99.00th=[ 317], 99.50th=[ 363], 99.90th=[ 609], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 111, per=25.33%, avg=30.14, stdev=21.08, samples=401 iops : min= 1, max= 27, avg= 6.85, stdev= 5.30, samples=401 lat (msec) : 10=2.05%, 20=10.09%, 50=39.71%, 100=28.09%, 250=18.23% lat (msec) : 500=1.76%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=4433, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178956: Fri Sep 4 20:21:38 2026 read: IOPS=7, BW=28.8KiB/s (29.5kB/s)(6052KiB/210065msec) clat (msec): min=5, max=729, avg=54.44, stdev=56.13 lat (msec): min=5, max=729, avg=54.44, stdev=56.13 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 125], 95.00th=[ 165], | 99.00th=[ 264], 99.50th=[ 368], 99.90th=[ 485], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 135, per=26.68%, avg=30.15, stdev=22.26, samples=387 iops : min= 1, max= 33, avg= 6.84, stdev= 5.59, samples=387 write: IOPS=7, BW=29.7KiB/s (30.4kB/s)(6236KiB/210065msec); 0 zone resets clat (msec): min=9, max=1302, avg=81.58, stdev=70.01 lat (msec): min=9, max=1302, avg=81.58, stdev=70.01 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 94], 80.00th=[ 116], 90.00th=[ 157], 95.00th=[ 220], | 99.00th=[ 313], 99.50th=[ 359], 99.90th=[ 600], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 126, per=25.32%, avg=30.14, stdev=20.62, samples=398 iops : min= 1, max= 31, avg= 6.85, stdev= 5.18, samples=398 lat (msec) : 10=1.76%, 20=11.30%, 50=39.13%, 100=27.25%, 250=18.52% lat (msec) : 500=1.95%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.26%, ctx=4589, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=114KiB/s (116kB/s), 28.1KiB/s-28.8KiB/s (28.8kB/s-29.5kB/s), io=23.4MiB (24.6MB), run=209493-211259msec WRITE: bw=119KiB/s (122kB/s), 29.7KiB/s-30.0KiB/s (30.4kB/s-30.8kB/s), io=24.6MiB (25.7MB), run=209493-211259msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179009: Fri Sep 4 20:22:27 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5920KiB/35245msec) clat (usec): min=33, max=188308, avg=51428.18, stdev=34644.87 lat (usec): min=33, max=188309, avg=51438.26, stdev=34646.65 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 8225], 20.00th=[ 24249], | 30.00th=[ 32375], 40.00th=[ 40633], 50.00th=[ 45876], 60.00th=[ 53740], | 70.00th=[ 63701], 80.00th=[ 78119], 90.00th=[ 92799], 95.00th=[109577], | 99.00th=[183501], 99.50th=[187696], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 60, max= 348, per=25.33%, avg=170.74, stdev=66.32, samples=68 iops : min= 3, max= 21, avg= 9.94, stdev= 4.23, samples=68 write: IOPS=11, BW=181KiB/s (185kB/s)(6368KiB/35245msec); 0 zone resets clat (usec): min=1367, max=265490, avg=39678.21, stdev=41360.65 lat (usec): min=1370, max=265492, avg=39682.97, stdev=41359.26 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1745], 10.00th=[ 2343], 20.00th=[ 5669], | 30.00th=[ 10421], 40.00th=[ 17171], 50.00th=[ 24773], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[130548], | 99.00th=[187696], 99.50th=[200279], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 471, per=25.87%, avg=183.41, stdev=85.01, samples=68 iops : min= 1, max= 29, avg=10.78, stdev= 5.42, samples=68 lat (usec) : 50=0.52%, 100=3.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.69%, 4=3.52%, 10=7.29%, 20=9.90%, 50=32.16% lat (msec) : 100=29.69%, 250=8.07%, 500=0.13% cpu : usr=0.07%, sys=4.34%, ctx=1583, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179012: Fri Sep 4 20:22:27 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(5744KiB/35502msec) clat (usec): min=45, max=276982, avg=54168.63, stdev=37196.88 lat (usec): min=46, max=276983, avg=54170.05, stdev=37196.86 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 16188], 20.00th=[ 29754], | 30.00th=[ 35390], 40.00th=[ 40109], 50.00th=[ 47973], 60.00th=[ 54789], | 70.00th=[ 65799], 80.00th=[ 81265], 90.00th=[ 96994], 95.00th=[126354], | 99.00th=[177210], 99.50th=[204473], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 30, max= 352, per=24.01%, avg=161.80, stdev=69.77, samples=70 iops : min= 1, max= 22, avg= 9.40, stdev= 4.49, samples=70 write: IOPS=11, BW=184KiB/s (189kB/s)(6544KiB/35502msec); 0 zone resets clat (usec): min=1447, max=177552, avg=38334.54, stdev=39094.47 lat (usec): min=1450, max=177553, avg=38336.77, stdev=39094.62 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1795], 10.00th=[ 2409], 20.00th=[ 5080], | 30.00th=[ 9634], 40.00th=[ 17433], 50.00th=[ 28181], 60.00th=[ 36439], | 70.00th=[ 47973], 80.00th=[ 62653], 90.00th=[ 90702], 95.00th=[132645], | 99.00th=[162530], 99.50th=[166724], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 61, max= 384, per=25.85%, avg=183.29, stdev=82.23, samples=70 iops : min= 3, max= 24, avg=10.77, stdev= 5.19, samples=70 lat (usec) : 50=0.26%, 100=3.65%, 250=0.26%, 500=0.13% lat (msec) : 2=4.04%, 4=4.69%, 10=7.68%, 20=6.51%, 50=35.29% lat (msec) : 100=29.04%, 250=8.33%, 500=0.13% cpu : usr=0.06%, sys=4.66%, ctx=1586, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179013: Fri Sep 4 20:22:27 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34650msec) clat (usec): min=36, max=201230, avg=51369.54, stdev=34377.66 lat (usec): min=37, max=201231, avg=51371.06, stdev=34377.77 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 60], 10.00th=[ 77], 20.00th=[ 27657], | 30.00th=[ 34341], 40.00th=[ 40109], 50.00th=[ 47973], 60.00th=[ 54789], | 70.00th=[ 63701], 80.00th=[ 74974], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[179307], 99.50th=[183501], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 62, max= 380, per=27.25%, avg=183.66, stdev=67.87, samples=67 iops : min= 3, max= 23, avg=10.78, stdev= 4.37, samples=67 write: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34650msec); 0 zone resets clat (usec): min=1298, max=227980, avg=37568.93, stdev=38558.66 lat (usec): min=1299, max=227982, avg=37577.87, stdev=38559.84 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1762], 10.00th=[ 2008], 20.00th=[ 5538], | 30.00th=[ 8979], 40.00th=[ 16319], 50.00th=[ 24511], 60.00th=[ 35914], | 70.00th=[ 47973], 80.00th=[ 65799], 90.00th=[ 94897], 95.00th=[112722], | 99.00th=[160433], 99.50th=[187696], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 470, per=24.62%, avg=174.54, stdev=91.07, samples=67 iops : min= 1, max= 29, avg=10.21, stdev= 5.81, samples=67 lat (usec) : 50=0.78%, 100=4.95% lat (msec) : 2=5.08%, 4=2.73%, 10=8.07%, 20=7.42%, 50=33.07% lat (msec) : 100=30.08%, 250=7.81% cpu : usr=0.05%, sys=4.40%, ctx=1581, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179014: Fri Sep 4 20:22:27 2026 read: IOPS=11, BW=178KiB/s (183kB/s)(6032KiB/33796msec) clat (usec): min=40, max=219583, avg=47771.41, stdev=35269.59 lat (usec): min=41, max=219584, avg=47775.80, stdev=35265.35 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 21627], | 30.00th=[ 29492], 40.00th=[ 36439], 50.00th=[ 44303], 60.00th=[ 51119], | 70.00th=[ 63177], 80.00th=[ 72877], 90.00th=[ 89654], 95.00th=[106431], | 99.00th=[168821], 99.50th=[189793], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 63, max= 318, per=26.67%, avg=179.72, stdev=67.88, samples=65 iops : min= 3, max= 19, avg=10.51, stdev= 4.29, samples=65 write: IOPS=11, BW=185KiB/s (190kB/s)(6256KiB/33796msec); 0 zone resets clat (usec): min=1319, max=219596, avg=40086.20, stdev=39468.57 lat (usec): min=1321, max=219598, avg=40088.78, stdev=39468.66 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1827], 10.00th=[ 2769], 20.00th=[ 5997], | 30.00th=[ 11076], 40.00th=[ 19268], 50.00th=[ 27395], 60.00th=[ 38011], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[119014], | 99.00th=[179307], 99.50th=[185598], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 63, max= 447, per=26.04%, avg=184.61, stdev=79.42, samples=66 iops : min= 3, max= 27, avg=10.83, stdev= 5.05, samples=66 lat (usec) : 50=0.78%, 100=6.25%, 250=0.13%, 500=0.26% lat (msec) : 2=3.52%, 4=4.17%, 10=6.90%, 20=8.20%, 50=33.59% lat (msec) : 100=28.13%, 250=8.07% cpu : usr=0.07%, sys=4.75%, ctx=1565, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=675KiB/s (691kB/s), 162KiB/s-181KiB/s (166kB/s-185kB/s), io=23.4MiB (24.5MB), run=33796-35502msec WRITE: bw=710KiB/s (727kB/s), 174KiB/s-185KiB/s (178kB/s-190kB/s), io=24.6MiB (25.8MB), run=33796-35502msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179007: Fri Sep 4 20:22:41 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5920KiB/48886msec) clat (msec): min=7, max=287, avg=53.03, stdev=44.96 lat (msec): min=7, max=287, avg=53.03, stdev=44.96 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 78], 90.00th=[ 109], 95.00th=[ 157], | 99.00th=[ 209], 99.50th=[ 264], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 350, per=25.99%, avg=125.28, stdev=70.20, samples=92 iops : min= 1, max= 21, avg= 7.03, stdev= 4.47, samples=92 write: IOPS=8, BW=130KiB/s (133kB/s)(6368KiB/48886msec); 0 zone resets clat (msec): min=18, max=320, avg=72.47, stdev=46.86 lat (msec): min=18, max=320, avg=72.48, stdev=46.86 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 68], | 70.00th=[ 79], 80.00th=[ 104], 90.00th=[ 134], 95.00th=[ 169], | 99.00th=[ 241], 99.50th=[ 268], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 347, per=26.10%, avg=132.31, stdev=71.52, samples=94 iops : min= 1, max= 21, avg= 7.48, stdev= 4.55, samples=94 lat (msec) : 10=0.39%, 20=6.25%, 50=45.83%, 100=30.34%, 250=16.54% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.39%, ctx=1064, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179008: Fri Sep 4 20:22:41 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(5744KiB/49311msec) clat (msec): min=8, max=304, avg=50.43, stdev=42.03 lat (msec): min=8, max=304, avg=50.44, stdev=42.03 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 105], 95.00th=[ 136], | 99.00th=[ 230], 99.50th=[ 247], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 320, per=25.00%, avg=120.52, stdev=72.65, samples=93 iops : min= 1, max= 20, avg= 6.73, stdev= 4.61, samples=93 write: IOPS=8, BW=133KiB/s (136kB/s)(6544KiB/49311msec); 0 zone resets clat (msec): min=13, max=301, avg=75.11, stdev=49.16 lat (msec): min=13, max=301, avg=75.11, stdev=49.16 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 61], 60.00th=[ 70], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 142], 95.00th=[ 174], | 99.00th=[ 255], 99.50th=[ 275], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 347, per=26.59%, avg=134.79, stdev=75.54, samples=95 iops : min= 1, max= 21, avg= 7.64, stdev= 4.78, samples=95 lat (msec) : 10=0.52%, 20=6.90%, 50=46.35%, 100=29.43%, 250=15.89% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.49%, ctx=1168, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179010: Fri Sep 4 20:22:41 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(6256KiB/49295msec) clat (msec): min=7, max=311, avg=52.82, stdev=41.73 lat (msec): min=7, max=311, avg=52.82, stdev=41.73 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 74], 90.00th=[ 107], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 352, per=26.37%, avg=127.10, stdev=84.68, samples=97 iops : min= 1, max= 22, avg= 7.15, stdev= 5.36, samples=97 write: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49295msec); 0 zone resets clat (msec): min=17, max=284, avg=75.43, stdev=48.88 lat (msec): min=17, max=284, avg=75.44, stdev=48.88 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 110], 90.00th=[ 150], 95.00th=[ 178], | 99.00th=[ 243], 99.50th=[ 247], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 317, per=23.92%, avg=121.29, stdev=64.53, samples=97 iops : min= 1, max= 19, avg= 6.78, stdev= 4.09, samples=97 lat (msec) : 10=0.78%, 20=5.99%, 50=44.40%, 100=31.38%, 250=17.19% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.43%, ctx=1123, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179011: Fri Sep 4 20:22:41 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49687msec) clat (msec): min=6, max=304, avg=54.12, stdev=48.70 lat (msec): min=6, max=304, avg=54.12, stdev=48.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 80], 90.00th=[ 121], 95.00th=[ 165], | 99.00th=[ 255], 99.50th=[ 288], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 352, per=26.53%, avg=127.86, stdev=74.13, samples=92 iops : min= 1, max= 22, avg= 7.20, stdev= 4.73, samples=92 write: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49687msec); 0 zone resets clat (msec): min=15, max=324, avg=73.65, stdev=49.52 lat (msec): min=15, max=324, avg=73.65, stdev=49.52 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 101], 90.00th=[ 140], 95.00th=[ 176], | 99.00th=[ 288], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 316, per=24.83%, avg=125.89, stdev=75.13, samples=98 iops : min= 1, max= 19, avg= 7.07, stdev= 4.76, samples=98 lat (msec) : 10=0.78%, 20=8.72%, 50=41.15%, 100=32.81%, 250=15.10% lat (msec) : 500=1.43% cpu : usr=0.03%, sys=1.39%, ctx=1133, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=482KiB/s (494kB/s), 116KiB/s-127KiB/s (119kB/s-130kB/s), io=23.4MiB (24.5MB), run=48886-49687msec WRITE: bw=507KiB/s (519kB/s), 122KiB/s-133KiB/s (125kB/s-136kB/s), io=24.6MiB (25.8MB), run=48886-49687msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179027: Fri Sep 4 20:23:02 2026 read: IOPS=2, BW=2976KiB/s (3047kB/s)(7168KiB/2409msec) clat (msec): min=98, max=502, avg=188.64, stdev=142.67 lat (msec): min=98, max=502, avg=188.98, stdev=142.47 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 114], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 138], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 203], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2000, max= 4899, per=100.00%, avg=2731.25, stdev=1445.18, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=2, BW=2125KiB/s (2176kB/s)(5120KiB/2409msec); 0 zone resets clat (msec): min=126, max=376, avg=211.06, stdev=98.87 lat (msec): min=126, max=376, avg=211.28, stdev=98.87 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1633, max= 4000, per=75.65%, avg=2548.00, stdev=1271.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=4.65%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179028: Fri Sep 4 20:23:02 2026 read: IOPS=0, BW=241KiB/s (246kB/s)(2048KiB/8511msec) clat (msec): min=124, max=134, avg=129.32, stdev= 6.85 lat (msec): min=124, max=134, avg=129.32, stdev= 6.85 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 134], | 70.00th=[ 134], 80.00th=[ 134], 90.00th=[ 134], 95.00th=[ 134], | 99.00th=[ 134], 99.50th=[ 134], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 1665, max= 2027, per=76.72%, avg=1846.00, stdev=255.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1203KiB/s (1232kB/s)(10.0MiB/8511msec); 0 zone resets clat (msec): min=152, max=4560, avg=815.46, stdev=1328.25 lat (msec): min=152, max=4560, avg=815.81, stdev=1328.17 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 199], | 30.00th=[ 232], 40.00th=[ 347], 50.00th=[ 376], 60.00th=[ 464], | 70.00th=[ 535], 80.00th=[ 550], 90.00th=[ 743], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1992, max= 3330, per=64.86%, avg=2184.50, stdev=463.09, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.73%, ctx=108, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179029: Fri Sep 4 20:23:02 2026 read: IOPS=0, BW=893KiB/s (914kB/s)(6144KiB/6880msec) clat (msec): min=100, max=572, avg=369.66, stdev=203.67 lat (msec): min=100, max=572, avg=369.66, stdev=203.67 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 514], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2000, max= 4023, per=100.00%, avg=2510.50, stdev=1008.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=893KiB/s (914kB/s)(6144KiB/6880msec); 0 zone resets clat (msec): min=199, max=2801, avg=752.26, stdev=1017.94 lat (msec): min=199, max=2801, avg=752.39, stdev=1017.92 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 439], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1992, max= 3330, per=67.55%, avg=2275.20, stdev=589.92, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=16.67%, 750=33.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.91%, ctx=243, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179030: Fri Sep 4 20:23:02 2026 read: IOPS=0, BW=855KiB/s (875kB/s)(5120KiB/5991msec) clat (msec): min=113, max=443, avg=318.23, stdev=123.15 lat (msec): min=113, max=443, avg=318.23, stdev=123.15 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2000, max= 4000, per=100.00%, avg=2670.33, stdev=1151.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1196KiB/s (1225kB/s)(7168KiB/5991msec); 0 zone resets clat (msec): min=129, max=2933, avg=618.43, stdev=1024.00 lat (msec): min=129, max=2933, avg=618.63, stdev=1023.95 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 169], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 226], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 380], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2011, max= 4039, per=86.58%, avg=2916.00, stdev=1058.06, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=41.67%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=1.92%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2406KiB/s (2464kB/s), 241KiB/s-2976KiB/s (246kB/s-3047kB/s), io=20.0MiB (20.0MB), run=2409-8511msec WRITE: bw=3369KiB/s (3450kB/s), 893KiB/s-2125KiB/s (914kB/s-2176kB/s), io=28.0MiB (29.4MB), run=2409-8511msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179032: Fri Sep 4 20:23:02 2026 read: IOPS=1, BW=1144KiB/s (1171kB/s)(7168KiB/6267msec) clat (msec): min=89, max=2461, avg=732.33, stdev=943.54 lat (msec): min=89, max=2461, avg=732.34, stdev=943.54 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 192], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 203], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 1687], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1560, max= 3968, per=93.61%, avg=2385.25, stdev=1076.49, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=817KiB/s (837kB/s)(5120KiB/6267msec); 0 zone resets clat (msec): min=137, max=392, avg=227.63, stdev=99.82 lat (msec): min=137, max=393, avg=227.72, stdev=99.82 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1965, max= 5774, per=100.00%, avg=3869.50, stdev=2693.37, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.87%, ctx=612, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179033: Fri Sep 4 20:23:02 2026 read: IOPS=0, BW=255KiB/s (261kB/s)(2048KiB/8035msec) clat (msec): min=134, max=571, avg=352.86, stdev=309.21 lat (msec): min=134, max=571, avg=352.86, stdev=309.21 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1622, max= 1924, per=69.58%, avg=1773.00, stdev=213.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1274KiB/s (1305kB/s)(10.0MiB/8035msec); 0 zone resets clat (msec): min=199, max=3708, avg=731.51, stdev=1066.65 lat (msec): min=200, max=3708, avg=731.68, stdev=1066.62 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 249], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 334], 60.00th=[ 401], | 70.00th=[ 405], 80.00th=[ 550], 90.00th=[ 919], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1924, max= 4071, per=72.46%, avg=2585.43, stdev=1012.87, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.40%, ctx=90, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179034: Fri Sep 4 20:23:02 2026 read: IOPS=0, BW=972KiB/s (996kB/s)(6144KiB/6319msec) clat (usec): min=854, max=301580, avg=154528.16, stdev=125433.69 lat (usec): min=856, max=301582, avg=154529.72, stdev=125433.50 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[ 2212], | 30.00th=[ 2212], 40.00th=[179307], 50.00th=[179307], 60.00th=[204473], | 70.00th=[238027], 80.00th=[238027], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 2023, max= 3968, per=100.00%, avg=3280.00, stdev=1090.22, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=972KiB/s (996kB/s)(6144KiB/6319msec); 0 zone resets clat (msec): min=191, max=4150, avg=896.49, stdev=1595.19 lat (msec): min=191, max=4150, avg=896.60, stdev=1595.18 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 268], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 4144], 95.00th=[ 4144], | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4144], 99.95th=[ 4144], | 99.99th=[ 4144] bw ( KiB/s): min= 1924, max= 4047, per=77.75%, avg=2774.00, stdev=1024.13, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=50.00%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=6.51%, ctx=164, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179035: Fri Sep 4 20:23:02 2026 read: IOPS=0, BW=751KiB/s (769kB/s)(5120KiB/6815msec) clat (usec): min=1795, max=365552, avg=87750.66, stdev=157572.46 lat (usec): min=1796, max=365554, avg=87752.17, stdev=157572.64 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 1795], 10.00th=[ 1795], 20.00th=[ 1795], | 30.00th=[ 2933], 40.00th=[ 2933], 50.00th=[ 3982], 60.00th=[ 3982], | 70.00th=[ 64750], 80.00th=[ 64750], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 4047, max= 4063, per=100.00%, avg=4055.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1052KiB/s (1077kB/s)(7168KiB/6815msec); 0 zone resets clat (msec): min=122, max=4738, avg=910.47, stdev=1695.09 lat (msec): min=122, max=4739, avg=910.66, stdev=1695.31 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 138], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 279], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 535], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1615, max= 4063, per=80.93%, avg=2887.50, stdev=1248.05, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 2=8.33%, 4=16.67%, 100=8.33%, 250=25.00%, 500=25.00% lat (msec) : 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.27%, ctx=170, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2549KiB/s (2610kB/s), 255KiB/s-1144KiB/s (261kB/s-1171kB/s), io=20.0MiB (20.0MB), run=6267-8035msec WRITE: bw=3568KiB/s (3654kB/s), 817KiB/s-1274KiB/s (837kB/s-1305kB/s), io=28.0MiB (29.4MB), run=6267-8035msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179047: Fri Sep 4 20:23:22 2026 read: IOPS=0, BW=3625KiB/s (3712kB/s)(12.0MiB/3390msec) clat (msec): min=464, max=1744, avg=1024.42, stdev=655.06 lat (msec): min=464, max=1744, avg=1024.42, stdev=655.07 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.63%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179048: Fri Sep 4 20:23:22 2026 read: IOPS=0, BW=1263KiB/s (1294kB/s)(4096KiB/3242msec) clat (nsec): min=737194k, max=737194k, avg=737194057.00, stdev= 0.00 lat (nsec): min=737196k, max=737196k, avg=737195919.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2527KiB/s (2587kB/s)(8192KiB/3242msec); 0 zone resets clat (msec): min=1024, max=1310, avg=1167.55, stdev=201.74 lat (msec): min=1025, max=1310, avg=1168.13, stdev=201.51 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.89%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179049: Fri Sep 4 20:23:22 2026 write: IOPS=0, BW=2896KiB/s (2966kB/s)(12.0MiB/4243msec); 0 zone resets clat (msec): min=328, max=3372, avg=1373.60, stdev=1732.09 lat (msec): min=329, max=3376, avg=1374.95, stdev=1733.55 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.73%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179050: Fri Sep 4 20:23:22 2026 write: IOPS=0, BW=3647KiB/s (3735kB/s)(12.0MiB/3369msec); 0 zone resets clat (msec): min=330, max=2261, avg=1037.78, stdev=1064.19 lat (msec): min=330, max=2262, avg=1038.28, stdev=1064.18 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 5809, max= 8062, per=89.81%, avg=6935.50, stdev=1593.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.12%, sys=3.41%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4833KiB/s (4949kB/s), 1263KiB/s-3625KiB/s (1294kB/s-3712kB/s), io=16.0MiB (16.8MB), run=3242-3390msec WRITE: bw=7723KiB/s (7908kB/s), 2527KiB/s-3647KiB/s (2587kB/s-3735kB/s), io=32.0MiB (33.6MB), run=3242-4243msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179051: Fri Sep 4 20:23:22 2026 read: IOPS=1, BW=4204KiB/s (4305kB/s)(12.0MiB/2923msec) clat (msec): min=882, max=967, avg=938.10, stdev=47.96 lat (msec): min=882, max=967, avg=938.11, stdev=47.96 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=9.34%, ctx=176, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179052: Fri Sep 4 20:23:22 2026 read: IOPS=0, BW=1295KiB/s (1326kB/s)(4096KiB/3163msec) clat (nsec): min=833165k, max=833165k, avg=833165377.00, stdev= 0.00 lat (nsec): min=833169k, max=833169k, avg=833168961.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2590KiB/s (2652kB/s)(8192KiB/3163msec); 0 zone resets clat (msec): min=1038, max=1171, avg=1104.82, stdev=93.70 lat (msec): min=1038, max=1171, avg=1105.27, stdev=93.90 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.83%, ctx=73, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179053: Fri Sep 4 20:23:22 2026 write: IOPS=0, BW=2841KiB/s (2909kB/s)(12.0MiB/4325msec); 0 zone resets clat (msec): min=166, max=3818, avg=1420.37, stdev=2077.55 lat (msec): min=167, max=3818, avg=1420.77, stdev=2077.61 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.41%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179054: Fri Sep 4 20:23:22 2026 write: IOPS=0, BW=3466KiB/s (3549kB/s)(12.0MiB/3545msec); 0 zone resets clat (msec): min=644, max=1867, avg=1140.99, stdev=643.00 lat (msec): min=645, max=1867, avg=1141.60, stdev=642.89 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.57%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5180KiB/s (5304kB/s), 1295KiB/s-4204KiB/s (1326kB/s-4305kB/s), io=16.0MiB (16.8MB), run=2923-3163msec WRITE: bw=7576KiB/s (7758kB/s), 2590KiB/s-3466KiB/s (2652kB/s-3549kB/s), io=32.0MiB (33.6MB), run=3163-4325msec