== sanity test 398b: DIO and buffer IO race ============== 21:44:57 (1787795097) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.16386 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147159: Wed Aug 26 21:47:42 2026 read: IOPS=10, BW=40.9KiB/s (41.9kB/s)(5992KiB/146486msec) clat (usec): min=37, max=573065, avg=47968.02, stdev=37288.79 lat (usec): min=37, max=573067, avg=47973.32, stdev=37289.77 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 13698], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[185598], 99.50th=[206570], 99.90th=[316670], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 95, per=25.26%, avg=41.18, stdev=19.53, samples=282 iops : min= 1, max= 23, avg= 9.61, stdev= 4.90, samples=282 write: IOPS=10, BW=42.0KiB/s (44.0kB/s)(6296KiB/146486msec); 0 zone resets clat (usec): min=1026, max=429425, avg=47281.88, stdev=49245.84 lat (usec): min=1027, max=429426, avg=47284.44, stdev=49246.22 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1680], 20.00th=[ 4817], | 30.00th=[ 11076], 40.00th=[ 22414], 50.00th=[ 33817], 60.00th=[ 47973], | 70.00th=[ 60556], 80.00th=[ 81265], 90.00th=[110625], 95.00th=[145753], | 99.00th=[227541], 99.50th=[246416], 99.90th=[287310], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 127, per=24.84%, avg=42.48, stdev=19.89, samples=287 iops : min= 1, max= 31, avg= 9.94, stdev= 5.01, samples=287 lat (usec) : 50=0.23%, 100=3.26%, 250=0.42%, 500=0.07%, 750=0.03% lat (msec) : 2=5.76%, 4=3.48%, 10=5.79%, 20=8.98%, 50=33.59% lat (msec) : 100=28.42%, 250=9.67%, 500=0.26%, 750=0.03% cpu : usr=0.06%, sys=4.40%, ctx=6656, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147160: Wed Aug 26 21:47:42 2026 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(5940KiB/146313msec) clat (usec): min=38, max=809429, avg=48847.01, stdev=41447.09 lat (usec): min=38, max=809431, avg=48850.49, stdev=41449.56 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 72], 10.00th=[ 13042], 20.00th=[ 21627], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 57410], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[183501], 99.50th=[212861], 99.90th=[320865], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 95, per=24.81%, avg=40.44, stdev=19.12, samples=285 iops : min= 1, max= 23, avg= 9.43, stdev= 4.81, samples=285 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6348KiB/146313msec); 0 zone resets clat (usec): min=1006, max=478805, avg=46363.72, stdev=48126.83 lat (usec): min=1007, max=478807, avg=46366.67, stdev=48126.68 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1942], 20.00th=[ 5145], | 30.00th=[ 11338], 40.00th=[ 22938], 50.00th=[ 35390], 60.00th=[ 46400], | 70.00th=[ 58983], 80.00th=[ 77071], 90.00th=[107480], 95.00th=[133694], | 99.00th=[221250], 99.50th=[250610], 99.90th=[304088], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 141, per=25.15%, avg=43.01, stdev=20.75, samples=287 iops : min= 1, max= 35, avg=10.07, stdev= 5.21, samples=287 lat (usec) : 50=0.16%, 100=3.29%, 250=0.20%, 500=0.13%, 750=0.03% lat (msec) : 2=5.37%, 4=3.55%, 10=6.38%, 20=8.56%, 50=35.19% lat (msec) : 100=27.05%, 250=9.70%, 500=0.36%, 1000=0.03% cpu : usr=0.08%, sys=4.60%, ctx=6678, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147161: Wed Aug 26 21:47:42 2026 read: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6028KiB/143341msec) clat (usec): min=26, max=346529, avg=47191.91, stdev=36689.48 lat (usec): min=26, max=346530, avg=47197.90, stdev=36690.39 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 11863], 20.00th=[ 20579], | 30.00th=[ 27919], 40.00th=[ 33424], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[164627], 99.50th=[238027], 99.90th=[312476], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 110, per=25.87%, avg=42.17, stdev=20.77, samples=278 iops : min= 1, max= 27, avg= 9.86, stdev= 5.23, samples=278 write: IOPS=10, BW=43.7KiB/s (44.7kB/s)(6260KiB/143341msec); 0 zone resets clat (usec): min=1064, max=892022, avg=45982.14, stdev=51070.40 lat (usec): min=1066, max=892026, avg=45987.89, stdev=51067.64 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1811], 20.00th=[ 4293], | 30.00th=[ 8979], 40.00th=[ 20841], 50.00th=[ 34341], 60.00th=[ 45876], | 70.00th=[ 62653], 80.00th=[ 79168], 90.00th=[109577], 95.00th=[132645], | 99.00th=[193987], 99.50th=[252707], 99.90th=[346031], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 119, per=25.52%, avg=43.64, stdev=20.38, samples=279 iops : min= 1, max= 29, avg=10.24, stdev= 5.13, samples=279 lat (usec) : 50=0.26%, 100=3.45%, 250=0.23%, 500=0.10%, 750=0.16% lat (usec) : 1000=0.07% lat (msec) : 2=5.76%, 4=3.94%, 10=6.80%, 20=8.43%, 50=33.98% lat (msec) : 100=27.31%, 250=9.05%, 500=0.42%, 1000=0.03% cpu : usr=0.07%, sys=4.47%, ctx=6495, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147162: Wed Aug 26 21:47:42 2026 read: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6052KiB/145923msec) clat (usec): min=38, max=313743, avg=47529.67, stdev=36841.55 lat (usec): min=39, max=313745, avg=47533.21, stdev=36841.07 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 12387], 20.00th=[ 22152], | 30.00th=[ 27657], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 56886], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[189793], 99.50th=[231736], 99.90th=[291505], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 95, per=25.59%, avg=41.71, stdev=20.71, samples=282 iops : min= 1, max= 23, avg= 9.74, stdev= 5.21, samples=282 write: IOPS=10, BW=42.7KiB/s (43.8kB/s)(6236KiB/145923msec); 0 zone resets clat (usec): min=986, max=962487, avg=47354.19, stdev=55778.98 lat (usec): min=987, max=962490, avg=47357.90, stdev=55779.88 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1795], 20.00th=[ 4555], | 30.00th=[ 8717], 40.00th=[ 19792], 50.00th=[ 33424], 60.00th=[ 47449], | 70.00th=[ 62653], 80.00th=[ 80217], 90.00th=[109577], 95.00th=[137364], | 99.00th=[227541], 99.50th=[256902], 99.90th=[608175], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 103, per=24.87%, avg=42.53, stdev=19.81, samples=285 iops : min= 1, max= 25, avg= 9.95, stdev= 4.98, samples=285 lat (usec) : 50=0.16%, 100=3.58%, 250=0.36%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.47%, 4=3.78%, 10=6.74%, 20=8.50%, 50=34.41% lat (msec) : 100=26.82%, 250=9.47%, 500=0.42%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.49%, ctx=6638, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=164KiB/s (168kB/s), 40.6KiB/s-42.1KiB/s (41.6kB/s-43.1kB/s), io=23.4MiB (24.6MB), run=143341-146486msec WRITE: bw=172KiB/s (176kB/s), 42.7KiB/s-43.7KiB/s (43.8kB/s-44.7kB/s), io=24.6MiB (25.7MB), run=143341-146486msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147154: Wed Aug 26 21:50:00 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(5992KiB/282985msec) clat (msec): min=6, max=684, avg=40.76, stdev=47.81 lat (msec): min=6, max=684, avg=40.77, stdev=47.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 86], 95.00th=[ 117], | 99.00th=[ 245], 99.50th=[ 305], 99.90th=[ 523], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 87, per=28.84%, avg=24.22, stdev=15.76, samples=477 iops : min= 1, max= 21, avg= 5.42, stdev= 3.99, samples=477 write: IOPS=5, BW=22.2KiB/s (22.8kB/s)(6296KiB/282985msec); 0 zone resets clat (msec): min=38, max=615, avg=140.73, stdev=73.20 lat (msec): min=38, max=615, avg=140.73, stdev=73.20 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 418], 99.50th=[ 489], 99.90th=[ 567], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 48, per=25.24%, avg=22.21, stdev=10.32, samples=544 iops : min= 1, max= 12, avg= 4.90, stdev= 2.63, samples=544 lat (msec) : 10=2.34%, 20=14.62%, 50=21.52%, 100=23.14%, 250=33.53% lat (msec) : 500=4.56%, 750=0.29% cpu : usr=0.04%, sys=1.11%, ctx=5269, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147155: Wed Aug 26 21:50:00 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(5940KiB/285197msec) clat (msec): min=5, max=871, avg=40.65, stdev=47.32 lat (msec): min=5, max=871, avg=40.66, stdev=47.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 83], 95.00th=[ 116], | 99.00th=[ 222], 99.50th=[ 296], 99.90th=[ 485], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 95, per=28.40%, avg=23.85, stdev=15.44, samples=480 iops : min= 1, max= 23, avg= 5.32, stdev= 3.89, samples=480 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6348KiB/285197msec); 0 zone resets clat (msec): min=41, max=611, avg=141.42, stdev=73.95 lat (msec): min=41, max=611, avg=141.43, stdev=73.96 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 234], 95.00th=[ 288], | 99.00th=[ 430], 99.50th=[ 481], 99.90th=[ 584], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 48, per=25.20%, avg=22.18, stdev=10.38, samples=550 iops : min= 1, max= 12, avg= 4.89, stdev= 2.65, samples=550 lat (msec) : 10=1.79%, 20=14.78%, 50=21.13%, 100=23.70%, 250=34.11% lat (msec) : 500=4.23%, 750=0.23%, 1000=0.03% cpu : usr=0.03%, sys=1.12%, ctx=5278, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147156: Wed Aug 26 21:50:00 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6028KiB/281256msec) clat (msec): min=6, max=435, avg=41.68, stdev=43.22 lat (msec): min=6, max=435, avg=41.68, stdev=43.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 90], 95.00th=[ 123], | 99.00th=[ 207], 99.50th=[ 266], 99.90th=[ 393], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 103, per=28.04%, avg=23.55, stdev=16.13, samples=493 iops : min= 1, max= 25, avg= 5.24, stdev= 4.07, samples=493 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6260KiB/281256msec); 0 zone resets clat (msec): min=45, max=987, avg=139.32, stdev=74.36 lat (msec): min=45, max=987, avg=139.33, stdev=74.37 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 232], 95.00th=[ 271], | 99.00th=[ 414], 99.50th=[ 502], 99.90th=[ 718], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 55, per=25.16%, avg=22.14, stdev=10.47, samples=543 iops : min= 1, max= 13, avg= 4.88, stdev= 2.67, samples=543 lat (msec) : 10=1.95%, 20=14.36%, 50=21.35%, 100=24.45%, 250=33.69% lat (msec) : 500=3.97%, 750=0.20%, 1000=0.03% cpu : usr=0.04%, sys=1.12%, ctx=5183, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147157: Wed Aug 26 21:50:00 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6052KiB/279909msec) clat (msec): min=6, max=519, avg=40.62, stdev=43.20 lat (msec): min=6, max=519, avg=40.62, stdev=43.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 89], 95.00th=[ 124], | 99.00th=[ 199], 99.50th=[ 292], 99.90th=[ 464], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 103, per=28.81%, avg=24.20, stdev=16.12, samples=482 iops : min= 1, max= 25, avg= 5.40, stdev= 4.06, samples=482 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6236KiB/279909msec); 0 zone resets clat (msec): min=33, max=1056, avg=139.88, stdev=75.57 lat (msec): min=33, max=1056, avg=139.88, stdev=75.57 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 153], 80.00th=[ 180], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 405], 99.50th=[ 456], 99.90th=[ 718], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 48, per=25.04%, avg=22.03, stdev=10.27, samples=543 iops : min= 1, max= 12, avg= 4.85, stdev= 2.62, samples=543 lat (msec) : 10=2.15%, 20=15.27%, 50=21.16%, 100=23.54%, 250=33.66% lat (msec) : 500=4.04%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5255, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=84.2KiB/s (86.2kB/s), 20.8KiB/s-21.6KiB/s (21.3kB/s-22.1kB/s), io=23.4MiB (24.6MB), run=279909-285197msec WRITE: bw=88.1KiB/s (90.3kB/s), 22.2KiB/s-22.3KiB/s (22.8kB/s-22.8kB/s), io=24.6MiB (25.7MB), run=279909-285197msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147224: Wed Aug 26 21:50:43 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(5920KiB/32256msec) clat (usec): min=39, max=239214, avg=42192.58, stdev=39976.54 lat (usec): min=39, max=239216, avg=42193.83, stdev=39976.55 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 100], | 30.00th=[ 19792], 40.00th=[ 29492], 50.00th=[ 36963], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[123208], | 99.00th=[181404], 99.50th=[217056], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 383, per=25.17%, avg=183.76, stdev=75.56, samples=63 iops : min= 1, max= 23, avg=10.79, stdev= 4.77, samples=63 write: IOPS=12, BW=197KiB/s (202kB/s)(6368KiB/32256msec); 0 zone resets clat (usec): min=1506, max=247445, avg=41661.82, stdev=44734.37 lat (usec): min=1508, max=247447, avg=41664.54, stdev=44734.18 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1975], 10.00th=[ 3097], 20.00th=[ 6390], | 30.00th=[ 9634], 40.00th=[ 16319], 50.00th=[ 23725], 60.00th=[ 36963], | 70.00th=[ 55837], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[133694], | 99.00th=[214959], 99.50th=[231736], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 476, per=25.73%, avg=197.63, stdev=94.30, samples=63 iops : min= 1, max= 29, avg=11.67, stdev= 5.96, samples=63 lat (usec) : 50=1.43%, 100=8.20%, 250=1.95%, 500=0.65%, 1000=0.26% lat (msec) : 2=2.99%, 4=4.17%, 10=9.64%, 20=8.33%, 50=28.39% lat (msec) : 100=25.65%, 250=8.33% cpu : usr=0.06%, sys=5.27%, ctx=1450, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147225: Wed Aug 26 21:50:43 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(5744KiB/32801msec) clat (usec): min=41, max=248099, avg=47196.76, stdev=38765.86 lat (usec): min=41, max=248099, avg=47198.11, stdev=38765.88 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 13960], | 30.00th=[ 27132], 40.00th=[ 34866], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 60556], 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[122160], | 99.00th=[173016], 99.50th=[189793], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 335, per=23.79%, avg=173.64, stdev=73.43, samples=64 iops : min= 1, max= 20, avg=10.12, stdev= 4.64, samples=64 write: IOPS=12, BW=200KiB/s (204kB/s)(6544KiB/32801msec); 0 zone resets clat (usec): min=1494, max=336337, avg=38667.99, stdev=43666.21 lat (usec): min=1496, max=336340, avg=38670.30, stdev=43666.19 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2057], 10.00th=[ 3523], 20.00th=[ 5538], | 30.00th=[ 9372], 40.00th=[ 14746], 50.00th=[ 23725], 60.00th=[ 33817], | 70.00th=[ 46924], 80.00th=[ 66847], 90.00th=[ 91751], 95.00th=[126354], | 99.00th=[166724], 99.50th=[248513], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 476, per=25.69%, avg=197.27, stdev=88.01, samples=64 iops : min= 1, max= 29, avg=11.64, stdev= 5.55, samples=64 lat (usec) : 50=0.52%, 100=6.38%, 250=1.04%, 500=0.13%, 1000=0.26% lat (msec) : 2=2.73%, 4=5.08%, 10=9.11%, 20=10.68%, 50=30.60% lat (msec) : 100=25.00%, 250=8.20%, 500=0.26% cpu : usr=0.06%, sys=5.67%, ctx=1535, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147226: Wed Aug 26 21:50:43 2026 read: IOPS=12, BW=195KiB/s (199kB/s)(6256KiB/32115msec) clat (usec): min=39, max=335946, avg=44102.82, stdev=44094.33 lat (usec): min=40, max=335948, avg=44104.22, stdev=44094.31 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 113], | 30.00th=[ 21627], 40.00th=[ 30016], 50.00th=[ 36963], 60.00th=[ 45351], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 90702], 95.00th=[120062], | 99.00th=[238027], 99.50th=[267387], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 443, per=27.00%, avg=197.10, stdev=92.15, samples=62 iops : min= 1, max= 27, avg=11.63, stdev= 5.88, samples=62 write: IOPS=11, BW=188KiB/s (192kB/s)(6032KiB/32115msec); 0 zone resets clat (usec): min=1405, max=210399, avg=39285.43, stdev=42011.74 lat (usec): min=1407, max=210401, avg=39290.85, stdev=42013.49 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1893], 10.00th=[ 2442], 20.00th=[ 5014], | 30.00th=[ 8979], 40.00th=[ 13698], 50.00th=[ 23200], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 70779], 90.00th=[101188], 95.00th=[124257], | 99.00th=[196084], 99.50th=[208667], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 62, max= 448, per=24.31%, avg=186.68, stdev=83.45, samples=62 iops : min= 3, max= 28, avg=10.97, stdev= 5.32, samples=62 lat (usec) : 50=1.04%, 100=8.33%, 250=1.95%, 500=0.13%, 750=0.52% lat (msec) : 2=3.39%, 4=5.21%, 10=7.94%, 20=8.98%, 50=29.95% lat (msec) : 100=23.57%, 250=8.72%, 500=0.26% cpu : usr=0.07%, sys=5.66%, ctx=1517, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147227: Wed Aug 26 21:50:43 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(6032KiB/31273msec) clat (usec): min=38, max=229061, avg=45563.27, stdev=38621.92 lat (usec): min=38, max=229062, avg=45565.97, stdev=38621.64 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 988], | 30.00th=[ 25297], 40.00th=[ 32375], 50.00th=[ 39584], 60.00th=[ 47449], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[111674], | 99.00th=[175113], 99.50th=[212861], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 31, max= 447, per=26.61%, avg=194.22, stdev=92.00, samples=60 iops : min= 1, max= 27, avg=11.43, stdev= 5.82, samples=60 write: IOPS=12, BW=200KiB/s (205kB/s)(6256KiB/31273msec); 0 zone resets clat (usec): min=1445, max=292339, avg=35898.67, stdev=42158.07 lat (usec): min=1446, max=292342, avg=35901.08, stdev=42158.03 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1926], 10.00th=[ 2376], 20.00th=[ 4686], | 30.00th=[ 7439], 40.00th=[ 10945], 50.00th=[ 20317], 60.00th=[ 29492], | 70.00th=[ 44303], 80.00th=[ 63701], 90.00th=[ 90702], 95.00th=[123208], | 99.00th=[189793], 99.50th=[225444], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 58, max= 416, per=26.50%, avg=203.48, stdev=71.24, samples=60 iops : min= 3, max= 26, avg=12.03, stdev= 4.55, samples=60 lat (usec) : 50=0.52%, 100=7.16%, 250=1.43%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=4.04%, 4=6.12%, 10=9.38%, 20=7.68%, 50=30.73% lat (msec) : 100=23.70%, 250=8.33%, 500=0.13% cpu : usr=0.05%, sys=5.54%, ctx=1507, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=730KiB/s (748kB/s), 175KiB/s-195KiB/s (179kB/s-199kB/s), io=23.4MiB (24.5MB), run=31273-32801msec WRITE: bw=768KiB/s (787kB/s), 188KiB/s-200KiB/s (192kB/s-205kB/s), io=24.6MiB (25.8MB), run=31273-32801msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147219: Wed Aug 26 21:51:22 2026 read: IOPS=5, BW=81.6KiB/s (83.6kB/s)(5920KiB/72534msec) clat (msec): min=6, max=310, avg=44.31, stdev=46.02 lat (msec): min=6, max=310, avg=44.31, stdev=46.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 107], 95.00th=[ 148], | 99.00th=[ 241], 99.50th=[ 296], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 319, per=29.40%, avg=96.42, stdev=58.06, samples=120 iops : min= 1, max= 19, avg= 5.28, stdev= 3.68, samples=120 write: IOPS=5, BW=87.8KiB/s (89.9kB/s)(6368KiB/72534msec); 0 zone resets clat (msec): min=41, max=418, avg=140.71, stdev=60.14 lat (msec): min=41, max=418, avg=140.72, stdev=60.14 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 106], 40.00th=[ 116], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 257], | 99.00th=[ 338], 99.50th=[ 405], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 191, per=25.79%, avg=88.96, stdev=38.24, samples=140 iops : min= 1, max= 11, avg= 4.80, stdev= 2.46, samples=140 lat (msec) : 10=1.30%, 20=11.85%, 50=24.61%, 100=17.45%, 250=41.02% lat (msec) : 500=3.78% cpu : usr=0.03%, sys=1.15%, ctx=1286, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147220: Wed Aug 26 21:51:22 2026 read: IOPS=4, BW=78.9KiB/s (80.8kB/s)(5744KiB/72837msec) clat (msec): min=6, max=406, avg=43.34, stdev=44.78 lat (msec): min=6, max=406, avg=43.34, stdev=44.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 60], 90.00th=[ 105], 95.00th=[ 136], | 99.00th=[ 194], 99.50th=[ 292], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 22, max= 351, per=27.24%, avg=89.34, stdev=60.93, samples=127 iops : min= 1, max= 21, avg= 4.83, stdev= 3.90, samples=127 write: IOPS=5, BW=89.8KiB/s (92.0kB/s)(6544KiB/72837msec); 0 zone resets clat (msec): min=38, max=443, avg=139.71, stdev=62.82 lat (msec): min=38, max=443, avg=139.71, stdev=62.82 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 65], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 129], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 180], 90.00th=[ 218], 95.00th=[ 262], | 99.00th=[ 359], 99.50th=[ 393], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 30, max= 256, per=26.46%, avg=91.28, stdev=42.95, samples=141 iops : min= 1, max= 16, avg= 4.95, stdev= 2.76, samples=141 lat (msec) : 10=1.30%, 20=13.67%, 50=22.14%, 100=18.49%, 250=41.41% lat (msec) : 500=2.99% cpu : usr=0.05%, sys=1.25%, ctx=1301, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147221: Wed Aug 26 21:51:22 2026 read: IOPS=5, BW=87.6KiB/s (89.7kB/s)(6256KiB/71388msec) clat (msec): min=7, max=403, avg=42.29, stdev=41.74 lat (msec): min=7, max=403, avg=42.30, stdev=41.75 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 94], 95.00th=[ 124], | 99.00th=[ 197], 99.50th=[ 321], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 317, per=28.46%, avg=93.36, stdev=62.09, samples=132 iops : min= 1, max= 19, avg= 5.09, stdev= 3.93, samples=132 write: IOPS=5, BW=84.5KiB/s (86.5kB/s)(6032KiB/71388msec); 0 zone resets clat (msec): min=56, max=444, avg=145.08, stdev=67.06 lat (msec): min=56, max=444, avg=145.08, stdev=67.06 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 81], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 114], 50.00th=[ 130], 60.00th=[ 144], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 239], 95.00th=[ 284], | 99.00th=[ 384], 99.50th=[ 426], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 160, per=24.70%, avg=85.21, stdev=34.98, samples=139 iops : min= 1, max= 10, avg= 4.57, stdev= 2.27, samples=139 lat (msec) : 10=0.39%, 20=13.54%, 50=25.78%, 100=20.18%, 250=35.68% lat (msec) : 500=4.43% cpu : usr=0.03%, sys=1.24%, ctx=1263, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147222: Wed Aug 26 21:51:22 2026 read: IOPS=5, BW=84.1KiB/s (86.1kB/s)(6032KiB/71754msec) clat (msec): min=7, max=340, avg=42.78, stdev=45.96 lat (msec): min=7, max=340, avg=42.79, stdev=45.96 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 92], 95.00th=[ 140], | 99.00th=[ 236], 99.50th=[ 330], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 288, per=29.46%, avg=96.63, stdev=68.33, samples=121 iops : min= 1, max= 18, avg= 5.27, stdev= 4.33, samples=121 write: IOPS=5, BW=87.2KiB/s (89.3kB/s)(6256KiB/71754msec); 0 zone resets clat (msec): min=53, max=422, avg=142.10, stdev=67.02 lat (msec): min=53, max=422, avg=142.10, stdev=67.02 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 82], 20.00th=[ 92], | 30.00th=[ 100], 40.00th=[ 114], 50.00th=[ 125], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 234], 95.00th=[ 275], | 99.00th=[ 384], 99.50th=[ 401], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 31, max= 160, per=25.60%, avg=88.31, stdev=38.59, samples=138 iops : min= 1, max= 10, avg= 4.76, stdev= 2.50, samples=138 lat (msec) : 10=0.91%, 20=13.67%, 50=23.44%, 100=22.53%, 250=35.42% lat (msec) : 500=4.04% cpu : usr=0.04%, sys=1.25%, ctx=1319, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=329KiB/s (337kB/s), 78.9KiB/s-87.6KiB/s (80.8kB/s-89.7kB/s), io=23.4MiB (24.5MB), run=71388-72837msec WRITE: bw=346KiB/s (354kB/s), 84.5KiB/s-89.8KiB/s (86.5kB/s-92.0kB/s), io=24.6MiB (25.8MB), run=71388-72837msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147249: Wed Aug 26 21:51:36 2026 read: IOPS=1, BW=1964KiB/s (2012kB/s)(7168KiB/3649msec) clat (usec): min=704, max=419442, avg=218872.01, stdev=133414.34 lat (usec): min=705, max=419444, avg=218873.80, stdev=133414.39 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[149947], | 30.00th=[160433], 40.00th=[160433], 50.00th=[240124], 60.00th=[246416], | 70.00th=[246416], 80.00th=[316670], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 2031, max= 4308, per=71.62%, avg=3420.67, stdev=1218.78, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1403KiB/s (1437kB/s)(5120KiB/3649msec); 0 zone resets clat (msec): min=231, max=757, avg=399.39, stdev=210.63 lat (msec): min=231, max=757, avg=399.51, stdev=210.62 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2035, max= 3856, per=39.58%, avg=2646.33, stdev=1047.62, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=18.48%, ctx=318, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147250: Wed Aug 26 21:51:36 2026 read: IOPS=0, BW=478KiB/s (489kB/s)(2048KiB/4288msec) clat (msec): min=192, max=199, avg=195.94, stdev= 4.65 lat (msec): min=192, max=199, avg=195.94, stdev= 4.65 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 1420, max= 2035, per=36.17%, avg=1727.50, stdev=434.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2388KiB/s (2445kB/s)(10.0MiB/4288msec); 0 zone resets clat (msec): min=56, max=762, avg=385.04, stdev=204.87 lat (msec): min=56, max=763, avg=385.25, stdev=205.01 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 218], | 30.00th=[ 271], 40.00th=[ 288], 50.00th=[ 317], 60.00th=[ 414], | 70.00th=[ 439], 80.00th=[ 460], 90.00th=[ 634], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1420, max= 4096, per=37.57%, avg=2512.00, stdev=1102.88, samples=7 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=14.79%, ctx=187, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147251: Wed Aug 26 21:51:36 2026 read: IOPS=1, BW=1454KiB/s (1488kB/s)(6144KiB/4227msec) clat (usec): min=518, max=324025, avg=148837.33, stdev=137397.61 lat (usec): min=530, max=324037, avg=148842.11, stdev=137398.31 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 766], | 30.00th=[ 766], 40.00th=[ 91751], 50.00th=[ 91751], 60.00th=[219153], | 70.00th=[256902], 80.00th=[256902], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 3856, max= 4096, per=83.25%, avg=3976.00, stdev=169.71, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1454KiB/s (1488kB/s)(6144KiB/4227msec); 0 zone resets clat (msec): min=184, max=918, avg=508.40, stdev=288.48 lat (msec): min=184, max=918, avg=508.47, stdev=288.48 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 651], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1499, max= 2048, per=28.32%, avg=1893.40, stdev=225.92, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=12.42%, ctx=167, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147252: Wed Aug 26 21:51:36 2026 read: IOPS=1, BW=1283KiB/s (1314kB/s)(5120KiB/3990msec) clat (usec): min=1338, max=293356, avg=184674.03, stdev=120565.47 lat (usec): min=1340, max=293357, avg=184675.50, stdev=120565.41 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1336], 10.00th=[ 1336], 20.00th=[ 1336], | 30.00th=[137364], 40.00th=[137364], 50.00th=[208667], 60.00th=[208667], | 70.00th=[283116], 80.00th=[283116], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 2035, max= 6095, per=85.11%, avg=4065.00, stdev=2870.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1796KiB/s (1840kB/s)(7168KiB/3990msec); 0 zone resets clat (msec): min=187, max=750, avg=393.41, stdev=245.27 lat (msec): min=187, max=750, avg=393.50, stdev=245.29 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 199], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 317], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 735], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1446, max= 4096, per=43.00%, avg=2875.00, stdev=1333.76, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 2=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=14.64%, ctx=192, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4776KiB/s (4891kB/s), 478KiB/s-1964KiB/s (489kB/s-2012kB/s), io=20.0MiB (20.0MB), run=3649-4288msec WRITE: bw=6687KiB/s (6847kB/s), 1403KiB/s-2388KiB/s (1437kB/s-2445kB/s), io=28.0MiB (29.4MB), run=3649-4288msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147244: Wed Aug 26 21:51:37 2026 read: IOPS=2, BW=2058KiB/s (2107kB/s)(7168KiB/3483msec) clat (msec): min=95, max=650, avg=249.44, stdev=184.58 lat (msec): min=95, max=650, avg=249.45, stdev=184.58 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 159], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 182], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 266], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1928, max= 4071, per=78.25%, avg=3011.25, stdev=1205.72, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1470KiB/s (1505kB/s)(5120KiB/3483msec); 0 zone resets clat (msec): min=158, max=489, avg=323.92, stdev=126.82 lat (msec): min=158, max=489, avg=324.04, stdev=126.83 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1921, max= 4096, per=49.64%, avg=2674.67, stdev=1231.66, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=4.11%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147245: Wed Aug 26 21:51:37 2026 read: IOPS=0, BW=385KiB/s (394kB/s)(2048KiB/5321msec) clat (msec): min=148, max=284, avg=216.69, stdev=96.11 lat (msec): min=148, max=284, avg=216.69, stdev=96.12 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1570, max= 2048, per=47.01%, avg=1809.00, stdev=338.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1924KiB/s (1971kB/s)(10.0MiB/5321msec); 0 zone resets clat (msec): min=131, max=1485, avg=479.97, stdev=405.18 lat (msec): min=131, max=1485, avg=480.16, stdev=405.18 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 207], | 30.00th=[ 224], 40.00th=[ 245], 50.00th=[ 309], 60.00th=[ 347], | 70.00th=[ 502], 80.00th=[ 575], 90.00th=[ 785], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 1818, max= 4087, per=43.44%, avg=2340.33, stdev=860.14, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.32%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147246: Wed Aug 26 21:51:37 2026 read: IOPS=1, BW=1215KiB/s (1244kB/s)(6144KiB/5058msec) clat (msec): min=76, max=819, avg=229.15, stdev=291.13 lat (msec): min=76, max=819, avg=229.15, stdev=291.13 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 113], 50.00th=[ 113], 60.00th=[ 125], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1818, max= 4087, per=68.85%, avg=2649.33, stdev=1250.13, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1215KiB/s (1244kB/s)(6144KiB/5058msec); 0 zone resets clat (msec): min=127, max=1617, avg=564.65, stdev=571.00 lat (msec): min=127, max=1617, avg=564.93, stdev=571.00 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 527], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 1582, max= 4087, per=45.11%, avg=2430.75, stdev=1123.99, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.65%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147247: Wed Aug 26 21:51:37 2026 read: IOPS=1, BW=1181KiB/s (1209kB/s)(5120KiB/4337msec) clat (msec): min=127, max=639, avg=329.89, stdev=230.67 lat (msec): min=127, max=639, avg=329.89, stdev=230.67 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2043, max= 3637, per=66.94%, avg=2576.00, stdev=918.86, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1653KiB/s (1692kB/s)(7168KiB/4337msec); 0 zone resets clat (msec): min=196, max=607, avg=376.46, stdev=135.32 lat (msec): min=196, max=607, avg=376.67, stdev=135.37 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 243], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 393], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 443], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1398, max= 3543, per=40.45%, avg=2179.67, stdev=714.85, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 250=41.67%, 500=33.33%, 750=25.00% cpu : usr=0.02%, sys=5.03%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3849KiB/s (3941kB/s), 385KiB/s-2058KiB/s (394kB/s-2107kB/s), io=20.0MiB (20.0MB), run=3483-5321msec WRITE: bw=5388KiB/s (5518kB/s), 1215KiB/s-1924KiB/s (1244kB/s-1971kB/s), io=28.0MiB (29.4MB), run=3483-5321msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147260: Wed Aug 26 21:51:52 2026 read: IOPS=0, BW=4016KiB/s (4112kB/s)(12.0MiB/3060msec) clat (msec): min=804, max=1098, avg=934.96, stdev=149.85 lat (msec): min=804, max=1098, avg=934.96, stdev=149.85 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.40%, ctx=385, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147262: Wed Aug 26 21:51:52 2026 read: IOPS=0, BW=1327KiB/s (1359kB/s)(4096KiB/3086msec) clat (nsec): min=1122.4M, max=1122.4M, avg=1122361095.00, stdev= 0.00 lat (nsec): min=1122.4M, max=1122.4M, avg=1122363585.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2655KiB/s (2718kB/s)(8192KiB/3086msec); 0 zone resets clat (msec): min=358, max=1481, avg=920.20, stdev=793.98 lat (msec): min=359, max=1482, avg=921.00, stdev=794.38 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8094, max= 8094, per=76.23%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.89%, ctx=179, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147263: Wed Aug 26 21:51:52 2026 write: IOPS=1, BW=4836KiB/s (4952kB/s)(12.0MiB/2541msec); 0 zone resets clat (msec): min=570, max=926, avg=792.66, stdev=193.67 lat (msec): min=634, max=929, avg=815.08, stdev=158.38 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8143, max= 8175, per=76.84%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=4.80%, ctx=41, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147265: Wed Aug 26 21:51:52 2026 write: IOPS=1, BW=4748KiB/s (4862kB/s)(12.0MiB/2588msec); 0 zone resets clat (msec): min=405, max=1502, avg=835.62, stdev=585.28 lat (msec): min=406, max=1502, avg=836.16, stdev=585.40 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 6041, max= 8143, per=66.79%, avg=7092.00, stdev=1486.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.91%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5309KiB/s (5437kB/s), 1327KiB/s-4016KiB/s (1359kB/s-4112kB/s), io=16.0MiB (16.8MB), run=3060-3086msec WRITE: bw=10.4MiB/s (10.9MB/s), 2655KiB/s-4836KiB/s (2718kB/s-4952kB/s), io=32.0MiB (33.6MB), run=2541-3086msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147259: Wed Aug 26 21:51:53 2026 read: IOPS=0, BW=3562KiB/s (3647kB/s)(12.0MiB/3450msec) clat (msec): min=221, max=1556, avg=1087.81, stdev=751.43 lat (msec): min=221, max=1556, avg=1087.81, stdev=751.43 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.22%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147261: Wed Aug 26 21:51:53 2026 read: IOPS=0, BW=1125KiB/s (1152kB/s)(4096KiB/3640msec) clat (nsec): min=1335.2M, max=1335.2M, avg=1335209403.00, stdev= 0.00 lat (nsec): min=1335.2M, max=1335.2M, avg=1335212386.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2251KiB/s (2305kB/s)(8192KiB/3640msec); 0 zone resets clat (msec): min=559, max=1660, avg=1110.22, stdev=778.85 lat (msec): min=562, max=1661, avg=1111.75, stdev=777.24 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.63%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147264: Wed Aug 26 21:51:53 2026 write: IOPS=0, BW=3006KiB/s (3078kB/s)(12.0MiB/4088msec); 0 zone resets clat (msec): min=268, max=1904, avg=1306.97, stdev=902.94 lat (msec): min=270, max=1906, avg=1308.27, stdev=902.54 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.72%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147266: Wed Aug 26 21:51:53 2026 write: IOPS=1, BW=4096KiB/s (4194kB/s)(12.0MiB/3000msec); 0 zone resets clat (msec): min=484, max=1510, avg=922.01, stdev=529.66 lat (msec): min=485, max=1511, avg=922.74, stdev=529.70 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.57%, ctx=80, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4501KiB/s (4609kB/s), 1125KiB/s-3562KiB/s (1152kB/s-3647kB/s), io=16.0MiB (16.8MB), run=3450-3640msec WRITE: bw=8016KiB/s (8208kB/s), 2251KiB/s-4096KiB/s (2305kB/s-4194kB/s), io=32.0MiB (33.6MB), run=3000-4088msec