== sanity test 398b: DIO and buffer IO race ============== 00:05:37 (1790741137) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.92246 s, 7.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145560: Wed Sep 30 00:08:13 2026 read: IOPS=10, BW=43.9KiB/s (44.0kB/s)(5992KiB/136494msec) clat (usec): min=32, max=344441, avg=44774.07, stdev=35634.44 lat (usec): min=32, max=344443, avg=44781.76, stdev=35629.96 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 73], 10.00th=[ 8455], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[185598], 99.50th=[225444], 99.90th=[337642], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 95, per=25.14%, avg=43.99, stdev=18.51, samples=265 iops : min= 1, max= 23, avg=10.34, stdev= 4.64, samples=265 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6296KiB/136494msec); 0 zone resets clat (usec): min=1050, max=1175.5k, avg=43699.00, stdev=51575.28 lat (usec): min=1051, max=1175.5k, avg=43701.43, stdev=51575.19 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1401], 10.00th=[ 2442], | 20.00th=[ 5735], 30.00th=[ 10683], 40.00th=[ 20055], | 50.00th=[ 31851], 60.00th=[ 42730], 70.00th=[ 56361], | 80.00th=[ 74974], 90.00th=[ 101188], 95.00th=[ 126354], | 99.00th=[ 187696], 99.50th=[ 206570], 99.90th=[ 354419], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 119, per=25.17%, avg=46.05, stdev=18.69, samples=266 iops : min= 1, max= 29, avg=10.86, stdev= 4.70, samples=266 lat (usec) : 50=0.29%, 100=3.32%, 250=0.52%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.26%, 4=3.81%, 10=7.26%, 20=9.38%, 50=36.88% lat (msec) : 100=26.20%, 250=7.49%, 500=0.26%, 2000=0.03% cpu : usr=0.09%, sys=5.04%, ctx=6727, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145561: Wed Sep 30 00:08:13 2026 read: IOPS=10, BW=43.9KiB/s (45.0kB/s)(5940KiB/135165msec) clat (usec): min=34, max=363879, avg=44922.60, stdev=32643.12 lat (usec): min=34, max=363879, avg=44924.95, stdev=32642.64 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 73], 10.00th=[ 13042], 20.00th=[ 21627], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[ 99091], | 99.00th=[160433], 99.50th=[187696], 99.90th=[274727], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 104, per=24.98%, avg=43.71, stdev=18.50, samples=265 iops : min= 1, max= 26, avg=10.27, stdev= 4.67, samples=265 write: IOPS=11, BW=46.0KiB/s (48.1kB/s)(6348KiB/135165msec); 0 zone resets clat (usec): min=1020, max=1153.7k, avg=42809.06, stdev=49372.58 lat (usec): min=1021, max=1153.7k, avg=42814.11, stdev=49370.71 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1434], 10.00th=[ 2442], | 20.00th=[ 5669], 30.00th=[ 10552], 40.00th=[ 20317], | 50.00th=[ 31327], 60.00th=[ 42206], 70.00th=[ 57934], | 80.00th=[ 74974], 90.00th=[ 99091], 95.00th=[ 117965], | 99.00th=[ 175113], 99.50th=[ 198181], 99.90th=[ 291505], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 102, per=25.45%, avg=46.57, stdev=19.44, samples=266 iops : min= 1, max= 25, avg=10.99, stdev= 4.89, samples=266 lat (usec) : 50=0.20%, 100=3.35%, 250=0.42%, 500=0.16% lat (msec) : 2=4.59%, 4=3.48%, 10=7.42%, 20=9.41%, 50=36.20% lat (msec) : 100=27.51%, 250=7.10%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=5.13%, ctx=6750, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145563: Wed Sep 30 00:08:13 2026 read: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6028KiB/137033msec) clat (usec): min=39, max=1257.9k, avg=45468.84, stdev=47090.85 lat (usec): min=39, max=1257.9k, avg=45472.21, stdev=47090.11 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 79], 10.00th=[ 13304], | 20.00th=[ 21365], 30.00th=[ 26870], 40.00th=[ 32113], | 50.00th=[ 38011], 60.00th=[ 44827], 70.00th=[ 54264], | 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[ 102237], | 99.00th=[ 143655], 99.50th=[ 223347], 99.90th=[ 497026], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 95, per=25.07%, avg=43.87, stdev=18.01, samples=266 iops : min= 1, max= 23, avg=10.31, stdev= 4.53, samples=266 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6260KiB/137033msec); 0 zone resets clat (usec): min=998, max=555882, avg=43435.05, stdev=45845.58 lat (usec): min=999, max=555884, avg=43443.85, stdev=45842.67 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1401], 10.00th=[ 2089], 20.00th=[ 5276], | 30.00th=[ 9896], 40.00th=[ 20841], 50.00th=[ 32113], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[128451], | 99.00th=[189793], 99.50th=[227541], 99.90th=[463471], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 118, per=24.72%, avg=45.24, stdev=18.81, samples=267 iops : min= 1, max= 29, avg=10.65, stdev= 4.73, samples=267 lat (usec) : 50=0.23%, 100=2.80%, 250=0.59%, 500=0.16%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=4.79%, 4=3.42%, 10=7.49%, 20=8.92%, 50=36.82% lat (msec) : 100=26.73%, 250=7.65%, 500=0.20%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.15%, ctx=6686, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145564: Wed Sep 30 00:08:13 2026 read: IOPS=11, BW=44.3KiB/s (45.4kB/s)(6052KiB/136488msec) clat (usec): min=33, max=324358, avg=44446.47, stdev=31794.44 lat (usec): min=33, max=324359, avg=44449.36, stdev=31793.98 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 71], 10.00th=[ 11600], 20.00th=[ 21627], | 30.00th=[ 26870], 40.00th=[ 32900], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 54264], 80.00th=[ 65799], 90.00th=[ 85459], 95.00th=[100140], | 99.00th=[143655], 99.50th=[156238], 99.90th=[278922], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 104, per=25.53%, avg=44.67, stdev=19.07, samples=263 iops : min= 1, max= 26, avg=10.51, stdev= 4.79, samples=263 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6236KiB/136488msec); 0 zone resets clat (usec): min=915, max=1474.3k, avg=44036.62, stdev=58562.31 lat (usec): min=915, max=1474.3k, avg=44043.32, stdev=58562.93 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1385], 10.00th=[ 2376], | 20.00th=[ 5276], 30.00th=[ 10290], 40.00th=[ 19792], | 50.00th=[ 32900], 60.00th=[ 43779], 70.00th=[ 57410], | 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[ 123208], | 99.00th=[ 187696], 99.50th=[ 223347], 99.90th=[ 616563], | 99.95th=[1468007], 99.99th=[1468007] bw ( KiB/s): min= 7, max= 103, per=24.88%, avg=45.52, stdev=18.37, samples=266 iops : min= 1, max= 25, avg=10.73, stdev= 4.63, samples=266 lat (usec) : 50=0.42%, 100=3.19%, 250=0.55%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=4.43%, 4=3.74%, 10=7.16%, 20=9.31%, 50=36.17% lat (msec) : 100=27.28%, 250=7.23%, 500=0.16%, 750=0.07%, 2000=0.03% cpu : usr=0.10%, sys=5.08%, ctx=6801, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=175KiB/s (179kB/s), 43.9KiB/s-44.3KiB/s (44.0kB/s-45.4kB/s), io=23.4MiB (24.6MB), run=135165-137033msec WRITE: bw=183KiB/s (188kB/s), 45.7KiB/s-46.0KiB/s (46.8kB/s-48.1kB/s), io=24.6MiB (25.7MB), run=135165-137033msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145565: Wed Sep 30 00:10:39 2026 read: IOPS=5, BW=21.3KiB/s (21.8kB/s)(5992KiB/281026msec) clat (msec): min=5, max=1241, avg=35.70, stdev=45.59 lat (msec): min=5, max=1241, avg=35.70, stdev=45.59 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 74], 95.00th=[ 103], | 99.00th=[ 180], 99.50th=[ 222], 99.90th=[ 292], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 88, per=29.21%, avg=24.54, stdev=16.43, samples=471 iops : min= 1, max= 22, avg= 5.47, stdev= 4.15, samples=471 write: IOPS=5, BW=22.4KiB/s (22.9kB/s)(6296KiB/281026msec); 0 zone resets clat (msec): min=37, max=575, avg=144.22, stdev=67.17 lat (msec): min=37, max=575, avg=144.23, stdev=67.17 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 128], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 363], 99.50th=[ 376], 99.90th=[ 518], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 56, per=25.11%, avg=22.09, stdev= 9.71, samples=547 iops : min= 1, max= 14, avg= 4.86, stdev= 2.48, samples=547 lat (msec) : 10=2.15%, 20=17.35%, 50=20.87%, 100=19.69%, 250=35.61% lat (msec) : 500=4.20%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5086, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145566: Wed Sep 30 00:10:39 2026 read: IOPS=5, BW=21.0KiB/s (21.5kB/s)(5940KiB/282837msec) clat (msec): min=5, max=1253, avg=37.08, stdev=47.42 lat (msec): min=5, max=1253, avg=37.09, stdev=47.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 309], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 111, per=28.57%, avg=24.00, stdev=16.36, samples=477 iops : min= 1, max= 27, avg= 5.34, stdev= 4.12, samples=477 write: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6348KiB/282837msec); 0 zone resets clat (msec): min=41, max=566, avg=143.19, stdev=66.83 lat (msec): min=41, max=566, avg=143.20, stdev=66.84 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 230], 95.00th=[ 275], | 99.00th=[ 368], 99.50th=[ 422], 99.90th=[ 510], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 56, per=25.14%, avg=22.13, stdev= 9.66, samples=551 iops : min= 1, max= 14, avg= 4.87, stdev= 2.46, samples=551 lat (msec) : 10=2.64%, 20=15.82%, 50=21.09%, 100=20.44%, 250=36.10% lat (msec) : 500=3.81%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.14%, ctx=5082, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145567: Wed Sep 30 00:10:39 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6028KiB/282320msec) clat (msec): min=6, max=443, avg=37.36, stdev=36.28 lat (msec): min=6, max=443, avg=37.36, stdev=36.28 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 159], 99.50th=[ 222], 99.90th=[ 368], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 95, per=28.09%, avg=23.60, stdev=16.31, samples=492 iops : min= 1, max= 23, avg= 5.23, stdev= 4.10, samples=492 write: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6260KiB/282320msec); 0 zone resets clat (msec): min=43, max=1470, avg=144.16, stdev=75.78 lat (msec): min=43, max=1470, avg=144.16, stdev=75.78 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 397], 99.50th=[ 430], 99.90th=[ 617], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7, max= 48, per=24.97%, avg=21.97, stdev= 9.89, samples=547 iops : min= 1, max= 12, avg= 4.83, stdev= 2.52, samples=547 lat (msec) : 10=2.64%, 20=14.91%, 50=21.65%, 100=21.19%, 250=35.90% lat (msec) : 500=3.55%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145568: Wed Sep 30 00:10:39 2026 read: IOPS=5, BW=21.5KiB/s (22.0kB/s)(6052KiB/281164msec) clat (msec): min=5, max=441, avg=36.98, stdev=37.63 lat (msec): min=5, max=441, avg=36.99, stdev=37.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 81], 95.00th=[ 107], | 99.00th=[ 186], 99.50th=[ 215], 99.90th=[ 380], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 103, per=28.91%, avg=24.29, stdev=16.89, samples=480 iops : min= 1, max= 25, avg= 5.42, stdev= 4.26, samples=480 write: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6236KiB/281164msec); 0 zone resets clat (msec): min=40, max=1436, avg=144.17, stdev=74.40 lat (msec): min=40, max=1436, avg=144.17, stdev=74.40 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 232], 95.00th=[ 271], | 99.00th=[ 384], 99.50th=[ 460], 99.90th=[ 617], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 48, per=24.85%, avg=21.87, stdev= 9.67, samples=546 iops : min= 1, max= 12, avg= 4.80, stdev= 2.47, samples=546 lat (msec) : 10=2.28%, 20=16.28%, 50=21.19%, 100=20.90%, 250=35.61% lat (msec) : 500=3.55%, 750=0.16%, 2000=0.03% cpu : usr=0.06%, sys=1.19%, ctx=5216, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=84.9KiB/s (86.9kB/s), 21.0KiB/s-21.5KiB/s (21.5kB/s-22.0kB/s), io=23.4MiB (24.6MB), run=281026-282837msec WRITE: bw=88.9KiB/s (91.0kB/s), 22.2KiB/s-22.4KiB/s (22.7kB/s-22.0kB/s), io=24.6MiB (25.7MB), run=281026-282837msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145623: Wed Sep 30 00:11:25 2026 read: IOPS=11, BW=176KiB/s (181kB/s)(5920KiB/33584msec) clat (usec): min=34, max=457571, avg=45420.48, stdev=43008.86 lat (usec): min=34, max=457572, avg=45422.80, stdev=43009.14 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 94], | 30.00th=[ 24773], 40.00th=[ 33162], 50.00th=[ 40109], 60.00th=[ 48497], | 70.00th=[ 60556], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[149947], 99.50th=[196084], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 62, max= 381, per=24.70%, avg=175.65, stdev=74.04, samples=66 iops : min= 3, max= 23, avg=10.20, stdev= 4.66, samples=66 write: IOPS=11, BW=190KiB/s (194kB/s)(6368KiB/33584msec); 0 zone resets clat (usec): min=1385, max=276125, avg=41856.67, stdev=41682.18 lat (usec): min=1386, max=276126, avg=41859.84, stdev=41682.58 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1860], 10.00th=[ 2999], 20.00th=[ 5145], | 30.00th=[ 10290], 40.00th=[ 17433], 50.00th=[ 28705], 60.00th=[ 40109], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[166724], 99.50th=[181404], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 411, per=25.34%, avg=189.52, stdev=82.97, samples=66 iops : min= 1, max= 25, avg=11.09, stdev= 5.22, samples=66 lat (usec) : 50=1.17%, 100=8.98%, 250=0.78%, 500=0.52%, 1000=0.26% lat (msec) : 2=2.99%, 4=4.56%, 10=8.07%, 20=8.33%, 50=27.99% lat (msec) : 100=27.47%, 250=8.59%, 500=0.26% cpu : usr=0.09%, sys=5.15%, ctx=1388, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145624: Wed Sep 30 00:11:25 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(5744KiB/32645msec) clat (usec): min=37, max=272670, avg=47109.16, stdev=38252.51 lat (usec): min=37, max=272672, avg=47110.55, stdev=38252.61 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 725], | 30.00th=[ 28443], 40.00th=[ 35914], 50.00th=[ 43779], 60.00th=[ 53740], | 70.00th=[ 63701], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[108528], | 99.00th=[168821], 99.50th=[225444], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 380, per=24.68%, avg=175.47, stdev=75.08, samples=64 iops : min= 1, max= 23, avg=10.20, stdev= 4.77, samples=64 write: IOPS=12, BW=200KiB/s (205kB/s)(6544KiB/32645msec); 0 zone resets clat (usec): min=1559, max=325661, avg=37885.72, stdev=41729.26 lat (usec): min=1561, max=325663, avg=37888.19, stdev=41729.47 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 3163], 10.00th=[ 4359], 20.00th=[ 6849], | 30.00th=[ 9503], 40.00th=[ 13566], 50.00th=[ 22414], 60.00th=[ 32900], | 70.00th=[ 47973], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[115868], | 99.00th=[185598], 99.50th=[208667], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 441, per=26.77%, avg=200.20, stdev=90.04, samples=64 iops : min= 1, max= 27, avg=11.78, stdev= 5.76, samples=64 lat (usec) : 50=1.30%, 100=6.77%, 250=0.52%, 500=0.26%, 750=0.52% lat (msec) : 2=1.56%, 4=3.39%, 10=13.41%, 20=8.85%, 50=27.60% lat (msec) : 100=28.65%, 250=6.90%, 500=0.26% cpu : usr=0.09%, sys=5.37%, ctx=1484, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145625: Wed Sep 30 00:11:25 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(6256KiB/33653msec) clat (usec): min=38, max=326777, avg=44322.27, stdev=39587.76 lat (usec): min=39, max=326804, avg=44330.40, stdev=39588.40 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 100], | 30.00th=[ 22152], 40.00th=[ 32375], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 87557], 95.00th=[115868], | 99.00th=[168821], 99.50th=[189793], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 63, max= 445, per=26.19%, avg=186.18, stdev=76.03, samples=66 iops : min= 3, max= 27, avg=10.88, stdev= 4.83, samples=66 write: IOPS=11, BW=179KiB/s (184kB/s)(6032KiB/33653msec); 0 zone resets clat (usec): min=1450, max=261500, avg=42756.27, stdev=42786.34 lat (usec): min=1452, max=261503, avg=42759.83, stdev=42785.50 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1991], 10.00th=[ 3326], 20.00th=[ 7308], | 30.00th=[ 11338], 40.00th=[ 18482], 50.00th=[ 30802], 60.00th=[ 42730], | 70.00th=[ 56886], 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[125305], | 99.00th=[210764], 99.50th=[254804], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 62, max= 337, per=23.77%, avg=177.77, stdev=71.62, samples=66 iops : min= 3, max= 21, avg=10.36, stdev= 4.60, samples=66 lat (usec) : 50=1.04%, 100=9.11%, 250=1.43%, 500=0.39% lat (msec) : 2=2.86%, 4=3.39%, 10=7.29%, 20=9.77%, 50=28.26% lat (msec) : 100=28.78%, 250=7.16%, 500=0.52% cpu : usr=0.08%, sys=5.34%, ctx=1431, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145626: Wed Sep 30 00:11:25 2026 read: IOPS=11, BW=189KiB/s (193kB/s)(6032KiB/31947msec) clat (usec): min=36, max=267048, avg=43138.67, stdev=39431.73 lat (usec): min=36, max=267049, avg=43139.95, stdev=39431.70 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 89], | 30.00th=[ 19530], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[160433], 99.50th=[223347], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 434, per=26.85%, avg=190.93, stdev=75.60, samples=61 iops : min= 1, max= 27, avg=11.16, stdev= 4.76, samples=61 write: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31947msec); 0 zone resets clat (usec): min=1356, max=266665, avg=39376.52, stdev=46788.69 lat (usec): min=1357, max=266666, avg=39381.03, stdev=46789.34 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1942], 10.00th=[ 3359], 20.00th=[ 5407], | 30.00th=[ 8455], 40.00th=[ 12518], 50.00th=[ 17695], 60.00th=[ 31589], | 70.00th=[ 47449], 80.00th=[ 68682], 90.00th=[101188], 95.00th=[141558], | 99.00th=[227541], 99.50th=[265290], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 61, max= 351, per=26.19%, avg=195.90, stdev=71.04, samples=62 iops : min= 3, max= 21, avg=11.48, stdev= 4.46, samples=62 lat (usec) : 50=1.43%, 100=9.77%, 250=1.04%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=3.12%, 4=3.91%, 10=11.46%, 20=9.64%, 50=25.52% lat (msec) : 100=24.09%, 250=8.72%, 500=0.52% cpu : usr=0.08%, sys=5.32%, ctx=1412, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=712KiB/s (729kB/s), 176KiB/s-189KiB/s (180kB/s-193kB/s), io=23.4MiB (24.5MB), run=31947-33653msec WRITE: bw=749KiB/s (767kB/s), 179KiB/s-200KiB/s (184kB/s-205kB/s), io=24.6MiB (25.8MB), run=31947-33653msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145628: Wed Sep 30 00:12:08 2026 read: IOPS=4, BW=78.5KiB/s (80.3kB/s)(5920KiB/75458msec) clat (msec): min=8, max=395, avg=49.25, stdev=56.44 lat (msec): min=8, max=395, avg=49.25, stdev=56.44 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 61], 90.00th=[ 114], 95.00th=[ 159], | 99.00th=[ 334], 99.50th=[ 388], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 318, per=28.72%, avg=90.17, stdev=54.99, samples=129 iops : min= 1, max= 19, avg= 4.82, stdev= 3.45, samples=129 write: IOPS=5, BW=84.4KiB/s (86.4kB/s)(6368KiB/75458msec); 0 zone resets clat (msec): min=48, max=566, avg=143.65, stdev=72.02 lat (msec): min=48, max=566, avg=143.66, stdev=72.02 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 110], 50.00th=[ 125], 60.00th=[ 136], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 251], 95.00th=[ 279], | 99.00th=[ 376], 99.50th=[ 531], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 22, max= 191, per=25.79%, avg=85.12, stdev=41.27, samples=147 iops : min= 1, max= 11, avg= 4.51, stdev= 2.60, samples=147 lat (msec) : 10=0.78%, 20=10.94%, 50=24.48%, 100=22.01%, 250=35.68% lat (msec) : 500=5.86%, 750=0.26% cpu : usr=0.06%, sys=1.29%, ctx=1340, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145629: Wed Sep 30 00:12:08 2026 read: IOPS=4, BW=75.4KiB/s (77.2kB/s)(5744KiB/76168msec) clat (msec): min=8, max=474, avg=46.66, stdev=55.74 lat (msec): min=8, max=474, avg=46.67, stdev=55.74 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 64], 90.00th=[ 101], 95.00th=[ 171], | 99.00th=[ 326], 99.50th=[ 359], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 22, max= 318, per=28.30%, avg=88.87, stdev=57.90, samples=126 iops : min= 1, max= 19, avg= 4.75, stdev= 3.62, samples=126 write: IOPS=5, BW=85.9KiB/s (87.0kB/s)(6544KiB/76168msec); 0 zone resets clat (msec): min=44, max=531, avg=145.20, stdev=71.34 lat (msec): min=44, max=531, avg=145.21, stdev=71.34 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 70], 10.00th=[ 78], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 114], 50.00th=[ 127], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 245], 95.00th=[ 279], | 99.00th=[ 388], 99.50th=[ 447], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 29, max= 187, per=26.53%, avg=87.55, stdev=40.74, samples=146 iops : min= 1, max= 11, avg= 4.65, stdev= 2.57, samples=146 lat (msec) : 10=0.91%, 20=13.41%, 50=21.74%, 100=21.48%, 250=37.11% lat (msec) : 500=5.21%, 750=0.13% cpu : usr=0.06%, sys=1.23%, ctx=1266, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145630: Wed Sep 30 00:12:08 2026 read: IOPS=5, BW=85.1KiB/s (87.2kB/s)(6256KiB/73504msec) clat (msec): min=8, max=362, avg=41.68, stdev=42.05 lat (msec): min=8, max=362, avg=41.68, stdev=42.05 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 87], 95.00th=[ 118], | 99.00th=[ 236], 99.50th=[ 257], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 22, max= 320, per=30.73%, avg=96.48, stdev=67.37, samples=128 iops : min= 1, max= 20, avg= 5.23, stdev= 4.27, samples=128 write: IOPS=5, BW=82.1KiB/s (84.0kB/s)(6032KiB/73504msec); 0 zone resets clat (msec): min=37, max=581, avg=151.54, stdev=83.29 lat (msec): min=37, max=581, avg=151.55, stdev=83.30 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 103], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 197], 90.00th=[ 264], 95.00th=[ 338], | 99.00th=[ 435], 99.50th=[ 567], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 31, max= 159, per=25.36%, avg=83.67, stdev=38.15, samples=141 iops : min= 1, max= 9, avg= 4.42, stdev= 2.40, samples=141 lat (msec) : 10=0.65%, 20=13.80%, 50=25.91%, 100=20.70%, 250=33.33% lat (msec) : 500=5.21%, 750=0.39% cpu : usr=0.05%, sys=1.24%, ctx=1324, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145631: Wed Sep 30 00:12:08 2026 read: IOPS=4, BW=79.7KiB/s (81.7kB/s)(6032KiB/75640msec) clat (msec): min=7, max=530, avg=43.78, stdev=47.78 lat (msec): min=7, max=530, avg=43.78, stdev=47.78 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 92], 95.00th=[ 134], | 99.00th=[ 222], 99.50th=[ 334], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 31, max= 285, per=30.50%, avg=95.77, stdev=60.77, samples=123 iops : min= 1, max= 17, avg= 5.19, stdev= 3.86, samples=123 write: IOPS=5, BW=82.7KiB/s (84.7kB/s)(6256KiB/75640msec); 0 zone resets clat (msec): min=44, max=472, avg=151.10, stdev=78.35 lat (msec): min=44, max=472, avg=151.10, stdev=78.35 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 80], 20.00th=[ 91], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 127], 60.00th=[ 146], | 70.00th=[ 174], 80.00th=[ 205], 90.00th=[ 253], 95.00th=[ 321], | 99.00th=[ 418], 99.50th=[ 422], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 31, max= 190, per=25.33%, avg=83.58, stdev=40.36, samples=147 iops : min= 1, max= 11, avg= 4.40, stdev= 2.57, samples=147 lat (msec) : 10=0.39%, 20=12.63%, 50=25.65%, 100=20.96%, 250=34.64% lat (msec) : 500=5.60%, 750=0.13% cpu : usr=0.05%, sys=1.25%, ctx=1294, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=314KiB/s (322kB/s), 75.4KiB/s-85.1KiB/s (77.2kB/s-87.2kB/s), io=23.4MiB (24.5MB), run=73504-76168msec WRITE: bw=331KiB/s (339kB/s), 82.1KiB/s-85.9KiB/s (84.0kB/s-87.0kB/s), io=24.6MiB (25.8MB), run=73504-76168msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145654: Wed Sep 30 00:12:28 2026 read: IOPS=2, BW=2665KiB/s (2729kB/s)(7168KiB/2690msec) clat (msec): min=59, max=198, avg=138.19, stdev=55.30 lat (msec): min=59, max=198, avg=138.19, stdev=55.30 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 63], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 161], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 178], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 2023, max= 3835, per=63.26%, avg=2908.67, stdev=906.68, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1903KiB/s (1949kB/s)(5120KiB/2690msec); 0 zone resets clat (msec): min=182, max=371, avg=285.67, stdev=83.46 lat (msec): min=182, max=371, avg=285.77, stdev=83.47 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1917, max= 4007, per=41.15%, avg=2649.00, stdev=1177.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=16.55%, ctx=152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145655: Wed Sep 30 00:12:28 2026 read: IOPS=0, BW=484KiB/s (495kB/s)(2048KiB/4234msec) clat (usec): min=556, max=490221, avg=245389.20, stdev=346245.04 lat (usec): min=558, max=490224, avg=245391.46, stdev=346246.35 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[ 553], 50.00th=[ 553], 60.00th=[488637], | 70.00th=[488637], 80.00th=[488637], 90.00th=[488637], 95.00th=[488637], | 99.00th=[488637], 99.50th=[488637], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 1992, max= 2019, per=43.62%, avg=2005.50, stdev=19.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2419KiB/s (2477kB/s)(10.0MiB/4234msec); 0 zone resets clat (msec): min=120, max=753, avg=359.45, stdev=186.38 lat (msec): min=120, max=753, avg=359.98, stdev=186.44 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 136], | 30.00th=[ 253], 40.00th=[ 292], 50.00th=[ 342], 60.00th=[ 384], | 70.00th=[ 388], 80.00th=[ 397], 90.00th=[ 535], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1946, max= 4071, per=46.73%, avg=3007.83, stdev=1127.41, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.95%, ctx=263, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145656: Wed Sep 30 00:12:28 2026 read: IOPS=2, BW=2052KiB/s (2101kB/s)(6144KiB/2994msec) clat (usec): min=364, max=225496, avg=100694.37, stdev=110037.85 lat (usec): min=365, max=225498, avg=100695.38, stdev=110038.25 clat percentiles (usec): | 1.00th=[ 367], 5.00th=[ 367], 10.00th=[ 367], 20.00th=[ 652], | 30.00th=[ 652], 40.00th=[ 9110], 50.00th=[ 9110], 60.00th=[147850], | 70.00th=[219153], 80.00th=[219153], 90.00th=[225444], 95.00th=[225444], | 99.00th=[225444], 99.50th=[225444], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 1973, max= 4047, per=72.69%, avg=3342.33, stdev=1186.05, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2052KiB/s (2101kB/s)(6144KiB/2994msec); 0 zone resets clat (msec): min=135, max=444, avg=335.63, stdev=128.52 lat (msec): min=135, max=444, avg=335.72, stdev=128.50 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 405], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1973, max= 4007, per=45.98%, avg=2959.50, stdev=1112.65, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=14.00%, ctx=93, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145657: Wed Sep 30 00:12:28 2026 read: IOPS=1, BW=1150KiB/s (1177kB/s)(5120KiB/4454msec) clat (usec): min=509, max=381016, avg=208751.84, stdev=147525.71 lat (usec): min=510, max=381016, avg=208752.99, stdev=147525.44 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[130548], 40.00th=[130548], 50.00th=[240124], 60.00th=[240124], | 70.00th=[291505], 80.00th=[291505], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 3946, max= 4039, per=86.83%, avg=3992.50, stdev=65.76, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1609KiB/s (1648kB/s)(7168KiB/4454msec); 0 zone resets clat (msec): min=175, max=989, avg=441.96, stdev=293.75 lat (msec): min=175, max=990, avg=442.39, stdev=294.16 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 184], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 351], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 667], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1973, max= 4079, per=43.89%, avg=2825.00, stdev=1130.33, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=11.18%, ctx=180, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4598KiB/s (4708kB/s), 484KiB/s-2665KiB/s (495kB/s-2729kB/s), io=20.0MiB (20.0MB), run=2690-4454msec WRITE: bw=6437KiB/s (6592kB/s), 1609KiB/s-2419KiB/s (1648kB/s-2477kB/s), io=28.0MiB (29.4MB), run=2690-4454msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145649: Wed Sep 30 00:12:29 2026 read: IOPS=1, BW=1946KiB/s (1992kB/s)(7168KiB/3684msec) clat (msec): min=50, max=795, avg=211.57, stdev=261.28 lat (msec): min=50, max=795, avg=211.58, stdev=261.28 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 73], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 121], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 180], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 3757, max= 4420, per=100.00%, avg=4088.50, stdev=468.81, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1390KiB/s (1423kB/s)(5120KiB/3684msec); 0 zone resets clat (msec): min=206, max=628, avg=433.00, stdev=181.95 lat (msec): min=206, max=628, avg=433.10, stdev=181.96 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2015, max= 4071, per=48.28%, avg=2705.67, stdev=1182.44, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=4.24%, ctx=64, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145650: Wed Sep 30 00:12:29 2026 read: IOPS=0, BW=400KiB/s (410kB/s)(2048KiB/5116msec) clat (msec): min=162, max=298, avg=230.24, stdev=96.26 lat (msec): min=162, max=298, avg=230.24, stdev=96.26 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1539, max= 2035, per=44.64%, avg=1787.00, stdev=350.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2002KiB/s (2050kB/s)(10.0MiB/5116msec); 0 zone resets clat (msec): min=165, max=1278, avg=452.07, stdev=347.48 lat (msec): min=165, max=1278, avg=452.18, stdev=347.48 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 203], | 30.00th=[ 215], 40.00th=[ 220], 50.00th=[ 266], 60.00th=[ 363], | 70.00th=[ 451], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1539, max= 4071, per=45.85%, avg=2569.50, stdev=1062.46, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=4.03%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145652: Wed Sep 30 00:12:29 2026 read: IOPS=1, BW=1451KiB/s (1486kB/s)(6144KiB/4235msec) clat (msec): min=129, max=284, avg=180.40, stdev=56.17 lat (msec): min=129, max=284, avg=180.40, stdev=56.17 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 182], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 2035, max= 4096, per=84.62%, avg=3387.33, stdev=1171.61, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1451KiB/s (1486kB/s)(6144KiB/4235msec); 0 zone resets clat (msec): min=188, max=977, avg=448.43, stdev=291.90 lat (msec): min=188, max=977, avg=448.69, stdev=291.89 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 443], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 2023, max= 3757, per=44.00%, avg=2465.75, stdev=860.89, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.05%, sys=4.91%, ctx=117, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145653: Wed Sep 30 00:12:29 2026 read: IOPS=1, BW=1346KiB/s (1378kB/s)(5120KiB/3805msec) clat (msec): min=74, max=292, avg=150.52, stdev=83.81 lat (msec): min=74, max=292, avg=150.52, stdev=83.81 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 133], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 4031, max= 4071, per=100.00%, avg=4051.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1884KiB/s (1929kB/s)(7168KiB/3805msec); 0 zone resets clat (msec): min=211, max=681, avg=382.53, stdev=196.65 lat (msec): min=211, max=682, avg=382.71, stdev=196.80 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 230], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 305], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 651], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1878, max= 4096, per=50.27%, avg=2817.40, stdev=1146.71, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=4.73%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4003KiB/s (4099kB/s), 400KiB/s-1946KiB/s (410kB/s-1992kB/s), io=20.0MiB (20.0MB), run=3684-5116msec WRITE: bw=5604KiB/s (5739kB/s), 1390KiB/s-2002KiB/s (1423kB/s-2050kB/s), io=28.0MiB (29.4MB), run=3684-5116msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145663: Wed Sep 30 00:12:44 2026 read: IOPS=1, BW=4126KiB/s (4225kB/s)(12.0MiB/2978msec) clat (msec): min=878, max=1106, avg=961.26, stdev=126.24 lat (msec): min=878, max=1106, avg=961.26, stdev=126.24 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8031, max= 8159, per=100.00%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.60%, ctx=256, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145665: Wed Sep 30 00:12:44 2026 read: IOPS=0, BW=1040KiB/s (1065kB/s)(4096KiB/3940msec) clat (nsec): min=1128.9M, max=1128.9M, avg=1128935322.00, stdev= 0.00 lat (nsec): min=1128.9M, max=1128.9M, avg=1128937728.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2079KiB/s (2129kB/s)(8192KiB/3940msec); 0 zone resets clat (msec): min=516, max=2216, avg=1366.01, stdev=1202.08 lat (msec): min=516, max=2216, avg=1366.49, stdev=1202.17 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8031, max= 8031, per=96.57%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=3.30%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145666: Wed Sep 30 00:12:44 2026 write: IOPS=1, BW=5478KiB/s (5610kB/s)(12.0MiB/2243msec); 0 zone resets clat (msec): min=399, max=899, avg=711.72, stdev=272.44 lat (msec): min=399, max=900, avg=712.64, stdev=272.81 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 5483, max= 8159, per=82.02%, avg=6821.00, stdev=1892.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.26%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145667: Wed Sep 30 00:12:44 2026 write: IOPS=1, BW=4723KiB/s (4836kB/s)(12.0MiB/2602msec); 0 zone resets clat (msec): min=384, max=1578, avg=814.78, stdev=663.21 lat (msec): min=384, max=1578, avg=815.15, stdev=663.15 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7420, max= 8094, per=93.28%, avg=7757.00, stdev=476.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.81%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4158KiB/s (4258kB/s), 1040KiB/s-4126KiB/s (1065kB/s-4225kB/s), io=16.0MiB (16.8MB), run=2978-3940msec WRITE: bw=8317KiB/s (8516kB/s), 2079KiB/s-5478KiB/s (2129kB/s-5610kB/s), io=32.0MiB (33.6MB), run=2243-3940msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145668: Wed Sep 30 00:12:44 2026 read: IOPS=0, BW=3222KiB/s (3299kB/s)(12.0MiB/3814msec) clat (msec): min=365, max=1875, avg=1237.83, stdev=782.14 lat (msec): min=365, max=1875, avg=1237.84, stdev=782.14 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.52%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145669: Wed Sep 30 00:12:44 2026 read: IOPS=0, BW=1003KiB/s (1027kB/s)(4096KiB/4085msec) clat (nsec): min=1712.7M, max=1712.7M, avg=1712685551.00, stdev= 0.00 lat (nsec): min=1712.7M, max=1712.7M, avg=1712688347.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2005KiB/s (2054kB/s)(8192KiB/4085msec); 0 zone resets clat (msec): min=1026, max=1151, avg=1089.05, stdev=87.93 lat (msec): min=1029, max=1151, avg=1090.73, stdev=86.23 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.02%, sys=4.46%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145670: Wed Sep 30 00:12:44 2026 write: IOPS=0, BW=3378KiB/s (3459kB/s)(12.0MiB/3638msec); 0 zone resets clat (msec): min=315, max=1963, avg=1181.37, stdev=827.05 lat (msec): min=316, max=1963, avg=1181.88, stdev=826.96 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.24%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145671: Wed Sep 30 00:12:44 2026 write: IOPS=0, BW=4086KiB/s (4185kB/s)(12.0MiB/3007msec); 0 zone resets clat (msec): min=335, max=1869, avg=952.16, stdev=809.93 lat (msec): min=335, max=1869, avg=952.54, stdev=809.94 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.16%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4011KiB/s (4107kB/s), 1003KiB/s-3222KiB/s (1027kB/s-3299kB/s), io=16.0MiB (16.8MB), run=3814-4085msec WRITE: bw=8022KiB/s (8214kB/s), 2005KiB/s-4086KiB/s (2054kB/s-4185kB/s), io=32.0MiB (33.6MB), run=3007-4085msec