== sanity test 398b: DIO and buffer IO race ============== 19:29:33 (1788564573) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 10.6629 s, 4.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144273: Fri Sep 4 19:32:21 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(5992KiB/144714msec) clat (usec): min=22, max=498409, avg=46182.89, stdev=39001.82 lat (usec): min=22, max=498411, avg=46184.42, stdev=39001.72 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 75], 20.00th=[ 18482], | 30.00th=[ 24511], 40.00th=[ 31589], 50.00th=[ 38536], 60.00th=[ 45351], | 70.00th=[ 56361], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[166724], 99.50th=[189793], 99.90th=[320865], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 120, per=25.15%, avg=41.50, stdev=21.11, samples=281 iops : min= 1, max= 30, avg= 9.72, stdev= 5.33, samples=281 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6296KiB/144714msec); 0 zone resets clat (usec): min=870, max=563944, avg=47886.80, stdev=52468.37 lat (usec): min=871, max=563946, avg=47892.01, stdev=52465.78 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 4015], | 30.00th=[ 9110], 40.00th=[ 21627], 50.00th=[ 35914], 60.00th=[ 47973], | 70.00th=[ 64226], 80.00th=[ 83362], 90.00th=[110625], 95.00th=[139461], | 99.00th=[227541], 99.50th=[274727], 99.90th=[557843], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 135, per=24.93%, avg=43.12, stdev=21.19, samples=284 iops : min= 1, max= 33, avg=10.14, stdev= 5.34, samples=284 lat (usec) : 50=0.91%, 100=4.49%, 250=0.26%, 500=0.07%, 1000=0.29% lat (msec) : 2=6.90%, 4=3.19%, 10=6.05%, 20=8.79%, 50=32.13% lat (msec) : 100=25.98%, 250=10.42%, 500=0.46%, 750=0.07% cpu : usr=0.07%, sys=4.20%, ctx=6118, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144274: Fri Sep 4 19:32:21 2026 read: IOPS=10, BW=41.2KiB/s (42.1kB/s)(5940KiB/144340msec) clat (usec): min=26, max=842863, avg=47454.63, stdev=42573.11 lat (usec): min=27, max=842865, avg=47459.12, stdev=42574.84 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 93], 20.00th=[ 19268], | 30.00th=[ 25560], 40.00th=[ 31327], 50.00th=[ 39584], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[166724], 99.50th=[206570], 99.90th=[362808], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 112, per=24.90%, avg=41.09, stdev=20.08, samples=281 iops : min= 1, max= 28, avg= 9.62, stdev= 5.08, samples=281 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6348KiB/144340msec); 0 zone resets clat (usec): min=910, max=325433, avg=46467.99, stdev=48420.53 lat (usec): min=911, max=325434, avg=46471.59, stdev=48420.03 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 3523], | 30.00th=[ 8979], 40.00th=[ 20317], 50.00th=[ 33817], 60.00th=[ 48497], | 70.00th=[ 62129], 80.00th=[ 80217], 90.00th=[110625], 95.00th=[141558], | 99.00th=[212861], 99.50th=[242222], 99.90th=[316670], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 134, per=25.12%, avg=43.46, stdev=21.20, samples=283 iops : min= 1, max= 33, avg=10.23, stdev= 5.34, samples=283 lat (usec) : 50=0.91%, 100=3.97%, 250=0.26%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=7.62%, 4=3.39%, 10=5.21%, 20=9.02%, 50=30.89% lat (msec) : 100=28.22%, 250=9.96%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=4.37%, ctx=6236, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144275: Fri Sep 4 19:32:21 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6028KiB/144913msec) clat (usec): min=29, max=376406, avg=48090.73, stdev=40947.31 lat (usec): min=29, max=376408, avg=48104.23, stdev=40950.21 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 83], 20.00th=[ 19268], | 30.00th=[ 25035], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 47973], | 70.00th=[ 58459], 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[196084], 99.50th=[229639], 99.90th=[362808], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 135, per=25.18%, avg=41.54, stdev=19.95, samples=281 iops : min= 1, max= 33, avg= 9.74, stdev= 5.03, samples=281 write: IOPS=10, BW=43.2KiB/s (44.2kB/s)(6260KiB/144913msec); 0 zone resets clat (usec): min=818, max=921645, avg=46181.02, stdev=54200.06 lat (usec): min=819, max=921648, avg=46183.15, stdev=54200.13 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1270], 20.00th=[ 3949], | 30.00th=[ 9110], 40.00th=[ 20055], 50.00th=[ 33817], 60.00th=[ 45351], | 70.00th=[ 61080], 80.00th=[ 78119], 90.00th=[108528], 95.00th=[135267], | 99.00th=[214959], 99.50th=[267387], 99.90th=[488637], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 119, per=24.71%, avg=42.75, stdev=21.53, samples=283 iops : min= 1, max= 29, avg=10.04, stdev= 5.40, samples=283 lat (usec) : 50=0.88%, 100=4.30%, 250=0.13%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.39% lat (msec) : 2=6.93%, 4=2.99%, 10=5.86%, 20=9.15%, 50=32.00% lat (msec) : 100=26.53%, 250=10.22%, 500=0.46%, 1000=0.03% cpu : usr=0.08%, sys=4.29%, ctx=6219, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144276: Fri Sep 4 19:32:21 2026 read: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6052KiB/142817msec) clat (usec): min=31, max=468386, avg=47445.80, stdev=38396.11 lat (usec): min=32, max=468387, avg=47451.60, stdev=38391.31 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 77], 20.00th=[ 19530], | 30.00th=[ 27657], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 57934], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[170918], 99.50th=[193987], 99.90th=[337642], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 127, per=26.11%, avg=43.09, stdev=20.23, samples=273 iops : min= 1, max= 31, avg=10.14, stdev= 5.10, samples=273 write: IOPS=10, BW=43.7KiB/s (44.7kB/s)(6236KiB/142817msec); 0 zone resets clat (usec): min=692, max=844891, avg=45434.35, stdev=57928.87 lat (usec): min=693, max=844894, avg=45436.00, stdev=57928.84 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1287], 20.00th=[ 3589], | 30.00th=[ 8094], 40.00th=[ 17171], 50.00th=[ 30802], 60.00th=[ 42730], | 70.00th=[ 56361], 80.00th=[ 74974], 90.00th=[104334], 95.00th=[141558], | 99.00th=[256902], 99.50th=[362808], 99.90th=[566232], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 111, per=25.30%, avg=43.77, stdev=21.88, samples=277 iops : min= 1, max= 27, avg=10.30, stdev= 5.53, samples=277 lat (usec) : 50=0.98%, 100=4.30%, 250=0.20%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.29% lat (msec) : 2=7.32%, 4=3.19%, 10=6.45%, 20=8.27%, 50=32.23% lat (msec) : 100=27.28%, 250=8.66%, 500=0.62%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.17%, ctx=5976, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 41.2KiB/s-42.4KiB/s (42.1kB/s-43.4kB/s), io=23.4MiB (24.6MB), run=142817-144913msec WRITE: bw=173KiB/s (178kB/s), 43.2KiB/s-43.0KiB/s (44.2kB/s-45.0kB/s), io=24.6MiB (25.7MB), run=142817-144913msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144268: Fri Sep 4 19:34:57 2026 read: IOPS=4, BW=19.9KiB/s (20.4kB/s)(5992KiB/301097msec) clat (msec): min=5, max=1199, avg=37.78, stdev=50.98 lat (msec): min=5, max=1199, avg=37.78, stdev=50.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 83], 95.00th=[ 112], | 99.00th=[ 218], 99.50th=[ 255], 99.90th=[ 464], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 103, per=29.60%, avg=23.39, stdev=16.28, samples=493 iops : min= 1, max= 25, avg= 5.21, stdev= 4.10, samples=493 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6296KiB/301097msec); 0 zone resets clat (msec): min=31, max=1156, avg=155.01, stdev=89.31 lat (msec): min=31, max=1156, avg=155.01, stdev=89.31 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 91], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 262], 95.00th=[ 321], | 99.00th=[ 489], 99.50th=[ 542], 99.90th=[ 693], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 55, per=25.15%, avg=20.88, stdev=10.42, samples=577 iops : min= 1, max= 13, avg= 4.58, stdev= 2.67, samples=577 lat (msec) : 10=4.00%, 20=16.34%, 50=19.14%, 100=19.63%, 250=34.51% lat (msec) : 500=5.89%, 750=0.42%, 2000=0.07% cpu : usr=0.03%, sys=0.93%, ctx=4976, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144269: Fri Sep 4 19:34:57 2026 read: IOPS=4, BW=19.7KiB/s (20.1kB/s)(5940KiB/302040msec) clat (msec): min=6, max=1307, avg=38.50, stdev=55.67 lat (msec): min=6, max=1307, avg=38.51, stdev=55.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 88], 95.00th=[ 122], | 99.00th=[ 213], 99.50th=[ 288], 99.90th=[ 575], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 87, per=29.09%, avg=22.98, stdev=15.52, samples=497 iops : min= 1, max= 21, avg= 5.12, stdev= 3.93, samples=497 write: IOPS=5, BW=21.0KiB/s (21.5kB/s)(6348KiB/302040msec); 0 zone resets clat (msec): min=35, max=771, avg=153.94, stdev=83.14 lat (msec): min=35, max=771, avg=153.94, stdev=83.14 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 92], | 30.00th=[ 107], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 205], 90.00th=[ 255], 95.00th=[ 317], | 99.00th=[ 464], 99.50th=[ 527], 99.90th=[ 651], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 56, per=25.40%, avg=21.08, stdev=10.29, samples=577 iops : min= 1, max= 14, avg= 4.64, stdev= 2.64, samples=577 lat (msec) : 10=3.42%, 20=17.19%, 50=18.98%, 100=18.72%, 250=35.90% lat (msec) : 500=5.40%, 750=0.33%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=0.92%, ctx=4971, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144270: Fri Sep 4 19:34:57 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6028KiB/300118msec) clat (msec): min=5, max=471, avg=38.32, stdev=42.22 lat (msec): min=5, max=471, avg=38.32, stdev=42.22 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 122], | 99.00th=[ 201], 99.50th=[ 264], 99.90th=[ 359], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 110, per=29.19%, avg=23.06, stdev=16.56, samples=503 iops : min= 1, max= 27, avg= 5.13, stdev= 4.17, samples=503 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6260KiB/300118msec); 0 zone resets clat (msec): min=37, max=1547, avg=154.53, stdev=93.10 lat (msec): min=37, max=1547, avg=154.53, stdev=93.10 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 117], 50.00th=[ 134], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 203], 90.00th=[ 257], 95.00th=[ 313], | 99.00th=[ 485], 99.50th=[ 550], 99.90th=[ 1020], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7, max= 55, per=25.33%, avg=21.03, stdev=10.34, samples=570 iops : min= 1, max= 13, avg= 4.62, stdev= 2.65, samples=570 lat (msec) : 10=3.65%, 20=17.22%, 50=18.03%, 100=20.80%, 250=34.41% lat (msec) : 500=5.44%, 750=0.39%, 2000=0.07% cpu : usr=0.04%, sys=0.90%, ctx=5014, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144271: Fri Sep 4 19:34:57 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6052KiB/298189msec) clat (msec): min=5, max=572, avg=37.60, stdev=42.81 lat (msec): min=5, max=572, avg=37.60, stdev=42.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 115], | 99.00th=[ 211], 99.50th=[ 271], 99.90th=[ 376], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 103, per=30.09%, avg=23.77, stdev=16.36, samples=491 iops : min= 1, max= 25, avg= 5.31, stdev= 4.12, samples=491 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6236KiB/298189msec); 0 zone resets clat (msec): min=38, max=1551, avg=154.43, stdev=90.49 lat (msec): min=38, max=1551, avg=154.43, stdev=90.49 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 199], 90.00th=[ 259], 95.00th=[ 317], | 99.00th=[ 498], 99.50th=[ 542], 99.90th=[ 634], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7, max= 55, per=25.34%, avg=21.03, stdev=10.32, samples=569 iops : min= 1, max= 13, avg= 4.62, stdev= 2.65, samples=569 lat (msec) : 10=3.65%, 20=16.41%, 50=19.79%, 100=19.30%, 250=34.83% lat (msec) : 500=5.50%, 750=0.49%, 2000=0.03% cpu : usr=0.04%, sys=0.92%, ctx=5072, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=79.5KiB/s (81.4kB/s), 19.7KiB/s-20.3KiB/s (20.1kB/s-20.8kB/s), io=23.4MiB (24.6MB), run=298189-302040msec WRITE: bw=83.2KiB/s (85.2kB/s), 20.9KiB/s-21.0KiB/s (21.4kB/s-21.5kB/s), io=24.6MiB (25.7MB), run=298189-302040msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144338: Fri Sep 4 19:35:37 2026 read: IOPS=14, BW=229KiB/s (235kB/s)(5920KiB/25818msec) clat (usec): min=38, max=165739, avg=36759.98, stdev=29943.21 lat (usec): min=38, max=165739, avg=36761.04, stdev=29943.35 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 104], | 30.00th=[ 19530], 40.00th=[ 27395], 50.00th=[ 33162], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 60031], 90.00th=[ 80217], 95.00th=[ 92799], | 99.00th=[112722], 99.50th=[152044], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 93, max= 541, per=25.10%, avg=228.20, stdev=84.24, samples=50 iops : min= 5, max= 33, avg=13.56, stdev= 5.23, samples=50 write: IOPS=15, BW=247KiB/s (253kB/s)(6368KiB/25818msec); 0 zone resets clat (usec): min=1020, max=208631, avg=29835.65, stdev=32015.71 lat (usec): min=1023, max=208633, avg=29837.42, stdev=32015.67 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1647], 10.00th=[ 1876], 20.00th=[ 3687], | 30.00th=[ 6587], 40.00th=[ 11731], 50.00th=[ 19792], 60.00th=[ 27657], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[145753], 99.50th=[158335], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 28, max= 608, per=25.85%, avg=247.38, stdev=112.89, samples=50 iops : min= 1, max= 38, avg=14.76, stdev= 7.10, samples=50 lat (usec) : 50=1.30%, 100=8.07%, 250=1.17%, 500=0.26% lat (msec) : 2=6.12%, 4=5.08%, 10=7.68%, 20=11.20%, 50=34.77% lat (msec) : 100=20.83%, 250=3.52% cpu : usr=0.09%, sys=5.34%, ctx=1293, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144339: Fri Sep 4 19:35:37 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(5744KiB/26329msec) clat (usec): min=37, max=187576, avg=37432.97, stdev=30906.27 lat (usec): min=37, max=187577, avg=37434.47, stdev=30906.13 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 1369], | 30.00th=[ 21103], 40.00th=[ 28181], 50.00th=[ 32900], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 98042], | 99.00th=[131597], 99.50th=[177210], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 28, max= 475, per=24.28%, avg=220.74, stdev=100.32, samples=50 iops : min= 1, max= 29, avg=13.08, stdev= 6.30, samples=50 write: IOPS=15, BW=249KiB/s (255kB/s)(6544KiB/26329msec); 0 zone resets clat (usec): min=1128, max=275596, avg=30722.07, stdev=35478.79 lat (usec): min=1130, max=275598, avg=30738.66, stdev=35494.97 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1647], 10.00th=[ 1844], 20.00th=[ 4113], | 30.00th=[ 6783], 40.00th=[ 12125], 50.00th=[ 20317], 60.00th=[ 27657], | 70.00th=[ 37487], 80.00th=[ 49021], 90.00th=[ 73925], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[185598], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 62, max= 480, per=25.33%, avg=242.37, stdev=108.14, samples=51 iops : min= 3, max= 30, avg=14.43, stdev= 6.83, samples=51 lat (usec) : 50=1.82%, 100=7.16% lat (msec) : 2=6.12%, 4=4.95%, 10=9.38%, 20=10.03%, 50=36.85% lat (msec) : 100=19.27%, 250=4.17%, 500=0.26% cpu : usr=0.06%, sys=5.32%, ctx=1345, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144340: Fri Sep 4 19:35:37 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(6256KiB/25833msec) clat (usec): min=36, max=251950, avg=36947.62, stdev=36043.41 lat (usec): min=37, max=251951, avg=36948.62, stdev=36043.43 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 74], | 30.00th=[ 16712], 40.00th=[ 25297], 50.00th=[ 33162], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 58459], 90.00th=[ 77071], 95.00th=[101188], | 99.00th=[177210], 99.50th=[217056], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 57, max= 512, per=26.85%, avg=244.04, stdev=112.71, samples=50 iops : min= 3, max= 32, avg=14.54, stdev= 7.14, samples=50 write: IOPS=14, BW=233KiB/s (239kB/s)(6032KiB/25833msec); 0 zone resets clat (usec): min=1082, max=148184, avg=29811.89, stdev=30072.61 lat (usec): min=1083, max=148188, avg=29832.53, stdev=30066.72 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1647], 10.00th=[ 1827], 20.00th=[ 3294], | 30.00th=[ 6652], 40.00th=[ 11207], 50.00th=[ 20317], 60.00th=[ 28967], | 70.00th=[ 41157], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[132645], 99.50th=[143655], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 62, max= 542, per=24.23%, avg=231.92, stdev=110.77, samples=50 iops : min= 3, max= 33, avg=13.80, stdev= 6.88, samples=50 lat (usec) : 50=1.82%, 100=9.77%, 250=0.91%, 1000=0.26% lat (msec) : 2=6.25%, 4=5.34%, 10=7.55%, 20=9.24%, 50=33.59% lat (msec) : 100=21.22%, 250=3.91%, 500=0.13% cpu : usr=0.07%, sys=5.36%, ctx=1332, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144341: Fri Sep 4 19:35:37 2026 read: IOPS=14, BW=236KiB/s (242kB/s)(6032KiB/25543msec) clat (usec): min=34, max=344580, avg=36786.28, stdev=37877.18 lat (usec): min=35, max=344581, avg=36787.31, stdev=37877.26 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 49], 10.00th=[ 57], 20.00th=[ 68], | 30.00th=[ 15139], 40.00th=[ 23725], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 61604], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[162530], 99.50th=[208667], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 62, max= 574, per=25.82%, avg=234.66, stdev=119.24, samples=50 iops : min= 3, max= 35, avg=13.96, stdev= 7.44, samples=50 write: IOPS=15, BW=245KiB/s (251kB/s)(6256KiB/25543msec); 0 zone resets clat (usec): min=1162, max=195025, avg=29033.25, stdev=32798.34 lat (usec): min=1163, max=195026, avg=29043.82, stdev=32833.05 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1582], 10.00th=[ 1745], 20.00th=[ 3064], | 30.00th=[ 5211], 40.00th=[ 8717], 50.00th=[ 16057], 60.00th=[ 26084], | 70.00th=[ 38536], 80.00th=[ 52691], 90.00th=[ 70779], 95.00th=[ 93848], | 99.00th=[158335], 99.50th=[175113], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 62, max= 541, per=25.65%, avg=245.50, stdev=121.80, samples=50 iops : min= 3, max= 33, avg=14.64, stdev= 7.63, samples=50 lat (usec) : 50=2.47%, 100=10.29%, 250=0.78%, 500=0.26% lat (msec) : 2=6.64%, 4=6.12%, 10=9.11%, 20=8.98%, 50=29.56% lat (msec) : 100=20.44%, 250=5.21%, 500=0.13% cpu : usr=0.08%, sys=5.61%, ctx=1260, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=910KiB/s (932kB/s), 218KiB/s-242KiB/s (223kB/s-248kB/s), io=23.4MiB (24.5MB), run=25543-26329msec WRITE: bw=957KiB/s (980kB/s), 233KiB/s-249KiB/s (239kB/s-255kB/s), io=24.6MiB (25.8MB), run=25543-26329msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144343: Fri Sep 4 19:36:13 2026 read: IOPS=6, BW=98.8KiB/s (101kB/s)(5920KiB/59916msec) clat (msec): min=6, max=324, avg=34.34, stdev=39.43 lat (msec): min=6, max=324, avg=34.34, stdev=39.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 113], | 99.00th=[ 215], 99.50th=[ 257], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 438, per=26.76%, avg=105.96, stdev=72.33, samples=109 iops : min= 1, max= 27, avg= 5.89, stdev= 4.61, samples=109 write: IOPS=6, BW=106KiB/s (109kB/s)(6368KiB/59916msec); 0 zone resets clat (msec): min=31, max=470, avg=118.19, stdev=65.27 lat (msec): min=31, max=470, avg=118.19, stdev=65.27 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 59], 20.00th=[ 72], | 30.00th=[ 80], 40.00th=[ 88], 50.00th=[ 99], 60.00th=[ 114], | 70.00th=[ 127], 80.00th=[ 153], 90.00th=[ 205], 95.00th=[ 257], | 99.00th=[ 368], 99.50th=[ 401], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 31, max= 223, per=26.07%, avg=108.44, stdev=51.15, samples=115 iops : min= 1, max= 13, avg= 6.04, stdev= 3.28, samples=115 lat (msec) : 10=4.17%, 20=18.23%, 50=20.18%, 100=29.43%, 250=24.87% lat (msec) : 500=3.12% cpu : usr=0.03%, sys=1.28%, ctx=1284, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144344: Fri Sep 4 19:36:13 2026 read: IOPS=5, BW=94.0KiB/s (97.3kB/s)(5744KiB/60472msec) clat (msec): min=6, max=340, avg=30.98, stdev=34.05 lat (msec): min=6, max=340, avg=30.98, stdev=34.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 60], 95.00th=[ 84], | 99.00th=[ 184], 99.50th=[ 257], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 384, per=27.08%, avg=107.25, stdev=75.35, samples=104 iops : min= 1, max= 24, avg= 5.98, stdev= 4.80, samples=104 write: IOPS=6, BW=108KiB/s (111kB/s)(6544KiB/60472msec); 0 zone resets clat (msec): min=33, max=509, avg=120.23, stdev=70.29 lat (msec): min=33, max=509, avg=120.25, stdev=70.28 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 91], 50.00th=[ 101], 60.00th=[ 110], | 70.00th=[ 127], 80.00th=[ 150], 90.00th=[ 209], 95.00th=[ 268], | 99.00th=[ 397], 99.50th=[ 472], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 30, max= 255, per=26.09%, avg=108.52, stdev=50.14, samples=117 iops : min= 1, max= 15, avg= 6.04, stdev= 3.23, samples=117 lat (msec) : 10=3.78%, 20=18.75%, 50=20.44%, 100=28.65%, 250=24.74% lat (msec) : 500=3.39%, 750=0.26% cpu : usr=0.04%, sys=1.30%, ctx=1307, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144345: Fri Sep 4 19:36:13 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(6256KiB/59005msec) clat (msec): min=5, max=281, avg=31.78, stdev=36.32 lat (msec): min=5, max=281, avg=31.79, stdev=36.32 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 38], 90.00th=[ 61], 95.00th=[ 93], | 99.00th=[ 243], 99.50th=[ 253], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 351, per=30.02%, avg=118.88, stdev=80.98, samples=104 iops : min= 1, max= 21, avg= 6.71, stdev= 5.13, samples=104 write: IOPS=6, BW=102KiB/s (105kB/s)(6032KiB/59005msec); 0 zone resets clat (msec): min=35, max=587, avg=123.01, stdev=68.92 lat (msec): min=35, max=587, avg=123.01, stdev=68.92 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 104], 60.00th=[ 114], | 70.00th=[ 133], 80.00th=[ 155], 90.00th=[ 197], 95.00th=[ 257], | 99.00th=[ 418], 99.50th=[ 468], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 30, max= 192, per=24.91%, avg=103.65, stdev=44.10, samples=113 iops : min= 1, max= 12, avg= 5.74, stdev= 2.86, samples=113 lat (msec) : 10=3.52%, 20=21.48%, 50=20.57%, 100=25.52%, 250=25.91% lat (msec) : 500=2.86%, 750=0.13% cpu : usr=0.05%, sys=1.22%, ctx=1332, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144346: Fri Sep 4 19:36:13 2026 read: IOPS=6, BW=102KiB/s (105kB/s)(6032KiB/58942msec) clat (msec): min=5, max=258, avg=32.97, stdev=35.00 lat (msec): min=5, max=258, avg=32.97, stdev=35.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 72], 95.00th=[ 100], | 99.00th=[ 220], 99.50th=[ 226], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 320, per=27.92%, avg=110.57, stdev=67.29, samples=106 iops : min= 1, max= 20, avg= 6.19, stdev= 4.29, samples=106 write: IOPS=6, BW=106KiB/s (109kB/s)(6256KiB/58942msec); 0 zone resets clat (msec): min=26, max=492, avg=118.45, stdev=63.27 lat (msec): min=26, max=492, avg=118.46, stdev=63.27 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 93], 50.00th=[ 103], 60.00th=[ 111], | 70.00th=[ 130], 80.00th=[ 153], 90.00th=[ 188], 95.00th=[ 234], | 99.00th=[ 414], 99.50th=[ 451], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 224, per=25.76%, avg=107.18, stdev=48.40, samples=114 iops : min= 1, max= 14, avg= 5.96, stdev= 3.12, samples=114 lat (msec) : 10=4.04%, 20=18.88%, 50=19.27%, 100=29.30%, 250=26.56% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.24%, ctx=1304, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=396KiB/s (406kB/s), 94.0KiB/s-106KiB/s (97.3kB/s-109kB/s), io=23.4MiB (24.5MB), run=58942-60472msec WRITE: bw=417KiB/s (427kB/s), 102KiB/s-108KiB/s (105kB/s-111kB/s), io=24.6MiB (25.8MB), run=58942-60472msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144364: Fri Sep 4 19:36:27 2026 read: IOPS=2, BW=2707KiB/s (2772kB/s)(7168KiB/2648msec) clat (msec): min=158, max=322, avg=230.74, stdev=48.25 lat (msec): min=158, max=322, avg=230.74, stdev=48.25 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 228], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 241], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 2023, max= 4031, per=55.31%, avg=2828.75, stdev=981.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1934KiB/s (1980kB/s)(5120KiB/2648msec); 0 zone resets clat (msec): min=86, max=317, avg=191.80, stdev=88.91 lat (msec): min=86, max=317, avg=192.06, stdev=88.76 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2023, max= 6095, per=56.69%, avg=4059.00, stdev=2879.34, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.00%, sys=19.04%, ctx=279, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144365: Fri Sep 4 19:36:27 2026 read: IOPS=0, BW=584KiB/s (598kB/s)(2048KiB/3508msec) clat (msec): min=214, max=216, avg=215.18, stdev= 1.46 lat (msec): min=214, max=216, avg=215.18, stdev= 1.46 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 1372, max= 2043, per=33.39%, avg=1707.50, stdev=474.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2919KiB/s (2989kB/s)(10.0MiB/3508msec); 0 zone resets clat (msec): min=80, max=1000, avg=288.51, stdev=300.44 lat (msec): min=80, max=1000, avg=288.59, stdev=300.46 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 90], | 30.00th=[ 99], 40.00th=[ 112], 50.00th=[ 130], 60.00th=[ 186], | 70.00th=[ 275], 80.00th=[ 284], 90.00th=[ 634], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 2043, max= 6107, per=56.66%, avg=4057.00, stdev=1659.26, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=14.28%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144366: Fri Sep 4 19:36:27 2026 read: IOPS=1, BW=1534KiB/s (1571kB/s)(6144KiB/4004msec) clat (msec): min=94, max=328, avg=156.12, stdev=85.97 lat (msec): min=94, max=328, avg=156.13, stdev=85.97 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 126], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 2035, max= 4096, per=53.28%, avg=2724.67, stdev=1187.62, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1534KiB/s (1571kB/s)(6144KiB/4004msec); 0 zone resets clat (msec): min=60, max=1491, avg=422.66, stdev=551.03 lat (msec): min=60, max=1491, avg=422.85, stdev=550.96 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 199], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 2043, max= 4096, per=47.42%, avg=3395.33, stdev=1171.41, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.27%, ctx=368, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144367: Fri Sep 4 19:36:27 2026 read: IOPS=1, BW=1969KiB/s (2016kB/s)(5120KiB/2600msec) clat (usec): min=576, max=266934, avg=120247.43, stdev=120057.17 lat (usec): min=577, max=266935, avg=120248.31, stdev=120057.02 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 857], 40.00th=[ 857], 50.00th=[126354], 60.00th=[126354], | 70.00th=[206570], 80.00th=[206570], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 2023, max= 6035, per=78.78%, avg=4029.00, stdev=2836.91, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2757KiB/s (2823kB/s)(7168KiB/2600msec); 0 zone resets clat (msec): min=128, max=734, avg=272.23, stdev=209.86 lat (msec): min=128, max=735, avg=272.35, stdev=209.96 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 140], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 230], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 253], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2019, max= 6119, per=66.15%, avg=4736.33, stdev=2353.40, samples=3 iops : min= 1, max= 5, avg= 3.67, stdev= 2.31, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=17.58%, ctx=224, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5115KiB/s (5238kB/s), 584KiB/s-2707KiB/s (598kB/s-2772kB/s), io=20.0MiB (20.0MB), run=2600-4004msec WRITE: bw=7161KiB/s (7333kB/s), 1534KiB/s-2919KiB/s (1571kB/s-2989kB/s), io=28.0MiB (29.4MB), run=2600-4004msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144368: Fri Sep 4 19:36:28 2026 read: IOPS=1, BW=1728KiB/s (1769kB/s)(7168KiB/4149msec) clat (msec): min=56, max=1332, avg=368.92, stdev=455.96 lat (msec): min=56, max=1332, avg=368.92, stdev=455.96 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 63], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 153], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 468], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1715, max= 2031, per=42.69%, avg=1955.20, stdev=136.21, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1234KiB/s (1264kB/s)(5120KiB/4149msec); 0 zone resets clat (msec): min=156, max=348, avg=226.35, stdev=80.05 lat (msec): min=156, max=348, avg=226.43, stdev=80.03 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2023, max= 2031, per=31.61%, avg=2027.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=2.92%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144369: Fri Sep 4 19:36:28 2026 read: IOPS=0, BW=465KiB/s (477kB/s)(2048KiB/4401msec) clat (msec): min=62, max=190, avg=126.70, stdev=90.39 lat (msec): min=62, max=190, avg=126.70, stdev=90.39 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 63], 50.00th=[ 63], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 1641, max= 2031, per=40.09%, avg=1836.00, stdev=275.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2327KiB/s (2383kB/s)(10.0MiB/4401msec); 0 zone resets clat (msec): min=127, max=1269, avg=388.44, stdev=345.94 lat (msec): min=127, max=1275, avg=389.06, stdev=347.44 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 155], | 30.00th=[ 165], 40.00th=[ 169], 50.00th=[ 171], 60.00th=[ 363], | 70.00th=[ 472], 80.00th=[ 485], 90.00th=[ 510], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1976, max= 6095, per=50.54%, avg=3240.80, stdev=1829.99, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.57%, ctx=82, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144370: Fri Sep 4 19:36:28 2026 read: IOPS=1, BW=1847KiB/s (1891kB/s)(6144KiB/3327msec) clat (msec): min=53, max=292, avg=141.10, stdev=94.71 lat (msec): min=53, max=292, avg=141.10, stdev=94.71 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 142], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1976, max= 6095, per=73.52%, avg=3367.33, stdev=2362.39, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1847KiB/s (1891kB/s)(6144KiB/3327msec); 0 zone resets clat (msec): min=105, max=1176, avg=399.40, stdev=388.13 lat (msec): min=105, max=1176, avg=399.50, stdev=388.18 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1976, max= 3210, per=36.06%, avg=2312.00, stdev=599.23, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=4.09%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144371: Fri Sep 4 19:36:28 2026 read: IOPS=1, BW=1145KiB/s (1173kB/s)(5120KiB/4471msec) clat (msec): min=59, max=584, avg=186.35, stdev=226.27 lat (msec): min=59, max=584, avg=186.35, stdev=226.27 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 73], 60.00th=[ 73], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 4047, max= 4063, per=88.54%, avg=4055.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1603KiB/s (1642kB/s)(7168KiB/4471msec); 0 zone resets clat (msec): min=139, max=1543, avg=440.64, stdev=501.89 lat (msec): min=139, max=1543, avg=440.72, stdev=501.88 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 174], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 447], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 2015, max= 4063, per=39.57%, avg=2537.00, stdev=1017.38, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.07%, sys=2.82%, ctx=71, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4581KiB/s (4691kB/s), 465KiB/s-1847KiB/s (477kB/s-1891kB/s), io=20.0MiB (20.0MB), run=3327-4471msec WRITE: bw=6413KiB/s (6567kB/s), 1234KiB/s-2327KiB/s (1264kB/s-2383kB/s), io=28.0MiB (29.4MB), run=3327-4471msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144383: Fri Sep 4 19:36:40 2026 read: IOPS=1, BW=5067KiB/s (5189kB/s)(12.0MiB/2425msec) clat (msec): min=537, max=985, avg=792.18, stdev=230.30 lat (msec): min=537, max=985, avg=792.18, stdev=230.30 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.80%, ctx=234, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144384: Fri Sep 4 19:36:40 2026 read: IOPS=0, BW=1884KiB/s (1929kB/s)(4096KiB/2174msec) clat (nsec): min=965029k, max=965029k, avg=965029100.00, stdev= 0.00 lat (nsec): min=965032k, max=965032k, avg=965031752.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7831, max= 7831, per=100.00%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3768KiB/s (3859kB/s)(8192KiB/2174msec); 0 zone resets clat (msec): min=553, max=579, avg=566.56, stdev=18.99 lat (msec): min=553, max=580, avg=566.86, stdev=19.15 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8062, max= 8062, per=66.14%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.77%, ctx=140, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144385: Fri Sep 4 19:36:40 2026 write: IOPS=1, BW=4571KiB/s (4681kB/s)(12.0MiB/2688msec); 0 zone resets clat (msec): min=355, max=1319, avg=845.87, stdev=482.35 lat (msec): min=355, max=1319, avg=846.24, stdev=482.43 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8062, max= 8110, per=66.33%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.92%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144386: Fri Sep 4 19:36:40 2026 write: IOPS=1, BW=5583KiB/s (5717kB/s)(12.0MiB/2201msec); 0 zone resets clat (msec): min=311, max=1005, avg=698.72, stdev=353.75 lat (msec): min=311, max=1005, avg=699.58, stdev=353.90 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8062, max= 8078, per=66.20%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.55%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6756KiB/s (6918kB/s), 1884KiB/s-5067KiB/s (1929kB/s-5189kB/s), io=16.0MiB (16.8MB), run=2174-2425msec WRITE: bw=11.9MiB/s (12.5MB/s), 3768KiB/s-5583KiB/s (3859kB/s-5717kB/s), io=32.0MiB (33.6MB), run=2174-2688msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144379: Fri Sep 4 19:36:40 2026 read: IOPS=1, BW=4274KiB/s (4377kB/s)(12.0MiB/2875msec) clat (msec): min=368, max=1492, avg=898.90, stdev=564.44 lat (msec): min=368, max=1492, avg=898.90, stdev=564.44 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.57%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144380: Fri Sep 4 19:36:40 2026 read: IOPS=0, BW=1382KiB/s (1415kB/s)(4096KiB/2964msec) clat (nsec): min=1083.5M, max=1083.5M, avg=1083463997.00, stdev= 0.00 lat (nsec): min=1083.5M, max=1083.5M, avg=1083466262.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2764KiB/s (2830kB/s)(8192KiB/2964msec); 0 zone resets clat (msec): min=775, max=1020, avg=898.29, stdev=172.96 lat (msec): min=776, max=1020, avg=898.54, stdev=173.03 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8175, max= 8175, per=73.95%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.04%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144381: Fri Sep 4 19:36:40 2026 write: IOPS=1, BW=8154KiB/s (8350kB/s)(12.0MiB/1507msec); 0 zone resets clat (msec): min=274, max=703, avg=460.06, stdev=220.14 lat (msec): min=275, max=710, avg=462.99, stdev=223.80 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 6714, max= 8159, per=67.27%, avg=7436.50, stdev=1021.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=7.64%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144382: Fri Sep 4 19:36:40 2026 write: IOPS=1, BW=6172KiB/s (6320kB/s)(12.0MiB/1991msec); 0 zone resets clat (msec): min=311, max=1081, avg=640.31, stdev=397.34 lat (msec): min=312, max=1082, avg=640.87, stdev=397.06 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 6838, max= 8192, per=67.98%, avg=7515.00, stdev=957.42, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.13%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5528KiB/s (5660kB/s), 1382KiB/s-4274KiB/s (1415kB/s-4377kB/s), io=16.0MiB (16.8MB), run=2875-2964msec WRITE: bw=10.8MiB/s (11.3MB/s), 2764KiB/s-8154KiB/s (2830kB/s-8350kB/s), io=32.0MiB (33.6MB), run=1507-2964msec