== sanity test 398b: DIO and buffer IO race ============== 08:37:32 (1790944652) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.23621 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145171: Fri Oct 2 08:40:11 2026 read: IOPS=11, BW=44.3KiB/s (45.3kB/s)(5992KiB/135310msec) clat (usec): min=31, max=1473.2k, avg=44241.00, stdev=50255.62 lat (usec): min=32, max=1473.2k, avg=44245.27, stdev=50255.51 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 529], | 20.00th=[ 19792], 30.00th=[ 25560], 40.00th=[ 31327], | 50.00th=[ 37487], 60.00th=[ 44303], 70.00th=[ 52691], | 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[ 100140], | 99.00th=[ 168821], 99.50th=[ 202376], 99.90th=[ 492831], | 99.95th=[1468007], 99.99th=[1468007] bw ( KiB/s): min= 7, max= 126, per=26.11%, avg=44.65, stdev=20.29, samples=262 iops : min= 1, max= 31, avg=10.50, stdev= 5.08, samples=262 write: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6296KiB/135310msec); 0 zone resets clat (usec): min=938, max=472256, avg=43482.92, stdev=45745.98 lat (usec): min=939, max=472256, avg=43485.57, stdev=45745.58 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1795], 20.00th=[ 4686], | 30.00th=[ 8979], 40.00th=[ 19792], 50.00th=[ 31589], 60.00th=[ 43254], | 70.00th=[ 57410], 80.00th=[ 72877], 90.00th=[104334], 95.00th=[131597], | 99.00th=[200279], 99.50th=[229639], 99.90th=[325059], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 111, per=25.98%, avg=46.51, stdev=19.37, samples=264 iops : min= 1, max= 27, avg=10.97, stdev= 4.90, samples=264 lat (usec) : 50=0.75%, 100=3.58%, 250=0.46%, 500=0.07%, 750=0.16% lat (usec) : 1000=0.07% lat (msec) : 2=5.73%, 4=3.68%, 10=7.00%, 20=9.11%, 50=35.12% lat (msec) : 100=25.98%, 250=8.07%, 500=0.20%, 2000=0.03% cpu : usr=0.08%, sys=4.86%, ctx=6304, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145175: Fri Oct 2 08:40:11 2026 read: IOPS=10, BW=42.4KiB/s (43.4kB/s)(5940KiB/140150msec) clat (usec): min=35, max=1580.4k, avg=44059.93, stdev=51890.21 lat (usec): min=35, max=1580.4k, avg=44063.52, stdev=51890.86 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 1795], | 20.00th=[ 19792], 30.00th=[ 25035], 40.00th=[ 30540], | 50.00th=[ 36439], 60.00th=[ 43779], 70.00th=[ 52167], | 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 101188], | 99.00th=[ 156238], 99.50th=[ 223347], 99.90th=[ 299893], | 99.95th=[1585447], 99.99th=[1585447] bw ( KiB/s): min= 7, max= 93, per=24.98%, avg=42.71, stdev=19.11, samples=270 iops : min= 1, max= 23, avg=10.02, stdev= 4.82, samples=270 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6348KiB/140150msec); 0 zone resets clat (usec): min=953, max=576207, avg=46610.49, stdev=49356.86 lat (usec): min=955, max=576208, avg=46618.17, stdev=49367.75 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1319], 10.00th=[ 1958], 20.00th=[ 5080], | 30.00th=[ 10159], 40.00th=[ 23200], 50.00th=[ 35914], 60.00th=[ 46400], | 70.00th=[ 60556], 80.00th=[ 78119], 90.00th=[107480], 95.00th=[135267], | 99.00th=[214959], 99.50th=[274727], 99.90th=[404751], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 133, per=25.37%, avg=45.42, stdev=19.13, samples=271 iops : min= 1, max= 33, avg=10.70, stdev= 4.83, samples=271 lat (usec) : 50=0.59%, 100=3.42%, 250=0.46%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=5.24%, 4=3.52%, 10=6.80%, 20=8.76%, 50=35.68% lat (msec) : 100=26.53%, 250=8.14%, 500=0.39%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.79%, ctx=6440, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145176: Fri Oct 2 08:40:11 2026 read: IOPS=10, BW=43.2KiB/s (44.3kB/s)(6028KiB/139452msec) clat (usec): min=33, max=1472.3k, avg=43656.78, stdev=50338.64 lat (usec): min=33, max=1472.3k, avg=43659.17, stdev=50339.47 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 85], | 20.00th=[ 19006], 30.00th=[ 24773], 40.00th=[ 30278], | 50.00th=[ 34866], 60.00th=[ 42730], 70.00th=[ 51643], | 80.00th=[ 65274], 90.00th=[ 84411], 95.00th=[ 102237], | 99.00th=[ 154141], 99.50th=[ 206570], 99.90th=[ 408945], | 99.95th=[1468007], 99.99th=[1468007] bw ( KiB/s): min= 6, max= 95, per=25.28%, avg=43.23, stdev=18.84, samples=271 iops : min= 1, max= 23, avg=10.15, stdev= 4.76, samples=271 write: IOPS=11, BW=44.9KiB/s (45.0kB/s)(6260KiB/139452msec); 0 zone resets clat (usec): min=974, max=557282, avg=46691.87, stdev=46864.49 lat (usec): min=976, max=557283, avg=46695.79, stdev=46867.18 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 2073], 20.00th=[ 4817], | 30.00th=[ 10552], 40.00th=[ 23987], 50.00th=[ 35914], 60.00th=[ 49021], | 70.00th=[ 63177], 80.00th=[ 79168], 90.00th=[107480], 95.00th=[132645], | 99.00th=[193987], 99.50th=[208667], 99.90th=[358613], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 119, per=24.87%, avg=44.52, stdev=19.84, samples=273 iops : min= 1, max= 29, avg=10.48, stdev= 4.98, samples=273 lat (usec) : 50=0.75%, 100=4.36%, 250=0.36%, 500=0.20%, 1000=0.03% lat (msec) : 2=4.92%, 4=3.71%, 10=6.71%, 20=8.43%, 50=35.12% lat (msec) : 100=26.73%, 250=8.43%, 500=0.20%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.96%, ctx=6457, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145177: Fri Oct 2 08:40:11 2026 read: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6052KiB/139074msec) clat (usec): min=31, max=582051, avg=44235.01, stdev=35921.02 lat (usec): min=32, max=582052, avg=44236.50, stdev=35921.20 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 221], 20.00th=[ 19530], | 30.00th=[ 25297], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 66323], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[139461], 99.50th=[187696], 99.90th=[413139], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 7, max= 117, per=25.80%, avg=44.12, stdev=19.30, samples=266 iops : min= 1, max= 29, avg=10.38, stdev= 4.85, samples=266 write: IOPS=11, BW=44.8KiB/s (45.9kB/s)(6236KiB/139074msec); 0 zone resets clat (usec): min=901, max=1944.0k, avg=45828.68, stdev=68300.07 lat (usec): min=902, max=1945.0k, avg=45831.62, stdev=68300.43 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1827], | 20.00th=[ 4424], 30.00th=[ 9110], 40.00th=[ 19268], | 50.00th=[ 32900], 60.00th=[ 44827], 70.00th=[ 57934], | 80.00th=[ 77071], 90.00th=[ 104334], 95.00th=[ 130548], | 99.00th=[ 212861], 99.50th=[ 295699], 99.90th=[ 396362], | 99.95th=[1937769], 99.99th=[1937769] bw ( KiB/s): min= 7, max= 102, per=25.01%, avg=44.76, stdev=20.09, samples=270 iops : min= 1, max= 25, avg=10.54, stdev= 5.08, samples=270 lat (usec) : 50=0.72%, 100=3.94%, 250=0.33%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=5.63%, 4=3.81%, 10=6.84%, 20=9.15%, 50=34.67% lat (msec) : 100=26.40%, 250=7.85%, 500=0.39%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.92%, ctx=6509, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.4KiB/s-44.3KiB/s (43.4kB/s-45.3kB/s), io=23.4MiB (24.6MB), run=135310-140150msec WRITE: bw=179KiB/s (184kB/s), 44.8KiB/s-46.5KiB/s (45.9kB/s-47.6kB/s), io=24.6MiB (25.7MB), run=135310-140150msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145170: Fri Oct 2 08:42:45 2026 read: IOPS=5, BW=20.5KiB/s (21.0kB/s)(5992KiB/291673msec) clat (msec): min=5, max=1528, avg=37.63, stdev=55.71 lat (msec): min=5, max=1528, avg=37.63, stdev=55.71 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 83], 95.00th=[ 112], | 99.00th=[ 190], 99.50th=[ 259], 99.90th=[ 567], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7, max= 87, per=29.27%, avg=23.70, stdev=16.05, samples=488 iops : min= 1, max= 21, avg= 5.32, stdev= 4.05, samples=488 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6296KiB/291673msec); 0 zone resets clat (msec): min=38, max=608, avg=149.16, stdev=75.58 lat (msec): min=38, max=608, avg=149.17, stdev=75.58 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 128], 60.00th=[ 146], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 253], 95.00th=[ 296], | 99.00th=[ 388], 99.50th=[ 464], 99.90th=[ 600], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 48, per=25.40%, avg=21.59, stdev=10.33, samples=560 iops : min= 1, max= 12, avg= 4.78, stdev= 2.65, samples=560 lat (msec) : 10=4.00%, 20=16.54%, 50=18.65%, 100=20.93%, 250=34.28% lat (msec) : 500=5.37%, 750=0.20%, 2000=0.03% cpu : usr=0.04%, sys=1.02%, ctx=5223, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145172: Fri Oct 2 08:42:45 2026 read: IOPS=5, BW=20.2KiB/s (20.7kB/s)(5940KiB/293726msec) clat (msec): min=5, max=1726, avg=36.64, stdev=58.91 lat (msec): min=5, max=1726, avg=36.64, stdev=58.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 79], 95.00th=[ 105], | 99.00th=[ 192], 99.50th=[ 275], 99.90th=[ 409], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 7, max= 103, per=29.59%, avg=23.97, stdev=16.78, samples=478 iops : min= 1, max= 25, avg= 5.39, stdev= 4.24, samples=478 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6348KiB/293726msec); 0 zone resets clat (msec): min=32, max=705, avg=150.48, stdev=76.63 lat (msec): min=32, max=705, avg=150.49, stdev=76.63 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 131], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 255], 95.00th=[ 296], | 99.00th=[ 409], 99.50th=[ 468], 99.90th=[ 651], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 64, per=25.33%, avg=21.53, stdev=10.08, samples=565 iops : min= 1, max= 16, avg= 4.76, stdev= 2.59, samples=565 lat (msec) : 10=4.26%, 20=16.67%, 50=18.78%, 100=19.56%, 250=34.93% lat (msec) : 500=5.60%, 750=0.16%, 2000=0.03% cpu : usr=0.03%, sys=1.02%, ctx=5177, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145173: Fri Oct 2 08:42:45 2026 read: IOPS=5, BW=20.7KiB/s (21.2kB/s)(6028KiB/291501msec) clat (msec): min=5, max=373, avg=36.99, stdev=35.27 lat (msec): min=5, max=373, avg=36.99, stdev=35.27 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 89], 95.00th=[ 110], | 99.00th=[ 167], 99.50th=[ 184], 99.90th=[ 239], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 103, per=28.46%, avg=23.05, stdev=16.55, samples=504 iops : min= 1, max= 25, avg= 5.15, stdev= 4.18, samples=504 write: IOPS=5, BW=21.5KiB/s (21.0kB/s)(6260KiB/291501msec); 0 zone resets clat (msec): min=39, max=1855, avg=150.31, stdev=85.69 lat (msec): min=39, max=1855, avg=150.32, stdev=85.69 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 91], | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 247], 95.00th=[ 288], | 99.00th=[ 409], 99.50th=[ 481], 99.90th=[ 592], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 7, max= 48, per=25.31%, avg=21.52, stdev=10.00, samples=559 iops : min= 1, max= 12, avg= 4.76, stdev= 2.57, samples=559 lat (msec) : 10=4.26%, 20=16.31%, 50=18.10%, 100=20.64%, 250=35.81% lat (msec) : 500=4.75%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=0.99%, ctx=5129, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145174: Fri Oct 2 08:42:45 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6052KiB/290655msec) clat (msec): min=5, max=431, avg=35.85, stdev=38.17 lat (msec): min=5, max=431, avg=35.86, stdev=38.18 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 80], 95.00th=[ 107], | 99.00th=[ 184], 99.50th=[ 224], 99.90th=[ 405], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 95, per=30.32%, avg=24.56, stdev=17.10, samples=476 iops : min= 1, max= 23, avg= 5.53, stdev= 4.33, samples=476 write: IOPS=5, BW=21.5KiB/s (21.0kB/s)(6236KiB/290655msec); 0 zone resets clat (msec): min=40, max=1907, avg=151.24, stdev=86.48 lat (msec): min=40, max=1907, avg=151.24, stdev=86.48 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 174], 80.00th=[ 205], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 388], 99.50th=[ 468], 99.90th=[ 659], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 7, max= 48, per=24.98%, avg=21.23, stdev=10.14, samples=564 iops : min= 1, max= 12, avg= 4.69, stdev= 2.60, samples=564 lat (msec) : 10=4.46%, 20=16.86%, 50=18.55%, 100=20.25%, 250=34.93% lat (msec) : 500=4.85%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.04%, ctx=5238, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=81.7KiB/s (83.7kB/s), 20.2KiB/s-20.8KiB/s (20.7kB/s-21.3kB/s), io=23.4MiB (24.6MB), run=290655-293726msec WRITE: bw=85.6KiB/s (87.6kB/s), 21.5KiB/s-21.6KiB/s (21.0kB/s-22.1kB/s), io=24.6MiB (25.7MB), run=290655-293726msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145233: Fri Oct 2 08:43:23 2026 read: IOPS=14, BW=229KiB/s (234kB/s)(5920KiB/25898msec) clat (usec): min=32, max=150741, avg=33638.45, stdev=29813.41 lat (usec): min=32, max=150742, avg=33644.89, stdev=29807.55 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 69], | 30.00th=[ 18482], 40.00th=[ 23987], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 43779], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[132645], 99.50th=[147850], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 95, max= 447, per=25.03%, avg=228.78, stdev=90.30, samples=51 iops : min= 5, max= 27, avg=13.53, stdev= 5.67, samples=51 write: IOPS=15, BW=246KiB/s (252kB/s)(6368KiB/25898msec); 0 zone resets clat (usec): min=1418, max=243262, avg=33493.16, stdev=35531.36 lat (usec): min=1420, max=243264, avg=33497.41, stdev=35529.88 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1729], 10.00th=[ 2442], 20.00th=[ 5866], | 30.00th=[ 9110], 40.00th=[ 13698], 50.00th=[ 22152], 60.00th=[ 30802], | 70.00th=[ 41681], 80.00th=[ 53216], 90.00th=[ 80217], 95.00th=[113771], | 99.00th=[149947], 99.50th=[208667], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 509, per=25.59%, avg=246.14, stdev=96.50, samples=51 iops : min= 1, max= 31, avg=14.63, stdev= 6.03, samples=51 lat (usec) : 50=1.95%, 100=9.51%, 250=0.91%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.04%, 4=3.78%, 10=9.77%, 20=9.38%, 50=35.94% lat (msec) : 100=19.66%, 250=4.43% cpu : usr=0.08%, sys=6.30%, ctx=1386, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145234: Fri Oct 2 08:43:23 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(5744KiB/25986msec) clat (usec): min=37, max=133829, avg=34316.78, stdev=27976.08 lat (usec): min=38, max=133830, avg=34317.85, stdev=27976.07 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 72], | 30.00th=[ 19792], 40.00th=[ 26346], 50.00th=[ 31851], 60.00th=[ 40109], | 70.00th=[ 46400], 80.00th=[ 55313], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[106431], 99.50th=[128451], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 21, max= 412, per=24.91%, avg=227.65, stdev=92.65, samples=49 iops : min= 1, max= 25, avg=13.47, stdev= 5.82, samples=49 write: IOPS=15, BW=252KiB/s (258kB/s)(6544KiB/25986msec); 0 zone resets clat (usec): min=1412, max=268296, avg=32450.25, stdev=37728.33 lat (usec): min=1414, max=268298, avg=32461.40, stdev=37739.16 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1631], 10.00th=[ 2180], 20.00th=[ 4883], | 30.00th=[ 6783], 40.00th=[ 10159], 50.00th=[ 17957], 60.00th=[ 26870], | 70.00th=[ 40633], 80.00th=[ 55837], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[158335], 99.50th=[221250], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 42, max= 480, per=26.43%, avg=254.24, stdev=82.92, samples=50 iops : min= 2, max= 30, avg=15.16, stdev= 5.30, samples=50 lat (usec) : 50=1.69%, 100=8.85%, 250=0.39%, 500=0.26%, 1000=0.26% lat (msec) : 2=5.34%, 4=3.26%, 10=12.76%, 20=8.59%, 50=35.42% lat (msec) : 100=19.66%, 250=3.39%, 500=0.13% cpu : usr=0.09%, sys=6.08%, ctx=1385, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145235: Fri Oct 2 08:43:23 2026 read: IOPS=14, BW=239KiB/s (245kB/s)(6256KiB/26184msec) clat (usec): min=36, max=264805, avg=35253.01, stdev=33304.72 lat (usec): min=36, max=264807, avg=35254.03, stdev=33304.74 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 74], | 30.00th=[ 13960], 40.00th=[ 26608], 50.00th=[ 33162], 60.00th=[ 39060], | 70.00th=[ 47973], 80.00th=[ 56886], 90.00th=[ 73925], 95.00th=[ 96994], | 99.00th=[133694], 99.50th=[208667], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 95, max= 475, per=27.38%, avg=250.24, stdev=86.45, samples=49 iops : min= 5, max= 29, avg=14.88, stdev= 5.49, samples=49 write: IOPS=14, BW=230KiB/s (236kB/s)(6032KiB/26184msec); 0 zone resets clat (usec): min=1326, max=293417, avg=31687.51, stdev=34824.90 lat (usec): min=1327, max=293420, avg=31689.55, stdev=34825.30 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1680], 10.00th=[ 2376], 20.00th=[ 4555], | 30.00th=[ 8455], 40.00th=[ 11994], 50.00th=[ 19792], 60.00th=[ 30016], | 70.00th=[ 40633], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[162530], 99.50th=[265290], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 63, max= 574, per=24.12%, avg=232.04, stdev=101.22, samples=50 iops : min= 3, max= 35, avg=13.72, stdev= 6.37, samples=50 lat (usec) : 50=2.21%, 100=9.77%, 250=1.69%, 500=0.65%, 750=0.26% lat (msec) : 2=4.17%, 4=4.69%, 10=8.85%, 20=9.51%, 50=30.86% lat (msec) : 100=23.83%, 250=3.12%, 500=0.39% cpu : usr=0.08%, sys=5.92%, ctx=1372, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145237: Fri Oct 2 08:43:23 2026 read: IOPS=15, BW=244KiB/s (249kB/s)(6032KiB/24769msec) clat (usec): min=33, max=213197, avg=33113.36, stdev=29491.03 lat (usec): min=33, max=213197, avg=33123.43, stdev=29496.66 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 2180], 40.00th=[ 24249], 50.00th=[ 32637], 60.00th=[ 40633], | 70.00th=[ 45351], 80.00th=[ 56886], 90.00th=[ 68682], 95.00th=[ 77071], | 99.00th=[117965], 99.50th=[130548], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 85, max= 414, per=26.63%, avg=243.40, stdev=75.34, samples=48 iops : min= 5, max= 25, avg=14.44, stdev= 4.77, samples=48 write: IOPS=15, BW=253KiB/s (259kB/s)(6256KiB/24769msec); 0 zone resets clat (usec): min=1350, max=183427, avg=30816.80, stdev=32564.05 lat (usec): min=1353, max=183428, avg=30819.65, stdev=32564.74 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1811], 10.00th=[ 3097], 20.00th=[ 5276], | 30.00th=[ 8291], 40.00th=[ 11469], 50.00th=[ 18482], 60.00th=[ 27132], | 70.00th=[ 38536], 80.00th=[ 51643], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[143655], 99.50th=[149947], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 541, per=26.36%, avg=253.62, stdev=93.94, samples=48 iops : min= 3, max= 33, avg=15.08, stdev= 5.90, samples=48 lat (usec) : 50=1.95%, 100=10.94%, 250=0.78%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=3.26%, 4=4.69%, 10=10.29%, 20=10.68%, 50=32.94% lat (msec) : 100=19.79%, 250=3.91% cpu : usr=0.09%, sys=6.11%, ctx=1320, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=915KiB/s (937kB/s), 221KiB/s-244KiB/s (226kB/s-249kB/s), io=23.4MiB (24.5MB), run=24769-26184msec WRITE: bw=962KiB/s (986kB/s), 230KiB/s-253KiB/s (236kB/s-259kB/s), io=24.6MiB (25.8MB), run=24769-26184msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145238: Fri Oct 2 08:44:02 2026 read: IOPS=5, BW=91.8KiB/s (93.0kB/s)(5920KiB/64507msec) clat (msec): min=5, max=340, avg=37.55, stdev=43.70 lat (msec): min=5, max=340, avg=37.56, stdev=43.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 84], 95.00th=[ 127], | 99.00th=[ 228], 99.50th=[ 309], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 379, per=26.97%, avg=99.23, stdev=63.46, samples=116 iops : min= 1, max= 23, avg= 5.47, stdev= 4.02, samples=116 write: IOPS=6, BW=98.7KiB/s (101kB/s)(6368KiB/64507msec); 0 zone resets clat (msec): min=38, max=330, avg=126.31, stdev=56.19 lat (msec): min=38, max=330, avg=126.32, stdev=56.19 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 167], 90.00th=[ 207], 95.00th=[ 243], | 99.00th=[ 317], 99.50th=[ 326], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 223, per=25.79%, avg=99.79, stdev=45.85, samples=125 iops : min= 1, max= 13, avg= 5.50, stdev= 2.99, samples=125 lat (msec) : 10=2.60%, 20=17.32%, 50=19.79%, 100=24.09%, 250=33.72% lat (msec) : 500=2.47% cpu : usr=0.03%, sys=1.23%, ctx=1258, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145239: Fri Oct 2 08:44:02 2026 read: IOPS=5, BW=88.4KiB/s (90.6kB/s)(5744KiB/64955msec) clat (msec): min=7, max=249, avg=34.69, stdev=35.98 lat (msec): min=7, max=249, avg=34.69, stdev=35.98 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 115], | 99.00th=[ 180], 99.50th=[ 213], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 28, max= 414, per=27.77%, avg=102.19, stdev=70.86, samples=110 iops : min= 1, max= 25, avg= 5.64, stdev= 4.53, samples=110 write: IOPS=6, BW=101KiB/s (103kB/s)(6544KiB/64955msec); 0 zone resets clat (msec): min=39, max=450, avg=128.07, stdev=63.98 lat (msec): min=39, max=450, avg=128.08, stdev=63.98 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 167], 90.00th=[ 211], 95.00th=[ 259], | 99.00th=[ 380], 99.50th=[ 405], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 28, max= 223, per=26.01%, avg=100.68, stdev=45.33, samples=127 iops : min= 1, max= 13, avg= 5.56, stdev= 2.92, samples=127 lat (msec) : 10=2.73%, 20=18.75%, 50=17.58%, 100=25.65%, 250=32.42% lat (msec) : 500=2.86% cpu : usr=0.04%, sys=1.25%, ctx=1384, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145240: Fri Oct 2 08:44:02 2026 read: IOPS=6, BW=102KiB/s (105kB/s)(6256KiB/61052msec) clat (msec): min=6, max=239, avg=30.33, stdev=30.66 lat (msec): min=6, max=239, avg=30.33, stdev=30.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 58], 95.00th=[ 93], | 99.00th=[ 188], 99.50th=[ 199], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 30, max= 350, per=29.97%, avg=110.29, stdev=79.02, samples=112 iops : min= 1, max= 21, avg= 6.17, stdev= 5.04, samples=112 write: IOPS=6, BW=98.8KiB/s (101kB/s)(6032KiB/61052msec); 0 zone resets clat (msec): min=42, max=448, avg=129.83, stdev=62.74 lat (msec): min=42, max=448, avg=129.83, stdev=62.74 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 113], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 174], 90.00th=[ 224], 95.00th=[ 253], | 99.00th=[ 351], 99.50th=[ 393], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 28, max= 223, per=25.26%, avg=97.74, stdev=43.87, samples=120 iops : min= 1, max= 13, avg= 5.37, stdev= 2.84, samples=120 lat (msec) : 10=3.26%, 20=21.61%, 50=20.57%, 100=21.48%, 250=30.47% lat (msec) : 500=2.60% cpu : usr=0.04%, sys=1.29%, ctx=1422, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145241: Fri Oct 2 08:44:02 2026 read: IOPS=5, BW=95.7KiB/s (98.0kB/s)(6032KiB/63012msec) clat (msec): min=6, max=305, avg=34.64, stdev=39.32 lat (msec): min=6, max=305, avg=34.65, stdev=39.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 74], 95.00th=[ 116], | 99.00th=[ 220], 99.50th=[ 232], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 288, per=28.49%, avg=104.85, stdev=69.36, samples=112 iops : min= 1, max= 18, avg= 5.83, stdev= 4.43, samples=112 write: IOPS=6, BW=99.3KiB/s (102kB/s)(6256KiB/63012msec); 0 zone resets clat (msec): min=43, max=345, avg=126.53, stdev=56.33 lat (msec): min=43, max=345, avg=126.53, stdev=56.33 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 84], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 207], 95.00th=[ 249], | 99.00th=[ 321], 99.50th=[ 334], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 223, per=25.80%, avg=99.86, stdev=45.30, samples=123 iops : min= 1, max= 13, avg= 5.50, stdev= 2.94, samples=123 lat (msec) : 10=3.52%, 20=19.14%, 50=19.14%, 100=24.09%, 250=31.51% lat (msec) : 500=2.60% cpu : usr=0.03%, sys=1.26%, ctx=1323, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=369KiB/s (378kB/s), 88.4KiB/s-102KiB/s (90.6kB/s-105kB/s), io=23.4MiB (24.5MB), run=61052-64955msec WRITE: bw=388KiB/s (397kB/s), 98.7KiB/s-101KiB/s (101kB/s-103kB/s), io=24.6MiB (25.8MB), run=61052-64955msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145262: Fri Oct 2 08:44:18 2026 read: IOPS=1, BW=1427KiB/s (1461kB/s)(7168KiB/5024msec) clat (msec): min=122, max=552, avg=291.58, stdev=136.14 lat (msec): min=122, max=552, avg=291.58, stdev=136.14 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 226], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 241], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 355], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1892, max= 3025, per=65.72%, avg=2191.00, stdev=469.58, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=1019KiB/s (1044kB/s)(5120KiB/5024msec); 0 zone resets clat (msec): min=280, max=871, avg=596.11, stdev=234.15 lat (msec): min=280, max=871, avg=596.29, stdev=234.25 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1835, max= 2035, per=42.13%, avg=1966.80, stdev=79.67, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=10.83%, ctx=311, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145263: Fri Oct 2 08:44:18 2026 read: IOPS=0, BW=410KiB/s (420kB/s)(2048KiB/4997msec) clat (usec): min=499, max=374424, avg=187462.09, stdev=264405.28 lat (usec): min=500, max=374427, avg=187463.95, stdev=264406.22 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[375391], | 70.00th=[375391], 80.00th=[375391], 90.00th=[375391], 95.00th=[375391], | 99.00th=[375391], 99.50th=[375391], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 1723, max= 1835, per=53.36%, avg=1779.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2049KiB/s (2098kB/s)(10.0MiB/4997msec); 0 zone resets clat (msec): min=156, max=1179, avg=461.81, stdev=317.99 lat (msec): min=156, max=1179, avg=461.99, stdev=317.93 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 192], | 30.00th=[ 251], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 397], | 70.00th=[ 518], 80.00th=[ 531], 90.00th=[ 802], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1835, max= 4047, per=54.29%, avg=2534.43, stdev=949.58, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 500=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=10.47%, ctx=140, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145264: Fri Oct 2 08:44:18 2026 read: IOPS=1, BW=1755KiB/s (1797kB/s)(6144KiB/3501msec) clat (msec): min=2, max=327, avg=83.96, stdev=125.91 lat (msec): min=2, max=327, avg=83.96, stdev=125.91 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 56], | 70.00th=[ 105], 80.00th=[ 105], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1835, max= 5941, per=98.17%, avg=3273.00, stdev=2312.90, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1755KiB/s (1797kB/s)(6144KiB/3501msec); 0 zone resets clat (msec): min=252, max=838, avg=489.56, stdev=269.16 lat (msec): min=252, max=838, avg=489.63, stdev=269.16 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 600], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1835, max= 4071, per=70.46%, avg=3289.00, stdev=1260.40, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 4=16.67%, 20=8.33%, 100=8.33%, 250=8.33%, 500=33.33% lat (msec) : 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=9.20%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145265: Fri Oct 2 08:44:18 2026 read: IOPS=0, BW=834KiB/s (854kB/s)(5120KiB/6142msec) clat (usec): min=411, max=418620, avg=269967.28, stdev=163354.42 lat (usec): min=413, max=418621, avg=269968.74, stdev=163354.26 clat percentiles (usec): | 1.00th=[ 412], 5.00th=[ 412], 10.00th=[ 412], 20.00th=[ 412], | 30.00th=[254804], 40.00th=[254804], 50.00th=[304088], 60.00th=[304088], | 70.00th=[375391], 80.00th=[375391], 90.00th=[417334], 95.00th=[417334], | 99.00th=[417334], 99.50th=[417334], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 1892, max= 4071, per=79.22%, avg=2641.33, stdev=1238.61, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1167KiB/s (1195kB/s)(7168KiB/6142msec); 0 zone resets clat (msec): min=239, max=1125, avg=684.11, stdev=394.11 lat (msec): min=239, max=1125, avg=684.20, stdev=394.10 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 279], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 550], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1116], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1718, max= 4096, per=50.78%, avg=2370.60, stdev=973.47, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=8.33%, 500=50.00%, 750=8.33%, 2000=25.00% cpu : usr=0.00%, sys=8.76%, ctx=180, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3334KiB/s (3414kB/s), 410KiB/s-1755KiB/s (420kB/s-1797kB/s), io=20.0MiB (20.0MB), run=3501-6142msec WRITE: bw=4668KiB/s (4780kB/s), 1019KiB/s-2049KiB/s (1044kB/s-2098kB/s), io=28.0MiB (29.4MB), run=3501-6142msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145257: Fri Oct 2 08:44:19 2026 read: IOPS=1, BW=1690KiB/s (1731kB/s)(7168KiB/4241msec) clat (msec): min=75, max=287, avg=157.49, stdev=68.99 lat (msec): min=75, max=287, avg=157.49, stdev=68.99 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 112], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 163], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 186], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1799, max= 4156, per=100.00%, avg=3305.33, stdev=1308.16, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1207KiB/s (1236kB/s)(5120KiB/4241msec); 0 zone resets clat (msec): min=450, max=781, avg=621.92, stdev=118.25 lat (msec): min=451, max=782, avg=622.00, stdev=118.24 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1799, max= 2048, per=44.63%, avg=1971.25, stdev=115.83, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.05%, sys=3.61%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145258: Fri Oct 2 08:44:19 2026 read: IOPS=0, BW=316KiB/s (323kB/s)(2048KiB/6491msec) clat (msec): min=120, max=196, avg=158.40, stdev=53.44 lat (msec): min=120, max=196, avg=158.41, stdev=53.44 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1389, max= 2011, per=53.88%, avg=1700.00, stdev=439.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1578KiB/s (1615kB/s)(10.0MiB/6491msec); 0 zone resets clat (msec): min=209, max=2129, avg=607.50, stdev=566.61 lat (msec): min=210, max=2129, avg=607.65, stdev=566.58 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 279], | 30.00th=[ 300], 40.00th=[ 342], 50.00th=[ 355], 60.00th=[ 506], | 70.00th=[ 535], 80.00th=[ 567], 90.00th=[ 852], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 1389, max= 4096, per=55.91%, avg=2469.43, stdev=1088.61, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.17%, ctx=101, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145259: Fri Oct 2 08:44:19 2026 read: IOPS=1, BW=1025KiB/s (1050kB/s)(6144KiB/5992msec) clat (msec): min=112, max=828, avg=396.05, stdev=268.80 lat (msec): min=112, max=828, avg=396.05, stdev=268.80 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 477], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2011, max= 4096, per=80.59%, avg=2542.50, stdev=1035.80, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1025KiB/s (1050kB/s)(6144KiB/5992msec); 0 zone resets clat (msec): min=249, max=1054, avg=591.67, stdev=327.66 lat (msec): min=250, max=1054, avg=591.75, stdev=327.67 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 634], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1475, max= 4096, per=52.78%, avg=2331.40, stdev=1015.24, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=2.40%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145260: Fri Oct 2 08:44:19 2026 read: IOPS=0, BW=939KiB/s (961kB/s)(5120KiB/5453msec) clat (msec): min=85, max=411, avg=234.27, stdev=148.46 lat (msec): min=85, max=411, avg=234.27, stdev=148.46 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 3599, max= 4031, per=100.00%, avg=3815.00, stdev=305.47, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1315KiB/s (1346kB/s)(7168KiB/5453msec); 0 zone resets clat (msec): min=340, max=1058, avg=600.18, stdev=319.03 lat (msec): min=341, max=1058, avg=600.36, stdev=318.94 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 405], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 1003], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1430, max= 2048, per=43.55%, avg=1923.67, stdev=242.26, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 100=16.67%, 250=8.33%, 500=50.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.95%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3155KiB/s (3231kB/s), 316KiB/s-1690KiB/s (323kB/s-1731kB/s), io=20.0MiB (20.0MB), run=4241-6491msec WRITE: bw=4417KiB/s (4523kB/s), 1025KiB/s-1578KiB/s (1050kB/s-1615kB/s), io=28.0MiB (29.4MB), run=4241-6491msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145273: Fri Oct 2 08:44:35 2026 read: IOPS=0, BW=3041KiB/s (3114kB/s)(12.0MiB/4041msec) clat (msec): min=1109, max=1437, avg=1282.49, stdev=165.00 lat (msec): min=1109, max=1437, avg=1282.49, stdev=165.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.02%, sys=7.62%, ctx=273, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145274: Fri Oct 2 08:44:35 2026 read: IOPS=0, BW=889KiB/s (910kB/s)(4096KiB/4607msec) clat (nsec): min=1112.5M, max=1112.5M, avg=1112482309.00, stdev= 0.00 lat (nsec): min=1112.5M, max=1112.5M, avg=1112483826.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1778KiB/s (1821kB/s)(8192KiB/4607msec); 0 zone resets clat (msec): min=1347, max=2032, avg=1690.23, stdev=484.66 lat (msec): min=1347, max=2033, avg=1690.52, stdev=484.70 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 2039], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.41%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145275: Fri Oct 2 08:44:35 2026 write: IOPS=0, BW=2308KiB/s (2364kB/s)(12.0MiB/5323msec); 0 zone resets clat (msec): min=290, max=3093, avg=1702.69, stdev=1401.61 lat (msec): min=290, max=3095, avg=1703.45, stdev=1402.36 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8031, max= 8143, per=100.00%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.16%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145276: Fri Oct 2 08:44:35 2026 write: IOPS=0, BW=3192KiB/s (3268kB/s)(12.0MiB/3850msec); 0 zone resets clat (msec): min=733, max=2033, avg=1226.94, stdev=704.48 lat (msec): min=733, max=2033, avg=1227.27, stdev=704.43 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.78%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3556KiB/s (3642kB/s), 889KiB/s-3041KiB/s (910kB/s-3114kB/s), io=16.0MiB (16.8MB), run=4041-4607msec WRITE: bw=6156KiB/s (6304kB/s), 1778KiB/s-3192KiB/s (1821kB/s-3268kB/s), io=32.0MiB (33.6MB), run=3850-5323msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145278: Fri Oct 2 08:44:35 2026 read: IOPS=0, BW=3179KiB/s (3256kB/s)(12.0MiB/3865msec) clat (msec): min=667, max=1831, avg=1286.12, stdev=585.41 lat (msec): min=667, max=1831, avg=1286.12, stdev=585.41 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.54%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145279: Fri Oct 2 08:44:35 2026 read: IOPS=0, BW=1002KiB/s (1026kB/s)(4096KiB/4089msec) clat (nsec): min=1671.9M, max=1671.9M, avg=1671950240.00, stdev= 0.00 lat (nsec): min=1671.0M, max=1671.0M, avg=1671951605.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1670], 5.00th=[ 1670], 10.00th=[ 1670], 20.00th=[ 1670], | 30.00th=[ 1670], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2003KiB/s (2052kB/s)(8192KiB/4089msec); 0 zone resets clat (msec): min=804, max=1610, avg=1207.44, stdev=569.63 lat (msec): min=804, max=1610, avg=1207.77, stdev=569.67 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7953, max= 7953, per=99.25%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.02%, sys=3.25%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145280: Fri Oct 2 08:44:35 2026 write: IOPS=0, BW=3251KiB/s (3329kB/s)(12.0MiB/3780msec); 0 zone resets clat (msec): min=853, max=1762, avg=1257.03, stdev=463.11 lat (msec): min=854, max=1763, avg=1259.76, stdev=462.30 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8015, max= 8078, per=100.00%, avg=8046.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.05%, sys=2.86%, ctx=35, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145281: Fri Oct 2 08:44:35 2026 write: IOPS=0, BW=3776KiB/s (3867kB/s)(12.0MiB/3254msec); 0 zone resets clat (msec): min=861, max=1216, avg=1078.13, stdev=189.95 lat (msec): min=864, max=1216, avg=1079.36, stdev=188.38 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7984, max= 8126, per=100.00%, avg=8055.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.93%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4007KiB/s (4103kB/s), 1002KiB/s-3179KiB/s (1026kB/s-3256kB/s), io=16.0MiB (16.8MB), run=3865-4089msec WRITE: bw=8014KiB/s (8206kB/s), 2003KiB/s-3776KiB/s (2052kB/s-3867kB/s), io=32.0MiB (33.6MB), run=3254-4089msec