== sanity test 398b: DIO and buffer IO race ============== 05:39:53 (1769078393) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.43735 s, 6.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146793: Thu Jan 22 05:42:15 2026 read: IOPS=12, BW=51.3KiB/s (52.5kB/s)(5992KiB/116800msec) clat (usec): min=93, max=199925, avg=38414.49, stdev=28125.43 lat (usec): min=94, max=199927, avg=38418.23, stdev=28127.70 clat percentiles (usec): | 1.00th=[ 125], 5.00th=[ 165], 10.00th=[ 519], 20.00th=[ 17433], | 30.00th=[ 22414], 40.00th=[ 27657], 50.00th=[ 33162], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[147850], 99.90th=[191890], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 7, max= 135, per=25.38%, avg=51.26, stdev=23.15, samples=228 iops : min= 1, max= 33, avg=12.14, stdev= 5.83, samples=228 write: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6296KiB/116800msec); 0 zone resets clat (usec): min=623, max=419970, avg=37544.73, stdev=40398.08 lat (usec): min=624, max=419970, avg=37549.58, stdev=40399.47 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 3163], | 30.00th=[ 7767], 40.00th=[ 16581], 50.00th=[ 26870], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 63177], 90.00th=[ 89654], 95.00th=[114820], | 99.00th=[166724], 99.50th=[202376], 99.90th=[325059], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 7, max= 143, per=25.28%, avg=53.35, stdev=25.36, samples=230 iops : min= 1, max= 35, avg=12.67, stdev= 6.39, samples=230 lat (usec) : 100=0.03%, 250=4.33%, 500=0.49%, 750=0.33%, 1000=0.42% lat (msec) : 2=7.62%, 4=3.74%, 10=6.09%, 20=10.97%, 50=37.08% lat (msec) : 100=23.34%, 250=5.44%, 500=0.13% cpu : usr=0.08%, sys=5.39%, ctx=6250, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146794: Thu Jan 22 05:42:15 2026 read: IOPS=12, BW=50.3KiB/s (51.5kB/s)(5940KiB/118030msec) clat (usec): min=62, max=385743, avg=38949.86, stdev=31813.79 lat (usec): min=63, max=385744, avg=38951.91, stdev=31814.14 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 176], 10.00th=[ 963], 20.00th=[ 16581], | 30.00th=[ 22152], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 58459], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[143655], 99.50th=[158335], 99.90th=[261096], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 118, per=24.76%, avg=50.01, stdev=22.35, samples=232 iops : min= 1, max= 29, avg=11.83, stdev= 5.63, samples=232 write: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6348KiB/118030msec); 0 zone resets clat (usec): min=622, max=315389, avg=37823.96, stdev=40174.80 lat (usec): min=623, max=315391, avg=37832.07, stdev=40172.02 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 3556], | 30.00th=[ 7504], 40.00th=[ 15795], 50.00th=[ 26084], 60.00th=[ 35914], | 70.00th=[ 49021], 80.00th=[ 66323], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[166724], 99.50th=[177210], 99.90th=[278922], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 175, per=25.24%, avg=53.25, stdev=24.60, samples=233 iops : min= 1, max= 43, avg=12.65, stdev= 6.18, samples=233 lat (usec) : 100=0.03%, 250=3.91%, 500=0.65%, 750=0.20%, 1000=0.39% lat (msec) : 2=7.45%, 4=3.74%, 10=7.42%, 20=11.59%, 50=36.75% lat (msec) : 100=20.90%, 250=6.84%, 500=0.13% cpu : usr=0.08%, sys=5.34%, ctx=6274, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146795: Thu Jan 22 05:42:15 2026 read: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6028KiB/117546msec) clat (usec): min=106, max=393659, avg=37346.08, stdev=30435.83 lat (usec): min=106, max=393660, avg=37348.54, stdev=30435.24 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 169], 10.00th=[ 227], 20.00th=[ 16057], | 30.00th=[ 21365], 40.00th=[ 26346], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 55837], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[158335], 99.90th=[265290], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 136, per=25.22%, avg=50.95, stdev=23.76, samples=231 iops : min= 1, max= 34, avg=12.08, stdev= 5.99, samples=231 write: IOPS=13, BW=53.3KiB/s (54.5kB/s)(6260KiB/117546msec); 0 zone resets clat (usec): min=820, max=300760, avg=39047.68, stdev=40442.01 lat (usec): min=821, max=300760, avg=39051.54, stdev=40440.77 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1352], 20.00th=[ 3785], | 30.00th=[ 8848], 40.00th=[ 19006], 50.00th=[ 28443], 60.00th=[ 39060], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[177210], 99.50th=[212861], 99.90th=[291505], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 143, per=24.94%, avg=52.62, stdev=21.09, samples=232 iops : min= 1, max= 35, avg=12.49, stdev= 5.32, samples=232 lat (usec) : 250=5.11%, 500=0.36%, 750=0.23%, 1000=0.29% lat (msec) : 2=6.93%, 4=3.84%, 10=5.63%, 20=11.95%, 50=37.40% lat (msec) : 100=22.49%, 250=5.60%, 500=0.16% cpu : usr=0.09%, sys=5.39%, ctx=6260, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146796: Thu Jan 22 05:42:15 2026 read: IOPS=12, BW=50.0KiB/s (52.2kB/s)(6052KiB/118736msec) clat (usec): min=79, max=254423, avg=37920.91, stdev=29499.63 lat (usec): min=79, max=254424, avg=37923.01, stdev=29500.64 clat percentiles (usec): | 1.00th=[ 122], 5.00th=[ 167], 10.00th=[ 449], 20.00th=[ 16909], | 30.00th=[ 21627], 40.00th=[ 26346], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 46924], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[135267], 99.50th=[177210], 99.90th=[221250], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 159, per=25.06%, avg=50.62, stdev=23.21, samples=233 iops : min= 1, max= 39, avg=11.99, stdev= 5.86, samples=233 write: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6236KiB/118736msec); 0 zone resets clat (usec): min=734, max=573846, avg=39270.10, stdev=43227.98 lat (usec): min=735, max=573848, avg=39272.64, stdev=43227.80 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1270], 20.00th=[ 3097], | 30.00th=[ 6980], 40.00th=[ 15795], 50.00th=[ 27657], 60.00th=[ 40633], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[117965], | 99.00th=[170918], 99.50th=[196084], 99.90th=[325059], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 135, per=24.62%, avg=51.96, stdev=23.68, samples=234 iops : min= 1, max= 33, avg=12.32, stdev= 5.95, samples=234 lat (usec) : 100=0.03%, 250=4.36%, 500=0.59%, 750=0.23%, 1000=0.46% lat (msec) : 2=8.07%, 4=3.65%, 10=6.71%, 20=11.23%, 50=34.86% lat (msec) : 100=24.22%, 250=5.40%, 500=0.16%, 750=0.03% cpu : usr=0.09%, sys=5.37%, ctx=6290, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=202KiB/s (207kB/s), 50.3KiB/s-51.3KiB/s (51.5kB/s-52.5kB/s), io=23.4MiB (24.6MB), run=116800-118736msec WRITE: bw=212KiB/s (217kB/s), 52.5KiB/s-53.9KiB/s (53.8kB/s-55.2kB/s), io=24.6MiB (25.7MB), run=116800-118736msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146788: Thu Jan 22 05:44:43 2026 read: IOPS=5, BW=22.4KiB/s (22.9kB/s)(5992KiB/267873msec) clat (msec): min=4, max=747, avg=32.69, stdev=34.96 lat (msec): min=4, max=747, avg=32.70, stdev=34.95 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 70], 95.00th=[ 97], | 99.00th=[ 148], 99.50th=[ 176], 99.90th=[ 247], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 112, per=28.06%, avg=24.97, stdev=17.67, samples=463 iops : min= 1, max= 28, avg= 5.63, stdev= 4.46, samples=463 write: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6296KiB/267873msec); 0 zone resets clat (msec): min=16, max=602, avg=138.87, stdev=71.32 lat (msec): min=16, max=602, avg=138.87, stdev=71.32 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 50], 10.00th=[ 62], 20.00th=[ 79], | 30.00th=[ 95], 40.00th=[ 109], 50.00th=[ 126], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 232], 95.00th=[ 275], | 99.00th=[ 372], 99.50th=[ 388], 99.90th=[ 468], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 88, per=24.85%, avg=23.11, stdev=12.07, samples=524 iops : min= 1, max= 22, avg= 5.15, stdev= 3.08, samples=524 lat (msec) : 10=5.47%, 20=16.15%, 50=21.09%, 100=20.87%, 250=32.49% lat (msec) : 500=3.87%, 750=0.07% cpu : usr=0.04%, sys=1.22%, ctx=5198, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146789: Thu Jan 22 05:44:43 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(5940KiB/267791msec) clat (msec): min=3, max=617, avg=32.41, stdev=35.00 lat (msec): min=3, max=617, avg=32.41, stdev=35.00 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 72], 95.00th=[ 97], | 99.00th=[ 157], 99.50th=[ 180], 99.90th=[ 359], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 111, per=28.81%, avg=25.65, stdev=18.94, samples=448 iops : min= 1, max= 27, avg= 5.80, stdev= 4.77, samples=448 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6348KiB/267791msec); 0 zone resets clat (msec): min=19, max=572, avg=138.20, stdev=69.97 lat (msec): min=19, max=572, avg=138.20, stdev=69.97 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 48], 10.00th=[ 59], 20.00th=[ 79], | 30.00th=[ 93], 40.00th=[ 109], 50.00th=[ 127], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 239], 95.00th=[ 271], | 99.00th=[ 334], 99.50th=[ 351], 99.90th=[ 527], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 96, per=25.11%, avg=23.35, stdev=11.99, samples=524 iops : min= 1, max= 24, avg= 5.21, stdev= 3.06, samples=524 lat (msec) : 4=0.07%, 10=4.98%, 20=17.38%, 50=21.00%, 100=20.51% lat (msec) : 250=32.03%, 500=3.94%, 750=0.10% cpu : usr=0.04%, sys=1.14%, ctx=5154, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146790: Thu Jan 22 05:44:43 2026 read: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6028KiB/267133msec) clat (msec): min=4, max=393, avg=33.29, stdev=32.96 lat (msec): min=4, max=393, avg=33.29, stdev=32.96 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 94], | 99.00th=[ 163], 99.50th=[ 194], 99.90th=[ 359], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 112, per=27.73%, avg=24.68, stdev=17.61, samples=470 iops : min= 1, max= 28, avg= 5.55, stdev= 4.45, samples=470 write: IOPS=5, BW=23.4KiB/s (23.0kB/s)(6260KiB/267133msec); 0 zone resets clat (msec): min=18, max=707, avg=138.44, stdev=72.69 lat (msec): min=18, max=707, avg=138.44, stdev=72.69 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 50], 10.00th=[ 62], 20.00th=[ 81], | 30.00th=[ 94], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 192], 90.00th=[ 239], 95.00th=[ 271], | 99.00th=[ 355], 99.50th=[ 397], 99.90th=[ 600], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 88, per=24.76%, avg=23.03, stdev=12.26, samples=522 iops : min= 1, max= 22, avg= 5.13, stdev= 3.12, samples=522 lat (msec) : 10=5.01%, 20=16.54%, 50=21.29%, 100=21.74%, 250=31.15% lat (msec) : 500=4.20%, 750=0.07% cpu : usr=0.04%, sys=1.16%, ctx=5249, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146791: Thu Jan 22 05:44:43 2026 read: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6052KiB/267479msec) clat (msec): min=4, max=514, avg=32.71, stdev=33.11 lat (msec): min=4, max=514, avg=32.71, stdev=33.11 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 69], 95.00th=[ 97], | 99.00th=[ 150], 99.50th=[ 176], 99.90th=[ 296], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7, max= 160, per=28.90%, avg=25.72, stdev=18.64, samples=454 iops : min= 1, max= 40, avg= 5.80, stdev= 4.72, samples=454 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6236KiB/267479msec); 0 zone resets clat (msec): min=22, max=710, avg=139.62, stdev=73.00 lat (msec): min=22, max=710, avg=139.62, stdev=73.00 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 51], 10.00th=[ 63], 20.00th=[ 80], | 30.00th=[ 93], 40.00th=[ 109], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 363], 99.50th=[ 414], 99.90th=[ 535], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 88, per=24.47%, avg=22.76, stdev=12.08, samples=526 iops : min= 1, max= 22, avg= 5.06, stdev= 3.08, samples=526 lat (msec) : 10=5.63%, 20=16.28%, 50=21.45%, 100=21.16%, 250=31.67% lat (msec) : 500=3.68%, 750=0.13% cpu : usr=0.04%, sys=1.16%, ctx=5267, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.6KiB/s (91.8kB/s), 22.2KiB/s-22.6KiB/s (22.7kB/s-23.2kB/s), io=23.4MiB (24.6MB), run=267133-267873msec WRITE: bw=93.8KiB/s (96.1kB/s), 23.3KiB/s-23.7KiB/s (23.9kB/s-24.3kB/s), io=24.6MiB (25.7MB), run=267133-267873msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146852: Thu Jan 22 05:45:19 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5920KiB/27858msec) clat (usec): min=107, max=193211, avg=36480.59, stdev=31487.79 lat (usec): min=107, max=193211, avg=36482.66, stdev=31487.48 clat percentiles (usec): | 1.00th=[ 122], 5.00th=[ 151], 10.00th=[ 165], 20.00th=[ 210], | 30.00th=[ 18220], 40.00th=[ 28181], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[127402], 99.50th=[149947], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 471, per=25.49%, avg=210.54, stdev=83.25, samples=54 iops : min= 3, max= 29, avg=12.43, stdev= 5.31, samples=54 write: IOPS=14, BW=229KiB/s (234kB/s)(6368KiB/27858msec); 0 zone resets clat (usec): min=1423, max=264896, avg=35525.15, stdev=41253.09 lat (usec): min=1424, max=264897, avg=35553.51, stdev=41269.86 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1696], 10.00th=[ 1926], 20.00th=[ 4621], | 30.00th=[ 7373], 40.00th=[ 11207], 50.00th=[ 17171], 60.00th=[ 28705], | 70.00th=[ 44303], 80.00th=[ 64750], 90.00th=[ 95945], 95.00th=[116917], | 99.00th=[212861], 99.50th=[219153], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 536, per=26.27%, avg=228.31, stdev=101.31, samples=54 iops : min= 1, max= 33, avg=13.54, stdev= 6.41, samples=54 lat (usec) : 250=10.81%, 500=0.39%, 750=0.52%, 1000=0.13% lat (msec) : 2=5.86%, 4=4.56%, 10=11.07%, 20=9.38%, 50=30.34% lat (msec) : 100=20.70%, 250=6.12%, 500=0.13% cpu : usr=0.10%, sys=5.80%, ctx=1360, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146853: Thu Jan 22 05:45:19 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(5744KiB/28569msec) clat (usec): min=104, max=313388, avg=38799.53, stdev=34330.88 lat (usec): min=104, max=313389, avg=38801.02, stdev=34330.87 clat percentiles (usec): | 1.00th=[ 116], 5.00th=[ 149], 10.00th=[ 165], 20.00th=[ 314], | 30.00th=[ 18744], 40.00th=[ 28967], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 89654], | 99.00th=[139461], 99.50th=[152044], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 93, max= 377, per=24.22%, avg=200.05, stdev=64.21, samples=55 iops : min= 5, max= 23, avg=11.75, stdev= 4.07, samples=55 write: IOPS=14, BW=229KiB/s (235kB/s)(6544KiB/28569msec); 0 zone resets clat (usec): min=1337, max=241199, avg=35568.40, stdev=37891.90 lat (usec): min=1339, max=241200, avg=35574.68, stdev=37890.99 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1663], 10.00th=[ 2212], 20.00th=[ 5342], | 30.00th=[ 8848], 40.00th=[ 12911], 50.00th=[ 21365], 60.00th=[ 33817], | 70.00th=[ 46924], 80.00th=[ 62653], 90.00th=[ 87557], 95.00th=[106431], | 99.00th=[154141], 99.50th=[187696], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 30, max= 557, per=26.02%, avg=226.15, stdev=92.81, samples=55 iops : min= 1, max= 34, avg=13.36, stdev= 5.81, samples=55 lat (usec) : 250=8.98%, 500=0.52%, 750=0.52% lat (msec) : 2=5.34%, 4=4.30%, 10=10.03%, 20=11.07%, 50=29.43% lat (msec) : 100=24.48%, 250=5.21%, 500=0.13% cpu : usr=0.09%, sys=5.74%, ctx=1418, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146854: Thu Jan 22 05:45:19 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6256KiB/28971msec) clat (usec): min=115, max=228269, avg=39469.18, stdev=34206.30 lat (usec): min=115, max=228271, avg=39471.14, stdev=34206.26 clat percentiles (usec): | 1.00th=[ 124], 5.00th=[ 159], 10.00th=[ 176], 20.00th=[ 322], | 30.00th=[ 20055], 40.00th=[ 29230], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 94897], | 99.00th=[152044], 99.50th=[208667], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 92, max= 411, per=26.23%, avg=216.70, stdev=79.01, samples=56 iops : min= 5, max= 25, avg=12.80, stdev= 5.01, samples=56 write: IOPS=13, BW=208KiB/s (213kB/s)(6032KiB/28971msec); 0 zone resets clat (usec): min=1473, max=332768, avg=35430.29, stdev=39599.63 lat (usec): min=1475, max=332772, avg=35433.14, stdev=39599.40 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1778], 10.00th=[ 2835], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[ 13435], 50.00th=[ 20841], 60.00th=[ 31327], | 70.00th=[ 44303], 80.00th=[ 60031], 90.00th=[ 85459], 95.00th=[116917], | 99.00th=[170918], 99.50th=[208667], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 62, max= 382, per=23.60%, avg=205.05, stdev=82.76, samples=56 iops : min= 3, max= 23, avg=12.05, stdev= 5.22, samples=56 lat (usec) : 250=9.77%, 500=0.91% lat (msec) : 2=4.30%, 4=4.17%, 10=9.90%, 20=10.29%, 50=30.34% lat (msec) : 100=24.87%, 250=5.34%, 500=0.13% cpu : usr=0.08%, sys=5.77%, ctx=1377, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146855: Thu Jan 22 05:45:19 2026 read: IOPS=14, BW=227KiB/s (232kB/s)(6032KiB/26611msec) clat (usec): min=111, max=203536, avg=36357.39, stdev=35409.32 lat (usec): min=111, max=203538, avg=36358.75, stdev=35409.32 clat percentiles (usec): | 1.00th=[ 120], 5.00th=[ 153], 10.00th=[ 167], 20.00th=[ 198], | 30.00th=[ 1762], 40.00th=[ 22938], 50.00th=[ 32900], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[102237], | 99.00th=[147850], 99.50th=[175113], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 62, max= 440, per=26.71%, avg=220.59, stdev=94.81, samples=51 iops : min= 3, max= 27, avg=13.04, stdev= 6.02, samples=51 write: IOPS=14, BW=235KiB/s (241kB/s)(6256KiB/26611msec); 0 zone resets clat (usec): min=1386, max=285548, avg=32502.96, stdev=38763.28 lat (usec): min=1388, max=285550, avg=32538.86, stdev=38815.73 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1729], 10.00th=[ 2057], 20.00th=[ 4080], | 30.00th=[ 7439], 40.00th=[ 11207], 50.00th=[ 16909], 60.00th=[ 26084], | 70.00th=[ 38011], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[109577], | 99.00th=[179307], 99.50th=[225444], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 64, max= 384, per=26.59%, avg=231.06, stdev=87.86, samples=51 iops : min= 4, max= 24, avg=13.73, stdev= 5.59, samples=51 lat (usec) : 250=11.98%, 500=1.69%, 750=0.65%, 1000=0.13% lat (msec) : 2=5.34%, 4=6.12%, 10=9.38%, 20=10.16%, 50=27.86% lat (msec) : 100=19.66%, 250=6.90%, 500=0.13% cpu : usr=0.11%, sys=5.45%, ctx=1224, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=827KiB/s (847kB/s), 201KiB/s-227KiB/s (206kB/s-232kB/s), io=23.4MiB (24.5MB), run=26611-28971msec WRITE: bw=870KiB/s (891kB/s), 208KiB/s-235KiB/s (213kB/s-241kB/s), io=24.6MiB (25.8MB), run=26611-28971msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146857: Thu Jan 22 05:46:04 2026 read: IOPS=5, BW=81.4KiB/s (83.4kB/s)(5920KiB/72707msec) clat (msec): min=7, max=241, avg=41.81, stdev=38.85 lat (msec): min=7, max=241, avg=41.81, stdev=38.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 87], 95.00th=[ 140], | 99.00th=[ 199], 99.50th=[ 218], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 286, per=27.89%, avg=91.21, stdev=55.77, samples=126 iops : min= 1, max= 17, avg= 4.94, stdev= 3.55, samples=126 write: IOPS=5, BW=87.6KiB/s (89.7kB/s)(6368KiB/72707msec); 0 zone resets clat (msec): min=49, max=398, avg=143.63, stdev=65.22 lat (msec): min=49, max=398, avg=143.65, stdev=65.24 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 79], 20.00th=[ 89], | 30.00th=[ 103], 40.00th=[ 117], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 384], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 23, max= 191, per=25.66%, avg=88.27, stdev=38.04, samples=141 iops : min= 1, max= 11, avg= 4.74, stdev= 2.46, samples=141 lat (msec) : 10=0.78%, 20=14.19%, 50=21.09%, 100=23.18%, 250=36.98% lat (msec) : 500=3.78% cpu : usr=0.05%, sys=1.34%, ctx=1468, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146858: Thu Jan 22 05:46:04 2026 read: IOPS=4, BW=78.6KiB/s (80.5kB/s)(5744KiB/73048msec) clat (msec): min=6, max=452, avg=39.44, stdev=39.92 lat (msec): min=6, max=452, avg=39.44, stdev=39.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 115], | 99.00th=[ 182], 99.50th=[ 232], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 24, max= 255, per=27.65%, avg=90.42, stdev=55.88, samples=124 iops : min= 1, max= 15, avg= 4.90, stdev= 3.57, samples=124 write: IOPS=5, BW=89.6KiB/s (91.7kB/s)(6544KiB/73048msec); 0 zone resets clat (msec): min=47, max=440, avg=143.83, stdev=66.77 lat (msec): min=47, max=440, avg=143.83, stdev=66.77 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 116], 50.00th=[ 129], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 226], 95.00th=[ 275], | 99.00th=[ 376], 99.50th=[ 409], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 30, max= 192, per=26.62%, avg=91.58, stdev=39.09, samples=140 iops : min= 1, max= 12, avg= 4.96, stdev= 2.53, samples=140 lat (msec) : 10=1.82%, 20=13.67%, 50=20.44%, 100=22.92%, 250=36.98% lat (msec) : 500=4.17% cpu : usr=0.04%, sys=1.27%, ctx=1415, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146859: Thu Jan 22 05:46:04 2026 read: IOPS=5, BW=87.1KiB/s (89.2kB/s)(6256KiB/71842msec) clat (msec): min=6, max=245, avg=38.98, stdev=34.91 lat (msec): min=6, max=245, avg=38.98, stdev=34.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 109], | 99.00th=[ 186], 99.50th=[ 224], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 350, per=30.51%, avg=99.76, stdev=67.18, samples=124 iops : min= 1, max= 21, avg= 5.46, stdev= 4.25, samples=124 write: IOPS=5, BW=83.0KiB/s (85.0kB/s)(6032KiB/71842msec); 0 zone resets clat (msec): min=47, max=490, avg=149.97, stdev=71.19 lat (msec): min=47, max=490, avg=149.97, stdev=71.19 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 83], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 121], 50.00th=[ 134], 60.00th=[ 146], | 70.00th=[ 161], 80.00th=[ 192], 90.00th=[ 243], 95.00th=[ 292], | 99.00th=[ 422], 99.50th=[ 468], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 24, max= 191, per=24.82%, avg=85.38, stdev=36.96, samples=139 iops : min= 1, max= 11, avg= 4.55, stdev= 2.42, samples=139 lat (msec) : 10=2.08%, 20=16.28%, 50=20.44%, 100=20.44%, 250=36.07% lat (msec) : 500=4.69% cpu : usr=0.03%, sys=1.35%, ctx=1435, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146860: Thu Jan 22 05:46:04 2026 read: IOPS=5, BW=83.2KiB/s (85.2kB/s)(6032KiB/72526msec) clat (msec): min=6, max=416, avg=39.22, stdev=41.31 lat (msec): min=6, max=416, avg=39.22, stdev=41.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 106], | 99.00th=[ 201], 99.50th=[ 321], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 351, per=29.51%, avg=96.50, stdev=68.38, samples=122 iops : min= 1, max= 21, avg= 5.28, stdev= 4.34, samples=122 write: IOPS=5, BW=86.3KiB/s (88.3kB/s)(6256KiB/72526msec); 0 zone resets clat (msec): min=37, max=520, avg=147.61, stdev=66.74 lat (msec): min=37, max=520, avg=147.61, stdev=66.74 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 83], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 188], 90.00th=[ 241], 95.00th=[ 271], | 99.00th=[ 372], 99.50th=[ 443], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 30, max= 160, per=25.15%, avg=86.51, stdev=37.21, samples=142 iops : min= 1, max= 10, avg= 4.63, stdev= 2.40, samples=142 lat (msec) : 10=2.73%, 20=15.36%, 50=19.92%, 100=21.22%, 250=36.59% lat (msec) : 500=4.04%, 750=0.13% cpu : usr=0.04%, sys=1.26%, ctx=1330, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=328KiB/s (336kB/s), 78.6KiB/s-87.1KiB/s (80.5kB/s-89.2kB/s), io=23.4MiB (24.5MB), run=71842-73048msec WRITE: bw=345KiB/s (353kB/s), 83.0KiB/s-89.6KiB/s (85.0kB/s-91.7kB/s), io=24.6MiB (25.8MB), run=71842-73048msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146879: Thu Jan 22 05:46:22 2026 read: IOPS=1, BW=1380KiB/s (1413kB/s)(7168KiB/5193msec) clat (usec): min=620, max=394265, avg=170388.07, stdev=120237.21 lat (usec): min=622, max=394266, avg=170389.70, stdev=120236.89 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[119014], | 30.00th=[123208], 40.00th=[123208], 50.00th=[152044], 60.00th=[183501], | 70.00th=[183501], 80.00th=[219153], 90.00th=[396362], 95.00th=[396362], | 99.00th=[396362], 99.50th=[396362], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 2000, max= 5077, per=100.00%, avg=3700.00, stdev=1563.72, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=986KiB/s (1010kB/s)(5120KiB/5193msec); 0 zone resets clat (msec): min=232, max=2410, avg=785.78, stdev=923.84 lat (msec): min=232, max=2410, avg=785.84, stdev=923.83 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1899, max= 4063, per=58.01%, avg=2654.00, stdev=1221.27, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=7.01%, ctx=154, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146880: Thu Jan 22 05:46:22 2026 read: IOPS=0, BW=327KiB/s (335kB/s)(2048KiB/6266msec) clat (usec): min=590, max=2502.5k, avg=1251537.54, stdev=1769105.73 lat (usec): min=592, max=2502.5k, avg=1251539.48, stdev=1769106.65 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], | 20.00th=[ 594], 30.00th=[ 594], 40.00th=[ 594], | 50.00th=[ 594], 60.00th=[2499806], 70.00th=[2499806], | 80.00th=[2499806], 90.00th=[2499806], 95.00th=[2499806], | 99.00th=[2499806], 99.50th=[2499806], 99.90th=[2499806], | 99.95th=[2499806], 99.99th=[2499806] bw ( KiB/s): min= 2000, max= 2031, per=61.67%, avg=2015.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1634KiB/s (1673kB/s)(10.0MiB/6266msec); 0 zone resets clat (msec): min=223, max=627, avg=369.81, stdev=132.99 lat (msec): min=223, max=627, avg=369.91, stdev=132.99 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 230], | 30.00th=[ 275], 40.00th=[ 284], 50.00th=[ 330], 60.00th=[ 380], | 70.00th=[ 401], 80.00th=[ 405], 90.00th=[ 550], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1899, max= 4007, per=58.21%, avg=2663.17, stdev=1039.38, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.27%, ctx=591, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146881: Thu Jan 22 05:46:22 2026 read: IOPS=1, BW=1169KiB/s (1197kB/s)(6144KiB/5258msec) clat (usec): min=615, max=628955, avg=211051.54, stdev=229464.90 lat (usec): min=617, max=628957, avg=211053.19, stdev=229465.09 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 5276], | 30.00th=[ 5276], 40.00th=[183501], 50.00th=[183501], 60.00th=[204473], | 70.00th=[244319], 80.00th=[244319], 90.00th=[624952], 95.00th=[624952], | 99.00th=[624952], 99.50th=[624952], 99.90th=[624952], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 2011, max= 6095, per=100.00%, avg=3379.00, stdev=2352.15, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1169KiB/s (1197kB/s)(6144KiB/5258msec); 0 zone resets clat (msec): min=145, max=2517, avg=630.97, stdev=931.26 lat (msec): min=145, max=2518, avg=631.15, stdev=931.54 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 388], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2011, max= 4063, per=65.05%, avg=2976.00, stdev=1108.02, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=7.40%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146882: Thu Jan 22 05:46:22 2026 read: IOPS=1, BW=1052KiB/s (1077kB/s)(5120KiB/4869msec) clat (usec): min=989, max=314851, avg=172808.95, stdev=156860.22 lat (usec): min=991, max=314852, avg=172810.56, stdev=156859.84 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 988], | 30.00th=[ 3359], 40.00th=[ 3359], 50.00th=[263193], 60.00th=[263193], | 70.00th=[283116], 80.00th=[283116], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 2000, max= 6095, per=100.00%, avg=4047.50, stdev=2895.60, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1472KiB/s (1508kB/s)(7168KiB/4869msec); 0 zone resets clat (msec): min=118, max=2700, avg=541.88, stdev=957.17 lat (msec): min=118, max=2700, avg=542.30, stdev=957.03 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 132], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 144], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 405], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 2011, max= 5699, per=85.32%, avg=3903.33, stdev=1845.90, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.85%, ctx=135, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3268KiB/s (3347kB/s), 327KiB/s-1380KiB/s (335kB/s-1413kB/s), io=20.0MiB (20.0MB), run=4869-6266msec WRITE: bw=4576KiB/s (4686kB/s), 986KiB/s-1634KiB/s (1010kB/s-1673kB/s), io=28.0MiB (29.4MB), run=4869-6266msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146883: Thu Jan 22 05:46:22 2026 read: IOPS=1, BW=1234KiB/s (1263kB/s)(7168KiB/5811msec) clat (msec): min=104, max=572, avg=229.07, stdev=163.33 lat (msec): min=104, max=572, avg=229.07, stdev=163.33 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 111], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 169], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 288], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 3976, max= 4314, per=100.00%, avg=4145.00, stdev=239.00, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=0, BW=881KiB/s (902kB/s)(5120KiB/5811msec); 0 zone resets clat (msec): min=261, max=2218, avg=825.74, stdev=789.64 lat (msec): min=261, max=2218, avg=826.57, stdev=789.31 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1910, max= 2035, per=44.80%, avg=1965.00, stdev=54.92, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=2.50%, ctx=74, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146884: Thu Jan 22 05:46:22 2026 read: IOPS=0, BW=317KiB/s (325kB/s)(2048KiB/6454msec) clat (msec): min=99, max=2354, avg=1227.25, stdev=1594.21 lat (msec): min=99, max=2354, avg=1227.26, stdev=1594.22 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 2366], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1980, max= 2000, per=63.54%, avg=1990.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1587KiB/s (1625kB/s)(10.0MiB/6454msec); 0 zone resets clat (msec): min=109, max=776, avg=385.15, stdev=279.02 lat (msec): min=110, max=776, avg=385.27, stdev=279.03 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 122], | 30.00th=[ 133], 40.00th=[ 138], 50.00th=[ 174], 60.00th=[ 481], | 70.00th=[ 506], 80.00th=[ 667], 90.00th=[ 743], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1910, max= 6000, per=60.28%, avg=2644.00, stdev=1644.71, samples=6 iops : min= 1, max= 5, avg= 1.67, stdev= 1.63, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.65%, ctx=67, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146885: Thu Jan 22 05:46:22 2026 read: IOPS=0, BW=1011KiB/s (1035kB/s)(6144KiB/6077msec) clat (msec): min=107, max=483, avg=255.95, stdev=155.60 lat (msec): min=107, max=483, avg=255.95, stdev=155.60 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 268], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1910, max= 2035, per=62.87%, avg=1969.00, stdev=56.93, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=1011KiB/s (1035kB/s)(6144KiB/6077msec); 0 zone resets clat (msec): min=150, max=2656, avg=697.96, stdev=974.00 lat (msec): min=150, max=2656, avg=698.07, stdev=974.00 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 388], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1910, max= 2043, per=45.47%, avg=1994.40, stdev=52.86, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.02%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146886: Thu Jan 22 05:46:22 2026 read: IOPS=0, BW=783KiB/s (802kB/s)(5120KiB/6537msec) clat (msec): min=45, max=855, avg=320.55, stdev=318.75 lat (msec): min=45, max=855, avg=320.55, stdev=318.75 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1935, max= 2035, per=63.59%, avg=1991.50, stdev=41.54, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1097KiB/s (1123kB/s)(7168KiB/6537msec); 0 zone resets clat (msec): min=115, max=2979, avg=655.76, stdev=1030.28 lat (msec): min=115, max=2979, avg=655.87, stdev=1030.27 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 188], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 355], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 397], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 2000, max= 3976, per=74.45%, avg=3265.33, stdev=1098.58, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 250=41.67%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.45%, ctx=87, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3133KiB/s (3208kB/s), 317KiB/s-1234KiB/s (325kB/s-1263kB/s), io=20.0MiB (20.0MB), run=5811-6537msec WRITE: bw=4386KiB/s (4491kB/s), 881KiB/s-1587KiB/s (902kB/s-1625kB/s), io=28.0MiB (29.4MB), run=5811-6537msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146893: Thu Jan 22 05:46:39 2026 read: IOPS=0, BW=2228KiB/s (2282kB/s)(12.0MiB/5515msec) clat (msec): min=789, max=3501, avg=1753.94, stdev=1516.23 lat (msec): min=789, max=3501, avg=1753.94, stdev=1516.23 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.02%, ctx=501, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146894: Thu Jan 22 05:46:39 2026 read: IOPS=0, BW=656KiB/s (671kB/s)(4096KiB/6247msec) clat (nsec): min=3565.9M, max=3565.9M, avg=3565922341.00, stdev= 0.00 lat (nsec): min=3565.9M, max=3565.9M, avg=3565925123.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3574], 5.00th=[ 3574], 10.00th=[ 3574], 20.00th=[ 3574], | 30.00th=[ 3574], 40.00th=[ 3574], 50.00th=[ 3574], 60.00th=[ 3574], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1311KiB/s (1343kB/s)(8192KiB/6247msec); 0 zone resets clat (msec): min=890, max=1721, avg=1306.31, stdev=587.75 lat (msec): min=892, max=1722, avg=1307.37, stdev=586.80 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.75%, ctx=437, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146895: Thu Jan 22 05:46:39 2026 write: IOPS=0, BW=2110KiB/s (2161kB/s)(12.0MiB/5823msec); 0 zone resets clat (msec): min=520, max=3821, avg=1918.04, stdev=1707.87 lat (msec): min=520, max=3823, avg=1918.95, stdev=1708.44 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.56%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146896: Thu Jan 22 05:46:39 2026 write: IOPS=0, BW=2194KiB/s (2246kB/s)(12.0MiB/5602msec); 0 zone resets clat (msec): min=334, max=3358, avg=1805.66, stdev=1513.88 lat (msec): min=334, max=3359, avg=1806.75, stdev=1513.74 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.95%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2623KiB/s (2686kB/s), 656KiB/s-2228KiB/s (671kB/s-2282kB/s), io=16.0MiB (16.8MB), run=5515-6247msec WRITE: bw=5245KiB/s (5371kB/s), 1311KiB/s-2194KiB/s (1343kB/s-2246kB/s), io=32.0MiB (33.6MB), run=5602-6247msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146898: Thu Jan 22 05:46:40 2026 read: IOPS=0, BW=1838KiB/s (1882kB/s)(12.0MiB/6686msec) clat (msec): min=1082, max=3962, avg=2167.21, stdev=1565.83 lat (msec): min=1082, max=3962, avg=2167.21, stdev=1565.83 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 7968, max= 8192, per=100.00%, avg=8080.00, stdev=158.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.80%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146899: Thu Jan 22 05:46:40 2026 read: IOPS=0, BW=587KiB/s (601kB/s)(4096KiB/6977msec) clat (nsec): min=4420.9M, max=4420.9M, avg=4420915073.00, stdev= 0.00 lat (nsec): min=4420.9M, max=4420.9M, avg=4420919498.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4396], 5.00th=[ 4396], 10.00th=[ 4396], 20.00th=[ 4396], | 30.00th=[ 4396], 40.00th=[ 4396], 50.00th=[ 4396], 60.00th=[ 4396], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1174KiB/s (1202kB/s)(8192KiB/6977msec); 0 zone resets clat (msec): min=477, max=1784, avg=1131.15, stdev=924.22 lat (msec): min=478, max=1787, avg=1132.89, stdev=925.85 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.78%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146900: Thu Jan 22 05:46:40 2026 write: IOPS=0, BW=1758KiB/s (1800kB/s)(12.0MiB/6991msec); 0 zone resets clat (msec): min=418, max=4270, avg=2270.48, stdev=1930.12 lat (msec): min=419, max=4270, avg=2270.91, stdev=1930.07 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 2123], 50.00th=[ 2123], 60.00th=[ 2123], | 70.00th=[ 4279], 80.00th=[ 4279], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 8047, max= 8143, per=100.00%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.60%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146901: Thu Jan 22 05:46:40 2026 write: IOPS=0, BW=2152KiB/s (2203kB/s)(12.0MiB/5711msec); 0 zone resets clat (msec): min=812, max=3683, avg=1877.20, stdev=1572.73 lat (msec): min=814, max=3684, avg=1877.95, stdev=1572.43 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.59%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2348KiB/s (2405kB/s), 587KiB/s-1838KiB/s (601kB/s-1882kB/s), io=16.0MiB (16.8MB), run=6686-6977msec WRITE: bw=4687KiB/s (4800kB/s), 1174KiB/s-2152KiB/s (1202kB/s-2203kB/s), io=32.0MiB (33.6MB), run=5711-6991msec