== sanity test 398b: DIO and buffer IO race ============== 01:28:47 (1788931727) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.6588 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145866: Wed Sep 9 01:30:44 2026 read: IOPS=14, BW=59.2KiB/s (60.6kB/s)(5992KiB/101264msec) clat (usec): min=31, max=851822, avg=32680.40, stdev=32542.42 lat (usec): min=32, max=851823, avg=32687.06, stdev=32543.70 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 5866], 20.00th=[ 15008], | 30.00th=[ 19006], 40.00th=[ 22414], 50.00th=[ 26870], 60.00th=[ 31851], | 70.00th=[ 39584], 80.00th=[ 47973], 90.00th=[ 62653], 95.00th=[ 76022], | 99.00th=[112722], 99.50th=[127402], 99.90th=[250610], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 127, per=24.97%, avg=58.93, stdev=22.85, samples=198 iops : min= 1, max= 31, avg=14.12, stdev= 5.73, samples=198 write: IOPS=15, BW=62.2KiB/s (63.7kB/s)(6296KiB/101264msec); 0 zone resets clat (usec): min=929, max=288891, avg=32985.12, stdev=33822.06 lat (usec): min=931, max=288891, avg=32986.54, stdev=33821.99 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1844], 20.00th=[ 3621], | 30.00th=[ 7177], 40.00th=[ 16909], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 42730], 80.00th=[ 55837], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[191890], 99.90th=[278922], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 15, max= 120, per=25.07%, avg=61.93, stdev=22.58, samples=198 iops : min= 3, max= 30, avg=14.86, stdev= 5.66, samples=198 lat (usec) : 50=0.72%, 100=3.39%, 250=0.42%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=5.44%, 4=5.24%, 10=7.49%, 20=15.23%, 50=40.82% lat (msec) : 100=17.87%, 250=2.90%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=6.41%, ctx=6800, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145867: Wed Sep 9 01:30:44 2026 read: IOPS=14, BW=58.9KiB/s (60.4kB/s)(5940KiB/100764msec) clat (usec): min=27, max=847518, avg=33588.80, stdev=34409.39 lat (usec): min=28, max=847520, avg=33592.73, stdev=34408.51 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 6587], 20.00th=[ 15664], | 30.00th=[ 20055], 40.00th=[ 23987], 50.00th=[ 27395], 60.00th=[ 32900], | 70.00th=[ 40109], 80.00th=[ 47973], 90.00th=[ 60556], 95.00th=[ 76022], | 99.00th=[117965], 99.50th=[189793], 99.90th=[413139], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 8, max= 126, per=24.97%, avg=58.93, stdev=20.63, samples=197 iops : min= 2, max= 31, avg=14.11, stdev= 5.16, samples=197 write: IOPS=15, BW=62.0KiB/s (64.5kB/s)(6348KiB/100764msec); 0 zone resets clat (usec): min=934, max=242939, avg=31808.94, stdev=32503.63 lat (usec): min=935, max=242940, avg=31810.96, stdev=32504.13 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1287], 10.00th=[ 1827], 20.00th=[ 3458], | 30.00th=[ 6849], 40.00th=[ 15401], 50.00th=[ 23725], 60.00th=[ 31589], | 70.00th=[ 41681], 80.00th=[ 54264], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[160433], 99.90th=[214959], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 15, max= 143, per=25.60%, avg=63.23, stdev=23.77, samples=196 iops : min= 3, max= 35, avg=15.19, stdev= 5.97, samples=196 lat (usec) : 50=0.46%, 100=3.74%, 250=0.29%, 500=0.07%, 1000=0.13% lat (msec) : 2=5.99%, 4=5.21%, 10=7.75%, 20=14.36%, 50=41.11% lat (msec) : 100=17.81%, 250=2.93%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=6.40%, ctx=6570, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145869: Wed Sep 9 01:30:44 2026 read: IOPS=14, BW=59.4KiB/s (60.8kB/s)(6028KiB/101505msec) clat (usec): min=32, max=288723, avg=32405.55, stdev=24520.33 lat (usec): min=32, max=288724, avg=32406.73, stdev=24520.31 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 6849], 20.00th=[ 15401], | 30.00th=[ 19792], 40.00th=[ 23725], 50.00th=[ 27919], 60.00th=[ 32375], | 70.00th=[ 39584], 80.00th=[ 47449], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[111674], 99.50th=[131597], 99.90th=[208667], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 135, per=25.09%, avg=59.21, stdev=22.68, samples=199 iops : min= 1, max= 33, avg=14.18, stdev= 5.67, samples=199 write: IOPS=15, BW=61.7KiB/s (63.2kB/s)(6260KiB/101505msec); 0 zone resets clat (usec): min=927, max=827440, avg=33399.61, stdev=40386.52 lat (usec): min=928, max=827441, avg=33408.93, stdev=40390.26 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1237], 10.00th=[ 1827], 20.00th=[ 4080], | 30.00th=[ 7439], 40.00th=[ 16450], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 56361], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[139461], 99.50th=[173016], 99.90th=[509608], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 135, per=24.73%, avg=61.09, stdev=23.06, samples=200 iops : min= 1, max= 33, avg=14.65, stdev= 5.81, samples=200 lat (usec) : 50=0.62%, 100=3.45%, 250=0.49%, 500=0.03%, 1000=0.20% lat (msec) : 2=5.53%, 4=4.65%, 10=7.78%, 20=14.10%, 50=42.12% lat (msec) : 100=18.52%, 250=2.34%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.38%, ctx=6711, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145870: Wed Sep 9 01:30:44 2026 read: IOPS=14, BW=59.6KiB/s (60.0kB/s)(6052KiB/101624msec) clat (usec): min=35, max=351836, avg=32020.87, stdev=26034.87 lat (usec): min=35, max=351837, avg=32026.09, stdev=26038.09 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 122], 20.00th=[ 14222], | 30.00th=[ 18482], 40.00th=[ 22676], 50.00th=[ 26608], 60.00th=[ 31851], | 70.00th=[ 39060], 80.00th=[ 47973], 90.00th=[ 62653], 95.00th=[ 76022], | 99.00th=[109577], 99.50th=[137364], 99.90th=[256902], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 127, per=25.30%, avg=59.72, stdev=22.87, samples=197 iops : min= 1, max= 31, avg=14.31, stdev= 5.73, samples=197 write: IOPS=15, BW=61.4KiB/s (62.8kB/s)(6236KiB/101624msec); 0 zone resets clat (usec): min=998, max=946454, avg=33845.93, stdev=42554.17 lat (usec): min=999, max=946455, avg=33847.85, stdev=42554.01 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1844], 20.00th=[ 3654], | 30.00th=[ 6980], 40.00th=[ 15270], 50.00th=[ 23987], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 57410], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[154141], 99.50th=[191890], 99.90th=[396362], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 151, per=24.72%, avg=61.06, stdev=23.13, samples=199 iops : min= 1, max= 37, avg=14.64, stdev= 5.79, samples=199 lat (usec) : 50=0.78%, 100=3.87%, 250=0.59%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=5.76%, 4=5.53%, 10=7.03%, 20=15.30%, 50=39.10% lat (msec) : 100=18.39%, 250=3.03%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=6.31%, ctx=6635, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=236KiB/s (242kB/s), 58.9KiB/s-59.6KiB/s (60.4kB/s-60.0kB/s), io=23.4MiB (24.6MB), run=100764-101624msec WRITE: bw=247KiB/s (253kB/s), 61.4KiB/s-62.0KiB/s (62.8kB/s-64.5kB/s), io=24.6MiB (25.7MB), run=100764-101624msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145865: Wed Sep 9 01:32:29 2026 read: IOPS=7, BW=29.1KiB/s (29.8kB/s)(5992KiB/205862msec) clat (msec): min=4, max=847, avg=28.04, stdev=35.15 lat (msec): min=4, max=847, avg=28.04, stdev=35.15 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 58], 95.00th=[ 80], | 99.00th=[ 124], 99.50th=[ 155], 99.90th=[ 451], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 104, per=26.52%, avg=30.76, stdev=20.14, samples=379 iops : min= 1, max= 26, avg= 7.11, stdev= 5.07, samples=379 write: IOPS=7, BW=30.6KiB/s (31.3kB/s)(6296KiB/205862msec); 0 zone resets clat (msec): min=29, max=510, avg=103.87, stdev=51.03 lat (msec): min=29, max=510, avg=103.87, stdev=51.03 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 82], 50.00th=[ 90], 60.00th=[ 101], | 70.00th=[ 114], 80.00th=[ 138], 90.00th=[ 174], 95.00th=[ 203], | 99.00th=[ 268], 99.50th=[ 300], 99.90th=[ 418], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 56, per=24.96%, avg=30.20, stdev=13.21, samples=405 iops : min= 1, max= 14, avg= 6.96, stdev= 3.35, samples=405 lat (msec) : 10=8.14%, 20=18.16%, 50=18.88%, 100=32.98%, 250=20.77% lat (msec) : 500=1.01%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.44%, ctx=5474, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145868: Wed Sep 9 01:32:29 2026 read: IOPS=7, BW=28.8KiB/s (29.5kB/s)(5940KiB/206315msec) clat (msec): min=5, max=841, avg=27.95, stdev=32.55 lat (msec): min=5, max=841, avg=27.96, stdev=32.55 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 58], 95.00th=[ 80], | 99.00th=[ 131], 99.50th=[ 144], 99.90th=[ 207], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 111, per=26.87%, avg=31.16, stdev=20.70, samples=371 iops : min= 1, max= 27, avg= 7.21, stdev= 5.18, samples=371 write: IOPS=7, BW=30.8KiB/s (31.5kB/s)(6348KiB/206315msec); 0 zone resets clat (msec): min=31, max=617, avg=103.63, stdev=51.78 lat (msec): min=31, max=617, avg=103.63, stdev=51.78 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 89], 60.00th=[ 100], | 70.00th=[ 114], 80.00th=[ 136], 90.00th=[ 174], 95.00th=[ 205], | 99.00th=[ 275], 99.50th=[ 305], 99.90th=[ 510], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 71, per=25.03%, avg=30.28, stdev=13.18, samples=407 iops : min= 1, max= 17, avg= 6.98, stdev= 3.35, samples=407 lat (msec) : 10=7.26%, 20=18.68%, 50=18.36%, 100=34.18%, 250=20.70% lat (msec) : 500=0.72%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.46%, ctx=5502, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145871: Wed Sep 9 01:32:29 2026 read: IOPS=7, BW=29.2KiB/s (29.0kB/s)(6028KiB/206080msec) clat (msec): min=5, max=362, avg=28.90, stdev=29.02 lat (msec): min=5, max=362, avg=28.90, stdev=29.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 63], 95.00th=[ 86], | 99.00th=[ 138], 99.50th=[ 161], 99.90th=[ 309], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 103, per=26.34%, avg=30.56, stdev=20.08, samples=384 iops : min= 1, max= 25, avg= 7.06, stdev= 5.05, samples=384 write: IOPS=7, BW=30.4KiB/s (31.1kB/s)(6260KiB/206080msec); 0 zone resets clat (msec): min=33, max=927, avg=103.63, stdev=56.84 lat (msec): min=33, max=927, avg=103.63, stdev=56.84 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 65], | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 89], 60.00th=[ 99], | 70.00th=[ 112], 80.00th=[ 136], 90.00th=[ 169], 95.00th=[ 205], | 99.00th=[ 292], 99.50th=[ 334], 99.90th=[ 617], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 71, per=24.78%, avg=29.99, stdev=13.67, samples=406 iops : min= 1, max= 17, avg= 6.91, stdev= 3.47, samples=406 lat (msec) : 10=7.94%, 20=18.20%, 50=18.20%, 100=34.93%, 250=19.56% lat (msec) : 500=1.11%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.44%, ctx=5492, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145872: Wed Sep 9 01:32:29 2026 read: IOPS=7, BW=29.6KiB/s (30.4kB/s)(6052KiB/204140msec) clat (msec): min=4, max=371, avg=27.42, stdev=26.36 lat (msec): min=4, max=371, avg=27.43, stdev=26.36 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 39], 90.00th=[ 63], 95.00th=[ 79], | 99.00th=[ 127], 99.50th=[ 142], 99.90th=[ 211], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 127, per=27.57%, avg=31.98, stdev=21.30, samples=369 iops : min= 1, max= 31, avg= 7.40, stdev= 5.36, samples=369 write: IOPS=7, BW=30.5KiB/s (31.3kB/s)(6236KiB/204140msec); 0 zone resets clat (msec): min=31, max=933, avg=104.11, stdev=56.09 lat (msec): min=31, max=933, avg=104.11, stdev=56.09 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 55], 20.00th=[ 65], | 30.00th=[ 72], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 100], | 70.00th=[ 114], 80.00th=[ 140], 90.00th=[ 174], 95.00th=[ 209], | 99.00th=[ 279], 99.50th=[ 305], 99.90th=[ 609], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 71, per=24.94%, avg=30.17, stdev=13.60, samples=402 iops : min= 1, max= 17, avg= 6.96, stdev= 3.45, samples=402 lat (msec) : 10=8.56%, 20=18.16%, 50=18.49%, 100=33.50%, 250=20.35% lat (msec) : 500=0.88%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.43%, ctx=5400, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=116KiB/s (119kB/s), 28.8KiB/s-29.6KiB/s (29.5kB/s-30.4kB/s), io=23.4MiB (24.6MB), run=204140-206315msec WRITE: bw=122KiB/s (125kB/s), 30.4KiB/s-30.8KiB/s (31.1kB/s-31.5kB/s), io=24.6MiB (25.7MB), run=204140-206315msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145915: Wed Sep 9 01:32:58 2026 read: IOPS=18, BW=295KiB/s (302kB/s)(5920KiB/20071msec) clat (usec): min=40, max=131140, avg=26886.59, stdev=21919.71 lat (usec): min=40, max=131141, avg=26887.63, stdev=21919.69 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 115], | 30.00th=[ 15533], 40.00th=[ 21627], 50.00th=[ 25035], 60.00th=[ 29230], | 70.00th=[ 34866], 80.00th=[ 42206], 90.00th=[ 56886], 95.00th=[ 63701], | 99.00th=[ 93848], 99.50th=[119014], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 158, max= 506, per=24.78%, avg=290.90, stdev=83.88, samples=39 iops : min= 9, max= 31, avg=17.51, stdev= 5.18, samples=39 write: IOPS=19, BW=317KiB/s (325kB/s)(6368KiB/20071msec); 0 zone resets clat (usec): min=1351, max=303986, avg=25107.68, stdev=28684.09 lat (usec): min=1352, max=303989, avg=25109.55, stdev=28684.11 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1991], 10.00th=[ 2868], 20.00th=[ 4883], | 30.00th=[ 6259], 40.00th=[ 9503], 50.00th=[ 17433], 60.00th=[ 25297], | 70.00th=[ 33424], 80.00th=[ 42206], 90.00th=[ 54789], 95.00th=[ 65274], | 99.00th=[139461], 99.50th=[217056], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 62, max= 573, per=25.66%, avg=317.10, stdev=112.25, samples=39 iops : min= 3, max= 35, avg=19.15, stdev= 7.09, samples=39 lat (usec) : 50=1.04%, 100=8.07%, 250=1.17%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=5.73%, 10=13.02%, 20=12.89%, 50=40.49% lat (msec) : 100=12.50%, 250=1.17%, 500=0.13% cpu : usr=0.09%, sys=8.96%, ctx=1594, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145916: Wed Sep 9 01:32:58 2026 read: IOPS=17, BW=282KiB/s (289kB/s)(5744KiB/20385msec) clat (usec): min=35, max=234341, avg=28687.27, stdev=24319.13 lat (usec): min=35, max=234342, avg=28688.53, stdev=24319.18 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 285], | 30.00th=[ 17433], 40.00th=[ 22938], 50.00th=[ 26346], 60.00th=[ 31065], | 70.00th=[ 35914], 80.00th=[ 42206], 90.00th=[ 56361], 95.00th=[ 71828], | 99.00th=[103285], 99.50th=[109577], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 95, max= 506, per=23.90%, avg=280.60, stdev=93.67, samples=40 iops : min= 5, max= 31, avg=16.88, stdev= 5.88, samples=40 write: IOPS=20, BW=321KiB/s (329kB/s)(6544KiB/20385msec); 0 zone resets clat (usec): min=1350, max=134971, avg=24515.76, stdev=23488.64 lat (usec): min=1352, max=134972, avg=24517.60, stdev=23488.58 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1942], 10.00th=[ 2671], 20.00th=[ 4080], | 30.00th=[ 6259], 40.00th=[ 9634], 50.00th=[ 17171], 60.00th=[ 25035], | 70.00th=[ 33424], 80.00th=[ 44303], 90.00th=[ 56886], 95.00th=[ 69731], | 99.00th=[100140], 99.50th=[105382], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 95, max= 640, per=25.83%, avg=319.30, stdev=96.29, samples=40 iops : min= 5, max= 40, avg=19.30, stdev= 6.03, samples=40 lat (usec) : 50=0.65%, 100=7.29%, 250=1.30%, 500=0.13% lat (msec) : 2=3.26%, 4=7.68%, 10=11.72%, 20=12.76%, 50=40.76% lat (msec) : 100=13.28%, 250=1.17% cpu : usr=0.08%, sys=8.83%, ctx=1546, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145917: Wed Sep 9 01:32:58 2026 read: IOPS=20, BW=327KiB/s (334kB/s)(6256KiB/19159msec) clat (usec): min=36, max=184565, avg=26902.85, stdev=22392.42 lat (usec): min=36, max=184566, avg=26904.47, stdev=22393.04 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 129], | 30.00th=[ 16712], 40.00th=[ 20317], 50.00th=[ 24773], 60.00th=[ 29754], | 70.00th=[ 36439], 80.00th=[ 44303], 90.00th=[ 54264], 95.00th=[ 64750], | 99.00th=[ 91751], 99.50th=[112722], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 127, max= 569, per=28.07%, avg=329.57, stdev=99.14, samples=37 iops : min= 7, max= 35, avg=19.95, stdev= 6.19, samples=37 write: IOPS=19, BW=315KiB/s (322kB/s)(6032KiB/19159msec); 0 zone resets clat (usec): min=1434, max=153613, avg=22560.19, stdev=22211.23 lat (usec): min=1435, max=153616, avg=22570.80, stdev=22205.25 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1991], 10.00th=[ 3064], 20.00th=[ 4359], | 30.00th=[ 6128], 40.00th=[ 8717], 50.00th=[ 16057], 60.00th=[ 21103], | 70.00th=[ 28705], 80.00th=[ 40109], 90.00th=[ 53740], 95.00th=[ 67634], | 99.00th=[ 95945], 99.50th=[107480], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 127, max= 633, per=25.28%, avg=312.43, stdev=108.60, samples=37 iops : min= 7, max= 39, avg=18.86, stdev= 6.84, samples=37 lat (usec) : 50=1.04%, 100=8.33%, 250=1.82%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.86%, 4=6.12%, 10=12.76%, 20=14.06%, 50=39.45% lat (msec) : 100=12.37%, 250=0.65% cpu : usr=0.07%, sys=8.98%, ctx=1509, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145918: Wed Sep 9 01:32:58 2026 read: IOPS=19, BW=310KiB/s (317kB/s)(6032KiB/19471msec) clat (usec): min=35, max=152797, avg=26425.90, stdev=23732.58 lat (usec): min=36, max=152799, avg=26451.59, stdev=23734.17 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 106], | 30.00th=[ 14484], 40.00th=[ 20317], 50.00th=[ 24249], 60.00th=[ 28181], | 70.00th=[ 33424], 80.00th=[ 41681], 90.00th=[ 56361], 95.00th=[ 71828], | 99.00th=[ 92799], 99.50th=[128451], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 62, max= 475, per=26.22%, avg=307.79, stdev=96.27, samples=38 iops : min= 3, max= 29, avg=18.58, stdev= 6.10, samples=38 write: IOPS=20, BW=321KiB/s (329kB/s)(6256KiB/19471msec); 0 zone resets clat (usec): min=1381, max=132299, avg=23895.45, stdev=25916.50 lat (usec): min=1382, max=132299, avg=23897.33, stdev=25916.47 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1975], 10.00th=[ 3228], 20.00th=[ 4621], | 30.00th=[ 6194], 40.00th=[ 8717], 50.00th=[ 13435], 60.00th=[ 21365], | 70.00th=[ 28181], 80.00th=[ 39584], 90.00th=[ 58983], 95.00th=[ 79168], | 99.00th=[129500], 99.50th=[131597], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 160, max= 537, per=25.84%, avg=319.34, stdev=97.66, samples=38 iops : min= 10, max= 33, avg=19.32, stdev= 6.07, samples=38 lat (usec) : 50=1.56%, 100=8.20%, 250=1.95%, 500=0.78%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.86%, 4=5.21%, 10=14.19%, 20=13.67%, 50=36.98% lat (msec) : 100=12.76%, 250=1.56% cpu : usr=0.07%, sys=8.96%, ctx=1523, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1175KiB/s (1203kB/s), 282KiB/s-327KiB/s (289kB/s-334kB/s), io=23.4MiB (24.5MB), run=19159-20385msec WRITE: bw=1236KiB/s (1266kB/s), 315KiB/s-321KiB/s (322kB/s-329kB/s), io=24.6MiB (25.8MB), run=19159-20385msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145920: Wed Sep 9 01:33:26 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(5920KiB/48510msec) clat (msec): min=6, max=183, avg=27.43, stdev=24.98 lat (msec): min=6, max=183, avg=27.44, stdev=24.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 36], 90.00th=[ 53], 95.00th=[ 79], | 99.00th=[ 138], 99.50th=[ 169], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 446, per=26.00%, avg=128.18, stdev=80.00, samples=91 iops : min= 1, max= 27, avg= 7.29, stdev= 5.06, samples=91 write: IOPS=8, BW=131KiB/s (134kB/s)(6368KiB/48510msec); 0 zone resets clat (msec): min=39, max=280, avg=95.82, stdev=41.18 lat (msec): min=39, max=280, avg=95.82, stdev=41.18 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 51], 10.00th=[ 56], 20.00th=[ 63], | 30.00th=[ 71], 40.00th=[ 79], 50.00th=[ 86], 60.00th=[ 94], | 70.00th=[ 104], 80.00th=[ 120], 90.00th=[ 155], 95.00th=[ 190], | 99.00th=[ 230], 99.50th=[ 236], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 28, max= 224, per=25.16%, avg=130.59, stdev=51.06, samples=96 iops : min= 1, max= 14, avg= 7.44, stdev= 3.30, samples=96 lat (msec) : 10=5.47%, 20=18.75%, 50=21.22%, 100=35.16%, 250=19.27% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.83%, ctx=1427, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145921: Wed Sep 9 01:33:26 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(5744KiB/48283msec) clat (msec): min=6, max=185, avg=26.24, stdev=24.55 lat (msec): min=6, max=185, avg=26.25, stdev=24.55 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 51], 95.00th=[ 81], | 99.00th=[ 124], 99.50th=[ 157], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 28, max= 350, per=25.90%, avg=127.67, stdev=79.65, samples=88 iops : min= 1, max= 21, avg= 7.27, stdev= 5.04, samples=88 write: IOPS=8, BW=136KiB/s (139kB/s)(6544KiB/48283msec); 0 zone resets clat (msec): min=36, max=320, avg=94.67, stdev=42.35 lat (msec): min=36, max=320, avg=94.67, stdev=42.35 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 56], 20.00th=[ 65], | 30.00th=[ 70], 40.00th=[ 77], 50.00th=[ 85], 60.00th=[ 91], | 70.00th=[ 101], 80.00th=[ 122], 90.00th=[ 150], 95.00th=[ 176], | 99.00th=[ 262], 99.50th=[ 275], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 224, per=25.94%, avg=134.65, stdev=53.65, samples=95 iops : min= 1, max= 14, avg= 7.69, stdev= 3.47, samples=95 lat (msec) : 10=7.16%, 20=19.27%, 50=17.71%, 100=38.41%, 250=16.80% lat (msec) : 500=0.65% cpu : usr=0.03%, sys=1.74%, ctx=1445, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145922: Wed Sep 9 01:33:26 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(6256KiB/47295msec) clat (msec): min=5, max=152, avg=25.34, stdev=23.26 lat (msec): min=5, max=152, avg=25.34, stdev=23.26 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 52], 95.00th=[ 75], | 99.00th=[ 130], 99.50th=[ 144], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 31, max= 447, per=28.56%, avg=140.80, stdev=93.90, samples=88 iops : min= 1, max= 27, avg= 8.08, stdev= 5.92, samples=88 write: IOPS=7, BW=128KiB/s (131kB/s)(6032KiB/47295msec); 0 zone resets clat (msec): min=32, max=331, avg=98.56, stdev=45.00 lat (msec): min=32, max=331, avg=98.56, stdev=45.00 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 65], | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 89], 60.00th=[ 99], | 70.00th=[ 109], 80.00th=[ 128], 90.00th=[ 161], 95.00th=[ 188], | 99.00th=[ 262], 99.50th=[ 317], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 224, per=24.39%, avg=126.59, stdev=48.53, samples=93 iops : min= 1, max= 14, avg= 7.18, stdev= 3.15, samples=93 lat (msec) : 10=5.86%, 20=24.74%, 50=18.62%, 100=30.99%, 250=19.14% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.81%, ctx=1406, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145923: Wed Sep 9 01:33:26 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6032KiB/48142msec) clat (msec): min=5, max=334, avg=27.71, stdev=28.50 lat (msec): min=5, max=334, avg=27.71, stdev=28.51 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 38], 90.00th=[ 61], 95.00th=[ 85], | 99.00th=[ 121], 99.50th=[ 126], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 445, per=26.55%, avg=130.89, stdev=80.18, samples=90 iops : min= 1, max= 27, avg= 7.47, stdev= 5.11, samples=90 write: IOPS=8, BW=130KiB/s (133kB/s)(6256KiB/48142msec); 0 zone resets clat (msec): min=35, max=313, avg=95.70, stdev=39.93 lat (msec): min=35, max=313, avg=95.71, stdev=39.93 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 65], | 30.00th=[ 71], 40.00th=[ 79], 50.00th=[ 88], 60.00th=[ 96], | 70.00th=[ 108], 80.00th=[ 124], 90.00th=[ 148], 95.00th=[ 169], | 99.00th=[ 247], 99.50th=[ 279], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 255, per=24.90%, avg=129.25, stdev=52.46, samples=95 iops : min= 1, max= 15, avg= 7.36, stdev= 3.36, samples=95 lat (msec) : 10=6.12%, 20=21.88%, 50=17.71%, 100=34.11%, 250=19.66% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.83%, ctx=1407, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=494KiB/s (506kB/s), 119KiB/s-132KiB/s (122kB/s-135kB/s), io=23.4MiB (24.5MB), run=47295-48510msec WRITE: bw=519KiB/s (532kB/s), 128KiB/s-136KiB/s (131kB/s-139kB/s), io=24.6MiB (25.8MB), run=47295-48510msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145937: Wed Sep 9 01:33:41 2026 read: IOPS=1, BW=1452KiB/s (1486kB/s)(7168KiB/4938msec) clat (msec): min=55, max=2182, avg=491.36, stdev=762.03 lat (msec): min=55, max=2182, avg=491.37, stdev=762.03 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 123], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 176], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 542], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 2019, max= 3084, per=64.29%, avg=2244.20, stdev=469.58, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1037KiB/s (1062kB/s)(5120KiB/4938msec); 0 zone resets clat (msec): min=147, max=526, avg=278.70, stdev=156.56 lat (msec): min=147, max=526, avg=278.77, stdev=156.55 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2048, max= 5965, per=81.98%, avg=4006.50, stdev=2769.74, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=14.26%, ctx=595, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145938: Wed Sep 9 01:33:41 2026 read: IOPS=0, BW=349KiB/s (358kB/s)(2048KiB/5866msec) clat (msec): min=145, max=356, avg=250.59, stdev=149.17 lat (msec): min=145, max=356, avg=250.59, stdev=149.17 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1546, max= 2031, per=51.23%, avg=1788.50, stdev=342.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1746KiB/s (1788kB/s)(10.0MiB/5866msec); 0 zone resets clat (msec): min=92, max=2642, avg=525.65, stdev=763.08 lat (msec): min=92, max=2642, avg=525.73, stdev=763.07 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 153], | 30.00th=[ 155], 40.00th=[ 207], 50.00th=[ 218], 60.00th=[ 279], | 70.00th=[ 380], 80.00th=[ 481], 90.00th=[ 651], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 2019, max= 6083, per=62.03%, avg=3031.33, stdev=1685.12, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=11.83%, ctx=191, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145939: Wed Sep 9 01:33:41 2026 read: IOPS=1, BW=1238KiB/s (1267kB/s)(6144KiB/4964msec) clat (usec): min=455, max=405061, avg=169198.45, stdev=159802.71 lat (usec): min=456, max=405062, avg=169199.69, stdev=159802.67 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 2835], | 30.00th=[ 2835], 40.00th=[114820], 50.00th=[114820], 60.00th=[223347], | 70.00th=[270533], 80.00th=[270533], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 1988, max= 6095, per=96.46%, avg=3367.33, stdev=2362.28, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1238KiB/s (1267kB/s)(6144KiB/4964msec); 0 zone resets clat (msec): min=105, max=2781, avg=652.80, stdev=1046.41 lat (msec): min=105, max=2781, avg=652.87, stdev=1046.42 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 305], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1988, max= 4063, per=57.01%, avg=2786.25, stdev=989.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.48%, ctx=141, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145940: Wed Sep 9 01:33:41 2026 read: IOPS=0, BW=962KiB/s (985kB/s)(5120KiB/5322msec) clat (usec): min=436, max=265639, avg=157498.20, stdev=143350.43 lat (usec): min=438, max=265640, avg=157499.42, stdev=143350.43 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 437], 10.00th=[ 437], 20.00th=[ 437], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[261096], 60.00th=[261096], | 70.00th=[261096], 80.00th=[261096], 90.00th=[265290], 95.00th=[265290], | 99.00th=[265290], 99.50th=[265290], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 2019, max= 5965, per=100.00%, avg=3992.00, stdev=2790.24, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1347KiB/s (1379kB/s)(7168KiB/5322msec); 0 zone resets clat (msec): min=89, max=2517, avg=633.42, stdev=846.59 lat (msec): min=89, max=2517, avg=633.72, stdev=846.44 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 197], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 313], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 567], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1607, max= 4096, per=48.23%, avg=2356.80, stdev=989.12, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.52%, ctx=172, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3491KiB/s (3575kB/s), 349KiB/s-1452KiB/s (358kB/s-1486kB/s), io=20.0MiB (20.0MB), run=4938-5866msec WRITE: bw=4888KiB/s (5005kB/s), 1037KiB/s-1746KiB/s (1062kB/s-1788kB/s), io=28.0MiB (29.4MB), run=4938-5866msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145943: Wed Sep 9 01:33:42 2026 read: IOPS=1, BW=1149KiB/s (1177kB/s)(7168KiB/6236msec) clat (msec): min=90, max=2076, avg=695.27, stdev=830.67 lat (msec): min=90, max=2076, avg=695.28, stdev=830.67 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 93], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 334], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 1687], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 1992, max= 2048, per=64.81%, avg=2028.00, stdev=22.11, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=821KiB/s (841kB/s)(5120KiB/6236msec); 0 zone resets clat (msec): min=116, max=385, avg=258.11, stdev=96.28 lat (msec): min=116, max=386, avg=258.35, stdev=96.37 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1992, max= 6035, per=76.53%, avg=3352.67, stdev=2323.05, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=16.67%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.05%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145944: Wed Sep 9 01:33:42 2026 read: IOPS=0, BW=316KiB/s (323kB/s)(2048KiB/6487msec) clat (msec): min=70, max=200, avg=135.73, stdev=91.94 lat (msec): min=70, max=200, avg=135.73, stdev=91.94 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 71], 50.00th=[ 71], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 1906, max= 1992, per=62.29%, avg=1949.00, stdev=60.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1579KiB/s (1616kB/s)(10.0MiB/6487msec); 0 zone resets clat (msec): min=180, max=3134, avg=612.92, stdev=910.31 lat (msec): min=180, max=3134, avg=613.00, stdev=910.30 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 194], | 30.00th=[ 203], 40.00th=[ 215], 50.00th=[ 266], 60.00th=[ 284], | 70.00th=[ 363], 80.00th=[ 405], 90.00th=[ 885], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 2011, max= 4096, per=73.70%, avg=3229.00, stdev=1103.50, samples=5 iops : min= 1, max= 4, avg= 2.40, stdev= 1.34, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.98%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145945: Wed Sep 9 01:33:42 2026 read: IOPS=0, BW=1008KiB/s (1032kB/s)(6144KiB/6096msec) clat (msec): min=104, max=634, avg=238.14, stdev=207.85 lat (msec): min=104, max=634, avg=238.14, stdev=207.85 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 138], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2048, max= 4063, per=100.00%, avg=3365.00, stdev=1141.24, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=0, BW=1008KiB/s (1032kB/s)(6144KiB/6096msec); 0 zone resets clat (msec): min=117, max=3053, avg=764.82, stdev=1125.42 lat (msec): min=117, max=3053, avg=765.00, stdev=1125.38 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 368], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1848, max= 2048, per=45.35%, avg=1986.80, stdev=80.54, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.35%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145946: Wed Sep 9 01:33:42 2026 read: IOPS=0, BW=782KiB/s (801kB/s)(5120KiB/6544msec) clat (msec): min=50, max=540, avg=230.63, stdev=193.47 lat (msec): min=50, max=540, avg=230.63, stdev=193.47 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 51], | 30.00th=[ 99], 40.00th=[ 99], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1992, max= 4096, per=86.28%, avg=2699.67, stdev=1209.30, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1095KiB/s (1122kB/s)(7168KiB/6544msec); 0 zone resets clat (msec): min=176, max=2975, avg=761.67, stdev=1009.12 lat (msec): min=176, max=2975, avg=761.79, stdev=1009.08 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 234], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 953], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1921, max= 4063, per=57.10%, avg=2501.50, stdev=1041.86, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.19%, ctx=70, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3130KiB/s (3205kB/s), 316KiB/s-1149KiB/s (323kB/s-1177kB/s), io=20.0MiB (20.0MB), run=6096-6544msec WRITE: bw=4381KiB/s (4487kB/s), 821KiB/s-1579KiB/s (841kB/s-1616kB/s), io=28.0MiB (29.4MB), run=6096-6544msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145952: Wed Sep 9 01:33:53 2026 read: IOPS=2, BW=11.3MiB/s (11.8MB/s)(12.0MiB/1064msec) clat (msec): min=98, max=677, avg=342.54, stdev=300.23 lat (msec): min=98, max=677, avg=342.54, stdev=300.23 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min=11175, max=11175, per=100.00%, avg=11175.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=14.21%, ctx=63, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145953: Wed Sep 9 01:33:53 2026 read: IOPS=0, BW=2682KiB/s (2747kB/s)(4096KiB/1527msec) clat (nsec): min=161376k, max=161376k, avg=161376194.00, stdev= 0.00 lat (nsec): min=161378k, max=161378k, avg=161378473.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 5919, max= 5919, per=55.17%, avg=5919.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5365KiB/s (5494kB/s)(8192KiB/1527msec); 0 zone resets clat (msec): min=551, max=765, avg=658.59, stdev=151.04 lat (msec): min=551, max=766, avg=658.99, stdev=151.39 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8175, max= 8175, per=48.48%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.07%, sys=9.30%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145954: Wed Sep 9 01:33:53 2026 write: IOPS=1, BW=6324KiB/s (6476kB/s)(12.0MiB/1943msec); 0 zone resets clat (msec): min=259, max=1273, avg=631.99, stdev=557.51 lat (msec): min=260, max=1273, avg=632.27, stdev=557.53 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 6838, max= 8175, per=44.51%, avg=7506.50, stdev=945.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.62%, ctx=31, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145955: Wed Sep 9 01:33:53 2026 write: IOPS=1, BW=7006KiB/s (7174kB/s)(12.0MiB/1754msec); 0 zone resets clat (msec): min=425, max=761, avg=577.67, stdev=170.35 lat (msec): min=425, max=761, avg=577.91, stdev=170.42 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 6671, max= 8175, per=44.02%, avg=7423.00, stdev=1063.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.69%, ctx=86, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.5MiB/s (10.0MB/s), 2682KiB/s-11.3MiB/s (2747kB/s-11.8MB/s), io=16.0MiB (16.8MB), run=1064-1527msec WRITE: bw=16.5MiB/s (17.3MB/s), 5365KiB/s-7006KiB/s (5494kB/s-7174kB/s), io=32.0MiB (33.6MB), run=1527-1943msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145957: Wed Sep 9 01:33:54 2026 read: IOPS=1, BW=6086KiB/s (6232kB/s)(12.0MiB/2019msec) clat (msec): min=606, max=794, avg=669.12, stdev=108.77 lat (msec): min=606, max=794, avg=669.12, stdev=108.77 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.77%, ctx=514, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145958: Wed Sep 9 01:33:54 2026 read: IOPS=0, BW=1963KiB/s (2010kB/s)(4096KiB/2087msec) clat (nsec): min=845607k, max=845607k, avg=845607132.00, stdev= 0.00 lat (nsec): min=845608k, max=845608k, avg=845608322.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3925KiB/s (4019kB/s)(8192KiB/2087msec); 0 zone resets clat (msec): min=457, max=782, avg=619.88, stdev=230.28 lat (msec): min=457, max=782, avg=620.20, stdev=230.08 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8192, max= 8192, per=60.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=8.72%, ctx=115, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145959: Wed Sep 9 01:33:54 2026 write: IOPS=1, BW=5044KiB/s (5165kB/s)(12.0MiB/2436msec); 0 zone resets clat (msec): min=376, max=1396, avg=810.43, stdev=526.69 lat (msec): min=377, max=1398, avg=811.72, stdev=527.37 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7366, max= 8159, per=57.71%, avg=7762.50, stdev=560.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=7.19%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145960: Wed Sep 9 01:33:54 2026 write: IOPS=1, BW=6285KiB/s (6436kB/s)(12.0MiB/1955msec); 0 zone resets clat (msec): min=288, max=1068, avg=650.54, stdev=392.91 lat (msec): min=290, max=1068, avg=651.35, stdev=392.10 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8110, max= 8110, per=60.29%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.20%, sys=12.08%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7851KiB/s (8039kB/s), 1963KiB/s-6086KiB/s (2010kB/s-6232kB/s), io=16.0MiB (16.8MB), run=2019-2087msec WRITE: bw=13.1MiB/s (13.8MB/s), 3925KiB/s-6285KiB/s (4019kB/s-6436kB/s), io=32.0MiB (33.6MB), run=1955-2436msec