== sanity test 398b: DIO and buffer IO race ============== 22:31:28 (1783564288) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.93822 s, 17.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151643: Wed Jul 8 22:32:35 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(5992KiB/56600msec) clat (usec): min=33, max=144107, avg=18364.02, stdev=12304.88 lat (usec): min=33, max=144108, avg=18365.22, stdev=12305.01 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 92], 10.00th=[ 7177], 20.00th=[ 10028], | 30.00th=[ 11863], 40.00th=[ 13566], 50.00th=[ 15926], 60.00th=[ 19268], | 70.00th=[ 22152], 80.00th=[ 26346], 90.00th=[ 32637], 95.00th=[ 40109], | 99.00th=[ 60031], 99.50th=[ 73925], 99.90th=[ 98042], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 21, max= 184, per=25.08%, avg=105.34, stdev=32.58, samples=112 iops : min= 5, max= 46, avg=25.86, stdev= 8.16, samples=112 write: IOPS=27, BW=111KiB/s (114kB/s)(6296KiB/56600msec); 0 zone resets clat (usec): min=725, max=648080, avg=18327.05, stdev=24242.44 lat (usec): min=726, max=648081, avg=18328.45, stdev=24242.53 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1483], 10.00th=[ 2114], 20.00th=[ 3261], | 30.00th=[ 5080], 40.00th=[ 9765], 50.00th=[ 13829], 60.00th=[ 17957], | 70.00th=[ 22414], 80.00th=[ 29230], 90.00th=[ 39584], 95.00th=[ 50070], | 99.00th=[ 76022], 99.50th=[ 91751], 99.90th=[283116], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 47, max= 191, per=25.46%, avg=111.78, stdev=29.02, samples=111 iops : min= 11, max= 47, avg=27.47, stdev= 7.29, samples=111 lat (usec) : 50=0.62%, 100=2.18%, 250=0.94%, 750=0.07%, 1000=0.49% lat (msec) : 2=4.17%, 4=8.50%, 10=13.51%, 20=33.59%, 50=32.49% lat (msec) : 100=3.26%, 250=0.13%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=15.05%, ctx=7690, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151644: Wed Jul 8 22:32:35 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(5940KiB/57040msec) clat (usec): min=36, max=570842, avg=19280.65, stdev=19366.43 lat (usec): min=37, max=570843, avg=19283.10, stdev=19367.51 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 115], 10.00th=[ 8160], 20.00th=[ 10290], | 30.00th=[ 12125], 40.00th=[ 13829], 50.00th=[ 16057], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 27132], 90.00th=[ 33424], 95.00th=[ 39060], | 99.00th=[ 63701], 99.50th=[ 89654], 99.90th=[135267], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 191, per=24.65%, avg=103.53, stdev=31.03, samples=113 iops : min= 1, max= 47, avg=25.40, stdev= 7.77, samples=113 write: IOPS=27, BW=111KiB/s (114kB/s)(6348KiB/57040msec); 0 zone resets clat (usec): min=679, max=266872, avg=17742.94, stdev=17787.85 lat (usec): min=679, max=266872, avg=17744.35, stdev=17787.78 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1549], 10.00th=[ 2212], 20.00th=[ 3228], | 30.00th=[ 5407], 40.00th=[ 9896], 50.00th=[ 14091], 60.00th=[ 17957], | 70.00th=[ 22938], 80.00th=[ 28967], 90.00th=[ 38536], 95.00th=[ 47449], | 99.00th=[ 70779], 99.50th=[ 78119], 99.90th=[217056], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 35, max= 182, per=25.14%, avg=110.35, stdev=29.39, samples=113 iops : min= 8, max= 45, avg=27.11, stdev= 7.41, samples=113 lat (usec) : 50=0.42%, 100=1.56%, 250=0.81%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=3.87%, 4=8.76%, 10=14.13%, 20=34.70%, 50=32.19% lat (msec) : 100=2.90%, 250=0.29%, 500=0.03%, 750=0.03% cpu : usr=0.12%, sys=15.15%, ctx=7731, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151645: Wed Jul 8 22:32:35 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(6028KiB/57105msec) clat (usec): min=28, max=153036, avg=18592.65, stdev=12834.03 lat (usec): min=29, max=153037, avg=18593.72, stdev=12834.05 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 99], 10.00th=[ 7570], 20.00th=[ 9896], | 30.00th=[ 11731], 40.00th=[ 13829], 50.00th=[ 15664], 60.00th=[ 18482], | 70.00th=[ 22152], 80.00th=[ 26346], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 58983], 99.50th=[ 80217], 99.90th=[115868], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 14, max= 168, per=25.00%, avg=105.01, stdev=30.13, samples=113 iops : min= 3, max= 42, avg=25.77, stdev= 7.58, samples=113 write: IOPS=27, BW=110KiB/s (112kB/s)(6260KiB/57105msec); 0 zone resets clat (usec): min=822, max=556755, avg=18423.07, stdev=22175.34 lat (usec): min=823, max=556756, avg=18428.57, stdev=22174.68 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1565], 10.00th=[ 2180], 20.00th=[ 3359], | 30.00th=[ 5538], 40.00th=[ 10552], 50.00th=[ 14091], 60.00th=[ 18744], | 70.00th=[ 23725], 80.00th=[ 29754], 90.00th=[ 39060], 95.00th=[ 47973], | 99.00th=[ 78119], 99.50th=[103285], 99.90th=[214959], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 21, max= 183, per=24.78%, avg=108.78, stdev=32.26, samples=113 iops : min= 5, max= 45, avg=26.73, stdev= 8.08, samples=113 lat (usec) : 50=0.62%, 100=1.95%, 250=0.75%, 750=0.03%, 1000=0.33% lat (msec) : 2=3.94%, 4=7.75%, 10=14.52%, 20=33.85%, 50=33.37% lat (msec) : 100=2.54%, 250=0.33%, 750=0.03% cpu : usr=0.15%, sys=15.22%, ctx=7805, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151646: Wed Jul 8 22:32:35 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(6052KiB/57149msec) clat (usec): min=30, max=656246, avg=19416.69, stdev=21362.75 lat (usec): min=30, max=656247, avg=19418.51, stdev=21362.45 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 95], 10.00th=[ 7570], 20.00th=[ 10028], | 30.00th=[ 11994], 40.00th=[ 14222], 50.00th=[ 16319], 60.00th=[ 19268], | 70.00th=[ 22676], 80.00th=[ 26870], 90.00th=[ 33817], 95.00th=[ 39584], | 99.00th=[ 63701], 99.50th=[ 80217], 99.90th=[221250], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 14, max= 200, per=24.99%, avg=104.96, stdev=29.10, samples=113 iops : min= 3, max= 50, avg=25.75, stdev= 7.31, samples=113 write: IOPS=27, BW=109KiB/s (112kB/s)(6236KiB/57149msec); 0 zone resets clat (usec): min=630, max=179176, avg=17658.93, stdev=16175.89 lat (usec): min=630, max=179177, avg=17662.87, stdev=16175.80 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1549], 10.00th=[ 2147], 20.00th=[ 3359], | 30.00th=[ 5473], 40.00th=[ 9896], 50.00th=[ 13829], 60.00th=[ 18220], | 70.00th=[ 23725], 80.00th=[ 29754], 90.00th=[ 38536], 95.00th=[ 45876], | 99.00th=[ 67634], 99.50th=[ 90702], 99.90th=[109577], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 23, max= 192, per=24.71%, avg=108.46, stdev=32.66, samples=113 iops : min= 5, max= 48, avg=26.64, stdev= 8.20, samples=113 lat (usec) : 50=0.59%, 100=2.12%, 250=0.94%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=3.94%, 4=8.01%, 10=14.29%, 20=32.39%, 50=34.47% lat (msec) : 100=2.57%, 250=0.29%, 750=0.03% cpu : usr=0.15%, sys=15.26%, ctx=7777, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=420KiB/s (430kB/s), 104KiB/s-106KiB/s (107kB/s-108kB/s), io=23.4MiB (24.6MB), run=56600-57149msec WRITE: bw=440KiB/s (450kB/s), 109KiB/s-111KiB/s (112kB/s-114kB/s), io=24.6MiB (25.7MB), run=56600-57149msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151648: Wed Jul 8 22:33:19 2026 read: IOPS=14, BW=59.5KiB/s (60.0kB/s)(5992KiB/100647msec) clat (msec): min=3, max=571, avg=16.85, stdev=20.23 lat (msec): min=3, max=571, avg=16.86, stdev=20.24 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 47], | 99.00th=[ 75], 99.50th=[ 88], 99.90th=[ 132], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 152, per=25.29%, avg=59.93, stdev=35.65, samples=197 iops : min= 1, max= 38, avg=14.61, stdev= 8.98, samples=197 write: IOPS=15, BW=62.6KiB/s (64.1kB/s)(6296KiB/100647msec); 0 zone resets clat (msec): min=16, max=353, avg=47.85, stdev=27.85 lat (msec): min=16, max=353, avg=47.85, stdev=27.85 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 66], 90.00th=[ 84], 95.00th=[ 102], | 99.00th=[ 142], 99.50th=[ 171], 99.90th=[ 284], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 128, per=25.18%, avg=62.45, stdev=29.56, samples=199 iops : min= 1, max= 32, avg=15.24, stdev= 7.46, samples=199 lat (msec) : 4=0.20%, 10=17.77%, 20=21.06%, 50=42.19%, 100=15.85% lat (msec) : 250=2.83%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=4.77%, ctx=5879, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151649: Wed Jul 8 22:33:19 2026 read: IOPS=14, BW=58.8KiB/s (60.2kB/s)(5940KiB/101077msec) clat (msec): min=3, max=661, avg=17.06, stdev=22.07 lat (msec): min=3, max=661, avg=17.06, stdev=22.07 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 46], | 99.00th=[ 77], 99.50th=[ 97], 99.90th=[ 133], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 174, per=24.93%, avg=59.08, stdev=36.54, samples=199 iops : min= 1, max= 43, avg=14.40, stdev= 9.21, samples=199 write: IOPS=15, BW=62.8KiB/s (64.3kB/s)(6348KiB/101077msec); 0 zone resets clat (msec): min=17, max=367, avg=47.69, stdev=27.14 lat (msec): min=17, max=367, avg=47.69, stdev=27.14 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 66], 90.00th=[ 83], 95.00th=[ 95], | 99.00th=[ 136], 99.50th=[ 163], 99.90th=[ 279], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 15, max= 128, per=25.25%, avg=62.62, stdev=29.35, samples=200 iops : min= 3, max= 32, avg=15.28, stdev= 7.42, samples=200 lat (msec) : 4=0.20%, 10=17.87%, 20=20.15%, 50=42.58%, 100=16.99% lat (msec) : 250=2.08%, 500=0.10%, 750=0.03% cpu : usr=0.07%, sys=4.74%, ctx=5807, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151650: Wed Jul 8 22:33:19 2026 read: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6028KiB/100713msec) clat (msec): min=3, max=233, avg=16.93, stdev=15.25 lat (msec): min=3, max=233, avg=16.93, stdev=15.25 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 70], 99.50th=[ 90], 99.90th=[ 157], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 7, max= 184, per=25.22%, avg=59.76, stdev=34.68, samples=199 iops : min= 1, max= 46, avg=14.57, stdev= 8.73, samples=199 write: IOPS=15, BW=62.2KiB/s (63.6kB/s)(6260KiB/100713msec); 0 zone resets clat (msec): min=17, max=731, avg=48.01, stdev=31.66 lat (msec): min=17, max=731, avg=48.01, stdev=31.66 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 68], 90.00th=[ 86], 95.00th=[ 102], | 99.00th=[ 140], 99.50th=[ 155], 99.90th=[ 253], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 128, per=25.00%, avg=62.01, stdev=30.75, samples=199 iops : min= 1, max= 32, avg=15.13, stdev= 7.76, samples=199 lat (msec) : 4=0.23%, 10=17.35%, 20=20.64%, 50=43.16%, 100=15.85% lat (msec) : 250=2.70%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=4.77%, ctx=5827, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151651: Wed Jul 8 22:33:19 2026 read: IOPS=15, BW=60.4KiB/s (61.9kB/s)(6052KiB/100192msec) clat (msec): min=3, max=176, avg=16.64, stdev=14.64 lat (msec): min=3, max=176, avg=16.64, stdev=14.64 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 72], 99.50th=[ 91], 99.90th=[ 122], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 7, max= 167, per=25.89%, avg=61.37, stdev=35.27, samples=195 iops : min= 1, max= 41, avg=14.97, stdev= 8.88, samples=195 write: IOPS=15, BW=62.2KiB/s (63.7kB/s)(6236KiB/100192msec); 0 zone resets clat (msec): min=16, max=723, avg=48.08, stdev=32.25 lat (msec): min=16, max=723, avg=48.08, stdev=32.25 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 67], 90.00th=[ 84], 95.00th=[ 101], | 99.00th=[ 142], 99.50th=[ 159], 99.90th=[ 384], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 15, max= 136, per=25.03%, avg=62.09, stdev=29.60, samples=198 iops : min= 3, max= 34, avg=15.15, stdev= 7.48, samples=198 lat (msec) : 4=0.23%, 10=18.68%, 20=19.40%, 50=43.16%, 100=15.76% lat (msec) : 250=2.67%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=4.77%, ctx=5836, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=238KiB/s (243kB/s), 58.8KiB/s-60.4KiB/s (60.2kB/s-61.9kB/s), io=23.4MiB (24.6MB), run=100192-101077msec WRITE: bw=249KiB/s (255kB/s), 62.2KiB/s-62.8KiB/s (63.6kB/s-64.3kB/s), io=24.6MiB (25.7MB), run=100192-101077msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151680: Wed Jul 8 22:33:37 2026 read: IOPS=29, BW=465KiB/s (476kB/s)(5920KiB/12729msec) clat (usec): min=39, max=63219, avg=16729.32, stdev=11693.24 lat (usec): min=40, max=63220, avg=16730.16, stdev=11693.24 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 71], 10.00th=[ 85], 20.00th=[ 8160], | 30.00th=[11994], 40.00th=[14353], 50.00th=[16319], 60.00th=[18744], | 70.00th=[21627], 80.00th=[25297], 90.00th=[30016], 95.00th=[35390], | 99.00th=[55313], 99.50th=[56886], 99.90th=[63177], 99.95th=[63177], | 99.99th=[63177] bw ( KiB/s): min= 256, max= 733, per=24.88%, avg=466.00, stdev=113.73, samples=25 iops : min= 16, max= 45, avg=28.48, stdev= 7.09, samples=25 write: IOPS=31, BW=500KiB/s (512kB/s)(6368KiB/12729msec); 0 zone resets clat (usec): min=1095, max=69746, avg=16198.69, stdev=13129.15 lat (usec): min=1096, max=69748, avg=16200.42, stdev=13129.12 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2573], 10.00th=[ 3589], 20.00th=[ 4686], | 30.00th=[ 6521], 40.00th=[ 9372], 50.00th=[12780], 60.00th=[15926], | 70.00th=[20841], 80.00th=[26608], 90.00th=[34341], 95.00th=[42206], | 99.00th=[66323], 99.50th=[69731], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 286, max= 796, per=25.50%, avg=502.52, stdev=110.65, samples=25 iops : min= 17, max= 49, avg=30.76, stdev= 6.92, samples=25 lat (usec) : 50=1.04%, 100=4.82%, 250=3.12%, 500=0.13%, 750=0.13% lat (msec) : 2=1.56%, 4=4.82%, 10=17.58%, 20=33.85%, 50=30.99% lat (msec) : 100=1.95% cpu : usr=0.09%, sys=22.00%, ctx=2182, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151681: Wed Jul 8 22:33:37 2026 read: IOPS=28, BW=449KiB/s (460kB/s)(5744KiB/12785msec) clat (usec): min=44, max=77685, avg=18231.38, stdev=11450.66 lat (usec): min=44, max=77686, avg=18232.39, stdev=11450.69 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 106], 10.00th=[ 832], 20.00th=[11076], | 30.00th=[12649], 40.00th=[14353], 50.00th=[16909], 60.00th=[19006], | 70.00th=[22152], 80.00th=[25297], 90.00th=[31589], 95.00th=[38536], | 99.00th=[61080], 99.50th=[74974], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 255, max= 637, per=24.00%, avg=449.52, stdev=99.89, samples=25 iops : min= 15, max= 39, avg=27.44, stdev= 6.26, samples=25 write: IOPS=31, BW=512KiB/s (524kB/s)(6544KiB/12785msec); 0 zone resets clat (usec): min=1092, max=87818, avg=15089.62, stdev=12761.02 lat (usec): min=1093, max=87819, avg=15091.34, stdev=12761.00 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2769], 10.00th=[ 3359], 20.00th=[ 4555], | 30.00th=[ 5407], 40.00th=[ 7635], 50.00th=[11469], 60.00th=[14615], | 70.00th=[18744], 80.00th=[25297], 90.00th=[33817], 95.00th=[39584], | 99.00th=[51119], 99.50th=[60556], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 318, max= 825, per=25.87%, avg=509.80, stdev=122.30, samples=25 iops : min= 19, max= 51, avg=31.20, stdev= 7.71, samples=25 lat (usec) : 50=0.13%, 100=1.82%, 250=2.47%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=6.64%, 10=19.27%, 20=37.50%, 50=29.69% lat (msec) : 100=1.43% cpu : usr=0.09%, sys=22.14%, ctx=2321, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151682: Wed Jul 8 22:33:37 2026 read: IOPS=31, BW=508KiB/s (520kB/s)(6256KiB/12318msec) clat (usec): min=24, max=98853, avg=17336.94, stdev=12775.74 lat (usec): min=24, max=98854, avg=17337.96, stdev=12775.83 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 82], 10.00th=[ 109], 20.00th=[ 9503], | 30.00th=[11994], 40.00th=[13960], 50.00th=[16188], 60.00th=[17957], | 70.00th=[21103], 80.00th=[25822], 90.00th=[31065], 95.00th=[35390], | 99.00th=[63177], 99.50th=[90702], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 318, max= 864, per=27.42%, avg=513.50, stdev=139.03, samples=24 iops : min= 19, max= 54, avg=31.46, stdev= 8.83, samples=24 write: IOPS=30, BW=490KiB/s (501kB/s)(6032KiB/12318msec); 0 zone resets clat (usec): min=1350, max=80311, avg=14418.68, stdev=11369.54 lat (usec): min=1352, max=80312, avg=14420.80, stdev=11369.23 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2540], 10.00th=[ 3458], 20.00th=[ 4817], | 30.00th=[ 6063], 40.00th=[ 8291], 50.00th=[10945], 60.00th=[15139], | 70.00th=[18744], 80.00th=[22414], 90.00th=[30278], 95.00th=[36439], | 99.00th=[47973], 99.50th=[62653], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 256, max= 606, per=24.72%, avg=487.25, stdev=86.18, samples=24 iops : min= 16, max= 37, avg=29.79, stdev= 5.27, samples=24 lat (usec) : 50=0.78%, 100=3.65%, 250=3.65%, 500=0.13%, 750=0.13% lat (msec) : 2=0.78%, 4=6.90%, 10=17.71%, 20=36.07%, 50=28.91% lat (msec) : 100=1.30% cpu : usr=0.13%, sys=22.72%, ctx=2247, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151683: Wed Jul 8 22:33:37 2026 read: IOPS=30, BW=492KiB/s (504kB/s)(6032KiB/12264msec) clat (usec): min=42, max=89343, avg=16703.87, stdev=11562.00 lat (usec): min=46, max=89343, avg=16704.94, stdev=11561.85 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 71], 10.00th=[ 105], 20.00th=[ 9372], | 30.00th=[12256], 40.00th=[13960], 50.00th=[15533], 60.00th=[17695], | 70.00th=[20055], 80.00th=[23987], 90.00th=[31327], 95.00th=[36963], | 99.00th=[49546], 99.50th=[72877], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 350, max= 798, per=26.24%, avg=491.50, stdev=94.95, samples=24 iops : min= 21, max= 49, avg=30.08, stdev= 5.98, samples=24 write: IOPS=31, BW=510KiB/s (522kB/s)(6256KiB/12264msec); 0 zone resets clat (usec): min=1285, max=88094, avg=15152.93, stdev=12623.31 lat (usec): min=1287, max=88095, avg=15154.95, stdev=12623.07 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2507], 10.00th=[ 3261], 20.00th=[ 4490], | 30.00th=[ 5800], 40.00th=[ 8291], 50.00th=[11731], 60.00th=[14615], | 70.00th=[19530], 80.00th=[25035], 90.00th=[33424], 95.00th=[38536], | 99.00th=[56361], 99.50th=[63701], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 318, max= 698, per=26.11%, avg=514.67, stdev=100.00, samples=24 iops : min= 19, max= 43, avg=31.54, stdev= 6.19, samples=24 lat (usec) : 50=0.91%, 100=3.52%, 250=2.47%, 500=0.39% lat (msec) : 2=1.43%, 4=7.29%, 10=18.10%, 20=36.20%, 50=28.52% lat (msec) : 100=1.17% cpu : usr=0.12%, sys=22.81%, ctx=2140, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1873KiB/s (1918kB/s), 449KiB/s-508KiB/s (460kB/s-520kB/s), io=23.4MiB (24.5MB), run=12264-12785msec WRITE: bw=1971KiB/s (2018kB/s), 490KiB/s-512KiB/s (501kB/s-524kB/s), io=24.6MiB (25.8MB), run=12264-12785msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151685: Wed Jul 8 22:33:49 2026 read: IOPS=15, BW=244KiB/s (250kB/s)(5920KiB/24216msec) clat (msec): min=3, max=112, avg=16.23, stdev=13.74 lat (msec): min=3, max=112, avg=16.23, stdev=13.74 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 78], 99.50th=[ 96], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 64, max= 480, per=25.50%, avg=244.02, stdev=100.41, samples=48 iops : min= 4, max= 30, avg=14.90, stdev= 6.37, samples=48 write: IOPS=16, BW=263KiB/s (269kB/s)(6368KiB/24216msec); 0 zone resets clat (msec): min=19, max=162, avg=45.50, stdev=20.30 lat (msec): min=19, max=162, avg=45.50, stdev=20.30 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 40], 60.00th=[ 44], | 70.00th=[ 51], 80.00th=[ 57], 90.00th=[ 70], 95.00th=[ 90], | 99.00th=[ 117], 99.50th=[ 127], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 64, max= 448, per=26.09%, avg=262.77, stdev=103.71, samples=48 iops : min= 4, max= 28, avg=16.06, stdev= 6.59, samples=48 lat (msec) : 4=0.13%, 10=20.70%, 20=16.28%, 50=45.83%, 100=15.10% lat (msec) : 250=1.95% cpu : usr=0.08%, sys=5.93%, ctx=1539, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151686: Wed Jul 8 22:33:49 2026 read: IOPS=14, BW=230KiB/s (235kB/s)(5744KiB/25009msec) clat (msec): min=4, max=133, avg=16.32, stdev=15.56 lat (msec): min=4, max=133, avg=16.32, stdev=15.56 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 50], | 99.00th=[ 77], 99.50th=[ 80], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 53, max= 512, per=24.52%, avg=234.63, stdev=118.06, samples=48 iops : min= 3, max= 32, avg=14.29, stdev= 7.47, samples=48 write: IOPS=16, BW=262KiB/s (268kB/s)(6544KiB/25009msec); 0 zone resets clat (msec): min=18, max=142, avg=46.57, stdev=19.24 lat (msec): min=18, max=142, avg=46.58, stdev=19.24 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 39], 50.00th=[ 42], 60.00th=[ 44], | 70.00th=[ 51], 80.00th=[ 59], 90.00th=[ 77], 95.00th=[ 87], | 99.00th=[ 111], 99.50th=[ 116], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 127, max= 416, per=25.93%, avg=261.10, stdev=90.14, samples=49 iops : min= 7, max= 26, avg=15.96, stdev= 5.73, samples=49 lat (msec) : 10=22.14%, 20=14.58%, 50=45.31%, 100=16.80%, 250=1.17% cpu : usr=0.10%, sys=5.70%, ctx=1530, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151687: Wed Jul 8 22:33:49 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6256KiB/23952msec) clat (msec): min=4, max=111, avg=16.25, stdev=14.79 lat (msec): min=4, max=111, avg=16.25, stdev=14.79 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 81], 99.50th=[ 102], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 32, max= 608, per=27.61%, avg=264.23, stdev=137.04, samples=47 iops : min= 2, max= 38, avg=16.17, stdev= 8.66, samples=47 write: IOPS=15, BW=252KiB/s (258kB/s)(6032KiB/23952msec); 0 zone resets clat (msec): min=18, max=161, avg=46.58, stdev=20.72 lat (msec): min=18, max=161, avg=46.58, stdev=20.72 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 32], | 30.00th=[ 34], 40.00th=[ 38], 50.00th=[ 42], 60.00th=[ 46], | 70.00th=[ 50], 80.00th=[ 58], 90.00th=[ 75], 95.00th=[ 92], | 99.00th=[ 115], 99.50th=[ 157], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 94, max= 416, per=24.89%, avg=250.64, stdev=95.54, samples=47 iops : min= 5, max= 26, avg=15.32, stdev= 6.10, samples=47 lat (msec) : 10=23.83%, 20=15.23%, 50=44.40%, 100=14.71%, 250=1.82% cpu : usr=0.11%, sys=6.01%, ctx=1553, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151688: Wed Jul 8 22:33:49 2026 read: IOPS=15, BW=244KiB/s (250kB/s)(6032KiB/24700msec) clat (msec): min=4, max=110, avg=16.75, stdev=14.64 lat (msec): min=4, max=110, avg=16.75, stdev=14.64 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 36], 95.00th=[ 47], | 99.00th=[ 87], 99.50th=[ 95], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 32, max= 512, per=25.35%, avg=242.59, stdev=112.85, samples=49 iops : min= 2, max= 32, avg=14.80, stdev= 7.15, samples=49 write: IOPS=15, BW=253KiB/s (259kB/s)(6256KiB/24700msec); 0 zone resets clat (msec): min=18, max=154, avg=46.72, stdev=21.63 lat (msec): min=18, max=154, avg=46.72, stdev=21.63 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 41], 60.00th=[ 45], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 78], 95.00th=[ 92], | 99.00th=[ 126], 99.50th=[ 142], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 94, max= 448, per=25.23%, avg=254.06, stdev=103.46, samples=49 iops : min= 5, max= 28, avg=15.51, stdev= 6.59, samples=49 lat (msec) : 10=18.62%, 20=19.01%, 50=45.57%, 100=15.23%, 250=1.56% cpu : usr=0.09%, sys=5.77%, ctx=1588, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=958KiB/s (981kB/s), 230KiB/s-261KiB/s (235kB/s-267kB/s), io=23.4MiB (24.5MB), run=23952-25009msec WRITE: bw=1008KiB/s (1032kB/s), 252KiB/s-263KiB/s (258kB/s-269kB/s), io=24.6MiB (25.8MB), run=23952-25009msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151700: Wed Jul 8 22:33:58 2026 read: IOPS=2, BW=2459KiB/s (2518kB/s)(7168KiB/2915msec) clat (usec): min=532, max=1514.2k, avg=281664.49, stdev=545036.66 lat (usec): min=533, max=1514.2k, avg=281665.68, stdev=545037.17 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], | 20.00th=[ 54789], 30.00th=[ 77071], 40.00th=[ 77071], | 50.00th=[ 92799], 60.00th=[ 100140], 70.00th=[ 100140], | 80.00th=[ 132645], 90.00th=[1518339], 95.00th=[1518339], | 99.00th=[1518339], 99.50th=[1518339], 99.90th=[1518339], | 99.95th=[1518339], 99.99th=[1518339] bw ( KiB/s): min= 2035, max= 8175, per=100.00%, avg=5105.00, stdev=4341.64, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1756KiB/s (1799kB/s)(5120KiB/2915msec); 0 zone resets clat (msec): min=68, max=277, avg=184.03, stdev=85.36 lat (msec): min=68, max=278, avg=184.10, stdev=85.36 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 2043, max= 3923, per=44.36%, avg=2983.00, stdev=1329.36, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=41.67%, 250=33.33%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=24.88%, ctx=977, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151702: Wed Jul 8 22:33:58 2026 read: IOPS=0, BW=480KiB/s (492kB/s)(2048KiB/4264msec) clat (usec): min=543, max=79451, avg=39997.31, stdev=55796.61 lat (usec): min=544, max=79454, avg=39999.23, stdev=55797.56 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[ 545], 60.00th=[79168], | 70.00th=[79168], 80.00th=[79168], 90.00th=[79168], 95.00th=[79168], | 99.00th=[79168], 99.50th=[79168], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 1984, max= 1992, per=41.39%, avg=1988.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2402KiB/s (2459kB/s)(10.0MiB/4264msec); 0 zone resets clat (msec): min=99, max=1805, avg=412.88, stdev=509.01 lat (msec): min=100, max=1805, avg=412.95, stdev=509.02 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 114], | 30.00th=[ 153], 40.00th=[ 155], 50.00th=[ 247], 60.00th=[ 251], | 70.00th=[ 347], 80.00th=[ 430], 90.00th=[ 531], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1984, max= 5885, per=47.74%, avg=3210.20, stdev=1744.10, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.95, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=24.51%, ctx=217, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151703: Wed Jul 8 22:33:58 2026 read: IOPS=1, BW=1613KiB/s (1652kB/s)(6144KiB/3808msec) clat (usec): min=593, max=203085, avg=145527.44, stdev=73965.81 lat (usec): min=594, max=203086, avg=145528.73, stdev=73965.80 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[145753], | 30.00th=[145753], 40.00th=[156238], 50.00th=[156238], 60.00th=[183501], | 70.00th=[183501], 80.00th=[183501], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 2043, max= 5953, per=69.71%, avg=3348.00, stdev=2256.00, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1613KiB/s (1652kB/s)(6144KiB/3808msec); 0 zone resets clat (msec): min=114, max=1918, avg=475.82, stdev=709.36 lat (msec): min=114, max=1918, avg=475.90, stdev=709.37 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 249], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1984, max= 4087, per=40.40%, avg=2716.75, stdev=976.85, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=75.00%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=24.19%, ctx=527, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151705: Wed Jul 8 22:33:58 2026 read: IOPS=1, BW=1442KiB/s (1477kB/s)(5120KiB/3550msec) clat (usec): min=497, max=202745, avg=47713.84, stdev=87247.27 lat (usec): min=498, max=202746, avg=47714.86, stdev=87247.40 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[ 9634], 60.00th=[ 9634], | 70.00th=[ 25035], 80.00th=[ 25035], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2019KiB/s (2068kB/s)(7168KiB/3550msec); 0 zone resets clat (msec): min=180, max=1689, avg=457.79, stdev=547.69 lat (msec): min=181, max=1690, avg=457.88, stdev=547.70 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 186], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 245], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 372], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1946, max= 2043, per=29.50%, avg=1983.50, stdev=42.63, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 50=8.33%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=21.72%, ctx=296, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4803KiB/s (4918kB/s), 480KiB/s-2459KiB/s (492kB/s-2518kB/s), io=20.0MiB (20.0MB), run=2915-4264msec WRITE: bw=6724KiB/s (6886kB/s), 1613KiB/s-2402KiB/s (1652kB/s-2459kB/s), io=28.0MiB (29.4MB), run=2915-4264msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151699: Wed Jul 8 22:33:58 2026 read: IOPS=1, BW=1698KiB/s (1739kB/s)(7168KiB/4222msec) clat (msec): min=44, max=1466, avg=431.22, stdev=590.42 lat (msec): min=44, max=1466, avg=431.22, stdev=590.42 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 56], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 89], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 1083], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 2043, max= 4087, per=64.42%, avg=3064.25, stdev=1176.36, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1213KiB/s (1242kB/s)(5120KiB/4222msec); 0 zone resets clat (msec): min=162, max=360, avg=219.42, stdev=80.42 lat (msec): min=162, max=360, avg=219.49, stdev=80.42 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2039, max= 4096, per=40.93%, avg=2726.00, stdev=1186.46, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=41.67%, 500=8.33%, 2000=16.67% cpu : usr=0.00%, sys=8.51%, ctx=123, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151701: Wed Jul 8 22:33:58 2026 read: IOPS=0, BW=511KiB/s (524kB/s)(2048KiB/4006msec) clat (msec): min=51, max=165, avg=108.44, stdev=80.29 lat (msec): min=51, max=165, avg=108.44, stdev=80.28 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 52], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 165], 95.00th=[ 165], | 99.00th=[ 165], 99.50th=[ 165], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 1935, max= 2039, per=41.77%, avg=1987.00, stdev=73.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2556KiB/s (2618kB/s)(10.0MiB/4006msec); 0 zone resets clat (msec): min=86, max=1747, avg=376.54, stdev=509.10 lat (msec): min=86, max=1747, avg=376.63, stdev=509.10 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 92], | 30.00th=[ 121], 40.00th=[ 157], 50.00th=[ 169], 60.00th=[ 209], | 70.00th=[ 243], 80.00th=[ 292], 90.00th=[ 651], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1917, max= 6131, per=53.21%, avg=3543.50, stdev=1991.61, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=6.82%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151704: Wed Jul 8 22:33:58 2026 read: IOPS=1, BW=1516KiB/s (1552kB/s)(6144KiB/4054msec) clat (msec): min=51, max=435, avg=198.99, stdev=130.53 lat (msec): min=51, max=435, avg=198.99, stdev=130.53 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 188], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1917, max= 4087, per=56.36%, avg=2681.00, stdev=1219.16, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1516KiB/s (1552kB/s)(6144KiB/4054msec); 0 zone resets clat (msec): min=140, max=1795, avg=458.28, stdev=656.91 lat (msec): min=140, max=1795, avg=458.36, stdev=656.90 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 180], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1917, max= 3886, per=39.25%, avg=2614.00, stdev=1103.27, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=8.49%, ctx=111, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151706: Wed Jul 8 22:33:58 2026 read: IOPS=1, BW=1189KiB/s (1218kB/s)(5120KiB/4305msec) clat (msec): min=18, max=562, avg=265.12, stdev=219.66 lat (msec): min=18, max=562, avg=265.12, stdev=219.66 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 19], 10.00th=[ 19], 20.00th=[ 19], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2031, max= 2048, per=42.89%, avg=2040.25, stdev= 7.18, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1665KiB/s (1705kB/s)(7168KiB/4305msec); 0 zone resets clat (msec): min=79, max=1584, avg=414.02, stdev=535.68 lat (msec): min=79, max=1584, avg=414.11, stdev=535.67 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 83], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 234], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 502], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1368, max= 6144, per=50.27%, avg=3348.00, stdev=2138.81, samples=4 iops : min= 1, max= 6, avg= 2.75, stdev= 2.36, samples=4 lat (msec) : 20=8.33%, 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=8.76%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4757KiB/s (4871kB/s), 511KiB/s-1698KiB/s (524kB/s-1739kB/s), io=20.0MiB (20.0MB), run=4006-4305msec WRITE: bw=6660KiB/s (6820kB/s), 1213KiB/s-2556KiB/s (1242kB/s-2618kB/s), io=28.0MiB (29.4MB), run=4006-4305msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151712: Wed Jul 8 22:34:04 2026 read: IOPS=2, BW=8872KiB/s (9085kB/s)(12.0MiB/1385msec) clat (msec): min=351, max=573, avg=437.20, stdev=119.47 lat (msec): min=351, max=573, avg=437.20, stdev=119.47 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 5720, max= 8192, per=71.12%, avg=6956.00, stdev=1747.97, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=39.09%, ctx=1784, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151713: Wed Jul 8 22:34:04 2026 read: IOPS=0, BW=2445KiB/s (2504kB/s)(4096KiB/1675msec) clat (nsec): min=386793k, max=386793k, avg=386792893.00, stdev= 0.00 lat (nsec): min=386795k, max=386795k, avg=386795333.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 5919, max= 5919, per=60.52%, avg=5919.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4891KiB/s (5008kB/s)(8192KiB/1675msec); 0 zone resets clat (msec): min=495, max=741, avg=618.83, stdev=173.71 lat (msec): min=496, max=741, avg=619.12, stdev=173.76 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8192, max= 8192, per=52.23%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=20.49%, ctx=452, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151714: Wed Jul 8 22:34:04 2026 write: IOPS=1, BW=5882KiB/s (6023kB/s)(12.0MiB/2089msec); 0 zone resets clat (msec): min=158, max=1084, avg=671.71, stdev=471.09 lat (msec): min=158, max=1085, avg=672.00, stdev=471.10 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=52.23%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.10%, sys=9.48%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151715: Wed Jul 8 22:34:04 2026 write: IOPS=1, BW=7995KiB/s (8187kB/s)(12.0MiB/1537msec); 0 zone resets clat (msec): min=271, max=935, avg=502.88, stdev=374.69 lat (msec): min=272, max=935, avg=503.21, stdev=374.71 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min=12263, max=12263, per=78.18%, avg=12263.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.47%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9781KiB/s (10.0MB/s), 2445KiB/s-8872KiB/s (2504kB/s-9085kB/s), io=16.0MiB (16.8MB), run=1385-1675msec WRITE: bw=15.3MiB/s (16.1MB/s), 4891KiB/s-7995KiB/s (5008kB/s-8187kB/s), io=32.0MiB (33.6MB), run=1537-2089msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151716: Wed Jul 8 22:34:04 2026 read: IOPS=1, BW=8047KiB/s (8240kB/s)(12.0MiB/1527msec) clat (msec): min=220, max=696, avg=497.64, stdev=247.29 lat (msec): min=220, max=696, avg=497.65, stdev=247.29 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 6291, max= 6291, per=66.24%, avg=6291.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=11.47%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151717: Wed Jul 8 22:34:04 2026 read: IOPS=0, BW=2374KiB/s (2431kB/s)(4096KiB/1725msec) clat (nsec): min=422083k, max=422083k, avg=422083124.00, stdev= 0.00 lat (nsec): min=422085k, max=422085k, avg=422085271.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 6187, max= 6187, per=65.15%, avg=6187.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4749KiB/s (4863kB/s)(8192KiB/1725msec); 0 zone resets clat (msec): min=561, max=725, avg=643.61, stdev=115.79 lat (msec): min=562, max=725, avg=643.94, stdev=115.74 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8192, max= 8192, per=53.73%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=10.27%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151718: Wed Jul 8 22:34:04 2026 write: IOPS=1, BW=5718KiB/s (5855kB/s)(12.0MiB/2149msec); 0 zone resets clat (msec): min=108, max=1320, avg=708.14, stdev=606.05 lat (msec): min=108, max=1320, avg=708.48, stdev=606.08 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8192, max= 8192, per=53.73%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.38%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151719: Wed Jul 8 22:34:04 2026 write: IOPS=1, BW=7670KiB/s (7855kB/s)(12.0MiB/1602msec); 0 zone resets clat (msec): min=477, max=564, avg=519.62, stdev=43.37 lat (msec): min=478, max=564, avg=519.94, stdev=43.32 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 6196, max= 8192, per=47.18%, avg=7194.00, stdev=1411.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=21.24%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9498KiB/s (9726kB/s), 2374KiB/s-8047KiB/s (2431kB/s-8240kB/s), io=16.0MiB (16.8MB), run=1527-1725msec WRITE: bw=14.9MiB/s (15.6MB/s), 4749KiB/s-7670KiB/s (4863kB/s-7855kB/s), io=32.0MiB (33.6MB), run=1602-2149msec