== sanity test 398b: DIO and buffer IO race ============== 21:16:50 (1781227010) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.06957 s, 7.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180570: Thu Jun 11 21:19:35 2026 read: IOPS=10, BW=41.8KiB/s (42.8kB/s)(5992KiB/143482msec) clat (usec): min=45, max=826500, avg=54021.09, stdev=38068.74 lat (usec): min=46, max=826501, avg=54023.59, stdev=38068.41 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 14353], 10.00th=[ 19530], 20.00th=[ 27919], | 30.00th=[ 33817], 40.00th=[ 41681], 50.00th=[ 47973], 60.00th=[ 55313], | 70.00th=[ 64226], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[113771], | 99.00th=[168821], 99.50th=[191890], 99.90th=[252707], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 102, per=24.95%, avg=41.42, stdev=16.66, samples=281 iops : min= 1, max= 25, avg= 9.69, stdev= 4.19, samples=281 write: IOPS=10, BW=43.9KiB/s (44.9kB/s)(6296KiB/143482msec); 0 zone resets clat (usec): min=1097, max=332526, avg=39434.80, stdev=39621.94 lat (usec): min=1097, max=332527, avg=39441.67, stdev=39624.61 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1549], 10.00th=[ 2474], 20.00th=[ 5211], | 30.00th=[ 9634], 40.00th=[ 17957], 50.00th=[ 29492], 60.00th=[ 39060], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[158335], 99.50th=[200279], 99.90th=[250610], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 127, per=25.00%, avg=43.50, stdev=20.29, samples=281 iops : min= 1, max= 31, avg=10.21, stdev= 5.10, samples=281 lat (usec) : 50=0.16%, 100=1.27%, 250=0.13%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.04%, 4=4.13%, 10=7.78%, 20=8.50%, 50=35.22% lat (msec) : 100=30.47%, 250=8.07%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.35%, ctx=6944, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180571: Thu Jun 11 21:19:35 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(5940KiB/141768msec) clat (usec): min=44, max=830118, avg=52716.44, stdev=38807.36 lat (usec): min=44, max=830120, avg=52720.00, stdev=38806.67 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 13829], 10.00th=[ 19792], 20.00th=[ 26608], | 30.00th=[ 32900], 40.00th=[ 39584], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[168821], 99.50th=[189793], 99.90th=[333448], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 95, per=25.00%, avg=41.50, stdev=17.70, samples=279 iops : min= 1, max= 23, avg= 9.70, stdev= 4.44, samples=279 write: IOPS=11, BW=44.8KiB/s (45.9kB/s)(6348KiB/141768msec); 0 zone resets clat (usec): min=1052, max=309679, avg=39706.56, stdev=40995.53 lat (usec): min=1053, max=309680, avg=39714.62, stdev=41001.20 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1549], 10.00th=[ 2442], 20.00th=[ 5211], | 30.00th=[ 10028], 40.00th=[ 18482], 50.00th=[ 28967], 60.00th=[ 38536], | 70.00th=[ 50594], 80.00th=[ 65274], 90.00th=[ 96994], 95.00th=[116917], | 99.00th=[187696], 99.50th=[214959], 99.90th=[278922], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 119, per=25.50%, avg=44.37, stdev=19.29, samples=279 iops : min= 1, max= 29, avg=10.43, stdev= 4.84, samples=279 lat (usec) : 50=0.07%, 100=1.60%, 250=0.10%, 500=0.07% lat (msec) : 2=4.10%, 4=4.13%, 10=7.29%, 20=8.98%, 50=36.65% lat (msec) : 100=28.39%, 250=8.43%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=5.51%, ctx=6930, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180572: Thu Jun 11 21:19:35 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(6028KiB/141896msec) clat (usec): min=39, max=286892, avg=51227.72, stdev=32166.34 lat (usec): min=40, max=286893, avg=51234.78, stdev=32162.67 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 9765], 10.00th=[ 20055], 20.00th=[ 26608], | 30.00th=[ 32637], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 52691], | 70.00th=[ 62653], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[105382], | 99.00th=[162530], 99.50th=[183501], 99.90th=[225444], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 111, per=25.56%, avg=42.43, stdev=17.25, samples=276 iops : min= 1, max= 27, avg= 9.94, stdev= 4.32, samples=276 write: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6260KiB/141896msec); 0 zone resets clat (usec): min=1093, max=793069, avg=41054.89, stdev=45209.57 lat (usec): min=1095, max=793071, avg=41057.69, stdev=45208.94 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1565], 10.00th=[ 2343], 20.00th=[ 5145], | 30.00th=[ 10159], 40.00th=[ 21103], 50.00th=[ 29492], 60.00th=[ 40633], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[185598], 99.50th=[217056], 99.90th=[316670], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 111, per=25.08%, avg=43.65, stdev=19.24, samples=279 iops : min= 1, max= 27, avg=10.24, stdev= 4.84, samples=279 lat (usec) : 50=0.10%, 100=2.02%, 250=0.07%, 500=0.03%, 750=0.07% lat (msec) : 2=4.17%, 4=4.56%, 10=6.61%, 20=6.90%, 50=37.92% lat (msec) : 100=30.05%, 250=7.36%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=5.47%, ctx=6848, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180573: Thu Jun 11 21:19:35 2026 read: IOPS=10, BW=42.0KiB/s (43.1kB/s)(6052KiB/143945msec) clat (usec): min=35, max=318027, avg=51901.82, stdev=35304.77 lat (usec): min=35, max=318028, avg=51904.42, stdev=35305.60 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 8029], 10.00th=[ 17695], 20.00th=[ 24773], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 52691], | 70.00th=[ 61604], 80.00th=[ 77071], 90.00th=[ 94897], 95.00th=[116917], | 99.00th=[170918], 99.50th=[193987], 99.90th=[256902], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 110, per=25.13%, avg=41.72, stdev=16.30, samples=282 iops : min= 1, max= 27, avg= 9.77, stdev= 4.10, samples=282 write: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6236KiB/143945msec); 0 zone resets clat (usec): min=1168, max=817141, avg=41701.80, stdev=46391.49 lat (usec): min=1168, max=817145, avg=41707.93, stdev=46390.50 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1549], 10.00th=[ 2376], 20.00th=[ 5276], | 30.00th=[ 9765], 40.00th=[ 19530], 50.00th=[ 30016], 60.00th=[ 39060], | 70.00th=[ 53740], 80.00th=[ 69731], 90.00th=[100140], 95.00th=[125305], | 99.00th=[181404], 99.50th=[200279], 99.90th=[312476], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 149, per=24.79%, avg=43.14, stdev=20.14, samples=281 iops : min= 1, max= 37, avg=10.12, stdev= 5.05, samples=281 lat (usec) : 50=0.10%, 100=1.86%, 250=0.20%, 750=0.10%, 1000=0.03% lat (msec) : 2=4.13%, 4=4.00%, 10=7.45%, 20=8.92%, 50=35.25% lat (msec) : 100=28.68%, 250=9.05%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=5.28%, ctx=6760, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=167KiB/s (171kB/s), 41.8KiB/s-42.5KiB/s (42.8kB/s-43.5kB/s), io=23.4MiB (24.6MB), run=141768-143945msec WRITE: bw=175KiB/s (179kB/s), 43.3KiB/s-44.8KiB/s (44.4kB/s-45.9kB/s), io=24.6MiB (25.7MB), run=141768-143945msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180574: Thu Jun 11 21:20:17 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(5992KiB/185493msec) clat (msec): min=5, max=843, avg=48.61, stdev=48.34 lat (msec): min=5, max=843, avg=48.62, stdev=48.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 106], 95.00th=[ 142], | 99.00th=[ 224], 99.50th=[ 255], 99.90th=[ 321], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 128, per=25.84%, avg=33.33, stdev=23.60, samples=349 iops : min= 1, max= 32, avg= 7.67, stdev= 5.95, samples=349 write: IOPS=8, BW=33.9KiB/s (34.8kB/s)(6296KiB/185493msec); 0 zone resets clat (msec): min=13, max=419, avg=71.39, stdev=51.31 lat (msec): min=13, max=419, avg=71.39, stdev=51.31 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 55], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 107], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 253], 99.50th=[ 313], 99.90th=[ 409], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 111, per=25.08%, avg=33.86, stdev=21.70, samples=361 iops : min= 1, max= 27, avg= 7.80, stdev= 5.47, samples=361 lat (msec) : 10=1.60%, 20=12.11%, 50=43.16%, 100=26.14%, 250=16.21% lat (msec) : 500=0.75%, 1000=0.03% cpu : usr=0.06%, sys=2.08%, ctx=5066, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180575: Thu Jun 11 21:20:17 2026 read: IOPS=7, BW=31.0KiB/s (32.7kB/s)(5940KiB/185822msec) clat (msec): min=4, max=724, avg=48.41, stdev=46.76 lat (msec): min=4, max=724, avg=48.42, stdev=46.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 109], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 243], 99.90th=[ 309], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 127, per=25.63%, avg=33.06, stdev=23.70, samples=348 iops : min= 1, max= 31, avg= 7.59, stdev= 5.97, samples=348 write: IOPS=8, BW=34.2KiB/s (34.0kB/s)(6348KiB/185822msec); 0 zone resets clat (msec): min=10, max=391, avg=71.54, stdev=49.76 lat (msec): min=10, max=391, avg=71.54, stdev=49.76 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 56], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 236], 99.50th=[ 292], 99.90th=[ 351], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 103, per=25.31%, avg=34.17, stdev=21.77, samples=359 iops : min= 1, max= 25, avg= 7.88, stdev= 5.48, samples=359 lat (msec) : 10=1.33%, 20=12.30%, 50=43.03%, 100=25.94%, 250=16.67% lat (msec) : 500=0.68%, 750=0.03% cpu : usr=0.07%, sys=2.11%, ctx=5140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180576: Thu Jun 11 21:20:17 2026 read: IOPS=8, BW=32.5KiB/s (33.2kB/s)(6028KiB/185681msec) clat (msec): min=5, max=341, avg=49.52, stdev=45.42 lat (msec): min=5, max=341, avg=49.52, stdev=45.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 107], 95.00th=[ 148], | 99.00th=[ 222], 99.50th=[ 249], 99.90th=[ 326], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 136, per=25.57%, avg=32.99, stdev=23.64, samples=354 iops : min= 1, max= 34, avg= 7.58, stdev= 5.96, samples=354 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6260KiB/185681msec); 0 zone resets clat (msec): min=11, max=694, avg=70.69, stdev=54.62 lat (msec): min=11, max=694, avg=70.70, stdev=54.62 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 171], | 99.00th=[ 259], 99.50th=[ 342], 99.90th=[ 414], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=33.67, stdev=22.99, samples=360 iops : min= 1, max= 29, avg= 7.75, stdev= 5.78, samples=360 lat (msec) : 10=1.76%, 20=12.01%, 50=43.29%, 100=26.53%, 250=15.59% lat (msec) : 500=0.78%, 750=0.03% cpu : usr=0.06%, sys=2.04%, ctx=5118, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180577: Thu Jun 11 21:20:17 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6052KiB/184952msec) clat (msec): min=5, max=358, avg=47.52, stdev=43.40 lat (msec): min=5, max=358, avg=47.52, stdev=43.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 106], 95.00th=[ 140], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 321], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 126, per=26.58%, avg=34.29, stdev=23.39, samples=343 iops : min= 1, max= 31, avg= 7.91, stdev= 5.90, samples=343 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6236KiB/184952msec); 0 zone resets clat (msec): min=14, max=806, avg=72.32, stdev=54.91 lat (msec): min=14, max=806, avg=72.32, stdev=54.91 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 108], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 264], 99.50th=[ 342], 99.90th=[ 401], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 112, per=24.95%, avg=33.68, stdev=21.76, samples=359 iops : min= 1, max= 28, avg= 7.76, stdev= 5.48, samples=359 lat (msec) : 10=1.43%, 20=12.34%, 50=43.49%, 100=25.52%, 250=16.50% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.06%, sys=2.08%, ctx=5122, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (132kB/s), 31.0KiB/s-32.7KiB/s (32.7kB/s-33.5kB/s), io=23.4MiB (24.6MB), run=184952-185822msec WRITE: bw=135KiB/s (139kB/s), 33.7KiB/s-34.2KiB/s (34.5kB/s-34.0kB/s), io=24.6MiB (25.7MB), run=184952-185822msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180619: Thu Jun 11 21:21:01 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(5920KiB/32718msec) clat (usec): min=38, max=190151, avg=45969.85, stdev=30674.32 lat (usec): min=38, max=190153, avg=45971.25, stdev=30674.50 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 125], 20.00th=[ 24249], | 30.00th=[ 31065], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[103285], | 99.00th=[154141], 99.50th=[160433], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 288, per=25.27%, avg=179.17, stdev=54.36, samples=64 iops : min= 3, max= 18, avg=10.42, stdev= 3.47, samples=64 write: IOPS=12, BW=195KiB/s (199kB/s)(6368KiB/32718msec); 0 zone resets clat (usec): min=1573, max=233988, avg=38837.98, stdev=35515.19 lat (usec): min=1575, max=233990, avg=38840.60, stdev=35515.16 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2999], 10.00th=[ 5014], 20.00th=[ 7832], | 30.00th=[ 12780], 40.00th=[ 20055], 50.00th=[ 28705], 60.00th=[ 36439], | 70.00th=[ 51119], 80.00th=[ 66323], 90.00th=[ 88605], 95.00th=[102237], | 99.00th=[168821], 99.50th=[183501], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 348, per=26.01%, avg=194.02, stdev=63.81, samples=64 iops : min= 1, max= 21, avg=11.36, stdev= 4.01, samples=64 lat (usec) : 50=0.39%, 100=3.91%, 250=0.65%, 750=0.39% lat (msec) : 2=1.04%, 4=3.12%, 10=9.77%, 20=8.72%, 50=38.28% lat (msec) : 100=28.39%, 250=5.34% cpu : usr=0.09%, sys=5.97%, ctx=1728, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180620: Thu Jun 11 21:21:01 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5744KiB/33758msec) clat (usec): min=43, max=280317, avg=49726.22, stdev=34365.50 lat (usec): min=43, max=280318, avg=49730.86, stdev=34363.72 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 86], 20.00th=[ 25297], | 30.00th=[ 31589], 40.00th=[ 39584], 50.00th=[ 46400], 60.00th=[ 53740], | 70.00th=[ 63701], 80.00th=[ 73925], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[149947], 99.50th=[170918], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 63, max= 382, per=23.76%, avg=168.45, stdev=65.14, samples=66 iops : min= 3, max= 23, avg= 9.73, stdev= 4.10, samples=66 write: IOPS=12, BW=194KiB/s (199kB/s)(6544KiB/33758msec); 0 zone resets clat (usec): min=1680, max=243644, avg=38436.38, stdev=35634.87 lat (usec): min=1682, max=243648, avg=38460.24, stdev=35653.28 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2180], 10.00th=[ 3556], 20.00th=[ 6849], | 30.00th=[ 11207], 40.00th=[ 19792], 50.00th=[ 28705], 60.00th=[ 37487], | 70.00th=[ 53740], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[102237], | 99.00th=[145753], 99.50th=[170918], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 61, max= 349, per=25.67%, avg=191.53, stdev=78.73, samples=66 iops : min= 3, max= 21, avg=11.18, stdev= 4.91, samples=66 lat (usec) : 50=0.26%, 100=4.82%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=2.21%, 4=4.43%, 10=8.33%, 20=7.94%, 50=32.94% lat (msec) : 100=31.64%, 250=6.64%, 500=0.13% cpu : usr=0.07%, sys=5.72%, ctx=1734, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180621: Thu Jun 11 21:21:01 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(6256KiB/32999msec) clat (usec): min=52, max=263645, avg=49141.54, stdev=34966.52 lat (usec): min=53, max=263646, avg=49144.03, stdev=34965.68 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 1172], 20.00th=[ 24249], | 30.00th=[ 30802], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 58983], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[114820], | 99.00th=[175113], 99.50th=[204473], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 63, max= 383, per=26.72%, avg=189.43, stdev=70.27, samples=65 iops : min= 3, max= 23, avg=11.06, stdev= 4.42, samples=65 write: IOPS=11, BW=183KiB/s (187kB/s)(6032KiB/32999msec); 0 zone resets clat (usec): min=1761, max=191443, avg=36332.53, stdev=34414.74 lat (usec): min=1763, max=191445, avg=36335.08, stdev=34414.70 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2835], 10.00th=[ 3785], 20.00th=[ 7504], | 30.00th=[ 10290], 40.00th=[ 16712], 50.00th=[ 25297], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 63177], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[145753], 99.50th=[149947], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 374, per=24.23%, avg=180.78, stdev=74.46, samples=65 iops : min= 1, max= 23, avg=10.51, stdev= 4.70, samples=65 lat (usec) : 100=4.43%, 250=0.52%, 500=0.13% lat (msec) : 2=1.04%, 4=4.30%, 10=9.24%, 20=9.38%, 50=35.94% lat (msec) : 100=28.52%, 250=6.38%, 500=0.13% cpu : usr=0.09%, sys=5.92%, ctx=1771, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180622: Thu Jun 11 21:21:01 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(6032KiB/31408msec) clat (usec): min=40, max=207263, avg=47188.19, stdev=31332.40 lat (usec): min=40, max=207266, avg=47191.23, stdev=31332.59 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 114], 20.00th=[ 24511], | 30.00th=[ 31065], 40.00th=[ 37487], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[141558], 99.50th=[154141], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 63, max= 382, per=26.77%, avg=189.82, stdev=68.08, samples=61 iops : min= 3, max= 23, avg=11.13, stdev= 4.31, samples=61 write: IOPS=12, BW=199KiB/s (204kB/s)(6256KiB/31408msec); 0 zone resets clat (usec): min=1828, max=242842, avg=34543.77, stdev=34230.16 lat (usec): min=1830, max=242844, avg=34547.02, stdev=34229.49 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2376], 10.00th=[ 3982], 20.00th=[ 6194], | 30.00th=[ 9503], 40.00th=[ 15795], 50.00th=[ 23462], 60.00th=[ 32900], | 70.00th=[ 45876], 80.00th=[ 59507], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[152044], 99.50th=[168821], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 32, max= 441, per=26.59%, avg=198.34, stdev=91.54, samples=61 iops : min= 2, max= 27, avg=11.67, stdev= 5.78, samples=61 lat (usec) : 50=0.39%, 100=4.17%, 250=0.78%, 500=0.13%, 750=0.26% lat (msec) : 2=1.04%, 4=4.43%, 10=10.55%, 20=8.98%, 50=35.94% lat (msec) : 100=27.86%, 250=5.47% cpu : usr=0.10%, sys=6.11%, ctx=1709, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=710KiB/s (727kB/s), 170KiB/s-192KiB/s (174kB/s-197kB/s), io=23.4MiB (24.5MB), run=31408-33758msec WRITE: bw=746KiB/s (764kB/s), 183KiB/s-199KiB/s (187kB/s-204kB/s), io=24.6MiB (25.8MB), run=31408-33758msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180624: Thu Jun 11 21:21:14 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5920KiB/45433msec) clat (msec): min=9, max=261, avg=52.30, stdev=43.38 lat (msec): min=9, max=261, avg=52.30, stdev=43.38 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 59], 80.00th=[ 77], 90.00th=[ 116], 95.00th=[ 148], | 99.00th=[ 213], 99.50th=[ 251], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 383, per=24.35%, avg=128.06, stdev=76.26, samples=89 iops : min= 1, max= 23, avg= 7.24, stdev= 4.79, samples=89 write: IOPS=8, BW=140KiB/s (144kB/s)(6368KiB/45433msec); 0 zone resets clat (msec): min=14, max=228, avg=65.16, stdev=39.27 lat (msec): min=14, max=228, avg=65.17, stdev=39.28 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 146], | 99.00th=[ 201], 99.50th=[ 211], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 31, max= 319, per=25.43%, avg=140.64, stdev=79.42, samples=88 iops : min= 1, max= 19, avg= 8.02, stdev= 5.04, samples=88 lat (msec) : 10=0.13%, 20=10.16%, 50=45.57%, 100=27.99%, 250=16.02% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.09%, ctx=1269, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180626: Thu Jun 11 21:21:14 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(5744KiB/44916msec) clat (msec): min=8, max=217, avg=45.81, stdev=36.82 lat (msec): min=8, max=217, avg=45.83, stdev=36.82 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 136], | 99.00th=[ 180], 99.50th=[ 215], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 30, max= 415, per=24.94%, avg=131.19, stdev=86.51, samples=85 iops : min= 1, max= 25, avg= 7.44, stdev= 5.51, samples=85 write: IOPS=9, BW=146KiB/s (149kB/s)(6544KiB/44916msec); 0 zone resets clat (msec): min=19, max=278, avg=69.28, stdev=45.61 lat (msec): min=19, max=278, avg=69.29, stdev=45.61 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 65], | 70.00th=[ 80], 80.00th=[ 101], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 234], 99.50th=[ 271], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 383, per=26.37%, avg=145.83, stdev=79.40, samples=87 iops : min= 1, max= 23, avg= 8.37, stdev= 4.98, samples=87 lat (msec) : 10=0.13%, 20=9.90%, 50=47.14%, 100=27.73%, 250=14.58% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=2.25%, ctx=1314, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180627: Thu Jun 11 21:21:14 2026 read: IOPS=8, BW=137KiB/s (141kB/s)(6256KiB/45532msec) clat (msec): min=8, max=241, avg=47.46, stdev=38.31 lat (msec): min=8, max=241, avg=47.46, stdev=38.31 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 110], 95.00th=[ 131], | 99.00th=[ 178], 99.50th=[ 184], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 30, max= 447, per=26.47%, avg=139.25, stdev=95.09, samples=88 iops : min= 1, max= 27, avg= 7.94, stdev= 6.02, samples=88 write: IOPS=8, BW=132KiB/s (136kB/s)(6032KiB/45532msec); 0 zone resets clat (msec): min=18, max=385, avg=71.40, stdev=47.96 lat (msec): min=18, max=385, avg=71.41, stdev=47.96 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 85], 80.00th=[ 102], 90.00th=[ 134], 95.00th=[ 167], | 99.00th=[ 228], 99.50th=[ 347], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 382, per=23.54%, avg=130.19, stdev=77.50, samples=89 iops : min= 1, max= 23, avg= 7.37, stdev= 4.88, samples=89 lat (msec) : 10=0.65%, 20=11.20%, 50=42.97%, 100=29.17%, 250=15.63% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.12%, ctx=1228, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180628: Thu Jun 11 21:21:14 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45332msec) clat (msec): min=8, max=210, avg=48.85, stdev=39.72 lat (msec): min=8, max=210, avg=48.85, stdev=39.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 48], 80.00th=[ 72], 90.00th=[ 116], 95.00th=[ 140], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 352, per=25.33%, avg=133.22, stdev=76.80, samples=88 iops : min= 1, max= 22, avg= 7.56, stdev= 4.89, samples=88 write: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45332msec); 0 zone resets clat (msec): min=17, max=362, avg=68.49, stdev=48.03 lat (msec): min=17, max=362, avg=68.52, stdev=48.05 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 95], 90.00th=[ 136], 95.00th=[ 163], | 99.00th=[ 259], 99.50th=[ 279], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 383, per=24.90%, avg=137.69, stdev=81.69, samples=89 iops : min= 1, max= 23, avg= 7.85, stdev= 5.14, samples=89 lat (msec) : 10=0.78%, 20=9.11%, 50=49.22%, 100=25.39%, 250=14.97% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=2.24%, ctx=1265, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=526KiB/s (539kB/s), 128KiB/s-137KiB/s (131kB/s-141kB/s), io=23.4MiB (24.5MB), run=44916-45532msec WRITE: bw=553KiB/s (567kB/s), 132KiB/s-146KiB/s (136kB/s-149kB/s), io=24.6MiB (25.8MB), run=44916-45532msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180639: Thu Jun 11 21:21:29 2026 read: IOPS=1, BW=1353KiB/s (1385kB/s)(7168KiB/5299msec) clat (msec): min=6, max=3000, avg=526.40, stdev=1093.45 lat (msec): min=6, max=3000, avg=526.40, stdev=1093.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 16], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 169], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 190], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1494, max= 4087, per=89.36%, avg=2917.75, stdev=1345.93, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=966KiB/s (989kB/s)(5120KiB/5299msec); 0 zone resets clat (msec): min=130, max=752, avg=302.60, stdev=257.65 lat (msec): min=131, max=752, avg=302.73, stdev=257.64 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2023, max= 4087, per=59.44%, avg=2717.67, stdev=1185.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 20=8.33%, 250=58.33%, 500=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=12.38%, ctx=662, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180640: Thu Jun 11 21:21:29 2026 read: IOPS=0, BW=327KiB/s (334kB/s)(2048KiB/6271msec) clat (msec): min=162, max=272, avg=217.55, stdev=78.39 lat (msec): min=162, max=272, avg=217.55, stdev=78.39 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1440, max= 2007, per=52.79%, avg=1723.50, stdev=400.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1633KiB/s (1672kB/s)(10.0MiB/6271msec); 0 zone resets clat (msec): min=131, max=3104, avg=569.57, stdev=900.00 lat (msec): min=131, max=3104, avg=569.72, stdev=899.98 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 165], | 30.00th=[ 176], 40.00th=[ 213], 50.00th=[ 251], 60.00th=[ 296], | 70.00th=[ 418], 80.00th=[ 426], 90.00th=[ 518], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 2007, max= 4087, per=66.63%, avg=3046.33, stdev=1113.85, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=12.46%, ctx=148, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180641: Thu Jun 11 21:21:29 2026 read: IOPS=1, BW=1141KiB/s (1169kB/s)(6144KiB/5384msec) clat (usec): min=535, max=241623, avg=91424.65, stdev=105036.72 lat (usec): min=537, max=241625, avg=91427.81, stdev=105034.99 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 1074], | 30.00th=[ 1074], 40.00th=[ 1909], 50.00th=[ 1909], 60.00th=[130548], | 70.00th=[173016], 80.00th=[173016], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 2007, max= 6131, per=100.00%, avg=3393.67, stdev=2370.67, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1141KiB/s (1169kB/s)(6144KiB/5384msec); 0 zone resets clat (msec): min=196, max=3336, avg=800.64, stdev=1247.36 lat (msec): min=201, max=3337, avg=801.55, stdev=1246.92 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 342], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 2043, max= 4087, per=66.17%, avg=3025.33, stdev=1024.31, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 250=50.00%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=10.03%, ctx=129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180643: Thu Jun 11 21:21:29 2026 read: IOPS=0, BW=933KiB/s (956kB/s)(5120KiB/5485msec) clat (usec): min=1656, max=254106, avg=57134.64, stdev=110601.29 lat (usec): min=1658, max=254108, avg=57136.34, stdev=110601.37 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1663], 10.00th=[ 1663], 20.00th=[ 1663], | 30.00th=[ 1713], 40.00th=[ 1713], 50.00th=[ 2278], 60.00th=[ 2278], | 70.00th=[ 25822], 80.00th=[ 25822], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1307KiB/s (1338kB/s)(7168KiB/5485msec); 0 zone resets clat (msec): min=126, max=3268, avg=735.14, stdev=1129.28 lat (msec): min=127, max=3268, avg=735.29, stdev=1129.26 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 207], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 330], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 642], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1544, max= 4087, per=51.20%, avg=2340.80, stdev=998.15, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=16.67%, 4=8.33%, 50=8.33%, 250=25.00%, 500=25.00% lat (msec) : 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=10.98%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3266KiB/s (3344kB/s), 327KiB/s-1353KiB/s (334kB/s-1385kB/s), io=20.0MiB (20.0MB), run=5299-6271msec WRITE: bw=4572KiB/s (4682kB/s), 966KiB/s-1633KiB/s (989kB/s-1672kB/s), io=28.0MiB (29.4MB), run=5299-6271msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180645: Thu Jun 11 21:21:30 2026 read: IOPS=1, BW=1091KiB/s (1117kB/s)(7168KiB/6571msec) clat (msec): min=57, max=2895, avg=725.87, stdev=1042.33 lat (msec): min=57, max=2895, avg=725.87, stdev=1042.33 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 69], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 85], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 953], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 2027, max= 4096, per=78.57%, avg=2448.20, stdev=921.18, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 write: IOPS=0, BW=779KiB/s (798kB/s)(5120KiB/6571msec); 0 zone resets clat (msec): min=63, max=630, avg=276.16, stdev=222.88 lat (msec): min=63, max=630, avg=276.50, stdev=222.94 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2048, max= 6144, per=78.23%, avg=3413.33, stdev=2364.83, samples=3 iops : min= 2, max= 6, avg= 3.33, stdev= 2.31, samples=3 lat (msec) : 100=41.67%, 250=16.67%, 500=8.33%, 750=8.33%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=3.06%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180646: Thu Jun 11 21:21:30 2026 read: IOPS=0, BW=317KiB/s (325kB/s)(2048KiB/6459msec) clat (msec): min=80, max=242, avg=161.84, stdev=114.40 lat (msec): min=80, max=242, avg=161.84, stdev=114.40 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 82], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1980, max= 2048, per=64.63%, avg=2014.00, stdev=48.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1585KiB/s (1623kB/s)(10.0MiB/6459msec); 0 zone resets clat (msec): min=72, max=3112, avg=602.81, stdev=914.97 lat (msec): min=72, max=3112, avg=603.02, stdev=914.90 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 95], | 30.00th=[ 107], 40.00th=[ 118], 50.00th=[ 203], 60.00th=[ 430], | 70.00th=[ 567], 80.00th=[ 575], 90.00th=[ 751], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 2031, max= 4096, per=56.15%, avg=2449.80, stdev=920.28, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=8.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=4.58%, ctx=124, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180647: Thu Jun 11 21:21:30 2026 read: IOPS=0, BW=964KiB/s (987kB/s)(6144KiB/6372msec) clat (msec): min=53, max=490, avg=259.50, stdev=199.70 lat (msec): min=53, max=490, avg=259.50, stdev=199.70 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 55], | 30.00th=[ 55], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 342], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2031, max= 6144, per=100.00%, avg=3406.00, stdev=2371.19, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=0, BW=964KiB/s (987kB/s)(6144KiB/6372msec); 0 zone resets clat (msec): min=148, max=3357, avg=787.97, stdev=1263.38 lat (msec): min=148, max=3357, avg=788.20, stdev=1263.34 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 279], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 2039, max= 4096, per=58.62%, avg=2557.75, stdev=1025.51, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, >=2000=8.33% cpu : usr=0.03%, sys=4.25%, ctx=150, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180648: Thu Jun 11 21:21:30 2026 read: IOPS=0, BW=806KiB/s (825kB/s)(5120KiB/6355msec) clat (msec): min=53, max=487, avg=182.60, stdev=179.88 lat (msec): min=53, max=487, avg=182.60, stdev=179.88 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 86], 60.00th=[ 86], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2031, max= 6144, per=100.00%, avg=4087.50, stdev=2908.33, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1128KiB/s (1155kB/s)(7168KiB/6355msec); 0 zone resets clat (msec): min=179, max=3344, avg=767.41, stdev=1142.55 lat (msec): min=179, max=3344, avg=767.55, stdev=1142.57 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 245], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 347], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 518], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1393, max= 4096, per=53.22%, avg=2322.20, stdev=1030.49, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.00%, ctx=170, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3117KiB/s (3192kB/s), 317KiB/s-1091KiB/s (325kB/s-1117kB/s), io=20.0MiB (20.0MB), run=6355-6571msec WRITE: bw=4363KiB/s (4468kB/s), 779KiB/s-1585KiB/s (798kB/s-1623kB/s), io=28.0MiB (29.4MB), run=6355-6571msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180659: Thu Jun 11 21:21:43 2026 read: IOPS=1, BW=5150KiB/s (5274kB/s)(12.0MiB/2386msec) clat (msec): min=287, max=1322, avg=789.07, stdev=518.30 lat (msec): min=287, max=1322, avg=789.08, stdev=518.31 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.49%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180660: Thu Jun 11 21:21:43 2026 read: IOPS=0, BW=1317KiB/s (1348kB/s)(4096KiB/3111msec) clat (nsec): min=1691.9M, max=1691.9M, avg=1691917766.00, stdev= 0.00 lat (nsec): min=1691.9M, max=1691.9M, avg=1691919540.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1687], 5.00th=[ 1687], 10.00th=[ 1687], 20.00th=[ 1687], | 30.00th=[ 1687], 40.00th=[ 1687], 50.00th=[ 1687], 60.00th=[ 1687], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2633KiB/s (2696kB/s)(8192KiB/3111msec); 0 zone resets clat (msec): min=609, max=771, avg=690.94, stdev=114.63 lat (msec): min=610, max=772, avg=691.55, stdev=114.46 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8143, max= 8143, per=77.32%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=3.76%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180661: Thu Jun 11 21:21:43 2026 write: IOPS=1, BW=4231KiB/s (4333kB/s)(12.0MiB/2904msec); 0 zone resets clat (msec): min=283, max=2099, avg=943.09, stdev=1004.82 lat (msec): min=283, max=2101, avg=944.05, stdev=1005.62 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.21%, sys=4.82%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180662: Thu Jun 11 21:21:43 2026 write: IOPS=1, BW=4200KiB/s (4300kB/s)(12.0MiB/2926msec); 0 zone resets clat (msec): min=743, max=1134, avg=948.28, stdev=196.02 lat (msec): min=745, max=1138, avg=950.85, stdev=197.36 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8143, max= 8192, per=77.55%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.50%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5266KiB/s (5393kB/s), 1317KiB/s-5150KiB/s (1348kB/s-5274kB/s), io=16.0MiB (16.8MB), run=2386-3111msec WRITE: bw=10.3MiB/s (10.8MB/s), 2633KiB/s-4231KiB/s (2696kB/s-4333kB/s), io=32.0MiB (33.6MB), run=2904-3111msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180654: Thu Jun 11 21:21:43 2026 read: IOPS=1, BW=5925KiB/s (6067kB/s)(12.0MiB/2074msec) clat (msec): min=569, max=737, avg=663.09, stdev=85.96 lat (msec): min=569, max=737, avg=663.09, stdev=85.96 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=17.51%, ctx=366, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180655: Thu Jun 11 21:21:43 2026 read: IOPS=0, BW=1572KiB/s (1609kB/s)(4096KiB/2606msec) clat (nsec): min=764135k, max=764135k, avg=764134580.00, stdev= 0.00 lat (nsec): min=764138k, max=764138k, avg=764138351.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3144KiB/s (3219kB/s)(8192KiB/2606msec); 0 zone resets clat (msec): min=681, max=1111, avg=896.86, stdev=304.07 lat (msec): min=682, max=1112, avg=897.55, stdev=304.34 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8175, max= 8175, per=80.53%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.68%, ctx=142, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180657: Thu Jun 11 21:21:43 2026 write: IOPS=0, BW=3807KiB/s (3898kB/s)(12.0MiB/3228msec); 0 zone resets clat (msec): min=161, max=2453, avg=1060.96, stdev=1223.20 lat (msec): min=162, max=2454, avg=1061.82, stdev=1223.00 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8159, max= 8175, per=80.46%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.11%, ctx=112, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180658: Thu Jun 11 21:21:43 2026 write: IOPS=1, BW=4390KiB/s (4496kB/s)(12.0MiB/2799msec); 0 zone resets clat (msec): min=252, max=1948, avg=909.60, stdev=910.44 lat (msec): min=253, max=1949, avg=910.06, stdev=910.48 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 5970, max= 8175, per=69.67%, avg=7072.50, stdev=1559.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.25%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6287KiB/s (6438kB/s), 1572KiB/s-5925KiB/s (1609kB/s-6067kB/s), io=16.0MiB (16.8MB), run=2074-2606msec WRITE: bw=9.91MiB/s (10.4MB/s), 3144KiB/s-4390KiB/s (3219kB/s-4496kB/s), io=32.0MiB (33.6MB), run=2606-3228msec