== sanity test 398b: DIO and buffer IO race ============== 20:27:46 (1781224066) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.16538 s, 9.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144969: Thu Jun 11 20:30:06 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5992KiB/120532msec) clat (usec): min=21, max=996388, avg=39720.47, stdev=40434.31 lat (usec): min=21, max=996389, avg=39722.10, stdev=40434.36 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 67], 20.00th=[ 16188], | 30.00th=[ 21890], 40.00th=[ 27132], 50.00th=[ 32637], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[189793], 99.90th=[354419], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 119, per=25.03%, avg=49.55, stdev=20.93, samples=235 iops : min= 1, max= 29, avg=11.75, stdev= 5.26, samples=235 write: IOPS=13, BW=52.2KiB/s (53.5kB/s)(6296KiB/120532msec); 0 zone resets clat (usec): min=874, max=279702, avg=38420.69, stdev=38442.51 lat (usec): min=875, max=279704, avg=38424.95, stdev=38442.68 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1483], 20.00th=[ 4490], | 30.00th=[ 8979], 40.00th=[ 19268], 50.00th=[ 28443], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[166724], 99.50th=[198181], 99.90th=[274727], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 143, per=25.07%, avg=52.15, stdev=21.66, samples=235 iops : min= 1, max= 35, avg=12.41, stdev= 5.45, samples=235 lat (usec) : 50=1.11%, 100=4.72%, 250=0.29%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.67%, 4=2.99%, 10=6.74%, 20=11.00%, 50=36.43% lat (msec) : 100=24.77%, 250=4.92%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.57%, ctx=6350, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144971: Thu Jun 11 20:30:06 2026 read: IOPS=12, BW=49.3KiB/s (50.5kB/s)(5940KiB/120367msec) clat (usec): min=20, max=970631, avg=37963.45, stdev=38220.05 lat (usec): min=21, max=970634, avg=37965.23, stdev=38220.64 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 16319], | 30.00th=[ 21890], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[137364], 99.50th=[170918], 99.90th=[329253], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 118, per=25.15%, avg=49.79, stdev=21.23, samples=233 iops : min= 1, max= 29, avg=11.81, stdev= 5.35, samples=233 write: IOPS=13, BW=52.7KiB/s (54.0kB/s)(6348KiB/120367msec); 0 zone resets clat (usec): min=728, max=321400, avg=39955.51, stdev=41441.04 lat (usec): min=728, max=321402, avg=39959.64, stdev=41441.09 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1483], 20.00th=[ 4228], | 30.00th=[ 8717], 40.00th=[ 19006], 50.00th=[ 30540], 60.00th=[ 40633], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 95945], 95.00th=[120062], | 99.00th=[196084], 99.50th=[223347], 99.90th=[263193], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 135, per=25.31%, avg=52.65, stdev=21.74, samples=235 iops : min= 1, max= 33, avg=12.53, stdev= 5.48, samples=235 lat (usec) : 50=1.20%, 100=4.52%, 250=0.20%, 750=0.13%, 1000=0.23% lat (msec) : 2=6.64%, 4=3.29%, 10=6.87%, 20=10.68%, 50=37.43% lat (msec) : 100=22.79%, 250=5.86%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=5.50%, ctx=6312, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144973: Thu Jun 11 20:30:06 2026 read: IOPS=12, BW=50.9KiB/s (52.1kB/s)(6028KiB/118415msec) clat (usec): min=30, max=371798, avg=37053.11, stdev=31365.22 lat (usec): min=31, max=371800, avg=37059.07, stdev=31364.11 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 15533], | 30.00th=[ 21627], 40.00th=[ 26346], 50.00th=[ 31065], 60.00th=[ 37487], | 70.00th=[ 44303], 80.00th=[ 55313], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[177210], 99.90th=[320865], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 135, per=25.94%, avg=51.37, stdev=22.01, samples=229 iops : min= 1, max= 33, avg=12.21, stdev= 5.56, samples=229 write: IOPS=13, BW=52.9KiB/s (54.1kB/s)(6260KiB/118415msec); 0 zone resets clat (usec): min=772, max=935634, avg=39631.53, stdev=45370.19 lat (usec): min=772, max=935635, avg=39633.15, stdev=45370.19 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1500], 20.00th=[ 4359], | 30.00th=[ 9896], 40.00th=[ 19530], 50.00th=[ 29754], 60.00th=[ 39060], | 70.00th=[ 51119], 80.00th=[ 66323], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[168821], 99.50th=[191890], 99.90th=[333448], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 119, per=25.54%, avg=53.12, stdev=21.80, samples=230 iops : min= 1, max= 29, avg=12.65, stdev= 5.50, samples=230 lat (usec) : 50=1.07%, 100=5.37%, 250=0.13%, 500=0.07%, 1000=0.23% lat (msec) : 2=6.41%, 4=3.32%, 10=5.92%, 20=11.39%, 50=38.28% lat (msec) : 100=22.30%, 250=5.31%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=5.64%, ctx=6332, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144975: Thu Jun 11 20:30:06 2026 read: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6052KiB/120803msec) clat (usec): min=24, max=283190, avg=37679.51, stdev=28629.46 lat (usec): min=24, max=283191, avg=37684.14, stdev=28632.17 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 16319], | 30.00th=[ 22414], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 58459], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[122160], 99.50th=[137364], 99.90th=[214959], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 126, per=25.46%, avg=50.41, stdev=21.18, samples=234 iops : min= 1, max= 31, avg=11.97, stdev= 5.33, samples=234 write: IOPS=12, BW=51.6KiB/s (52.9kB/s)(6236KiB/120803msec); 0 zone resets clat (usec): min=755, max=1081.2k, avg=40553.10, stdev=50931.55 lat (usec): min=757, max=1081.2k, avg=40558.90, stdev=50934.07 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1450], | 20.00th=[ 3949], 30.00th=[ 7767], 40.00th=[ 17695], | 50.00th=[ 28967], 60.00th=[ 40633], 70.00th=[ 52167], | 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[ 119014], | 99.00th=[ 181404], 99.50th=[ 223347], 99.90th=[ 591397], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 127, per=24.74%, avg=51.46, stdev=21.26, samples=236 iops : min= 1, max= 31, avg=12.23, stdev= 5.36, samples=236 lat (usec) : 50=0.78%, 100=5.05%, 250=0.49%, 500=0.03%, 750=0.16% lat (usec) : 1000=0.10% lat (msec) : 2=7.03%, 4=3.09%, 10=7.36%, 20=9.60%, 50=36.69% lat (msec) : 100=23.86%, 250=5.57%, 500=0.13%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=5.62%, ctx=6426, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=199KiB/s (204kB/s), 49.3KiB/s-50.9KiB/s (50.5kB/s-52.1kB/s), io=23.4MiB (24.6MB), run=118415-120803msec WRITE: bw=208KiB/s (213kB/s), 51.6KiB/s-52.9KiB/s (52.9kB/s-54.1kB/s), io=24.6MiB (25.7MB), run=118415-120803msec fio: pid=144970, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144970: Thu Jun 11 20:32:16 2026 read: IOPS=5, BW=22.8KiB/s (23.4kB/s)(5244KiB/229548msec) clat (msec): min=5, max=994, avg=36.39, stdev=46.07 lat (msec): min=5, max=994, avg=36.39, stdev=46.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 75], 95.00th=[ 106], | 99.00th=[ 167], 99.50th=[ 226], 99.90th=[ 642], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 88, per=28.03%, avg=25.78, stdev=17.20, samples=393 iops : min= 1, max= 22, avg= 5.85, stdev= 4.34, samples=393 write: IOPS=6, BW=24.0KiB/s (24.6kB/s)(5516KiB/229548msec); 0 zone resets clat (msec): min=38, max=618, avg=131.49, stdev=61.63 lat (msec): min=38, max=618, avg=131.50, stdev=61.64 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 176], 90.00th=[ 215], 95.00th=[ 251], | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 550], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 56, per=24.48%, avg=23.74, stdev=11.24, samples=448 iops : min= 1, max= 14, avg= 5.32, stdev= 2.87, samples=448 lat (msec) : 10=4.27%, 20=16.57%, 50=18.65%, 100=24.79%, 250=32.92% lat (msec) : 500=2.60%, 750=0.11%, 1000=0.04% cpu : usr=0.05%, sys=1.28%, ctx=4390, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1312,1379,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144972: Thu Jun 11 20:32:16 2026 read: IOPS=5, BW=23.8KiB/s (24.3kB/s)(5940KiB/250088msec) clat (msec): min=5, max=943, avg=32.12, stdev=37.10 lat (msec): min=5, max=943, avg=32.12, stdev=37.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 70], 95.00th=[ 89], | 99.00th=[ 153], 99.50th=[ 180], 99.90th=[ 211], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 87, per=29.16%, avg=26.82, stdev=17.69, samples=429 iops : min= 1, max= 21, avg= 6.10, stdev= 4.48, samples=429 write: IOPS=6, BW=25.4KiB/s (25.0kB/s)(6348KiB/250088msec); 0 zone resets clat (msec): min=33, max=615, avg=127.23, stdev=62.62 lat (msec): min=33, max=615, avg=127.24, stdev=62.63 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 130], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 209], 95.00th=[ 249], | 99.00th=[ 317], 99.50th=[ 363], 99.90th=[ 592], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 64, per=25.72%, avg=24.95, stdev=11.50, samples=491 iops : min= 1, max= 16, avg= 5.63, stdev= 2.95, samples=491 lat (msec) : 10=4.72%, 20=17.45%, 50=19.76%, 100=24.87%, 250=30.73% lat (msec) : 500=2.31%, 750=0.13%, 1000=0.03% cpu : usr=0.05%, sys=1.32%, ctx=5210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144974: Thu Jun 11 20:32:16 2026 read: IOPS=6, BW=24.1KiB/s (24.6kB/s)(6028KiB/250417msec) clat (msec): min=5, max=649, avg=34.34, stdev=37.04 lat (msec): min=5, max=649, avg=34.34, stdev=37.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 78], 95.00th=[ 101], | 99.00th=[ 163], 99.50th=[ 203], 99.90th=[ 397], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 111, per=28.30%, avg=26.04, stdev=17.58, samples=448 iops : min= 1, max= 27, avg= 5.90, stdev= 4.44, samples=448 write: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6260KiB/250417msec); 0 zone resets clat (msec): min=32, max=1172, avg=126.62, stdev=66.62 lat (msec): min=32, max=1172, avg=126.63, stdev=66.62 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 78], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 203], 95.00th=[ 247], | 99.00th=[ 334], 99.50th=[ 359], 99.90th=[ 514], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 71, per=25.48%, avg=24.71, stdev=11.79, samples=489 iops : min= 1, max= 17, avg= 5.57, stdev= 3.01, samples=489 lat (msec) : 10=4.59%, 20=17.64%, 50=19.01%, 100=25.52%, 250=30.73% lat (msec) : 500=2.41%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.31%, ctx=5063, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144976: Thu Jun 11 20:32:16 2026 read: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6052KiB/248206msec) clat (msec): min=4, max=374, avg=32.37, stdev=32.61 lat (msec): min=4, max=374, avg=32.37, stdev=32.61 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 92], | 99.00th=[ 165], 99.50th=[ 194], 99.90th=[ 342], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 95, per=29.51%, avg=27.15, stdev=17.51, samples=432 iops : min= 1, max= 23, avg= 6.19, stdev= 4.41, samples=432 write: IOPS=6, BW=25.1KiB/s (25.7kB/s)(6236KiB/248206msec); 0 zone resets clat (msec): min=34, max=1073, avg=127.50, stdev=68.08 lat (msec): min=34, max=1073, avg=127.50, stdev=68.08 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 211], 95.00th=[ 253], | 99.00th=[ 347], 99.50th=[ 388], 99.90th=[ 575], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 64, per=25.52%, avg=24.76, stdev=11.68, samples=486 iops : min= 1, max= 16, avg= 5.58, stdev= 2.99, samples=486 lat (msec) : 10=4.69%, 20=18.00%, 50=19.40%, 100=26.37%, 250=28.68% lat (msec) : 500=2.80%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.35%, ctx=5226, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=92.9KiB/s (95.1kB/s), 22.8KiB/s-24.4KiB/s (23.4kB/s-24.0kB/s), io=22.7MiB (23.8MB), run=229548-250417msec WRITE: bw=97.3KiB/s (99.6kB/s), 24.0KiB/s-25.4KiB/s (24.6kB/s-25.0kB/s), io=23.8MiB (24.9MB), run=229548-250417msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145039: Thu Jun 11 20:32:57 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(5920KiB/29749msec) clat (usec): min=36, max=247738, avg=41716.39, stdev=37838.82 lat (usec): min=36, max=247739, avg=41717.83, stdev=37838.72 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 91], | 30.00th=[ 21890], 40.00th=[ 29754], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 53216], 80.00th=[ 63177], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[168821], 99.50th=[191890], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 91, max= 378, per=24.13%, avg=194.22, stdev=73.31, samples=58 iops : min= 5, max= 23, avg=11.40, stdev= 4.65, samples=58 write: IOPS=13, BW=214KiB/s (219kB/s)(6368KiB/29749msec); 0 zone resets clat (usec): min=1366, max=205951, avg=35473.37, stdev=35609.57 lat (usec): min=1368, max=205954, avg=35475.49, stdev=35609.52 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1860], 10.00th=[ 2966], 20.00th=[ 5866], | 30.00th=[ 8160], 40.00th=[ 14222], 50.00th=[ 23725], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 63177], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[158335], 99.50th=[170918], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 380, per=25.29%, avg=214.23, stdev=84.48, samples=57 iops : min= 1, max= 23, avg=12.67, stdev= 5.34, samples=57 lat (usec) : 50=1.95%, 100=7.94%, 250=1.04%, 750=0.26%, 1000=0.26% lat (msec) : 2=3.65%, 4=4.04%, 10=10.68%, 20=8.07%, 50=32.16% lat (msec) : 100=23.44%, 250=6.51% cpu : usr=0.10%, sys=5.92%, ctx=1475, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145040: Thu Jun 11 20:32:57 2026 read: IOPS=12, BW=202KiB/s (206kB/s)(5744KiB/28489msec) clat (usec): min=37, max=213013, avg=42137.09, stdev=35844.83 lat (usec): min=37, max=213015, avg=42139.60, stdev=35845.04 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 104], | 30.00th=[ 22938], 40.00th=[ 32637], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[181404], 99.50th=[208667], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 384, per=25.06%, avg=201.75, stdev=71.68, samples=56 iops : min= 1, max= 24, avg=11.86, stdev= 4.53, samples=56 write: IOPS=14, BW=230KiB/s (235kB/s)(6544KiB/28489msec); 0 zone resets clat (usec): min=1352, max=262601, avg=32203.60, stdev=35233.96 lat (usec): min=1354, max=262604, avg=32205.84, stdev=35233.97 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1844], 10.00th=[ 2008], 20.00th=[ 5145], | 30.00th=[ 8586], 40.00th=[ 12911], 50.00th=[ 19792], 60.00th=[ 28967], | 70.00th=[ 41681], 80.00th=[ 54264], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[143655], 99.50th=[160433], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 63, max= 413, per=27.57%, avg=233.49, stdev=89.97, samples=55 iops : min= 3, max= 25, avg=13.87, stdev= 5.68, samples=55 lat (usec) : 50=1.30%, 100=7.94%, 250=0.39%, 500=0.13% lat (msec) : 2=5.34%, 4=3.26%, 10=9.77%, 20=11.20%, 50=31.51% lat (msec) : 100=23.96%, 250=5.08%, 500=0.13% cpu : usr=0.08%, sys=6.13%, ctx=1434, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145041: Thu Jun 11 20:32:57 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29559msec) clat (usec): min=36, max=305259, avg=38712.80, stdev=38250.86 lat (usec): min=36, max=305261, avg=38720.28, stdev=38251.72 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 48], 10.00th=[ 57], 20.00th=[ 70], | 30.00th=[ 16909], 40.00th=[ 27395], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[185598], 99.50th=[229639], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 608, per=26.83%, avg=215.98, stdev=92.41, samples=57 iops : min= 1, max= 38, avg=12.77, stdev= 5.86, samples=57 write: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29559msec); 0 zone resets clat (usec): min=1210, max=344993, avg=37738.86, stdev=41409.40 lat (usec): min=1211, max=344996, avg=37740.99, stdev=41409.53 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1909], 10.00th=[ 3032], 20.00th=[ 5932], | 30.00th=[ 9765], 40.00th=[ 16450], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[191890], 99.50th=[258999], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 440, per=23.90%, avg=202.41, stdev=92.89, samples=58 iops : min= 1, max= 27, avg=11.91, stdev= 5.88, samples=58 lat (usec) : 50=2.86%, 100=10.16%, 250=0.26%, 500=0.52% lat (msec) : 2=3.26%, 4=3.78%, 10=8.59%, 20=7.29%, 50=33.46% lat (msec) : 100=24.09%, 250=5.34%, 500=0.39% cpu : usr=0.09%, sys=5.51%, ctx=1376, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145042: Thu Jun 11 20:32:57 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(6032KiB/29262msec) clat (usec): min=35, max=213841, avg=40249.27, stdev=36240.57 lat (usec): min=35, max=213842, avg=40250.57, stdev=36240.57 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 87], | 30.00th=[ 20317], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[170918], 99.50th=[200279], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 471, per=25.34%, avg=204.02, stdev=85.08, samples=57 iops : min= 1, max= 29, avg=12.04, stdev= 5.46, samples=57 write: IOPS=13, BW=214KiB/s (219kB/s)(6256KiB/29262msec); 0 zone resets clat (usec): min=1302, max=410865, avg=35873.56, stdev=42563.57 lat (usec): min=1304, max=410868, avg=35882.58, stdev=42561.18 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1827], 10.00th=[ 2278], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[ 13042], 50.00th=[ 20841], 60.00th=[ 31065], | 70.00th=[ 45876], 80.00th=[ 61080], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[193987], 99.50th=[214959], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 31, max= 448, per=25.09%, avg=212.49, stdev=78.86, samples=57 iops : min= 1, max= 28, avg=12.56, stdev= 5.04, samples=57 lat (usec) : 50=2.08%, 100=8.20%, 250=0.52%, 500=0.26% lat (msec) : 2=4.69%, 4=4.56%, 10=8.20%, 20=11.33%, 50=30.34% lat (msec) : 100=23.57%, 250=6.12%, 500=0.13% cpu : usr=0.09%, sys=5.62%, ctx=1433, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=805KiB/s (824kB/s), 199KiB/s-212KiB/s (204kB/s-217kB/s), io=23.4MiB (24.5MB), run=28489-29749msec WRITE: bw=847KiB/s (867kB/s), 204KiB/s-230KiB/s (209kB/s-235kB/s), io=24.6MiB (25.8MB), run=28489-29749msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145044: Thu Jun 11 20:33:45 2026 read: IOPS=4, BW=77.1KiB/s (78.9kB/s)(5920KiB/76827msec) clat (msec): min=6, max=291, avg=40.40, stdev=36.16 lat (msec): min=6, max=291, avg=40.40, stdev=36.16 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 180], 99.50th=[ 239], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 29, max= 345, per=28.02%, avg=86.31, stdev=56.05, samples=134 iops : min= 1, max= 21, avg= 4.63, stdev= 3.57, samples=134 write: IOPS=5, BW=82.9KiB/s (84.9kB/s)(6368KiB/76827msec); 0 zone resets clat (msec): min=42, max=454, avg=155.35, stdev=68.21 lat (msec): min=42, max=454, avg=155.35, stdev=68.21 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 77], 20.00th=[ 96], | 30.00th=[ 115], 40.00th=[ 129], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 209], 90.00th=[ 249], 95.00th=[ 279], | 99.00th=[ 393], 99.50th=[ 451], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 26, max= 192, per=25.59%, avg=82.90, stdev=37.77, samples=150 iops : min= 1, max= 12, avg= 4.41, stdev= 2.45, samples=150 lat (msec) : 10=1.56%, 20=12.89%, 50=23.70%, 100=17.71%, 250=38.93% lat (msec) : 500=5.21% cpu : usr=0.04%, sys=1.32%, ctx=1289, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145045: Thu Jun 11 20:33:45 2026 read: IOPS=4, BW=73.9KiB/s (75.7kB/s)(5744KiB/77727msec) clat (msec): min=6, max=264, avg=42.74, stdev=42.06 lat (msec): min=6, max=264, avg=42.75, stdev=42.06 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 100], 95.00th=[ 131], | 99.00th=[ 205], 99.50th=[ 251], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 26, max= 256, per=28.12%, avg=86.60, stdev=56.73, samples=129 iops : min= 1, max= 16, avg= 4.65, stdev= 3.63, samples=129 write: IOPS=5, BW=84.2KiB/s (86.2kB/s)(6544KiB/77727msec); 0 zone resets clat (msec): min=32, max=441, avg=152.40, stdev=69.84 lat (msec): min=32, max=441, avg=152.40, stdev=69.84 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 97], | 30.00th=[ 110], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 161], | 70.00th=[ 178], 80.00th=[ 199], 90.00th=[ 247], 95.00th=[ 288], | 99.00th=[ 397], 99.50th=[ 418], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 29, max= 224, per=26.08%, avg=84.50, stdev=39.34, samples=151 iops : min= 1, max= 14, avg= 4.50, stdev= 2.52, samples=151 lat (msec) : 10=1.82%, 20=12.76%, 50=21.35%, 100=18.23%, 250=40.62% lat (msec) : 500=5.21% cpu : usr=0.04%, sys=1.26%, ctx=1305, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145046: Thu Jun 11 20:33:45 2026 read: IOPS=5, BW=83.6KiB/s (85.6kB/s)(6256KiB/74804msec) clat (msec): min=6, max=212, avg=39.10, stdev=32.84 lat (msec): min=6, max=212, avg=39.10, stdev=32.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 104], | 99.00th=[ 190], 99.50th=[ 207], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 29, max= 319, per=31.02%, avg=95.53, stdev=61.75, samples=129 iops : min= 1, max= 19, avg= 5.20, stdev= 3.91, samples=129 write: IOPS=5, BW=80.6KiB/s (82.6kB/s)(6032KiB/74804msec); 0 zone resets clat (msec): min=40, max=461, avg=157.71, stdev=68.69 lat (msec): min=40, max=461, avg=157.71, stdev=68.69 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 82], 20.00th=[ 104], | 30.00th=[ 118], 40.00th=[ 129], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 180], 80.00th=[ 203], 90.00th=[ 255], 95.00th=[ 292], | 99.00th=[ 380], 99.50th=[ 443], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 29, max= 224, per=24.87%, avg=80.58, stdev=34.98, samples=146 iops : min= 1, max= 14, avg= 4.25, stdev= 2.30, samples=146 lat (msec) : 10=1.56%, 20=12.11%, 50=26.17%, 100=17.32%, 250=37.37% lat (msec) : 500=5.47% cpu : usr=0.03%, sys=1.24%, ctx=1326, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145047: Thu Jun 11 20:33:45 2026 read: IOPS=4, BW=78.5KiB/s (80.3kB/s)(6032KiB/76884msec) clat (msec): min=5, max=290, avg=39.97, stdev=39.25 lat (msec): min=5, max=290, avg=39.98, stdev=39.25 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 81], 95.00th=[ 130], | 99.00th=[ 192], 99.50th=[ 243], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 29, max= 319, per=30.40%, avg=93.62, stdev=61.88, samples=125 iops : min= 1, max= 19, avg= 5.09, stdev= 3.91, samples=125 write: IOPS=5, BW=81.4KiB/s (83.3kB/s)(6256KiB/76884msec); 0 zone resets clat (msec): min=41, max=521, avg=157.98, stdev=69.80 lat (msec): min=41, max=521, avg=157.98, stdev=69.80 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 100], | 30.00th=[ 114], 40.00th=[ 133], 50.00th=[ 150], 60.00th=[ 167], | 70.00th=[ 188], 80.00th=[ 211], 90.00th=[ 241], 95.00th=[ 268], | 99.00th=[ 426], 99.50th=[ 489], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 31, max= 224, per=25.04%, avg=81.12, stdev=36.74, samples=150 iops : min= 1, max= 14, avg= 4.29, stdev= 2.39, samples=150 lat (msec) : 10=1.69%, 20=13.93%, 50=24.35%, 100=16.02%, 250=39.19% lat (msec) : 500=4.69%, 750=0.13% cpu : usr=0.04%, sys=1.29%, ctx=1294, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=308KiB/s (316kB/s), 73.9KiB/s-83.6KiB/s (75.7kB/s-85.6kB/s), io=23.4MiB (24.5MB), run=74804-77727msec WRITE: bw=324KiB/s (332kB/s), 80.6KiB/s-84.2KiB/s (82.6kB/s-86.2kB/s), io=24.6MiB (25.8MB), run=74804-77727msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145070: Thu Jun 11 20:34:03 2026 read: IOPS=1, BW=1209KiB/s (1238kB/s)(7168KiB/5928msec) clat (usec): min=634, max=2978.2k, avg=534760.90, stdev=1081272.78 lat (usec): min=635, max=2978.2k, avg=534762.39, stdev=1081273.19 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], | 20.00th=[ 6587], 30.00th=[ 143655], 40.00th=[ 143655], | 50.00th=[ 185598], 60.00th=[ 206570], 70.00th=[ 206570], | 80.00th=[ 221250], 90.00th=[2969568], 95.00th=[2969568], | 99.00th=[2969568], 99.50th=[2969568], 99.90th=[2969568], | 99.95th=[2969568], 99.99th=[2969568] bw ( KiB/s): min= 2015, max= 3915, per=100.00%, avg=2959.75, stdev=1081.79, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=864KiB/s (884kB/s)(5120KiB/5928msec); 0 zone resets clat (msec): min=195, max=610, avg=409.76, stdev=171.08 lat (msec): min=196, max=610, avg=409.84, stdev=171.08 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1976, max= 4031, per=69.03%, avg=2682.00, stdev=1168.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.08%, sys=6.90%, ctx=576, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145071: Thu Jun 11 20:34:03 2026 read: IOPS=0, BW=278KiB/s (284kB/s)(2048KiB/7380msec) clat (msec): min=282, max=433, avg=358.14, stdev=106.90 lat (msec): min=282, max=433, avg=358.14, stdev=106.90 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1462, max= 2015, per=62.65%, avg=1738.50, stdev=391.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1388KiB/s (1421kB/s)(10.0MiB/7380msec); 0 zone resets clat (msec): min=90, max=3330, avg=637.64, stdev=968.06 lat (msec): min=90, max=3330, avg=638.00, stdev=968.22 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 167], | 30.00th=[ 190], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 363], | 70.00th=[ 418], 80.00th=[ 550], 90.00th=[ 785], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1976, max= 4079, per=92.91%, avg=3609.60, stdev=915.45, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=6.33%, ctx=150, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Thu Jun 11 20:34:03 2026 read: IOPS=1, BW=1044KiB/s (1069kB/s)(6144KiB/5887msec) clat (usec): min=477, max=360190, avg=114578.57, stdev=159989.52 lat (usec): min=479, max=360191, avg=114579.91, stdev=159989.65 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 3425], | 30.00th=[ 3425], 40.00th=[ 14877], 50.00th=[ 14877], 60.00th=[ 33424], | 70.00th=[274727], 80.00th=[274727], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 1976, max= 5873, per=100.00%, avg=3288.00, stdev=2238.76, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1044KiB/s (1069kB/s)(6144KiB/5887msec); 0 zone resets clat (msec): min=163, max=3598, avg=805.48, stdev=1370.44 lat (msec): min=163, max=3598, avg=806.10, stdev=1370.17 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 247], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1551, max= 3915, per=61.18%, avg=2377.00, stdev=1049.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 20=8.33%, 50=8.33%, 250=33.33%, 500=25.00% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.81%, ctx=128, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Thu Jun 11 20:34:03 2026 read: IOPS=0, BW=776KiB/s (794kB/s)(5120KiB/6602msec) clat (usec): min=342, max=695392, avg=206058.32, stdev=286306.04 lat (usec): min=344, max=695393, avg=206059.71, stdev=286306.04 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 343], 10.00th=[ 343], 20.00th=[ 343], | 30.00th=[ 1516], 40.00th=[ 1516], 50.00th=[141558], 60.00th=[141558], | 70.00th=[189793], 80.00th=[189793], 90.00th=[692061], 95.00th=[692061], | 99.00th=[692061], 99.50th=[692061], 99.90th=[692061], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 3953, max= 4031, per=100.00%, avg=3992.00, stdev=55.15, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1086KiB/s (1112kB/s)(7168KiB/6602msec); 0 zone resets clat (msec): min=151, max=3164, avg=744.47, stdev=1078.77 lat (msec): min=152, max=3164, avg=744.55, stdev=1078.79 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 194], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 334], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 600], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1514, max= 3605, per=57.00%, avg=2214.60, stdev=804.33, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.45%, ctx=133, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2775KiB/s (2842kB/s), 278KiB/s-1209KiB/s (284kB/s-1238kB/s), io=20.0MiB (20.0MB), run=5887-7380msec WRITE: bw=3885KiB/s (3978kB/s), 864KiB/s-1388KiB/s (884kB/s-1421kB/s), io=28.0MiB (29.4MB), run=5887-7380msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145066: Thu Jun 11 20:34:03 2026 read: IOPS=1, BW=1148KiB/s (1175kB/s)(7168KiB/6246msec) clat (msec): min=86, max=3057, avg=622.61, stdev=1081.42 lat (msec): min=86, max=3057, avg=622.61, stdev=1081.42 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 114], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 213], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 447], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1404, max= 3992, per=85.68%, avg=2276.40, stdev=993.62, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=820KiB/s (839kB/s)(5120KiB/6246msec); 0 zone resets clat (msec): min=283, max=401, avg=355.79, stdev=54.76 lat (msec): min=283, max=401, avg=355.88, stdev=54.75 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1910, max= 3849, per=66.00%, avg=2455.25, stdev=930.94, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.62%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145067: Thu Jun 11 20:34:04 2026 read: IOPS=0, BW=280KiB/s (287kB/s)(2048KiB/7305msec) clat (msec): min=124, max=281, avg=202.97, stdev=111.45 lat (msec): min=124, max=281, avg=202.97, stdev=111.45 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1391, max= 1924, per=62.38%, avg=1657.50, stdev=376.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1402KiB/s (1435kB/s)(10.0MiB/7305msec); 0 zone resets clat (msec): min=204, max=3275, avg=656.46, stdev=942.58 lat (msec): min=205, max=3275, avg=656.88, stdev=942.68 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 207], | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 292], 60.00th=[ 342], | 70.00th=[ 359], 80.00th=[ 430], 90.00th=[ 911], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1910, max= 4047, per=62.41%, avg=2321.67, stdev=846.28, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=25.00%, 500=58.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.20%, ctx=80, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145068: Thu Jun 11 20:34:04 2026 read: IOPS=0, BW=916KiB/s (938kB/s)(6144KiB/6704msec) clat (msec): min=109, max=337, avg=200.82, stdev=87.25 lat (msec): min=109, max=337, avg=200.83, stdev=87.25 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 215], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1910, max= 3849, per=91.79%, avg=2438.75, stdev=941.30, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=916KiB/s (938kB/s)(6144KiB/6704msec); 0 zone resets clat (msec): min=209, max=3635, avg=874.44, stdev=1357.46 lat (msec): min=211, max=3635, avg=876.55, stdev=1356.53 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 401], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1910, max= 2824, per=58.67%, avg=2182.50, stdev=430.16, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=2.30%, ctx=81, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145069: Thu Jun 11 20:34:04 2026 read: IOPS=0, BW=664KiB/s (680kB/s)(5120KiB/7707msec) clat (msec): min=47, max=516, avg=267.92, stdev=193.77 lat (msec): min=47, max=516, avg=267.93, stdev=193.77 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1973, max= 3930, per=99.59%, avg=2646.00, stdev=1112.41, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=930KiB/s (952kB/s)(7168KiB/7707msec); 0 zone resets clat (msec): min=180, max=4303, avg=868.00, stdev=1518.40 lat (msec): min=180, max=4303, avg=868.10, stdev=1518.41 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 220], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 264], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 439], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 1387, max= 3820, per=61.60%, avg=2291.50, stdev=1057.56, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.26%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2657KiB/s (2721kB/s), 280KiB/s-1148KiB/s (287kB/s-1175kB/s), io=20.0MiB (20.0MB), run=6246-7707msec WRITE: bw=3720KiB/s (3810kB/s), 820KiB/s-1402KiB/s (839kB/s-1435kB/s), io=28.0MiB (29.4MB), run=6246-7707msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145081: Thu Jun 11 20:34:19 2026 read: IOPS=0, BW=4073KiB/s (4171kB/s)(12.0MiB/3017msec) clat (msec): min=894, max=1034, avg=944.54, stdev=77.80 lat (msec): min=894, max=1034, avg=944.54, stdev=77.80 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8094, max= 8110, per=100.00%, avg=8102.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.48%, ctx=194, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145082: Thu Jun 11 20:34:19 2026 read: IOPS=0, BW=1226KiB/s (1255kB/s)(4096KiB/3341msec) clat (nsec): min=1052.3M, max=1052.3M, avg=1052301093.00, stdev= 0.00 lat (nsec): min=1052.3M, max=1052.3M, avg=1052303921.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2452KiB/s (2511kB/s)(8192KiB/3341msec); 0 zone resets clat (msec): min=493, max=1593, avg=1043.64, stdev=777.57 lat (msec): min=496, max=1594, avg=1045.14, stdev=776.50 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8047, max= 8047, per=82.05%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.06%, sys=4.79%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145083: Thu Jun 11 20:34:19 2026 write: IOPS=1, BW=6582KiB/s (6740kB/s)(12.0MiB/1867msec); 0 zone resets clat (msec): min=482, max=650, avg=550.62, stdev=88.47 lat (msec): min=482, max=650, avg=551.00, stdev=88.43 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7801, max= 8159, per=81.37%, avg=7980.00, stdev=253.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=7.02%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145085: Thu Jun 11 20:34:19 2026 write: IOPS=1, BW=4985KiB/s (5105kB/s)(12.0MiB/2465msec); 0 zone resets clat (msec): min=470, max=1240, avg=789.43, stdev=401.74 lat (msec): min=476, max=1240, avg=791.71, stdev=399.50 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7816, max= 8094, per=81.12%, avg=7955.00, stdev=196.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.14%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4904KiB/s (5022kB/s), 1226KiB/s-4073KiB/s (1255kB/s-4171kB/s), io=16.0MiB (16.8MB), run=3017-3341msec WRITE: bw=9808KiB/s (10.0MB/s), 2452KiB/s-6582KiB/s (2511kB/s-6740kB/s), io=32.0MiB (33.6MB), run=1867-3341msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145084: Thu Jun 11 20:34:19 2026 read: IOPS=0, BW=2889KiB/s (2959kB/s)(12.0MiB/4253msec) clat (msec): min=376, max=1902, avg=1301.44, stdev=812.46 lat (msec): min=376, max=1902, avg=1301.44, stdev=812.46 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.21%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145086: Thu Jun 11 20:34:19 2026 read: IOPS=0, BW=982KiB/s (1005kB/s)(4096KiB/4172msec) clat (nsec): min=1378.8M, max=1378.8M, avg=1378850454.00, stdev= 0.00 lat (nsec): min=1378.9M, max=1378.9M, avg=1378853242.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1964KiB/s (2011kB/s)(8192KiB/4172msec); 0 zone resets clat (msec): min=332, max=2255, avg=1294.22, stdev=1360.14 lat (msec): min=333, max=2257, avg=1295.36, stdev=1360.03 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.09%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145087: Thu Jun 11 20:34:19 2026 write: IOPS=0, BW=3157KiB/s (3233kB/s)(12.0MiB/3892msec); 0 zone resets clat (msec): min=1031, max=1401, avg=1262.58, stdev=201.45 lat (msec): min=1031, max=1402, avg=1262.98, stdev=201.46 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=4.27%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145088: Thu Jun 11 20:34:19 2026 write: IOPS=1, BW=4556KiB/s (4666kB/s)(12.0MiB/2697msec); 0 zone resets clat (msec): min=621, max=941, avg=789.38, stdev=160.56 lat (msec): min=621, max=946, avg=791.53, stdev=163.02 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8062, max= 8143, per=100.00%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=3.19%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3852KiB/s (3945kB/s), 982KiB/s-2889KiB/s (1005kB/s-2959kB/s), io=16.0MiB (16.8MB), run=4172-4253msec WRITE: bw=7854KiB/s (8043kB/s), 1964KiB/s-4556KiB/s (2011kB/s-4666kB/s), io=32.0MiB (33.6MB), run=2697-4172msec