== sanity test 398b: DIO and buffer IO race ============== 15:39:40 (1780342780) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.54223 s, 14.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146000: Mon Jun 1 15:41:54 2026 read: IOPS=12, BW=49.0KiB/s (50.2kB/s)(5992KiB/122214msec) clat (usec): min=35, max=818886, avg=41698.16, stdev=59313.30 lat (usec): min=35, max=818888, avg=41703.47, stdev=59313.95 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 506], 20.00th=[ 13042], | 30.00th=[ 16712], 40.00th=[ 21103], 50.00th=[ 26608], 60.00th=[ 32900], | 70.00th=[ 42206], 80.00th=[ 56361], 90.00th=[ 88605], 95.00th=[122160], | 99.00th=[267387], 99.50th=[429917], 99.90th=[692061], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 5, max= 159, per=26.21%, avg=51.36, stdev=33.06, samples=228 iops : min= 1, max= 39, avg=12.25, stdev= 8.32, samples=228 write: IOPS=12, BW=51.5KiB/s (52.8kB/s)(6296KiB/122214msec); 0 zone resets clat (usec): min=1065, max=861571, avg=37733.34, stdev=54370.52 lat (usec): min=1066, max=861572, avg=37738.14, stdev=54369.66 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1565], 10.00th=[ 2442], 20.00th=[ 4555], | 30.00th=[ 8848], 40.00th=[ 15664], 50.00th=[ 22414], 60.00th=[ 30540], | 70.00th=[ 39060], 80.00th=[ 54789], 90.00th=[ 91751], 95.00th=[129500], | 99.00th=[227541], 99.50th=[329253], 99.90th=[641729], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 5, max= 184, per=26.09%, avg=53.48, stdev=36.39, samples=230 iops : min= 1, max= 46, avg=12.78, stdev= 9.17, samples=230 lat (usec) : 50=0.39%, 100=3.45%, 250=0.88%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=3.61%, 4=5.83%, 10=8.24%, 20=19.73%, 50=34.18% lat (msec) : 100=15.30%, 250=7.23%, 500=0.62%, 750=0.23%, 1000=0.07% cpu : usr=0.09%, sys=7.51%, ctx=7158, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146002: Mon Jun 1 15:41:54 2026 read: IOPS=12, BW=48.7KiB/s (49.9kB/s)(5940KiB/121874msec) clat (usec): min=30, max=842890, avg=40017.73, stdev=51549.87 lat (usec): min=30, max=842892, avg=40019.83, stdev=51549.37 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 84], 10.00th=[ 9110], 20.00th=[ 13566], | 30.00th=[ 17171], 40.00th=[ 21365], 50.00th=[ 25822], 60.00th=[ 32113], | 70.00th=[ 39584], 80.00th=[ 54264], 90.00th=[ 84411], 95.00th=[119014], | 99.00th=[219153], 99.50th=[295699], 99.90th=[549454], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 5, max= 136, per=25.70%, avg=50.38, stdev=35.09, samples=231 iops : min= 1, max= 34, avg=12.00, stdev= 8.84, samples=231 write: IOPS=13, BW=52.1KiB/s (53.3kB/s)(6348KiB/121874msec); 0 zone resets clat (usec): min=1108, max=923434, avg=39120.56, stdev=61546.82 lat (usec): min=1110, max=923435, avg=39122.38, stdev=61546.77 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1549], 10.00th=[ 2507], 20.00th=[ 4490], | 30.00th=[ 8717], 40.00th=[ 14877], 50.00th=[ 21103], 60.00th=[ 28443], | 70.00th=[ 36963], 80.00th=[ 55313], 90.00th=[ 96994], 95.00th=[133694], | 99.00th=[265290], 99.50th=[379585], 99.90th=[658506], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 5, max= 183, per=25.93%, avg=53.16, stdev=39.65, samples=234 iops : min= 1, max= 45, avg=12.71, stdev= 9.99, samples=234 lat (usec) : 50=0.52%, 100=2.25%, 250=0.62%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.94%, 4=5.27%, 10=9.34%, 20=20.67%, 50=34.77% lat (msec) : 100=14.19%, 250=7.19%, 500=0.75%, 750=0.20%, 1000=0.07% cpu : usr=0.07%, sys=7.80%, ctx=7295, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146004: Mon Jun 1 15:41:54 2026 read: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6028KiB/119519msec) clat (usec): min=26, max=611616, avg=38766.12, stdev=50996.93 lat (usec): min=27, max=611617, avg=38767.74, stdev=50996.96 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 82], 10.00th=[ 8291], 20.00th=[ 13304], | 30.00th=[ 16909], 40.00th=[ 20579], 50.00th=[ 24773], 60.00th=[ 31327], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 83362], 95.00th=[110625], | 99.00th=[244319], 99.50th=[387974], 99.90th=[566232], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 6, max= 167, per=26.80%, avg=52.52, stdev=36.37, samples=225 iops : min= 1, max= 41, avg=12.53, stdev= 9.15, samples=225 write: IOPS=13, BW=52.4KiB/s (53.6kB/s)(6260KiB/119519msec); 0 zone resets clat (usec): min=1099, max=1075.4k, avg=38823.58, stdev=64096.60 lat (usec): min=1100, max=1075.4k, avg=38826.55, stdev=64096.16 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1680], 10.00th=[ 2540], | 20.00th=[ 4490], 30.00th=[ 8586], 40.00th=[ 14877], | 50.00th=[ 21365], 60.00th=[ 29230], 70.00th=[ 39584], | 80.00th=[ 54264], 90.00th=[ 91751], 95.00th=[ 143655], | 99.00th=[ 244319], 99.50th=[ 278922], 99.90th=[ 985662], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 197, per=26.60%, avg=54.53, stdev=37.27, samples=225 iops : min= 1, max= 49, avg=13.04, stdev= 9.41, samples=225 lat (usec) : 50=0.36%, 100=2.67%, 250=0.94%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=3.55%, 4=5.53%, 10=8.98%, 20=20.77%, 50=35.38% lat (msec) : 100=13.70%, 250=6.90%, 500=0.62%, 750=0.16%, 1000=0.07% lat (msec) : 2000=0.03% cpu : usr=0.09%, sys=7.81%, ctx=7274, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146006: Mon Jun 1 15:41:54 2026 read: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6052KiB/122324msec) clat (usec): min=32, max=1133.6k, avg=40892.02, stdev=62528.70 lat (usec): min=33, max=1133.6k, avg=40894.59, stdev=62528.72 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 74], 10.00th=[ 8979], | 20.00th=[ 13698], 30.00th=[ 16909], 40.00th=[ 21365], | 50.00th=[ 26608], 60.00th=[ 31851], 70.00th=[ 39584], | 80.00th=[ 52691], 90.00th=[ 87557], 95.00th=[ 117965], | 99.00th=[ 221250], 99.50th=[ 446694], 99.90th=[ 851444], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 160, per=26.18%, avg=51.32, stdev=34.94, samples=230 iops : min= 1, max= 40, avg=12.23, stdev= 8.81, samples=230 write: IOPS=12, BW=50.0KiB/s (52.2kB/s)(6236KiB/122324msec); 0 zone resets clat (usec): min=1085, max=781045, avg=38555.25, stdev=53492.01 lat (usec): min=1086, max=781047, avg=38557.09, stdev=53492.00 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1549], 10.00th=[ 2474], 20.00th=[ 4490], | 30.00th=[ 8979], 40.00th=[ 15270], 50.00th=[ 21365], 60.00th=[ 29230], | 70.00th=[ 40633], 80.00th=[ 56886], 90.00th=[ 98042], 95.00th=[135267], | 99.00th=[244319], 99.50th=[299893], 99.90th=[501220], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 6, max= 167, per=25.91%, avg=53.11, stdev=36.45, samples=229 iops : min= 1, max= 41, avg=12.69, stdev= 9.18, samples=229 lat (usec) : 50=0.33%, 100=2.93%, 250=0.81%, 500=0.07%, 750=0.03% lat (msec) : 2=3.97%, 4=5.11%, 10=8.24%, 20=20.90%, 50=35.06% lat (msec) : 100=13.77%, 250=7.91%, 500=0.65%, 750=0.10%, 1000=0.10% lat (msec) : 2000=0.03% cpu : usr=0.08%, sys=7.77%, ctx=7155, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=196KiB/s (201kB/s), 48.7KiB/s-50.4KiB/s (49.9kB/s-51.6kB/s), io=23.4MiB (24.6MB), run=119519-122324msec WRITE: bw=206KiB/s (210kB/s), 50.0KiB/s-52.4KiB/s (52.2kB/s-53.6kB/s), io=24.6MiB (25.7MB), run=119519-122324msec fio: pid=146007, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146001: Mon Jun 1 15:44:18 2026 read: IOPS=5, BW=22.7KiB/s (23.2kB/s)(5992KiB/264262msec) clat (msec): min=5, max=834, avg=38.44, stdev=50.61 lat (msec): min=5, max=834, avg=38.44, stdev=50.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 64], 95.00th=[ 94], | 99.00th=[ 275], 99.50th=[ 342], 99.90th=[ 634], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 5, max= 103, per=31.91%, avg=26.49, stdev=16.43, samples=438 iops : min= 1, max= 25, avg= 6.02, stdev= 4.14, samples=438 write: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6296KiB/264262msec); 0 zone resets clat (msec): min=32, max=1215, avg=131.09, stdev=98.44 lat (msec): min=32, max=1215, avg=131.10, stdev=98.44 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 117], | 70.00th=[ 133], 80.00th=[ 157], 90.00th=[ 220], 95.00th=[ 309], | 99.00th=[ 514], 99.50th=[ 659], 99.90th=[ 1133], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 5, max= 56, per=27.98%, avg=24.34, stdev=11.67, samples=499 iops : min= 1, max= 14, avg= 5.48, stdev= 2.99, samples=499 lat (msec) : 10=1.82%, 20=13.96%, 50=25.36%, 100=28.97%, 250=25.55% lat (msec) : 500=3.55%, 750=0.55%, 1000=0.13%, 2000=0.10% cpu : usr=0.04%, sys=1.78%, ctx=5924, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146003: Mon Jun 1 15:44:18 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(5940KiB/266441msec) clat (msec): min=5, max=985, avg=40.15, stdev=57.60 lat (msec): min=5, max=985, avg=40.16, stdev=57.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 68], 95.00th=[ 109], | 99.00th=[ 243], 99.50th=[ 359], 99.90th=[ 869], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 5, max= 79, per=31.50%, avg=26.14, stdev=16.40, samples=440 iops : min= 1, max= 19, avg= 5.94, stdev= 4.12, samples=440 write: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6348KiB/266441msec); 0 zone resets clat (msec): min=36, max=989, avg=130.09, stdev=93.93 lat (msec): min=36, max=989, avg=130.09, stdev=93.93 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 85], 40.00th=[ 94], 50.00th=[ 104], 60.00th=[ 116], | 70.00th=[ 133], 80.00th=[ 157], 90.00th=[ 213], 95.00th=[ 309], | 99.00th=[ 514], 99.50th=[ 701], 99.90th=[ 961], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 5, max= 56, per=28.20%, avg=24.53, stdev=11.42, samples=500 iops : min= 1, max= 14, avg= 5.53, stdev= 2.92, samples=500 lat (msec) : 10=1.73%, 20=13.35%, 50=25.29%, 100=28.94%, 250=26.56% lat (msec) : 500=3.35%, 750=0.46%, 1000=0.33% cpu : usr=0.04%, sys=1.77%, ctx=5917, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146005: Mon Jun 1 15:44:18 2026 read: IOPS=5, BW=22.8KiB/s (23.4kB/s)(6028KiB/264016msec) clat (msec): min=5, max=710, avg=37.02, stdev=41.99 lat (msec): min=5, max=710, avg=37.02, stdev=41.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 64], 95.00th=[ 100], | 99.00th=[ 182], 99.50th=[ 255], 99.90th=[ 592], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 5, max= 79, per=31.51%, avg=26.16, stdev=16.87, samples=446 iops : min= 1, max= 19, avg= 5.95, stdev= 4.26, samples=446 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6260KiB/264016msec); 0 zone resets clat (msec): min=37, max=1107, avg=132.83, stdev=97.49 lat (msec): min=37, max=1107, avg=132.83, stdev=97.49 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 85], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 120], | 70.00th=[ 136], 80.00th=[ 159], 90.00th=[ 222], 95.00th=[ 326], | 99.00th=[ 518], 99.50th=[ 659], 99.90th=[ 961], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 5, max= 56, per=27.55%, avg=23.97, stdev=11.57, samples=504 iops : min= 1, max= 14, avg= 5.39, stdev= 2.96, samples=504 lat (msec) : 10=1.63%, 20=14.19%, 50=26.46%, 100=27.83%, 250=25.13% lat (msec) : 500=4.10%, 750=0.49%, 1000=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.78%, ctx=5778, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146007: Mon Jun 1 15:44:18 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(4408KiB/205949msec) clat (msec): min=5, max=650, avg=41.74, stdev=53.80 lat (msec): min=5, max=650, avg=41.74, stdev=53.80 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 80], 95.00th=[ 124], | 99.00th=[ 257], 99.50th=[ 430], 99.90th=[ 575], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 5, max= 96, per=30.82%, avg=25.58, stdev=17.26, samples=333 iops : min= 1, max= 24, avg= 5.79, stdev= 4.35, samples=333 write: IOPS=5, BW=22.0KiB/s (22.5kB/s)(4532KiB/205949msec); 0 zone resets clat (msec): min=32, max=1130, avg=140.87, stdev=116.43 lat (msec): min=32, max=1130, avg=140.88, stdev=116.43 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 74], | 30.00th=[ 82], 40.00th=[ 94], 50.00th=[ 107], 60.00th=[ 122], | 70.00th=[ 142], 80.00th=[ 176], 90.00th=[ 249], 95.00th=[ 351], | 99.00th=[ 609], 99.50th=[ 835], 99.90th=[ 1116], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 5, max= 56, per=26.67%, avg=23.20, stdev=12.08, samples=376 iops : min= 1, max= 14, avg= 5.18, stdev= 3.09, samples=376 lat (msec) : 10=2.10%, 20=15.34%, 50=23.57%, 100=27.77%, 250=25.72% lat (msec) : 500=4.47%, 750=0.67%, 1000=0.13%, 2000=0.18% cpu : usr=0.04%, sys=1.74%, ctx=3929, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1103,1133,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=83.0KiB/s (85.0kB/s), 21.4KiB/s-22.8KiB/s (21.9kB/s-23.4kB/s), io=21.8MiB (22.9MB), run=205949-266441msec WRITE: bw=87.0KiB/s (90.1kB/s), 22.0KiB/s-23.8KiB/s (22.5kB/s-24.4kB/s), io=22.9MiB (23.0MB), run=205949-266441msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146076: Mon Jun 1 15:44:57 2026 read: IOPS=14, BW=228KiB/s (234kB/s)(5920KiB/25909msec) clat (usec): min=35, max=214714, avg=34716.49, stdev=30455.28 lat (usec): min=35, max=214715, avg=34724.32, stdev=30467.03 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 52], 10.00th=[ 56], 20.00th=[ 85], | 30.00th=[ 20317], 40.00th=[ 27657], 50.00th=[ 32637], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[131597], 99.50th=[191890], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 63, max= 540, per=25.71%, avg=228.31, stdev=105.83, samples=51 iops : min= 3, max= 33, avg=13.53, stdev= 6.68, samples=51 write: IOPS=15, BW=246KiB/s (252kB/s)(6368KiB/25909msec); 0 zone resets clat (usec): min=1455, max=342553, avg=32512.42, stdev=41227.35 lat (usec): min=1456, max=342555, avg=32514.47, stdev=41227.46 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1893], 10.00th=[ 2802], 20.00th=[ 4948], | 30.00th=[ 7635], 40.00th=[ 11076], 50.00th=[ 18482], 60.00th=[ 28705], | 70.00th=[ 37487], 80.00th=[ 50070], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[238027], 99.50th=[291505], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 445, per=26.23%, avg=245.24, stdev=106.52, samples=51 iops : min= 1, max= 27, avg=14.59, stdev= 6.71, samples=51 lat (usec) : 50=1.82%, 100=8.59%, 250=0.78%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=3.78%, 4=4.95%, 10=10.81%, 20=9.64%, 50=36.72% lat (msec) : 100=18.49%, 250=3.52%, 500=0.26% cpu : usr=0.07%, sys=6.49%, ctx=1405, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146077: Mon Jun 1 15:44:57 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(5744KiB/26148msec) clat (usec): min=35, max=167985, avg=34892.70, stdev=28925.41 lat (usec): min=36, max=167986, avg=34893.78, stdev=28925.40 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 98], | 30.00th=[ 20317], 40.00th=[ 27657], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 54264], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[119014], 99.50th=[152044], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 475, per=24.46%, avg=217.22, stdev=111.78, samples=51 iops : min= 1, max= 29, avg=12.82, stdev= 7.00, samples=51 write: IOPS=15, BW=250KiB/s (256kB/s)(6544KiB/26148msec); 0 zone resets clat (usec): min=1478, max=211423, avg=32689.18, stdev=37004.94 lat (usec): min=1479, max=211426, avg=32691.68, stdev=37005.07 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1975], 10.00th=[ 2573], 20.00th=[ 5407], | 30.00th=[ 7635], 40.00th=[ 10159], 50.00th=[ 18220], 60.00th=[ 29754], | 70.00th=[ 42730], 80.00th=[ 55313], 90.00th=[ 74974], 95.00th=[106431], | 99.00th=[191890], 99.50th=[200279], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 62, max= 443, per=26.27%, avg=245.67, stdev=90.92, samples=51 iops : min= 3, max= 27, avg=14.63, stdev= 5.72, samples=51 lat (usec) : 50=1.56%, 100=8.07%, 250=0.91% lat (msec) : 2=3.39%, 4=5.86%, 10=12.37%, 20=9.38%, 50=33.20% lat (msec) : 100=20.57%, 250=4.69% cpu : usr=0.06%, sys=6.43%, ctx=1457, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146078: Mon Jun 1 15:44:57 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26946msec) clat (usec): min=41, max=368767, avg=36124.67, stdev=36028.54 lat (usec): min=41, max=368768, avg=36130.45, stdev=36030.39 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 63], 20.00th=[ 95], | 30.00th=[ 19792], 40.00th=[ 27657], 50.00th=[ 32375], 60.00th=[ 39584], | 70.00th=[ 46924], 80.00th=[ 56361], 90.00th=[ 70779], 95.00th=[ 81265], | 99.00th=[179307], 99.50th=[258999], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 63, max= 443, per=26.62%, avg=236.42, stdev=87.26, samples=52 iops : min= 3, max= 27, avg=14.04, stdev= 5.48, samples=52 write: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26946msec); 0 zone resets clat (usec): min=1527, max=265550, avg=32899.41, stdev=36178.16 lat (usec): min=1530, max=265551, avg=32901.98, stdev=36178.52 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1876], 10.00th=[ 2966], 20.00th=[ 5342], | 30.00th=[ 7570], 40.00th=[ 12125], 50.00th=[ 20579], 60.00th=[ 30016], | 70.00th=[ 41681], 80.00th=[ 55837], 90.00th=[ 80217], 95.00th=[104334], | 99.00th=[168821], 99.50th=[173016], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 62, max= 443, per=23.91%, avg=223.58, stdev=88.58, samples=52 iops : min= 3, max= 27, avg=13.23, stdev= 5.63, samples=52 lat (usec) : 50=0.65%, 100=9.90%, 250=1.04%, 500=0.39%, 1000=0.13% lat (msec) : 2=3.26%, 4=4.43%, 10=10.68%, 20=9.64%, 50=34.51% lat (msec) : 100=21.61%, 250=3.39%, 500=0.39% cpu : usr=0.08%, sys=6.39%, ctx=1412, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146079: Mon Jun 1 15:44:57 2026 read: IOPS=14, BW=233KiB/s (239kB/s)(6032KiB/25893msec) clat (usec): min=32, max=267202, avg=35439.87, stdev=35238.31 lat (usec): min=33, max=267202, avg=35440.92, stdev=35238.24 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 67], | 30.00th=[ 16188], 40.00th=[ 26346], 50.00th=[ 33424], 60.00th=[ 39584], | 70.00th=[ 46924], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 90702], | 99.00th=[183501], 99.50th=[231736], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 443, per=27.14%, avg=241.02, stdev=85.70, samples=49 iops : min= 1, max= 27, avg=14.33, stdev= 5.42, samples=49 write: IOPS=15, BW=242KiB/s (247kB/s)(6256KiB/25893msec); 0 zone resets clat (usec): min=1487, max=310798, avg=31289.30, stdev=38959.35 lat (usec): min=1489, max=310800, avg=31291.38, stdev=38959.25 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2024], 10.00th=[ 2868], 20.00th=[ 4228], | 30.00th=[ 6259], 40.00th=[ 8979], 50.00th=[ 14484], 60.00th=[ 25822], | 70.00th=[ 37487], 80.00th=[ 53740], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[183501], 99.50th=[242222], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 506, per=25.84%, avg=241.63, stdev=112.57, samples=51 iops : min= 1, max= 31, avg=14.35, stdev= 7.08, samples=51 lat (usec) : 50=1.43%, 100=10.29%, 250=1.95%, 750=0.13% lat (msec) : 2=2.86%, 4=7.16%, 10=11.85%, 20=8.20%, 50=32.16% lat (msec) : 100=18.88%, 250=4.82%, 500=0.26% cpu : usr=0.10%, sys=6.28%, ctx=1325, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=889KiB/s (910kB/s), 220KiB/s-233KiB/s (225kB/s-239kB/s), io=23.4MiB (24.5MB), run=25893-26946msec WRITE: bw=935KiB/s (958kB/s), 224KiB/s-250KiB/s (229kB/s-256kB/s), io=24.6MiB (25.8MB), run=25893-26946msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146071: Mon Jun 1 15:45:38 2026 read: IOPS=5, BW=88.1KiB/s (90.2kB/s)(5920KiB/67197msec) clat (msec): min=6, max=284, avg=37.45, stdev=39.70 lat (msec): min=6, max=284, avg=37.45, stdev=39.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 75], 95.00th=[ 118], | 99.00th=[ 222], 99.50th=[ 268], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 416, per=28.22%, avg=99.63, stdev=64.63, samples=117 iops : min= 1, max= 26, avg= 5.49, stdev= 4.13, samples=117 write: IOPS=5, BW=94.8KiB/s (97.0kB/s)(6368KiB/67197msec); 0 zone resets clat (msec): min=49, max=433, avg=133.49, stdev=60.49 lat (msec): min=49, max=433, avg=133.49, stdev=60.49 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 109], 50.00th=[ 120], 60.00th=[ 134], | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 257], | 99.00th=[ 342], 99.50th=[ 422], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 192, per=25.94%, avg=96.25, stdev=39.70, samples=130 iops : min= 1, max= 12, avg= 5.25, stdev= 2.54, samples=130 lat (msec) : 10=1.30%, 20=17.06%, 50=22.40%, 100=20.57%, 250=35.55% lat (msec) : 500=3.12% cpu : usr=0.05%, sys=1.49%, ctx=1396, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146072: Mon Jun 1 15:45:38 2026 read: IOPS=5, BW=84.8KiB/s (86.8kB/s)(5744KiB/67743msec) clat (msec): min=7, max=218, avg=35.36, stdev=32.52 lat (msec): min=7, max=218, avg=35.36, stdev=32.52 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 110], | 99.00th=[ 167], 99.50th=[ 188], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 30, max= 318, per=27.68%, avg=97.72, stdev=61.33, samples=115 iops : min= 1, max= 19, avg= 5.37, stdev= 3.93, samples=115 write: IOPS=6, BW=96.6KiB/s (98.9kB/s)(6544KiB/67743msec); 0 zone resets clat (msec): min=35, max=476, avg=134.22, stdev=65.59 lat (msec): min=35, max=476, avg=134.22, stdev=65.59 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 96], 40.00th=[ 106], 50.00th=[ 120], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 222], 95.00th=[ 255], | 99.00th=[ 384], 99.50th=[ 435], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 192, per=26.08%, avg=96.74, stdev=41.04, samples=133 iops : min= 1, max= 12, avg= 5.30, stdev= 2.64, samples=133 lat (msec) : 10=1.56%, 20=17.45%, 50=19.27%, 100=23.57%, 250=35.29% lat (msec) : 500=2.86% cpu : usr=0.06%, sys=1.44%, ctx=1396, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146073: Mon Jun 1 15:45:38 2026 read: IOPS=6, BW=96.2KiB/s (98.5kB/s)(6256KiB/65049msec) clat (msec): min=7, max=231, avg=35.45, stdev=31.68 lat (msec): min=7, max=231, avg=35.45, stdev=31.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 70], 95.00th=[ 103], | 99.00th=[ 167], 99.50th=[ 188], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 320, per=29.73%, avg=104.96, stdev=67.58, samples=118 iops : min= 1, max= 20, avg= 5.81, stdev= 4.26, samples=118 write: IOPS=5, BW=92.7KiB/s (94.0kB/s)(6032KiB/65049msec); 0 zone resets clat (msec): min=38, max=479, avg=135.44, stdev=58.95 lat (msec): min=38, max=483, avg=135.46, stdev=59.03 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 109], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 178], 90.00th=[ 209], 95.00th=[ 245], | 99.00th=[ 338], 99.50th=[ 443], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 30, max= 191, per=24.88%, avg=92.30, stdev=38.98, samples=129 iops : min= 1, max= 11, avg= 5.02, stdev= 2.48, samples=129 lat (msec) : 10=2.34%, 20=17.06%, 50=22.27%, 100=20.70%, 250=35.55% lat (msec) : 500=2.08% cpu : usr=0.04%, sys=1.50%, ctx=1386, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146075: Mon Jun 1 15:45:38 2026 read: IOPS=5, BW=90.8KiB/s (93.0kB/s)(6032KiB/66412msec) clat (msec): min=6, max=334, avg=37.91, stdev=38.87 lat (msec): min=6, max=334, avg=37.92, stdev=38.87 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 84], 95.00th=[ 126], | 99.00th=[ 190], 99.50th=[ 230], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 318, per=28.69%, avg=101.29, stdev=63.27, samples=116 iops : min= 1, max= 19, avg= 5.59, stdev= 4.00, samples=116 write: IOPS=5, BW=94.2KiB/s (96.5kB/s)(6256KiB/66412msec); 0 zone resets clat (msec): min=37, max=391, avg=133.14, stdev=57.74 lat (msec): min=37, max=391, avg=133.14, stdev=57.74 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 134], | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 205], 95.00th=[ 249], | 99.00th=[ 342], 99.50th=[ 368], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 192, per=25.42%, avg=94.30, stdev=39.37, samples=130 iops : min= 1, max= 12, avg= 5.15, stdev= 2.54, samples=130 lat (msec) : 10=0.91%, 20=15.23%, 50=25.00%, 100=21.22%, 250=35.03% lat (msec) : 500=2.60% cpu : usr=0.03%, sys=1.39%, ctx=1352, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=354KiB/s (362kB/s), 84.8KiB/s-96.2KiB/s (86.8kB/s-98.5kB/s), io=23.4MiB (24.5MB), run=65049-67743msec WRITE: bw=372KiB/s (381kB/s), 92.7KiB/s-96.6KiB/s (94.0kB/s-98.9kB/s), io=24.6MiB (25.8MB), run=65049-67743msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146097: Mon Jun 1 15:45:52 2026 read: IOPS=1, BW=1425KiB/s (1459kB/s)(7168KiB/5030msec) clat (usec): min=506, max=2563.6k, avg=506433.18, stdev=911612.70 lat (usec): min=507, max=2563.6k, avg=506434.41, stdev=911612.84 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], | 20.00th=[ 135267], 30.00th=[ 149947], 40.00th=[ 149947], | 50.00th=[ 179307], 60.00th=[ 217056], 70.00th=[ 217056], | 80.00th=[ 299893], 90.00th=[2566915], 95.00th=[2566915], | 99.00th=[2566915], 99.50th=[2566915], 99.90th=[2566915], | 99.95th=[2566915], 99.99th=[2566915] bw ( KiB/s): min= 2035, max= 3968, per=73.66%, avg=2715.00, stdev=910.34, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=0, BW=1018KiB/s (1042kB/s)(5120KiB/5030msec); 0 zone resets clat (msec): min=137, max=378, avg=239.36, stdev=94.05 lat (msec): min=137, max=378, avg=239.49, stdev=94.06 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1946, max= 4071, per=51.68%, avg=2667.00, stdev=1216.05, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=12.13%, ctx=518, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146099: Mon Jun 1 15:45:52 2026 read: IOPS=0, BW=369KiB/s (378kB/s)(2048KiB/5555msec) clat (usec): min=469, max=373438, avg=186953.60, stdev=263728.92 lat (usec): min=469, max=373440, avg=186955.12, stdev=263729.82 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 469], | 30.00th=[ 469], 40.00th=[ 469], 50.00th=[ 469], 60.00th=[375391], | 70.00th=[375391], 80.00th=[375391], 90.00th=[375391], 95.00th=[375391], | 99.00th=[375391], 99.50th=[375391], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 1450, max= 2035, per=47.27%, avg=1742.50, stdev=413.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1843KiB/s (1888kB/s)(10.0MiB/5555msec); 0 zone resets clat (msec): min=140, max=2729, avg=500.24, stdev=792.65 lat (msec): min=140, max=2729, avg=500.32, stdev=792.65 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 153], | 30.00th=[ 167], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 203], | 70.00th=[ 330], 80.00th=[ 409], 90.00th=[ 506], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 2039, max= 6047, per=78.49%, avg=4051.00, stdev=1636.31, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.62%, ctx=130, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146101: Mon Jun 1 15:45:52 2026 read: IOPS=1, BW=1165KiB/s (1192kB/s)(6144KiB/5276msec) clat (usec): min=480, max=278926, avg=92495.42, stdev=114098.30 lat (usec): min=480, max=278927, avg=92496.40, stdev=114098.27 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 1057], 50.00th=[ 1057], 60.00th=[113771], | 70.00th=[160433], 80.00th=[160433], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1961, max= 6095, per=91.22%, avg=3362.33, stdev=2366.82, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1165KiB/s (1192kB/s)(6144KiB/5276msec); 0 zone resets clat (msec): min=128, max=3087, avg=777.03, stdev=1145.64 lat (msec): min=128, max=3087, avg=777.10, stdev=1145.64 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 439], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1984, max= 3886, per=48.11%, avg=2483.00, stdev=935.60, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.80%, ctx=127, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146102: Mon Jun 1 15:45:52 2026 read: IOPS=1, BW=1027KiB/s (1052kB/s)(5120KiB/4986msec) clat (usec): min=506, max=174311, avg=53620.49, stdev=77679.98 lat (usec): min=508, max=174312, avg=53621.64, stdev=77680.13 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 2671], 60.00th=[ 2671], | 70.00th=[ 89654], 80.00th=[ 89654], 90.00th=[175113], 95.00th=[175113], | 99.00th=[175113], 99.50th=[175113], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 7787, max= 7787, per=100.00%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1438KiB/s (1472kB/s)(7168KiB/4986msec); 0 zone resets clat (msec): min=62, max=3170, avg=659.71, stdev=1110.81 lat (msec): min=62, max=3170, avg=659.80, stdev=1110.81 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 199], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 288], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 313], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1408, max= 4071, per=55.19%, avg=2848.25, stdev=1370.81, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 100=16.67%, 250=16.67%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.11%, ctx=157, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3687KiB/s (3775kB/s), 369KiB/s-1425KiB/s (378kB/s-1459kB/s), io=20.0MiB (20.0MB), run=4986-5555msec WRITE: bw=5161KiB/s (5285kB/s), 1018KiB/s-1843KiB/s (1042kB/s-1888kB/s), io=28.0MiB (29.4MB), run=4986-5555msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146095: Mon Jun 1 15:45:52 2026 read: IOPS=1, BW=1459KiB/s (1494kB/s)(7168KiB/4913msec) clat (msec): min=106, max=2345, avg=533.26, stdev=806.85 lat (msec): min=106, max=2345, avg=533.26, stdev=806.85 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 140], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 213], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 405], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1878, max= 4071, per=86.11%, avg=3001.75, stdev=1204.43, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1042KiB/s (1067kB/s)(5120KiB/4913msec); 0 zone resets clat (msec): min=167, max=268, avg=214.22, stdev=46.11 lat (msec): min=167, max=268, avg=214.32, stdev=46.10 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 2007, max= 4087, per=55.57%, avg=2712.33, stdev=1190.63, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.50%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146096: Mon Jun 1 15:45:52 2026 read: IOPS=0, BW=373KiB/s (382kB/s)(2048KiB/5489msec) clat (msec): min=170, max=394, avg=282.29, stdev=158.38 lat (msec): min=170, max=394, avg=282.29, stdev=158.39 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2000, max= 2043, per=57.99%, avg=2021.50, stdev=30.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1866KiB/s (1910kB/s)(10.0MiB/5489msec); 0 zone resets clat (msec): min=125, max=2631, avg=489.69, stdev=761.93 lat (msec): min=125, max=2631, avg=489.79, stdev=761.91 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 174], | 30.00th=[ 184], 40.00th=[ 199], 50.00th=[ 201], 60.00th=[ 257], | 70.00th=[ 268], 80.00th=[ 309], 90.00th=[ 550], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 2007, max= 6059, per=83.18%, avg=4060.00, stdev=1654.52, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=4.70%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146098: Mon Jun 1 15:45:52 2026 read: IOPS=1, BW=1046KiB/s (1071kB/s)(6144KiB/5874msec) clat (msec): min=81, max=330, avg=188.82, stdev=96.28 lat (msec): min=81, max=330, avg=188.82, stdev=96.28 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 220], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 4087, max= 4096, per=100.00%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1046KiB/s (1071kB/s)(6144KiB/5874msec); 0 zone resets clat (msec): min=112, max=3034, avg=768.30, stdev=1126.50 lat (msec): min=113, max=3034, avg=768.41, stdev=1126.48 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 426], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 2043, max= 4015, per=55.36%, avg=2702.00, stdev=1137.09, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.46%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146100: Mon Jun 1 15:45:52 2026 read: IOPS=1, BW=1043KiB/s (1068kB/s)(5120KiB/4908msec) clat (msec): min=79, max=252, avg=136.01, stdev=70.11 lat (msec): min=79, max=252, avg=136.02, stdev=70.11 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 120], 60.00th=[ 120], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 2035, max= 6131, per=100.00%, avg=4083.00, stdev=2896.31, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1460KiB/s (1496kB/s)(7168KiB/4908msec); 0 zone resets clat (msec): min=175, max=2627, avg=602.16, stdev=896.29 lat (msec): min=176, max=2627, avg=602.26, stdev=896.28 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 201], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 275], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 393], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 2007, max= 3835, per=49.02%, avg=2392.60, stdev=806.46, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.04%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3487KiB/s (3570kB/s), 373KiB/s-1459KiB/s (382kB/s-1494kB/s), io=20.0MiB (20.0MB), run=4908-5874msec WRITE: bw=4881KiB/s (4998kB/s), 1042KiB/s-1866KiB/s (1067kB/s-1910kB/s), io=28.0MiB (29.4MB), run=4908-5874msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146110: Mon Jun 1 15:46:06 2026 read: IOPS=0, BW=2550KiB/s (2612kB/s)(12.0MiB/4818msec) clat (msec): min=720, max=3107, avg=1532.15, stdev=1364.43 lat (msec): min=720, max=3107, avg=1532.15, stdev=1364.43 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=7.70%, ctx=417, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146112: Mon Jun 1 15:46:06 2026 read: IOPS=0, BW=807KiB/s (826kB/s)(4096KiB/5075msec) clat (nsec): min=3129.3M, max=3129.3M, avg=3129275075.00, stdev= 0.00 lat (nsec): min=3129.3M, max=3129.3M, avg=3129277057.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3138], 5.00th=[ 3138], 10.00th=[ 3138], 20.00th=[ 3138], | 30.00th=[ 3138], 40.00th=[ 3138], 50.00th=[ 3138], 60.00th=[ 3138], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1614KiB/s (1653kB/s)(8192KiB/5075msec); 0 zone resets clat (msec): min=323, max=1440, avg=881.92, stdev=790.13 lat (msec): min=324, max=1440, avg=882.62, stdev=789.64 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=6.13%, ctx=470, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146113: Mon Jun 1 15:46:06 2026 write: IOPS=0, BW=2483KiB/s (2543kB/s)(12.0MiB/4949msec); 0 zone resets clat (msec): min=653, max=2853, avg=1601.96, stdev=1130.80 lat (msec): min=653, max=2854, avg=1602.57, stdev=1131.13 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.89%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146114: Mon Jun 1 15:46:06 2026 write: IOPS=0, BW=2835KiB/s (2903kB/s)(12.0MiB/4335msec); 0 zone resets clat (msec): min=275, max=2476, avg=1373.15, stdev=1100.42 lat (msec): min=275, max=2478, avg=1374.04, stdev=1101.17 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 5603, max= 8126, per=100.00%, avg=6864.50, stdev=1784.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.91%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3228KiB/s (3306kB/s), 807KiB/s-2550KiB/s (826kB/s-2612kB/s), io=16.0MiB (16.8MB), run=4818-5075msec WRITE: bw=6457KiB/s (6612kB/s), 1614KiB/s-2835KiB/s (1653kB/s-2903kB/s), io=32.0MiB (33.6MB), run=4335-5075msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146115: Mon Jun 1 15:46:06 2026 read: IOPS=0, BW=2481KiB/s (2541kB/s)(12.0MiB/4952msec) clat (msec): min=344, max=3102, avg=1639.56, stdev=1386.82 lat (msec): min=344, max=3102, avg=1639.56, stdev=1386.82 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.44%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146116: Mon Jun 1 15:46:06 2026 read: IOPS=0, BW=772KiB/s (791kB/s)(4096KiB/5304msec) clat (nsec): min=3461.8M, max=3461.8M, avg=3461846470.00, stdev= 0.00 lat (nsec): min=3461.8M, max=3461.8M, avg=3461848129.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3473], 5.00th=[ 3473], 10.00th=[ 3473], 20.00th=[ 3473], | 30.00th=[ 3473], 40.00th=[ 3473], 50.00th=[ 3473], 60.00th=[ 3473], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1544KiB/s (1582kB/s)(8192KiB/5304msec); 0 zone resets clat (msec): min=452, max=1268, avg=860.36, stdev=576.68 lat (msec): min=454, max=1268, avg=861.33, stdev=575.76 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.02%, ctx=44, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146117: Mon Jun 1 15:46:06 2026 write: IOPS=0, BW=2317KiB/s (2373kB/s)(12.0MiB/5303msec); 0 zone resets clat (msec): min=288, max=3329, avg=1744.35, stdev=1524.63 lat (msec): min=288, max=3331, avg=1745.43, stdev=1525.77 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.17%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146118: Mon Jun 1 15:46:06 2026 write: IOPS=0, BW=2833KiB/s (2901kB/s)(12.0MiB/4337msec); 0 zone resets clat (msec): min=321, max=2743, avg=1407.18, stdev=1230.40 lat (msec): min=321, max=2743, avg=1407.51, stdev=1230.34 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 6649, max= 8159, per=100.00%, avg=7404.00, stdev=1067.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.44%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3089KiB/s (3163kB/s), 772KiB/s-2481KiB/s (791kB/s-2541kB/s), io=16.0MiB (16.8MB), run=4952-5304msec WRITE: bw=6178KiB/s (6326kB/s), 1544KiB/s-2833KiB/s (1582kB/s-2901kB/s), io=32.0MiB (33.6MB), run=4337-5304msec