== sanity test 398b: DIO and buffer IO race ============== 22:03:38 (1788487418) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.13551 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144734: Thu Sep 3 22:06:06 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5992KiB/128163msec) clat (usec): min=32, max=957744, avg=41550.52, stdev=37788.95 lat (usec): min=32, max=957745, avg=41552.53, stdev=37788.75 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 69], 10.00th=[ 161], 20.00th=[ 19530], | 30.00th=[ 25297], 40.00th=[ 30016], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[131597], 99.50th=[173016], 99.90th=[231736], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 110, per=25.15%, avg=46.53, stdev=20.16, samples=251 iops : min= 1, max= 27, avg=10.99, stdev= 5.06, samples=251 write: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6296KiB/128163msec); 0 zone resets clat (usec): min=1016, max=426430, avg=41540.38, stdev=42946.27 lat (usec): min=1018, max=426432, avg=41543.96, stdev=42945.39 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1336], 10.00th=[ 1844], 20.00th=[ 4424], | 30.00th=[ 8356], 40.00th=[ 19006], 50.00th=[ 30802], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 70779], 90.00th=[ 98042], 95.00th=[121111], | 99.00th=[170918], 99.50th=[217056], 99.90th=[358613], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 117, per=25.11%, avg=48.71, stdev=19.63, samples=252 iops : min= 1, max= 29, avg=11.54, stdev= 4.95, samples=252 lat (usec) : 50=0.39%, 100=4.00%, 250=0.52%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=5.63%, 4=4.07%, 10=7.29%, 20=8.95%, 50=36.10% lat (msec) : 100=26.37%, 250=6.15%, 500=0.16%, 1000=0.03% cpu : usr=0.09%, sys=5.59%, ctx=6709, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144735: Thu Sep 3 22:06:06 2026 read: IOPS=11, BW=45.0KiB/s (47.1kB/s)(5940KiB/129246msec) clat (usec): min=29, max=317143, avg=39986.44, stdev=29460.44 lat (usec): min=29, max=317145, avg=39989.12, stdev=29460.19 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 215], 20.00th=[ 19006], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[131597], 99.50th=[149947], 99.90th=[235930], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 103, per=24.54%, avg=45.40, stdev=19.58, samples=254 iops : min= 1, max= 25, avg=10.70, stdev= 4.90, samples=254 write: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6348KiB/129246msec); 0 zone resets clat (usec): min=1030, max=924942, avg=43712.77, stdev=48882.20 lat (usec): min=1031, max=924944, avg=43716.91, stdev=48882.11 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1303], 10.00th=[ 1811], 20.00th=[ 4293], | 30.00th=[ 9634], 40.00th=[ 21365], 50.00th=[ 32900], 60.00th=[ 43779], | 70.00th=[ 58459], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[126354], | 99.00th=[187696], 99.50th=[229639], 99.90th=[346031], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 134, per=24.97%, avg=48.45, stdev=19.99, samples=254 iops : min= 1, max= 33, avg=11.48, stdev= 5.05, samples=254 lat (usec) : 50=0.33%, 100=4.00%, 250=0.59%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.92%, 4=4.30%, 10=5.89%, 20=9.38%, 50=36.82% lat (msec) : 100=25.55%, 250=6.84%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=5.61%, ctx=6771, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144736: Thu Sep 3 22:06:06 2026 read: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6028KiB/125506msec) clat (usec): min=24, max=253646, avg=38724.64, stdev=28339.82 lat (usec): min=24, max=253648, avg=38730.60, stdev=28341.63 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 100], 20.00th=[ 18482], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[114820], 99.50th=[147850], 99.90th=[229639], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 125, per=25.79%, avg=47.71, stdev=20.99, samples=247 iops : min= 1, max= 31, avg=11.29, stdev= 5.31, samples=247 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6260KiB/125506msec); 0 zone resets clat (usec): min=1000, max=855230, avg=42564.88, stdev=45805.00 lat (usec): min=1001, max=855231, avg=42567.42, stdev=45805.03 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1893], 20.00th=[ 4621], | 30.00th=[ 10028], 40.00th=[ 20841], 50.00th=[ 32900], 60.00th=[ 43779], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[ 98042], 95.00th=[120062], | 99.00th=[183501], 99.50th=[198181], 99.90th=[295699], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 125, per=25.43%, avg=49.33, stdev=19.37, samples=248 iops : min= 1, max= 31, avg=11.70, stdev= 4.90, samples=248 lat (usec) : 50=0.62%, 100=4.30%, 250=0.65%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=5.60%, 4=3.81%, 10=6.35%, 20=9.70%, 50=37.43% lat (msec) : 100=24.97%, 250=6.15%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=5.38%, ctx=6509, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144737: Thu Sep 3 22:06:06 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6052KiB/127951msec) clat (usec): min=33, max=274868, avg=41387.13, stdev=31448.70 lat (usec): min=33, max=274870, avg=41392.42, stdev=31451.55 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 125], 20.00th=[ 19006], | 30.00th=[ 24249], 40.00th=[ 29230], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[183501], 99.90th=[256902], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 103, per=25.54%, avg=47.24, stdev=19.87, samples=249 iops : min= 1, max= 25, avg=11.17, stdev= 5.02, samples=249 write: IOPS=12, BW=48.7KiB/s (49.9kB/s)(6236KiB/127951msec); 0 zone resets clat (usec): min=1067, max=930600, avg=41547.28, stdev=45943.03 lat (usec): min=1069, max=930602, avg=41556.42, stdev=45942.83 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1385], 10.00th=[ 2073], 20.00th=[ 5211], | 30.00th=[ 9634], 40.00th=[ 20579], 50.00th=[ 31589], 60.00th=[ 42206], | 70.00th=[ 54264], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[116917], | 99.00th=[173016], 99.50th=[217056], 99.90th=[283116], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 143, per=24.89%, avg=48.29, stdev=19.49, samples=251 iops : min= 1, max= 35, avg=11.43, stdev= 4.88, samples=251 lat (usec) : 50=0.46%, 100=4.23%, 250=0.62%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=5.08%, 4=3.22%, 10=7.75%, 20=8.92%, 50=36.91% lat (msec) : 100=26.01%, 250=6.25%, 500=0.16%, 1000=0.03% cpu : usr=0.09%, sys=5.65%, ctx=6627, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (190kB/s), 45.0KiB/s-48.0KiB/s (47.1kB/s-49.2kB/s), io=23.4MiB (24.6MB), run=125506-129246msec WRITE: bw=195KiB/s (199kB/s), 48.7KiB/s-49.9KiB/s (49.9kB/s-51.1kB/s), io=24.6MiB (25.7MB), run=125506-129246msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144739: Thu Sep 3 22:08:30 2026 read: IOPS=5, BW=22.0KiB/s (22.6kB/s)(5992KiB/271762msec) clat (msec): min=6, max=979, avg=34.87, stdev=43.29 lat (msec): min=6, max=979, avg=34.87, stdev=43.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 75], 95.00th=[ 104], | 99.00th=[ 184], 99.50th=[ 226], 99.90th=[ 443], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 103, per=27.86%, avg=24.51, stdev=16.57, samples=472 iops : min= 1, max= 25, avg= 5.49, stdev= 4.15, samples=472 write: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6296KiB/271762msec); 0 zone resets clat (msec): min=37, max=516, avg=139.36, stdev=61.77 lat (msec): min=37, max=516, avg=139.36, stdev=61.77 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 224], 95.00th=[ 257], | 99.00th=[ 342], 99.50th=[ 372], 99.90th=[ 439], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 55, per=24.85%, avg=22.86, stdev=10.09, samples=530 iops : min= 1, max= 13, avg= 5.07, stdev= 2.57, samples=530 lat (msec) : 10=3.22%, 20=17.71%, 50=19.76%, 100=20.21%, 250=36.07% lat (msec) : 500=2.96%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.14%, ctx=5266, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144740: Thu Sep 3 22:08:30 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(5940KiB/272300msec) clat (msec): min=5, max=1086, avg=33.79, stdev=41.59 lat (msec): min=5, max=1086, avg=33.79, stdev=41.59 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 70], 95.00th=[ 96], | 99.00th=[ 169], 99.50th=[ 211], 99.90th=[ 271], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 87, per=28.22%, avg=24.84, stdev=16.25, samples=461 iops : min= 1, max= 21, avg= 5.57, stdev= 4.10, samples=461 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6348KiB/272300msec); 0 zone resets clat (msec): min=39, max=559, avg=139.85, stdev=61.60 lat (msec): min=39, max=559, avg=139.85, stdev=61.59 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 114], 50.00th=[ 128], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 224], 95.00th=[ 262], | 99.00th=[ 334], 99.50th=[ 363], 99.90th=[ 477], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 48, per=24.90%, avg=22.91, stdev= 9.74, samples=533 iops : min= 1, max= 12, avg= 5.08, stdev= 2.46, samples=533 lat (msec) : 10=3.78%, 20=17.25%, 50=19.27%, 100=20.44%, 250=36.30% lat (msec) : 500=2.90%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.13%, ctx=5189, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144741: Thu Sep 3 22:08:30 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6028KiB/270691msec) clat (msec): min=5, max=342, avg=35.67, stdev=35.39 lat (msec): min=5, max=342, avg=35.67, stdev=35.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 49], 90.00th=[ 82], 95.00th=[ 104], | 99.00th=[ 176], 99.50th=[ 215], 99.90th=[ 338], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 112, per=27.70%, avg=24.38, stdev=16.62, samples=477 iops : min= 1, max= 28, avg= 5.45, stdev= 4.19, samples=477 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6260KiB/270691msec); 0 zone resets clat (msec): min=33, max=1230, avg=138.51, stdev=65.67 lat (msec): min=33, max=1230, avg=138.51, stdev=65.68 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 220], 95.00th=[ 249], | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 518], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 47, per=24.87%, avg=22.88, stdev= 9.83, samples=526 iops : min= 1, max= 11, avg= 5.08, stdev= 2.48, samples=526 lat (msec) : 10=2.86%, 20=18.07%, 50=18.95%, 100=22.07%, 250=35.42% lat (msec) : 500=2.57%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.15%, ctx=5149, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144742: Thu Sep 3 22:08:30 2026 read: IOPS=5, BW=22.2KiB/s (22.8kB/s)(6052KiB/272247msec) clat (msec): min=4, max=445, avg=33.55, stdev=34.35 lat (msec): min=4, max=445, avg=33.56, stdev=34.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 74], 95.00th=[ 104], | 99.00th=[ 159], 99.50th=[ 194], 99.90th=[ 326], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 95, per=28.96%, avg=25.48, stdev=16.75, samples=459 iops : min= 1, max= 23, avg= 5.73, stdev= 4.21, samples=459 write: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6236KiB/272247msec); 0 zone resets clat (msec): min=40, max=1165, avg=141.97, stdev=68.93 lat (msec): min=40, max=1165, avg=141.97, stdev=68.93 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 89], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 224], 95.00th=[ 262], | 99.00th=[ 355], 99.50th=[ 409], 99.90th=[ 558], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 47, per=24.36%, avg=22.41, stdev= 9.89, samples=535 iops : min= 1, max= 11, avg= 4.96, stdev= 2.51, samples=535 lat (msec) : 10=3.65%, 20=18.72%, 50=18.33%, 100=20.31%, 250=35.87% lat (msec) : 500=3.03%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.14%, ctx=5152, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=88.2KiB/s (90.3kB/s), 21.8KiB/s-22.3KiB/s (22.3kB/s-22.8kB/s), io=23.4MiB (24.6MB), run=270691-272300msec WRITE: bw=92.3KiB/s (94.5kB/s), 22.9KiB/s-23.3KiB/s (23.5kB/s-23.9kB/s), io=24.6MiB (25.7MB), run=270691-272300msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144796: Thu Sep 3 22:09:08 2026 read: IOPS=13, BW=223KiB/s (229kB/s)(5920KiB/26510msec) clat (usec): min=33, max=241585, avg=37312.09, stdev=31081.86 lat (usec): min=34, max=241586, avg=37313.37, stdev=31081.84 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 62], 10.00th=[ 75], 20.00th=[ 104], | 30.00th=[ 21890], 40.00th=[ 30802], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[139461], 99.50th=[177210], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 63, max= 383, per=26.27%, avg=223.81, stdev=74.35, samples=52 iops : min= 3, max= 23, avg=13.21, stdev= 4.64, samples=52 write: IOPS=15, BW=240KiB/s (246kB/s)(6368KiB/26510msec); 0 zone resets clat (usec): min=1151, max=168272, avg=31320.67, stdev=32852.13 lat (usec): min=1153, max=168273, avg=31327.71, stdev=32848.96 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2114], 10.00th=[ 2999], 20.00th=[ 5669], | 30.00th=[ 8717], 40.00th=[ 12518], 50.00th=[ 20055], 60.00th=[ 27919], | 70.00th=[ 36963], 80.00th=[ 51643], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[145753], 99.50th=[154141], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 62, max= 472, per=26.85%, avg=240.88, stdev=93.08, samples=52 iops : min= 3, max= 29, avg=14.31, stdev= 5.89, samples=52 lat (usec) : 50=1.43%, 100=7.81%, 250=1.95%, 500=0.39%, 1000=0.13% lat (msec) : 2=2.21%, 4=5.08%, 10=9.77%, 20=10.16%, 50=36.20% lat (msec) : 100=21.09%, 250=3.78% cpu : usr=0.08%, sys=7.03%, ctx=1532, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144798: Thu Sep 3 22:09:08 2026 read: IOPS=13, BW=218KiB/s (224kB/s)(5744KiB/26297msec) clat (usec): min=39, max=197778, avg=35083.76, stdev=30559.27 lat (usec): min=39, max=197780, avg=35086.44, stdev=30559.62 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 86], | 30.00th=[ 14484], 40.00th=[ 27132], 50.00th=[ 33817], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[120062], 99.50th=[131597], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 29, max= 445, per=26.17%, avg=222.96, stdev=80.69, samples=51 iops : min= 1, max= 27, avg=13.16, stdev= 5.08, samples=51 write: IOPS=15, BW=249KiB/s (255kB/s)(6544KiB/26297msec); 0 zone resets clat (usec): min=1312, max=406107, avg=33220.26, stdev=39602.89 lat (usec): min=1313, max=406109, avg=33226.54, stdev=39602.01 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2180], 10.00th=[ 2966], 20.00th=[ 4883], | 30.00th=[ 7373], 40.00th=[ 12649], 50.00th=[ 20579], 60.00th=[ 28705], | 70.00th=[ 39584], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[168821], 99.50th=[200279], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 31, max= 479, per=27.69%, avg=248.35, stdev=92.29, samples=52 iops : min= 1, max= 29, avg=14.77, stdev= 5.85, samples=52 lat (usec) : 50=1.17%, 100=9.64%, 250=1.56%, 500=0.13%, 750=0.52% lat (usec) : 1000=0.26% lat (msec) : 2=1.95%, 4=6.51%, 10=10.29%, 20=9.90%, 50=31.77% lat (msec) : 100=23.18%, 250=2.86%, 500=0.26% cpu : usr=0.08%, sys=7.00%, ctx=1463, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144799: Thu Sep 3 22:09:08 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(6256KiB/28085msec) clat (usec): min=37, max=329981, avg=33746.60, stdev=33608.19 lat (usec): min=38, max=329982, avg=33761.53, stdev=33602.26 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 67], 20.00th=[ 86], | 30.00th=[ 310], 40.00th=[ 23987], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 47973], 80.00th=[ 57410], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[111674], 99.50th=[166724], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 62, max= 542, per=26.70%, avg=227.52, stdev=105.78, samples=54 iops : min= 3, max= 33, avg=13.44, stdev= 6.67, samples=54 write: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28085msec); 0 zone resets clat (usec): min=1527, max=259642, avg=38681.62, stdev=41214.05 lat (usec): min=1532, max=259645, avg=38684.68, stdev=41213.90 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2343], 10.00th=[ 3752], 20.00th=[ 5997], | 30.00th=[ 10159], 40.00th=[ 16188], 50.00th=[ 24511], 60.00th=[ 39060], | 70.00th=[ 49021], 80.00th=[ 62653], 90.00th=[ 87557], 95.00th=[119014], | 99.00th=[198181], 99.50th=[208667], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 29, max= 480, per=23.63%, avg=211.93, stdev=102.57, samples=55 iops : min= 1, max= 30, avg=12.45, stdev= 6.46, samples=55 lat (usec) : 50=2.21%, 100=10.94%, 250=1.69%, 500=0.91%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.82%, 4=4.04%, 10=9.11%, 20=9.11%, 50=31.12% lat (msec) : 100=23.83%, 250=4.69%, 500=0.26% cpu : usr=0.11%, sys=6.59%, ctx=1456, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144801: Thu Sep 3 22:09:08 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(6032KiB/27420msec) clat (usec): min=37, max=181233, avg=33143.40, stdev=29976.26 lat (usec): min=37, max=181235, avg=33144.63, stdev=29976.28 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 1156], 40.00th=[ 24249], 50.00th=[ 31851], 60.00th=[ 40109], | 70.00th=[ 47973], 80.00th=[ 58983], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[106431], 99.50th=[168821], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 507, per=26.67%, avg=227.19, stdev=95.46, samples=52 iops : min= 1, max= 31, avg=13.42, stdev= 6.00, samples=52 write: IOPS=14, BW=228KiB/s (234kB/s)(6256KiB/27420msec); 0 zone resets clat (usec): min=1505, max=366235, avg=37469.82, stdev=45026.39 lat (usec): min=1506, max=366237, avg=37475.15, stdev=45028.85 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2212], 10.00th=[ 3130], 20.00th=[ 5800], | 30.00th=[ 8717], 40.00th=[ 13960], 50.00th=[ 23725], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 58983], 90.00th=[ 85459], 95.00th=[114820], | 99.00th=[225444], 99.50th=[291505], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 30, max= 448, per=25.50%, avg=228.72, stdev=107.10, samples=54 iops : min= 1, max= 28, avg=13.52, stdev= 6.75, samples=54 lat (usec) : 50=1.95%, 100=10.55%, 250=1.56%, 500=0.65% lat (msec) : 2=2.86%, 4=5.21%, 10=9.77%, 20=8.98%, 50=30.99% lat (msec) : 100=23.44%, 250=3.78%, 500=0.26% cpu : usr=0.09%, sys=6.65%, ctx=1501, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=853KiB/s (873kB/s), 218KiB/s-223KiB/s (224kB/s-229kB/s), io=23.4MiB (24.5MB), run=26297-28085msec WRITE: bw=897KiB/s (919kB/s), 215KiB/s-249KiB/s (220kB/s-255kB/s), io=24.6MiB (25.8MB), run=26297-28085msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144795: Thu Sep 3 22:09:46 2026 read: IOPS=5, BW=90.8KiB/s (92.0kB/s)(5920KiB/65185msec) clat (msec): min=7, max=179, avg=36.90, stdev=28.17 lat (msec): min=7, max=179, avg=36.91, stdev=28.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 80], 95.00th=[ 97], | 99.00th=[ 142], 99.50th=[ 171], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 31, max= 316, per=28.53%, avg=102.44, stdev=64.33, samples=114 iops : min= 1, max= 19, avg= 5.64, stdev= 4.02, samples=114 write: IOPS=6, BW=97.7KiB/s (100kB/s)(6368KiB/65185msec); 0 zone resets clat (msec): min=51, max=355, avg=128.87, stdev=52.92 lat (msec): min=51, max=355, avg=128.87, stdev=52.92 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 118], 60.00th=[ 129], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 194], 95.00th=[ 222], | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 27, max= 160, per=25.95%, avg=98.11, stdev=37.77, samples=128 iops : min= 1, max= 10, avg= 5.34, stdev= 2.41, samples=128 lat (msec) : 10=1.56%, 20=12.63%, 50=23.83%, 100=25.78%, 250=34.38% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.47%, ctx=1358, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144797: Thu Sep 3 22:09:46 2026 read: IOPS=5, BW=86.3KiB/s (88.4kB/s)(5744KiB/66569msec) clat (msec): min=7, max=244, avg=36.66, stdev=34.17 lat (msec): min=7, max=244, avg=36.66, stdev=34.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 111], | 99.00th=[ 184], 99.50th=[ 207], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 27, max= 347, per=27.19%, avg=97.60, stdev=62.89, samples=115 iops : min= 1, max= 21, avg= 5.32, stdev= 3.95, samples=115 write: IOPS=6, BW=98.3KiB/s (101kB/s)(6544KiB/66569msec); 0 zone resets clat (msec): min=41, max=405, avg=130.33, stdev=56.20 lat (msec): min=41, max=405, avg=130.33, stdev=56.20 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 69], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 117], 60.00th=[ 132], | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 209], 95.00th=[ 247], | 99.00th=[ 321], 99.50th=[ 347], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 191, per=25.78%, avg=97.44, stdev=40.11, samples=131 iops : min= 1, max= 11, avg= 5.31, stdev= 2.56, samples=131 lat (msec) : 10=1.30%, 20=15.23%, 50=21.74%, 100=24.09%, 250=35.29% lat (msec) : 500=2.34% cpu : usr=0.04%, sys=1.42%, ctx=1414, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144800: Thu Sep 3 22:09:46 2026 read: IOPS=6, BW=97.0KiB/s (99.3kB/s)(6256KiB/64491msec) clat (msec): min=6, max=228, avg=36.20, stdev=29.41 lat (msec): min=6, max=228, avg=36.20, stdev=29.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 74], 95.00th=[ 94], | 99.00th=[ 157], 99.50th=[ 182], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 30, max= 319, per=29.21%, avg=104.85, stdev=66.52, samples=118 iops : min= 1, max= 19, avg= 5.77, stdev= 4.19, samples=118 write: IOPS=5, BW=93.5KiB/s (95.8kB/s)(6032KiB/64491msec); 0 zone resets clat (msec): min=43, max=389, avg=132.87, stdev=58.41 lat (msec): min=43, max=389, avg=132.88, stdev=58.41 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 117], 60.00th=[ 134], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 245], | 99.00th=[ 342], 99.50th=[ 359], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 27, max= 190, per=24.56%, avg=92.83, stdev=35.89, samples=127 iops : min= 1, max= 11, avg= 5.02, stdev= 2.35, samples=127 lat (msec) : 10=1.04%, 20=15.63%, 50=24.09%, 100=24.35%, 250=32.55% lat (msec) : 500=2.34% cpu : usr=0.04%, sys=1.31%, ctx=1332, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144802: Thu Sep 3 22:09:46 2026 read: IOPS=5, BW=93.9KiB/s (96.1kB/s)(6032KiB/64260msec) clat (msec): min=7, max=175, avg=34.04, stdev=27.61 lat (msec): min=7, max=175, avg=34.05, stdev=27.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 69], 95.00th=[ 96], | 99.00th=[ 146], 99.50th=[ 165], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 30, max= 349, per=28.33%, avg=101.71, stdev=65.76, samples=116 iops : min= 1, max= 21, avg= 5.59, stdev= 4.16, samples=116 write: IOPS=6, BW=97.4KiB/s (99.7kB/s)(6256KiB/64260msec); 0 zone resets clat (msec): min=53, max=386, avg=130.94, stdev=56.95 lat (msec): min=53, max=386, avg=130.94, stdev=56.95 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 95], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 209], 95.00th=[ 241], | 99.00th=[ 347], 99.50th=[ 359], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 27, max= 191, per=25.89%, avg=97.87, stdev=40.05, samples=126 iops : min= 1, max= 11, avg= 5.33, stdev= 2.57, samples=126 lat (msec) : 10=1.95%, 20=14.84%, 50=23.70%, 100=25.13%, 250=32.55% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.42%, ctx=1330, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=360KiB/s (368kB/s), 86.3KiB/s-97.0KiB/s (88.4kB/s-99.3kB/s), io=23.4MiB (24.5MB), run=64260-66569msec WRITE: bw=379KiB/s (388kB/s), 93.5KiB/s-98.3KiB/s (95.8kB/s-101kB/s), io=24.6MiB (25.8MB), run=64260-66569msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144821: Thu Sep 3 22:10:03 2026 read: IOPS=1, BW=1217KiB/s (1246kB/s)(7168KiB/5890msec) clat (usec): min=486, max=3684.2k, avg=647416.23, stdev=1346930.04 lat (usec): min=487, max=3684.2k, avg=647418.14, stdev=1346930.04 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], | 20.00th=[ 1696], 30.00th=[ 1844], 40.00th=[ 1844], | 50.00th=[ 206570], 60.00th=[ 316670], 70.00th=[ 316670], | 80.00th=[ 320865], 90.00th=[3674211], 95.00th=[3674211], | 99.00th=[3674211], 99.50th=[3674211], 99.90th=[3674211], | 99.95th=[3674211], 99.99th=[3674211] bw ( KiB/s): min= 2007, max= 4087, per=100.00%, avg=3049.00, stdev=1184.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=869KiB/s (890kB/s)(5120KiB/5890msec); 0 zone resets clat (msec): min=130, max=293, avg=198.61, stdev=59.47 lat (msec): min=130, max=293, avg=198.73, stdev=59.43 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 2039, max= 6095, per=100.00%, avg=4067.00, stdev=2868.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33% lat (msec) : 2=16.67%, 250=41.67%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=9.03%, ctx=593, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144823: Thu Sep 3 22:10:03 2026 read: IOPS=0, BW=276KiB/s (283kB/s)(2048KiB/7413msec) clat (usec): min=1681, max=401764, avg=201722.91, stdev=282901.96 lat (usec): min=1766, max=401767, avg=201767.04, stdev=282843.50 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1680], 10.00th=[ 1680], 20.00th=[ 1680], | 30.00th=[ 1680], 40.00th=[ 1680], 50.00th=[ 1680], 60.00th=[400557], | 70.00th=[400557], 80.00th=[400557], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 2035, max= 2043, per=73.82%, avg=2039.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1381KiB/s (1415kB/s)(10.0MiB/7413msec); 0 zone resets clat (msec): min=105, max=3449, avg=657.99, stdev=1007.33 lat (msec): min=106, max=3449, avg=658.10, stdev=1007.33 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 153], | 30.00th=[ 184], 40.00th=[ 197], 50.00th=[ 211], 60.00th=[ 388], | 70.00th=[ 460], 80.00th=[ 609], 90.00th=[ 827], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 2003, max= 4096, per=69.65%, avg=2693.33, stdev=1040.83, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 2=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.77%, ctx=131, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144824: Thu Sep 3 22:10:03 2026 read: IOPS=0, BW=910KiB/s (932kB/s)(6144KiB/6749msec) clat (usec): min=524, max=315762, avg=141089.12, stdev=155180.45 lat (usec): min=526, max=315764, avg=141090.88, stdev=155180.33 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 783], 50.00th=[ 783], 60.00th=[252707], | 70.00th=[274727], 80.00th=[274727], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 4063, max= 4071, per=100.00%, avg=4067.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=910KiB/s (932kB/s)(6144KiB/6749msec); 0 zone resets clat (msec): min=126, max=3529, avg=933.19, stdev=1281.27 lat (msec): min=126, max=3529, avg=933.27, stdev=1281.28 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 481], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 2003, max= 2043, per=52.50%, avg=2030.20, stdev=15.85, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=8.33%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=6.08%, ctx=203, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144825: Thu Sep 3 22:10:03 2026 read: IOPS=0, BW=912KiB/s (933kB/s)(5120KiB/5617msec) clat (msec): min=2, max=396, avg=188.34, stdev=143.39 lat (msec): min=2, max=396, avg=188.34, stdev=143.39 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 3976, max= 4087, per=100.00%, avg=4031.50, stdev=78.49, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1276KiB/s (1307kB/s)(7168KiB/5617msec); 0 zone resets clat (msec): min=127, max=2344, avg=661.97, stdev=784.48 lat (msec): min=127, max=2344, avg=662.20, stdev=784.41 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 171], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 418], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 860], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2003, max= 4063, per=72.79%, avg=2814.75, stdev=987.43, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 4=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.58%, ctx=153, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2763KiB/s (2829kB/s), 276KiB/s-1217KiB/s (283kB/s-1246kB/s), io=20.0MiB (20.0MB), run=5617-7413msec WRITE: bw=3868KiB/s (3961kB/s), 869KiB/s-1381KiB/s (890kB/s-1415kB/s), io=28.0MiB (29.4MB), run=5617-7413msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144820: Thu Sep 3 22:10:04 2026 read: IOPS=2, BW=2169KiB/s (2222kB/s)(7168KiB/3304msec) clat (msec): min=101, max=659, avg=269.54, stdev=194.58 lat (msec): min=101, max=659, avg=269.54, stdev=194.58 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 150], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 192], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 393], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1546, max= 4071, per=100.00%, avg=2932.75, stdev=1329.91, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1550KiB/s (1587kB/s)(5120KiB/3304msec); 0 zone resets clat (msec): min=116, max=326, avg=242.10, stdev=86.36 lat (msec): min=116, max=326, avg=242.21, stdev=86.36 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 2039, max= 4000, per=70.60%, avg=2694.00, stdev=1131.03, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=5.27%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144822: Thu Sep 3 22:10:04 2026 read: IOPS=0, BW=281KiB/s (288kB/s)(2048KiB/7282msec) clat (msec): min=165, max=397, avg=281.45, stdev=163.92 lat (msec): min=165, max=397, avg=281.46, stdev=163.93 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1510, max= 2043, per=65.19%, avg=1776.50, stdev=376.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1406KiB/s (1440kB/s)(10.0MiB/7282msec); 0 zone resets clat (msec): min=181, max=3396, avg=660.43, stdev=984.66 lat (msec): min=181, max=3397, avg=660.68, stdev=984.64 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 186], | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 292], 60.00th=[ 347], | 70.00th=[ 418], 80.00th=[ 531], 90.00th=[ 860], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 2000, max= 4079, per=68.33%, avg=2607.29, stdev=997.35, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.83%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144826: Thu Sep 3 22:10:04 2026 read: IOPS=0, BW=818KiB/s (837kB/s)(6144KiB/7513msec) clat (msec): min=77, max=499, avg=184.60, stdev=156.61 lat (msec): min=77, max=499, avg=184.60, stdev=156.61 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 142], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2000, max= 4055, per=99.06%, avg=2699.33, stdev=1174.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=818KiB/s (837kB/s)(6144KiB/7513msec); 0 zone resets clat (msec): min=173, max=3562, avg=1020.10, stdev=1277.90 lat (msec): min=173, max=3562, avg=1020.20, stdev=1277.91 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 575], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 2000, max= 2039, per=53.14%, avg=2028.00, stdev=16.40, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.12%, ctx=127, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144827: Thu Sep 3 22:10:04 2026 read: IOPS=0, BW=712KiB/s (729kB/s)(5120KiB/7194msec) clat (msec): min=62, max=200, avg=130.07, stdev=55.02 lat (msec): min=62, max=200, avg=130.08, stdev=55.02 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 2043, max= 6119, per=100.00%, avg=4081.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=996KiB/s (1020kB/s)(7168KiB/7194msec); 0 zone resets clat (msec): min=145, max=3842, avg=895.25, stdev=1339.88 lat (msec): min=146, max=3843, avg=895.46, stdev=1340.18 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 169], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 296], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 1083], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 2000, max= 2043, per=53.18%, avg=2029.25, stdev=19.77, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.57%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2726KiB/s (2791kB/s), 281KiB/s-2169KiB/s (288kB/s-2222kB/s), io=20.0MiB (20.0MB), run=3304-7513msec WRITE: bw=3816KiB/s (3908kB/s), 818KiB/s-1550KiB/s (837kB/s-1587kB/s), io=28.0MiB (29.4MB), run=3304-7513msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144835: Thu Sep 3 22:10:21 2026 read: IOPS=0, BW=2345KiB/s (2401kB/s)(12.0MiB/5240msec) clat (msec): min=802, max=3278, avg=1690.11, stdev=1378.45 lat (msec): min=802, max=3278, avg=1690.11, stdev=1378.45 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=8.26%, ctx=573, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144836: Thu Sep 3 22:10:21 2026 read: IOPS=0, BW=869KiB/s (890kB/s)(4096KiB/4715msec) clat (nsec): min=3274.1M, max=3274.1M, avg=3274071903.00, stdev= 0.00 lat (nsec): min=3274.1M, max=3274.1M, avg=3274073175.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3272], 5.00th=[ 3272], 10.00th=[ 3272], 20.00th=[ 3272], | 30.00th=[ 3272], 40.00th=[ 3272], 50.00th=[ 3272], 60.00th=[ 3272], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1737KiB/s (1779kB/s)(8192KiB/4715msec); 0 zone resets clat (msec): min=293, max=918, avg=605.71, stdev=441.92 lat (msec): min=293, max=919, avg=606.74, stdev=442.99 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.98%, ctx=456, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Thu Sep 3 22:10:21 2026 write: IOPS=0, BW=2171KiB/s (2223kB/s)(12.0MiB/5661msec); 0 zone resets clat (msec): min=373, max=3575, avg=1837.52, stdev=1618.35 lat (msec): min=373, max=3577, avg=1838.41, stdev=1619.25 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1569], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.99%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144838: Thu Sep 3 22:10:21 2026 write: IOPS=0, BW=2348KiB/s (2405kB/s)(12.0MiB/5233msec); 0 zone resets clat (msec): min=297, max=4456, avg=1693.63, stdev=2392.88 lat (msec): min=299, max=4456, avg=1694.81, stdev=2392.02 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 5809, max= 8192, per=100.00%, avg=7000.50, stdev=1685.04, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.80%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3127KiB/s (3202kB/s), 869KiB/s-2345KiB/s (890kB/s-2401kB/s), io=16.0MiB (16.8MB), run=4715-5240msec WRITE: bw=5788KiB/s (5927kB/s), 1737KiB/s-2348KiB/s (1779kB/s-2405kB/s), io=32.0MiB (33.6MB), run=4715-5661msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Thu Sep 3 22:10:21 2026 read: IOPS=0, BW=2053KiB/s (2103kB/s)(12.0MiB/5984msec) clat (msec): min=149, max=4109, avg=1966.24, stdev=2000.36 lat (msec): min=149, max=4109, avg=1966.24, stdev=2000.36 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 4111], 80.00th=[ 4111], 90.00th=[ 4111], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.81%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Thu Sep 3 22:10:21 2026 read: IOPS=0, BW=713KiB/s (730kB/s)(4096KiB/5747msec) clat (nsec): min=3642.4M, max=3642.4M, avg=3642356611.00, stdev= 0.00 lat (nsec): min=3642.4M, max=3642.4M, avg=3642359228.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3641], 5.00th=[ 3641], 10.00th=[ 3641], 20.00th=[ 3641], | 30.00th=[ 3641], 40.00th=[ 3641], 50.00th=[ 3641], 60.00th=[ 3641], | 70.00th=[ 3641], 80.00th=[ 3641], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1425KiB/s (1460kB/s)(8192KiB/5747msec); 0 zone resets clat (msec): min=447, max=1609, avg=1028.79, stdev=821.82 lat (msec): min=447, max=1610, avg=1029.22, stdev=822.23 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.64%, ctx=28, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144841: Thu Sep 3 22:10:21 2026 write: IOPS=0, BW=2171KiB/s (2223kB/s)(12.0MiB/5661msec); 0 zone resets clat (msec): min=312, max=3979, avg=1871.81, stdev=1893.77 lat (msec): min=313, max=3979, avg=1872.56, stdev=1893.27 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.82%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144842: Thu Sep 3 22:10:21 2026 write: IOPS=0, BW=2266KiB/s (2321kB/s)(12.0MiB/5422msec); 0 zone resets clat (msec): min=216, max=4645, avg=1744.75, stdev=2513.51 lat (msec): min=216, max=4646, avg=1745.30, stdev=2513.36 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min=16253, max=16253, per=100.00%, avg=16253.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.90%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2738KiB/s (2804kB/s), 713KiB/s-2053KiB/s (730kB/s-2103kB/s), io=16.0MiB (16.8MB), run=5747-5984msec WRITE: bw=5702KiB/s (5839kB/s), 1425KiB/s-2266KiB/s (1460kB/s-2321kB/s), io=32.0MiB (33.6MB), run=5422-5747msec