== sanity test 398b: DIO and buffer IO race ============== 22:07:54 (1772680074) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.65107 s, 19.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154067: Wed Mar 4 22:09:20 2026 read: IOPS=19, BW=77.9KiB/s (79.8kB/s)(5992KiB/76933msec) clat (usec): min=121, max=760956, avg=25221.69, stdev=28723.58 lat (usec): min=122, max=760958, avg=25222.83, stdev=28723.61 clat percentiles (usec): | 1.00th=[ 219], 5.00th=[ 537], 10.00th=[ 8160], 20.00th=[ 11731], | 30.00th=[ 14484], 40.00th=[ 16909], 50.00th=[ 20579], 60.00th=[ 24249], | 70.00th=[ 28443], 80.00th=[ 34341], 90.00th=[ 45351], 95.00th=[ 57410], | 99.00th=[ 94897], 99.50th=[135267], 99.90th=[354419], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 15, max= 224, per=24.93%, avg=77.77, stdev=35.69, samples=151 iops : min= 3, max= 56, avg=18.93, stdev= 8.96, samples=151 write: IOPS=20, BW=81.8KiB/s (83.8kB/s)(6296KiB/76933msec); 0 zone resets clat (usec): min=763, max=601134, avg=24821.36, stdev=31524.65 lat (usec): min=763, max=601136, avg=24823.37, stdev=31525.57 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1401], 10.00th=[ 2040], 20.00th=[ 3458], | 30.00th=[ 7242], 40.00th=[ 12387], 50.00th=[ 17433], 60.00th=[ 22414], | 70.00th=[ 29230], 80.00th=[ 39584], 90.00th=[ 55313], 95.00th=[ 76022], | 99.00th=[121111], 99.50th=[147850], 99.90th=[492831], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 15, max= 248, per=25.06%, avg=81.71, stdev=36.58, samples=151 iops : min= 3, max= 62, avg=19.91, stdev= 9.21, samples=151 lat (usec) : 250=0.88%, 500=1.40%, 750=0.42%, 1000=0.46% lat (msec) : 2=4.88%, 4=6.58%, 10=10.29%, 20=27.28%, 50=37.70% lat (msec) : 100=8.66%, 250=1.30%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=11.01%, ctx=7590, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154068: Wed Mar 4 22:09:20 2026 read: IOPS=19, BW=77.0KiB/s (79.8kB/s)(5940KiB/76183msec) clat (usec): min=132, max=603705, avg=26325.01, stdev=28626.99 lat (usec): min=133, max=603706, avg=26326.29, stdev=28627.12 clat percentiles (usec): | 1.00th=[ 225], 5.00th=[ 478], 10.00th=[ 8717], 20.00th=[ 12256], | 30.00th=[ 14746], 40.00th=[ 17695], 50.00th=[ 21103], 60.00th=[ 25035], | 70.00th=[ 30278], 80.00th=[ 36439], 90.00th=[ 47449], 95.00th=[ 61080], | 99.00th=[ 95945], 99.50th=[114820], 99.90th=[497026], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 175, per=24.95%, avg=77.85, stdev=31.40, samples=149 iops : min= 1, max= 43, avg=18.94, stdev= 7.88, samples=149 write: IOPS=20, BW=83.3KiB/s (85.3kB/s)(6348KiB/76183msec); 0 zone resets clat (usec): min=673, max=475042, avg=23304.10, stdev=26780.41 lat (usec): min=673, max=475044, avg=23307.62, stdev=26779.44 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1516], 10.00th=[ 2073], 20.00th=[ 3556], | 30.00th=[ 5932], 40.00th=[ 11338], 50.00th=[ 16319], 60.00th=[ 21890], | 70.00th=[ 28705], 80.00th=[ 38011], 90.00th=[ 52167], 95.00th=[ 67634], | 99.00th=[113771], 99.50th=[137364], 99.90th=[250610], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 243, per=25.41%, avg=82.84, stdev=37.63, samples=149 iops : min= 1, max= 60, avg=20.19, stdev= 9.44, samples=149 lat (usec) : 250=1.11%, 500=1.40%, 750=0.46%, 1000=0.26% lat (msec) : 2=4.72%, 4=6.87%, 10=10.84%, 20=26.73%, 50=37.70% lat (msec) : 100=8.63%, 250=1.11%, 500=0.16%, 750=0.03% cpu : usr=0.10%, sys=10.36%, ctx=7574, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154069: Wed Mar 4 22:09:20 2026 read: IOPS=19, BW=78.7KiB/s (80.6kB/s)(6028KiB/76590msec) clat (usec): min=124, max=197262, avg=23903.89, stdev=19494.24 lat (usec): min=124, max=197263, avg=23906.66, stdev=19493.46 clat percentiles (usec): | 1.00th=[ 217], 5.00th=[ 453], 10.00th=[ 8225], 20.00th=[ 11469], | 30.00th=[ 13829], 40.00th=[ 16319], 50.00th=[ 19530], 60.00th=[ 22938], | 70.00th=[ 27395], 80.00th=[ 32637], 90.00th=[ 43779], 95.00th=[ 58459], | 99.00th=[104334], 99.50th=[116917], 99.90th=[187696], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 16, max= 184, per=25.19%, avg=78.59, stdev=34.12, samples=150 iops : min= 4, max= 46, avg=19.12, stdev= 8.55, samples=150 write: IOPS=20, BW=81.7KiB/s (83.7kB/s)(6260KiB/76590msec); 0 zone resets clat (usec): min=844, max=652178, avg=25851.15, stdev=35897.42 lat (usec): min=845, max=652181, avg=25858.20, stdev=35895.47 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1516], 10.00th=[ 2114], 20.00th=[ 3720], | 30.00th=[ 7242], 40.00th=[ 13698], 50.00th=[ 19006], 60.00th=[ 24511], | 70.00th=[ 30802], 80.00th=[ 40109], 90.00th=[ 54264], 95.00th=[ 70779], | 99.00th=[124257], 99.50th=[158335], 99.90th=[541066], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 22, max= 196, per=24.98%, avg=81.45, stdev=33.05, samples=150 iops : min= 5, max= 49, avg=19.85, stdev= 8.33, samples=150 lat (usec) : 250=1.11%, 500=1.50%, 750=0.42%, 1000=0.36% lat (msec) : 2=4.49%, 4=6.38%, 10=10.03%, 20=27.67%, 50=37.92% lat (msec) : 100=8.63%, 250=1.33%, 500=0.07%, 750=0.10% cpu : usr=0.08%, sys=10.96%, ctx=7592, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154070: Wed Mar 4 22:09:20 2026 read: IOPS=20, BW=80.4KiB/s (82.3kB/s)(6052KiB/75312msec) clat (usec): min=123, max=505042, avg=24239.78, stdev=22765.04 lat (usec): min=124, max=505043, avg=24240.99, stdev=22765.05 clat percentiles (usec): | 1.00th=[ 212], 5.00th=[ 453], 10.00th=[ 8029], 20.00th=[ 11469], | 30.00th=[ 14222], 40.00th=[ 16450], 50.00th=[ 19530], 60.00th=[ 22938], | 70.00th=[ 28181], 80.00th=[ 33817], 90.00th=[ 45876], 95.00th=[ 57410], | 99.00th=[ 84411], 99.50th=[106431], 99.90th=[325059], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 7, max= 183, per=26.04%, avg=81.25, stdev=32.12, samples=147 iops : min= 1, max= 45, avg=19.79, stdev= 8.08, samples=147 write: IOPS=20, BW=82.8KiB/s (84.8kB/s)(6236KiB/75312msec); 0 zone resets clat (usec): min=772, max=674922, avg=24714.36, stdev=31538.51 lat (usec): min=772, max=674923, avg=24715.88, stdev=31538.49 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1434], 10.00th=[ 2114], 20.00th=[ 3523], | 30.00th=[ 6849], 40.00th=[ 12518], 50.00th=[ 18220], 60.00th=[ 23725], | 70.00th=[ 31065], 80.00th=[ 40109], 90.00th=[ 55837], 95.00th=[ 67634], | 99.00th=[115868], 99.50th=[147850], 99.90th=[501220], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 8, max= 191, per=25.47%, avg=83.02, stdev=34.31, samples=148 iops : min= 2, max= 47, avg=20.24, stdev= 8.58, samples=148 lat (usec) : 250=1.14%, 500=1.60%, 750=0.59%, 1000=0.36% lat (msec) : 2=4.43%, 4=6.90%, 10=10.64%, 20=27.41%, 50=36.23% lat (msec) : 100=9.83%, 250=0.75%, 500=0.03%, 750=0.10% cpu : usr=0.10%, sys=10.50%, ctx=7355, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=312KiB/s (320kB/s), 77.9KiB/s-80.4KiB/s (79.8kB/s-82.3kB/s), io=23.4MiB (24.6MB), run=75312-76933msec WRITE: bw=327KiB/s (335kB/s), 81.7KiB/s-83.3KiB/s (83.7kB/s-85.3kB/s), io=24.6MiB (25.7MB), run=75312-76933msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154062: Wed Mar 4 22:10:16 2026 read: IOPS=11, BW=45.1KiB/s (46.2kB/s)(5992KiB/132909msec) clat (msec): min=3, max=788, avg=21.98, stdev=31.86 lat (msec): min=3, max=788, avg=21.98, stdev=31.86 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 58], | 99.00th=[ 115], 99.50th=[ 190], 99.90th=[ 372], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 143, per=25.79%, avg=46.42, stdev=30.41, samples=254 iops : min= 1, max= 35, avg=11.10, stdev= 7.70, samples=254 write: IOPS=11, BW=47.4KiB/s (48.5kB/s)(6296KiB/132909msec); 0 zone resets clat (msec): min=18, max=821, avg=63.36, stdev=48.79 lat (msec): min=18, max=821, avg=63.36, stdev=48.79 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 67], 80.00th=[ 82], 90.00th=[ 110], 95.00th=[ 153], | 99.00th=[ 234], 99.50th=[ 296], 99.90th=[ 567], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 103, per=25.44%, avg=47.83, stdev=24.59, samples=259 iops : min= 1, max= 25, avg=11.45, stdev= 6.25, samples=259 lat (msec) : 4=0.10%, 10=15.92%, 20=15.40%, 50=40.62%, 100=20.70% lat (msec) : 250=6.71%, 500=0.46%, 750=0.03%, 1000=0.07% cpu : usr=0.04%, sys=3.51%, ctx=5916, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154063: Wed Mar 4 22:10:16 2026 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(5940KiB/133197msec) clat (msec): min=3, max=630, avg=22.50, stdev=28.96 lat (msec): min=3, max=630, avg=22.50, stdev=28.96 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 61], | 99.00th=[ 125], 99.50th=[ 163], 99.90th=[ 347], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 5, max= 128, per=25.68%, avg=46.23, stdev=28.80, samples=252 iops : min= 1, max= 32, avg=11.05, stdev= 7.27, samples=252 write: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6348KiB/133197msec); 0 zone resets clat (msec): min=18, max=932, avg=62.71, stdev=48.56 lat (msec): min=18, max=932, avg=62.72, stdev=48.56 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 56], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 114], 95.00th=[ 146], | 99.00th=[ 239], 99.50th=[ 257], 99.90th=[ 625], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 5, max= 104, per=25.22%, avg=47.40, stdev=25.53, samples=262 iops : min= 1, max= 26, avg=11.35, stdev= 6.49, samples=262 lat (msec) : 4=0.03%, 10=15.79%, 20=14.16%, 50=41.24%, 100=21.42% lat (msec) : 250=6.90%, 500=0.36%, 750=0.07%, 1000=0.03% cpu : usr=0.06%, sys=3.44%, ctx=5908, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154064: Wed Mar 4 22:10:16 2026 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6028KiB/132924msec) clat (msec): min=3, max=225, avg=22.34, stdev=21.61 lat (msec): min=3, max=225, avg=22.35, stdev=21.61 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 62], | 99.00th=[ 107], 99.50th=[ 155], 99.90th=[ 211], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 7, max= 152, per=25.74%, avg=46.33, stdev=29.03, samples=256 iops : min= 1, max= 38, avg=11.08, stdev= 7.33, samples=256 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6260KiB/132924msec); 0 zone resets clat (msec): min=16, max=737, avg=63.26, stdev=50.12 lat (msec): min=16, max=737, avg=63.27, stdev=50.12 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 56], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 249], 99.50th=[ 296], 99.90th=[ 676], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 5, max= 104, per=25.09%, avg=47.17, stdev=25.03, samples=261 iops : min= 1, max= 26, avg=11.29, stdev= 6.36, samples=261 lat (msec) : 4=0.13%, 10=13.74%, 20=16.02%, 50=41.57%, 100=21.81% lat (msec) : 250=6.25%, 500=0.36%, 750=0.13% cpu : usr=0.06%, sys=3.52%, ctx=6028, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154065: Wed Mar 4 22:10:16 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6052KiB/132215msec) clat (msec): min=3, max=371, avg=21.48, stdev=21.45 lat (msec): min=3, max=371, avg=21.49, stdev=21.45 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 56], | 99.00th=[ 106], 99.50th=[ 133], 99.90th=[ 188], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 144, per=26.68%, avg=48.02, stdev=28.98, samples=247 iops : min= 1, max= 36, avg=11.50, stdev= 7.34, samples=247 write: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6236KiB/132215msec); 0 zone resets clat (msec): min=18, max=685, avg=63.80, stdev=49.72 lat (msec): min=18, max=685, avg=63.80, stdev=49.72 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 50], 60.00th=[ 57], | 70.00th=[ 65], 80.00th=[ 81], 90.00th=[ 112], 95.00th=[ 150], | 99.00th=[ 247], 99.50th=[ 309], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 104, per=25.03%, avg=47.05, stdev=23.92, samples=259 iops : min= 1, max= 26, avg=11.26, stdev= 6.09, samples=259 lat (msec) : 4=0.10%, 10=14.71%, 20=15.76%, 50=40.85%, 100=21.55% lat (msec) : 250=6.54%, 500=0.39%, 750=0.10% cpu : usr=0.06%, sys=3.59%, ctx=5871, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=180KiB/s (185kB/s), 44.6KiB/s-45.8KiB/s (45.7kB/s-46.9kB/s), io=23.4MiB (24.6MB), run=132215-133197msec WRITE: bw=189KiB/s (193kB/s), 47.1KiB/s-47.7KiB/s (48.2kB/s-48.8kB/s), io=24.6MiB (25.7MB), run=132215-133197msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154104: Wed Mar 4 22:10:36 2026 read: IOPS=26, BW=419KiB/s (429kB/s)(5920KiB/14118msec) clat (usec): min=136, max=75433, avg=19681.96, stdev=14271.20 lat (usec): min=136, max=75434, avg=19687.85, stdev=14270.44 clat percentiles (usec): | 1.00th=[ 192], 5.00th=[ 322], 10.00th=[ 490], 20.00th=[ 7832], | 30.00th=[13304], 40.00th=[15795], 50.00th=[18220], 60.00th=[21103], | 70.00th=[24773], 80.00th=[30540], 90.00th=[37487], 95.00th=[45351], | 99.00th=[66323], 99.50th=[71828], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 224, max= 570, per=24.09%, avg=408.52, stdev=94.08, samples=27 iops : min= 14, max= 35, avg=24.93, stdev= 5.84, samples=27 write: IOPS=28, BW=451KiB/s (462kB/s)(6368KiB/14118msec); 0 zone resets clat (usec): min=1177, max=89578, avg=16994.69, stdev=14547.26 lat (usec): min=1179, max=89581, avg=16997.33, stdev=14547.16 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2278], 10.00th=[ 3261], 20.00th=[ 4293], | 30.00th=[ 5800], 40.00th=[ 9765], 50.00th=[13566], 60.00th=[17433], | 70.00th=[21890], 80.00th=[27657], 90.00th=[35390], 95.00th=[46924], | 99.00th=[65799], 99.50th=[73925], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 221, max= 768, per=24.64%, avg=439.67, stdev=129.12, samples=27 iops : min= 13, max= 48, avg=26.85, stdev= 8.22, samples=27 lat (usec) : 250=1.82%, 500=3.12%, 750=2.34%, 1000=1.30% lat (msec) : 2=2.47%, 4=7.29%, 10=13.54%, 20=29.56%, 50=35.42% lat (msec) : 100=3.12% cpu : usr=0.16%, sys=20.71%, ctx=2149, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154105: Wed Mar 4 22:10:36 2026 read: IOPS=25, BW=411KiB/s (421kB/s)(5744KiB/13964msec) clat (usec): min=160, max=118696, avg=19963.34, stdev=16031.91 lat (usec): min=161, max=118697, avg=19965.82, stdev=16031.48 clat percentiles (usec): | 1.00th=[ 223], 5.00th=[ 449], 10.00th=[ 553], 20.00th=[ 9634], | 30.00th=[ 12649], 40.00th=[ 15270], 50.00th=[ 18482], 60.00th=[ 20579], | 70.00th=[ 24773], 80.00th=[ 28967], 90.00th=[ 35914], 95.00th=[ 46400], | 99.00th=[ 79168], 99.50th=[106431], 99.90th=[119014], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 159, max= 576, per=24.30%, avg=412.11, stdev=102.05, samples=27 iops : min= 9, max= 36, avg=25.15, stdev= 6.50, samples=27 write: IOPS=29, BW=469KiB/s (480kB/s)(6544KiB/13964msec); 0 zone resets clat (usec): min=1199, max=98549, avg=16523.23, stdev=13386.38 lat (usec): min=1200, max=98553, avg=16525.70, stdev=13386.15 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2638], 10.00th=[ 3458], 20.00th=[ 4948], | 30.00th=[ 6783], 40.00th=[ 9503], 50.00th=[12911], 60.00th=[16188], | 70.00th=[20841], 80.00th=[26608], 90.00th=[35914], 95.00th=[42730], | 99.00th=[52691], 99.50th=[58983], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 192, max= 728, per=26.02%, avg=464.26, stdev=140.82, samples=27 iops : min= 12, max= 45, avg=28.41, stdev= 8.80, samples=27 lat (usec) : 250=0.52%, 500=2.86%, 750=2.86%, 1000=0.78% lat (msec) : 2=2.47%, 4=6.12%, 10=16.67%, 20=29.95%, 50=34.90% lat (msec) : 100=2.60%, 250=0.26% cpu : usr=0.12%, sys=21.07%, ctx=2157, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154106: Wed Mar 4 22:10:36 2026 read: IOPS=28, BW=459KiB/s (470kB/s)(6256KiB/13639msec) clat (usec): min=104, max=111394, avg=18378.42, stdev=13739.73 lat (usec): min=104, max=111396, avg=18379.62, stdev=13739.80 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 293], 10.00th=[ 498], 20.00th=[ 7046], | 30.00th=[ 12256], 40.00th=[ 14877], 50.00th=[ 17171], 60.00th=[ 20317], | 70.00th=[ 23725], 80.00th=[ 27919], 90.00th=[ 34341], 95.00th=[ 42730], | 99.00th=[ 60556], 99.50th=[ 78119], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 255, max= 798, per=27.76%, avg=470.81, stdev=126.66, samples=26 iops : min= 15, max= 49, avg=28.81, stdev= 7.90, samples=26 write: IOPS=27, BW=442KiB/s (453kB/s)(6032KiB/13639msec); 0 zone resets clat (usec): min=1070, max=71168, avg=16932.47, stdev=14588.49 lat (usec): min=1071, max=71170, avg=16935.58, stdev=14588.69 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 2442], 10.00th=[ 3097], 20.00th=[ 4490], | 30.00th=[ 5932], 40.00th=[ 8979], 50.00th=[12518], 60.00th=[16581], | 70.00th=[21365], 80.00th=[28443], 90.00th=[36963], 95.00th=[46924], | 99.00th=[64226], 99.50th=[68682], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 223, max= 685, per=24.87%, avg=443.73, stdev=133.85, samples=26 iops : min= 13, max= 42, avg=27.12, stdev= 8.38, samples=26 lat (usec) : 250=1.82%, 500=3.39%, 750=2.34%, 1000=1.04% lat (msec) : 2=2.08%, 4=7.16%, 10=15.76%, 20=29.30%, 50=34.11% lat (msec) : 100=2.86%, 250=0.13% cpu : usr=0.17%, sys=20.86%, ctx=2118, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154107: Wed Mar 4 22:10:36 2026 read: IOPS=27, BW=439KiB/s (450kB/s)(6032KiB/13729msec) clat (usec): min=191, max=100263, avg=18340.79, stdev=14624.02 lat (usec): min=191, max=100265, avg=18341.94, stdev=14623.96 clat percentiles (usec): | 1.00th=[ 215], 5.00th=[ 396], 10.00th=[ 498], 20.00th=[ 1663], | 30.00th=[ 11207], 40.00th=[ 14222], 50.00th=[ 16909], 60.00th=[ 20317], | 70.00th=[ 23200], 80.00th=[ 27657], 90.00th=[ 35914], 95.00th=[ 43254], | 99.00th=[ 69731], 99.50th=[100140], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 224, max= 640, per=25.74%, avg=436.63, stdev=125.27, samples=27 iops : min= 14, max= 40, avg=26.67, stdev= 7.85, samples=27 write: IOPS=28, BW=456KiB/s (467kB/s)(6256KiB/13729msec); 0 zone resets clat (usec): min=1092, max=129853, avg=17194.96, stdev=14895.69 lat (usec): min=1094, max=129855, avg=17197.18, stdev=14896.10 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2442], 10.00th=[ 3392], 20.00th=[ 4752], | 30.00th=[ 6980], 40.00th=[ 9634], 50.00th=[ 13173], 60.00th=[ 16909], | 70.00th=[ 20841], 80.00th=[ 27657], 90.00th=[ 38011], 95.00th=[ 45351], | 99.00th=[ 60556], 99.50th=[ 66323], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 287, max= 670, per=25.49%, avg=454.67, stdev=101.95, samples=27 iops : min= 17, max= 41, avg=27.78, stdev= 6.48, samples=27 lat (usec) : 250=0.91%, 500=4.04%, 750=2.86%, 1000=1.17% lat (msec) : 2=2.73%, 4=5.47%, 10=16.41%, 20=30.34%, 50=33.07% lat (msec) : 100=2.60%, 250=0.39% cpu : usr=0.10%, sys=21.23%, ctx=2119, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1697KiB/s (1737kB/s), 411KiB/s-459KiB/s (421kB/s-470kB/s), io=23.4MiB (24.5MB), run=13639-14118msec WRITE: bw=1785KiB/s (1828kB/s), 442KiB/s-469KiB/s (453kB/s-480kB/s), io=24.6MiB (25.8MB), run=13639-14118msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154109: Wed Mar 4 22:10:48 2026 read: IOPS=14, BW=229KiB/s (234kB/s)(5920KiB/25864msec) clat (usec): min=4150, max=96377, avg=18800.88, stdev=14607.01 lat (usec): min=4151, max=96377, avg=18801.91, stdev=14607.05 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 6063], 10.00th=[ 6718], 20.00th=[ 8455], | 30.00th=[10028], 40.00th=[12125], 50.00th=[13698], 60.00th=[16712], | 70.00th=[20579], 80.00th=[26870], 90.00th=[37487], 95.00th=[48497], | 99.00th=[79168], 99.50th=[90702], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 31, max= 576, per=24.53%, avg=226.94, stdev=121.23, samples=51 iops : min= 1, max= 36, avg=13.73, stdev= 7.71, samples=51 write: IOPS=15, BW=246KiB/s (252kB/s)(6368KiB/25864msec); 0 zone resets clat (msec): min=16, max=132, avg=47.39, stdev=25.44 lat (msec): min=16, max=132, avg=47.39, stdev=25.44 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 54], 80.00th=[ 64], 90.00th=[ 86], 95.00th=[ 103], | 99.00th=[ 132], 99.50th=[ 133], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 95, max= 480, per=25.22%, avg=245.39, stdev=112.57, samples=51 iops : min= 5, max= 30, avg=14.88, stdev= 7.16, samples=51 lat (msec) : 10=14.19%, 20=19.79%, 50=45.44%, 100=17.45%, 250=3.12% cpu : usr=0.06%, sys=6.44%, ctx=1650, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154110: Wed Mar 4 22:10:48 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(5744KiB/25889msec) clat (msec): min=3, max=137, avg=19.00, stdev=17.31 lat (msec): min=3, max=137, avg=19.00, stdev=17.31 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 95], 99.50th=[ 136], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 544, per=24.81%, avg=229.53, stdev=131.35, samples=49 iops : min= 1, max= 34, avg=13.88, stdev= 8.34, samples=49 write: IOPS=15, BW=253KiB/s (259kB/s)(6544KiB/25889msec); 0 zone resets clat (msec): min=12, max=152, avg=46.39, stdev=24.17 lat (msec): min=12, max=152, avg=46.39, stdev=24.17 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 46], | 70.00th=[ 53], 80.00th=[ 63], 90.00th=[ 81], 95.00th=[ 95], | 99.00th=[ 142], 99.50th=[ 144], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 94, max= 544, per=25.74%, avg=250.49, stdev=111.47, samples=51 iops : min= 5, max= 34, avg=15.20, stdev= 7.11, samples=51 lat (msec) : 4=0.52%, 10=14.19%, 20=19.92%, 50=46.09%, 100=16.93% lat (msec) : 250=2.34% cpu : usr=0.09%, sys=6.40%, ctx=1682, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154111: Wed Mar 4 22:10:48 2026 read: IOPS=15, BW=245KiB/s (251kB/s)(6256KiB/25543msec) clat (msec): min=3, max=138, avg=19.46, stdev=17.32 lat (msec): min=3, max=138, avg=19.46, stdev=17.32 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 57], | 99.00th=[ 97], 99.50th=[ 114], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 608, per=26.50%, avg=245.08, stdev=142.01, samples=50 iops : min= 3, max= 38, avg=14.86, stdev= 8.94, samples=50 write: IOPS=14, BW=236KiB/s (242kB/s)(6032KiB/25543msec); 0 zone resets clat (msec): min=18, max=155, avg=47.27, stdev=24.22 lat (msec): min=18, max=155, avg=47.27, stdev=24.22 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 79], 95.00th=[ 97], | 99.00th=[ 133], 99.50th=[ 144], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 64, max= 480, per=23.87%, avg=232.30, stdev=105.21, samples=50 iops : min= 4, max= 30, avg=14.06, stdev= 6.71, samples=50 lat (msec) : 4=0.13%, 10=15.63%, 20=20.96%, 50=43.62%, 100=17.19% lat (msec) : 250=2.47% cpu : usr=0.06%, sys=6.56%, ctx=1683, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154112: Wed Mar 4 22:10:48 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(6032KiB/25780msec) clat (msec): min=4, max=136, avg=18.71, stdev=16.11 lat (msec): min=4, max=136, avg=18.71, stdev=16.11 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 38], 95.00th=[ 54], | 99.00th=[ 85], 99.50th=[ 96], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 63, max= 512, per=25.17%, avg=232.82, stdev=126.59, samples=51 iops : min= 3, max= 32, avg=14.10, stdev= 8.01, samples=51 write: IOPS=15, BW=243KiB/s (248kB/s)(6256KiB/25780msec); 0 zone resets clat (msec): min=14, max=167, avg=47.66, stdev=26.00 lat (msec): min=14, max=167, avg=47.66, stdev=26.00 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 54], 80.00th=[ 65], 90.00th=[ 84], 95.00th=[ 105], | 99.00th=[ 136], 99.50th=[ 159], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 96, max= 512, per=24.96%, avg=242.90, stdev=113.56, samples=51 iops : min= 6, max= 32, avg=14.73, stdev= 7.23, samples=51 lat (msec) : 10=17.58%, 20=19.01%, 50=42.45%, 100=17.97%, 250=2.99% cpu : usr=0.10%, sys=6.54%, ctx=1701, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=925KiB/s (947kB/s), 222KiB/s-245KiB/s (227kB/s-251kB/s), io=23.4MiB (24.5MB), run=25543-25889msec WRITE: bw=973KiB/s (997kB/s), 236KiB/s-253KiB/s (242kB/s-259kB/s), io=24.6MiB (25.8MB), run=25543-25889msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154121: Wed Mar 4 22:10:57 2026 read: IOPS=3, BW=3444KiB/s (3527kB/s)(7168KiB/2081msec) clat (msec): min=37, max=215, avg=123.01, stdev=62.88 lat (msec): min=37, max=215, avg=123.01, stdev=62.88 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 106], 60.00th=[ 155], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 4079, max= 5251, per=94.24%, avg=4665.00, stdev=828.73, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2460KiB/s (2519kB/s)(5120KiB/2081msec); 0 zone resets clat (msec): min=120, max=454, avg=229.93, stdev=131.27 lat (msec): min=120, max=454, avg=230.00, stdev=131.26 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2039, max= 4055, per=43.97%, avg=3047.00, stdev=1425.53, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=66.67%, 500=8.33% cpu : usr=0.00%, sys=12.21%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154122: Wed Mar 4 22:10:57 2026 read: IOPS=0, BW=495KiB/s (507kB/s)(2048KiB/4137msec) clat (msec): min=42, max=104, avg=73.44, stdev=44.37 lat (msec): min=42, max=104, avg=73.45, stdev=44.37 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 43], 40.00th=[ 43], 50.00th=[ 43], 60.00th=[ 105], | 70.00th=[ 105], 80.00th=[ 105], 90.00th=[ 105], 95.00th=[ 105], | 99.00th=[ 105], 99.50th=[ 105], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 1744, max= 2043, per=38.25%, avg=1893.50, stdev=211.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2475KiB/s (2535kB/s)(10.0MiB/4137msec); 0 zone resets clat (msec): min=89, max=1683, avg=385.67, stdev=480.21 lat (msec): min=89, max=1683, avg=386.30, stdev=480.16 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 95], | 30.00th=[ 121], 40.00th=[ 132], 50.00th=[ 180], 60.00th=[ 292], | 70.00th=[ 342], 80.00th=[ 368], 90.00th=[ 558], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 2039, max= 6144, per=53.00%, avg=3672.80, stdev=1714.87, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=6.53%, ctx=113, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154124: Wed Mar 4 22:10:57 2026 read: IOPS=1, BW=1557KiB/s (1595kB/s)(6144KiB/3945msec) clat (msec): min=36, max=210, avg=102.15, stdev=58.16 lat (msec): min=36, max=210, avg=102.15, stdev=58.16 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 91], 50.00th=[ 91], 60.00th=[ 95], | 70.00th=[ 106], 80.00th=[ 106], 90.00th=[ 211], 95.00th=[ 211], | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 2015, max= 8110, per=100.00%, avg=5062.50, stdev=4309.82, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1557KiB/s (1595kB/s)(6144KiB/3945msec); 0 zone resets clat (msec): min=86, max=1951, avg=543.15, stdev=709.96 lat (msec): min=86, max=1951, avg=543.23, stdev=709.96 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 359], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 2015, max= 3518, per=34.63%, avg=2399.75, stdev=745.56, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=33.33%, 500=8.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=5.73%, ctx=114, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154125: Wed Mar 4 22:10:57 2026 read: IOPS=1, BW=1353KiB/s (1385kB/s)(5120KiB/3785msec) clat (msec): min=88, max=391, avg=186.97, stdev=117.94 lat (msec): min=88, max=391, avg=186.97, stdev=117.94 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 4055, max= 4079, per=82.16%, avg=4067.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1894KiB/s (1939kB/s)(7168KiB/3785msec); 0 zone resets clat (msec): min=85, max=1826, avg=403.55, stdev=630.08 lat (msec): min=85, max=1826, avg=403.64, stdev=630.08 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 157], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 275], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 2039, max= 5324, per=54.81%, avg=3798.00, stdev=1654.85, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=5.92%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4950KiB/s (5069kB/s), 495KiB/s-3444KiB/s (507kB/s-3527kB/s), io=20.0MiB (20.0MB), run=2081-4137msec WRITE: bw=6931KiB/s (7097kB/s), 1557KiB/s-2475KiB/s (1595kB/s-2535kB/s), io=28.0MiB (29.4MB), run=2081-4137msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154126: Wed Mar 4 22:10:58 2026 read: IOPS=1, BW=1883KiB/s (1929kB/s)(7168KiB/3806msec) clat (usec): min=471, max=2708.1k, avg=445811.12, stdev=999926.81 lat (usec): min=471, max=2708.1k, avg=445812.42, stdev=999926.87 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], | 20.00th=[ 660], 30.00th=[ 1369], 40.00th=[ 1369], | 50.00th=[ 124257], 60.00th=[ 131597], 70.00th=[ 131597], | 80.00th=[ 154141], 90.00th=[2701132], 95.00th=[2701132], | 99.00th=[2701132], 99.50th=[2701132], 99.90th=[2701132], | 99.95th=[2701132], 99.99th=[2701132] bw ( KiB/s): min= 3518, max= 6047, per=96.71%, avg=4782.50, stdev=1788.27, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1345KiB/s (1378kB/s)(5120KiB/3806msec); 0 zone resets clat (msec): min=48, max=197, avg=109.68, stdev=56.40 lat (msec): min=48, max=197, avg=109.73, stdev=56.42 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 49], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 96], 60.00th=[ 96], | 70.00th=[ 127], 80.00th=[ 127], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 50=8.33%, 100=16.67%, 250=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=14.90%, ctx=686, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154127: Wed Mar 4 22:10:58 2026 read: IOPS=0, BW=495KiB/s (506kB/s)(2048KiB/4141msec) clat (usec): min=914, max=180771, avg=90843.06, stdev=127177.53 lat (usec): min=915, max=180773, avg=90844.51, stdev=127178.96 clat percentiles (usec): | 1.00th=[ 914], 5.00th=[ 914], 10.00th=[ 914], 20.00th=[ 914], | 30.00th=[ 914], 40.00th=[ 914], 50.00th=[ 914], 60.00th=[181404], | 70.00th=[181404], 80.00th=[181404], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 1750, max= 2043, per=38.35%, avg=1896.50, stdev=207.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2473KiB/s (2532kB/s)(10.0MiB/4141msec); 0 zone resets clat (msec): min=93, max=1678, avg=385.87, stdev=487.53 lat (msec): min=94, max=1678, avg=385.94, stdev=487.54 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 124], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 133], 60.00th=[ 148], | 70.00th=[ 380], 80.00th=[ 435], 90.00th=[ 625], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1969, max= 6131, per=52.85%, avg=3658.60, stdev=2257.14, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=18.00%, ctx=188, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154128: Wed Mar 4 22:10:58 2026 read: IOPS=1, BW=1556KiB/s (1593kB/s)(6144KiB/3949msec) clat (usec): min=1071, max=187706, avg=117546.39, stdev=71092.34 lat (usec): min=1072, max=187707, avg=117547.63, stdev=71092.32 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1074], 10.00th=[ 1074], 20.00th=[ 87557], | 30.00th=[ 87557], 40.00th=[ 91751], 50.00th=[ 91751], 60.00th=[164627], | 70.00th=[173016], 80.00th=[173016], 90.00th=[187696], 95.00th=[187696], | 99.00th=[187696], 99.50th=[187696], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 4087, max= 4087, per=82.65%, avg=4087.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1556KiB/s (1593kB/s)(6144KiB/3949msec); 0 zone resets clat (msec): min=174, max=1665, avg=525.55, stdev=573.27 lat (msec): min=174, max=1665, avg=525.63, stdev=573.24 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 288], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1744, max= 2043, per=28.35%, avg=1962.80, stdev=126.00, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 2=8.33%, 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=18.52%, ctx=348, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154129: Wed Mar 4 22:10:58 2026 read: IOPS=1, BW=1324KiB/s (1356kB/s)(5120KiB/3867msec) clat (usec): min=657, max=279379, avg=134066.27, stdev=132173.15 lat (usec): min=657, max=279380, avg=134067.26, stdev=132173.32 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[ 865], 40.00th=[ 865], 50.00th=[141558], 60.00th=[141558], | 70.00th=[248513], 80.00th=[248513], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2043, max= 6131, per=82.65%, avg=4087.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1854KiB/s (1898kB/s)(7168KiB/3867msec); 0 zone resets clat (msec): min=52, max=1735, avg=453.04, stdev=582.51 lat (msec): min=52, max=1735, avg=453.38, stdev=582.40 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 153], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 220], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 502], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1735, max= 3938, per=37.15%, avg=2572.00, stdev=1192.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=19.17%, ctx=251, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4946KiB/s (5064kB/s), 495KiB/s-1883KiB/s (506kB/s-1929kB/s), io=20.0MiB (20.0MB), run=3806-4141msec WRITE: bw=6924KiB/s (7090kB/s), 1345KiB/s-2473KiB/s (1378kB/s-2532kB/s), io=28.0MiB (29.4MB), run=3806-4141msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154135: Wed Mar 4 22:11:08 2026 read: IOPS=0, BW=3514KiB/s (3598kB/s)(12.0MiB/3497msec) clat (msec): min=542, max=2162, avg=1126.44, stdev=899.71 lat (msec): min=542, max=2162, avg=1126.44, stdev=899.71 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.64%, ctx=95, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154136: Wed Mar 4 22:11:08 2026 read: IOPS=0, BW=1140KiB/s (1168kB/s)(4096KiB/3592msec) clat (nsec): min=240344k, max=240344k, avg=240344267.00, stdev= 0.00 lat (nsec): min=240345k, max=240345k, avg=240345237.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 6736, max= 6736, per=100.00%, avg=6736.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2281KiB/s (2335kB/s)(8192KiB/3592msec); 0 zone resets clat (msec): min=817, max=2343, avg=1580.71, stdev=1079.35 lat (msec): min=817, max=2344, avg=1581.05, stdev=1079.28 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8078, max= 8078, per=97.68%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=8.02%, ctx=91, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154139: Wed Mar 4 22:11:08 2026 write: IOPS=0, BW=3101KiB/s (3176kB/s)(12.0MiB/3962msec); 0 zone resets clat (msec): min=614, max=2574, avg=1278.62, stdev=1122.71 lat (msec): min=614, max=2575, avg=1278.99, stdev=1122.77 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 7937, max= 8078, per=96.83%, avg=8007.50, stdev=99.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.88%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154141: Wed Mar 4 22:11:08 2026 write: IOPS=0, BW=3788KiB/s (3879kB/s)(12.0MiB/3244msec); 0 zone resets clat (msec): min=279, max=2185, avg=1064.24, stdev=996.67 lat (msec): min=279, max=2186, avg=1064.64, stdev=996.83 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8015, max= 8110, per=97.49%, avg=8062.50, stdev=67.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.78%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4561KiB/s (4671kB/s), 1140KiB/s-3514KiB/s (1168kB/s-3598kB/s), io=16.0MiB (16.8MB), run=3497-3592msec WRITE: bw=8271KiB/s (8469kB/s), 2281KiB/s-3788KiB/s (2335kB/s-3879kB/s), io=32.0MiB (33.6MB), run=3244-3962msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154137: Wed Mar 4 22:11:08 2026 read: IOPS=0, BW=3651KiB/s (3738kB/s)(12.0MiB/3366msec) clat (msec): min=508, max=2106, avg=1104.03, stdev=873.00 lat (msec): min=508, max=2106, avg=1104.03, stdev=873.00 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=14.86%, ctx=1053, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154138: Wed Mar 4 22:11:08 2026 read: IOPS=0, BW=1075KiB/s (1101kB/s)(4096KiB/3811msec) clat (nsec): min=2119.0M, max=2119.0M, avg=2119008658.00, stdev= 0.00 lat (nsec): min=2119.0M, max=2119.0M, avg=2119010274.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 2123], 20.00th=[ 2123], | 30.00th=[ 2123], 40.00th=[ 2123], 50.00th=[ 2123], 60.00th=[ 2123], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2150KiB/s (2201kB/s)(8192KiB/3811msec); 0 zone resets clat (msec): min=717, max=896, avg=806.90, stdev=126.46 lat (msec): min=717, max=896, avg=807.24, stdev=126.50 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7984, max= 7984, per=93.17%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=10.18%, ctx=525, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154140: Wed Mar 4 22:11:08 2026 write: IOPS=0, BW=3213KiB/s (3291kB/s)(12.0MiB/3824msec); 0 zone resets clat (msec): min=194, max=2812, avg=1245.86, stdev=1383.20 lat (msec): min=194, max=2813, avg=1246.27, stdev=1383.36 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 7984, max= 7984, per=93.17%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.78%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154142: Wed Mar 4 22:11:08 2026 write: IOPS=0, BW=3977KiB/s (4072kB/s)(12.0MiB/3090msec); 0 zone resets clat (msec): min=317, max=1854, avg=1004.52, stdev=781.35 lat (msec): min=317, max=1854, avg=1005.05, stdev=781.23 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8126, max= 8175, per=95.12%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.41%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4299KiB/s (4402kB/s), 1075KiB/s-3651KiB/s (1101kB/s-3738kB/s), io=16.0MiB (16.8MB), run=3366-3811msec WRITE: bw=8569KiB/s (8775kB/s), 2150KiB/s-3977KiB/s (2201kB/s-4072kB/s), io=32.0MiB (33.6MB), run=3090-3824msec