== sanity test 398b: DIO and buffer IO race ============== 06:06:59 (1769080019) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.26136 s, 11.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146452: Thu Jan 22 06:08:47 2026 read: IOPS=16, BW=65.0KiB/s (66.6kB/s)(5992KiB/92147msec) clat (usec): min=68, max=330572, avg=29696.56, stdev=23113.10 lat (usec): min=68, max=330574, avg=29698.18, stdev=23113.11 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 178], 10.00th=[ 562], 20.00th=[ 14484], | 30.00th=[ 18482], 40.00th=[ 21890], 50.00th=[ 25822], 60.00th=[ 30278], | 70.00th=[ 35914], 80.00th=[ 43254], 90.00th=[ 54789], 95.00th=[ 65799], | 99.00th=[104334], 99.50th=[143655], 99.90th=[193987], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 21, max= 134, per=25.44%, avg=64.63, stdev=23.49, samples=182 iops : min= 5, max= 33, avg=15.54, stdev= 5.90, samples=182 write: IOPS=17, BW=68.3KiB/s (69.0kB/s)(6296KiB/92147msec); 0 zone resets clat (usec): min=692, max=565000, avg=30149.54, stdev=31863.49 lat (usec): min=693, max=565003, avg=30152.69, stdev=31866.59 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1319], 10.00th=[ 1680], 20.00th=[ 3621], | 30.00th=[ 7963], 40.00th=[ 15139], 50.00th=[ 23725], 60.00th=[ 30802], | 70.00th=[ 39584], 80.00th=[ 52167], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[121111], 99.50th=[143655], 99.90th=[252707], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 15, max= 143, per=25.66%, avg=68.24, stdev=22.90, samples=181 iops : min= 3, max= 35, avg=16.44, stdev= 5.75, samples=181 lat (usec) : 100=0.03%, 250=4.04%, 500=0.75%, 750=0.29%, 1000=0.39% lat (msec) : 2=6.25%, 4=5.05%, 10=6.74%, 20=16.70%, 50=41.99% lat (msec) : 100=15.95%, 250=1.73%, 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=7.21%, ctx=6686, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146453: Thu Jan 22 06:08:47 2026 read: IOPS=16, BW=64.0KiB/s (65.6kB/s)(5940KiB/92753msec) clat (usec): min=85, max=554572, avg=31087.88, stdev=24317.61 lat (usec): min=86, max=554575, avg=31089.52, stdev=24317.56 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 196], 10.00th=[ 10552], 20.00th=[ 16188], | 30.00th=[ 19792], 40.00th=[ 23462], 50.00th=[ 26870], 60.00th=[ 31327], | 70.00th=[ 37487], 80.00th=[ 45876], 90.00th=[ 56361], 95.00th=[ 67634], | 99.00th=[ 95945], 99.50th=[110625], 99.90th=[160433], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 135, per=25.15%, avg=63.89, stdev=22.23, samples=183 iops : min= 1, max= 33, avg=15.36, stdev= 5.57, samples=183 write: IOPS=17, BW=68.4KiB/s (70.1kB/s)(6348KiB/92753msec); 0 zone resets clat (usec): min=748, max=246130, avg=29165.70, stdev=28032.68 lat (usec): min=749, max=246132, avg=29169.51, stdev=28034.61 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1287], 10.00th=[ 1663], 20.00th=[ 3720], | 30.00th=[ 6783], 40.00th=[ 15401], 50.00th=[ 23200], 60.00th=[ 29754], | 70.00th=[ 38536], 80.00th=[ 50070], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[119014], 99.50th=[127402], 99.90th=[145753], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 23, max= 151, per=25.71%, avg=68.39, stdev=23.98, samples=183 iops : min= 5, max= 37, avg=16.47, stdev= 6.00, samples=183 lat (usec) : 100=0.07%, 250=2.96%, 500=0.78%, 750=0.10%, 1000=0.39% lat (msec) : 2=6.35%, 4=4.75%, 10=6.84%, 20=15.92%, 50=43.62% lat (msec) : 100=16.57%, 250=1.63%, 750=0.03% cpu : usr=0.11%, sys=7.52%, ctx=6813, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146454: Thu Jan 22 06:08:47 2026 read: IOPS=15, BW=63.8KiB/s (65.3kB/s)(6028KiB/94478msec) clat (usec): min=77, max=242279, avg=29602.16, stdev=21480.00 lat (usec): min=77, max=242281, avg=29604.91, stdev=21480.61 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 178], 10.00th=[ 330], 20.00th=[ 14484], | 30.00th=[ 18744], 40.00th=[ 22676], 50.00th=[ 26346], 60.00th=[ 30278], | 70.00th=[ 36439], 80.00th=[ 44303], 90.00th=[ 56886], 95.00th=[ 66323], | 99.00th=[ 89654], 99.50th=[108528], 99.90th=[217056], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 127, per=25.00%, avg=63.51, stdev=24.58, samples=186 iops : min= 1, max= 31, avg=15.25, stdev= 6.17, samples=186 write: IOPS=16, BW=66.3KiB/s (67.8kB/s)(6260KiB/94478msec); 0 zone resets clat (usec): min=731, max=674253, avg=31668.52, stdev=33987.50 lat (usec): min=732, max=674258, avg=31670.56, stdev=33987.41 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1270], 10.00th=[ 1614], 20.00th=[ 3720], | 30.00th=[ 7308], 40.00th=[ 16319], 50.00th=[ 24511], 60.00th=[ 33424], | 70.00th=[ 42730], 80.00th=[ 53216], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[130548], 99.50th=[156238], 99.90th=[217056], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 15, max= 120, per=24.73%, avg=65.77, stdev=21.76, samples=186 iops : min= 3, max= 30, avg=15.82, stdev= 5.47, samples=186 lat (usec) : 100=0.13%, 250=4.20%, 500=0.94%, 750=0.26%, 1000=0.46% lat (msec) : 2=6.32%, 4=4.33%, 10=7.23%, 20=15.17%, 50=41.80% lat (msec) : 100=17.51%, 250=1.63%, 750=0.03% cpu : usr=0.10%, sys=7.17%, ctx=6647, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146455: Thu Jan 22 06:08:47 2026 read: IOPS=16, BW=64.2KiB/s (65.7kB/s)(6052KiB/94340msec) clat (usec): min=81, max=286220, avg=30320.67, stdev=21583.72 lat (usec): min=81, max=286221, avg=30323.77, stdev=21581.94 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 192], 10.00th=[ 1139], 20.00th=[ 15401], | 30.00th=[ 18744], 40.00th=[ 22414], 50.00th=[ 26346], 60.00th=[ 31065], | 70.00th=[ 36963], 80.00th=[ 44827], 90.00th=[ 56361], 95.00th=[ 66323], | 99.00th=[ 98042], 99.50th=[117965], 99.90th=[158335], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 127, per=25.43%, avg=64.60, stdev=22.67, samples=184 iops : min= 1, max= 31, avg=15.52, stdev= 5.67, samples=184 write: IOPS=16, BW=66.1KiB/s (67.7kB/s)(6236KiB/94340msec); 0 zone resets clat (usec): min=682, max=690454, avg=30932.90, stdev=33984.71 lat (usec): min=683, max=690459, avg=30934.81, stdev=33984.79 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1336], 10.00th=[ 1909], 20.00th=[ 4080], | 30.00th=[ 7832], 40.00th=[ 15139], 50.00th=[ 23200], 60.00th=[ 30278], | 70.00th=[ 41157], 80.00th=[ 52691], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[122160], 99.50th=[141558], 99.90th=[246416], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 134, per=24.72%, avg=65.75, stdev=21.38, samples=186 iops : min= 3, max= 33, avg=15.81, stdev= 5.38, samples=186 lat (usec) : 100=0.03%, 250=3.45%, 500=1.14%, 750=0.16%, 1000=0.52% lat (msec) : 2=4.95%, 4=4.88%, 10=7.49%, 20=16.83%, 50=41.50% lat (msec) : 100=17.15%, 250=1.82%, 500=0.03%, 750=0.03% cpu : usr=0.14%, sys=7.21%, ctx=6866, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=254KiB/s (260kB/s), 63.8KiB/s-65.0KiB/s (65.3kB/s-66.6kB/s), io=23.4MiB (24.6MB), run=92147-94478msec WRITE: bw=266KiB/s (272kB/s), 66.1KiB/s-68.4KiB/s (67.7kB/s-70.1kB/s), io=24.6MiB (25.7MB), run=92147-94478msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146447: Thu Jan 22 06:10:39 2026 read: IOPS=7, BW=29.4KiB/s (30.1kB/s)(5992KiB/203842msec) clat (msec): min=4, max=695, avg=30.27, stdev=30.76 lat (msec): min=4, max=695, avg=30.27, stdev=30.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 60], 95.00th=[ 74], | 99.00th=[ 120], 99.50th=[ 178], 99.90th=[ 275], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 104, per=26.51%, avg=30.75, stdev=19.48, samples=379 iops : min= 1, max= 26, avg= 7.10, stdev= 4.90, samples=379 write: IOPS=7, BW=30.9KiB/s (31.6kB/s)(6296KiB/203842msec); 0 zone resets clat (msec): min=30, max=340, avg=100.50, stdev=42.09 lat (msec): min=30, max=340, avg=100.50, stdev=42.09 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 66], | 30.00th=[ 75], 40.00th=[ 84], 50.00th=[ 91], 60.00th=[ 102], | 70.00th=[ 115], 80.00th=[ 132], 90.00th=[ 159], 95.00th=[ 180], | 99.00th=[ 234], 99.50th=[ 247], 99.90th=[ 309], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 64, per=24.99%, avg=30.49, stdev=12.17, samples=401 iops : min= 1, max= 16, avg= 7.04, stdev= 3.12, samples=401 lat (msec) : 10=5.57%, 20=16.63%, 50=22.23%, 100=33.76%, 250=21.52% lat (msec) : 500=0.26%, 750=0.03% cpu : usr=0.06%, sys=1.69%, ctx=5763, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146448: Thu Jan 22 06:10:39 2026 read: IOPS=7, BW=28.8KiB/s (29.5kB/s)(5940KiB/206046msec) clat (msec): min=3, max=624, avg=29.55, stdev=29.62 lat (msec): min=3, max=624, avg=29.55, stdev=29.62 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 58], 95.00th=[ 79], | 99.00th=[ 120], 99.50th=[ 161], 99.90th=[ 255], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 111, per=26.71%, avg=30.98, stdev=18.89, samples=373 iops : min= 1, max= 27, avg= 7.16, stdev= 4.75, samples=373 write: IOPS=7, BW=30.8KiB/s (31.5kB/s)(6348KiB/206046msec); 0 zone resets clat (msec): min=21, max=377, avg=101.99, stdev=46.96 lat (msec): min=21, max=377, avg=101.99, stdev=46.96 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 47], 10.00th=[ 54], 20.00th=[ 64], | 30.00th=[ 73], 40.00th=[ 83], 50.00th=[ 91], 60.00th=[ 104], | 70.00th=[ 117], 80.00th=[ 138], 90.00th=[ 167], 95.00th=[ 197], | 99.00th=[ 249], 99.50th=[ 284], 99.90th=[ 355], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 95, per=24.78%, avg=30.23, stdev=13.09, samples=408 iops : min= 1, max= 23, avg= 6.97, stdev= 3.34, samples=408 lat (msec) : 4=0.03%, 10=6.28%, 20=17.35%, 50=21.52%, 100=32.23% lat (msec) : 250=22.07%, 500=0.49%, 750=0.03% cpu : usr=0.05%, sys=1.66%, ctx=5733, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146449: Thu Jan 22 06:10:39 2026 read: IOPS=7, BW=29.8KiB/s (30.5kB/s)(6028KiB/202611msec) clat (msec): min=4, max=276, avg=28.96, stdev=25.22 lat (msec): min=4, max=276, avg=28.96, stdev=25.22 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 57], 95.00th=[ 71], | 99.00th=[ 120], 99.50th=[ 159], 99.90th=[ 266], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 112, per=26.28%, avg=30.48, stdev=19.34, samples=385 iops : min= 1, max= 28, avg= 7.04, stdev= 4.89, samples=385 write: IOPS=7, BW=30.9KiB/s (31.6kB/s)(6260KiB/202611msec); 0 zone resets clat (msec): min=28, max=718, avg=101.36, stdev=45.02 lat (msec): min=28, max=718, avg=101.37, stdev=45.02 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 67], | 30.00th=[ 75], 40.00th=[ 84], 50.00th=[ 92], 60.00th=[ 103], | 70.00th=[ 115], 80.00th=[ 131], 90.00th=[ 157], 95.00th=[ 180], | 99.00th=[ 249], 99.50th=[ 268], 99.90th=[ 347], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 71, per=25.04%, avg=30.55, stdev=12.06, samples=399 iops : min= 1, max= 17, avg= 7.06, stdev= 3.09, samples=399 lat (msec) : 10=6.41%, 20=16.57%, 50=21.65%, 100=32.98%, 250=21.88% lat (msec) : 500=0.49%, 750=0.03% cpu : usr=0.05%, sys=1.70%, ctx=5598, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146450: Thu Jan 22 06:10:39 2026 read: IOPS=7, BW=29.9KiB/s (30.6kB/s)(6052KiB/202255msec) clat (msec): min=4, max=212, avg=28.86, stdev=24.20 lat (msec): min=4, max=212, avg=28.86, stdev=24.20 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 58], 95.00th=[ 72], | 99.00th=[ 118], 99.50th=[ 155], 99.90th=[ 192], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 7, max= 104, per=26.80%, avg=31.09, stdev=19.68, samples=379 iops : min= 1, max= 26, avg= 7.19, stdev= 4.96, samples=379 write: IOPS=7, BW=30.8KiB/s (31.6kB/s)(6236KiB/202255msec); 0 zone resets clat (msec): min=26, max=714, avg=101.51, stdev=46.20 lat (msec): min=26, max=714, avg=101.51, stdev=46.20 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 66], | 30.00th=[ 75], 40.00th=[ 84], 50.00th=[ 92], 60.00th=[ 103], | 70.00th=[ 115], 80.00th=[ 133], 90.00th=[ 159], 95.00th=[ 184], | 99.00th=[ 234], 99.50th=[ 292], 99.90th=[ 376], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 71, per=24.83%, avg=30.29, stdev=12.24, samples=400 iops : min= 1, max= 17, avg= 6.99, stdev= 3.13, samples=400 lat (msec) : 10=6.71%, 20=16.80%, 50=22.20%, 100=32.26%, 250=21.71% lat (msec) : 500=0.29%, 750=0.03% cpu : usr=0.06%, sys=1.72%, ctx=5685, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=117KiB/s (119kB/s), 28.8KiB/s-29.9KiB/s (29.5kB/s-30.6kB/s), io=23.4MiB (24.6MB), run=202255-206046msec WRITE: bw=122KiB/s (125kB/s), 30.8KiB/s-30.9KiB/s (31.5kB/s-31.6kB/s), io=24.6MiB (25.7MB), run=202255-206046msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146503: Thu Jan 22 06:11:03 2026 read: IOPS=23, BW=373KiB/s (382kB/s)(5920KiB/15860msec) clat (usec): min=69, max=125924, avg=20646.99, stdev=17341.37 lat (usec): min=69, max=125924, avg=20648.29, stdev=17341.52 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 137], 10.00th=[ 153], 20.00th=[ 322], | 30.00th=[ 11600], 40.00th=[ 15926], 50.00th=[ 19268], 60.00th=[ 23725], | 70.00th=[ 27395], 80.00th=[ 32637], 90.00th=[ 42206], 95.00th=[ 50594], | 99.00th=[ 70779], 99.50th=[ 74974], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 190, max= 629, per=25.27%, avg=373.97, stdev=110.08, samples=31 iops : min= 11, max= 39, avg=22.71, stdev= 6.95, samples=31 write: IOPS=25, BW=402KiB/s (411kB/s)(6368KiB/15860msec); 0 zone resets clat (usec): min=1002, max=137774, avg=20582.92, stdev=21572.36 lat (usec): min=1004, max=137779, avg=20592.27, stdev=21577.08 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1565], 10.00th=[ 1909], 20.00th=[ 3261], | 30.00th=[ 5014], 40.00th=[ 7898], 50.00th=[ 13304], 60.00th=[ 19530], | 70.00th=[ 27919], 80.00th=[ 34341], 90.00th=[ 48497], 95.00th=[ 58459], | 99.00th=[111674], 99.50th=[122160], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 191, max= 702, per=25.92%, avg=403.55, stdev=119.47, samples=31 iops : min= 11, max= 43, avg=24.55, stdev= 7.50, samples=31 lat (usec) : 100=0.26%, 250=8.33%, 500=2.08%, 750=0.52%, 1000=0.13% lat (msec) : 2=6.38%, 4=7.55%, 10=11.20%, 20=19.53%, 50=36.98% lat (msec) : 100=6.38%, 250=0.65% cpu : usr=0.10%, sys=10.25%, ctx=1388, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146504: Thu Jan 22 06:11:03 2026 read: IOPS=22, BW=355KiB/s (364kB/s)(5744KiB/16175msec) clat (usec): min=93, max=85999, avg=21233.34, stdev=17312.03 lat (usec): min=93, max=86000, avg=21234.55, stdev=17312.00 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 141], 10.00th=[ 165], 20.00th=[ 363], | 30.00th=[11469], 40.00th=[15533], 50.00th=[20841], 60.00th=[24249], | 70.00th=[30278], 80.00th=[36439], 90.00th=[43779], 95.00th=[50594], | 99.00th=[77071], 99.50th=[82314], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 118, max= 670, per=24.29%, avg=359.42, stdev=132.08, samples=31 iops : min= 7, max= 41, avg=21.77, stdev= 8.27, samples=31 write: IOPS=25, BW=405KiB/s (414kB/s)(6544KiB/16175msec); 0 zone resets clat (usec): min=984, max=139842, avg=20828.93, stdev=21879.90 lat (usec): min=986, max=139845, avg=20833.54, stdev=21879.35 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1631], 10.00th=[ 2008], 20.00th=[ 3261], | 30.00th=[ 5145], 40.00th=[ 7832], 50.00th=[ 13173], 60.00th=[ 19006], | 70.00th=[ 26870], 80.00th=[ 37487], 90.00th=[ 50070], 95.00th=[ 64226], | 99.00th=[ 93848], 99.50th=[113771], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 192, max= 574, per=26.04%, avg=405.48, stdev=110.61, samples=31 iops : min= 12, max= 35, avg=24.68, stdev= 6.96, samples=31 lat (usec) : 100=0.26%, 250=8.07%, 500=1.82%, 750=0.39%, 1000=0.39% lat (msec) : 2=5.99%, 4=7.94%, 10=12.63%, 20=18.10%, 50=36.72% lat (msec) : 100=7.16%, 250=0.52% cpu : usr=0.15%, sys=10.23%, ctx=1502, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146505: Thu Jan 22 06:11:03 2026 read: IOPS=24, BW=391KiB/s (400kB/s)(6256KiB/16002msec) clat (usec): min=60, max=112249, avg=19202.71, stdev=17269.43 lat (usec): min=61, max=112250, avg=19204.86, stdev=17268.40 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 135], 10.00th=[ 155], 20.00th=[ 221], | 30.00th=[ 6128], 40.00th=[ 13960], 50.00th=[ 17695], 60.00th=[ 21627], | 70.00th=[ 27132], 80.00th=[ 30278], 90.00th=[ 41157], 95.00th=[ 49021], | 99.00th=[ 72877], 99.50th=[ 79168], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 63, max= 702, per=26.85%, avg=397.32, stdev=140.66, samples=31 iops : min= 3, max= 43, avg=24.16, stdev= 8.78, samples=31 write: IOPS=23, BW=377KiB/s (386kB/s)(6032KiB/16002msec); 0 zone resets clat (usec): min=1117, max=173276, avg=22466.53, stdev=26074.65 lat (usec): min=1120, max=173278, avg=22469.22, stdev=26074.94 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1647], 10.00th=[ 2057], 20.00th=[ 3261], | 30.00th=[ 4686], 40.00th=[ 7504], 50.00th=[ 12911], 60.00th=[ 19268], | 70.00th=[ 26608], 80.00th=[ 39060], 90.00th=[ 55313], 95.00th=[ 68682], | 99.00th=[122160], 99.50th=[170918], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 119, max= 574, per=24.13%, avg=375.74, stdev=121.26, samples=31 iops : min= 7, max= 35, avg=22.81, stdev= 7.66, samples=31 lat (usec) : 100=0.65%, 250=10.29%, 500=2.47%, 750=0.91%, 1000=0.13% lat (msec) : 2=5.21%, 4=7.42%, 10=9.77%, 20=21.48%, 50=32.68% lat (msec) : 100=7.81%, 250=1.17% cpu : usr=0.11%, sys=9.99%, ctx=1426, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146506: Thu Jan 22 06:11:03 2026 read: IOPS=23, BW=374KiB/s (383kB/s)(6032KiB/16115msec) clat (usec): min=97, max=174056, avg=20778.38, stdev=18881.30 lat (usec): min=98, max=174058, avg=20780.45, stdev=18881.05 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 143], 10.00th=[ 159], 20.00th=[ 273], | 30.00th=[ 11600], 40.00th=[ 15401], 50.00th=[ 18482], 60.00th=[ 23200], | 70.00th=[ 27132], 80.00th=[ 34866], 90.00th=[ 43779], 95.00th=[ 52691], | 99.00th=[ 76022], 99.50th=[ 83362], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 169, max= 573, per=24.89%, avg=368.32, stdev=102.30, samples=31 iops : min= 10, max= 35, avg=22.32, stdev= 6.36, samples=31 write: IOPS=24, BW=388KiB/s (398kB/s)(6256KiB/16115msec); 0 zone resets clat (usec): min=912, max=141525, avg=21119.21, stdev=22243.35 lat (usec): min=913, max=141527, avg=21121.45, stdev=22243.31 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1713], 10.00th=[ 2073], 20.00th=[ 3326], | 30.00th=[ 5014], 40.00th=[ 7832], 50.00th=[ 13304], 60.00th=[ 19006], | 70.00th=[ 27395], 80.00th=[ 37487], 90.00th=[ 51119], 95.00th=[ 63701], | 99.00th=[111674], 99.50th=[124257], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 169, max= 734, per=24.84%, avg=386.77, stdev=144.24, samples=31 iops : min= 10, max= 45, avg=23.48, stdev= 9.03, samples=31 lat (usec) : 100=0.13%, 250=8.85%, 500=2.73%, 750=0.78%, 1000=0.26% lat (msec) : 2=4.95%, 4=8.07%, 10=11.46%, 20=20.05%, 50=34.38% lat (msec) : 100=7.68%, 250=0.65% cpu : usr=0.10%, sys=10.00%, ctx=1452, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1481KiB/s (1516kB/s), 355KiB/s-391KiB/s (364kB/s-400kB/s), io=23.4MiB (24.5MB), run=15860-16175msec WRITE: bw=1558KiB/s (1595kB/s), 377KiB/s-405KiB/s (386kB/s-414kB/s), io=24.6MiB (25.8MB), run=15860-16175msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146498: Thu Jan 22 06:11:26 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(5920KiB/39500msec) clat (msec): min=4, max=154, avg=21.49, stdev=20.53 lat (msec): min=4, max=154, avg=21.49, stdev=20.53 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 66], | 99.00th=[ 110], 99.50th=[ 148], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 31, max= 415, per=24.83%, avg=149.97, stdev=84.73, samples=77 iops : min= 1, max= 25, avg= 8.61, stdev= 5.34, samples=77 write: IOPS=10, BW=161KiB/s (165kB/s)(6368KiB/39500msec); 0 zone resets clat (msec): min=28, max=235, avg=78.86, stdev=35.16 lat (msec): min=28, max=235, avg=78.88, stdev=35.16 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 36], 10.00th=[ 43], 20.00th=[ 50], | 30.00th=[ 58], 40.00th=[ 65], 50.00th=[ 71], 60.00th=[ 79], | 70.00th=[ 89], 80.00th=[ 106], 90.00th=[ 126], 95.00th=[ 150], | 99.00th=[ 201], 99.50th=[ 209], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 288, per=25.18%, avg=159.92, stdev=63.44, samples=78 iops : min= 1, max= 18, avg= 9.23, stdev= 4.08, samples=78 lat (msec) : 10=14.32%, 20=17.71%, 50=22.40%, 100=33.20%, 250=12.37% cpu : usr=0.06%, sys=2.15%, ctx=1397, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146499: Thu Jan 22 06:11:26 2026 read: IOPS=9, BW=145KiB/s (148kB/s)(5744KiB/39630msec) clat (msec): min=3, max=156, avg=21.73, stdev=21.26 lat (msec): min=3, max=156, avg=21.73, stdev=21.26 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 47], 95.00th=[ 63], | 99.00th=[ 105], 99.50th=[ 148], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 30, max= 479, per=25.00%, avg=151.00, stdev=93.39, samples=74 iops : min= 1, max= 29, avg= 8.66, stdev= 5.92, samples=74 write: IOPS=10, BW=165KiB/s (169kB/s)(6544KiB/39630msec); 0 zone resets clat (msec): min=19, max=241, avg=77.47, stdev=36.14 lat (msec): min=19, max=241, avg=77.48, stdev=36.14 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 36], 10.00th=[ 41], 20.00th=[ 50], | 30.00th=[ 56], 40.00th=[ 62], 50.00th=[ 69], 60.00th=[ 77], | 70.00th=[ 89], 80.00th=[ 106], 90.00th=[ 128], 95.00th=[ 148], | 99.00th=[ 201], 99.50th=[ 203], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 62, max= 288, per=25.51%, avg=161.99, stdev=68.44, samples=78 iops : min= 3, max= 18, avg= 9.36, stdev= 4.36, samples=78 lat (msec) : 4=0.13%, 10=14.06%, 20=17.19%, 50=22.53%, 100=33.72% lat (msec) : 250=12.37% cpu : usr=0.07%, sys=2.19%, ctx=1442, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146500: Thu Jan 22 06:11:26 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38807msec) clat (msec): min=5, max=155, avg=20.82, stdev=19.72 lat (msec): min=5, max=155, avg=20.83, stdev=19.72 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 44], 95.00th=[ 61], | 99.00th=[ 104], 99.50th=[ 144], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 448, per=27.79%, avg=167.86, stdev=109.04, samples=74 iops : min= 1, max= 28, avg= 9.73, stdev= 6.91, samples=74 write: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38807msec); 0 zone resets clat (msec): min=25, max=259, avg=81.02, stdev=38.56 lat (msec): min=25, max=259, avg=81.02, stdev=38.56 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 39], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 64], 50.00th=[ 71], 60.00th=[ 80], | 70.00th=[ 90], 80.00th=[ 106], 90.00th=[ 136], 95.00th=[ 155], | 99.00th=[ 215], 99.50th=[ 241], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 63, max= 288, per=24.41%, avg=154.99, stdev=64.46, samples=77 iops : min= 3, max= 18, avg= 8.92, stdev= 4.12, samples=77 lat (msec) : 10=15.10%, 20=19.79%, 50=20.96%, 100=32.03%, 250=11.98% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.15%, ctx=1420, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146501: Thu Jan 22 06:11:26 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39063msec) clat (msec): min=3, max=157, avg=20.99, stdev=21.64 lat (msec): min=3, max=157, avg=20.99, stdev=21.64 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 29], 90.00th=[ 48], 95.00th=[ 61], | 99.00th=[ 128], 99.50th=[ 150], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 444, per=26.28%, avg=158.73, stdev=87.19, samples=74 iops : min= 1, max= 27, avg= 9.16, stdev= 5.53, samples=74 write: IOPS=10, BW=160KiB/s (164kB/s)(6256KiB/39063msec); 0 zone resets clat (msec): min=29, max=282, avg=79.52, stdev=36.98 lat (msec): min=29, max=282, avg=79.53, stdev=36.98 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 52], | 30.00th=[ 57], 40.00th=[ 65], 50.00th=[ 70], 60.00th=[ 78], | 70.00th=[ 88], 80.00th=[ 103], 90.00th=[ 123], 95.00th=[ 155], | 99.00th=[ 230], 99.50th=[ 257], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 288, per=25.12%, avg=159.52, stdev=63.83, samples=77 iops : min= 1, max= 18, avg= 9.21, stdev= 4.08, samples=77 lat (msec) : 4=0.13%, 10=15.49%, 20=19.27%, 50=18.62%, 100=34.11% lat (msec) : 250=12.11%, 500=0.26% cpu : usr=0.08%, sys=2.18%, ctx=1417, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=604KiB/s (619kB/s), 145KiB/s-161KiB/s (148kB/s-165kB/s), io=23.4MiB (24.5MB), run=38807-39630msec WRITE: bw=636KiB/s (651kB/s), 155KiB/s-165KiB/s (159kB/s-169kB/s), io=24.6MiB (25.8MB), run=38807-39630msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146518: Thu Jan 22 06:11:35 2026 read: IOPS=2, BW=2502KiB/s (2562kB/s)(7168KiB/2865msec) clat (msec): min=49, max=415, avg=146.52, stdev=132.37 lat (msec): min=49, max=415, avg=146.52, stdev=132.36 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 52], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 84], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 215], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1980, max= 5512, per=54.28%, avg=3180.00, stdev=2019.86, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1787KiB/s (1830kB/s)(5120KiB/2865msec); 0 zone resets clat (msec): min=228, max=561, avg=356.62, stdev=130.74 lat (msec): min=228, max=562, avg=356.70, stdev=130.77 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1378, max= 4096, per=28.96%, avg=2375.50, stdev=1185.86, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=6.28%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146519: Thu Jan 22 06:11:35 2026 read: IOPS=0, BW=586KiB/s (600kB/s)(2048KiB/3495msec) clat (msec): min=63, max=195, avg=129.10, stdev=93.33 lat (msec): min=63, max=195, avg=129.11, stdev=93.33 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 64], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1368, max= 2048, per=29.15%, avg=1708.00, stdev=480.83, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2930KiB/s (3000kB/s)(10.0MiB/3495msec); 0 zone resets clat (msec): min=82, max=1503, avg=318.60, stdev=428.27 lat (msec): min=82, max=1503, avg=318.70, stdev=428.27 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 100], 40.00th=[ 159], 50.00th=[ 174], 60.00th=[ 201], | 70.00th=[ 224], 80.00th=[ 245], 90.00th=[ 422], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 1980, max= 4096, per=39.34%, avg=3227.25, stdev=1049.67, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.50, samples=4 lat (msec) : 100=33.33%, 250=50.00%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.30%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146520: Thu Jan 22 06:11:35 2026 read: IOPS=2, BW=2465KiB/s (2524kB/s)(6144KiB/2493msec) clat (msec): min=63, max=540, avg=201.76, stdev=172.99 lat (msec): min=63, max=540, avg=201.76, stdev=172.99 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 188], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2035, max= 3976, per=56.77%, avg=3326.33, stdev=1118.33, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2465KiB/s (2524kB/s)(6144KiB/2493msec); 0 zone resets clat (msec): min=138, max=401, avg=209.92, stdev=97.63 lat (msec): min=138, max=401, avg=210.06, stdev=97.61 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 190], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1984, max= 3976, per=39.92%, avg=3274.67, stdev=1119.15, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=8.33%, 750=8.33% cpu : usr=0.04%, sys=8.03%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146521: Thu Jan 22 06:11:35 2026 read: IOPS=1, BW=1732KiB/s (1774kB/s)(5120KiB/2956msec) clat (msec): min=106, max=519, avg=278.25, stdev=185.72 lat (msec): min=106, max=519, avg=278.25, stdev=185.72 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1980, max= 6144, per=69.33%, avg=4062.00, stdev=2944.39, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2425KiB/s (2483kB/s)(7168KiB/2956msec); 0 zone resets clat (msec): min=120, max=435, avg=213.60, stdev=103.54 lat (msec): min=120, max=435, avg=213.69, stdev=103.54 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 150], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 192], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 222], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2767, max= 4096, per=43.98%, avg=3608.00, stdev=731.45, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 lat (msec) : 250=75.00%, 500=16.67%, 750=8.33% cpu : usr=0.03%, sys=7.61%, ctx=227, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5860KiB/s (6000kB/s), 586KiB/s-2502KiB/s (600kB/s-2562kB/s), io=20.0MiB (20.0MB), run=2493-3495msec WRITE: bw=8204KiB/s (8401kB/s), 1787KiB/s-2930KiB/s (1830kB/s-3000kB/s), io=28.0MiB (29.4MB), run=2493-3495msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146522: Thu Jan 22 06:11:35 2026 read: IOPS=2, BW=3050KiB/s (3123kB/s)(7168KiB/2350msec) clat (usec): min=620, max=242764, avg=135976.35, stdev=102423.22 lat (usec): min=621, max=242765, avg=135977.68, stdev=102423.32 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 1696], | 30.00th=[111674], 40.00th=[111674], 50.00th=[166724], 60.00th=[187696], | 70.00th=[187696], 80.00th=[240124], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 1980, max= 6107, per=57.80%, avg=3661.00, stdev=2167.25, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2179KiB/s (2231kB/s)(5120KiB/2350msec); 0 zone resets clat (msec): min=146, max=390, avg=251.80, stdev=99.41 lat (msec): min=146, max=390, avg=251.87, stdev=99.39 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2035, max= 3961, per=30.24%, avg=2681.33, stdev=1108.24, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=66.67%, 500=16.67% cpu : usr=0.04%, sys=25.03%, ctx=241, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146523: Thu Jan 22 06:11:35 2026 read: IOPS=0, BW=633KiB/s (649kB/s)(2048KiB/3233msec) clat (msec): min=163, max=223, avg=193.30, stdev=42.74 lat (msec): min=163, max=223, avg=193.30, stdev=42.74 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 1475, max= 2011, per=27.52%, avg=1743.00, stdev=379.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3167KiB/s (3243kB/s)(10.0MiB/3233msec); 0 zone resets clat (msec): min=63, max=874, avg=264.43, stdev=254.02 lat (msec): min=63, max=874, avg=264.51, stdev=254.02 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 88], | 30.00th=[ 116], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 150], | 70.00th=[ 182], 80.00th=[ 430], 90.00th=[ 460], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2048, max= 8192, per=51.51%, avg=4568.00, stdev=2588.39, samples=4 iops : min= 2, max= 8, avg= 4.00, stdev= 2.71, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 1000=8.33% cpu : usr=0.03%, sys=19.80%, ctx=144, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146524: Thu Jan 22 06:11:35 2026 read: IOPS=2, BW=2394KiB/s (2452kB/s)(6144KiB/2566msec) clat (msec): min=97, max=307, avg=179.62, stdev=74.48 lat (msec): min=97, max=307, avg=179.63, stdev=74.48 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 176], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1980, max= 6144, per=53.46%, avg=3386.33, stdev=2388.37, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=2, BW=2394KiB/s (2452kB/s)(6144KiB/2566msec); 0 zone resets clat (msec): min=74, max=522, avg=230.46, stdev=158.55 lat (msec): min=74, max=522, avg=230.54, stdev=158.55 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 224], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1980, max= 2888, per=25.23%, avg=2237.75, stdev=434.50, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=24.83%, ctx=474, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146525: Thu Jan 22 06:11:35 2026 read: IOPS=1, BW=1611KiB/s (1650kB/s)(5120KiB/3178msec) clat (usec): min=633, max=297480, avg=148911.60, stdev=106942.66 lat (usec): min=634, max=297482, avg=148912.56, stdev=106942.62 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[124257], 40.00th=[124257], 50.00th=[141558], 60.00th=[141558], | 70.00th=[181404], 80.00th=[181404], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2256KiB/s (2310kB/s)(7168KiB/3178msec); 0 zone resets clat (msec): min=88, max=776, avg=341.22, stdev=299.61 lat (msec): min=88, max=776, avg=341.31, stdev=299.61 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 131], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 751], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1422, max= 3961, per=27.88%, avg=2472.67, stdev=1324.88, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=19.10%, ctx=407, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6335KiB/s (6487kB/s), 633KiB/s-3050KiB/s (649kB/s-3123kB/s), io=20.0MiB (20.0MB), run=2350-3233msec WRITE: bw=8869KiB/s (9081kB/s), 2179KiB/s-3167KiB/s (2231kB/s-3243kB/s), io=28.0MiB (29.4MB), run=2350-3233msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146532: Thu Jan 22 06:11:45 2026 read: IOPS=1, BW=6557KiB/s (6714kB/s)(12.0MiB/1874msec) clat (msec): min=564, max=633, avg=587.57, stdev=39.38 lat (msec): min=564, max=633, avg=587.57, stdev=39.38 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 5760, max= 8192, per=79.80%, avg=6976.00, stdev=1719.68, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=19.01%, ctx=480, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146535: Thu Jan 22 06:11:45 2026 read: IOPS=0, BW=2400KiB/s (2457kB/s)(4096KiB/1707msec) clat (nsec): min=668187k, max=668187k, avg=668186711.00, stdev= 0.00 lat (nsec): min=668190k, max=668190k, avg=668189615.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8192, max= 8192, per=93.71%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4799KiB/s (4914kB/s)(8192KiB/1707msec); 0 zone resets clat (msec): min=261, max=677, avg=469.46, stdev=294.60 lat (msec): min=261, max=678, avg=469.82, stdev=294.59 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8192, max= 8192, per=62.30%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=20.57%, ctx=209, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146537: Thu Jan 22 06:11:45 2026 write: IOPS=1, BW=4931KiB/s (5049kB/s)(12.0MiB/2492msec); 0 zone resets clat (msec): min=195, max=1258, avg=773.77, stdev=537.49 lat (msec): min=195, max=1258, avg=774.13, stdev=537.47 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8094, max= 8094, per=61.56%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=5.58%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146538: Thu Jan 22 06:11:45 2026 write: IOPS=1, BW=6915KiB/s (7081kB/s)(12.0MiB/1777msec); 0 zone resets clat (msec): min=322, max=822, avg=582.87, stdev=250.59 lat (msec): min=323, max=823, avg=583.28, stdev=250.58 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=9.18%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8743KiB/s (8953kB/s), 2400KiB/s-6557KiB/s (2457kB/s-6714kB/s), io=16.0MiB (16.8MB), run=1707-1874msec WRITE: bw=12.8MiB/s (13.5MB/s), 4799KiB/s-6915KiB/s (4914kB/s-7081kB/s), io=32.0MiB (33.6MB), run=1707-2492msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146531: Thu Jan 22 06:11:45 2026 read: IOPS=3, BW=13.2MiB/s (13.9MB/s)(12.0MiB/907msec) clat (msec): min=127, max=465, avg=262.57, stdev=178.83 lat (msec): min=127, max=465, avg=262.57, stdev=178.82 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min=12374, max=12374, per=100.00%, avg=12374.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=19.76%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146533: Thu Jan 22 06:11:45 2026 read: IOPS=0, BW=1811KiB/s (1854kB/s)(4096KiB/2262msec) clat (nsec): min=840948k, max=840948k, avg=840948211.00, stdev= 0.00 lat (nsec): min=840950k, max=840950k, avg=840950352.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3622KiB/s (3708kB/s)(8192KiB/2262msec); 0 zone resets clat (msec): min=577, max=729, avg=653.46, stdev=108.04 lat (msec): min=577, max=730, avg=653.86, stdev=108.01 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8078, max= 8078, per=66.02%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.25%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146534: Thu Jan 22 06:11:45 2026 write: IOPS=1, BW=4588KiB/s (4699kB/s)(12.0MiB/2678msec); 0 zone resets clat (msec): min=179, max=1792, avg=850.59, stdev=839.49 lat (msec): min=180, max=1792, avg=850.89, stdev=839.52 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7892, max= 8175, per=65.66%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.19%, ctx=47, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146536: Thu Jan 22 06:11:45 2026 write: IOPS=1, BW=7211KiB/s (7384kB/s)(12.0MiB/1704msec); 0 zone resets clat (msec): min=276, max=1021, avg=537.46, stdev=419.88 lat (msec): min=276, max=1022, avg=537.82, stdev=419.80 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 6450, max= 8192, per=59.84%, avg=7321.00, stdev=1231.78, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.98%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7243KiB/s (7417kB/s), 1811KiB/s-13.2MiB/s (1854kB/s-13.9MB/s), io=16.0MiB (16.8MB), run=907-2262msec WRITE: bw=11.9MiB/s (12.5MB/s), 3622KiB/s-7211KiB/s (3708kB/s-7384kB/s), io=32.0MiB (33.6MB), run=1704-2678msec