== sanity test 398b: DIO and buffer IO race ============== 07:09:32 (1769083772) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.6062 s, 14.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183427: Thu Jan 22 07:11:05 2026 read: IOPS=18, BW=73.0KiB/s (74.8kB/s)(5992KiB/82034msec) clat (usec): min=77, max=245112, avg=30044.66, stdev=19157.57 lat (usec): min=77, max=245113, avg=30047.50, stdev=19156.36 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 9241], 10.00th=[ 12518], 20.00th=[ 15664], | 30.00th=[ 19268], 40.00th=[ 22414], 50.00th=[ 26084], 60.00th=[ 30540], | 70.00th=[ 35914], 80.00th=[ 41681], 90.00th=[ 52691], 95.00th=[ 64226], | 99.00th=[ 90702], 99.50th=[101188], 99.90th=[212861], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 21, max= 143, per=24.81%, avg=72.44, stdev=24.31, samples=162 iops : min= 5, max= 35, avg=17.51, stdev= 6.15, samples=162 write: IOPS=19, BW=76.7KiB/s (78.6kB/s)(6296KiB/82034msec); 0 zone resets clat (usec): min=692, max=466928, avg=23318.28, stdev=25136.00 lat (usec): min=693, max=466930, avg=23322.69, stdev=25136.16 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 1156], 10.00th=[ 1434], 20.00th=[ 2606], | 30.00th=[ 5211], 40.00th=[ 11731], 50.00th=[ 17171], 60.00th=[ 22938], | 70.00th=[ 30016], 80.00th=[ 40633], 90.00th=[ 54264], 95.00th=[ 66847], | 99.00th=[ 95945], 99.50th=[104334], 99.90th=[145753], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 15, max= 183, per=25.07%, avg=76.71, stdev=29.42, samples=161 iops : min= 3, max= 45, avg=18.57, stdev= 7.39, samples=161 lat (usec) : 100=0.03%, 250=1.04%, 500=0.33%, 750=0.16%, 1000=0.68% lat (msec) : 2=7.23%, 4=5.53%, 10=6.77%, 20=22.43%, 50=43.85% lat (msec) : 100=11.26%, 250=0.65%, 500=0.03% cpu : usr=0.12%, sys=8.15%, ctx=6842, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183428: Thu Jan 22 07:11:05 2026 read: IOPS=18, BW=73.7KiB/s (75.5kB/s)(5940KiB/80606msec) clat (usec): min=110, max=143032, avg=29431.00, stdev=17005.55 lat (usec): min=111, max=143033, avg=29432.33, stdev=17005.43 clat percentiles (usec): | 1.00th=[ 169], 5.00th=[ 9896], 10.00th=[ 12387], 20.00th=[ 16057], | 30.00th=[ 19268], 40.00th=[ 22414], 50.00th=[ 25822], 60.00th=[ 30016], | 70.00th=[ 35390], 80.00th=[ 41157], 90.00th=[ 50594], 95.00th=[ 59507], | 99.00th=[ 85459], 99.50th=[ 95945], 99.90th=[128451], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 14, max= 149, per=25.01%, avg=73.03, stdev=24.21, samples=159 iops : min= 3, max= 37, avg=17.65, stdev= 6.08, samples=159 write: IOPS=19, BW=78.8KiB/s (80.6kB/s)(6348KiB/80606msec); 0 zone resets clat (usec): min=565, max=453579, avg=23043.69, stdev=25855.72 lat (usec): min=566, max=453581, avg=23045.86, stdev=25855.70 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1172], 10.00th=[ 1352], 20.00th=[ 2409], | 30.00th=[ 4424], 40.00th=[ 10028], 50.00th=[ 16319], 60.00th=[ 21890], | 70.00th=[ 29230], 80.00th=[ 40109], 90.00th=[ 56361], 95.00th=[ 70779], | 99.00th=[100140], 99.50th=[109577], 99.90th=[152044], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 15, max= 151, per=25.44%, avg=77.84, stdev=24.91, samples=159 iops : min= 3, max= 37, avg=18.85, stdev= 6.30, samples=159 lat (usec) : 250=0.88%, 500=0.23%, 750=0.10%, 1000=0.62% lat (msec) : 2=8.50%, 4=5.73%, 10=7.00%, 20=21.68%, 50=43.36% lat (msec) : 100=11.13%, 250=0.75%, 500=0.03% cpu : usr=0.10%, sys=8.23%, ctx=6779, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183429: Thu Jan 22 07:11:05 2026 read: IOPS=18, BW=73.0KiB/s (75.8kB/s)(6028KiB/81483msec) clat (usec): min=107, max=183091, avg=29497.61, stdev=17656.56 lat (usec): min=107, max=183092, avg=29499.95, stdev=17656.21 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 8979], 10.00th=[ 12256], 20.00th=[ 15664], | 30.00th=[ 19006], 40.00th=[ 22152], 50.00th=[ 25560], 60.00th=[ 30540], | 70.00th=[ 35914], 80.00th=[ 41681], 90.00th=[ 52167], 95.00th=[ 61604], | 99.00th=[ 87557], 99.50th=[ 96994], 99.90th=[131597], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 15, max= 143, per=25.29%, avg=73.85, stdev=22.60, samples=160 iops : min= 3, max= 35, avg=17.86, stdev= 5.72, samples=160 write: IOPS=19, BW=76.8KiB/s (78.7kB/s)(6260KiB/81483msec); 0 zone resets clat (usec): min=661, max=513786, avg=23445.20, stdev=25968.84 lat (usec): min=662, max=513790, avg=23447.69, stdev=25968.38 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1237], 10.00th=[ 1598], 20.00th=[ 2835], | 30.00th=[ 5800], 40.00th=[ 11863], 50.00th=[ 17695], 60.00th=[ 22676], | 70.00th=[ 29230], 80.00th=[ 39584], 90.00th=[ 54264], 95.00th=[ 66323], | 99.00th=[101188], 99.50th=[117965], 99.90th=[162530], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 23, max= 166, per=25.03%, avg=76.60, stdev=28.26, samples=160 iops : min= 5, max= 41, avg=18.55, stdev= 7.14, samples=160 lat (usec) : 250=1.01%, 500=0.36%, 750=0.20%, 1000=0.46% lat (msec) : 2=6.93%, 4=5.63%, 10=7.23%, 20=22.75%, 50=43.46% lat (msec) : 100=11.23%, 250=0.72%, 750=0.03% cpu : usr=0.11%, sys=8.29%, ctx=6756, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183430: Thu Jan 22 07:11:05 2026 read: IOPS=18, BW=74.4KiB/s (76.2kB/s)(6052KiB/81339msec) clat (usec): min=95, max=492413, avg=30077.69, stdev=22565.63 lat (usec): min=96, max=492414, avg=30081.65, stdev=22565.80 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 9241], 10.00th=[ 12256], 20.00th=[ 15533], | 30.00th=[ 19006], 40.00th=[ 22152], 50.00th=[ 25560], 60.00th=[ 29754], | 70.00th=[ 34866], 80.00th=[ 41681], 90.00th=[ 52167], 95.00th=[ 62653], | 99.00th=[ 94897], 99.50th=[133694], 99.90th=[179307], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 14, max= 135, per=25.33%, avg=73.97, stdev=23.01, samples=161 iops : min= 3, max= 33, avg=17.88, stdev= 5.77, samples=161 write: IOPS=19, BW=76.7KiB/s (78.5kB/s)(6236KiB/81339msec); 0 zone resets clat (usec): min=726, max=146061, avg=22745.09, stdev=22477.39 lat (usec): min=727, max=146063, avg=22747.78, stdev=22478.03 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1172], 10.00th=[ 1549], 20.00th=[ 2802], | 30.00th=[ 5473], 40.00th=[ 11469], 50.00th=[ 17433], 60.00th=[ 21627], | 70.00th=[ 28443], 80.00th=[ 39060], 90.00th=[ 55313], 95.00th=[ 69731], | 99.00th=[ 94897], 99.50th=[103285], 99.90th=[121111], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 15, max= 167, per=24.82%, avg=75.95, stdev=26.08, samples=161 iops : min= 3, max= 41, avg=18.39, stdev= 6.55, samples=161 lat (usec) : 100=0.03%, 250=1.07%, 500=0.26%, 750=0.10%, 1000=0.46% lat (msec) : 2=6.87%, 4=5.83%, 10=7.39%, 20=23.11%, 50=42.84% lat (msec) : 100=11.26%, 250=0.75%, 500=0.03% cpu : usr=0.11%, sys=8.09%, ctx=6787, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=293KiB/s (300kB/s), 73.0KiB/s-74.4KiB/s (74.8kB/s-76.2kB/s), io=23.4MiB (24.6MB), run=80606-82034msec WRITE: bw=306KiB/s (314kB/s), 76.7KiB/s-78.8KiB/s (78.5kB/s-80.6kB/s), io=24.6MiB (25.7MB), run=80606-82034msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183432: Thu Jan 22 07:11:33 2026 read: IOPS=13, BW=55.2KiB/s (56.5kB/s)(5992KiB/108592msec) clat (msec): min=4, max=580, avg=27.58, stdev=27.00 lat (msec): min=4, max=580, avg=27.58, stdev=27.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 60], 95.00th=[ 75], | 99.00th=[ 114], 99.50th=[ 128], 99.90th=[ 197], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 192, per=25.09%, avg=54.94, stdev=34.73, samples=214 iops : min= 1, max= 48, avg=13.14, stdev= 8.70, samples=214 write: IOPS=14, BW=57.0KiB/s (59.4kB/s)(6296KiB/108592msec); 0 zone resets clat (msec): min=8, max=195, avg=42.61, stdev=28.30 lat (msec): min=8, max=195, avg=42.62, stdev=28.30 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 81], 95.00th=[ 100], | 99.00th=[ 146], 99.50th=[ 180], 99.90th=[ 190], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 15, max= 144, per=25.17%, avg=57.64, stdev=31.04, samples=214 iops : min= 3, max= 36, avg=13.82, stdev= 7.79, samples=214 lat (msec) : 10=7.26%, 20=27.60%, 50=43.20%, 100=18.68%, 250=3.22% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=2.95%, ctx=4939, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183433: Thu Jan 22 07:11:33 2026 read: IOPS=13, BW=54.2KiB/s (55.5kB/s)(5940KiB/109520msec) clat (msec): min=4, max=471, avg=28.18, stdev=26.29 lat (msec): min=4, max=471, avg=28.18, stdev=26.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 63], 95.00th=[ 81], | 99.00th=[ 109], 99.50th=[ 128], 99.90th=[ 161], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 168, per=24.69%, avg=54.07, stdev=34.05, samples=215 iops : min= 1, max= 42, avg=12.93, stdev= 8.53, samples=215 write: IOPS=14, BW=57.0KiB/s (59.4kB/s)(6348KiB/109520msec); 0 zone resets clat (msec): min=7, max=303, avg=42.50, stdev=28.62 lat (msec): min=7, max=303, avg=42.50, stdev=28.61 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 80], 95.00th=[ 99], | 99.00th=[ 142], 99.50th=[ 178], 99.90th=[ 192], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 175, per=25.08%, avg=57.43, stdev=31.74, samples=216 iops : min= 1, max= 43, avg=13.77, stdev= 7.96, samples=216 lat (msec) : 10=6.87%, 20=28.42%, 50=42.81%, 100=18.52%, 250=3.32% lat (msec) : 500=0.07% cpu : usr=0.08%, sys=2.84%, ctx=4886, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183434: Thu Jan 22 07:11:33 2026 read: IOPS=13, BW=55.3KiB/s (56.7kB/s)(6028KiB/108914msec) clat (msec): min=5, max=176, avg=28.64, stdev=24.83 lat (msec): min=5, max=176, avg=28.64, stdev=24.83 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 45], 90.00th=[ 66], 95.00th=[ 83], | 99.00th=[ 112], 99.50th=[ 140], 99.90th=[ 176], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 7, max= 183, per=25.17%, avg=55.12, stdev=33.30, samples=215 iops : min= 1, max= 45, avg=13.19, stdev= 8.34, samples=215 write: IOPS=14, BW=57.5KiB/s (58.9kB/s)(6260KiB/108914msec); 0 zone resets clat (msec): min=8, max=509, avg=41.89, stdev=29.80 lat (msec): min=8, max=509, avg=41.89, stdev=29.80 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 61], 90.00th=[ 79], 95.00th=[ 96], | 99.00th=[ 146], 99.50th=[ 174], 99.90th=[ 203], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 167, per=24.98%, avg=57.21, stdev=32.62, samples=215 iops : min= 1, max= 41, avg=13.72, stdev= 8.19, samples=215 lat (msec) : 10=6.84%, 20=28.91%, 50=41.60%, 100=19.56%, 250=3.06% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=2.83%, ctx=4903, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183435: Thu Jan 22 07:11:33 2026 read: IOPS=13, BW=55.4KiB/s (56.8kB/s)(6052KiB/109148msec) clat (msec): min=4, max=163, avg=28.47, stdev=24.46 lat (msec): min=4, max=163, avg=28.47, stdev=24.46 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 64], 95.00th=[ 81], | 99.00th=[ 116], 99.50th=[ 144], 99.90th=[ 157], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 7, max= 191, per=25.27%, avg=55.33, stdev=33.28, samples=214 iops : min= 1, max= 47, avg=13.24, stdev= 8.35, samples=214 write: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6236KiB/109148msec); 0 zone resets clat (msec): min=8, max=458, avg=42.23, stdev=29.76 lat (msec): min=8, max=458, avg=42.23, stdev=29.76 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 63], 90.00th=[ 78], 95.00th=[ 95], | 99.00th=[ 136], 99.50th=[ 178], 99.90th=[ 300], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 8, max= 158, per=24.76%, avg=56.69, stdev=31.62, samples=215 iops : min= 2, max= 39, avg=13.59, stdev= 7.92, samples=215 lat (msec) : 10=6.74%, 20=28.42%, 50=42.09%, 100=19.60%, 250=3.09% lat (msec) : 500=0.07% cpu : usr=0.08%, sys=2.84%, ctx=4981, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=219KiB/s (225kB/s), 54.2KiB/s-55.4KiB/s (55.5kB/s-56.8kB/s), io=23.4MiB (24.6MB), run=108592-109520msec WRITE: bw=230KiB/s (235kB/s), 57.1KiB/s-57.0KiB/s (58.5kB/s-59.4kB/s), io=24.6MiB (25.7MB), run=108592-109520msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183464: Thu Jan 22 07:12:01 2026 read: IOPS=17, BW=286KiB/s (293kB/s)(5920KiB/20679msec) clat (usec): min=80, max=110384, avg=29611.86, stdev=19966.70 lat (usec): min=80, max=110385, avg=29613.09, stdev=19966.71 clat percentiles (usec): | 1.00th=[ 130], 5.00th=[ 151], 10.00th=[ 1205], 20.00th=[ 14615], | 30.00th=[ 19006], 40.00th=[ 22414], 50.00th=[ 26084], 60.00th=[ 30278], | 70.00th=[ 37487], 80.00th=[ 43254], 90.00th=[ 56361], 95.00th=[ 64750], | 99.00th=[ 95945], 99.50th=[107480], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 127, max= 479, per=24.26%, avg=279.95, stdev=84.87, samples=40 iops : min= 7, max= 29, avg=16.80, stdev= 5.39, samples=40 write: IOPS=19, BW=308KiB/s (315kB/s)(6368KiB/20679msec); 0 zone resets clat (usec): min=1391, max=108685, avg=23926.64, stdev=21987.88 lat (usec): min=1391, max=108687, avg=23928.75, stdev=21987.70 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1745], 10.00th=[ 2245], 20.00th=[ 4293], | 30.00th=[ 7701], 40.00th=[ 13698], 50.00th=[ 17957], 60.00th=[ 22938], | 70.00th=[ 30802], 80.00th=[ 41157], 90.00th=[ 54789], 95.00th=[ 66323], | 99.00th=[ 98042], 99.50th=[105382], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 127, max= 480, per=25.18%, avg=305.65, stdev=95.28, samples=40 iops : min= 7, max= 30, avg=18.40, stdev= 6.02, samples=40 lat (usec) : 100=0.13%, 250=3.78%, 500=0.65%, 750=0.13% lat (msec) : 2=4.04%, 4=5.86%, 10=9.64%, 20=19.53%, 50=43.10% lat (msec) : 100=12.37%, 250=0.78% cpu : usr=0.12%, sys=9.29%, ctx=1752, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183465: Thu Jan 22 07:12:01 2026 read: IOPS=17, BW=277KiB/s (284kB/s)(5744KiB/20742msec) clat (usec): min=107, max=169585, avg=29188.50, stdev=19839.60 lat (usec): min=107, max=169587, avg=29195.15, stdev=19839.11 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 229], 10.00th=[ 11076], 20.00th=[ 14877], | 30.00th=[ 18482], 40.00th=[ 22152], 50.00th=[ 25822], 60.00th=[ 30278], | 70.00th=[ 35390], 80.00th=[ 41157], 90.00th=[ 51119], 95.00th=[ 66323], | 99.00th=[102237], 99.50th=[125305], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 94, max= 507, per=23.65%, avg=272.93, stdev=98.82, samples=40 iops : min= 5, max= 31, avg=16.35, stdev= 6.24, samples=40 write: IOPS=19, BW=315KiB/s (323kB/s)(6544KiB/20742msec); 0 zone resets clat (usec): min=1316, max=134329, avg=24761.53, stdev=23232.02 lat (usec): min=1317, max=134330, avg=24766.59, stdev=23231.52 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1745], 10.00th=[ 2409], 20.00th=[ 4228], | 30.00th=[ 7308], 40.00th=[ 12649], 50.00th=[ 17957], 60.00th=[ 22152], | 70.00th=[ 32637], 80.00th=[ 42730], 90.00th=[ 60556], 95.00th=[ 69731], | 99.00th=[ 94897], 99.50th=[101188], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 95, max= 638, per=25.08%, avg=304.48, stdev=103.20, samples=40 iops : min= 5, max= 39, avg=18.35, stdev= 6.49, samples=40 lat (usec) : 250=2.60%, 500=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=4.17%, 4=6.25%, 10=9.38%, 20=21.61%, 50=41.80% lat (msec) : 100=12.50%, 250=0.91% cpu : usr=0.11%, sys=9.42%, ctx=1791, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183466: Thu Jan 22 07:12:01 2026 read: IOPS=19, BW=308KiB/s (316kB/s)(6256KiB/20304msec) clat (usec): min=112, max=114361, avg=29432.18, stdev=18894.82 lat (usec): min=113, max=114362, avg=29433.33, stdev=18894.86 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 202], 10.00th=[ 2474], 20.00th=[ 15270], | 30.00th=[ 19268], 40.00th=[ 23725], 50.00th=[ 27395], 60.00th=[ 31065], | 70.00th=[ 37487], 80.00th=[ 42730], 90.00th=[ 50070], 95.00th=[ 63701], | 99.00th=[ 99091], 99.50th=[111674], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 181, max= 574, per=26.81%, avg=309.35, stdev=87.24, samples=40 iops : min= 11, max= 35, avg=18.65, stdev= 5.46, samples=40 write: IOPS=18, BW=297KiB/s (304kB/s)(6032KiB/20304msec); 0 zone resets clat (usec): min=1269, max=111645, avg=22905.55, stdev=20535.77 lat (usec): min=1271, max=111648, avg=22907.50, stdev=20535.76 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2180], 10.00th=[ 3261], 20.00th=[ 4883], | 30.00th=[ 8455], 40.00th=[ 13042], 50.00th=[ 17171], 60.00th=[ 21365], | 70.00th=[ 28705], 80.00th=[ 39060], 90.00th=[ 52691], 95.00th=[ 61080], | 99.00th=[ 94897], 99.50th=[104334], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 125, max= 512, per=24.27%, avg=294.63, stdev=93.62, samples=40 iops : min= 7, max= 32, avg=17.72, stdev= 5.91, samples=40 lat (usec) : 250=2.99%, 500=1.69%, 1000=0.26% lat (msec) : 2=2.08%, 4=6.25%, 10=10.16%, 20=20.57%, 50=44.92% lat (msec) : 100=10.29%, 250=0.78% cpu : usr=0.10%, sys=9.58%, ctx=1769, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183467: Thu Jan 22 07:12:01 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(6032KiB/19988msec) clat (usec): min=88, max=131668, avg=29140.81, stdev=21291.49 lat (usec): min=88, max=131669, avg=29141.87, stdev=21291.51 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 169], 10.00th=[ 498], 20.00th=[ 14484], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 25822], 60.00th=[ 29754], | 70.00th=[ 36439], 80.00th=[ 41681], 90.00th=[ 52167], 95.00th=[ 67634], | 99.00th=[111674], 99.50th=[127402], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 156, max= 510, per=26.09%, avg=301.13, stdev=80.71, samples=39 iops : min= 9, max= 31, avg=18.10, stdev= 5.07, samples=39 write: IOPS=19, BW=313KiB/s (320kB/s)(6256KiB/19988msec); 0 zone resets clat (usec): min=1093, max=140904, avg=22890.64, stdev=22208.21 lat (usec): min=1095, max=140906, avg=22892.88, stdev=22208.22 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1860], 10.00th=[ 2606], 20.00th=[ 4686], | 30.00th=[ 6980], 40.00th=[ 11207], 50.00th=[ 15664], 60.00th=[ 22152], | 70.00th=[ 28705], 80.00th=[ 38536], 90.00th=[ 51643], 95.00th=[ 67634], | 99.00th=[104334], 99.50th=[111674], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 126, max= 476, per=25.90%, avg=314.46, stdev=85.97, samples=39 iops : min= 7, max= 29, avg=18.95, stdev= 5.48, samples=39 lat (usec) : 100=0.13%, 250=4.04%, 500=0.78%, 750=0.52%, 1000=0.13% lat (msec) : 2=3.78%, 4=5.60%, 10=11.33%, 20=19.27%, 50=43.36% lat (msec) : 100=9.64%, 250=1.43% cpu : usr=0.12%, sys=9.41%, ctx=1741, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1155KiB/s (1182kB/s), 277KiB/s-308KiB/s (284kB/s-316kB/s), io=23.4MiB (24.5MB), run=19988-20742msec WRITE: bw=1215KiB/s (1244kB/s), 297KiB/s-315KiB/s (304kB/s-323kB/s), io=24.6MiB (25.8MB), run=19988-20742msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183469: Thu Jan 22 07:12:09 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(5920KiB/29091msec) clat (msec): min=5, max=158, avg=29.09, stdev=23.69 lat (msec): min=5, max=158, avg=29.10, stdev=23.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 63], 95.00th=[ 81], | 99.00th=[ 112], 99.50th=[ 128], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 63, max= 509, per=24.57%, avg=200.74, stdev=101.92, samples=57 iops : min= 3, max= 31, avg=11.82, stdev= 6.45, samples=57 write: IOPS=13, BW=219KiB/s (224kB/s)(6368KiB/29091msec); 0 zone resets clat (msec): min=11, max=189, avg=45.71, stdev=29.57 lat (msec): min=11, max=189, avg=45.72, stdev=29.57 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 66], 90.00th=[ 86], 95.00th=[ 103], | 99.00th=[ 153], 99.50th=[ 171], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 61, max= 510, per=25.35%, avg=217.75, stdev=113.24, samples=57 iops : min= 3, max= 31, avg=12.89, stdev= 7.12, samples=57 lat (msec) : 10=4.69%, 20=23.44%, 50=48.70%, 100=19.14%, 250=4.04% cpu : usr=0.10%, sys=2.96%, ctx=1293, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183470: Thu Jan 22 07:12:09 2026 read: IOPS=12, BW=200KiB/s (204kB/s)(5744KiB/28772msec) clat (msec): min=5, max=157, avg=29.20, stdev=22.31 lat (msec): min=5, max=157, avg=29.21, stdev=22.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 61], 95.00th=[ 79], | 99.00th=[ 102], 99.50th=[ 142], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 31, max= 509, per=24.90%, avg=203.41, stdev=108.37, samples=56 iops : min= 1, max= 31, avg=12.00, stdev= 6.85, samples=56 write: IOPS=14, BW=227KiB/s (233kB/s)(6544KiB/28772msec); 0 zone resets clat (msec): min=8, max=155, avg=44.47, stdev=27.87 lat (msec): min=8, max=155, avg=44.47, stdev=27.87 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 87], 95.00th=[ 105], | 99.00th=[ 140], 99.50th=[ 146], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 92, max= 574, per=26.44%, avg=227.09, stdev=110.70, samples=57 iops : min= 5, max= 35, avg=13.47, stdev= 6.98, samples=57 lat (msec) : 10=3.91%, 20=24.22%, 50=48.70%, 100=19.40%, 250=3.78% cpu : usr=0.08%, sys=3.13%, ctx=1278, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183471: Thu Jan 22 07:12:09 2026 read: IOPS=13, BW=213KiB/s (219kB/s)(6256KiB/29316msec) clat (msec): min=5, max=158, avg=29.55, stdev=24.97 lat (msec): min=5, max=158, avg=29.56, stdev=24.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 61], 95.00th=[ 88], | 99.00th=[ 129], 99.50th=[ 134], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 63, max= 571, per=26.18%, avg=213.88, stdev=123.84, samples=58 iops : min= 3, max= 35, avg=12.66, stdev= 7.79, samples=58 write: IOPS=12, BW=206KiB/s (211kB/s)(6032KiB/29316msec); 0 zone resets clat (msec): min=7, max=190, avg=46.65, stdev=29.23 lat (msec): min=7, max=190, avg=46.66, stdev=29.23 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 67], 90.00th=[ 88], 95.00th=[ 104], | 99.00th=[ 148], 99.50th=[ 171], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 63, max= 510, per=23.73%, avg=203.88, stdev=102.65, samples=58 iops : min= 3, max= 31, avg=12.02, stdev= 6.44, samples=58 lat (msec) : 10=5.08%, 20=24.87%, 50=45.57%, 100=19.92%, 250=4.56% cpu : usr=0.08%, sys=3.02%, ctx=1289, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183472: Thu Jan 22 07:12:09 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(6032KiB/28666msec) clat (msec): min=5, max=133, avg=30.76, stdev=25.17 lat (msec): min=5, max=133, avg=30.76, stdev=25.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 67], 95.00th=[ 84], | 99.00th=[ 127], 99.50th=[ 131], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 63, max= 734, per=25.59%, avg=209.07, stdev=125.77, samples=56 iops : min= 3, max= 45, avg=12.36, stdev= 7.95, samples=56 write: IOPS=13, BW=218KiB/s (223kB/s)(6256KiB/28666msec); 0 zone resets clat (msec): min=12, max=127, avg=43.13, stdev=24.34 lat (msec): min=12, max=127, avg=43.14, stdev=24.34 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 42], | 70.00th=[ 49], 80.00th=[ 63], 90.00th=[ 78], 95.00th=[ 93], | 99.00th=[ 122], 99.50th=[ 126], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 63, max= 479, per=25.40%, avg=218.18, stdev=106.20, samples=56 iops : min= 3, max= 29, avg=12.93, stdev= 6.66, samples=56 lat (msec) : 10=4.30%, 20=25.00%, 50=47.92%, 100=19.14%, 250=3.65% cpu : usr=0.08%, sys=3.12%, ctx=1238, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=817KiB/s (837kB/s), 200KiB/s-213KiB/s (204kB/s-219kB/s), io=23.4MiB (24.5MB), run=28666-29316msec WRITE: bw=860KiB/s (880kB/s), 206KiB/s-227KiB/s (211kB/s-233kB/s), io=24.6MiB (25.8MB), run=28666-29316msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183482: Thu Jan 22 07:12:21 2026 read: IOPS=2, BW=2417KiB/s (2475kB/s)(7168KiB/2966msec) clat (usec): min=1260, max=882542, avg=240609.44, stdev=293327.48 lat (usec): min=1261, max=882543, avg=240610.93, stdev=293327.39 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1254], 10.00th=[ 1254], 20.00th=[113771], | 30.00th=[114820], 40.00th=[114820], 50.00th=[120062], 60.00th=[214959], | 70.00th=[214959], 80.00th=[235930], 90.00th=[884999], 95.00th=[884999], | 99.00th=[884999], 99.50th=[884999], 99.90th=[884999], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 1426, max= 4079, per=63.52%, avg=3194.67, stdev=1531.71, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1726KiB/s (1768kB/s)(5120KiB/2966msec); 0 zone resets clat (msec): min=147, max=374, avg=244.78, stdev=102.12 lat (msec): min=147, max=375, avg=244.89, stdev=102.10 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2015, max= 4055, per=38.39%, avg=2703.00, stdev=1170.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=66.67%, 500=16.67%, 1000=8.33% cpu : usr=0.03%, sys=24.89%, ctx=461, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183484: Thu Jan 22 07:12:21 2026 read: IOPS=0, BW=503KiB/s (515kB/s)(2048KiB/4072msec) clat (msec): min=93, max=234, avg=164.21, stdev=99.35 lat (msec): min=93, max=234, avg=164.21, stdev=99.35 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 94], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 1446, max= 2027, per=34.53%, avg=1736.50, stdev=410.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2515KiB/s (2575kB/s)(10.0MiB/4072msec); 0 zone resets clat (msec): min=69, max=1335, avg=360.67, stdev=400.67 lat (msec): min=69, max=1335, avg=360.82, stdev=400.67 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 71], | 30.00th=[ 112], 40.00th=[ 176], 50.00th=[ 186], 60.00th=[ 249], | 70.00th=[ 292], 80.00th=[ 334], 90.00th=[ 785], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 2039, max= 4096, per=46.53%, avg=3276.50, stdev=999.14, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.05%, sys=17.81%, ctx=145, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183488: Thu Jan 22 07:12:21 2026 read: IOPS=1, BW=2037KiB/s (2086kB/s)(6144KiB/3016msec) clat (usec): min=751, max=309931, avg=138294.42, stdev=124818.48 lat (usec): min=753, max=309932, avg=138295.77, stdev=124818.59 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[ 2343], | 30.00th=[ 2343], 40.00th=[125305], 50.00th=[125305], 60.00th=[149947], | 70.00th=[242222], 80.00th=[242222], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 2027, max= 6119, per=80.99%, avg=4073.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=2037KiB/s (2086kB/s)(6144KiB/3016msec); 0 zone resets clat (msec): min=112, max=1128, avg=337.22, stdev=390.39 lat (msec): min=112, max=1128, avg=337.44, stdev=390.35 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 201], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2015, max= 2856, per=31.73%, avg=2234.25, stdev=414.62, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=66.67%, 500=8.33%, 2000=8.33% cpu : usr=0.03%, sys=20.50%, ctx=198, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183489: Thu Jan 22 07:12:21 2026 read: IOPS=1, BW=1502KiB/s (1538kB/s)(5120KiB/3408msec) clat (usec): min=720, max=177544, avg=41190.04, stdev=76850.51 lat (usec): min=722, max=177545, avg=41191.53, stdev=76850.31 clat percentiles (usec): | 1.00th=[ 717], 5.00th=[ 717], 10.00th=[ 717], 20.00th=[ 717], | 30.00th=[ 758], 40.00th=[ 758], 50.00th=[ 2933], 60.00th=[ 2933], | 70.00th=[ 23987], 80.00th=[ 23987], 90.00th=[177210], 95.00th=[177210], | 99.00th=[177210], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2103KiB/s (2154kB/s)(7168KiB/3408msec); 0 zone resets clat (msec): min=100, max=1085, avg=440.74, stdev=321.25 lat (msec): min=100, max=1085, avg=440.83, stdev=321.24 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 247], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 363], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 575], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1456, max= 4079, per=33.00%, avg=2323.20, stdev=1012.22, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 50=8.33%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=20.60%, ctx=124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5029KiB/s (5150kB/s), 503KiB/s-2417KiB/s (515kB/s-2475kB/s), io=20.0MiB (20.0MB), run=2966-4072msec WRITE: bw=7041KiB/s (7210kB/s), 1726KiB/s-2515KiB/s (1768kB/s-2575kB/s), io=28.0MiB (29.4MB), run=2966-4072msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183483: Thu Jan 22 07:12:21 2026 read: IOPS=2, BW=2397KiB/s (2454kB/s)(7168KiB/2991msec) clat (msec): min=68, max=898, avg=244.88, stdev=296.13 lat (msec): min=68, max=898, avg=244.88, stdev=296.13 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 100], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 121], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 275], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2000, max= 3915, per=64.48%, avg=3235.67, stdev=1071.88, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1712KiB/s (1753kB/s)(5120KiB/2991msec); 0 zone resets clat (msec): min=128, max=358, avg=234.28, stdev=88.59 lat (msec): min=128, max=358, avg=234.37, stdev=88.58 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1957, max= 3992, per=37.72%, avg=2649.67, stdev=1162.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=7.39%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183485: Thu Jan 22 07:12:21 2026 read: IOPS=0, BW=502KiB/s (514kB/s)(2048KiB/4081msec) clat (msec): min=82, max=122, avg=102.82, stdev=28.27 lat (msec): min=82, max=122, avg=102.82, stdev=28.27 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 124], | 70.00th=[ 124], 80.00th=[ 124], 90.00th=[ 124], 95.00th=[ 124], | 99.00th=[ 124], 99.50th=[ 124], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 1910, max= 1996, per=38.92%, avg=1953.00, stdev=60.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2509KiB/s (2569kB/s)(10.0MiB/4081msec); 0 zone resets clat (msec): min=94, max=1133, avg=384.12, stdev=332.76 lat (msec): min=94, max=1133, avg=384.21, stdev=332.75 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 110], | 30.00th=[ 150], 40.00th=[ 262], 50.00th=[ 288], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 384], 90.00th=[ 810], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1910, max= 6131, per=40.15%, avg=2820.60, stdev=1851.25, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.37%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183486: Thu Jan 22 07:12:21 2026 read: IOPS=1, BW=1701KiB/s (1741kB/s)(6144KiB/3613msec) clat (msec): min=79, max=426, avg=250.01, stdev=128.57 lat (msec): min=79, max=426, avg=250.02, stdev=128.57 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1984, max= 3938, per=49.65%, avg=2491.25, stdev=964.82, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1701KiB/s (1741kB/s)(6144KiB/3613msec); 0 zone resets clat (msec): min=114, max=964, avg=345.18, stdev=313.68 lat (msec): min=114, max=964, avg=345.40, stdev=313.58 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 271], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1984, max= 2775, per=31.32%, avg=2200.50, stdev=383.81, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=6.92%, ctx=92, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183487: Thu Jan 22 07:12:21 2026 read: IOPS=1, BW=1279KiB/s (1310kB/s)(5120KiB/4003msec) clat (msec): min=74, max=703, avg=221.06, stdev=271.00 lat (msec): min=74, max=703, avg=221.07, stdev=271.00 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 97], 60.00th=[ 97], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2019, max= 3992, per=53.50%, avg=2684.67, stdev=1132.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1791KiB/s (1834kB/s)(7168KiB/4003msec); 0 zone resets clat (msec): min=83, max=1084, avg=396.84, stdev=345.54 lat (msec): min=83, max=1085, avg=397.17, stdev=345.84 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 211], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 236], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 617], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1957, max= 2043, per=28.46%, avg=1999.20, stdev=30.46, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=33.33%, 250=33.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=7.55%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5018KiB/s (5139kB/s), 502KiB/s-2397KiB/s (514kB/s-2454kB/s), io=20.0MiB (20.0MB), run=2991-4081msec WRITE: bw=7026KiB/s (7194kB/s), 1701KiB/s-2509KiB/s (1741kB/s-2569kB/s), io=28.0MiB (29.4MB), run=2991-4081msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183495: Thu Jan 22 07:12:31 2026 read: IOPS=1, BW=5503KiB/s (5635kB/s)(12.0MiB/2233msec) clat (msec): min=476, max=833, avg=683.83, stdev=185.55 lat (msec): min=476, max=833, avg=683.83, stdev=185.55 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.33%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183496: Thu Jan 22 07:12:31 2026 read: IOPS=0, BW=3264KiB/s (3342kB/s)(4096KiB/1255msec) clat (nsec): min=184977k, max=184977k, avg=184977385.00, stdev= 0.00 lat (nsec): min=184980k, max=184980k, avg=184980330.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 7013, max= 7013, per=95.58%, avg=7013.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6527KiB/s (6684kB/s)(8192KiB/1255msec); 0 zone resets clat (msec): min=394, max=441, avg=418.37, stdev=33.16 lat (msec): min=395, max=442, avg=419.02, stdev=33.05 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 8126, max= 8126, per=48.58%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=14.59%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183497: Thu Jan 22 07:12:31 2026 write: IOPS=1, BW=6273KiB/s (6423kB/s)(12.0MiB/1959msec); 0 zone resets clat (msec): min=419, max=792, avg=597.85, stdev=186.83 lat (msec): min=420, max=792, avg=598.35, stdev=186.84 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8126, max= 8126, per=48.58%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=10.73%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183498: Thu Jan 22 07:12:31 2026 write: IOPS=1, BW=8084KiB/s (8278kB/s)(12.0MiB/1520msec); 0 zone resets clat (msec): min=161, max=970, avg=456.46, stdev=446.52 lat (msec): min=162, max=970, avg=457.20, stdev=446.31 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8126, max= 8175, per=48.73%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.66%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7337KiB/s (7513kB/s), 3264KiB/s-5503KiB/s (3342kB/s-5635kB/s), io=16.0MiB (16.8MB), run=1255-2233msec WRITE: bw=16.3MiB/s (17.1MB/s), 6273KiB/s-8084KiB/s (6423kB/s-8278kB/s), io=32.0MiB (33.6MB), run=1255-1959msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183500: Thu Jan 22 07:12:31 2026 read: IOPS=2, BW=8821KiB/s (9033kB/s)(12.0MiB/1393msec) clat (msec): min=392, max=570, avg=463.50, stdev=94.67 lat (msec): min=392, max=570, avg=463.51, stdev=94.66 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7557, max= 8126, per=88.02%, avg=7841.50, stdev=402.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=17.31%, ctx=495, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183501: Thu Jan 22 07:12:31 2026 read: IOPS=0, BW=2227KiB/s (2281kB/s)(4096KiB/1839msec) clat (nsec): min=435986k, max=435986k, avg=435986351.00, stdev= 0.00 lat (nsec): min=435989k, max=435989k, avg=435988998.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7025, max= 7025, per=78.85%, avg=7025.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4455KiB/s (4562kB/s)(8192KiB/1839msec); 0 zone resets clat (msec): min=667, max=732, avg=700.05, stdev=45.82 lat (msec): min=668, max=732, avg=700.51, stdev=45.79 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8192, max= 8192, per=49.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.05%, sys=8.71%, ctx=228, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183502: Thu Jan 22 07:12:31 2026 write: IOPS=1, BW=6162KiB/s (6310kB/s)(12.0MiB/1994msec); 0 zone resets clat (msec): min=212, max=901, avg=662.46, stdev=390.25 lat (msec): min=212, max=902, avg=663.10, stdev=390.47 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8126, max= 8126, per=49.45%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.15%, sys=5.82%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183503: Thu Jan 22 07:12:31 2026 write: IOPS=1, BW=6974KiB/s (7141kB/s)(12.0MiB/1762msec); 0 zone resets clat (msec): min=180, max=806, avg=586.49, stdev=351.62 lat (msec): min=181, max=807, avg=586.84, stdev=351.61 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8126, max= 8192, per=49.65%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.98%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8909KiB/s (9123kB/s), 2227KiB/s-8821KiB/s (2281kB/s-9033kB/s), io=16.0MiB (16.8MB), run=1393-1839msec WRITE: bw=16.0MiB/s (16.8MB/s), 4455KiB/s-6974KiB/s (4562kB/s-7141kB/s), io=32.0MiB (33.6MB), run=1762-1994msec