== sanity test 398b: DIO and buffer IO race ============== 20:54:26 (1768010066) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.25748 s, 15.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151337: Fri Jan 9 20:55:35 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(5992KiB/57779msec) clat (usec): min=154, max=803595, avg=20283.49, stdev=23210.75 lat (usec): min=154, max=803596, avg=20284.23, stdev=23210.82 clat percentiles (usec): | 1.00th=[ 355], 5.00th=[ 5276], 10.00th=[ 7701], 20.00th=[ 10683], | 30.00th=[ 13435], 40.00th=[ 15533], 50.00th=[ 17957], 60.00th=[ 20317], | 70.00th=[ 23987], 80.00th=[ 28443], 90.00th=[ 33817], 95.00th=[ 39584], | 99.00th=[ 59507], 99.50th=[ 64226], 99.90th=[ 83362], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 6, max= 184, per=25.14%, avg=103.58, stdev=34.18, samples=115 iops : min= 1, max= 46, avg=25.51, stdev= 8.64, samples=115 write: IOPS=27, BW=109KiB/s (112kB/s)(6296KiB/57779msec); 0 zone resets clat (usec): min=604, max=138319, avg=17206.89, stdev=13849.45 lat (usec): min=604, max=138321, avg=17207.73, stdev=13849.54 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 2474], 10.00th=[ 3359], 20.00th=[ 5276], | 30.00th=[ 7832], 40.00th=[ 11207], 50.00th=[ 14484], 60.00th=[ 17433], | 70.00th=[ 21365], 80.00th=[ 27395], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 59507], 99.50th=[ 72877], 99.90th=[120062], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 48, max= 216, per=25.66%, avg=110.60, stdev=36.91, samples=113 iops : min= 12, max= 54, avg=27.27, stdev= 9.28, samples=113 lat (usec) : 250=0.16%, 500=0.78%, 750=1.14%, 1000=0.59% lat (msec) : 2=1.17%, 4=5.05%, 10=17.90%, 20=35.87%, 50=35.03% lat (msec) : 100=2.15%, 250=0.13%, 1000=0.03% cpu : usr=0.13%, sys=28.96%, ctx=9630, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151338: Fri Jan 9 20:55:35 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(5940KiB/58272msec) clat (usec): min=74, max=117050, avg=20058.87, stdev=11616.96 lat (usec): min=75, max=117051, avg=20059.61, stdev=11616.94 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 5473], 10.00th=[ 8225], 20.00th=[ 10945], | 30.00th=[ 13566], 40.00th=[ 15795], 50.00th=[ 18220], 60.00th=[ 21103], | 70.00th=[ 24249], 80.00th=[ 27919], 90.00th=[ 33817], 95.00th=[ 39584], | 99.00th=[ 55313], 99.50th=[ 63177], 99.90th=[114820], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 6, max= 208, per=24.91%, avg=102.62, stdev=34.97, samples=115 iops : min= 1, max= 52, avg=25.26, stdev= 8.84, samples=115 write: IOPS=27, BW=109KiB/s (112kB/s)(6348KiB/58272msec); 0 zone resets clat (usec): min=597, max=795971, avg=17753.18, stdev=24039.85 lat (usec): min=598, max=795972, avg=17754.47, stdev=24039.65 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 2409], 10.00th=[ 3195], 20.00th=[ 5014], | 30.00th=[ 7635], 40.00th=[ 10945], 50.00th=[ 14353], 60.00th=[ 17695], | 70.00th=[ 21365], 80.00th=[ 27132], 90.00th=[ 35390], 95.00th=[ 43254], | 99.00th=[ 63177], 99.50th=[ 82314], 99.90th=[106431], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 8, max= 294, per=25.45%, avg=109.69, stdev=41.27, samples=115 iops : min= 2, max= 73, avg=27.04, stdev=10.40, samples=115 lat (usec) : 100=0.07%, 250=0.10%, 500=0.85%, 750=0.88%, 1000=0.68% lat (msec) : 2=1.24%, 4=5.99%, 10=17.64%, 20=34.41%, 50=36.10% lat (msec) : 100=1.89%, 250=0.13%, 1000=0.03% cpu : usr=0.11%, sys=28.69%, ctx=9796, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151339: Fri Jan 9 20:55:35 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(6028KiB/57681msec) clat (usec): min=100, max=125892, avg=19900.37, stdev=11744.84 lat (usec): min=101, max=125893, avg=19901.13, stdev=11744.86 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 5800], 10.00th=[ 8291], 20.00th=[ 10945], | 30.00th=[ 13304], 40.00th=[ 15401], 50.00th=[ 17433], 60.00th=[ 20317], | 70.00th=[ 23725], 80.00th=[ 28443], 90.00th=[ 34341], 95.00th=[ 39060], | 99.00th=[ 60556], 99.50th=[ 70779], 99.90th=[ 89654], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 40, max= 224, per=25.75%, avg=106.09, stdev=35.85, samples=112 iops : min= 10, max= 56, avg=26.14, stdev= 9.04, samples=112 write: IOPS=27, BW=109KiB/s (111kB/s)(6260KiB/57681msec); 0 zone resets clat (usec): min=641, max=814920, avg=17502.25, stdev=24248.46 lat (usec): min=642, max=814922, avg=17503.42, stdev=24248.62 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 2442], 10.00th=[ 3359], 20.00th=[ 5145], | 30.00th=[ 7570], 40.00th=[ 11076], 50.00th=[ 14222], 60.00th=[ 17433], | 70.00th=[ 21365], 80.00th=[ 26608], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 61080], 99.50th=[ 73925], 99.90th=[106431], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 8, max= 224, per=25.27%, avg=108.91, stdev=37.13, samples=113 iops : min= 2, max= 56, avg=26.85, stdev= 9.33, samples=113 lat (usec) : 250=0.29%, 500=0.59%, 750=0.91%, 1000=0.46% lat (msec) : 2=1.17%, 4=5.50%, 10=17.71%, 20=36.49%, 50=34.70% lat (msec) : 100=2.08%, 250=0.07%, 1000=0.03% cpu : usr=0.10%, sys=28.94%, ctx=9642, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151340: Fri Jan 9 20:55:35 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(6052KiB/57825msec) clat (usec): min=82, max=109688, avg=19800.16, stdev=11298.57 lat (usec): min=82, max=109690, avg=19800.92, stdev=11298.65 clat percentiles (usec): | 1.00th=[ 355], 5.00th=[ 5080], 10.00th=[ 7701], 20.00th=[ 10814], | 30.00th=[ 13435], 40.00th=[ 15401], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 23725], 80.00th=[ 28181], 90.00th=[ 34341], 95.00th=[ 40109], | 99.00th=[ 57934], 99.50th=[ 61604], 99.90th=[ 69731], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 23, max= 207, per=25.78%, avg=106.20, stdev=32.51, samples=113 iops : min= 5, max= 51, avg=26.17, stdev= 8.19, samples=113 write: IOPS=26, BW=108KiB/s (110kB/s)(6236KiB/57825msec); 0 zone resets clat (usec): min=600, max=801293, avg=17679.11, stdev=24275.06 lat (usec): min=601, max=801293, avg=17679.97, stdev=24275.07 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 2311], 10.00th=[ 3163], 20.00th=[ 5276], | 30.00th=[ 7504], 40.00th=[ 11469], 50.00th=[ 14615], 60.00th=[ 17433], | 70.00th=[ 21365], 80.00th=[ 27132], 90.00th=[ 33817], 95.00th=[ 41157], | 99.00th=[ 66323], 99.50th=[ 89654], 99.90th=[125305], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 6, max= 200, per=24.94%, avg=107.48, stdev=35.10, samples=115 iops : min= 1, max= 50, avg=26.49, stdev= 8.89, samples=115 lat (usec) : 100=0.03%, 250=0.20%, 500=0.72%, 750=0.88%, 1000=0.75% lat (msec) : 2=1.17%, 4=5.37%, 10=17.32%, 20=35.64%, 50=35.94% lat (msec) : 100=1.79%, 250=0.16%, 1000=0.03% cpu : usr=0.11%, sys=28.81%, ctx=9748, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=412KiB/s (422kB/s), 102KiB/s-105KiB/s (104kB/s-107kB/s), io=23.4MiB (24.6MB), run=57681-58272msec WRITE: bw=431KiB/s (442kB/s), 108KiB/s-109KiB/s (110kB/s-112kB/s), io=24.6MiB (25.7MB), run=57681-58272msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151342: Fri Jan 9 20:55:57 2026 read: IOPS=18, BW=74.3KiB/s (76.1kB/s)(5992KiB/80631msec) clat (msec): min=2, max=808, avg=16.93, stdev=26.02 lat (msec): min=2, max=808, avg=16.93, stdev=26.02 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 50], | 99.00th=[ 78], 99.50th=[ 96], 99.90th=[ 153], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 23, max= 216, per=25.32%, avg=74.95, stdev=42.25, samples=158 iops : min= 5, max= 54, avg=18.44, stdev=10.70, samples=158 write: IOPS=19, BW=78.1KiB/s (79.0kB/s)(6296KiB/80631msec); 0 zone resets clat (msec): min=11, max=206, avg=34.99, stdev=18.36 lat (msec): min=11, max=206, avg=34.99, stdev=18.36 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 59], 95.00th=[ 69], | 99.00th=[ 105], 99.50th=[ 113], 99.90th=[ 186], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 8, max= 192, per=25.29%, avg=78.39, stdev=38.70, samples=159 iops : min= 2, max= 48, avg=19.30, stdev= 9.84, samples=159 lat (msec) : 4=6.45%, 10=15.10%, 20=21.52%, 50=46.48%, 100=9.70% lat (msec) : 250=0.72%, 1000=0.03% cpu : usr=0.05%, sys=9.61%, ctx=6070, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151343: Fri Jan 9 20:55:57 2026 read: IOPS=18, BW=73.5KiB/s (75.3kB/s)(5940KiB/80803msec) clat (msec): min=2, max=789, avg=16.82, stdev=25.21 lat (msec): min=2, max=789, avg=16.83, stdev=25.21 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 77], 99.50th=[ 85], 99.90th=[ 117], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8, max= 256, per=24.90%, avg=73.71, stdev=43.58, samples=159 iops : min= 2, max= 64, avg=18.13, stdev=11.04, samples=159 write: IOPS=19, BW=78.6KiB/s (80.4kB/s)(6348KiB/80803msec); 0 zone resets clat (msec): min=10, max=163, avg=35.04, stdev=17.60 lat (msec): min=10, max=163, avg=35.04, stdev=17.60 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 99], 99.50th=[ 118], 99.90th=[ 146], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 16, max= 192, per=25.35%, avg=78.59, stdev=37.60, samples=159 iops : min= 4, max= 48, avg=19.35, stdev= 9.57, samples=159 lat (msec) : 4=5.86%, 10=16.70%, 20=19.40%, 50=48.27%, 100=9.24% lat (msec) : 250=0.49%, 1000=0.03% cpu : usr=0.10%, sys=9.58%, ctx=5989, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151344: Fri Jan 9 20:55:57 2026 read: IOPS=18, BW=74.4KiB/s (76.2kB/s)(6028KiB/81027msec) clat (msec): min=2, max=137, avg=16.58, stdev=15.59 lat (msec): min=2, max=137, avg=16.58, stdev=15.59 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 9], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 49], | 99.00th=[ 71], 99.50th=[ 80], 99.90th=[ 134], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 16, max= 216, per=25.35%, avg=75.03, stdev=39.82, samples=159 iops : min= 4, max= 54, avg=18.46, stdev=10.10, samples=159 write: IOPS=19, BW=77.3KiB/s (79.1kB/s)(6260KiB/81027msec); 0 zone resets clat (msec): min=11, max=809, avg=35.68, stdev=26.70 lat (msec): min=11, max=809, avg=35.68, stdev=26.70 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 71], | 99.00th=[ 105], 99.50th=[ 113], 99.90th=[ 161], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 15, max= 192, per=24.94%, avg=77.30, stdev=39.18, samples=160 iops : min= 3, max= 48, avg=19.03, stdev= 9.95, samples=160 lat (msec) : 4=5.63%, 10=15.23%, 20=21.94%, 50=46.39%, 100=10.12% lat (msec) : 250=0.65%, 1000=0.03% cpu : usr=0.08%, sys=9.68%, ctx=6014, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151345: Fri Jan 9 20:55:57 2026 read: IOPS=18, BW=75.3KiB/s (77.1kB/s)(6052KiB/80398msec) clat (msec): min=2, max=122, avg=15.98, stdev=15.09 lat (msec): min=2, max=122, avg=15.98, stdev=15.09 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 47], | 99.00th=[ 71], 99.50th=[ 86], 99.90th=[ 115], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 7, max= 200, per=25.73%, avg=76.15, stdev=42.62, samples=158 iops : min= 1, max= 50, avg=18.74, stdev=10.83, samples=158 write: IOPS=19, BW=77.6KiB/s (79.4kB/s)(6236KiB/80398msec); 0 zone resets clat (msec): min=12, max=815, avg=35.94, stdev=27.41 lat (msec): min=12, max=815, avg=35.94, stdev=27.41 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 70], | 99.00th=[ 110], 99.50th=[ 134], 99.90th=[ 209], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 23, max= 192, per=25.16%, avg=77.99, stdev=37.45, samples=159 iops : min= 5, max= 48, avg=19.20, stdev= 9.52, samples=159 lat (msec) : 4=6.22%, 10=15.89%, 20=21.35%, 50=46.84%, 100=8.89% lat (msec) : 250=0.78%, 1000=0.03% cpu : usr=0.08%, sys=9.68%, ctx=6082, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=296KiB/s (303kB/s), 73.5KiB/s-75.3KiB/s (75.3kB/s-77.1kB/s), io=23.4MiB (24.6MB), run=80398-81027msec WRITE: bw=310KiB/s (318kB/s), 77.3KiB/s-78.6KiB/s (79.1kB/s-80.4kB/s), io=24.6MiB (25.7MB), run=80398-81027msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151373: Fri Jan 9 20:56:22 2026 read: IOPS=20, BW=326KiB/s (333kB/s)(5920KiB/18182msec) clat (usec): min=271, max=105734, avg=24511.61, stdev=14591.66 lat (usec): min=273, max=105735, avg=24512.70, stdev=14591.98 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 725], 10.00th=[ 8717], 20.00th=[ 13173], | 30.00th=[ 16909], 40.00th=[ 20055], 50.00th=[ 22414], 60.00th=[ 26084], | 70.00th=[ 30016], 80.00th=[ 34866], 90.00th=[ 42206], 95.00th=[ 49021], | 99.00th=[ 72877], 99.50th=[ 76022], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 191, max= 605, per=24.88%, avg=322.71, stdev=101.42, samples=35 iops : min= 11, max= 37, avg=19.46, stdev= 6.43, samples=35 write: IOPS=21, BW=350KiB/s (359kB/s)(6368KiB/18182msec); 0 zone resets clat (usec): min=1292, max=103226, avg=22770.58, stdev=15666.94 lat (usec): min=1294, max=103227, avg=22772.22, stdev=15666.93 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 54], | 99.00th=[ 72], 99.50th=[ 78], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 158, max= 795, per=25.67%, avg=350.43, stdev=125.31, samples=35 iops : min= 9, max= 49, avg=21.20, stdev= 7.85, samples=35 lat (usec) : 500=0.65%, 750=1.82%, 1000=0.91% lat (msec) : 2=0.39%, 4=1.56%, 10=13.02%, 20=28.26%, 50=48.18% lat (msec) : 100=4.95%, 250=0.26% cpu : usr=0.11%, sys=32.43%, ctx=3111, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151374: Fri Jan 9 20:56:22 2026 read: IOPS=19, BW=314KiB/s (321kB/s)(5744KiB/18310msec) clat (usec): min=240, max=90102, avg=25694.71, stdev=14225.90 lat (usec): min=240, max=90103, avg=25695.61, stdev=14225.96 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 799], 10.00th=[10290], 20.00th=[15401], | 30.00th=[18220], 40.00th=[20317], 50.00th=[23725], 60.00th=[27132], | 70.00th=[31065], 80.00th=[36439], 90.00th=[41681], 95.00th=[52691], | 99.00th=[72877], 99.50th=[84411], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 127, max= 636, per=24.17%, avg=313.50, stdev=103.87, samples=36 iops : min= 7, max= 39, avg=18.89, stdev= 6.59, samples=36 write: IOPS=22, BW=357KiB/s (366kB/s)(6544KiB/18310msec); 0 zone resets clat (usec): min=1311, max=104617, avg=22139.88, stdev=15002.41 lat (usec): min=1313, max=104619, avg=22143.38, stdev=15000.92 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 42], 95.00th=[ 54], | 99.00th=[ 62], 99.50th=[ 88], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 223, max= 604, per=26.21%, avg=357.72, stdev=93.73, samples=36 iops : min= 13, max= 37, avg=21.67, stdev= 5.93, samples=36 lat (usec) : 250=0.13%, 500=0.78%, 750=0.91%, 1000=0.78% lat (msec) : 2=0.52%, 4=1.30%, 10=12.63%, 20=29.43%, 50=47.27% lat (msec) : 100=6.12%, 250=0.13% cpu : usr=0.11%, sys=32.83%, ctx=3046, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151375: Fri Jan 9 20:56:22 2026 read: IOPS=21, BW=339KiB/s (347kB/s)(6256KiB/18455msec) clat (usec): min=250, max=125581, avg=25174.71, stdev=14824.68 lat (usec): min=250, max=125582, avg=25175.61, stdev=14824.75 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 586], 10.00th=[ 8717], 20.00th=[ 15270], | 30.00th=[ 18482], 40.00th=[ 21103], 50.00th=[ 24249], 60.00th=[ 26346], | 70.00th=[ 30016], 80.00th=[ 34866], 90.00th=[ 40633], 95.00th=[ 47449], | 99.00th=[ 73925], 99.50th=[107480], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 95, max= 704, per=26.10%, avg=338.47, stdev=125.29, samples=36 iops : min= 5, max= 44, avg=20.44, stdev= 7.97, samples=36 write: IOPS=20, BW=327KiB/s (335kB/s)(6032KiB/18455msec); 0 zone resets clat (usec): min=879, max=86264, avg=22664.51, stdev=14984.08 lat (usec): min=880, max=86266, avg=22666.27, stdev=14984.12 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 4424], 10.00th=[ 6718], 20.00th=[ 9241], | 30.00th=[12518], 40.00th=[16450], 50.00th=[19268], 60.00th=[23987], | 70.00th=[28967], 80.00th=[33817], 90.00th=[42730], 95.00th=[53216], | 99.00th=[69731], 99.50th=[81265], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 126, max= 572, per=23.52%, avg=321.11, stdev=99.11, samples=36 iops : min= 7, max= 35, avg=19.36, stdev= 6.15, samples=36 lat (usec) : 500=1.30%, 750=2.08%, 1000=0.91% lat (msec) : 2=0.78%, 4=1.30%, 10=10.16%, 20=26.30%, 50=52.47% lat (msec) : 100=4.43%, 250=0.26% cpu : usr=0.09%, sys=32.02%, ctx=3104, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151376: Fri Jan 9 20:56:22 2026 read: IOPS=20, BW=328KiB/s (336kB/s)(6032KiB/18392msec) clat (usec): min=274, max=86417, avg=24811.90, stdev=14332.47 lat (usec): min=274, max=86417, avg=24812.83, stdev=14332.73 clat percentiles (usec): | 1.00th=[ 314], 5.00th=[ 603], 10.00th=[ 1037], 20.00th=[14877], | 30.00th=[18220], 40.00th=[21103], 50.00th=[24511], 60.00th=[27395], | 70.00th=[30802], 80.00th=[34866], 90.00th=[42730], 95.00th=[46924], | 99.00th=[69731], 99.50th=[86508], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 63, max= 763, per=25.06%, avg=325.06, stdev=116.52, samples=36 iops : min= 3, max= 47, avg=19.61, stdev= 7.35, samples=36 write: IOPS=21, BW=340KiB/s (348kB/s)(6256KiB/18392msec); 0 zone resets clat (usec): min=1095, max=103354, avg=22909.70, stdev=16584.89 lat (usec): min=1096, max=103355, avg=22911.73, stdev=16584.86 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 88], 99.50th=[ 97], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 190, max= 890, per=24.81%, avg=338.67, stdev=128.30, samples=36 iops : min= 11, max= 55, avg=20.47, stdev= 8.07, samples=36 lat (usec) : 500=1.56%, 750=2.60%, 1000=0.65% lat (msec) : 2=0.78%, 4=0.91%, 10=13.54%, 20=24.87%, 50=50.78% lat (msec) : 100=4.17%, 250=0.13% cpu : usr=0.12%, sys=32.28%, ctx=3008, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1298KiB/s (1329kB/s), 314KiB/s-339KiB/s (321kB/s-347kB/s), io=23.4MiB (24.5MB), run=18182-18455msec WRITE: bw=1365KiB/s (1398kB/s), 327KiB/s-357KiB/s (335kB/s-366kB/s), io=24.6MiB (25.8MB), run=18182-18455msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151378: Fri Jan 9 20:56:26 2026 read: IOPS=16, BW=259KiB/s (266kB/s)(5920KiB/22815msec) clat (msec): min=2, max=119, avg=20.40, stdev=19.69 lat (msec): min=2, max=119, avg=20.40, stdev=19.69 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 10], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 45], 95.00th=[ 67], | 99.00th=[ 87], 99.50th=[ 112], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 95, max= 768, per=24.49%, avg=256.87, stdev=165.05, samples=45 iops : min= 5, max= 48, avg=15.44, stdev=10.54, samples=45 write: IOPS=17, BW=279KiB/s (286kB/s)(6368KiB/22815msec); 0 zone resets clat (msec): min=13, max=168, avg=38.06, stdev=22.81 lat (msec): min=13, max=168, avg=38.07, stdev=22.81 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 69], 95.00th=[ 82], | 99.00th=[ 126], 99.50th=[ 136], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 95, max= 672, per=25.15%, avg=277.67, stdev=159.85, samples=45 iops : min= 5, max= 42, avg=16.73, stdev=10.25, samples=45 lat (msec) : 4=4.56%, 10=14.84%, 20=20.05%, 50=45.70%, 100=13.15% lat (msec) : 250=1.69% cpu : usr=0.05%, sys=11.84%, ctx=1774, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151379: Fri Jan 9 20:56:26 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(5744KiB/22816msec) clat (msec): min=2, max=128, avg=21.44, stdev=23.10 lat (msec): min=2, max=128, avg=21.44, stdev=23.10 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 9], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 34], 90.00th=[ 51], 95.00th=[ 80], | 99.00th=[ 114], 99.50th=[ 121], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 31, max= 768, per=23.87%, avg=250.42, stdev=174.48, samples=45 iops : min= 1, max= 48, avg=15.02, stdev=11.11, samples=45 write: IOPS=17, BW=287KiB/s (294kB/s)(6544KiB/22816msec); 0 zone resets clat (msec): min=12, max=125, avg=36.56, stdev=20.66 lat (msec): min=12, max=125, avg=36.56, stdev=20.66 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 67], 95.00th=[ 82], | 99.00th=[ 105], 99.50th=[ 116], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 126, max= 736, per=25.73%, avg=284.07, stdev=170.89, samples=45 iops : min= 7, max= 46, avg=17.13, stdev=10.96, samples=45 lat (msec) : 4=4.04%, 10=15.76%, 20=19.92%, 50=45.05%, 100=13.80% lat (msec) : 250=1.43% cpu : usr=0.14%, sys=11.62%, ctx=1748, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151380: Fri Jan 9 20:56:26 2026 read: IOPS=17, BW=275KiB/s (282kB/s)(6256KiB/22725msec) clat (msec): min=2, max=127, avg=20.62, stdev=22.81 lat (msec): min=2, max=127, avg=20.62, stdev=22.81 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 50], 95.00th=[ 75], | 99.00th=[ 113], 99.50th=[ 126], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 63, max= 896, per=26.34%, avg=276.29, stdev=219.97, samples=45 iops : min= 3, max= 56, avg=16.64, stdev=14.01, samples=45 write: IOPS=16, BW=265KiB/s (272kB/s)(6032KiB/22725msec); 0 zone resets clat (msec): min=13, max=136, avg=38.61, stdev=23.60 lat (msec): min=13, max=136, avg=38.61, stdev=23.60 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 73], 95.00th=[ 88], | 99.00th=[ 127], 99.50th=[ 130], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 704, per=24.04%, avg=265.40, stdev=168.82, samples=45 iops : min= 3, max= 44, avg=15.98, stdev=10.79, samples=45 lat (msec) : 4=4.56%, 10=17.84%, 20=21.74%, 50=38.93%, 100=14.45% lat (msec) : 250=2.47% cpu : usr=0.07%, sys=11.91%, ctx=1842, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151381: Fri Jan 9 20:56:26 2026 read: IOPS=16, BW=265KiB/s (271kB/s)(6032KiB/22768msec) clat (msec): min=2, max=127, avg=20.74, stdev=20.69 lat (msec): min=2, max=127, avg=20.74, stdev=20.69 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 49], 95.00th=[ 68], | 99.00th=[ 95], 99.50th=[ 120], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 95, max= 768, per=25.14%, avg=263.71, stdev=176.07, samples=45 iops : min= 5, max= 48, avg=15.87, stdev=11.27, samples=45 write: IOPS=17, BW=275KiB/s (281kB/s)(6256KiB/22768msec); 0 zone resets clat (msec): min=13, max=146, avg=37.78, stdev=23.74 lat (msec): min=13, max=146, avg=37.78, stdev=23.74 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 70], 95.00th=[ 91], | 99.00th=[ 129], 99.50th=[ 133], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 95, max= 702, per=24.87%, avg=274.58, stdev=171.63, samples=45 iops : min= 5, max= 43, avg=16.56, stdev=10.98, samples=45 lat (msec) : 4=4.30%, 10=14.97%, 20=22.40%, 50=41.93%, 100=14.58% lat (msec) : 250=1.82% cpu : usr=0.06%, sys=11.77%, ctx=1788, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1050KiB/s (1075kB/s), 252KiB/s-275KiB/s (258kB/s-282kB/s), io=23.4MiB (24.5MB), run=22725-22816msec WRITE: bw=1104KiB/s (1131kB/s), 265KiB/s-287KiB/s (272kB/s-294kB/s), io=24.6MiB (25.8MB), run=22725-22816msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151389: Fri Jan 9 20:56:34 2026 read: IOPS=3, BW=3483KiB/s (3567kB/s)(7168KiB/2058msec) clat (msec): min=54, max=508, avg=181.64, stdev=174.89 lat (msec): min=54, max=508, avg=181.64, stdev=174.89 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 61], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 113], 60.00th=[ 115], | 70.00th=[ 115], 80.00th=[ 342], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2003, max= 5111, per=56.03%, avg=3699.33, stdev=1573.43, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2488KiB/s (2548kB/s)(5120KiB/2058msec); 0 zone resets clat (msec): min=84, max=316, avg=151.50, stdev=97.31 lat (msec): min=84, max=316, avg=151.57, stdev=97.31 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 102], 60.00th=[ 102], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1703, max= 6011, per=35.00%, avg=3235.33, stdev=2408.14, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=41.67%, 250=33.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=13.95%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151390: Fri Jan 9 20:56:34 2026 read: IOPS=0, BW=660KiB/s (676kB/s)(2048KiB/3102msec) clat (msec): min=42, max=475, avg=258.77, stdev=305.99 lat (msec): min=42, max=475, avg=258.77, stdev=305.99 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 43], 40.00th=[ 43], 50.00th=[ 43], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1703, max= 1992, per=27.98%, avg=1847.50, stdev=204.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3301KiB/s (3380kB/s)(10.0MiB/3102msec); 0 zone resets clat (msec): min=69, max=484, avg=254.13, stdev=120.80 lat (msec): min=69, max=484, avg=254.19, stdev=120.80 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 180], 40.00th=[ 266], 50.00th=[ 268], 60.00th=[ 284], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 334], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1703, max= 5976, per=37.05%, avg=3424.25, stdev=1986.88, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=8.33%, 500=66.67% cpu : usr=0.03%, sys=15.16%, ctx=124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151391: Fri Jan 9 20:56:34 2026 read: IOPS=2, BW=2490KiB/s (2550kB/s)(6144KiB/2467msec) clat (msec): min=101, max=333, avg=172.80, stdev=94.12 lat (msec): min=101, max=333, avg=172.81, stdev=94.12 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 138], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1992, max= 3984, per=40.29%, avg=2659.67, stdev=1146.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2490KiB/s (2550kB/s)(6144KiB/2467msec); 0 zone resets clat (msec): min=46, max=829, avg=235.97, stdev=295.39 lat (msec): min=46, max=829, avg=236.04, stdev=295.38 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 163], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1992, max= 3413, per=25.42%, avg=2350.00, stdev=708.69, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=66.67%, 500=8.33%, 1000=8.33% cpu : usr=0.04%, sys=14.48%, ctx=357, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151392: Fri Jan 9 20:56:34 2026 read: IOPS=1, BW=1726KiB/s (1768kB/s)(5120KiB/2966msec) clat (msec): min=45, max=371, avg=197.63, stdev=153.18 lat (msec): min=45, max=371, avg=197.63, stdev=153.18 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 54], 40.00th=[ 54], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1992, max= 6023, per=60.70%, avg=4007.50, stdev=2850.35, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2417KiB/s (2475kB/s)(7168KiB/2966msec); 0 zone resets clat (msec): min=55, max=900, avg=277.50, stdev=308.19 lat (msec): min=55, max=900, avg=277.59, stdev=308.20 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 106], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 397], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1703, max= 4007, per=27.78%, avg=2567.33, stdev=1255.13, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=33.33%, 1000=8.33% cpu : usr=0.03%, sys=11.33%, ctx=80, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6602KiB/s (6761kB/s), 660KiB/s-3483KiB/s (676kB/s-3567kB/s), io=20.0MiB (20.0MB), run=2058-3102msec WRITE: bw=9243KiB/s (9465kB/s), 2417KiB/s-3301KiB/s (2475kB/s-3380kB/s), io=28.0MiB (29.4MB), run=2058-3102msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151394: Fri Jan 9 20:56:34 2026 read: IOPS=2, BW=2715KiB/s (2780kB/s)(7168KiB/2640msec) clat (msec): min=99, max=691, avg=214.34, stdev=212.26 lat (msec): min=99, max=691, avg=214.34, stdev=212.26 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 111], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 140], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 182], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1686, max= 4096, per=43.70%, avg=2977.25, stdev=1299.48, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=1, BW=1939KiB/s (1986kB/s)(5120KiB/2640msec); 0 zone resets clat (msec): min=151, max=375, avg=219.29, stdev=92.57 lat (msec): min=151, max=375, avg=219.36, stdev=92.56 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2031, max= 5976, per=35.14%, avg=3351.67, stdev=2272.76, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=42.21%, ctx=1211, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151395: Fri Jan 9 20:56:34 2026 read: IOPS=0, BW=788KiB/s (807kB/s)(2048KiB/2599msec) clat (msec): min=95, max=237, avg=166.40, stdev=99.97 lat (msec): min=95, max=237, avg=166.40, stdev=99.97 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 1735, max= 1992, per=27.35%, avg=1863.50, stdev=181.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3940KiB/s (4035kB/s)(10.0MiB/2599msec); 0 zone resets clat (msec): min=94, max=438, avg=220.19, stdev=107.50 lat (msec): min=94, max=438, avg=220.26, stdev=107.50 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 144], | 30.00th=[ 153], 40.00th=[ 159], 50.00th=[ 178], 60.00th=[ 192], | 70.00th=[ 207], 80.00th=[ 279], 90.00th=[ 363], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1735, max= 5976, per=36.32%, avg=3463.75, stdev=1975.18, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.83, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=46.27%, ctx=288, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151396: Fri Jan 9 20:56:34 2026 read: IOPS=2, BW=2222KiB/s (2275kB/s)(6144KiB/2765msec) clat (usec): min=890, max=355381, avg=131932.38, stdev=130355.65 lat (usec): min=891, max=355382, avg=131933.19, stdev=130355.60 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 889], 10.00th=[ 889], 20.00th=[ 22152], | 30.00th=[ 22152], 40.00th=[ 82314], 50.00th=[ 82314], 60.00th=[143655], | 70.00th=[187696], 80.00th=[187696], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 4096, max= 6095, per=74.79%, avg=5095.50, stdev=1413.51, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2222KiB/s (2275kB/s)(6144KiB/2765msec); 0 zone resets clat (msec): min=110, max=745, avg=315.77, stdev=228.94 lat (msec): min=110, max=745, avg=315.82, stdev=228.96 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 288], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1992, max= 3482, per=25.04%, avg=2388.25, stdev=729.54, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=34.88%, ctx=890, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151397: Fri Jan 9 20:56:34 2026 read: IOPS=1, BW=1703KiB/s (1744kB/s)(5120KiB/3006msec) clat (usec): min=699, max=390088, avg=119665.32, stdev=160415.00 lat (usec): min=701, max=390088, avg=119666.52, stdev=160414.60 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 14615], 40.00th=[ 14615], 50.00th=[ 54264], 60.00th=[ 54264], | 70.00th=[139461], 80.00th=[139461], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 1992, max= 6095, per=59.35%, avg=4043.50, stdev=2901.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2385KiB/s (2442kB/s)(7168KiB/3006msec); 0 zone resets clat (msec): min=87, max=758, avg=332.56, stdev=244.26 lat (msec): min=87, max=758, avg=332.63, stdev=244.26 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 99], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 284], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 493], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1718, max= 3984, per=27.08%, avg=2583.33, stdev=1224.18, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 100=25.00%, 250=16.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=28.32%, ctx=588, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6813KiB/s (6977kB/s), 788KiB/s-2715KiB/s (807kB/s-2780kB/s), io=20.0MiB (20.0MB), run=2599-3006msec WRITE: bw=9538KiB/s (9767kB/s), 1939KiB/s-3940KiB/s (1986kB/s-4035kB/s), io=28.0MiB (29.4MB), run=2599-3006msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151402: Fri Jan 9 20:56:42 2026 read: IOPS=2, BW=9267KiB/s (9489kB/s)(12.0MiB/1326msec) clat (msec): min=378, max=432, avg=397.18, stdev=30.49 lat (msec): min=378, max=432, avg=397.18, stdev=30.49 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=52.45%, ctx=2593, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151403: Fri Jan 9 20:56:42 2026 read: IOPS=0, BW=2835KiB/s (2903kB/s)(4096KiB/1445msec) clat (nsec): min=433755k, max=433755k, avg=433755347.00, stdev= 0.00 lat (nsec): min=433758k, max=433758k, avg=433758168.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 8192, max= 8192, per=72.25%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5669KiB/s (5805kB/s)(8192KiB/1445msec); 0 zone resets clat (msec): min=307, max=567, avg=437.57, stdev=183.85 lat (msec): min=307, max=567, avg=437.88, stdev=183.83 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 8192, max= 8192, per=46.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.14%, sys=28.81%, ctx=604, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151404: Fri Jan 9 20:56:42 2026 write: IOPS=1, BW=6578KiB/s (6736kB/s)(12.0MiB/1868msec); 0 zone resets clat (msec): min=110, max=1085, avg=577.91, stdev=488.83 lat (msec): min=110, max=1085, avg=578.20, stdev=488.85 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=46.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.11%, sys=15.53%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151405: Fri Jan 9 20:56:42 2026 write: IOPS=1, BW=7714KiB/s (7899kB/s)(12.0MiB/1593msec); 0 zone resets clat (msec): min=121, max=1140, avg=485.14, stdev=568.53 lat (msec): min=121, max=1140, avg=485.46, stdev=568.55 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min=14733, max=14733, per=83.99%, avg=14733.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.06%, sys=17.78%, ctx=86, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.1MiB/s (11.6MB/s), 2835KiB/s-9267KiB/s (2903kB/s-9489kB/s), io=16.0MiB (16.8MB), run=1326-1445msec WRITE: bw=17.1MiB/s (17.0MB/s), 5669KiB/s-7714KiB/s (5805kB/s-7899kB/s), io=32.0MiB (33.6MB), run=1445-1868msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151407: Fri Jan 9 20:56:42 2026 read: IOPS=2, BW=9555KiB/s (9785kB/s)(12.0MiB/1286msec) clat (msec): min=340, max=515, avg=416.81, stdev=89.47 lat (msec): min=340, max=515, avg=416.81, stdev=89.47 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=19.92%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151408: Fri Jan 9 20:56:42 2026 read: IOPS=0, BW=2282KiB/s (2337kB/s)(4096KiB/1795msec) clat (nsec): min=1279.8M, max=1279.8M, avg=1279782284.00, stdev= 0.00 lat (nsec): min=1279.8M, max=1279.8M, avg=1279783457.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8192, max= 8192, per=89.76%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4564KiB/s (4673kB/s)(8192KiB/1795msec); 0 zone resets clat (msec): min=147, max=319, avg=233.25, stdev=121.56 lat (msec): min=147, max=319, avg=233.51, stdev=121.55 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 8192, max= 8192, per=44.88%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.10%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151409: Fri Jan 9 20:56:42 2026 write: IOPS=1, BW=7362KiB/s (7539kB/s)(12.0MiB/1669msec); 0 zone resets clat (msec): min=162, max=839, avg=539.26, stdev=344.75 lat (msec): min=162, max=839, avg=539.55, stdev=344.77 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8192, max= 8192, per=44.88%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=17.75%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151410: Fri Jan 9 20:56:42 2026 write: IOPS=1, BW=7497KiB/s (7677kB/s)(12.0MiB/1639msec); 0 zone resets clat (msec): min=159, max=1150, avg=534.30, stdev=537.45 lat (msec): min=159, max=1150, avg=534.60, stdev=537.45 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min=16000, max=16000, per=87.65%, avg=16000.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.12%, sys=15.81%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9128KiB/s (9347kB/s), 2282KiB/s-9555KiB/s (2337kB/s-9785kB/s), io=16.0MiB (16.8MB), run=1286-1795msec WRITE: bw=17.8MiB/s (18.7MB/s), 4564KiB/s-7497KiB/s (4673kB/s-7677kB/s), io=32.0MiB (33.6MB), run=1639-1795msec