== sanity test 398b: DIO and buffer IO race ============== 21:21:09 (1763346069) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.93512 s, 10.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184187: Sun Nov 16 21:23:01 2025 read: IOPS=15, BW=61.8KiB/s (63.3kB/s)(5992KiB/96968msec) clat (usec): min=124, max=1009.5k, avg=36430.30, stdev=34068.77 lat (usec): min=124, max=1009.5k, avg=36432.34, stdev=34069.17 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 8094], 10.00th=[ 14091], | 20.00th=[ 19006], 30.00th=[ 22676], 40.00th=[ 26870], | 50.00th=[ 31065], 60.00th=[ 36963], 70.00th=[ 42730], | 80.00th=[ 51119], 90.00th=[ 61604], 95.00th=[ 74974], | 99.00th=[ 125305], 99.50th=[ 149947], 99.90th=[ 198181], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 118, per=24.94%, avg=61.61, stdev=20.39, samples=191 iops : min= 1, max= 29, avg=14.78, stdev= 5.12, samples=191 write: IOPS=16, BW=64.9KiB/s (66.5kB/s)(6296KiB/96968msec); 0 zone resets clat (usec): min=938, max=201784, avg=26615.36, stdev=26790.90 lat (usec): min=939, max=201786, avg=26617.07, stdev=26790.79 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 2278], | 30.00th=[ 5866], 40.00th=[ 13304], 50.00th=[ 20579], 60.00th=[ 26870], | 70.00th=[ 34866], 80.00th=[ 45351], 90.00th=[ 62653], 95.00th=[ 77071], | 99.00th=[117965], 99.50th=[129500], 99.90th=[198181], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 143, per=25.01%, avg=64.76, stdev=24.12, samples=191 iops : min= 1, max= 35, avg=15.55, stdev= 6.05, samples=191 lat (usec) : 250=1.60%, 500=0.49%, 750=0.07%, 1000=0.16% lat (msec) : 2=9.31%, 4=3.74%, 10=6.18%, 20=14.68%, 50=44.79% lat (msec) : 100=17.22%, 250=1.73%, 2000=0.03% cpu : usr=0.09%, sys=7.75%, ctx=6512, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184188: Sun Nov 16 21:23:01 2025 read: IOPS=15, BW=61.5KiB/s (62.0kB/s)(5940KiB/96608msec) clat (usec): min=106, max=567780, avg=35107.66, stdev=26148.83 lat (usec): min=106, max=567782, avg=35116.27, stdev=26150.41 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 343], 10.00th=[ 13566], 20.00th=[ 18744], | 30.00th=[ 22152], 40.00th=[ 26084], 50.00th=[ 30540], 60.00th=[ 36439], | 70.00th=[ 41681], 80.00th=[ 49021], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[111674], 99.50th=[131597], 99.90th=[244319], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 15, max= 118, per=24.62%, avg=60.81, stdev=20.93, samples=190 iops : min= 3, max= 29, avg=14.58, stdev= 5.29, samples=190 write: IOPS=16, BW=65.7KiB/s (67.3kB/s)(6348KiB/96608msec); 0 zone resets clat (usec): min=861, max=300843, avg=27693.96, stdev=28957.95 lat (usec): min=861, max=300845, avg=27695.59, stdev=28957.95 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 2540], | 30.00th=[ 6325], 40.00th=[ 14222], 50.00th=[ 20579], 60.00th=[ 26870], | 70.00th=[ 35390], 80.00th=[ 46924], 90.00th=[ 65274], 95.00th=[ 80217], | 99.00th=[120062], 99.50th=[132645], 99.90th=[240124], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 157, per=25.00%, avg=64.75, stdev=24.52, samples=190 iops : min= 1, max= 39, avg=15.56, stdev= 6.16, samples=190 lat (usec) : 250=1.99%, 500=0.59%, 750=0.07%, 1000=0.29% lat (msec) : 2=8.59%, 4=3.74%, 10=6.35%, 20=14.91%, 50=45.28% lat (msec) : 100=16.21%, 250=1.92%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=7.79%, ctx=6533, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184189: Sun Nov 16 21:23:01 2025 read: IOPS=15, BW=62.7KiB/s (64.2kB/s)(6028KiB/96213msec) clat (usec): min=125, max=172695, avg=34924.26, stdev=20213.50 lat (usec): min=126, max=172697, avg=34927.66, stdev=20213.51 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 10552], 10.00th=[ 14353], 20.00th=[ 19006], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 31065], 60.00th=[ 36439], | 70.00th=[ 42206], 80.00th=[ 49546], 90.00th=[ 60556], 95.00th=[ 70779], | 99.00th=[101188], 99.50th=[112722], 99.90th=[135267], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 7, max= 119, per=25.26%, avg=62.40, stdev=21.72, samples=189 iops : min= 1, max= 29, avg=14.97, stdev= 5.47, samples=189 write: IOPS=16, BW=65.1KiB/s (66.6kB/s)(6260KiB/96213msec); 0 zone resets clat (usec): min=946, max=938430, avg=27543.93, stdev=35683.45 lat (usec): min=948, max=938431, avg=27551.92, stdev=35682.39 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1188], 10.00th=[ 1369], 20.00th=[ 2933], | 30.00th=[ 7177], 40.00th=[ 14091], 50.00th=[ 19792], 60.00th=[ 26346], | 70.00th=[ 34866], 80.00th=[ 46400], 90.00th=[ 63701], 95.00th=[ 80217], | 99.00th=[117965], 99.50th=[135267], 99.90th=[233833], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 127, per=24.85%, avg=64.35, stdev=23.11, samples=190 iops : min= 1, max= 31, avg=15.46, stdev= 5.83, samples=190 lat (usec) : 250=1.33%, 500=0.59%, 750=0.03%, 1000=0.16% lat (msec) : 2=7.88%, 4=3.87%, 10=6.05%, 20=16.67%, 50=45.18% lat (msec) : 100=16.76%, 250=1.43%, 1000=0.03% cpu : usr=0.11%, sys=8.09%, ctx=6674, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184190: Sun Nov 16 21:23:01 2025 read: IOPS=15, BW=63.3KiB/s (64.8kB/s)(6052KiB/95674msec) clat (usec): min=108, max=416373, avg=35015.19, stdev=23334.79 lat (usec): min=109, max=416375, avg=35016.63, stdev=23334.83 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 9503], 10.00th=[ 14615], 20.00th=[ 18744], | 30.00th=[ 22414], 40.00th=[ 26346], 50.00th=[ 30540], 60.00th=[ 36439], | 70.00th=[ 42206], 80.00th=[ 49021], 90.00th=[ 60556], 95.00th=[ 70779], | 99.00th=[105382], 99.50th=[130548], 99.90th=[238027], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 15, max= 111, per=25.55%, avg=63.10, stdev=19.73, samples=187 iops : min= 3, max= 27, avg=15.16, stdev= 4.96, samples=187 write: IOPS=16, BW=65.2KiB/s (66.7kB/s)(6236KiB/95674msec); 0 zone resets clat (usec): min=867, max=589014, avg=27054.93, stdev=30856.45 lat (usec): min=867, max=589015, avg=27057.31, stdev=30855.97 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1287], 20.00th=[ 2638], | 30.00th=[ 5997], 40.00th=[ 12911], 50.00th=[ 20579], 60.00th=[ 26346], | 70.00th=[ 34341], 80.00th=[ 46924], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[110625], 99.50th=[149947], 99.90th=[283116], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 151, per=24.95%, avg=64.61, stdev=23.61, samples=188 iops : min= 1, max= 37, avg=15.54, stdev= 5.95, samples=188 lat (usec) : 250=1.50%, 500=0.49%, 1000=0.20% lat (msec) : 2=8.85%, 4=3.65%, 10=6.58%, 20=15.27%, 50=45.38% lat (msec) : 100=16.63%, 250=1.37%, 500=0.07%, 750=0.03% cpu : usr=0.11%, sys=7.81%, ctx=6606, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=248KiB/s (254kB/s), 61.5KiB/s-63.3KiB/s (62.0kB/s-64.8kB/s), io=23.4MiB (24.6MB), run=95674-96968msec WRITE: bw=259KiB/s (265kB/s), 64.9KiB/s-65.7KiB/s (66.5kB/s-67.3kB/s), io=24.6MiB (25.7MB), run=95674-96968msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184192: Sun Nov 16 21:23:40 2025 read: IOPS=11, BW=44.2KiB/s (45.3kB/s)(5992KiB/135417msec) clat (msec): min=5, max=651, avg=35.02, stdev=34.09 lat (msec): min=5, max=651, avg=35.03, stdev=34.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 72], 95.00th=[ 95], | 99.00th=[ 155], 99.50th=[ 184], 99.90th=[ 271], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 128, per=24.94%, avg=44.14, stdev=25.96, samples=264 iops : min= 1, max= 32, avg=10.37, stdev= 6.53, samples=264 write: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6296KiB/135417msec); 0 zone resets clat (msec): min=9, max=314, avg=52.63, stdev=33.72 lat (msec): min=9, max=314, avg=52.64, stdev=33.72 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 62], 80.00th=[ 75], 90.00th=[ 93], 95.00th=[ 117], | 99.00th=[ 169], 99.50th=[ 222], 99.90th=[ 300], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 126, per=25.08%, avg=46.41, stdev=24.40, samples=264 iops : min= 1, max= 31, avg=10.94, stdev= 6.15, samples=264 lat (msec) : 10=2.25%, 20=20.02%, 50=47.20%, 100=24.28%, 250=6.05% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=2.56%, ctx=4874, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184193: Sun Nov 16 21:23:40 2025 read: IOPS=11, BW=44.1KiB/s (45.2kB/s)(5940KiB/134704msec) clat (msec): min=5, max=1030, avg=34.51, stdev=38.03 lat (msec): min=5, max=1030, avg=34.52, stdev=38.03 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 72], 95.00th=[ 92], | 99.00th=[ 140], 99.50th=[ 174], 99.90th=[ 228], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 135, per=24.89%, avg=44.05, stdev=28.04, samples=263 iops : min= 1, max= 33, avg=10.35, stdev= 7.04, samples=263 write: IOPS=11, BW=47.1KiB/s (48.3kB/s)(6348KiB/134704msec); 0 zone resets clat (msec): min=9, max=299, avg=52.51, stdev=30.87 lat (msec): min=9, max=299, avg=52.51, stdev=30.87 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 75], 90.00th=[ 93], 95.00th=[ 112], | 99.00th=[ 153], 99.50th=[ 171], 99.90th=[ 239], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 127, per=25.38%, avg=46.95, stdev=24.37, samples=264 iops : min= 1, max= 31, avg=11.08, stdev= 6.14, samples=264 lat (msec) : 10=2.44%, 20=19.86%, 50=47.17%, 100=24.80%, 250=5.66% lat (msec) : 500=0.03%, 2000=0.03% cpu : usr=0.09%, sys=2.59%, ctx=4870, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184194: Sun Nov 16 21:23:40 2025 read: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6028KiB/134920msec) clat (msec): min=5, max=266, avg=34.83, stdev=28.61 lat (msec): min=5, max=266, avg=34.83, stdev=28.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 71], 95.00th=[ 92], | 99.00th=[ 138], 99.50th=[ 178], 99.90th=[ 234], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 7, max= 158, per=25.31%, avg=44.79, stdev=25.57, samples=262 iops : min= 1, max= 39, avg=10.54, stdev= 6.43, samples=262 write: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6260KiB/134920msec); 0 zone resets clat (msec): min=10, max=1042, avg=52.59, stdev=40.55 lat (msec): min=10, max=1042, avg=52.59, stdev=40.55 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 73], 90.00th=[ 93], 95.00th=[ 112], | 99.00th=[ 163], 99.50th=[ 211], 99.90th=[ 305], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 119, per=25.00%, avg=46.26, stdev=24.57, samples=263 iops : min= 1, max= 29, avg=10.90, stdev= 6.19, samples=263 lat (msec) : 10=2.38%, 20=18.88%, 50=48.27%, 100=24.87%, 250=5.44% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.09%, sys=2.56%, ctx=4835, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184195: Sun Nov 16 21:23:40 2025 read: IOPS=11, BW=44.9KiB/s (45.0kB/s)(6052KiB/134783msec) clat (msec): min=6, max=260, avg=34.45, stdev=29.95 lat (msec): min=6, max=260, avg=34.45, stdev=29.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 77], 95.00th=[ 100], | 99.00th=[ 142], 99.50th=[ 163], 99.90th=[ 255], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 144, per=25.46%, avg=45.06, stdev=27.70, samples=262 iops : min= 1, max= 36, avg=10.61, stdev= 6.97, samples=262 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6236KiB/134783msec); 0 zone resets clat (msec): min=9, max=1048, avg=52.95, stdev=42.42 lat (msec): min=9, max=1048, avg=52.95, stdev=42.43 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 61], 80.00th=[ 74], 90.00th=[ 95], 95.00th=[ 114], | 99.00th=[ 176], 99.50th=[ 234], 99.90th=[ 317], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 128, per=24.99%, avg=46.23, stdev=24.81, samples=263 iops : min= 1, max= 32, avg=10.90, stdev= 6.24, samples=263 lat (msec) : 10=2.80%, 20=20.21%, 50=47.20%, 100=23.40%, 250=6.15% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.09%, sys=2.53%, ctx=4920, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=177KiB/s (182kB/s), 44.1KiB/s-44.9KiB/s (45.2kB/s-45.0kB/s), io=23.4MiB (24.6MB), run=134704-135417msec WRITE: bw=186KiB/s (190kB/s), 46.3KiB/s-47.1KiB/s (47.4kB/s-48.3kB/s), io=24.6MiB (25.7MB), run=134704-135417msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184238: Sun Nov 16 21:24:21 2025 read: IOPS=13, BW=216KiB/s (221kB/s)(5920KiB/27433msec) clat (usec): min=122, max=165486, avg=39487.69, stdev=25865.93 lat (usec): min=122, max=165487, avg=39488.99, stdev=25865.96 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 293], 10.00th=[ 13173], 20.00th=[ 21627], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 34341], 60.00th=[ 39584], | 70.00th=[ 45351], 80.00th=[ 55313], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[124257], 99.50th=[135267], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 378, per=26.77%, avg=216.34, stdev=79.26, samples=53 iops : min= 3, max= 23, avg=12.77, stdev= 5.04, samples=53 write: IOPS=14, BW=232KiB/s (238kB/s)(6368KiB/27433msec); 0 zone resets clat (usec): min=1433, max=158255, avg=32072.77, stdev=29237.44 lat (usec): min=1435, max=158257, avg=32077.26, stdev=29237.10 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1811], 10.00th=[ 2089], 20.00th=[ 6128], | 30.00th=[ 11863], 40.00th=[ 17695], 50.00th=[ 23987], 60.00th=[ 31851], | 70.00th=[ 41157], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 94897], | 99.00th=[131597], 99.50th=[147850], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 31, max= 476, per=27.54%, avg=234.09, stdev=84.21, samples=53 iops : min= 1, max= 29, avg=13.89, stdev= 5.32, samples=53 lat (usec) : 250=2.08%, 500=1.17%, 1000=0.13% lat (msec) : 2=5.08%, 4=3.39%, 10=6.12%, 20=13.41%, 50=44.66% lat (msec) : 100=20.70%, 250=3.26% cpu : usr=0.14%, sys=8.64%, ctx=1782, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184239: Sun Nov 16 21:24:21 2025 read: IOPS=12, BW=194KiB/s (199kB/s)(5744KiB/29628msec) clat (usec): min=143, max=150269, avg=41726.41, stdev=24607.19 lat (usec): min=144, max=150271, avg=41727.72, stdev=24607.27 clat percentiles (usec): | 1.00th=[ 157], 5.00th=[ 269], 10.00th=[ 14484], 20.00th=[ 22152], | 30.00th=[ 26870], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 61080], 90.00th=[ 72877], 95.00th=[ 81265], | 99.00th=[121111], 99.50th=[127402], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 31, max= 398, per=23.99%, avg=193.84, stdev=73.15, samples=58 iops : min= 1, max= 24, avg=11.33, stdev= 4.62, samples=58 write: IOPS=13, BW=221KiB/s (226kB/s)(6544KiB/29628msec); 0 zone resets clat (usec): min=1424, max=255384, avg=35702.70, stdev=33790.50 lat (usec): min=1427, max=255387, avg=35705.18, stdev=33790.46 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1909], 10.00th=[ 3556], 20.00th=[ 8094], | 30.00th=[ 13829], 40.00th=[ 19530], 50.00th=[ 27919], 60.00th=[ 33424], | 70.00th=[ 45876], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[141558], 99.50th=[198181], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 509, per=25.83%, avg=219.52, stdev=108.70, samples=58 iops : min= 1, max= 31, avg=12.97, stdev= 6.87, samples=58 lat (usec) : 250=2.21%, 500=0.91% lat (msec) : 2=3.39%, 4=3.26%, 10=6.51%, 20=12.76%, 50=41.28% lat (msec) : 100=25.78%, 250=3.78%, 500=0.13% cpu : usr=0.10%, sys=8.03%, ctx=1876, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184240: Sun Nov 16 21:24:21 2025 read: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29080msec) clat (usec): min=157, max=186915, avg=40870.20, stdev=25856.50 lat (usec): min=159, max=186917, avg=40872.63, stdev=25855.68 clat percentiles (usec): | 1.00th=[ 159], 5.00th=[ 258], 10.00th=[ 15139], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 42730], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[120062], 99.50th=[141558], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 409, per=26.83%, avg=216.77, stdev=83.74, samples=56 iops : min= 3, max= 25, avg=12.80, stdev= 5.29, samples=56 write: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29080msec); 0 zone resets clat (usec): min=1421, max=178166, avg=34632.28, stdev=31579.70 lat (usec): min=1423, max=178168, avg=34634.88, stdev=31579.94 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1876], 10.00th=[ 2835], 20.00th=[ 6587], | 30.00th=[ 13698], 40.00th=[ 19792], 50.00th=[ 26084], 60.00th=[ 33162], | 70.00th=[ 42206], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[130548], 99.50th=[149947], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 63, max= 350, per=24.15%, avg=205.27, stdev=72.55, samples=56 iops : min= 3, max= 21, avg=12.07, stdev= 4.59, samples=56 lat (usec) : 250=2.47%, 500=0.39%, 750=0.39% lat (msec) : 2=3.26%, 4=3.65%, 10=6.38%, 20=12.11%, 50=44.92% lat (msec) : 100=22.27%, 250=4.17% cpu : usr=0.11%, sys=7.99%, ctx=1904, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184241: Sun Nov 16 21:24:21 2025 read: IOPS=13, BW=219KiB/s (225kB/s)(6032KiB/27499msec) clat (usec): min=136, max=206684, avg=39598.81, stdev=27299.18 lat (usec): min=137, max=206686, avg=39600.19, stdev=27299.21 clat percentiles (usec): | 1.00th=[ 159], 5.00th=[ 208], 10.00th=[ 3490], 20.00th=[ 20841], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 46924], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[152044], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 62, max= 472, per=27.07%, avg=218.70, stdev=75.21, samples=53 iops : min= 3, max= 29, avg=12.91, stdev= 4.77, samples=53 write: IOPS=14, BW=227KiB/s (233kB/s)(6256KiB/27499msec); 0 zone resets clat (usec): min=1413, max=178081, avg=32070.64, stdev=31612.40 lat (usec): min=1416, max=178083, avg=32072.89, stdev=31612.47 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1795], 10.00th=[ 1975], 20.00th=[ 4228], | 30.00th=[ 9896], 40.00th=[ 16188], 50.00th=[ 24773], 60.00th=[ 30802], | 70.00th=[ 39584], 80.00th=[ 55313], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[139461], 99.50th=[154141], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 479, per=26.84%, avg=228.13, stdev=106.91, samples=53 iops : min= 1, max= 29, avg=13.51, stdev= 6.77, samples=53 lat (usec) : 250=2.86%, 500=1.30%, 750=0.39%, 1000=0.13% lat (msec) : 2=5.34%, 4=4.43%, 10=6.25%, 20=11.72%, 50=43.75% lat (msec) : 100=19.92%, 250=3.91% cpu : usr=0.11%, sys=8.25%, ctx=1773, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=808KiB/s (828kB/s), 194KiB/s-219KiB/s (199kB/s-225kB/s), io=23.4MiB (24.5MB), run=27433-29628msec WRITE: bw=851KiB/s (871kB/s), 207KiB/s-232KiB/s (212kB/s-238kB/s), io=24.6MiB (25.8MB), run=27433-29628msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184233: Sun Nov 16 21:24:30 2025 read: IOPS=9, BW=151KiB/s (155kB/s)(5920KiB/39208msec) clat (msec): min=7, max=163, avg=40.11, stdev=30.06 lat (msec): min=7, max=163, avg=40.12, stdev=30.06 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 88], 95.00th=[ 104], | 99.00th=[ 140], 99.50th=[ 146], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 30, max= 448, per=25.14%, avg=152.37, stdev=87.44, samples=76 iops : min= 1, max= 28, avg= 8.75, stdev= 5.53, samples=76 write: IOPS=10, BW=162KiB/s (166kB/s)(6368KiB/39208msec); 0 zone resets clat (msec): min=17, max=278, avg=61.02, stdev=38.55 lat (msec): min=17, max=278, avg=61.02, stdev=38.55 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 48], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 84], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 239], 99.50th=[ 259], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 412, per=25.37%, avg=161.60, stdev=80.94, samples=77 iops : min= 1, max= 25, avg= 9.35, stdev= 5.15, samples=77 lat (msec) : 10=1.56%, 20=12.63%, 50=48.05%, 100=28.26%, 250=9.24% lat (msec) : 500=0.26% cpu : usr=0.09%, sys=2.36%, ctx=1199, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184234: Sun Nov 16 21:24:30 2025 read: IOPS=9, BW=146KiB/s (150kB/s)(5744KiB/39253msec) clat (msec): min=7, max=165, avg=39.41, stdev=31.06 lat (msec): min=7, max=165, avg=39.41, stdev=31.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 84], 95.00th=[ 104], | 99.00th=[ 150], 99.50th=[ 165], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 31, max= 384, per=24.27%, avg=147.11, stdev=83.48, samples=76 iops : min= 1, max= 24, avg= 8.43, stdev= 5.35, samples=76 write: IOPS=10, BW=167KiB/s (171kB/s)(6544KiB/39253msec); 0 zone resets clat (msec): min=15, max=247, avg=60.98, stdev=34.56 lat (msec): min=15, max=247, avg=60.99, stdev=34.56 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 60], | 70.00th=[ 71], 80.00th=[ 86], 90.00th=[ 107], 95.00th=[ 129], | 99.00th=[ 167], 99.50th=[ 182], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 412, per=26.02%, avg=165.78, stdev=84.86, samples=77 iops : min= 1, max= 25, avg= 9.61, stdev= 5.38, samples=77 lat (msec) : 10=1.56%, 20=14.97%, 50=43.23%, 100=31.12%, 250=9.11% cpu : usr=0.06%, sys=2.39%, ctx=1203, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184235: Sun Nov 16 21:24:30 2025 read: IOPS=9, BW=159KiB/s (162kB/s)(6256KiB/39469msec) clat (msec): min=6, max=170, avg=39.47, stdev=30.74 lat (msec): min=6, max=170, avg=39.47, stdev=30.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 86], 95.00th=[ 108], | 99.00th=[ 150], 99.50th=[ 161], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 31, max= 608, per=26.35%, avg=159.68, stdev=100.95, samples=76 iops : min= 1, max= 38, avg= 9.24, stdev= 6.42, samples=76 write: IOPS=9, BW=153KiB/s (156kB/s)(6032KiB/39469msec); 0 zone resets clat (msec): min=10, max=215, avg=63.24, stdev=38.98 lat (msec): min=10, max=215, avg=63.25, stdev=38.98 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 63], | 70.00th=[ 71], 80.00th=[ 91], 90.00th=[ 118], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 211], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 349, per=23.84%, avg=151.84, stdev=71.68, samples=76 iops : min= 1, max= 21, avg= 8.74, stdev= 4.58, samples=76 lat (msec) : 10=2.21%, 20=13.54%, 50=46.88%, 100=25.91%, 250=11.46% cpu : usr=0.07%, sys=2.52%, ctx=1233, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184236: Sun Nov 16 21:24:30 2025 read: IOPS=9, BW=153KiB/s (156kB/s)(6032KiB/39508msec) clat (msec): min=7, max=218, avg=40.53, stdev=34.20 lat (msec): min=7, max=218, avg=40.53, stdev=34.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 90], 95.00th=[ 112], | 99.00th=[ 167], 99.50th=[ 199], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 475, per=25.07%, avg=151.91, stdev=86.44, samples=76 iops : min= 1, max= 29, avg= 8.72, stdev= 5.49, samples=76 write: IOPS=9, BW=158KiB/s (162kB/s)(6256KiB/39508msec); 0 zone resets clat (msec): min=13, max=276, avg=61.51, stdev=38.46 lat (msec): min=13, max=276, avg=61.57, stdev=38.46 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 58], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 110], 95.00th=[ 133], | 99.00th=[ 230], 99.50th=[ 259], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 405, per=24.55%, avg=156.36, stdev=81.31, samples=77 iops : min= 1, max= 25, avg= 9.01, stdev= 5.17, samples=77 lat (msec) : 10=1.43%, 20=14.32%, 50=46.48%, 100=27.73%, 250=9.77% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.69%, ctx=1275, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=606KiB/s (621kB/s), 146KiB/s-159KiB/s (150kB/s-162kB/s), io=23.4MiB (24.5MB), run=39208-39508msec WRITE: bw=638KiB/s (653kB/s), 153KiB/s-167KiB/s (156kB/s-171kB/s), io=24.6MiB (25.8MB), run=39208-39508msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184257: Sun Nov 16 21:24:43 2025 read: IOPS=2, BW=2342KiB/s (2398kB/s)(7168KiB/3061msec) clat (msec): min=156, max=245, avg=198.66, stdev=33.00 lat (msec): min=156, max=245, avg=198.66, stdev=33.00 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 161], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 211], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 1845, max= 4544, per=72.70%, avg=3492.00, stdev=1444.53, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1673KiB/s (1713kB/s)(5120KiB/3061msec); 0 zone resets clat (msec): min=225, max=484, avg=333.77, stdev=106.27 lat (msec): min=225, max=484, avg=333.85, stdev=106.25 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1845, max= 2043, per=29.31%, avg=1970.75, stdev=87.23, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=75.00%, 500=25.00% cpu : usr=0.07%, sys=19.71%, ctx=300, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184258: Sun Nov 16 21:24:43 2025 read: IOPS=0, BW=480KiB/s (492kB/s)(2048KiB/4264msec) clat (usec): min=668, max=530310, avg=265489.37, stdev=374513.71 lat (usec): min=669, max=530313, avg=265491.53, stdev=374515.21 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 668], | 30.00th=[ 668], 40.00th=[ 668], 50.00th=[ 668], 60.00th=[530580], | 70.00th=[530580], 80.00th=[530580], 90.00th=[530580], 95.00th=[530580], | 99.00th=[530580], 99.50th=[530580], 99.90th=[530580], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 1568, max= 1831, per=35.38%, avg=1699.50, stdev=185.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2402KiB/s (2459kB/s)(10.0MiB/4264msec); 0 zone resets clat (msec): min=163, max=754, avg=372.07, stdev=216.94 lat (msec): min=164, max=754, avg=372.17, stdev=216.93 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 167], | 30.00th=[ 192], 40.00th=[ 279], 50.00th=[ 305], 60.00th=[ 317], | 70.00th=[ 355], 80.00th=[ 447], 90.00th=[ 743], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1984, max= 6144, per=47.13%, avg=3169.00, stdev=1810.23, samples=5 iops : min= 1, max= 6, avg= 2.40, stdev= 2.19, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=16.94%, ctx=87, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184259: Sun Nov 16 21:24:43 2025 read: IOPS=1, BW=1967KiB/s (2015kB/s)(6144KiB/3123msec) clat (usec): min=666, max=252850, avg=158737.73, stdev=104914.77 lat (usec): min=667, max=252852, avg=158739.42, stdev=104915.07 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 65274], | 30.00th=[ 65274], 40.00th=[158335], 50.00th=[158335], 60.00th=[229639], | 70.00th=[244319], 80.00th=[244319], 90.00th=[252707], 95.00th=[252707], | 99.00th=[252707], 99.50th=[252707], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 1845, max= 3968, per=51.36%, avg=2466.75, stdev=1004.59, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1967KiB/s (2015kB/s)(6144KiB/3123msec); 0 zone resets clat (msec): min=165, max=575, avg=359.99, stdev=163.09 lat (msec): min=165, max=575, avg=360.05, stdev=163.08 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 439], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1845, max= 2929, per=32.72%, avg=2200.25, stdev=492.87, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.06%, sys=20.85%, ctx=289, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184260: Sun Nov 16 21:24:43 2025 read: IOPS=1, BW=1467KiB/s (1502kB/s)(5120KiB/3490msec) clat (usec): min=679, max=138756, avg=34995.67, stdev=58872.77 lat (usec): min=680, max=138757, avg=34997.00, stdev=58872.82 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 881], 40.00th=[ 881], 50.00th=[ 9241], 60.00th=[ 9241], | 70.00th=[ 25560], 80.00th=[ 25560], 90.00th=[139461], 95.00th=[139461], | 99.00th=[139461], 99.50th=[139461], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 7327, max= 7327, per=100.00%, avg=7327.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2054KiB/s (2103kB/s)(7168KiB/3490msec); 0 zone resets clat (msec): min=70, max=1203, avg=473.28, stdev=419.54 lat (msec): min=70, max=1204, avg=473.37, stdev=419.54 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 99], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 481], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 818], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1625, max= 3663, per=33.90%, avg=2279.25, stdev=934.26, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 10=8.33%, 50=8.33%, 100=16.67%, 250=16.67%, 500=16.67% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=15.71%, ctx=87, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4803KiB/s (4918kB/s), 480KiB/s-2342KiB/s (492kB/s-2398kB/s), io=20.0MiB (20.0MB), run=3061-4264msec WRITE: bw=6724KiB/s (6886kB/s), 1673KiB/s-2402KiB/s (1713kB/s-2459kB/s), io=28.0MiB (29.4MB), run=3061-4264msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184252: Sun Nov 16 21:24:43 2025 read: IOPS=2, BW=2117KiB/s (2168kB/s)(7168KiB/3386msec) clat (msec): min=94, max=418, avg=206.32, stdev=150.59 lat (msec): min=94, max=418, avg=206.32, stdev=150.59 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 96], | 30.00th=[ 99], 40.00th=[ 99], 50.00th=[ 102], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1996, max= 4151, per=79.55%, avg=3400.67, stdev=1217.42, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1512KiB/s (1548kB/s)(5120KiB/3386msec); 0 zone resets clat (msec): min=274, max=533, avg=374.32, stdev=108.69 lat (msec): min=274, max=534, avg=374.41, stdev=108.70 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1383, max= 4096, per=39.79%, avg=2381.25, stdev=1182.31, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=25.00%, 250=16.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=4.64%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184253: Sun Nov 16 21:24:43 2025 read: IOPS=0, BW=428KiB/s (438kB/s)(2048KiB/4790msec) clat (msec): min=104, max=229, avg=167.03, stdev=88.21 lat (msec): min=104, max=229, avg=167.03, stdev=88.21 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 1374, max= 2027, per=39.78%, avg=1700.50, stdev=461.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2138KiB/s (2189kB/s)(10.0MiB/4790msec); 0 zone resets clat (msec): min=139, max=1875, avg=437.63, stdev=518.96 lat (msec): min=139, max=1875, avg=437.74, stdev=518.97 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 144], | 30.00th=[ 201], 40.00th=[ 218], 50.00th=[ 226], 60.00th=[ 305], | 70.00th=[ 355], 80.00th=[ 405], 90.00th=[ 510], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1988, max= 4123, per=47.55%, avg=2845.60, stdev=1139.02, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.04%, sys=9.35%, ctx=142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184254: Sun Nov 16 21:24:43 2025 read: IOPS=1, BW=1713KiB/s (1754kB/s)(6144KiB/3586msec) clat (msec): min=99, max=626, avg=349.04, stdev=220.27 lat (msec): min=99, max=626, avg=349.04, stdev=220.27 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 498], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1365, max= 4096, per=55.64%, avg=2378.75, stdev=1186.60, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1713KiB/s (1754kB/s)(6144KiB/3586msec); 0 zone resets clat (msec): min=131, max=472, avg=241.69, stdev=128.90 lat (msec): min=131, max=472, avg=241.80, stdev=128.90 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 201], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2019, max= 4096, per=42.56%, avg=2547.50, stdev=1032.41, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=6.11%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184255: Sun Nov 16 21:24:43 2025 read: IOPS=1, BW=1650KiB/s (1690kB/s)(5120KiB/3103msec) clat (msec): min=91, max=564, avg=226.39, stdev=198.39 lat (msec): min=91, max=564, avg=226.40, stdev=198.39 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1467, max= 6059, per=88.02%, avg=3763.00, stdev=3247.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2310KiB/s (2365kB/s)(7168KiB/3103msec); 0 zone resets clat (msec): min=113, max=685, avg=277.56, stdev=215.86 lat (msec): min=114, max=685, avg=277.68, stdev=215.83 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 126], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 157], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 439], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1996, max= 5868, per=55.20%, avg=3304.00, stdev=2220.64, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=4.80%, ctx=55, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4276KiB/s (4378kB/s), 428KiB/s-2117KiB/s (438kB/s-2168kB/s), io=20.0MiB (20.0MB), run=3103-4790msec WRITE: bw=5986KiB/s (6129kB/s), 1512KiB/s-2310KiB/s (1548kB/s-2365kB/s), io=28.0MiB (29.4MB), run=3103-4790msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184268: Sun Nov 16 21:24:54 2025 read: IOPS=1, BW=5196KiB/s (5320kB/s)(12.0MiB/2365msec) clat (msec): min=575, max=794, avg=682.73, stdev=109.39 lat (msec): min=575, max=794, avg=682.73, stdev=109.39 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8015, max= 8192, per=100.00%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.96%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184269: Sun Nov 16 21:24:54 2025 read: IOPS=0, BW=1433KiB/s (1467kB/s)(4096KiB/2859msec) clat (nsec): min=1569.4M, max=1569.4M, avg=1569417554.00, stdev= 0.00 lat (nsec): min=1569.4M, max=1569.4M, avg=1569421073.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1569], 5.00th=[ 1569], 10.00th=[ 1569], 20.00th=[ 1569], | 30.00th=[ 1569], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2865KiB/s (2934kB/s)(8192KiB/2859msec); 0 zone resets clat (msec): min=280, max=768, avg=524.47, stdev=345.42 lat (msec): min=280, max=769, avg=524.91, stdev=345.41 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7984, max= 7984, per=70.96%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.58%, ctx=46, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184271: Sun Nov 16 21:24:54 2025 write: IOPS=1, BW=4220KiB/s (4321kB/s)(12.0MiB/2912msec); 0 zone resets clat (msec): min=488, max=1075, avg=866.68, stdev=328.08 lat (msec): min=489, max=1075, avg=867.45, stdev=328.02 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8143, max= 8175, per=72.51%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=7.04%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184273: Sun Nov 16 21:24:54 2025 write: IOPS=1, BW=4876KiB/s (4993kB/s)(12.0MiB/2520msec); 0 zone resets clat (msec): min=209, max=1882, avg=774.32, stdev=959.43 lat (msec): min=209, max=1882, avg=775.12, stdev=959.06 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min=12564, max=12564, per=100.00%, avg=12564.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.27%, ctx=109, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5731KiB/s (5868kB/s), 1433KiB/s-5196KiB/s (1467kB/s-5320kB/s), io=16.0MiB (16.8MB), run=2365-2859msec WRITE: bw=10.0MiB/s (11.5MB/s), 2865KiB/s-4876KiB/s (2934kB/s-4993kB/s), io=32.0MiB (33.6MB), run=2520-2912msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184270: Sun Nov 16 21:24:55 2025 read: IOPS=1, BW=5780KiB/s (5919kB/s)(12.0MiB/2126msec) clat (msec): min=599, max=697, avg=632.81, stdev=55.63 lat (msec): min=599, max=697, avg=632.81, stdev=55.63 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=24.71%, ctx=632, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184272: Sun Nov 16 21:24:55 2025 read: IOPS=0, BW=1999KiB/s (2047kB/s)(4096KiB/2049msec) clat (nsec): min=429046k, max=429046k, avg=429045843.00, stdev= 0.00 lat (nsec): min=429048k, max=429048k, avg=429048488.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3998KiB/s (4094kB/s)(8192KiB/2049msec); 0 zone resets clat (msec): min=470, max=788, avg=629.82, stdev=224.85 lat (msec): min=471, max=790, avg=630.98, stdev=225.92 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8192, max= 8192, per=72.50%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.74%, ctx=101, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184274: Sun Nov 16 21:24:55 2025 write: IOPS=1, BW=4237KiB/s (4339kB/s)(12.0MiB/2900msec); 0 zone resets clat (msec): min=229, max=1986, avg=868.18, stdev=971.83 lat (msec): min=229, max=1987, avg=869.54, stdev=971.18 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min=16157, max=16157, per=100.00%, avg=16157.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.42%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184275: Sun Nov 16 21:24:55 2025 write: IOPS=1, BW=4477KiB/s (4584kB/s)(12.0MiB/2745msec); 0 zone resets clat (msec): min=247, max=1974, avg=850.56, stdev=974.07 lat (msec): min=247, max=1974, avg=851.05, stdev=974.01 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 6041, max= 8126, per=62.69%, avg=7083.50, stdev=1474.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.03%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7706KiB/s (7891kB/s), 1999KiB/s-5780KiB/s (2047kB/s-5919kB/s), io=16.0MiB (16.8MB), run=2049-2126msec WRITE: bw=11.0MiB/s (11.6MB/s), 3998KiB/s-4477KiB/s (4094kB/s-4584kB/s), io=32.0MiB (33.6MB), run=2049-2900msec