== sanity test 398b: DIO and buffer IO race ============== 19:41:03 (1763340063) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.58457 s, 11.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183405: Sun Nov 16 19:42:46 2025 read: IOPS=17, BW=68.8KiB/s (70.5kB/s)(5992KiB/87054msec) clat (usec): min=119, max=698338, avg=33186.85, stdev=26195.32 lat (usec): min=119, max=698340, avg=33188.16, stdev=26195.19 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 8586], 10.00th=[ 13435], 20.00th=[ 17695], | 30.00th=[ 21103], 40.00th=[ 25035], 50.00th=[ 28967], 60.00th=[ 33817], | 70.00th=[ 39060], 80.00th=[ 46400], 90.00th=[ 56361], 95.00th=[ 70779], | 99.00th=[ 94897], 99.50th=[113771], 99.90th=[164627], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 11, max= 126, per=25.08%, avg=68.20, stdev=22.50, samples=171 iops : min= 2, max= 31, avg=16.44, stdev= 5.71, samples=171 write: IOPS=18, BW=72.3KiB/s (74.1kB/s)(6296KiB/87054msec); 0 zone resets clat (usec): min=885, max=245207, avg=23642.23, stdev=24719.37 lat (usec): min=887, max=245208, avg=23645.61, stdev=24718.15 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1074], 10.00th=[ 1139], 20.00th=[ 1663], | 30.00th=[ 4817], 40.00th=[ 10290], 50.00th=[ 17433], 60.00th=[ 23725], | 70.00th=[ 30802], 80.00th=[ 41681], 90.00th=[ 56886], 95.00th=[ 69731], | 99.00th=[108528], 99.50th=[120062], 99.90th=[173016], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 147, per=25.41%, avg=72.18, stdev=26.89, samples=170 iops : min= 1, max= 36, avg=17.43, stdev= 6.76, samples=170 lat (usec) : 250=1.76%, 500=0.23%, 750=0.03%, 1000=0.49% lat (msec) : 2=10.81%, 4=3.06%, 10=6.64%, 20=18.10%, 50=43.95% lat (msec) : 100=13.83%, 250=1.07%, 750=0.03% cpu : usr=0.08%, sys=6.59%, ctx=6284, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183406: Sun Nov 16 19:42:46 2025 read: IOPS=17, BW=69.0KiB/s (70.7kB/s)(5940KiB/86062msec) clat (usec): min=107, max=690566, avg=32505.65, stdev=25662.62 lat (usec): min=107, max=690567, avg=32509.28, stdev=25664.53 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 1713], 10.00th=[ 13042], 20.00th=[ 17433], | 30.00th=[ 20841], 40.00th=[ 24511], 50.00th=[ 29230], 60.00th=[ 33817], | 70.00th=[ 38536], 80.00th=[ 45351], 90.00th=[ 55313], 95.00th=[ 66847], | 99.00th=[ 99091], 99.50th=[109577], 99.90th=[160433], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 5, max= 127, per=25.22%, avg=68.59, stdev=22.01, samples=169 iops : min= 1, max= 31, avg=16.54, stdev= 5.55, samples=169 write: IOPS=18, BW=73.8KiB/s (75.5kB/s)(6348KiB/86062msec); 0 zone resets clat (usec): min=875, max=249880, avg=23731.14, stdev=24708.35 lat (usec): min=876, max=249881, avg=23732.33, stdev=24708.36 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1074], 10.00th=[ 1139], 20.00th=[ 1516], | 30.00th=[ 4555], 40.00th=[ 10945], 50.00th=[ 17695], 60.00th=[ 23987], | 70.00th=[ 31065], 80.00th=[ 40633], 90.00th=[ 56886], 95.00th=[ 72877], | 99.00th=[101188], 99.50th=[113771], 99.90th=[145753], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 15, max= 151, per=25.76%, avg=73.17, stdev=26.11, samples=169 iops : min= 3, max= 37, avg=17.69, stdev= 6.57, samples=169 lat (usec) : 250=2.28%, 500=0.10%, 1000=0.91% lat (msec) : 2=10.58%, 4=3.42%, 10=5.63%, 20=18.36%, 50=45.12% lat (msec) : 100=12.53%, 250=1.04%, 750=0.03% cpu : usr=0.09%, sys=6.50%, ctx=6185, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183407: Sun Nov 16 19:42:46 2025 read: IOPS=17, BW=70.6KiB/s (72.3kB/s)(6028KiB/85362msec) clat (usec): min=106, max=230765, avg=31806.99, stdev=21209.68 lat (usec): min=107, max=230766, avg=31813.79, stdev=21213.80 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 8356], 10.00th=[ 12387], 20.00th=[ 16712], | 30.00th=[ 20055], 40.00th=[ 23462], 50.00th=[ 27395], 60.00th=[ 32113], | 70.00th=[ 38011], 80.00th=[ 45351], 90.00th=[ 55313], 95.00th=[ 65274], | 99.00th=[109577], 99.50th=[129500], 99.90th=[221250], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 15, max= 142, per=25.97%, avg=70.63, stdev=22.92, samples=167 iops : min= 3, max= 35, avg=17.06, stdev= 5.79, samples=167 write: IOPS=18, BW=73.3KiB/s (75.1kB/s)(6260KiB/85362msec); 0 zone resets clat (usec): min=818, max=903967, avg=23819.63, stdev=32275.75 lat (usec): min=819, max=903968, avg=23822.29, stdev=32274.99 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1074], 10.00th=[ 1139], 20.00th=[ 1418], | 30.00th=[ 4817], 40.00th=[ 11076], 50.00th=[ 17957], 60.00th=[ 23725], | 70.00th=[ 30540], 80.00th=[ 40633], 90.00th=[ 54789], 95.00th=[ 67634], | 99.00th=[ 95945], 99.50th=[108528], 99.90th=[179307], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 15, max= 140, per=25.84%, avg=73.39, stdev=25.23, samples=167 iops : min= 3, max= 35, avg=17.75, stdev= 6.37, samples=167 lat (usec) : 250=1.99%, 500=0.07%, 750=0.07%, 1000=0.65% lat (msec) : 2=11.17%, 4=2.64%, 10=6.05%, 20=19.04%, 50=44.53% lat (msec) : 100=12.89%, 250=0.88%, 1000=0.03% cpu : usr=0.10%, sys=6.54%, ctx=6162, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183408: Sun Nov 16 19:42:46 2025 read: IOPS=17, BW=68.6KiB/s (70.2kB/s)(6052KiB/88248msec) clat (usec): min=117, max=179825, avg=32347.76, stdev=20609.02 lat (usec): min=118, max=179826, avg=32348.77, stdev=20609.01 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 1090], 10.00th=[ 12125], 20.00th=[ 17171], | 30.00th=[ 20317], 40.00th=[ 23987], 50.00th=[ 28443], 60.00th=[ 33424], | 70.00th=[ 39060], 80.00th=[ 46400], 90.00th=[ 56886], 95.00th=[ 67634], | 99.00th=[107480], 99.50th=[125305], 99.90th=[160433], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 15, max= 125, per=25.13%, avg=68.35, stdev=22.49, samples=172 iops : min= 3, max= 31, avg=16.48, stdev= 5.68, samples=172 write: IOPS=17, BW=70.7KiB/s (72.4kB/s)(6236KiB/88248msec); 0 zone resets clat (usec): min=800, max=846226, avg=25147.23, stdev=32330.88 lat (usec): min=802, max=846228, avg=25148.51, stdev=32330.89 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1074], 10.00th=[ 1139], 20.00th=[ 1663], | 30.00th=[ 5276], 40.00th=[ 12387], 50.00th=[ 19268], 60.00th=[ 24511], | 70.00th=[ 30802], 80.00th=[ 42730], 90.00th=[ 58459], 95.00th=[ 72877], | 99.00th=[106431], 99.50th=[132645], 99.90th=[181404], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 16, max= 148, per=24.85%, avg=70.58, stdev=24.89, samples=172 iops : min= 4, max= 37, avg=17.05, stdev= 6.29, samples=172 lat (usec) : 250=2.18%, 500=0.16%, 750=0.07%, 1000=0.88% lat (msec) : 2=10.06%, 4=2.60%, 10=5.89%, 20=18.52%, 50=44.47% lat (msec) : 100=13.83%, 250=1.30%, 1000=0.03% cpu : usr=0.09%, sys=6.50%, ctx=6320, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=272KiB/s (279kB/s), 68.6KiB/s-70.6KiB/s (70.2kB/s-72.3kB/s), io=23.4MiB (24.6MB), run=85362-88248msec WRITE: bw=285KiB/s (292kB/s), 70.7KiB/s-73.8KiB/s (72.4kB/s-75.5kB/s), io=24.6MiB (25.7MB), run=85362-88248msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183400: Sun Nov 16 19:43:16 2025 read: IOPS=12, BW=50.7KiB/s (51.0kB/s)(5992KiB/118078msec) clat (msec): min=5, max=660, avg=29.50, stdev=30.17 lat (msec): min=5, max=660, avg=29.51, stdev=30.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 64], 95.00th=[ 84], | 99.00th=[ 132], 99.50th=[ 142], 99.90th=[ 194], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 159, per=25.21%, avg=50.93, stdev=31.82, samples=230 iops : min= 1, max= 39, avg=12.10, stdev= 8.01, samples=230 write: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6296KiB/118078msec); 0 zone resets clat (msec): min=8, max=323, avg=46.71, stdev=32.23 lat (msec): min=8, max=323, avg=46.72, stdev=32.23 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 68], 90.00th=[ 88], 95.00th=[ 105], | 99.00th=[ 161], 99.50th=[ 190], 99.90th=[ 321], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 160, per=25.27%, avg=53.32, stdev=30.98, samples=231 iops : min= 1, max= 40, avg=12.70, stdev= 7.82, samples=231 lat (msec) : 10=5.66%, 20=25.03%, 50=44.47%, 100=20.51%, 250=4.20% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=2.34%, ctx=4773, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183401: Sun Nov 16 19:43:16 2025 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(5940KiB/117606msec) clat (msec): min=4, max=767, avg=29.01, stdev=31.52 lat (msec): min=4, max=767, avg=29.01, stdev=31.52 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 63], 95.00th=[ 82], | 99.00th=[ 124], 99.50th=[ 155], 99.90th=[ 201], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 168, per=25.00%, avg=50.51, stdev=32.71, samples=230 iops : min= 1, max= 42, avg=12.00, stdev= 8.24, samples=230 write: IOPS=13, BW=53.0KiB/s (55.3kB/s)(6348KiB/117606msec); 0 zone resets clat (msec): min=6, max=316, avg=46.73, stdev=31.37 lat (msec): min=6, max=316, avg=46.73, stdev=31.37 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 67], 90.00th=[ 85], 95.00th=[ 105], | 99.00th=[ 153], 99.50th=[ 188], 99.90th=[ 313], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 151, per=25.41%, avg=53.61, stdev=30.06, samples=231 iops : min= 1, max= 37, avg=12.77, stdev= 7.57, samples=231 lat (msec) : 10=5.53%, 20=24.97%, 50=44.66%, 100=20.51%, 250=4.23% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=2.30%, ctx=4801, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183402: Sun Nov 16 19:43:16 2025 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6028KiB/118848msec) clat (msec): min=4, max=250, avg=29.94, stdev=27.87 lat (msec): min=4, max=250, avg=29.94, stdev=27.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 67], 95.00th=[ 91], | 99.00th=[ 138], 99.50th=[ 161], 99.90th=[ 218], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 7, max= 168, per=24.99%, avg=50.48, stdev=32.90, samples=232 iops : min= 1, max= 42, avg=11.99, stdev= 8.28, samples=232 write: IOPS=13, BW=52.7KiB/s (53.9kB/s)(6260KiB/118848msec); 0 zone resets clat (msec): min=8, max=841, avg=46.88, stdev=38.28 lat (msec): min=8, max=841, avg=46.88, stdev=38.28 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 69], 90.00th=[ 91], 95.00th=[ 107], | 99.00th=[ 159], 99.50th=[ 199], 99.90th=[ 321], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 15, max= 151, per=24.91%, avg=52.56, stdev=32.42, samples=231 iops : min= 3, max= 37, avg=12.51, stdev= 8.17, samples=231 lat (msec) : 10=6.05%, 20=25.81%, 50=43.68%, 100=19.30%, 250=5.05% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=2.36%, ctx=5010, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183403: Sun Nov 16 19:43:16 2025 read: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6052KiB/118247msec) clat (msec): min=4, max=198, avg=29.65, stdev=27.29 lat (msec): min=4, max=198, avg=29.65, stdev=27.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 67], 95.00th=[ 90], | 99.00th=[ 132], 99.50th=[ 161], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 7, max= 168, per=25.50%, avg=51.51, stdev=32.51, samples=229 iops : min= 1, max= 42, avg=12.24, stdev= 8.20, samples=229 write: IOPS=13, BW=52.7KiB/s (54.0kB/s)(6236KiB/118247msec); 0 zone resets clat (msec): min=8, max=841, avg=46.85, stdev=37.91 lat (msec): min=8, max=841, avg=46.85, stdev=37.91 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 66], 90.00th=[ 90], 95.00th=[ 111], | 99.00th=[ 157], 99.50th=[ 182], 99.90th=[ 321], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 144, per=24.94%, avg=52.63, stdev=30.62, samples=231 iops : min= 1, max= 36, avg=12.52, stdev= 7.71, samples=231 lat (msec) : 10=4.98%, 20=26.73%, 50=44.50%, 100=18.52%, 250=5.18% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=2.32%, ctx=4860, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=202KiB/s (207kB/s), 50.5KiB/s-51.2KiB/s (51.7kB/s-52.4kB/s), io=23.4MiB (24.6MB), run=117606-118848msec WRITE: bw=212KiB/s (217kB/s), 52.7KiB/s-53.0KiB/s (53.9kB/s-55.3kB/s), io=24.6MiB (25.7MB), run=117606-118848msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183441: Sun Nov 16 19:43:48 2025 read: IOPS=16, BW=261KiB/s (267kB/s)(5920KiB/22711msec) clat (usec): min=117, max=138836, avg=31490.68, stdev=21909.45 lat (usec): min=117, max=138838, avg=31491.79, stdev=21909.42 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 176], 10.00th=[ 725], 20.00th=[ 15533], | 30.00th=[ 19792], 40.00th=[ 23200], 50.00th=[ 27657], 60.00th=[ 32113], | 70.00th=[ 37487], 80.00th=[ 46400], 90.00th=[ 60031], 95.00th=[ 71828], | 99.00th=[116917], 99.50th=[120062], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 126, max= 442, per=24.45%, avg=257.73, stdev=83.34, samples=44 iops : min= 7, max= 27, avg=15.36, stdev= 5.23, samples=44 write: IOPS=17, BW=280KiB/s (287kB/s)(6368KiB/22711msec); 0 zone resets clat (usec): min=1395, max=131061, avg=27357.89, stdev=23984.21 lat (usec): min=1397, max=131063, avg=27359.84, stdev=23984.16 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1663], 10.00th=[ 1991], 20.00th=[ 4948], | 30.00th=[ 9503], 40.00th=[ 17695], 50.00th=[ 22676], 60.00th=[ 27395], | 70.00th=[ 34341], 80.00th=[ 45351], 90.00th=[ 60556], 95.00th=[ 73925], | 99.00th=[105382], 99.50th=[116917], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 94, max= 509, per=25.20%, avg=279.52, stdev=94.07, samples=44 iops : min= 5, max= 31, avg=16.75, stdev= 5.91, samples=44 lat (usec) : 250=3.52%, 500=1.17%, 750=0.13% lat (msec) : 2=5.34%, 4=4.56%, 10=6.77%, 20=15.23%, 50=46.88% lat (msec) : 100=14.97%, 250=1.43% cpu : usr=0.07%, sys=8.52%, ctx=1728, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183442: Sun Nov 16 19:43:48 2025 read: IOPS=16, BW=260KiB/s (266kB/s)(5744KiB/22108msec) clat (usec): min=131, max=149065, avg=32865.11, stdev=19772.84 lat (usec): min=131, max=149066, avg=32866.26, stdev=19772.80 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 178], 10.00th=[ 11338], 20.00th=[ 17695], | 30.00th=[ 22676], 40.00th=[ 26346], 50.00th=[ 31065], 60.00th=[ 35390], | 70.00th=[ 42206], 80.00th=[ 47973], 90.00th=[ 55837], 95.00th=[ 64750], | 99.00th=[ 94897], 99.50th=[102237], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 94, max= 441, per=24.64%, avg=259.70, stdev=87.80, samples=43 iops : min= 5, max= 27, avg=15.51, stdev= 5.58, samples=43 write: IOPS=18, BW=296KiB/s (303kB/s)(6544KiB/22108msec); 0 zone resets clat (usec): min=1350, max=144249, avg=24854.61, stdev=23805.03 lat (usec): min=1353, max=144250, avg=24858.47, stdev=23804.34 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1647], 10.00th=[ 1762], 20.00th=[ 4047], | 30.00th=[ 7373], 40.00th=[ 12649], 50.00th=[ 19268], 60.00th=[ 25035], | 70.00th=[ 31851], 80.00th=[ 41681], 90.00th=[ 56361], 95.00th=[ 74974], | 99.00th=[107480], 99.50th=[119014], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 95, max= 508, per=26.73%, avg=296.47, stdev=90.70, samples=43 iops : min= 5, max= 31, avg=17.84, stdev= 5.71, samples=43 lat (usec) : 250=2.99%, 500=0.65%, 1000=0.13% lat (msec) : 2=7.03%, 4=3.91%, 10=7.68%, 20=16.28%, 50=46.48% lat (msec) : 100=13.54%, 250=1.30% cpu : usr=0.04%, sys=8.59%, ctx=1698, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183444: Sun Nov 16 19:43:48 2025 read: IOPS=17, BW=288KiB/s (295kB/s)(6256KiB/21748msec) clat (usec): min=128, max=165413, avg=31932.88, stdev=22039.36 lat (usec): min=129, max=165415, avg=31934.03, stdev=22039.39 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 174], 10.00th=[ 717], 20.00th=[ 16450], | 30.00th=[ 20055], 40.00th=[ 23987], 50.00th=[ 28705], 60.00th=[ 33817], | 70.00th=[ 39060], 80.00th=[ 46924], 90.00th=[ 57410], 95.00th=[ 67634], | 99.00th=[107480], 99.50th=[154141], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 126, max= 478, per=27.32%, avg=287.98, stdev=84.44, samples=42 iops : min= 7, max= 29, avg=17.26, stdev= 5.37, samples=42 write: IOPS=17, BW=277KiB/s (284kB/s)(6032KiB/21748msec); 0 zone resets clat (usec): min=1300, max=194239, avg=24402.13, stdev=24004.40 lat (usec): min=1302, max=194240, avg=24404.07, stdev=24004.51 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1614], 10.00th=[ 1762], 20.00th=[ 3589], | 30.00th=[ 7439], 40.00th=[ 12911], 50.00th=[ 19268], 60.00th=[ 22676], | 70.00th=[ 32113], 80.00th=[ 41157], 90.00th=[ 57410], 95.00th=[ 68682], | 99.00th=[108528], 99.50th=[117965], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 126, max= 606, per=24.63%, avg=273.17, stdev=94.50, samples=42 iops : min= 7, max= 37, avg=16.36, stdev= 5.93, samples=42 lat (usec) : 250=3.78%, 500=1.17%, 750=0.26%, 1000=0.13% lat (msec) : 2=7.03%, 4=3.78%, 10=6.90%, 20=17.19%, 50=44.14% lat (msec) : 100=14.58%, 250=1.04% cpu : usr=0.06%, sys=8.54%, ctx=1698, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183445: Sun Nov 16 19:43:48 2025 read: IOPS=16, BW=270KiB/s (277kB/s)(6032KiB/22323msec) clat (usec): min=116, max=193439, avg=32890.22, stdev=22254.85 lat (usec): min=116, max=193441, avg=32891.37, stdev=22254.77 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 157], 10.00th=[ 3163], 20.00th=[ 16712], | 30.00th=[ 21365], 40.00th=[ 26084], 50.00th=[ 30016], 60.00th=[ 35914], | 70.00th=[ 39584], 80.00th=[ 48497], 90.00th=[ 58983], 95.00th=[ 72877], | 99.00th=[ 94897], 99.50th=[115868], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 384, per=24.94%, avg=262.84, stdev=77.84, samples=43 iops : min= 3, max= 24, avg=15.70, stdev= 4.97, samples=43 write: IOPS=17, BW=280KiB/s (287kB/s)(6256KiB/22323msec); 0 zone resets clat (usec): min=1337, max=129137, avg=25030.59, stdev=23672.64 lat (usec): min=1339, max=129139, avg=25033.65, stdev=23671.95 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1614], 10.00th=[ 1795], 20.00th=[ 3490], | 30.00th=[ 7308], 40.00th=[ 12649], 50.00th=[ 18744], 60.00th=[ 25297], | 70.00th=[ 31851], 80.00th=[ 44303], 90.00th=[ 59507], 95.00th=[ 70779], | 99.00th=[113771], 99.50th=[126354], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 128, max= 448, per=25.01%, avg=277.40, stdev=88.19, samples=43 iops : min= 8, max= 28, avg=16.63, stdev= 5.53, samples=43 lat (usec) : 250=4.30%, 500=0.52% lat (msec) : 2=6.38%, 4=5.08%, 10=7.81%, 20=15.89%, 50=42.71% lat (msec) : 100=16.41%, 250=0.91% cpu : usr=0.09%, sys=8.40%, ctx=1693, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1055KiB/s (1080kB/s), 260KiB/s-288KiB/s (266kB/s-295kB/s), io=23.4MiB (24.5MB), run=21748-22711msec WRITE: bw=1110KiB/s (1136kB/s), 277KiB/s-296KiB/s (284kB/s-303kB/s), io=24.6MiB (25.8MB), run=21748-22711msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183446: Sun Nov 16 19:44:01 2025 read: IOPS=10, BW=171KiB/s (175kB/s)(5920KiB/34589msec) clat (msec): min=8, max=141, avg=37.92, stdev=23.10 lat (msec): min=8, max=141, avg=37.92, stdev=23.10 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 55], 90.00th=[ 70], 95.00th=[ 84], | 99.00th=[ 112], 99.50th=[ 126], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 31, max= 381, per=25.10%, avg=170.96, stdev=65.39, samples=68 iops : min= 1, max= 23, avg= 9.91, stdev= 4.15, samples=68 write: IOPS=11, BW=184KiB/s (189kB/s)(6368KiB/34589msec); 0 zone resets clat (msec): min=11, max=170, avg=51.53, stdev=29.39 lat (msec): min=11, max=170, avg=51.54, stdev=29.39 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 51], | 70.00th=[ 57], 80.00th=[ 69], 90.00th=[ 90], 95.00th=[ 115], | 99.00th=[ 161], 99.50th=[ 169], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 31, max= 320, per=25.60%, avg=183.54, stdev=67.57, samples=68 iops : min= 1, max= 20, avg=10.72, stdev= 4.26, samples=68 lat (msec) : 10=1.04%, 20=11.33%, 50=55.47%, 100=26.95%, 250=5.21% cpu : usr=0.07%, sys=2.56%, ctx=1268, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183447: Sun Nov 16 19:44:01 2025 read: IOPS=10, BW=164KiB/s (167kB/s)(5744KiB/35131msec) clat (msec): min=6, max=175, avg=38.67, stdev=26.67 lat (msec): min=6, max=175, avg=38.67, stdev=26.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 72], 95.00th=[ 89], | 99.00th=[ 138], 99.50th=[ 146], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 349, per=24.24%, avg=165.04, stdev=76.61, samples=68 iops : min= 1, max= 21, avg= 9.56, stdev= 4.85, samples=68 write: IOPS=11, BW=186KiB/s (191kB/s)(6544KiB/35131msec); 0 zone resets clat (msec): min=13, max=198, avg=51.80, stdev=28.26 lat (msec): min=13, max=198, avg=51.80, stdev=28.26 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 72], 90.00th=[ 90], 95.00th=[ 109], | 99.00th=[ 146], 99.50th=[ 167], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 63, max= 448, per=25.81%, avg=185.04, stdev=73.25, samples=69 iops : min= 3, max= 28, avg=10.81, stdev= 4.68, samples=69 lat (msec) : 10=1.17%, 20=14.45%, 50=50.78%, 100=28.52%, 250=5.08% cpu : usr=0.06%, sys=2.66%, ctx=1293, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183448: Sun Nov 16 19:44:01 2025 read: IOPS=11, BW=184KiB/s (189kB/s)(6256KiB/33953msec) clat (msec): min=8, max=129, avg=37.58, stdev=24.03 lat (msec): min=8, max=129, avg=37.58, stdev=24.03 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 57], 90.00th=[ 71], 95.00th=[ 88], | 99.00th=[ 115], 99.50th=[ 123], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 31, max= 447, per=27.07%, avg=184.37, stdev=85.26, samples=67 iops : min= 1, max= 27, avg=10.76, stdev= 5.38, samples=67 write: IOPS=11, BW=178KiB/s (182kB/s)(6032KiB/33953msec); 0 zone resets clat (msec): min=16, max=209, avg=50.98, stdev=27.52 lat (msec): min=16, max=209, avg=50.98, stdev=27.52 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 43], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 70], 90.00th=[ 88], 95.00th=[ 106], | 99.00th=[ 140], 99.50th=[ 150], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 379, per=24.65%, avg=176.75, stdev=65.77, samples=67 iops : min= 1, max= 23, avg=10.28, stdev= 4.20, samples=67 lat (msec) : 10=0.78%, 20=13.28%, 50=54.04%, 100=27.86%, 250=4.04% cpu : usr=0.05%, sys=2.65%, ctx=1310, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183449: Sun Nov 16 19:44:01 2025 read: IOPS=11, BW=177KiB/s (181kB/s)(6032KiB/34095msec) clat (msec): min=6, max=197, avg=37.76, stdev=25.53 lat (msec): min=6, max=197, avg=37.76, stdev=25.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 71], 95.00th=[ 90], | 99.00th=[ 121], 99.50th=[ 155], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 382, per=25.75%, avg=175.39, stdev=76.62, samples=67 iops : min= 1, max= 23, avg=10.19, stdev= 4.82, samples=67 write: IOPS=11, BW=183KiB/s (188kB/s)(6256KiB/34095msec); 0 zone resets clat (msec): min=14, max=206, avg=50.68, stdev=30.53 lat (msec): min=14, max=206, avg=50.69, stdev=30.53 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 42], 60.00th=[ 48], | 70.00th=[ 56], 80.00th=[ 68], 90.00th=[ 89], 95.00th=[ 105], | 99.00th=[ 174], 99.50th=[ 197], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 62, max= 478, per=25.60%, avg=183.55, stdev=70.06, samples=67 iops : min= 3, max= 29, avg=10.70, stdev= 4.46, samples=67 lat (msec) : 10=1.69%, 20=13.80%, 50=53.65%, 100=26.30%, 250=4.56% cpu : usr=0.07%, sys=2.63%, ctx=1258, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=682KiB/s (698kB/s), 164KiB/s-184KiB/s (167kB/s-189kB/s), io=23.4MiB (24.5MB), run=33953-35131msec WRITE: bw=717KiB/s (735kB/s), 178KiB/s-186KiB/s (182kB/s-191kB/s), io=24.6MiB (25.8MB), run=33953-35131msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183460: Sun Nov 16 19:44:17 2025 read: IOPS=2, BW=2363KiB/s (2420kB/s)(7168KiB/3033msec) clat (msec): min=9, max=449, avg=220.12, stdev=131.05 lat (msec): min=9, max=449, avg=220.12, stdev=131.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 171], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 213], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 268], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2039, max= 3690, per=64.26%, avg=2816.00, stdev=829.76, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1688KiB/s (1729kB/s)(5120KiB/3033msec); 0 zone resets clat (msec): min=160, max=456, avg=271.01, stdev=117.34 lat (msec): min=160, max=457, avg=271.05, stdev=117.36 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1845, max= 4079, per=43.29%, avg=2655.67, stdev=1236.61, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=11.94%, ctx=160, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183461: Sun Nov 16 19:44:17 2025 read: IOPS=0, BW=438KiB/s (449kB/s)(2048KiB/4673msec) clat (msec): min=2, max=221, avg=111.79, stdev=154.93 lat (msec): min=2, max=221, avg=111.79, stdev=154.93 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 1389, max= 2023, per=38.93%, avg=1706.00, stdev=448.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2191KiB/s (2244kB/s)(10.0MiB/4673msec); 0 zone resets clat (msec): min=93, max=856, avg=443.19, stdev=273.67 lat (msec): min=93, max=856, avg=443.29, stdev=273.65 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 186], | 30.00th=[ 213], 40.00th=[ 305], 50.00th=[ 313], 60.00th=[ 351], | 70.00th=[ 634], 80.00th=[ 701], 90.00th=[ 785], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1845, max= 4047, per=38.16%, avg=2341.33, stdev=839.21, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 4=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67% lat (msec) : 1000=16.67% cpu : usr=0.04%, sys=12.50%, ctx=121, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183462: Sun Nov 16 19:44:17 2025 read: IOPS=1, BW=1485KiB/s (1520kB/s)(6144KiB/4138msec) clat (usec): min=1580, max=785088, avg=284887.10, stdev=301876.81 lat (usec): min=1581, max=785089, avg=284888.15, stdev=301876.60 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1582], 10.00th=[ 1582], 20.00th=[ 2114], | 30.00th=[ 2114], 40.00th=[164627], 50.00th=[164627], 60.00th=[295699], | 70.00th=[459277], 80.00th=[459277], 90.00th=[784335], 95.00th=[784335], | 99.00th=[784335], 99.50th=[784335], 99.90th=[784335], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 2039, max= 6095, per=77.38%, avg=3391.00, stdev=2341.73, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1485KiB/s (1520kB/s)(6144KiB/4138msec); 0 zone resets clat (msec): min=140, max=656, avg=391.01, stdev=178.83 lat (msec): min=140, max=656, avg=391.07, stdev=178.83 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 439], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1845, max= 2856, per=35.76%, avg=2193.75, stdev=450.71, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 4=8.33%, 250=16.67%, 500=50.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=11.94%, ctx=129, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183463: Sun Nov 16 19:44:17 2025 read: IOPS=1, BW=1372KiB/s (1404kB/s)(5120KiB/3733msec) clat (usec): min=523, max=333686, avg=100759.72, stdev=145745.46 lat (usec): min=523, max=333687, avg=100760.57, stdev=145745.70 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 5342], 40.00th=[ 5342], 50.00th=[ 8455], 60.00th=[ 8455], | 70.00th=[156238], 80.00th=[156238], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1920KiB/s (1966kB/s)(7168KiB/3733msec); 0 zone resets clat (msec): min=199, max=921, avg=452.12, stdev=241.76 lat (msec): min=199, max=921, avg=452.19, stdev=241.77 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 251], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 418], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 550], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1535, max= 2043, per=30.41%, avg=1865.50, stdev=238.93, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=16.67%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.76%, ctx=104, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4383KiB/s (4488kB/s), 438KiB/s-2363KiB/s (449kB/s-2420kB/s), io=20.0MiB (20.0MB), run=3033-4673msec WRITE: bw=6136KiB/s (6283kB/s), 1485KiB/s-2191KiB/s (1520kB/s-2244kB/s), io=28.0MiB (29.4MB), run=3033-4673msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183465: Sun Nov 16 19:44:17 2025 read: IOPS=1, BW=1756KiB/s (1799kB/s)(7168KiB/4081msec) clat (msec): min=66, max=938, avg=334.20, stdev=370.10 lat (msec): min=66, max=938, avg=334.20, stdev=370.10 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 129], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 793], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1454, max= 4087, per=50.70%, avg=2302.60, stdev=1024.43, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1255KiB/s (1285kB/s)(5120KiB/4081msec); 0 zone resets clat (msec): min=99, max=547, avg=320.66, stdev=181.37 lat (msec): min=100, max=548, avg=320.83, stdev=181.27 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1969, max= 5896, per=61.85%, avg=3932.50, stdev=2776.81, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=33.33%, 250=16.67%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=3.36%, ctx=53, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183466: Sun Nov 16 19:44:17 2025 read: IOPS=0, BW=454KiB/s (465kB/s)(2048KiB/4509msec) clat (msec): min=90, max=638, avg=364.37, stdev=387.47 lat (msec): min=90, max=638, avg=364.37, stdev=387.47 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 91], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2023, max= 2031, per=44.63%, avg=2027.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2271KiB/s (2326kB/s)(10.0MiB/4509msec); 0 zone resets clat (msec): min=62, max=1050, avg=350.37, stdev=328.56 lat (msec): min=62, max=1050, avg=350.53, stdev=328.56 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 94], | 30.00th=[ 126], 40.00th=[ 163], 50.00th=[ 241], 60.00th=[ 288], | 70.00th=[ 300], 80.00th=[ 359], 90.00th=[ 827], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1969, max= 4087, per=47.68%, avg=3031.50, stdev=1205.07, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.07%, sys=6.39%, ctx=87, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183467: Sun Nov 16 19:44:17 2025 read: IOPS=1, BW=1546KiB/s (1583kB/s)(6144KiB/3975msec) clat (msec): min=55, max=999, avg=233.96, stdev=375.77 lat (msec): min=55, max=999, avg=233.96, stdev=375.77 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 73], 50.00th=[ 73], 60.00th=[ 107], | 70.00th=[ 108], 80.00th=[ 108], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1969, max= 5896, per=72.71%, avg=3302.67, stdev=2246.20, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1546KiB/s (1583kB/s)(6144KiB/3975msec); 0 zone resets clat (msec): min=117, max=662, avg=398.79, stdev=234.97 lat (msec): min=117, max=662, avg=398.87, stdev=234.99 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 510], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2023, max= 3968, per=52.01%, avg=3307.00, stdev=1112.14, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=8.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=4.13%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183468: Sun Nov 16 19:44:17 2025 read: IOPS=1, BW=1250KiB/s (1280kB/s)(5120KiB/4097msec) clat (msec): min=32, max=630, avg=246.20, stdev=225.68 lat (msec): min=32, max=630, avg=246.20, stdev=225.68 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 33], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1976, max= 3930, per=58.34%, avg=2649.67, stdev=1109.31, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1750KiB/s (1792kB/s)(7168KiB/4097msec); 0 zone resets clat (msec): min=96, max=789, avg=396.54, stdev=282.89 lat (msec): min=96, max=789, avg=396.63, stdev=282.86 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 174], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 255], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 768], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1976, max= 4047, per=41.98%, avg=2669.00, stdev=1193.39, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=4.15%, ctx=70, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4542KiB/s (4651kB/s), 454KiB/s-1756KiB/s (465kB/s-1799kB/s), io=20.0MiB (20.0MB), run=3975-4509msec WRITE: bw=6359KiB/s (6511kB/s), 1255KiB/s-2271KiB/s (1285kB/s-2326kB/s), io=28.0MiB (29.4MB), run=3975-4509msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183475: Sun Nov 16 19:44:31 2025 read: IOPS=0, BW=2442KiB/s (2501kB/s)(12.0MiB/5031msec) clat (msec): min=749, max=3232, avg=1634.26, stdev=1386.36 lat (msec): min=749, max=3232, avg=1634.26, stdev=1386.36 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=9.42%, ctx=770, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183476: Sun Nov 16 19:44:31 2025 read: IOPS=0, BW=906KiB/s (928kB/s)(4096KiB/4519msec) clat (nsec): min=3258.5M, max=3258.5M, avg=3258507405.00, stdev= 0.00 lat (nsec): min=3258.5M, max=3258.5M, avg=3258509799.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3272], 5.00th=[ 3272], 10.00th=[ 3272], 20.00th=[ 3272], | 30.00th=[ 3272], 40.00th=[ 3272], 50.00th=[ 3272], 60.00th=[ 3272], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1813KiB/s (1856kB/s)(8192KiB/4519msec); 0 zone resets clat (msec): min=376, max=765, avg=571.08, stdev=275.00 lat (msec): min=377, max=765, avg=571.44, stdev=274.96 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.80%, ctx=443, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183477: Sun Nov 16 19:44:31 2025 write: IOPS=3, BW=13.2MiB/s (13.9MB/s)(12.0MiB/907msec); 0 zone resets clat (msec): min=167, max=381, avg=267.44, stdev=108.03 lat (msec): min=169, max=384, avg=269.13, stdev=108.09 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min=11100, max=11100, per=100.00%, avg=11100.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=13.91%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183478: Sun Nov 16 19:44:31 2025 write: IOPS=0, BW=2853KiB/s (2922kB/s)(12.0MiB/4307msec); 0 zone resets clat (msec): min=241, max=3712, avg=1406.76, stdev=1996.96 lat (msec): min=242, max=3712, avg=1407.62, stdev=1996.48 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 3708], 80.00th=[ 3708], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 7123, max= 8192, per=100.00%, avg=7657.50, stdev=755.90, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.53%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3257KiB/s (3335kB/s), 906KiB/s-2442KiB/s (928kB/s-2501kB/s), io=16.0MiB (16.8MB), run=4519-5031msec WRITE: bw=7251KiB/s (7425kB/s), 1813KiB/s-13.2MiB/s (1856kB/s-13.9MB/s), io=32.0MiB (33.6MB), run=907-4519msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183479: Sun Nov 16 19:44:31 2025 read: IOPS=0, BW=2458KiB/s (2517kB/s)(12.0MiB/4999msec) clat (msec): min=735, max=3288, avg=1645.42, stdev=1426.06 lat (msec): min=735, max=3288, avg=1645.42, stdev=1426.06 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 3306], 80.00th=[ 3306], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 7953, max= 8047, per=100.00%, avg=8000.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.78%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183480: Sun Nov 16 19:44:31 2025 read: IOPS=0, BW=839KiB/s (859kB/s)(4096KiB/4884msec) clat (nsec): min=3436.6M, max=3436.6M, avg=3436581923.00, stdev= 0.00 lat (nsec): min=3436.6M, max=3436.6M, avg=3436584686.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3440], 5.00th=[ 3440], 10.00th=[ 3440], 20.00th=[ 3440], | 30.00th=[ 3440], 40.00th=[ 3440], 50.00th=[ 3440], 60.00th=[ 3440], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1677KiB/s (1718kB/s)(8192KiB/4884msec); 0 zone resets clat (msec): min=448, max=891, avg=669.76, stdev=312.92 lat (msec): min=452, max=891, avg=672.19, stdev=310.02 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.17%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183481: Sun Nov 16 19:44:31 2025 write: IOPS=0, BW=2325KiB/s (2380kB/s)(12.0MiB/5286msec); 0 zone resets clat (msec): min=575, max=3775, avg=1673.11, stdev=1821.44 lat (msec): min=575, max=3776, avg=1673.47, stdev=1821.44 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 7742, max= 8047, per=100.00%, avg=7894.50, stdev=215.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.11%, sys=2.63%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183482: Sun Nov 16 19:44:31 2025 write: IOPS=0, BW=2704KiB/s (2769kB/s)(12.0MiB/4545msec); 0 zone resets clat (msec): min=186, max=3895, avg=1485.44, stdev=2088.86 lat (msec): min=187, max=3895, avg=1485.81, stdev=2088.84 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 3910], 80.00th=[ 3910], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 7772, max= 8143, per=100.00%, avg=7957.50, stdev=262.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.98%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3277KiB/s (3356kB/s), 839KiB/s-2458KiB/s (859kB/s-2517kB/s), io=16.0MiB (16.8MB), run=4884-4999msec WRITE: bw=6199KiB/s (6348kB/s), 1677KiB/s-2704KiB/s (1718kB/s-2769kB/s), io=32.0MiB (33.6MB), run=4545-5286msec