== sanity test 398b: DIO and buffer IO race ============== 21:47:26 (1763347646) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.46037 s, 11.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181479: Sun Nov 16 21:49:02 2025 read: IOPS=18, BW=72.7KiB/s (74.4kB/s)(5992KiB/82430msec) clat (usec): min=113, max=703932, avg=30458.26, stdev=25484.50 lat (usec): min=113, max=703933, avg=30460.16, stdev=25484.84 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 9241], 10.00th=[ 13042], 20.00th=[ 16057], | 30.00th=[ 19268], 40.00th=[ 22152], 50.00th=[ 26084], 60.00th=[ 30540], | 70.00th=[ 35914], 80.00th=[ 42206], 90.00th=[ 52167], 95.00th=[ 62653], | 99.00th=[ 96994], 99.50th=[120062], 99.90th=[162530], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 143, per=25.02%, avg=72.31, stdev=24.67, samples=163 iops : min= 1, max= 35, avg=17.47, stdev= 6.18, samples=163 write: IOPS=19, BW=76.4KiB/s (78.2kB/s)(6296KiB/82430msec); 0 zone resets clat (usec): min=961, max=188862, avg=23180.28, stdev=22891.31 lat (usec): min=963, max=188864, avg=23183.70, stdev=22890.00 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1680], 20.00th=[ 3097], | 30.00th=[ 5932], 40.00th=[ 12125], 50.00th=[ 17957], 60.00th=[ 22938], | 70.00th=[ 29230], 80.00th=[ 38536], 90.00th=[ 53740], 95.00th=[ 68682], | 99.00th=[104334], 99.50th=[114820], 99.90th=[141558], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 8, max= 150, per=25.28%, avg=76.33, stdev=25.58, samples=162 iops : min= 2, max= 37, avg=18.48, stdev= 6.42, samples=162 lat (usec) : 250=1.17%, 500=0.68%, 750=0.07%, 1000=0.03% lat (msec) : 2=6.51%, 4=6.18%, 10=7.16%, 20=22.17%, 50=44.30% lat (msec) : 100=10.74%, 250=0.94%, 750=0.03% cpu : usr=0.13%, sys=10.21%, ctx=7204, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181481: Sun Nov 16 21:49:02 2025 read: IOPS=18, BW=72.1KiB/s (73.8kB/s)(5940KiB/82386msec) clat (usec): min=90, max=149671, avg=29146.01, stdev=16988.75 lat (usec): min=91, max=149673, avg=29147.55, stdev=16988.73 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 9241], 10.00th=[ 12387], 20.00th=[ 16188], | 30.00th=[ 19268], 40.00th=[ 22676], 50.00th=[ 25822], 60.00th=[ 29754], | 70.00th=[ 35390], 80.00th=[ 41157], 90.00th=[ 50070], 95.00th=[ 58983], | 99.00th=[ 89654], 99.50th=[ 98042], 99.90th=[127402], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 7, max= 142, per=24.89%, avg=71.93, stdev=23.66, samples=162 iops : min= 1, max= 35, avg=17.38, stdev= 5.92, samples=162 write: IOPS=19, BW=77.1KiB/s (78.9kB/s)(6348KiB/82386msec); 0 zone resets clat (usec): min=979, max=697218, avg=24443.87, stdev=29186.02 lat (usec): min=979, max=697219, avg=24445.85, stdev=29186.15 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1254], 10.00th=[ 1647], 20.00th=[ 3163], | 30.00th=[ 5932], 40.00th=[ 12387], 50.00th=[ 18482], 60.00th=[ 24249], | 70.00th=[ 30802], 80.00th=[ 40109], 90.00th=[ 56361], 95.00th=[ 69731], | 99.00th=[102237], 99.50th=[119014], 99.90th=[212861], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 23, max= 142, per=25.44%, avg=76.82, stdev=25.95, samples=162 iops : min= 5, max= 35, avg=18.60, stdev= 6.54, samples=162 lat (usec) : 100=0.03%, 250=1.20%, 500=0.52%, 750=0.03%, 1000=0.07% lat (msec) : 2=6.71%, 4=5.47%, 10=7.68%, 20=21.19%, 50=45.35% lat (msec) : 100=10.97%, 250=0.75%, 750=0.03% cpu : usr=0.10%, sys=10.20%, ctx=7066, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181483: Sun Nov 16 21:49:02 2025 read: IOPS=18, BW=73.5KiB/s (75.3kB/s)(6028KiB/81997msec) clat (usec): min=126, max=199550, avg=29482.61, stdev=18785.35 lat (usec): min=127, max=199552, avg=29485.35, stdev=18784.88 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 8225], 10.00th=[ 12518], 20.00th=[ 16057], | 30.00th=[ 18744], 40.00th=[ 21627], 50.00th=[ 25035], 60.00th=[ 29754], | 70.00th=[ 35390], 80.00th=[ 42206], 90.00th=[ 51643], 95.00th=[ 61604], | 99.00th=[ 93848], 99.50th=[117965], 99.90th=[164627], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 15, max= 143, per=25.51%, avg=73.72, stdev=22.47, samples=160 iops : min= 3, max= 35, avg=17.83, stdev= 5.66, samples=160 write: IOPS=19, BW=76.3KiB/s (78.2kB/s)(6260KiB/81997msec); 0 zone resets clat (usec): min=953, max=766499, avg=23774.03, stdev=28711.43 lat (usec): min=954, max=766501, avg=23778.57, stdev=28711.76 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1680], 20.00th=[ 3523], | 30.00th=[ 6521], 40.00th=[ 13304], 50.00th=[ 18482], 60.00th=[ 23200], | 70.00th=[ 30802], 80.00th=[ 39584], 90.00th=[ 53216], 95.00th=[ 64750], | 99.00th=[ 89654], 99.50th=[ 99091], 99.90th=[212861], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 159, per=25.21%, avg=76.14, stdev=28.82, samples=161 iops : min= 1, max= 39, avg=18.43, stdev= 7.24, samples=161 lat (usec) : 250=1.33%, 500=0.78%, 750=0.10%, 1000=0.26% lat (msec) : 2=5.92%, 4=5.08%, 10=7.39%, 20=23.24%, 50=43.75% lat (msec) : 100=11.52%, 250=0.59%, 1000=0.03% cpu : usr=0.12%, sys=10.40%, ctx=7236, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181484: Sun Nov 16 21:49:02 2025 read: IOPS=18, BW=72.9KiB/s (74.7kB/s)(6052KiB/82995msec) clat (usec): min=127, max=157290, avg=29628.15, stdev=18485.62 lat (usec): min=127, max=157291, avg=29629.84, stdev=18485.41 clat percentiles (usec): | 1.00th=[ 161], 5.00th=[ 8848], 10.00th=[ 12256], 20.00th=[ 15926], | 30.00th=[ 18744], 40.00th=[ 21890], 50.00th=[ 25822], 60.00th=[ 29754], | 70.00th=[ 35390], 80.00th=[ 42206], 90.00th=[ 52167], 95.00th=[ 63701], | 99.00th=[ 89654], 99.50th=[115868], 99.90th=[137364], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 23, max= 135, per=25.29%, avg=73.10, stdev=22.21, samples=162 iops : min= 5, max= 33, avg=17.67, stdev= 5.60, samples=162 write: IOPS=18, BW=75.1KiB/s (76.9kB/s)(6236KiB/82995msec); 0 zone resets clat (usec): min=915, max=768154, avg=24262.45, stdev=29430.16 lat (usec): min=916, max=768155, avg=24264.48, stdev=29430.00 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1270], 10.00th=[ 1729], 20.00th=[ 3490], | 30.00th=[ 6456], 40.00th=[ 13435], 50.00th=[ 18744], 60.00th=[ 24249], | 70.00th=[ 31065], 80.00th=[ 39584], 90.00th=[ 53740], 95.00th=[ 65799], | 99.00th=[ 91751], 99.50th=[117965], 99.90th=[242222], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 16, max= 152, per=24.81%, avg=74.94, stdev=25.70, samples=163 iops : min= 4, max= 38, avg=18.12, stdev= 6.46, samples=163 lat (usec) : 250=1.24%, 500=0.62%, 750=0.07%, 1000=0.10% lat (msec) : 2=6.09%, 4=5.47%, 10=7.13%, 20=22.62%, 50=44.79% lat (msec) : 100=11.13%, 250=0.72%, 1000=0.03% cpu : usr=0.11%, sys=10.41%, ctx=7146, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=289KiB/s (296kB/s), 72.1KiB/s-73.5KiB/s (73.8kB/s-75.3kB/s), io=23.4MiB (24.6MB), run=81997-82995msec WRITE: bw=303KiB/s (310kB/s), 75.1KiB/s-77.1KiB/s (76.9kB/s-78.9kB/s), io=24.6MiB (25.7MB), run=81997-82995msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181477: Sun Nov 16 21:49:25 2025 read: IOPS=14, BW=56.3KiB/s (57.6kB/s)(5992KiB/106486msec) clat (msec): min=4, max=710, avg=28.68, stdev=31.20 lat (msec): min=4, max=710, avg=28.68, stdev=31.20 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 64], 95.00th=[ 85], | 99.00th=[ 122], 99.50th=[ 140], 99.90th=[ 259], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 192, per=25.09%, avg=56.20, stdev=36.70, samples=209 iops : min= 1, max= 48, avg=13.41, stdev= 9.22, samples=209 write: IOPS=14, BW=59.1KiB/s (60.5kB/s)(6296KiB/106486msec); 0 zone resets clat (msec): min=7, max=226, avg=40.16, stdev=27.38 lat (msec): min=7, max=226, avg=40.16, stdev=27.38 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 78], 95.00th=[ 94], | 99.00th=[ 130], 99.50th=[ 161], 99.90th=[ 207], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 7, max= 176, per=25.12%, avg=59.04, stdev=36.58, samples=209 iops : min= 1, max= 44, avg=14.12, stdev= 9.22, samples=209 lat (msec) : 10=8.53%, 20=29.62%, 50=40.27%, 100=18.20%, 250=3.32% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=3.91%, ctx=5065, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181478: Sun Nov 16 21:49:25 2025 read: IOPS=13, BW=55.0KiB/s (57.3kB/s)(5940KiB/106090msec) clat (msec): min=5, max=690, avg=27.54, stdev=30.04 lat (msec): min=5, max=690, avg=27.55, stdev=30.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 59], 95.00th=[ 77], | 99.00th=[ 130], 99.50th=[ 144], 99.90th=[ 232], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 183, per=25.02%, avg=56.04, stdev=38.94, samples=208 iops : min= 1, max= 45, avg=13.38, stdev= 9.80, samples=208 write: IOPS=14, BW=59.8KiB/s (61.3kB/s)(6348KiB/106090msec); 0 zone resets clat (msec): min=9, max=256, avg=40.87, stdev=27.35 lat (msec): min=9, max=256, avg=40.87, stdev=27.35 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 61], 90.00th=[ 80], 95.00th=[ 94], | 99.00th=[ 130], 99.50th=[ 159], 99.90th=[ 228], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 174, per=25.32%, avg=59.51, stdev=36.02, samples=209 iops : min= 1, max= 43, avg=14.24, stdev= 9.05, samples=209 lat (msec) : 10=7.85%, 20=30.92%, 50=39.75%, 100=18.62%, 250=2.80% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=3.99%, ctx=5074, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181480: Sun Nov 16 21:49:25 2025 read: IOPS=14, BW=56.6KiB/s (58.0kB/s)(6028KiB/106409msec) clat (msec): min=4, max=263, avg=27.92, stdev=24.88 lat (msec): min=4, max=263, avg=27.93, stdev=24.89 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 59], 95.00th=[ 82], | 99.00th=[ 110], 99.50th=[ 144], 99.90th=[ 236], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 15, max= 192, per=25.66%, avg=57.48, stdev=36.75, samples=206 iops : min= 3, max= 48, avg=13.73, stdev= 9.25, samples=206 write: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6260KiB/106409msec); 0 zone resets clat (msec): min=7, max=713, avg=40.90, stdev=33.53 lat (msec): min=7, max=713, avg=40.91, stdev=33.53 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 80], 95.00th=[ 97], | 99.00th=[ 146], 99.50th=[ 184], 99.90th=[ 228], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 176, per=24.92%, avg=58.56, stdev=38.23, samples=210 iops : min= 1, max= 44, avg=14.00, stdev= 9.60, samples=210 lat (msec) : 10=8.27%, 20=30.76%, 50=39.55%, 100=18.16%, 250=3.19% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=3.91%, ctx=5085, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181482: Sun Nov 16 21:49:25 2025 read: IOPS=14, BW=56.7KiB/s (58.1kB/s)(6052KiB/106743msec) clat (msec): min=4, max=218, avg=27.64, stdev=25.10 lat (msec): min=4, max=218, avg=27.65, stdev=25.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 62], 95.00th=[ 82], | 99.00th=[ 123], 99.50th=[ 140], 99.90th=[ 155], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 7, max= 182, per=25.39%, avg=56.88, stdev=37.19, samples=207 iops : min= 1, max= 45, avg=13.58, stdev= 9.35, samples=207 write: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6236KiB/106743msec); 0 zone resets clat (msec): min=7, max=714, avg=41.45, stdev=34.34 lat (msec): min=7, max=714, avg=41.45, stdev=34.34 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 60], 90.00th=[ 78], 95.00th=[ 100], | 99.00th=[ 159], 99.50th=[ 178], 99.90th=[ 255], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 176, per=24.65%, avg=57.92, stdev=36.42, samples=210 iops : min= 1, max= 44, avg=13.84, stdev= 9.16, samples=210 lat (msec) : 10=8.40%, 20=31.25%, 50=38.25%, 100=18.46%, 250=3.58% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.92%, ctx=5079, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=225KiB/s (230kB/s), 55.0KiB/s-56.7KiB/s (57.3kB/s-58.1kB/s), io=23.4MiB (24.6MB), run=106090-106743msec WRITE: bw=236KiB/s (241kB/s), 58.4KiB/s-59.8KiB/s (59.8kB/s-61.3kB/s), io=24.6MiB (25.7MB), run=106090-106743msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181519: Sun Nov 16 21:49:53 2025 read: IOPS=18, BW=290KiB/s (297kB/s)(5920KiB/20406msec) clat (usec): min=131, max=134552, avg=28480.26, stdev=18761.52 lat (usec): min=131, max=134554, avg=28481.53, stdev=18761.55 clat percentiles (usec): | 1.00th=[ 159], 5.00th=[ 310], 10.00th=[ 10028], 20.00th=[ 16057], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 26608], 60.00th=[ 30016], | 70.00th=[ 33817], 80.00th=[ 39060], 90.00th=[ 48497], 95.00th=[ 58459], | 99.00th=[105382], 99.50th=[130548], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 95, max= 510, per=24.57%, avg=287.93, stdev=96.94, samples=40 iops : min= 5, max= 31, avg=17.32, stdev= 6.15, samples=40 write: IOPS=19, BW=312KiB/s (320kB/s)(6368KiB/20406msec); 0 zone resets clat (usec): min=1381, max=127418, avg=24288.92, stdev=22047.27 lat (usec): min=1382, max=127419, avg=24294.14, stdev=22048.65 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2057], 10.00th=[ 3294], 20.00th=[ 5342], | 30.00th=[ 8291], 40.00th=[ 14484], 50.00th=[ 18220], 60.00th=[ 22938], | 70.00th=[ 29754], 80.00th=[ 39584], 90.00th=[ 57934], 95.00th=[ 71828], | 99.00th=[ 92799], 99.50th=[121111], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 94, max= 638, per=25.31%, avg=312.10, stdev=106.02, samples=40 iops : min= 5, max= 39, avg=18.82, stdev= 6.66, samples=40 lat (usec) : 250=2.21%, 500=1.43%, 750=0.26% lat (msec) : 2=2.47%, 4=5.08%, 10=10.55%, 20=21.48%, 50=45.44% lat (msec) : 100=10.03%, 250=1.04% cpu : usr=0.09%, sys=12.83%, ctx=2001, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181521: Sun Nov 16 21:49:53 2025 read: IOPS=17, BW=284KiB/s (290kB/s)(5744KiB/20249msec) clat (usec): min=143, max=115933, avg=29673.39, stdev=16688.75 lat (usec): min=145, max=115934, avg=29674.69, stdev=16688.76 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 343], 10.00th=[ 13829], 20.00th=[ 17171], | 30.00th=[ 20055], 40.00th=[ 23462], 50.00th=[ 28181], 60.00th=[ 32113], | 70.00th=[ 36439], 80.00th=[ 40109], 90.00th=[ 49546], 95.00th=[ 56361], | 99.00th=[ 93848], 99.50th=[100140], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 95, max= 479, per=24.19%, avg=283.52, stdev=81.25, samples=40 iops : min= 5, max= 29, avg=17.02, stdev= 5.07, samples=40 write: IOPS=20, BW=323KiB/s (331kB/s)(6544KiB/20249msec); 0 zone resets clat (usec): min=1436, max=104548, avg=23293.18, stdev=20149.17 lat (usec): min=1438, max=104550, avg=23298.13, stdev=20147.39 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2376], 10.00th=[ 3392], 20.00th=[ 4752], | 30.00th=[ 8094], 40.00th=[ 14484], 50.00th=[ 19530], 60.00th=[ 22938], | 70.00th=[ 28443], 80.00th=[ 39060], 90.00th=[ 50594], 95.00th=[ 63701], | 99.00th=[ 90702], 99.50th=[ 95945], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 127, max= 573, per=26.16%, avg=322.52, stdev=108.73, samples=40 iops : min= 7, max= 35, avg=19.50, stdev= 6.84, samples=40 lat (usec) : 250=1.56%, 500=1.30% lat (msec) : 2=1.82%, 4=6.77%, 10=10.03%, 20=20.05%, 50=48.83% lat (msec) : 100=9.11%, 250=0.52% cpu : usr=0.10%, sys=13.43%, ctx=2007, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181522: Sun Nov 16 21:49:53 2025 read: IOPS=19, BW=306KiB/s (314kB/s)(6256KiB/20431msec) clat (usec): min=139, max=156452, avg=29065.61, stdev=19845.65 lat (usec): min=140, max=156453, avg=29068.27, stdev=19845.69 clat percentiles (usec): | 1.00th=[ 155], 5.00th=[ 318], 10.00th=[ 7504], 20.00th=[ 15926], | 30.00th=[ 19530], 40.00th=[ 23462], 50.00th=[ 26608], 60.00th=[ 30540], | 70.00th=[ 34341], 80.00th=[ 40109], 90.00th=[ 48497], 95.00th=[ 61604], | 99.00th=[109577], 99.50th=[129500], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 159, max= 479, per=26.35%, avg=308.77, stdev=83.00, samples=40 iops : min= 9, max= 29, avg=18.63, stdev= 5.28, samples=40 write: IOPS=18, BW=295KiB/s (302kB/s)(6032KiB/20431msec); 0 zone resets clat (usec): min=1441, max=117891, avg=23481.38, stdev=20581.92 lat (usec): min=1443, max=117894, avg=23484.07, stdev=20582.05 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2278], 10.00th=[ 3425], 20.00th=[ 5538], | 30.00th=[ 7898], 40.00th=[ 12911], 50.00th=[ 18744], 60.00th=[ 24249], | 70.00th=[ 30540], 80.00th=[ 38536], 90.00th=[ 50070], 95.00th=[ 60556], | 99.00th=[ 99091], 99.50th=[116917], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 126, max= 478, per=23.68%, avg=292.03, stdev=89.14, samples=40 iops : min= 7, max= 29, avg=17.57, stdev= 5.50, samples=40 lat (usec) : 250=2.21%, 500=1.69%, 750=0.65% lat (msec) : 2=2.21%, 4=4.17%, 10=11.46%, 20=19.14%, 50=48.70% lat (msec) : 100=8.72%, 250=1.04% cpu : usr=0.12%, sys=13.01%, ctx=2101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181523: Sun Nov 16 21:49:53 2025 read: IOPS=18, BW=300KiB/s (307kB/s)(6032KiB/20140msec) clat (usec): min=134, max=116523, avg=29121.11, stdev=19347.63 lat (usec): min=135, max=116524, avg=29122.49, stdev=19347.49 clat percentiles (usec): | 1.00th=[ 174], 5.00th=[ 273], 10.00th=[ 701], 20.00th=[ 14353], | 30.00th=[ 19268], 40.00th=[ 22414], 50.00th=[ 26346], 60.00th=[ 30802], | 70.00th=[ 36439], 80.00th=[ 41681], 90.00th=[ 53740], 95.00th=[ 67634], | 99.00th=[ 90702], 99.50th=[ 95945], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 159, max= 476, per=25.06%, avg=293.74, stdev=80.05, samples=39 iops : min= 9, max= 29, avg=17.69, stdev= 5.13, samples=39 write: IOPS=19, BW=311KiB/s (318kB/s)(6256KiB/20140msec); 0 zone resets clat (usec): min=1469, max=136296, avg=23027.37, stdev=21342.78 lat (usec): min=1473, max=136297, avg=23029.81, stdev=21342.65 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2024], 10.00th=[ 3097], 20.00th=[ 4555], | 30.00th=[ 7570], 40.00th=[ 12387], 50.00th=[ 17171], 60.00th=[ 22676], | 70.00th=[ 28443], 80.00th=[ 38011], 90.00th=[ 50070], 95.00th=[ 66323], | 99.00th=[ 95945], 99.50th=[113771], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 96, max= 510, per=25.05%, avg=308.92, stdev=94.23, samples=39 iops : min= 6, max= 31, avg=18.67, stdev= 5.84, samples=39 lat (usec) : 250=2.21%, 500=1.95%, 750=0.78%, 1000=0.13% lat (msec) : 2=2.47%, 4=6.12%, 10=10.42%, 20=20.18%, 50=43.88% lat (msec) : 100=11.33%, 250=0.52% cpu : usr=0.10%, sys=13.06%, ctx=1983, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1172KiB/s (1200kB/s), 284KiB/s-306KiB/s (290kB/s-314kB/s), io=23.4MiB (24.5MB), run=20140-20431msec WRITE: bw=1233KiB/s (1263kB/s), 295KiB/s-323KiB/s (302kB/s-331kB/s), io=24.6MiB (25.8MB), run=20140-20431msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181516: Sun Nov 16 21:49:59 2025 read: IOPS=13, BW=223KiB/s (228kB/s)(5920KiB/26592msec) clat (msec): min=4, max=173, avg=28.84, stdev=26.77 lat (msec): min=4, max=173, avg=28.84, stdev=26.77 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 43], 90.00th=[ 71], 95.00th=[ 87], | 99.00th=[ 120], 99.50th=[ 155], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 63, max= 605, per=23.85%, avg=214.63, stdev=133.34, samples=52 iops : min= 3, max= 37, avg=12.67, stdev= 8.34, samples=52 write: IOPS=14, BW=239KiB/s (245kB/s)(6368KiB/26592msec); 0 zone resets clat (msec): min=9, max=140, avg=39.45, stdev=25.59 lat (msec): min=9, max=140, avg=39.45, stdev=25.59 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 79], 95.00th=[ 92], | 99.00th=[ 117], 99.50th=[ 140], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 31, max= 637, per=24.76%, avg=234.48, stdev=142.77, samples=52 iops : min= 1, max= 39, avg=13.90, stdev= 8.93, samples=52 lat (msec) : 10=7.42%, 20=32.55%, 50=38.41%, 100=18.23%, 250=3.39% cpu : usr=0.09%, sys=4.25%, ctx=1312, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181517: Sun Nov 16 21:49:59 2025 read: IOPS=13, BW=219KiB/s (224kB/s)(5744KiB/26272msec) clat (msec): min=5, max=151, avg=27.95, stdev=24.64 lat (msec): min=5, max=151, avg=27.95, stdev=24.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 44], 90.00th=[ 67], 95.00th=[ 79], | 99.00th=[ 117], 99.50th=[ 140], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 31, max= 636, per=24.69%, avg=222.22, stdev=133.05, samples=51 iops : min= 1, max= 39, avg=13.14, stdev= 8.32, samples=51 write: IOPS=15, BW=249KiB/s (255kB/s)(6544KiB/26272msec); 0 zone resets clat (msec): min=9, max=174, avg=39.29, stdev=25.23 lat (msec): min=9, max=174, avg=39.29, stdev=25.23 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 75], 95.00th=[ 88], | 99.00th=[ 125], 99.50th=[ 136], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 96, max= 701, per=26.19%, avg=248.06, stdev=142.92, samples=52 iops : min= 6, max= 43, avg=14.75, stdev= 8.93, samples=52 lat (msec) : 10=7.29%, 20=30.08%, 50=40.76%, 100=19.40%, 250=2.47% cpu : usr=0.10%, sys=4.24%, ctx=1281, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181518: Sun Nov 16 21:49:59 2025 read: IOPS=14, BW=238KiB/s (243kB/s)(6256KiB/26320msec) clat (msec): min=5, max=172, avg=27.69, stdev=24.49 lat (msec): min=5, max=172, avg=27.69, stdev=24.49 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 42], 90.00th=[ 61], 95.00th=[ 82], | 99.00th=[ 116], 99.50th=[ 132], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 32, max= 670, per=26.43%, avg=237.88, stdev=152.20, samples=52 iops : min= 2, max= 41, avg=14.13, stdev= 9.49, samples=52 write: IOPS=14, BW=229KiB/s (235kB/s)(6032KiB/26320msec); 0 zone resets clat (msec): min=9, max=140, avg=40.97, stdev=25.47 lat (msec): min=9, max=140, avg=40.97, stdev=25.47 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 81], 95.00th=[ 94], | 99.00th=[ 117], 99.50th=[ 133], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 63, max= 667, per=24.02%, avg=227.48, stdev=128.18, samples=52 iops : min= 3, max= 41, avg=13.46, stdev= 8.06, samples=52 lat (msec) : 10=8.07%, 20=30.21%, 50=40.49%, 100=18.23%, 250=2.99% cpu : usr=0.08%, sys=4.41%, ctx=1324, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181520: Sun Nov 16 21:49:59 2025 read: IOPS=14, BW=229KiB/s (235kB/s)(6032KiB/26298msec) clat (msec): min=5, max=139, avg=26.89, stdev=23.25 lat (msec): min=5, max=139, avg=26.89, stdev=23.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 64], 95.00th=[ 83], | 99.00th=[ 105], 99.50th=[ 116], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 63, max= 637, per=25.28%, avg=227.56, stdev=137.50, samples=52 iops : min= 3, max= 39, avg=13.48, stdev= 8.59, samples=52 write: IOPS=14, BW=238KiB/s (244kB/s)(6256KiB/26298msec); 0 zone resets clat (msec): min=8, max=156, avg=40.70, stdev=26.50 lat (msec): min=8, max=156, avg=40.70, stdev=26.50 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 78], 95.00th=[ 102], | 99.00th=[ 125], 99.50th=[ 140], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 95, max= 604, per=25.05%, avg=237.25, stdev=129.47, samples=52 iops : min= 5, max= 37, avg=14.08, stdev= 8.11, samples=52 lat (msec) : 10=7.03%, 20=31.90%, 50=40.49%, 100=16.93%, 250=3.65% cpu : usr=0.11%, sys=4.44%, ctx=1319, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=901KiB/s (922kB/s), 219KiB/s-238KiB/s (224kB/s-243kB/s), io=23.4MiB (24.5MB), run=26272-26592msec WRITE: bw=948KiB/s (970kB/s), 229KiB/s-249KiB/s (235kB/s-255kB/s), io=24.6MiB (25.8MB), run=26272-26592msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181531: Sun Nov 16 21:50:08 2025 read: IOPS=2, BW=2252KiB/s (2306kB/s)(7168KiB/3183msec) clat (msec): min=114, max=295, avg=214.30, stdev=57.09 lat (msec): min=114, max=295, avg=214.30, stdev=57.09 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 186], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 220], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 262], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 2043, max= 4087, per=52.67%, avg=2985.50, stdev=1093.40, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1609KiB/s (1647kB/s)(5120KiB/3183msec); 0 zone resets clat (msec): min=198, max=509, avg=327.55, stdev=114.11 lat (msec): min=198, max=509, avg=327.65, stdev=114.09 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1712, max= 4096, per=31.08%, avg=2466.50, stdev=1096.62, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=21.15%, ctx=208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181532: Sun Nov 16 21:50:08 2025 read: IOPS=0, BW=567KiB/s (580kB/s)(2048KiB/3613msec) clat (usec): min=990, max=137964, avg=69477.23, stdev=96855.44 lat (usec): min=991, max=137968, avg=69479.88, stdev=96856.91 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 988], | 30.00th=[ 988], 40.00th=[ 988], 50.00th=[ 988], 60.00th=[137364], | 70.00th=[137364], 80.00th=[137364], 90.00th=[137364], 95.00th=[137364], | 99.00th=[137364], 99.50th=[137364], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 1988, max= 2048, per=35.60%, avg=2018.00, stdev=42.43, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2834KiB/s (2902kB/s)(10.0MiB/3613msec); 0 zone resets clat (msec): min=136, max=645, avg=335.72, stdev=170.18 lat (msec): min=136, max=645, avg=335.80, stdev=170.17 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 163], | 30.00th=[ 203], 40.00th=[ 224], 50.00th=[ 241], 60.00th=[ 363], | 70.00th=[ 401], 80.00th=[ 460], 90.00th=[ 527], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1712, max= 4096, per=35.17%, avg=2790.60, stdev=1194.63, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=23.03%, ctx=172, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181533: Sun Nov 16 21:50:08 2025 read: IOPS=1, BW=1831KiB/s (1875kB/s)(6144KiB/3356msec) clat (usec): min=684, max=277413, avg=149645.95, stdev=120125.16 lat (usec): min=686, max=277414, avg=149647.37, stdev=120125.04 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[ 16188], | 30.00th=[ 16188], 40.00th=[130548], 50.00th=[130548], 60.00th=[221250], | 70.00th=[250610], 80.00th=[250610], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 4087, max= 6144, per=90.25%, avg=5115.50, stdev=1454.52, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1831KiB/s (1875kB/s)(6144KiB/3356msec); 0 zone resets clat (msec): min=88, max=627, avg=385.03, stdev=214.33 lat (msec): min=88, max=628, avg=385.12, stdev=214.35 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 527], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1712, max= 2048, per=24.82%, avg=1969.80, stdev=145.25, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=19.17%, ctx=368, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181534: Sun Nov 16 21:50:08 2025 read: IOPS=1, BW=1953KiB/s (2000kB/s)(5120KiB/2621msec) clat (usec): min=1860, max=239361, avg=130317.30, stdev=111273.54 lat (usec): min=1861, max=239362, avg=130318.63, stdev=111273.65 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 1860], 10.00th=[ 1860], 20.00th=[ 1860], | 30.00th=[ 27132], 40.00th=[ 27132], 50.00th=[152044], 60.00th=[152044], | 70.00th=[229639], 80.00th=[229639], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 2043, max= 5137, per=63.34%, avg=3590.00, stdev=2187.79, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2735KiB/s (2800kB/s)(7168KiB/2621msec); 0 zone resets clat (msec): min=186, max=480, avg=261.88, stdev=104.51 lat (msec): min=187, max=481, avg=261.99, stdev=104.54 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 232], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 279], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1996, max= 6144, per=44.96%, avg=3567.50, stdev=1975.01, samples=4 iops : min= 1, max= 6, avg= 2.75, stdev= 2.36, samples=4 lat (msec) : 2=8.33%, 50=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.08%, sys=28.44%, ctx=197, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5668KiB/s (5804kB/s), 567KiB/s-2252KiB/s (580kB/s-2306kB/s), io=20.0MiB (20.0MB), run=2621-3613msec WRITE: bw=7936KiB/s (8126kB/s), 1609KiB/s-2834KiB/s (1647kB/s-2902kB/s), io=28.0MiB (29.4MB), run=2621-3613msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181536: Sun Nov 16 21:50:09 2025 read: IOPS=2, BW=2072KiB/s (2122kB/s)(7168KiB/3459msec) clat (msec): min=55, max=625, avg=269.84, stdev=216.60 lat (msec): min=55, max=625, avg=269.84, stdev=216.60 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 73], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 194], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 443], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1954, max= 4000, per=47.60%, avg=2479.50, stdev=1013.76, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1480KiB/s (1516kB/s)(5120KiB/3459msec); 0 zone resets clat (msec): min=57, max=413, avg=276.13, stdev=156.58 lat (msec): min=57, max=413, avg=276.24, stdev=156.59 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2000, max= 2043, per=27.80%, avg=2027.33, stdev=23.76, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=11.68%, ctx=234, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181537: Sun Nov 16 21:50:09 2025 read: IOPS=0, BW=521KiB/s (533kB/s)(2048KiB/3931msec) clat (msec): min=105, max=459, avg=282.08, stdev=250.25 lat (msec): min=105, max=459, avg=282.08, stdev=250.25 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1954, max= 2043, per=38.37%, avg=1998.50, stdev=62.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2605KiB/s (2667kB/s)(10.0MiB/3931msec); 0 zone resets clat (msec): min=75, max=1051, avg=321.53, stdev=282.59 lat (msec): min=75, max=1052, avg=321.63, stdev=282.60 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 148], | 30.00th=[ 150], 40.00th=[ 155], 50.00th=[ 190], 60.00th=[ 275], | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 435], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 2000, max= 6119, per=55.58%, avg=4053.25, stdev=1681.91, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 2000=8.33% cpu : usr=0.08%, sys=8.98%, ctx=123, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181538: Sun Nov 16 21:50:09 2025 read: IOPS=1, BW=1656KiB/s (1695kB/s)(6144KiB/3711msec) clat (msec): min=47, max=255, avg=138.98, stdev=82.91 lat (msec): min=47, max=255, avg=138.98, stdev=82.91 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 150], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 2000, max= 6011, per=64.31%, avg=3350.00, stdev=2304.58, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1656KiB/s (1695kB/s)(6144KiB/3711msec); 0 zone resets clat (msec): min=121, max=765, avg=450.01, stdev=263.36 lat (msec): min=121, max=766, avg=450.24, stdev=263.27 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 498], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2003, max= 3908, per=34.26%, avg=2498.25, stdev=940.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=7.87%, ctx=101, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181539: Sun Nov 16 21:50:09 2025 read: IOPS=1, BW=1329KiB/s (1361kB/s)(5120KiB/3852msec) clat (msec): min=49, max=298, avg=153.03, stdev=105.47 lat (msec): min=49, max=298, avg=153.03, stdev=105.47 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 111], 60.00th=[ 111], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2043, max= 6011, per=77.31%, avg=4027.00, stdev=2805.80, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1861KiB/s (1906kB/s)(7168KiB/3852msec); 0 zone resets clat (msec): min=86, max=780, avg=414.71, stdev=291.47 lat (msec): min=86, max=780, avg=414.82, stdev=291.45 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 150], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 271], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 735], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1954, max= 4000, per=34.27%, avg=2499.00, stdev=1001.27, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=7.12%, ctx=108, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5210KiB/s (5335kB/s), 521KiB/s-2072KiB/s (533kB/s-2122kB/s), io=20.0MiB (20.0MB), run=3459-3931msec WRITE: bw=7294KiB/s (7469kB/s), 1480KiB/s-2605KiB/s (1516kB/s-2667kB/s), io=28.0MiB (29.4MB), run=3459-3931msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181547: Sun Nov 16 21:50:19 2025 read: IOPS=1, BW=6190KiB/s (6339kB/s)(12.0MiB/1985msec) clat (msec): min=520, max=776, avg=651.43, stdev=128.34 lat (msec): min=520, max=776, avg=651.43, stdev=128.34 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.46%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181548: Sun Nov 16 21:50:19 2025 read: IOPS=0, BW=1761KiB/s (1803kB/s)(4096KiB/2326msec) clat (nsec): min=911428k, max=911428k, avg=911428454.00, stdev= 0.00 lat (nsec): min=911431k, max=911431k, avg=911431007.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3522KiB/s (3606kB/s)(8192KiB/2326msec); 0 zone resets clat (msec): min=431, max=888, avg=660.01, stdev=323.55 lat (msec): min=431, max=889, avg=660.66, stdev=323.76 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8143, max= 8143, per=57.81%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.72%, ctx=42, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181549: Sun Nov 16 21:50:19 2025 write: IOPS=2, BW=10.8MiB/s (11.3MB/s)(12.0MiB/1116msec); 0 zone resets clat (msec): min=145, max=757, avg=351.43, stdev=351.54 lat (msec): min=145, max=757, avg=352.82, stdev=350.72 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min=10981, max=10981, per=77.95%, avg=10981.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.89%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181550: Sun Nov 16 21:50:19 2025 write: IOPS=2, BW=9359KiB/s (9583kB/s)(12.0MiB/1313msec); 0 zone resets clat (msec): min=174, max=625, avg=417.28, stdev=227.12 lat (msec): min=175, max=625, avg=417.69, stdev=227.02 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 5910, max= 8110, per=49.76%, avg=7010.00, stdev=1555.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=12.73%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7044KiB/s (7213kB/s), 1761KiB/s-6190KiB/s (1803kB/s-6339kB/s), io=16.0MiB (16.8MB), run=1985-2326msec WRITE: bw=13.8MiB/s (14.4MB/s), 3522KiB/s-10.8MiB/s (3606kB/s-11.3MB/s), io=32.0MiB (33.6MB), run=1116-2326msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181551: Sun Nov 16 21:50:19 2025 read: IOPS=1, BW=6781KiB/s (6944kB/s)(12.0MiB/1812msec) clat (msec): min=482, max=686, avg=577.82, stdev=102.78 lat (msec): min=482, max=686, avg=577.82, stdev=102.78 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 6350, max= 8159, per=88.74%, avg=7254.50, stdev=1279.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=28.38%, ctx=820, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181552: Sun Nov 16 21:50:19 2025 read: IOPS=0, BW=2044KiB/s (2093kB/s)(4096KiB/2004msec) clat (nsec): min=522217k, max=522217k, avg=522217239.00, stdev= 0.00 lat (nsec): min=522221k, max=522221k, avg=522220952.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7049, max= 7049, per=86.23%, avg=7049.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4088KiB/s (4186kB/s)(8192KiB/2004msec); 0 zone resets clat (msec): min=545, max=890, avg=718.40, stdev=243.99 lat (msec): min=546, max=891, avg=718.85, stdev=243.94 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8159, max= 8159, per=53.59%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.25%, sys=8.84%, ctx=135, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181553: Sun Nov 16 21:50:19 2025 write: IOPS=1, BW=5710KiB/s (5847kB/s)(12.0MiB/2152msec); 0 zone resets clat (msec): min=240, max=931, avg=678.34, stdev=380.86 lat (msec): min=240, max=932, avg=680.63, stdev=382.18 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8110, max= 8192, per=53.53%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.09%, sys=8.60%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181554: Sun Nov 16 21:50:19 2025 write: IOPS=1, BW=6321KiB/s (6473kB/s)(12.0MiB/1944msec); 0 zone resets clat (msec): min=206, max=891, avg=628.95, stdev=369.04 lat (msec): min=207, max=891, avg=629.25, stdev=369.00 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=53.80%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=8.29%, ctx=91, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8176KiB/s (8372kB/s), 2044KiB/s-6781KiB/s (2093kB/s-6944kB/s), io=16.0MiB (16.8MB), run=1812-2004msec WRITE: bw=14.9MiB/s (15.6MB/s), 4088KiB/s-6321KiB/s (4186kB/s-6473kB/s), io=32.0MiB (33.6MB), run=1944-2152msec