== sanity test 398b: DIO and buffer IO race ============== 13:56:12 (1758736572) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.95815 s, 17.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186606: Wed Sep 24 13:57:46 2025 read: IOPS=18, BW=72.4KiB/s (74.1kB/s)(5992KiB/82789msec) clat (usec): min=118, max=284873, avg=30862.77, stdev=20967.18 lat (usec): min=119, max=284874, avg=30864.63, stdev=20966.96 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 7963], 10.00th=[ 11469], 20.00th=[ 15533], | 30.00th=[ 18744], 40.00th=[ 22414], 50.00th=[ 26870], 60.00th=[ 30802], | 70.00th=[ 36439], 80.00th=[ 44303], 90.00th=[ 55313], 95.00th=[ 68682], | 99.00th=[102237], 99.50th=[114820], 99.90th=[177210], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 15, max= 151, per=25.46%, avg=72.04, stdev=27.36, samples=163 iops : min= 3, max= 37, avg=17.41, stdev= 6.87, samples=163 write: IOPS=19, BW=76.0KiB/s (77.9kB/s)(6296KiB/82789msec); 0 zone resets clat (usec): min=871, max=286087, avg=23063.04, stdev=24400.61 lat (usec): min=872, max=286089, avg=23066.33, stdev=24400.39 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1352], 20.00th=[ 2835], | 30.00th=[ 5669], 40.00th=[ 11207], 50.00th=[ 17433], 60.00th=[ 22676], | 70.00th=[ 29230], 80.00th=[ 36963], 90.00th=[ 54264], 95.00th=[ 70779], | 99.00th=[105382], 99.50th=[127402], 99.90th=[149947], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 176, per=25.58%, avg=75.72, stdev=35.06, samples=163 iops : min= 1, max= 44, avg=18.33, stdev= 8.84, samples=163 lat (usec) : 250=1.43%, 500=0.33%, 750=0.07%, 1000=0.36% lat (msec) : 2=7.13%, 4=5.34%, 10=8.37%, 20=21.84%, 50=42.25% lat (msec) : 100=11.62%, 250=1.20%, 500=0.07% cpu : usr=0.09%, sys=9.23%, ctx=7008, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186608: Wed Sep 24 13:57:46 2025 read: IOPS=17, BW=70.8KiB/s (72.5kB/s)(5940KiB/83878msec) clat (usec): min=112, max=167305, avg=30364.30, stdev=19527.00 lat (usec): min=113, max=167307, avg=30365.39, stdev=19527.04 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 8160], 10.00th=[ 11338], 20.00th=[ 15401], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 26084], 60.00th=[ 30802], | 70.00th=[ 36439], 80.00th=[ 43254], 90.00th=[ 54789], 95.00th=[ 66323], | 99.00th=[ 96994], 99.50th=[108528], 99.90th=[141558], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 14, max= 159, per=24.78%, avg=70.13, stdev=28.45, samples=165 iops : min= 3, max= 39, avg=16.93, stdev= 7.14, samples=165 write: IOPS=18, BW=75.7KiB/s (77.5kB/s)(6348KiB/83878msec); 0 zone resets clat (usec): min=893, max=271897, avg=24290.66, stdev=25380.30 lat (usec): min=894, max=271898, avg=24291.97, stdev=25380.35 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1106], 10.00th=[ 1319], 20.00th=[ 3032], | 30.00th=[ 6128], 40.00th=[ 11731], 50.00th=[ 17695], 60.00th=[ 22676], | 70.00th=[ 30540], 80.00th=[ 40633], 90.00th=[ 57410], 95.00th=[ 76022], | 99.00th=[108528], 99.50th=[125305], 99.90th=[164627], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 15, max= 184, per=25.22%, avg=74.64, stdev=32.64, samples=165 iops : min= 3, max= 46, avg=18.07, stdev= 8.23, samples=165 lat (usec) : 250=1.30%, 500=0.29%, 750=0.07%, 1000=0.52% lat (msec) : 2=7.19%, 4=4.82%, 10=8.07%, 20=22.36%, 50=41.31% lat (msec) : 100=13.05%, 250=0.98%, 500=0.03% cpu : usr=0.12%, sys=9.17%, ctx=6961, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186610: Wed Sep 24 13:57:46 2025 read: IOPS=17, BW=71.7KiB/s (73.5kB/s)(6028KiB/84026msec) clat (usec): min=115, max=142359, avg=30358.95, stdev=19903.25 lat (usec): min=116, max=142360, avg=30360.11, stdev=19903.31 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 6259], 10.00th=[ 10945], 20.00th=[ 15270], | 30.00th=[ 18482], 40.00th=[ 21627], 50.00th=[ 25297], 60.00th=[ 30278], | 70.00th=[ 35914], 80.00th=[ 44827], 90.00th=[ 57410], 95.00th=[ 68682], | 99.00th=[ 94897], 99.50th=[102237], 99.90th=[122160], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 7, max= 144, per=25.24%, avg=71.42, stdev=31.04, samples=166 iops : min= 1, max= 36, avg=17.25, stdev= 7.80, samples=166 write: IOPS=18, BW=74.5KiB/s (76.3kB/s)(6260KiB/84026msec); 0 zone resets clat (usec): min=861, max=294085, avg=24294.33, stdev=25940.77 lat (usec): min=863, max=294087, avg=24295.79, stdev=25940.75 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1106], 10.00th=[ 1287], 20.00th=[ 2671], | 30.00th=[ 5997], 40.00th=[ 11863], 50.00th=[ 16909], 60.00th=[ 22938], | 70.00th=[ 30802], 80.00th=[ 41157], 90.00th=[ 57934], 95.00th=[ 71828], | 99.00th=[109577], 99.50th=[139461], 99.90th=[217056], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 15, max= 192, per=25.01%, avg=74.04, stdev=30.72, samples=166 iops : min= 3, max= 48, avg=17.92, stdev= 7.74, samples=166 lat (usec) : 250=1.66%, 500=0.49%, 1000=0.42% lat (msec) : 2=8.01%, 4=4.46%, 10=8.20%, 20=21.65%, 50=40.43% lat (msec) : 100=13.57%, 250=1.07%, 500=0.03% cpu : usr=0.09%, sys=9.07%, ctx=6979, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186612: Wed Sep 24 13:57:46 2025 read: IOPS=17, BW=71.4KiB/s (73.1kB/s)(6052KiB/84788msec) clat (usec): min=108, max=156971, avg=30569.83, stdev=19821.90 lat (usec): min=108, max=156972, avg=30570.97, stdev=19821.94 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 1663], 10.00th=[ 10945], 20.00th=[ 15270], | 30.00th=[ 19006], 40.00th=[ 22152], 50.00th=[ 26346], 60.00th=[ 31327], | 70.00th=[ 37487], 80.00th=[ 44303], 90.00th=[ 55837], 95.00th=[ 65799], | 99.00th=[ 96994], 99.50th=[112722], 99.90th=[137364], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 8, max= 160, per=25.02%, avg=70.82, stdev=26.37, samples=166 iops : min= 2, max= 40, avg=17.11, stdev= 6.62, samples=166 write: IOPS=18, BW=73.5KiB/s (75.3kB/s)(6236KiB/84788msec); 0 zone resets clat (usec): min=771, max=303236, avg=24553.42, stdev=26080.80 lat (usec): min=772, max=303237, avg=24554.80, stdev=26080.84 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1090], 10.00th=[ 1237], 20.00th=[ 2900], | 30.00th=[ 7046], 40.00th=[ 12911], 50.00th=[ 17695], 60.00th=[ 23987], | 70.00th=[ 31065], 80.00th=[ 40633], 90.00th=[ 55837], 95.00th=[ 71828], | 99.00th=[111674], 99.50th=[139461], 99.90th=[263193], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 183, per=24.60%, avg=72.80, stdev=31.64, samples=167 iops : min= 1, max= 45, avg=17.60, stdev= 7.94, samples=167 lat (usec) : 250=1.79%, 500=0.55%, 750=0.07%, 1000=0.94% lat (msec) : 2=7.03%, 4=4.30%, 10=7.03%, 20=21.91%, 50=42.84% lat (msec) : 100=12.24%, 250=1.24%, 500=0.07% cpu : usr=0.09%, sys=9.11%, ctx=7030, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=283KiB/s (290kB/s), 70.8KiB/s-72.4KiB/s (72.5kB/s-74.1kB/s), io=23.4MiB (24.6MB), run=82789-84788msec WRITE: bw=297KiB/s (304kB/s), 73.5KiB/s-76.0KiB/s (75.3kB/s-77.9kB/s), io=24.6MiB (25.7MB), run=82789-84788msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186605: Wed Sep 24 13:58:05 2025 read: IOPS=14, BW=57.5KiB/s (58.9kB/s)(5992KiB/104163msec) clat (msec): min=4, max=380, avg=27.04, stdev=30.78 lat (msec): min=4, max=380, avg=27.04, stdev=30.78 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 28], 80.00th=[ 39], 90.00th=[ 61], 95.00th=[ 85], | 99.00th=[ 144], 99.50th=[ 159], 99.90th=[ 313], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 192, per=24.82%, avg=57.09, stdev=45.52, samples=206 iops : min= 1, max= 48, avg=13.67, stdev=11.42, samples=206 write: IOPS=15, BW=60.4KiB/s (61.9kB/s)(6296KiB/104163msec); 0 zone resets clat (msec): min=6, max=320, avg=40.30, stdev=33.31 lat (msec): min=6, max=320, avg=40.30, stdev=33.31 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 86], 95.00th=[ 109], | 99.00th=[ 148], 99.50th=[ 167], 99.90th=[ 264], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 199, per=24.87%, avg=59.94, stdev=44.40, samples=206 iops : min= 1, max= 49, avg=14.38, stdev=11.14, samples=206 lat (msec) : 10=13.54%, 20=33.40%, 50=32.39%, 100=15.79%, 250=4.69% lat (msec) : 500=0.20% cpu : usr=0.06%, sys=3.59%, ctx=4999, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186607: Wed Sep 24 13:58:05 2025 read: IOPS=14, BW=57.3KiB/s (58.7kB/s)(5940KiB/103592msec) clat (msec): min=4, max=280, avg=26.80, stdev=27.84 lat (msec): min=4, max=280, avg=26.80, stdev=27.84 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 59], 95.00th=[ 84], | 99.00th=[ 138], 99.50th=[ 157], 99.90th=[ 275], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 223, per=24.88%, avg=57.22, stdev=45.38, samples=204 iops : min= 1, max= 55, avg=13.70, stdev=11.39, samples=204 write: IOPS=15, BW=61.3KiB/s (62.7kB/s)(6348KiB/103592msec); 0 zone resets clat (msec): min=6, max=322, avg=40.05, stdev=32.63 lat (msec): min=6, max=322, avg=40.06, stdev=32.63 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 84], 95.00th=[ 103], | 99.00th=[ 150], 99.50th=[ 174], 99.90th=[ 313], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 183, per=25.27%, avg=60.89, stdev=44.02, samples=205 iops : min= 1, max= 45, avg=14.62, stdev=11.04, samples=205 lat (msec) : 10=13.70%, 20=32.49%, 50=32.62%, 100=16.96%, 250=4.07% lat (msec) : 500=0.16% cpu : usr=0.08%, sys=3.54%, ctx=4974, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186609: Wed Sep 24 13:58:05 2025 read: IOPS=14, BW=58.2KiB/s (59.6kB/s)(6028KiB/103627msec) clat (msec): min=4, max=376, avg=26.56, stdev=28.36 lat (msec): min=4, max=376, avg=26.57, stdev=28.36 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 61], 95.00th=[ 83], | 99.00th=[ 126], 99.50th=[ 144], 99.90th=[ 313], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 223, per=25.12%, avg=57.78, stdev=44.75, samples=205 iops : min= 1, max= 55, avg=13.84, stdev=11.22, samples=205 write: IOPS=15, BW=60.4KiB/s (61.9kB/s)(6260KiB/103627msec); 0 zone resets clat (msec): min=6, max=289, avg=40.49, stdev=33.30 lat (msec): min=6, max=289, avg=40.49, stdev=33.30 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 86], 95.00th=[ 108], | 99.00th=[ 153], 99.50th=[ 186], 99.90th=[ 249], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 175, per=24.88%, avg=59.97, stdev=45.05, samples=205 iops : min= 1, max= 43, avg=14.39, stdev=11.31, samples=205 lat (msec) : 10=14.65%, 20=31.90%, 50=32.71%, 100=16.05%, 250=4.59% lat (msec) : 500=0.10% cpu : usr=0.06%, sys=3.59%, ctx=4970, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186611: Wed Sep 24 13:58:05 2025 read: IOPS=14, BW=58.2KiB/s (59.6kB/s)(6052KiB/103986msec) clat (msec): min=4, max=268, avg=27.01, stdev=28.10 lat (msec): min=4, max=268, avg=27.01, stdev=28.10 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 28], 80.00th=[ 41], 90.00th=[ 64], 95.00th=[ 85], | 99.00th=[ 131], 99.50th=[ 169], 99.90th=[ 257], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 223, per=25.47%, avg=58.57, stdev=44.70, samples=201 iops : min= 1, max= 55, avg=14.04, stdev=11.22, samples=201 write: IOPS=14, BW=59.0KiB/s (61.4kB/s)(6236KiB/103986msec); 0 zone resets clat (msec): min=7, max=286, avg=40.35, stdev=33.52 lat (msec): min=7, max=286, avg=40.35, stdev=33.52 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 86], 95.00th=[ 108], | 99.00th=[ 150], 99.50th=[ 197], 99.90th=[ 251], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 199, per=24.75%, avg=59.64, stdev=44.48, samples=204 iops : min= 1, max= 49, avg=14.31, stdev=11.15, samples=204 lat (msec) : 10=12.83%, 20=34.73%, 50=31.45%, 100=16.15%, 250=4.72% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=3.58%, ctx=4934, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=231KiB/s (236kB/s), 57.3KiB/s-58.2KiB/s (58.7kB/s-59.6kB/s), io=23.4MiB (24.6MB), run=103592-104163msec WRITE: bw=241KiB/s (247kB/s), 59.0KiB/s-61.3KiB/s (61.4kB/s-62.7kB/s), io=24.6MiB (25.7MB), run=103592-104163msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186653: Wed Sep 24 13:58:30 2025 read: IOPS=20, BW=332KiB/s (340kB/s)(5920KiB/17846msec) clat (usec): min=102, max=99580, avg=24899.33, stdev=15369.68 lat (usec): min=103, max=99582, avg=24900.49, stdev=15369.66 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 273], 10.00th=[ 6980], 20.00th=[13829], | 30.00th=[16319], 40.00th=[19006], 50.00th=[22414], 60.00th=[26346], | 70.00th=[31851], 80.00th=[36439], 90.00th=[44303], 95.00th=[54789], | 99.00th=[68682], 99.50th=[71828], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 158, max= 509, per=26.07%, avg=330.54, stdev=87.78, samples=35 iops : min= 9, max= 31, avg=20.00, stdev= 5.51, samples=35 write: IOPS=22, BW=357KiB/s (365kB/s)(6368KiB/17846msec); 0 zone resets clat (usec): min=977, max=129533, avg=21632.36, stdev=18014.46 lat (usec): min=979, max=129534, avg=21634.53, stdev=18014.79 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2507], 10.00th=[ 3392], 20.00th=[ 5997], | 30.00th=[ 8848], 40.00th=[ 13304], 50.00th=[ 17695], 60.00th=[ 20841], | 70.00th=[ 26346], 80.00th=[ 34866], 90.00th=[ 45876], 95.00th=[ 55837], | 99.00th=[ 77071], 99.50th=[ 94897], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 155, max= 544, per=26.77%, avg=357.11, stdev=94.48, samples=35 iops : min= 9, max= 34, avg=21.69, stdev= 5.99, samples=35 lat (usec) : 250=1.95%, 500=1.95%, 750=0.26%, 1000=0.26% lat (msec) : 2=1.17%, 4=6.12%, 10=10.42%, 20=28.65%, 50=41.41% lat (msec) : 100=7.68%, 250=0.13% cpu : usr=0.06%, sys=14.24%, ctx=2022, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186654: Wed Sep 24 13:58:30 2025 read: IOPS=19, BW=304KiB/s (312kB/s)(5744KiB/18879msec) clat (usec): min=120, max=131784, avg=26721.80, stdev=17173.42 lat (usec): min=121, max=131785, avg=26723.09, stdev=17173.22 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 297], 10.00th=[ 9372], 20.00th=[ 14615], | 30.00th=[ 18220], 40.00th=[ 21103], 50.00th=[ 23725], 60.00th=[ 28443], | 70.00th=[ 32375], 80.00th=[ 38536], 90.00th=[ 45351], 95.00th=[ 53216], | 99.00th=[ 94897], 99.50th=[104334], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 128, max= 544, per=23.81%, avg=301.95, stdev=84.78, samples=37 iops : min= 8, max= 34, avg=18.24, stdev= 5.27, samples=37 write: IOPS=21, BW=347KiB/s (355kB/s)(6544KiB/18879msec); 0 zone resets clat (usec): min=1422, max=160814, avg=22612.28, stdev=18705.90 lat (usec): min=1424, max=160816, avg=22642.47, stdev=18698.66 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2114], 10.00th=[ 2900], 20.00th=[ 5080], | 30.00th=[ 9765], 40.00th=[ 13960], 50.00th=[ 18482], 60.00th=[ 23200], | 70.00th=[ 30278], 80.00th=[ 38536], 90.00th=[ 47449], 95.00th=[ 54789], | 99.00th=[ 68682], 99.50th=[ 77071], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 158, max= 573, per=25.77%, avg=343.81, stdev=102.29, samples=37 iops : min= 9, max= 35, avg=20.84, stdev= 6.46, samples=37 lat (usec) : 250=1.82%, 500=1.69% lat (msec) : 2=2.73%, 4=5.99%, 10=9.11%, 20=24.48%, 50=47.40% lat (msec) : 100=6.38%, 250=0.39% cpu : usr=0.06%, sys=13.59%, ctx=2031, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186655: Wed Sep 24 13:58:30 2025 read: IOPS=21, BW=349KiB/s (357kB/s)(6256KiB/17946msec) clat (usec): min=111, max=113461, avg=25827.73, stdev=15971.02 lat (usec): min=112, max=113462, avg=25828.85, stdev=15971.14 clat percentiles (usec): | 1.00th=[ 149], 5.00th=[ 408], 10.00th=[ 10552], 20.00th=[ 14746], | 30.00th=[ 17433], 40.00th=[ 20317], 50.00th=[ 22938], 60.00th=[ 27657], | 70.00th=[ 31851], 80.00th=[ 36963], 90.00th=[ 43254], 95.00th=[ 50070], | 99.00th=[ 80217], 99.50th=[106431], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 190, max= 512, per=27.51%, avg=348.83, stdev=87.35, samples=35 iops : min= 11, max= 32, avg=21.17, stdev= 5.54, samples=35 write: IOPS=21, BW=336KiB/s (344kB/s)(6032KiB/17946msec); 0 zone resets clat (usec): min=1394, max=85540, avg=20771.97, stdev=17838.84 lat (usec): min=1395, max=85555, avg=20774.31, stdev=17839.54 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2147], 10.00th=[ 2769], 20.00th=[ 4621], | 30.00th=[ 6652], 40.00th=[10683], 50.00th=[15795], 60.00th=[21890], | 70.00th=[27395], 80.00th=[35390], 90.00th=[46924], 95.00th=[57410], | 99.00th=[70779], 99.50th=[74974], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 158, max= 541, per=24.86%, avg=331.60, stdev=92.88, samples=35 iops : min= 9, max= 33, avg=20.09, stdev= 5.83, samples=35 lat (usec) : 250=1.69%, 500=1.43%, 1000=0.26% lat (msec) : 2=2.08%, 4=7.42%, 10=11.59%, 20=23.05%, 50=45.57% lat (msec) : 100=6.64%, 250=0.26% cpu : usr=0.12%, sys=13.79%, ctx=2087, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186656: Wed Sep 24 13:58:30 2025 read: IOPS=21, BW=338KiB/s (346kB/s)(6032KiB/17856msec) clat (usec): min=134, max=146565, avg=25476.16, stdev=16544.37 lat (usec): min=136, max=146566, avg=25477.24, stdev=16544.35 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 204], 10.00th=[ 486], 20.00th=[ 13829], | 30.00th=[ 17171], 40.00th=[ 20579], 50.00th=[ 24249], 60.00th=[ 27657], | 70.00th=[ 31065], 80.00th=[ 36439], 90.00th=[ 43779], 95.00th=[ 54789], | 99.00th=[ 67634], 99.50th=[110625], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 95, max= 479, per=26.46%, avg=335.54, stdev=86.06, samples=35 iops : min= 5, max= 29, avg=20.31, stdev= 5.44, samples=35 write: IOPS=21, BW=350KiB/s (359kB/s)(6256KiB/17856msec); 0 zone resets clat (usec): min=1343, max=94666, avg=21043.51, stdev=17936.73 lat (usec): min=1344, max=94667, avg=21047.86, stdev=17936.56 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1860], 10.00th=[ 2802], 20.00th=[ 4490], | 30.00th=[ 7832], 40.00th=[11731], 50.00th=[16909], 60.00th=[21627], | 70.00th=[27132], 80.00th=[35390], 90.00th=[45351], 95.00th=[57410], | 99.00th=[74974], 99.50th=[80217], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 159, max= 574, per=26.24%, avg=350.00, stdev=96.72, samples=35 iops : min= 9, max= 35, avg=21.23, stdev= 6.14, samples=35 lat (usec) : 250=3.26%, 500=1.82% lat (msec) : 2=3.12%, 4=5.73%, 10=10.55%, 20=23.83%, 50=44.40% lat (msec) : 100=7.03%, 250=0.26% cpu : usr=0.10%, sys=14.21%, ctx=1959, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1269KiB/s (1299kB/s), 304KiB/s-349KiB/s (312kB/s-357kB/s), io=23.4MiB (24.5MB), run=17846-18879msec WRITE: bw=1335KiB/s (1367kB/s), 336KiB/s-357KiB/s (344kB/s-365kB/s), io=24.6MiB (25.8MB), run=17846-18879msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186648: Wed Sep 24 13:58:36 2025 read: IOPS=15, BW=246KiB/s (252kB/s)(5920KiB/24028msec) clat (msec): min=4, max=141, avg=25.44, stdev=21.71 lat (msec): min=4, max=141, avg=25.45, stdev=21.71 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 37], 90.00th=[ 57], 95.00th=[ 73], | 99.00th=[ 105], 99.50th=[ 120], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 63, max= 605, per=24.55%, avg=242.11, stdev=124.24, samples=47 iops : min= 3, max= 37, avg=14.43, stdev= 7.80, samples=47 write: IOPS=16, BW=265KiB/s (271kB/s)(6368KiB/24028msec); 0 zone resets clat (msec): min=8, max=145, avg=36.62, stdev=21.09 lat (msec): min=8, max=145, avg=36.63, stdev=21.09 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 66], 95.00th=[ 77], | 99.00th=[ 109], 99.50th=[ 117], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 62, max= 699, per=25.38%, avg=263.19, stdev=132.47, samples=47 iops : min= 3, max= 43, avg=15.74, stdev= 8.38, samples=47 lat (msec) : 10=8.33%, 20=31.51%, 50=42.84%, 100=15.76%, 250=1.56% cpu : usr=0.09%, sys=4.79%, ctx=1293, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186649: Wed Sep 24 13:58:36 2025 read: IOPS=14, BW=237KiB/s (242kB/s)(5744KiB/24278msec) clat (msec): min=5, max=141, avg=25.53, stdev=22.77 lat (msec): min=5, max=141, avg=25.53, stdev=22.77 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 58], 95.00th=[ 71], | 99.00th=[ 113], 99.50th=[ 138], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 63, max= 604, per=24.56%, avg=242.13, stdev=135.96, samples=47 iops : min= 3, max= 37, avg=14.43, stdev= 8.54, samples=47 write: IOPS=16, BW=270KiB/s (276kB/s)(6544KiB/24278msec); 0 zone resets clat (msec): min=8, max=168, avg=36.78, stdev=24.34 lat (msec): min=8, max=168, avg=36.79, stdev=24.34 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 70], 95.00th=[ 91], | 99.00th=[ 121], 99.50th=[ 136], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 94, max= 636, per=25.85%, avg=268.08, stdev=147.39, samples=48 iops : min= 5, max= 39, avg=16.04, stdev= 9.25, samples=48 lat (msec) : 10=8.20%, 20=33.59%, 50=41.02%, 100=14.58%, 250=2.60% cpu : usr=0.11%, sys=4.78%, ctx=1322, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186650: Wed Sep 24 13:58:36 2025 read: IOPS=16, BW=259KiB/s (265kB/s)(6256KiB/24134msec) clat (msec): min=5, max=143, avg=25.53, stdev=21.26 lat (msec): min=5, max=143, avg=25.53, stdev=21.26 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 37], 90.00th=[ 58], 95.00th=[ 71], | 99.00th=[ 103], 99.50th=[ 113], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 63, max= 702, per=26.11%, avg=257.47, stdev=159.20, samples=47 iops : min= 3, max= 43, avg=15.38, stdev=10.07, samples=47 write: IOPS=15, BW=250KiB/s (256kB/s)(6032KiB/24134msec); 0 zone resets clat (msec): min=7, max=164, avg=37.37, stdev=22.12 lat (msec): min=7, max=164, avg=37.38, stdev=22.12 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 69], 95.00th=[ 79], | 99.00th=[ 100], 99.50th=[ 134], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 31, max= 637, per=23.50%, avg=243.72, stdev=128.41, samples=47 iops : min= 1, max= 39, avg=14.51, stdev= 8.03, samples=47 lat (msec) : 10=7.81%, 20=32.29%, 50=40.23%, 100=18.75%, 250=0.91% cpu : usr=0.07%, sys=4.82%, ctx=1272, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186651: Wed Sep 24 13:58:36 2025 read: IOPS=15, BW=252KiB/s (258kB/s)(6032KiB/23958msec) clat (msec): min=4, max=131, avg=23.76, stdev=19.32 lat (msec): min=4, max=131, avg=23.77, stdev=19.32 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 48], 95.00th=[ 64], | 99.00th=[ 95], 99.50th=[ 123], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 94, max= 699, per=25.19%, avg=248.38, stdev=137.02, samples=47 iops : min= 5, max= 43, avg=14.81, stdev= 8.59, samples=47 write: IOPS=16, BW=261KiB/s (267kB/s)(6256KiB/23958msec); 0 zone resets clat (msec): min=7, max=145, avg=38.20, stdev=22.74 lat (msec): min=7, max=145, avg=38.20, stdev=22.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 45], 80.00th=[ 55], 90.00th=[ 70], 95.00th=[ 83], | 99.00th=[ 116], 99.50th=[ 123], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 95, max= 573, per=25.00%, avg=259.26, stdev=126.97, samples=47 iops : min= 5, max= 35, avg=15.49, stdev= 8.02, samples=47 lat (msec) : 10=10.55%, 20=30.21%, 50=42.32%, 100=15.49%, 250=1.43% cpu : usr=0.09%, sys=4.73%, ctx=1263, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=987KiB/s (1010kB/s), 237KiB/s-259KiB/s (242kB/s-265kB/s), io=23.4MiB (24.5MB), run=23958-24278msec WRITE: bw=1038KiB/s (1063kB/s), 250KiB/s-270KiB/s (256kB/s-276kB/s), io=24.6MiB (25.8MB), run=23958-24278msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186665: Wed Sep 24 13:58:47 2025 read: IOPS=1, BW=1994KiB/s (2042kB/s)(7168KiB/3595msec) clat (msec): min=49, max=530, avg=155.30, stdev=169.70 lat (msec): min=49, max=530, avg=155.30, stdev=169.70 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 70], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 95], 60.00th=[ 102], | 70.00th=[ 102], 80.00th=[ 167], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1861, max= 5626, per=89.25%, avg=3861.00, stdev=1893.47, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=1424KiB/s (1458kB/s)(5120KiB/3595msec); 0 zone resets clat (msec): min=80, max=1910, avg=489.47, stdev=797.24 lat (msec): min=80, max=1910, avg=489.58, stdev=797.23 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 113], 60.00th=[ 113], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 2048, max= 7447, per=78.39%, avg=4747.50, stdev=3817.67, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 lat (msec) : 50=8.33%, 100=41.67%, 250=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=5.79%, ctx=55, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186666: Wed Sep 24 13:58:47 2025 read: IOPS=0, BW=433KiB/s (443kB/s)(2048KiB/4734msec) clat (msec): min=91, max=387, avg=239.50, stdev=209.34 lat (msec): min=91, max=387, avg=239.50, stdev=209.34 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 1928, max= 2048, per=45.95%, avg=1988.00, stdev=84.85, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2163KiB/s (2215kB/s)(10.0MiB/4734msec); 0 zone resets clat (msec): min=61, max=1885, avg=410.99, stdev=545.52 lat (msec): min=61, max=1885, avg=411.07, stdev=545.52 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 67], | 30.00th=[ 115], 40.00th=[ 194], 50.00th=[ 234], 60.00th=[ 247], | 70.00th=[ 317], 80.00th=[ 342], 90.00th=[ 651], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 1984, max= 6131, per=52.61%, avg=3185.80, stdev=1803.31, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.88%, ctx=164, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186668: Wed Sep 24 13:58:47 2025 read: IOPS=1, BW=1398KiB/s (1431kB/s)(6144KiB/4396msec) clat (msec): min=65, max=277, avg=151.09, stdev=90.48 lat (msec): min=65, max=277, avg=151.09, stdev=90.48 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 111], 50.00th=[ 111], 60.00th=[ 134], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 2048, max= 4096, per=75.97%, avg=3286.67, stdev=1089.41, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1398KiB/s (1431kB/s)(6144KiB/4396msec); 0 zone resets clat (msec): min=75, max=2264, avg=564.87, stdev=838.05 lat (msec): min=75, max=2264, avg=564.97, stdev=838.06 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 268], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1858, max= 2852, per=36.35%, avg=2201.50, stdev=442.82, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=11.92%, ctx=133, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186670: Wed Sep 24 13:58:47 2025 read: IOPS=1, BW=1084KiB/s (1110kB/s)(5120KiB/4724msec) clat (msec): min=31, max=160, avg=91.33, stdev=48.04 lat (msec): min=31, max=160, avg=91.33, stdev=48.04 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 78], 60.00th=[ 78], | 70.00th=[ 112], 80.00th=[ 112], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 2048, max= 6131, per=94.53%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1517KiB/s (1554kB/s)(7168KiB/4724msec); 0 zone resets clat (msec): min=59, max=2649, avg=592.69, stdev=923.35 lat (msec): min=59, max=2649, avg=592.76, stdev=923.35 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 73], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 262], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 523], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 2043, max= 4096, per=42.23%, avg=2557.50, stdev=1025.67, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=7.75%, ctx=87, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4326KiB/s (4430kB/s), 433KiB/s-1994KiB/s (443kB/s-2042kB/s), io=20.0MiB (20.0MB), run=3595-4734msec WRITE: bw=6057KiB/s (6202kB/s), 1398KiB/s-2163KiB/s (1431kB/s-2215kB/s), io=28.0MiB (29.4MB), run=3595-4734msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186667: Wed Sep 24 13:58:47 2025 read: IOPS=1, BW=1832KiB/s (1876kB/s)(7168KiB/3912msec) clat (usec): min=920, max=1763.7k, avg=387246.40, stdev=613700.39 lat (usec): min=921, max=1763.7k, avg=387247.74, stdev=613700.47 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], | 20.00th=[ 94897], 30.00th=[ 181404], 40.00th=[ 181404], | 50.00th=[ 183501], 60.00th=[ 193987], 70.00th=[ 193987], | 80.00th=[ 291505], 90.00th=[1769997], 95.00th=[1769997], | 99.00th=[1769997], 99.50th=[1769997], 99.90th=[1769997], | 99.95th=[1769997], 99.99th=[1769997] bw ( KiB/s): min= 2048, max= 5896, per=79.40%, avg=3581.67, stdev=2039.33, samples=3 iops : min= 2, max= 5, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1309KiB/s (1340kB/s)(5120KiB/3912msec); 0 zone resets clat (msec): min=132, max=346, avg=192.11, stdev=88.18 lat (msec): min=132, max=346, avg=192.17, stdev=88.17 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 178], 80.00th=[ 178], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1965, max= 5575, per=50.61%, avg=3196.00, stdev=2060.69, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=29.33%, ctx=896, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186669: Wed Sep 24 13:58:47 2025 read: IOPS=0, BW=451KiB/s (462kB/s)(2048KiB/4540msec) clat (usec): min=853, max=158525, avg=79689.08, stdev=111490.93 lat (usec): min=854, max=158527, avg=79690.67, stdev=111491.65 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[ 857], | 30.00th=[ 857], 40.00th=[ 857], 50.00th=[ 857], 60.00th=[158335], | 70.00th=[158335], 80.00th=[158335], 90.00th=[158335], 95.00th=[158335], | 99.00th=[158335], 99.50th=[158335], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 1460, max= 2048, per=38.88%, avg=1754.00, stdev=415.78, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2256KiB/s (2310kB/s)(10.0MiB/4540msec); 0 zone resets clat (msec): min=81, max=1566, avg=417.55, stdev=453.52 lat (msec): min=81, max=1567, avg=417.64, stdev=453.53 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 105], | 30.00th=[ 153], 40.00th=[ 159], 50.00th=[ 247], 60.00th=[ 309], | 70.00th=[ 342], 80.00th=[ 430], 90.00th=[ 785], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 3930, max= 4096, per=64.17%, avg=4052.25, stdev=81.61, samples=4 iops : min= 3, max= 4, avg= 3.50, stdev= 0.58, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=24.26%, ctx=170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186671: Wed Sep 24 13:58:47 2025 read: IOPS=1, BW=1588KiB/s (1626kB/s)(6144KiB/3870msec) clat (usec): min=787, max=280444, avg=113258.11, stdev=106180.55 lat (usec): min=789, max=280446, avg=113259.21, stdev=106180.71 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 881], | 30.00th=[ 881], 40.00th=[ 95945], 50.00th=[ 95945], 60.00th=[149947], | 70.00th=[152044], 80.00th=[152044], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2048, max= 3930, per=71.63%, avg=3231.33, stdev=1030.37, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1588KiB/s (1626kB/s)(6144KiB/3870msec); 0 zone resets clat (msec): min=153, max=2040, avg=521.95, stdev=746.79 lat (msec): min=153, max=2040, avg=522.01, stdev=746.80 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 230], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 1965, max= 3716, per=41.52%, avg=2622.25, stdev=811.79, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 1000=16.67% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=24.14%, ctx=304, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186672: Wed Sep 24 13:58:47 2025 read: IOPS=1, BW=1373KiB/s (1406kB/s)(5120KiB/3730msec) clat (usec): min=624, max=136188, avg=27850.14, stdev=60563.16 lat (usec): min=625, max=136189, avg=27850.98, stdev=60563.26 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 627], | 30.00th=[ 717], 40.00th=[ 717], 50.00th=[ 857], 60.00th=[ 857], | 70.00th=[ 865], 80.00th=[ 865], 90.00th=[135267], 95.00th=[135267], | 99.00th=[135267], 99.50th=[135267], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 7433, max= 7433, per=100.00%, avg=7433.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1922KiB/s (1968kB/s)(7168KiB/3730msec); 0 zone resets clat (msec): min=92, max=2099, avg=499.24, stdev=721.59 lat (msec): min=92, max=2099, avg=499.91, stdev=721.33 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 167], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 190], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 558], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 1393, max= 3716, per=37.34%, avg=2358.00, stdev=1210.34, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=16.67%, 1000=16.67% lat (msec) : 100=8.33%, 250=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.08%, sys=22.31%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4511KiB/s (4619kB/s), 451KiB/s-1832KiB/s (462kB/s-1876kB/s), io=20.0MiB (20.0MB), run=3730-4540msec WRITE: bw=6315KiB/s (6467kB/s), 1309KiB/s-2256KiB/s (1340kB/s-2310kB/s), io=28.0MiB (29.4MB), run=3730-4540msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186683: Wed Sep 24 13:58:57 2025 read: IOPS=1, BW=5315KiB/s (5442kB/s)(12.0MiB/2312msec) clat (msec): min=586, max=973, avg=761.34, stdev=195.85 lat (msec): min=586, max=973, avg=761.34, stdev=195.85 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7922, max= 8175, per=100.00%, avg=8048.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=35.05%, ctx=1045, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186684: Wed Sep 24 13:58:57 2025 read: IOPS=0, BW=1266KiB/s (1296kB/s)(4096KiB/3236msec) clat (nsec): min=620985k, max=620985k, avg=620984538.00, stdev= 0.00 lat (nsec): min=620987k, max=620987k, avg=620987436.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2532KiB/s (2592kB/s)(8192KiB/3236msec); 0 zone resets clat (msec): min=803, max=1701, avg=1252.45, stdev=634.49 lat (msec): min=804, max=1701, avg=1252.91, stdev=634.26 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8175, max= 8175, per=83.41%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=21.89%, ctx=368, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186685: Wed Sep 24 13:58:57 2025 write: IOPS=0, BW=3676KiB/s (3764kB/s)(12.0MiB/3343msec); 0 zone resets clat (msec): min=425, max=1757, avg=1078.10, stdev=666.12 lat (msec): min=426, max=1757, avg=1078.56, stdev=666.20 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8110, max= 8192, per=83.16%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=34.98%, ctx=107, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186686: Wed Sep 24 13:58:57 2025 write: IOPS=1, BW=4201KiB/s (4302kB/s)(12.0MiB/2925msec); 0 zone resets clat (msec): min=753, max=1039, avg=932.05, stdev=156.10 lat (msec): min=753, max=1040, avg=932.43, stdev=155.99 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8175, max= 8192, per=83.50%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=49.15%, ctx=127, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5063KiB/s (5185kB/s), 1266KiB/s-5315KiB/s (1296kB/s-5442kB/s), io=16.0MiB (16.8MB), run=2312-3236msec WRITE: bw=9802KiB/s (10.0MB/s), 2532KiB/s-4201KiB/s (2592kB/s-4302kB/s), io=32.0MiB (33.6MB), run=2925-3343msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186679: Wed Sep 24 13:58:57 2025 read: IOPS=0, BW=4070KiB/s (4168kB/s)(12.0MiB/3019msec) clat (msec): min=663, max=1242, avg=981.69, stdev=293.55 lat (msec): min=663, max=1242, avg=981.69, stdev=293.55 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.14%, ctx=103, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186680: Wed Sep 24 13:58:57 2025 read: IOPS=0, BW=1091KiB/s (1118kB/s)(4096KiB/3753msec) clat (nsec): min=812511k, max=812511k, avg=812511438.00, stdev= 0.00 lat (nsec): min=812513k, max=812513k, avg=812513135.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2183KiB/s (2235kB/s)(8192KiB/3753msec); 0 zone resets clat (msec): min=668, max=2255, avg=1462.01, stdev=1121.94 lat (msec): min=669, max=2255, avg=1462.41, stdev=1121.91 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8175, max= 8175, per=93.63%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=12.39%, ctx=84, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186681: Wed Sep 24 13:58:57 2025 write: IOPS=1, BW=7959KiB/s (8150kB/s)(12.0MiB/1544msec); 0 zone resets clat (msec): min=262, max=910, avg=502.54, stdev=355.40 lat (msec): min=263, max=911, avg=503.06, stdev=355.19 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7922, max= 8175, per=92.18%, avg=8048.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=19.18%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186682: Wed Sep 24 13:58:57 2025 write: IOPS=1, BW=4979KiB/s (5098kB/s)(12.0MiB/2468msec); 0 zone resets clat (msec): min=289, max=1673, avg=807.40, stdev=755.00 lat (msec): min=290, max=1674, avg=807.87, stdev=754.86 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7627, max= 8175, per=90.49%, avg=7901.00, stdev=387.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=11.47%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4366KiB/s (4470kB/s), 1091KiB/s-4070KiB/s (1118kB/s-4168kB/s), io=16.0MiB (16.8MB), run=3019-3753msec WRITE: bw=8731KiB/s (8941kB/s), 2183KiB/s-7959KiB/s (2235kB/s-8150kB/s), io=32.0MiB (33.6MB), run=1544-3753msec