== sanity test 398b: DIO and buffer IO race ============== 20:26:25 (1781223985) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.33961 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180851: Thu Jun 11 20:29:18 2026 read: IOPS=9, BW=39.7KiB/s (40.7kB/s)(5992KiB/150940msec) clat (usec): min=34, max=464193, avg=56881.48, stdev=39596.24 lat (usec): min=34, max=464194, avg=56890.87, stdev=39596.37 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 13566], 10.00th=[ 20055], 20.00th=[ 27919], | 30.00th=[ 34341], 40.00th=[ 41681], 50.00th=[ 49021], 60.00th=[ 57410], | 70.00th=[ 67634], 80.00th=[ 81265], 90.00th=[103285], 95.00th=[126354], | 99.00th=[204473], 99.50th=[233833], 99.90th=[337642], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 96, per=25.27%, avg=39.67, stdev=17.44, samples=293 iops : min= 1, max= 24, avg= 9.26, stdev= 4.41, samples=293 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6296KiB/150940msec); 0 zone resets clat (usec): min=1117, max=854182, avg=41415.19, stdev=49726.25 lat (usec): min=1119, max=854183, avg=41425.96, stdev=49729.05 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1434], 10.00th=[ 1827], 20.00th=[ 4817], | 30.00th=[ 9372], 40.00th=[ 16909], 50.00th=[ 27919], 60.00th=[ 38536], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 99091], 95.00th=[125305], | 99.00th=[189793], 99.50th=[267387], 99.90th=[471860], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 134, per=25.06%, avg=41.36, stdev=20.10, samples=295 iops : min= 1, max= 33, avg= 9.69, stdev= 5.05, samples=295 lat (usec) : 50=0.03%, 100=1.46%, 250=0.16%, 750=0.07%, 1000=0.03% lat (msec) : 2=5.76%, 4=3.39%, 10=7.19%, 20=8.33%, 50=33.92% lat (msec) : 100=29.46%, 250=9.67%, 500=0.49%, 1000=0.03% cpu : usr=0.07%, sys=4.86%, ctx=6716, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180852: Thu Jun 11 20:29:18 2026 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(5940KiB/151207msec) clat (usec): min=33, max=850455, avg=56906.97, stdev=43972.95 lat (usec): min=33, max=850456, avg=56911.59, stdev=43972.61 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 15008], 10.00th=[ 22152], 20.00th=[ 30278], | 30.00th=[ 35914], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 56361], | 70.00th=[ 65274], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[122160], | 99.00th=[202376], 99.50th=[265290], 99.90th=[425722], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 104, per=24.69%, avg=38.76, stdev=16.85, samples=296 iops : min= 1, max= 26, avg= 9.03, stdev= 4.26, samples=296 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6348KiB/151207msec); 0 zone resets clat (usec): min=1165, max=300889, avg=41687.78, stdev=44502.94 lat (usec): min=1166, max=300890, avg=41693.38, stdev=44505.53 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1434], 10.00th=[ 2057], 20.00th=[ 4948], | 30.00th=[ 8848], 40.00th=[ 17957], 50.00th=[ 27657], 60.00th=[ 38536], | 70.00th=[ 52167], 80.00th=[ 71828], 90.00th=[102237], 95.00th=[135267], | 99.00th=[200279], 99.50th=[223347], 99.90th=[274727], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 107, per=25.21%, avg=41.60, stdev=19.82, samples=294 iops : min= 1, max= 26, avg= 9.75, stdev= 4.99, samples=294 lat (usec) : 50=0.16%, 100=1.40%, 250=0.23%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.08%, 4=3.71%, 10=7.68%, 20=6.93%, 50=35.35% lat (msec) : 100=28.97%, 250=9.96%, 500=0.33%, 1000=0.03% cpu : usr=0.08%, sys=4.94%, ctx=6745, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180853: Thu Jun 11 20:29:18 2026 read: IOPS=9, BW=39.6KiB/s (40.5kB/s)(6028KiB/152329msec) clat (usec): min=38, max=799749, avg=55380.79, stdev=39385.57 lat (usec): min=39, max=799750, avg=55389.01, stdev=39385.26 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11863], 10.00th=[ 20055], 20.00th=[ 27919], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 47449], 60.00th=[ 55837], | 70.00th=[ 66323], 80.00th=[ 79168], 90.00th=[101188], 95.00th=[120062], | 99.00th=[166724], 99.50th=[191890], 99.90th=[248513], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 111, per=25.11%, avg=39.42, stdev=17.00, samples=297 iops : min= 1, max= 27, avg= 9.20, stdev= 4.27, samples=297 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6260KiB/152329msec); 0 zone resets clat (usec): min=1090, max=456528, avg=43714.71, stdev=45439.06 lat (usec): min=1092, max=456529, avg=43717.69, stdev=45438.96 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1467], 10.00th=[ 2442], 20.00th=[ 5145], | 30.00th=[ 9765], 40.00th=[ 19792], 50.00th=[ 30016], 60.00th=[ 42206], | 70.00th=[ 57410], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[135267], | 99.00th=[187696], 99.50th=[217056], 99.90th=[291505], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 126, per=24.69%, avg=40.73, stdev=20.11, samples=298 iops : min= 1, max= 31, avg= 9.53, stdev= 5.07, samples=298 lat (usec) : 50=0.16%, 100=1.76%, 250=0.16%, 750=0.03% lat (msec) : 2=4.59%, 4=3.45%, 10=7.68%, 20=7.52%, 50=33.79% lat (msec) : 100=30.11%, 250=10.58%, 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=4.89%, ctx=6745, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180854: Thu Jun 11 20:29:18 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6052KiB/151698msec) clat (usec): min=36, max=993445, avg=54002.37, stdev=44151.66 lat (usec): min=37, max=993446, avg=54006.22, stdev=44153.22 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 133], 10.00th=[ 19006], 20.00th=[ 26870], | 30.00th=[ 32900], 40.00th=[ 38536], 50.00th=[ 46400], 60.00th=[ 54264], | 70.00th=[ 64750], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[185598], 99.50th=[221250], 99.90th=[400557], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 87, per=25.06%, avg=39.34, stdev=16.03, samples=296 iops : min= 1, max= 21, avg= 9.18, stdev= 4.06, samples=296 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6236KiB/151698msec); 0 zone resets clat (usec): min=1166, max=410479, avg=44541.82, stdev=46633.18 lat (usec): min=1167, max=410481, avg=44546.84, stdev=46631.24 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1565], 10.00th=[ 2442], 20.00th=[ 5800], | 30.00th=[ 10421], 40.00th=[ 20579], 50.00th=[ 31589], 60.00th=[ 42206], | 70.00th=[ 55837], 80.00th=[ 74974], 90.00th=[107480], 95.00th=[133694], | 99.00th=[208667], 99.50th=[233833], 99.90th=[350225], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 103, per=24.81%, avg=40.94, stdev=19.50, samples=294 iops : min= 1, max= 25, avg= 9.58, stdev= 4.91, samples=294 lat (usec) : 50=0.20%, 100=2.08%, 250=0.26%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.07%, 4=3.22%, 10=7.71%, 20=7.88%, 50=35.09% lat (msec) : 100=28.81%, 250=10.19%, 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=4.86%, ctx=6787, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (161kB/s), 39.3KiB/s-39.9KiB/s (40.2kB/s-40.9kB/s), io=23.4MiB (24.6MB), run=150940-152329msec WRITE: bw=165KiB/s (169kB/s), 41.1KiB/s-41.0KiB/s (42.1kB/s-42.0kB/s), io=24.6MiB (25.7MB), run=150940-152329msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180856: Thu Jun 11 20:30:06 2026 read: IOPS=7, BW=30.1KiB/s (30.8kB/s)(5992KiB/199074msec) clat (msec): min=6, max=983, avg=51.06, stdev=52.12 lat (msec): min=6, max=983, avg=51.06, stdev=52.12 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 113], 95.00th=[ 150], | 99.00th=[ 236], 99.50th=[ 284], 99.90th=[ 372], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 118, per=26.13%, avg=31.36, stdev=21.66, samples=368 iops : min= 1, max= 29, avg= 7.17, stdev= 5.46, samples=368 write: IOPS=7, BW=31.6KiB/s (32.4kB/s)(6296KiB/199074msec); 0 zone resets clat (msec): min=15, max=717, avg=77.74, stdev=59.89 lat (msec): min=15, max=717, avg=77.75, stdev=59.89 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 89], 80.00th=[ 113], 90.00th=[ 153], 95.00th=[ 188], | 99.00th=[ 296], 99.50th=[ 317], 99.90th=[ 518], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 95, per=25.43%, avg=31.79, stdev=20.68, samples=382 iops : min= 1, max= 23, avg= 7.27, stdev= 5.19, samples=382 lat (msec) : 10=1.11%, 20=10.03%, 50=43.46%, 100=26.63%, 250=17.48% lat (msec) : 500=1.20%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.91%, ctx=5057, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180857: Thu Jun 11 20:30:06 2026 read: IOPS=7, BW=29.7KiB/s (30.5kB/s)(5940KiB/199722msec) clat (msec): min=6, max=918, avg=50.96, stdev=50.88 lat (msec): min=6, max=918, avg=50.97, stdev=50.88 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 74], 90.00th=[ 111], 95.00th=[ 146], | 99.00th=[ 215], 99.50th=[ 262], 99.90th=[ 451], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 125, per=26.33%, avg=31.59, stdev=21.70, samples=364 iops : min= 1, max= 31, avg= 7.22, stdev= 5.47, samples=364 write: IOPS=7, BW=31.8KiB/s (32.5kB/s)(6348KiB/199722msec); 0 zone resets clat (msec): min=12, max=475, avg=78.03, stdev=56.65 lat (msec): min=12, max=475, avg=78.04, stdev=56.65 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 72], | 70.00th=[ 90], 80.00th=[ 115], 90.00th=[ 157], 95.00th=[ 188], | 99.00th=[ 292], 99.50th=[ 317], 99.90th=[ 439], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 127, per=25.34%, avg=31.68, stdev=20.78, samples=388 iops : min= 1, max= 31, avg= 7.25, stdev= 5.22, samples=388 lat (msec) : 10=0.62%, 20=10.32%, 50=43.68%, 100=26.20%, 250=18.07% lat (msec) : 500=1.07%, 1000=0.03% cpu : usr=0.06%, sys=1.93%, ctx=4866, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180858: Thu Jun 11 20:30:06 2026 read: IOPS=7, BW=30.3KiB/s (31.1kB/s)(6028KiB/198793msec) clat (msec): min=7, max=390, avg=51.28, stdev=46.98 lat (msec): min=7, max=390, avg=51.29, stdev=46.98 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 73], 90.00th=[ 113], 95.00th=[ 150], | 99.00th=[ 232], 99.50th=[ 292], 99.90th=[ 372], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 119, per=25.86%, avg=31.04, stdev=21.96, samples=376 iops : min= 1, max= 29, avg= 7.08, stdev= 5.53, samples=376 write: IOPS=7, BW=31.5KiB/s (32.2kB/s)(6260KiB/198793msec); 0 zone resets clat (msec): min=12, max=876, avg=77.51, stdev=60.00 lat (msec): min=12, max=876, avg=77.52, stdev=60.01 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 89], 80.00th=[ 111], 90.00th=[ 153], 95.00th=[ 186], | 99.00th=[ 288], 99.50th=[ 317], 99.90th=[ 609], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 101, per=25.22%, avg=31.53, stdev=20.53, samples=384 iops : min= 1, max= 25, avg= 7.21, stdev= 5.16, samples=384 lat (msec) : 10=0.68%, 20=9.41%, 50=44.30%, 100=27.08%, 250=17.25% lat (msec) : 500=1.20%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=2.00%, ctx=5073, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180859: Thu Jun 11 20:30:06 2026 read: IOPS=7, BW=30.4KiB/s (31.2kB/s)(6052KiB/198820msec) clat (msec): min=6, max=339, avg=50.70, stdev=46.81 lat (msec): min=6, max=339, avg=50.71, stdev=46.82 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 74], 90.00th=[ 114], 95.00th=[ 150], | 99.00th=[ 243], 99.50th=[ 271], 99.90th=[ 305], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 111, per=26.67%, avg=32.01, stdev=21.56, samples=366 iops : min= 1, max= 27, avg= 7.33, stdev= 5.42, samples=366 write: IOPS=7, BW=31.4KiB/s (32.1kB/s)(6236KiB/198820msec); 0 zone resets clat (msec): min=12, max=881, avg=78.21, stdev=62.17 lat (msec): min=12, max=881, avg=78.21, stdev=62.17 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 71], | 70.00th=[ 90], 80.00th=[ 118], 90.00th=[ 153], 95.00th=[ 190], | 99.00th=[ 279], 99.50th=[ 372], 99.90th=[ 718], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 103, per=25.15%, avg=31.44, stdev=20.19, samples=383 iops : min= 1, max= 25, avg= 7.19, stdev= 5.09, samples=383 lat (msec) : 10=0.78%, 20=10.22%, 50=44.92%, 100=24.77%, 250=18.13% lat (msec) : 500=1.11%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.96%, ctx=4933, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=120KiB/s (123kB/s), 29.7KiB/s-30.4KiB/s (30.5kB/s-31.2kB/s), io=23.4MiB (24.6MB), run=198793-199722msec WRITE: bw=126KiB/s (129kB/s), 31.4KiB/s-31.8KiB/s (32.1kB/s-32.5kB/s), io=24.6MiB (25.7MB), run=198793-199722msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180903: Thu Jun 11 20:30:52 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(5920KiB/35880msec) clat (usec): min=34, max=404614, avg=50542.14, stdev=39670.40 lat (usec): min=34, max=404616, avg=50544.15, stdev=39670.25 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 67], 10.00th=[ 98], 20.00th=[ 22676], | 30.00th=[ 30278], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 54264], | 70.00th=[ 62129], 80.00th=[ 74974], 90.00th=[ 90702], 95.00th=[115868], | 99.00th=[183501], 99.50th=[206570], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 31, max= 382, per=25.92%, avg=167.20, stdev=67.90, samples=69 iops : min= 1, max= 23, avg= 9.64, stdev= 4.28, samples=69 write: IOPS=11, BW=177KiB/s (182kB/s)(6368KiB/35880msec); 0 zone resets clat (usec): min=1757, max=240112, avg=42890.42, stdev=44969.34 lat (usec): min=1760, max=240114, avg=42893.81, stdev=44969.20 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 3064], 10.00th=[ 4228], 20.00th=[ 7308], | 30.00th=[ 10814], 40.00th=[ 19006], 50.00th=[ 28443], 60.00th=[ 37487], | 70.00th=[ 51643], 80.00th=[ 67634], 90.00th=[107480], 95.00th=[135267], | 99.00th=[221250], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 351, per=26.27%, avg=178.11, stdev=78.06, samples=70 iops : min= 1, max= 21, avg=10.31, stdev= 4.91, samples=70 lat (usec) : 50=0.65%, 100=4.43%, 250=0.91%, 500=0.26% lat (msec) : 2=1.04%, 4=3.39%, 10=10.16%, 20=8.33%, 50=33.46% lat (msec) : 100=27.86%, 250=9.38%, 500=0.13% cpu : usr=0.06%, sys=5.15%, ctx=1660, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180904: Thu Jun 11 20:30:52 2026 read: IOPS=9, BW=155KiB/s (158kB/s)(5744KiB/37119msec) clat (usec): min=39, max=182078, avg=54004.40, stdev=35889.43 lat (usec): min=40, max=182079, avg=54005.66, stdev=35889.43 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 95], 20.00th=[ 25822], | 30.00th=[ 34866], 40.00th=[ 42730], 50.00th=[ 49021], 60.00th=[ 59507], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[106431], 95.00th=[119014], | 99.00th=[162530], 99.50th=[173016], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 56, max= 286, per=24.27%, avg=156.51, stdev=54.48, samples=72 iops : min= 3, max= 17, avg= 8.96, stdev= 3.45, samples=72 write: IOPS=11, BW=176KiB/s (181kB/s)(6544KiB/37119msec); 0 zone resets clat (usec): min=1230, max=241053, avg=42780.30, stdev=43722.63 lat (usec): min=1231, max=241054, avg=42782.63, stdev=43722.55 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2606], 10.00th=[ 4015], 20.00th=[ 6915], | 30.00th=[ 10945], 40.00th=[ 18220], 50.00th=[ 26870], 60.00th=[ 39584], | 70.00th=[ 56361], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[135267], | 99.00th=[198181], 99.50th=[202376], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 414, per=25.90%, avg=175.63, stdev=87.87, samples=73 iops : min= 1, max= 25, avg=10.16, stdev= 5.52, samples=73 lat (usec) : 50=0.39%, 100=4.43%, 250=0.52%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.30%, 4=4.17%, 10=9.77%, 20=8.33%, 50=29.95% lat (msec) : 100=29.95%, 250=10.94% cpu : usr=0.09%, sys=5.43%, ctx=1664, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180905: Thu Jun 11 20:30:52 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(6256KiB/37039msec) clat (usec): min=35, max=256393, avg=54688.34, stdev=38129.42 lat (usec): min=35, max=256394, avg=54690.15, stdev=38129.14 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 65], 10.00th=[ 103], 20.00th=[ 28181], | 30.00th=[ 35390], 40.00th=[ 42730], 50.00th=[ 49546], 60.00th=[ 56886], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[125305], | 99.00th=[181404], 99.50th=[223347], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 63, max= 287, per=26.19%, avg=168.92, stdev=59.26, samples=73 iops : min= 3, max= 17, avg= 9.75, stdev= 3.71, samples=73 write: IOPS=10, BW=163KiB/s (167kB/s)(6032KiB/37039msec); 0 zone resets clat (usec): min=1711, max=212333, avg=41162.88, stdev=40970.86 lat (usec): min=1713, max=212343, avg=41165.25, stdev=40970.97 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2442], 10.00th=[ 4359], 20.00th=[ 7308], | 30.00th=[ 10945], 40.00th=[ 17433], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 51119], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[127402], | 99.00th=[170918], 99.50th=[196084], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 378, per=23.74%, avg=160.95, stdev=79.89, samples=73 iops : min= 1, max= 23, avg= 9.25, stdev= 5.05, samples=73 lat (usec) : 50=0.78%, 100=4.30%, 250=0.52%, 500=0.13% lat (msec) : 2=1.56%, 4=2.73%, 10=9.90%, 20=8.07%, 50=31.64% lat (msec) : 100=30.21%, 250=10.03%, 500=0.13% cpu : usr=0.04%, sys=5.79%, ctx=1691, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180906: Thu Jun 11 20:30:52 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36376msec) clat (usec): min=45, max=263778, avg=53064.54, stdev=38288.88 lat (usec): min=47, max=263779, avg=53065.76, stdev=38288.90 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 64], 10.00th=[ 89], 20.00th=[ 23200], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 56886], | 70.00th=[ 65799], 80.00th=[ 78119], 90.00th=[ 99091], 95.00th=[113771], | 99.00th=[183501], 99.50th=[219153], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 318, per=25.49%, avg=164.39, stdev=66.28, samples=71 iops : min= 1, max= 19, avg= 9.46, stdev= 4.20, samples=71 write: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36376msec); 0 zone resets clat (usec): min=1573, max=243105, avg=41446.85, stdev=41791.47 lat (usec): min=1576, max=243107, avg=41456.90, stdev=41792.89 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2147], 10.00th=[ 3818], 20.00th=[ 6390], | 30.00th=[ 9765], 40.00th=[ 15795], 50.00th=[ 28705], 60.00th=[ 39584], | 70.00th=[ 55313], 80.00th=[ 72877], 90.00th=[104334], 95.00th=[124257], | 99.00th=[177210], 99.50th=[196084], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 62, max= 447, per=25.37%, avg=172.01, stdev=76.25, samples=71 iops : min= 3, max= 27, avg= 9.94, stdev= 4.82, samples=71 lat (usec) : 50=0.13%, 100=5.34%, 250=0.65%, 750=0.13% lat (msec) : 2=1.56%, 4=4.30%, 10=10.55%, 20=7.81%, 50=29.82% lat (msec) : 100=29.17%, 250=10.42%, 500=0.13% cpu : usr=0.07%, sys=5.40%, ctx=1635, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=645KiB/s (661kB/s), 155KiB/s-169KiB/s (158kB/s-173kB/s), io=23.4MiB (24.5MB), run=35880-37119msec WRITE: bw=679KiB/s (695kB/s), 163KiB/s-177KiB/s (167kB/s-182kB/s), io=24.6MiB (25.8MB), run=35880-37119msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180908: Thu Jun 11 20:31:09 2026 read: IOPS=6, BW=111KiB/s (114kB/s)(5920KiB/53230msec) clat (msec): min=9, max=312, avg=57.24, stdev=48.27 lat (msec): min=9, max=312, avg=57.25, stdev=48.27 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 77], 90.00th=[ 127], 95.00th=[ 165], | 99.00th=[ 249], 99.50th=[ 271], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 318, per=25.43%, avg=112.90, stdev=61.42, samples=103 iops : min= 1, max= 19, avg= 6.25, stdev= 3.88, samples=103 write: IOPS=7, BW=120KiB/s (123kB/s)(6368KiB/53230msec); 0 zone resets clat (msec): min=15, max=272, avg=79.77, stdev=46.44 lat (msec): min=15, max=272, avg=79.78, stdev=46.44 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 44], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 78], | 70.00th=[ 92], 80.00th=[ 110], 90.00th=[ 148], 95.00th=[ 176], | 99.00th=[ 251], 99.50th=[ 268], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 29, max= 319, per=25.80%, avg=120.47, stdev=65.93, samples=104 iops : min= 1, max= 19, avg= 6.72, stdev= 4.17, samples=104 lat (msec) : 10=0.13%, 20=4.95%, 50=41.54%, 100=33.46%, 250=19.01% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.86%, ctx=1217, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180909: Thu Jun 11 20:31:09 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(5744KiB/53892msec) clat (msec): min=7, max=323, avg=56.04, stdev=46.86 lat (msec): min=7, max=323, avg=56.04, stdev=46.86 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 75], 90.00th=[ 118], 95.00th=[ 161], | 99.00th=[ 226], 99.50th=[ 271], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 29, max= 350, per=24.95%, avg=110.79, stdev=70.15, samples=101 iops : min= 1, max= 21, avg= 6.11, stdev= 4.44, samples=101 write: IOPS=7, BW=121KiB/s (124kB/s)(6544KiB/53892msec); 0 zone resets clat (msec): min=11, max=381, avg=82.35, stdev=52.57 lat (msec): min=11, max=381, avg=82.36, stdev=52.57 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 34], 20.00th=[ 43], | 30.00th=[ 49], 40.00th=[ 56], 50.00th=[ 67], 60.00th=[ 79], | 70.00th=[ 97], 80.00th=[ 120], 90.00th=[ 155], 95.00th=[ 186], | 99.00th=[ 268], 99.50th=[ 275], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 411, per=25.98%, avg=121.32, stdev=72.05, samples=105 iops : min= 1, max= 25, avg= 6.78, stdev= 4.54, samples=105 lat (msec) : 10=0.65%, 20=5.08%, 50=40.36%, 100=32.29%, 250=20.70% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.82%, ctx=1220, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180910: Thu Jun 11 20:31:09 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(6256KiB/53289msec) clat (msec): min=9, max=322, avg=58.54, stdev=51.74 lat (msec): min=9, max=322, avg=58.54, stdev=51.74 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 81], 90.00th=[ 132], 95.00th=[ 174], | 99.00th=[ 266], 99.50th=[ 309], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 411, per=26.90%, avg=119.42, stdev=79.25, samples=103 iops : min= 1, max= 25, avg= 6.66, stdev= 5.01, samples=103 write: IOPS=7, BW=113KiB/s (116kB/s)(6032KiB/53289msec); 0 zone resets clat (msec): min=19, max=371, avg=80.28, stdev=52.66 lat (msec): min=19, max=371, avg=80.29, stdev=52.66 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 48], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 73], | 70.00th=[ 89], 80.00th=[ 113], 90.00th=[ 153], 95.00th=[ 184], | 99.00th=[ 284], 99.50th=[ 321], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 288, per=24.94%, avg=116.48, stdev=64.34, samples=101 iops : min= 1, max= 18, avg= 6.47, stdev= 4.09, samples=101 lat (msec) : 10=0.39%, 20=5.86%, 50=41.80%, 100=31.64%, 250=18.62% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.99%, ctx=1287, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180911: Thu Jun 11 20:31:09 2026 read: IOPS=7, BW=112KiB/s (115kB/s)(6032KiB/53783msec) clat (msec): min=8, max=314, avg=61.51, stdev=53.62 lat (msec): min=8, max=314, avg=61.52, stdev=53.62 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 92], 90.00th=[ 133], 95.00th=[ 169], | 99.00th=[ 271], 99.50th=[ 313], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 379, per=26.22%, avg=116.42, stdev=70.15, samples=101 iops : min= 1, max= 23, avg= 6.48, stdev= 4.41, samples=101 write: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/53783msec); 0 zone resets clat (msec): min=16, max=273, avg=77.70, stdev=45.40 lat (msec): min=16, max=273, avg=77.70, stdev=45.40 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 48], 40.00th=[ 55], 50.00th=[ 64], 60.00th=[ 74], | 70.00th=[ 93], 80.00th=[ 112], 90.00th=[ 142], 95.00th=[ 171], | 99.00th=[ 218], 99.50th=[ 239], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 347, per=25.26%, avg=117.97, stdev=71.02, samples=104 iops : min= 1, max= 21, avg= 6.57, stdev= 4.50, samples=104 lat (msec) : 10=0.13%, 20=6.25%, 50=40.36%, 100=30.47%, 250=21.88% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.77%, ctx=1210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=444KiB/s (455kB/s), 107KiB/s-117KiB/s (109kB/s-120kB/s), io=23.4MiB (24.5MB), run=53230-53892msec WRITE: bw=468KiB/s (479kB/s), 113KiB/s-121KiB/s (116kB/s-124kB/s), io=24.6MiB (25.8MB), run=53230-53892msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180926: Thu Jun 11 20:31:30 2026 read: IOPS=1, BW=1333KiB/s (1365kB/s)(7168KiB/5377msec) clat (msec): min=190, max=827, avg=351.49, stdev=229.27 lat (msec): min=190, max=827, avg=351.49, stdev=229.27 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 209], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 259], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 464], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1771, max= 4096, per=62.77%, avg=2390.40, stdev=959.98, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=952KiB/s (975kB/s)(5120KiB/5377msec); 0 zone resets clat (msec): min=190, max=1425, avg=550.42, stdev=504.73 lat (msec): min=190, max=1425, avg=550.53, stdev=504.73 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1984, max= 2048, per=37.95%, avg=2023.50, stdev=27.53, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=10.55%, ctx=238, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180927: Thu Jun 11 20:31:30 2026 read: IOPS=0, BW=382KiB/s (391kB/s)(2048KiB/5364msec) clat (msec): min=236, max=299, avg=267.77, stdev=44.59 lat (msec): min=236, max=299, avg=267.77, stdev=44.59 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1698, max= 1984, per=48.35%, avg=1841.00, stdev=202.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1909KiB/s (1955kB/s)(10.0MiB/5364msec); 0 zone resets clat (msec): min=126, max=774, avg=452.35, stdev=226.03 lat (msec): min=126, max=774, avg=452.45, stdev=226.03 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 247], | 30.00th=[ 253], 40.00th=[ 284], 50.00th=[ 393], 60.00th=[ 518], | 70.00th=[ 550], 80.00th=[ 625], 90.00th=[ 760], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1984, max= 4071, per=48.64%, avg=2593.57, stdev=998.58, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=13.26%, ctx=186, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180928: Thu Jun 11 20:31:30 2026 read: IOPS=1, BW=1628KiB/s (1667kB/s)(6144KiB/3774msec) clat (usec): min=1523, max=389952, avg=193627.00, stdev=164551.87 lat (usec): min=1524, max=389953, avg=193628.41, stdev=164551.95 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1516], 10.00th=[ 1516], 20.00th=[ 3195], | 30.00th=[ 3195], 40.00th=[200279], 50.00th=[200279], 60.00th=[223347], | 70.00th=[346031], 80.00th=[346031], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 1984, max= 4031, per=65.87%, avg=2508.50, stdev=1015.28, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1628KiB/s (1667kB/s)(6144KiB/3774msec); 0 zone resets clat (msec): min=85, max=832, avg=424.85, stdev=283.57 lat (msec): min=85, max=832, avg=424.93, stdev=283.58 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 468], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2019, max= 3968, per=53.83%, avg=2870.25, stdev=995.65, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=25.00%, 500=33.33% lat (msec) : 750=8.33%, 1000=8.33% cpu : usr=0.05%, sys=14.68%, ctx=135, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180929: Thu Jun 11 20:31:30 2026 read: IOPS=1, BW=1131KiB/s (1158kB/s)(5120KiB/4526msec) clat (usec): min=1364, max=271787, avg=120648.94, stdev=123007.27 lat (usec): min=1365, max=271789, avg=120650.18, stdev=123007.49 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1369], 10.00th=[ 1369], 20.00th=[ 1369], | 30.00th=[ 2114], 40.00th=[ 2114], 50.00th=[110625], 60.00th=[110625], | 70.00th=[217056], 80.00th=[217056], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1584KiB/s (1622kB/s)(7168KiB/4526msec); 0 zone resets clat (msec): min=233, max=1271, avg=541.78, stdev=419.54 lat (msec): min=233, max=1271, avg=541.90, stdev=419.52 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 266], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 330], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 1011], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1448, max= 4063, per=53.47%, avg=2851.00, stdev=1315.42, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=41.67%, 2000=16.67% cpu : usr=0.00%, sys=11.45%, ctx=236, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3809KiB/s (3900kB/s), 382KiB/s-1628KiB/s (391kB/s-1667kB/s), io=20.0MiB (20.0MB), run=3774-5377msec WRITE: bw=5332KiB/s (5460kB/s), 952KiB/s-1909KiB/s (975kB/s-1955kB/s), io=28.0MiB (29.4MB), run=3774-5377msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180931: Thu Jun 11 20:31:31 2026 read: IOPS=1, BW=1538KiB/s (1574kB/s)(7168KiB/4662msec) clat (msec): min=115, max=1213, avg=359.22, stdev=394.41 lat (msec): min=115, max=1213, avg=359.22, stdev=394.41 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 161], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 188], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 472], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1851, max= 2031, per=49.79%, avg=1953.80, stdev=78.72, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1098KiB/s (1125kB/s)(5120KiB/4662msec); 0 zone resets clat (msec): min=133, max=708, avg=371.67, stdev=251.70 lat (msec): min=133, max=708, avg=371.79, stdev=251.73 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2023, max= 4079, per=55.53%, avg=3051.00, stdev=1453.81, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.38%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180932: Thu Jun 11 20:31:31 2026 read: IOPS=0, BW=420KiB/s (430kB/s)(2048KiB/4876msec) clat (msec): min=199, max=1235, avg=717.81, stdev=732.70 lat (msec): min=199, max=1235, avg=717.82, stdev=732.70 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1851, max= 2039, per=49.57%, avg=1945.00, stdev=132.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2100KiB/s (2150kB/s)(10.0MiB/4876msec); 0 zone resets clat (msec): min=119, max=605, avg=319.46, stdev=177.17 lat (msec): min=119, max=606, avg=320.20, stdev=177.40 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 167], | 30.00th=[ 197], 40.00th=[ 205], 50.00th=[ 234], 60.00th=[ 236], | 70.00th=[ 372], 80.00th=[ 489], 90.00th=[ 567], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1980, max= 6095, per=59.00%, avg=3241.60, stdev=1829.30, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=4.35%, ctx=80, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180933: Thu Jun 11 20:31:31 2026 read: IOPS=1, BW=1233KiB/s (1263kB/s)(6144KiB/4983msec) clat (msec): min=111, max=567, avg=254.27, stdev=201.73 lat (msec): min=111, max=567, avg=254.27, stdev=201.73 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1980, max= 2039, per=51.48%, avg=2020.25, stdev=27.10, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1233KiB/s (1263kB/s)(6144KiB/4983msec); 0 zone resets clat (msec): min=163, max=1217, avg=523.58, stdev=400.25 lat (msec): min=163, max=1217, avg=523.69, stdev=400.23 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 355], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1851, max= 3961, per=44.70%, avg=2455.75, stdev=1006.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=5.26%, ctx=100, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180934: Thu Jun 11 20:31:31 2026 read: IOPS=0, BW=981KiB/s (1005kB/s)(5120KiB/5218msec) clat (msec): min=88, max=365, avg=238.04, stdev=110.41 lat (msec): min=88, max=365, avg=238.04, stdev=110.41 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2039, max= 3961, per=68.29%, avg=2679.67, stdev=1109.67, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1374KiB/s (1407kB/s)(7168KiB/5218msec); 0 zone resets clat (msec): min=114, max=1420, avg=538.89, stdev=467.23 lat (msec): min=114, max=1420, avg=539.02, stdev=467.27 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 157], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 477], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 726], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1980, max= 6119, per=51.63%, avg=2836.80, stdev=1834.93, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.79%, ctx=106, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3925KiB/s (4019kB/s), 420KiB/s-1538KiB/s (430kB/s-1574kB/s), io=20.0MiB (20.0MB), run=4662-5218msec WRITE: bw=5495KiB/s (5627kB/s), 1098KiB/s-2100KiB/s (1125kB/s-2150kB/s), io=28.0MiB (29.4MB), run=4662-5218msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180943: Thu Jun 11 20:31:48 2026 read: IOPS=1, BW=4348KiB/s (4453kB/s)(12.0MiB/2826msec) clat (msec): min=176, max=1684, avg=922.16, stdev=754.01 lat (msec): min=176, max=1684, avg=922.16, stdev=754.01 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 6627, max= 8159, per=100.00%, avg=7393.00, stdev=1083.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.80%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180944: Thu Jun 11 20:31:48 2026 read: IOPS=0, BW=1099KiB/s (1125kB/s)(4096KiB/3727msec) clat (nsec): min=1202.4M, max=1202.4M, avg=1202449541.00, stdev= 0.00 lat (nsec): min=1202.5M, max=1202.5M, avg=1202452020.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1200], 5.00th=[ 1200], 10.00th=[ 1200], 20.00th=[ 1200], | 30.00th=[ 1200], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2198KiB/s (2251kB/s)(8192KiB/3727msec); 0 zone resets clat (msec): min=561, max=1793, avg=1177.40, stdev=870.69 lat (msec): min=562, max=1796, avg=1179.44, stdev=873.03 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8159, max= 8159, per=95.42%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.95%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180945: Thu Jun 11 20:31:48 2026 write: IOPS=0, BW=3207KiB/s (3284kB/s)(12.0MiB/3832msec); 0 zone resets clat (msec): min=448, max=1762, avg=1218.93, stdev=685.69 lat (msec): min=448, max=1762, avg=1219.32, stdev=685.69 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7772, max= 8159, per=93.15%, avg=7965.50, stdev=273.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.65%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180946: Thu Jun 11 20:31:48 2026 write: IOPS=1, BW=5473KiB/s (5605kB/s)(12.0MiB/2245msec); 0 zone resets clat (msec): min=219, max=1095, avg=724.89, stdev=453.18 lat (msec): min=219, max=1095, avg=725.20, stdev=453.12 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 6095, max= 7816, per=81.34%, avg=6955.50, stdev=1216.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.81%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4396KiB/s (4502kB/s), 1099KiB/s-4348KiB/s (1125kB/s-4453kB/s), io=16.0MiB (16.8MB), run=2826-3727msec WRITE: bw=8551KiB/s (8756kB/s), 2198KiB/s-5473KiB/s (2251kB/s-5605kB/s), io=32.0MiB (33.6MB), run=2245-3832msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180947: Thu Jun 11 20:31:48 2026 read: IOPS=1, BW=4640KiB/s (4752kB/s)(12.0MiB/2648msec) clat (msec): min=615, max=900, avg=790.30, stdev=152.81 lat (msec): min=615, max=900, avg=790.30, stdev=152.81 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.01%, ctx=270, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180948: Thu Jun 11 20:31:48 2026 read: IOPS=0, BW=1485KiB/s (1521kB/s)(4096KiB/2758msec) clat (nsec): min=761818k, max=761818k, avg=761818233.00, stdev= 0.00 lat (nsec): min=761820k, max=761820k, avg=761820439.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2970KiB/s (3042kB/s)(8192KiB/2758msec); 0 zone resets clat (msec): min=660, max=1151, avg=905.84, stdev=347.50 lat (msec): min=660, max=1151, avg=906.27, stdev=347.51 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7937, max= 7937, per=92.22%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=5.11%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180949: Thu Jun 11 20:31:48 2026 write: IOPS=0, BW=3228KiB/s (3305kB/s)(12.0MiB/3807msec); 0 zone resets clat (msec): min=909, max=1415, avg=1204.69, stdev=262.90 lat (msec): min=914, max=1415, avg=1206.54, stdev=260.46 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8143, max= 8175, per=94.79%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.68%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180950: Thu Jun 11 20:31:48 2026 write: IOPS=1, BW=4539KiB/s (4648kB/s)(12.0MiB/2707msec); 0 zone resets clat (msec): min=589, max=1093, avg=837.83, stdev=252.10 lat (msec): min=589, max=1095, avg=839.03, stdev=253.16 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7922, max= 8159, per=93.42%, avg=8040.50, stdev=167.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.28%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5941KiB/s (6083kB/s), 1485KiB/s-4640KiB/s (1521kB/s-4752kB/s), io=16.0MiB (16.8MB), run=2648-2758msec WRITE: bw=8607KiB/s (8814kB/s), 2970KiB/s-4539KiB/s (3042kB/s-4648kB/s), io=32.0MiB (33.6MB), run=2707-3807msec