== sanity test 398b: DIO and buffer IO race ============== 19:27:52 (1788564472) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.5579 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144862: Fri Sep 4 19:30:02 2026 read: IOPS=13, BW=53.3KiB/s (54.5kB/s)(5992KiB/112488msec) clat (usec): min=29, max=237381, avg=35845.55, stdev=28716.58 lat (usec): min=29, max=237382, avg=35847.78, stdev=28715.61 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 75], 20.00th=[ 14746], | 30.00th=[ 19792], 40.00th=[ 25035], 50.00th=[ 30278], 60.00th=[ 35914], | 70.00th=[ 44827], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[131597], 99.50th=[162530], 99.90th=[231736], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 119, per=25.29%, avg=53.11, stdev=20.94, samples=221 iops : min= 1, max= 29, avg=12.66, stdev= 5.29, samples=221 write: IOPS=13, BW=55.0KiB/s (57.3kB/s)(6296KiB/112488msec); 0 zone resets clat (usec): min=936, max=264063, avg=37276.06, stdev=38986.19 lat (usec): min=936, max=264064, avg=37288.48, stdev=38991.28 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1680], 20.00th=[ 3621], | 30.00th=[ 6718], 40.00th=[ 14484], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[168821], 99.50th=[196084], 99.90th=[254804], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 135, per=25.26%, avg=55.58, stdev=21.99, samples=222 iops : min= 1, max= 33, avg=13.28, stdev= 5.50, samples=222 lat (usec) : 50=1.27%, 100=4.07%, 250=0.33%, 500=0.29%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=6.09%, 4=5.05%, 10=7.55%, 20=12.37%, 50=34.99% lat (msec) : 100=22.82%, 250=4.82%, 500=0.07% cpu : usr=0.06%, sys=5.76%, ctx=6282, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144863: Fri Sep 4 19:30:02 2026 read: IOPS=13, BW=52.4KiB/s (53.7kB/s)(5940KiB/113346msec) clat (usec): min=31, max=409305, avg=36383.18, stdev=31613.19 lat (usec): min=31, max=409306, avg=36384.64, stdev=31613.15 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 83], 20.00th=[ 15401], | 30.00th=[ 20317], 40.00th=[ 25560], 50.00th=[ 30802], 60.00th=[ 36963], | 70.00th=[ 44827], 80.00th=[ 54789], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[137364], 99.50th=[173016], 99.90th=[396362], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 119, per=24.95%, avg=52.39, stdev=22.52, samples=222 iops : min= 1, max= 29, avg=12.49, stdev= 5.67, samples=222 write: IOPS=14, BW=56.0KiB/s (57.3kB/s)(6348KiB/113346msec); 0 zone resets clat (usec): min=964, max=281948, avg=37290.82, stdev=37681.12 lat (usec): min=965, max=281949, avg=37292.81, stdev=37680.87 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1582], 20.00th=[ 4015], | 30.00th=[ 8586], 40.00th=[ 18220], 50.00th=[ 27395], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 64226], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[160433], 99.50th=[196084], 99.90th=[278922], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 119, per=25.33%, avg=55.73, stdev=22.02, samples=223 iops : min= 1, max= 29, avg=13.32, stdev= 5.52, samples=223 lat (usec) : 50=1.27%, 100=3.87%, 250=0.75%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.22%, 4=4.04%, 10=6.67%, 20=12.53%, 50=37.66% lat (msec) : 100=22.04%, 250=4.52%, 500=0.16% cpu : usr=0.06%, sys=5.73%, ctx=6385, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144864: Fri Sep 4 19:30:02 2026 read: IOPS=13, BW=52.8KiB/s (54.0kB/s)(6028KiB/114218msec) clat (usec): min=33, max=217253, avg=34795.35, stdev=27333.77 lat (usec): min=33, max=217254, avg=34803.88, stdev=27345.05 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 53], 10.00th=[ 64], 20.00th=[ 14484], | 30.00th=[ 19268], 40.00th=[ 23987], 50.00th=[ 29230], 60.00th=[ 35390], | 70.00th=[ 43254], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[117965], 99.50th=[132645], 99.90th=[200279], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 135, per=25.12%, avg=52.75, stdev=22.94, samples=224 iops : min= 1, max= 33, avg=12.57, stdev= 5.76, samples=224 write: IOPS=13, BW=54.8KiB/s (56.1kB/s)(6260KiB/114218msec); 0 zone resets clat (usec): min=880, max=492044, avg=39395.96, stdev=40689.18 lat (usec): min=880, max=492046, avg=39398.58, stdev=40688.04 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1663], 20.00th=[ 3949], | 30.00th=[ 8717], 40.00th=[ 19530], 50.00th=[ 30802], 60.00th=[ 39584], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[173016], 99.50th=[183501], 99.90th=[250610], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 7, max= 159, per=24.64%, avg=54.21, stdev=23.22, samples=226 iops : min= 1, max= 39, avg=12.93, stdev= 5.83, samples=226 lat (usec) : 50=1.46%, 100=4.33%, 250=0.59%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=6.15%, 4=4.30%, 10=6.28%, 20=12.76%, 50=36.49% lat (msec) : 100=21.94%, 250=5.27%, 500=0.07% cpu : usr=0.06%, sys=5.80%, ctx=6316, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144865: Fri Sep 4 19:30:02 2026 read: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6052KiB/113583msec) clat (usec): min=27, max=339460, avg=34834.49, stdev=28837.26 lat (usec): min=27, max=339461, avg=34836.65, stdev=28836.24 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 73], 20.00th=[ 14484], | 30.00th=[ 19530], 40.00th=[ 23987], 50.00th=[ 29230], 60.00th=[ 34866], | 70.00th=[ 43254], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[127402], 99.50th=[162530], 99.90th=[252707], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 127, per=25.42%, avg=53.39, stdev=22.60, samples=221 iops : min= 1, max= 31, avg=12.72, stdev= 5.71, samples=221 write: IOPS=13, BW=54.9KiB/s (56.2kB/s)(6236KiB/113583msec); 0 zone resets clat (usec): min=918, max=397153, avg=38964.12, stdev=39995.15 lat (usec): min=919, max=397157, avg=38966.82, stdev=39995.28 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1647], 20.00th=[ 3752], | 30.00th=[ 7570], 40.00th=[ 18220], 50.00th=[ 30016], 60.00th=[ 40109], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[156238], 99.50th=[189793], 99.90th=[354419], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 118, per=24.65%, avg=54.23, stdev=21.41, samples=224 iops : min= 1, max= 29, avg=12.94, stdev= 5.40, samples=224 lat (usec) : 50=1.60%, 100=4.17%, 250=0.59%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.12%, 4=4.69%, 10=6.67%, 20=12.57%, 50=35.61% lat (msec) : 100=22.62%, 250=4.95%, 500=0.13% cpu : usr=0.07%, sys=5.82%, ctx=6304, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=210KiB/s (215kB/s), 52.4KiB/s-53.3KiB/s (53.7kB/s-54.6kB/s), io=23.4MiB (24.6MB), run=112488-114218msec WRITE: bw=220KiB/s (225kB/s), 54.8KiB/s-56.0KiB/s (56.1kB/s-57.3kB/s), io=24.6MiB (25.7MB), run=112488-114218msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144856: Fri Sep 4 19:32:01 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(5992KiB/234413msec) clat (msec): min=4, max=858, avg=31.73, stdev=38.38 lat (msec): min=4, max=858, avg=31.74, stdev=38.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 157], 99.50th=[ 205], 99.90th=[ 342], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 96, per=27.24%, avg=27.79, stdev=19.08, samples=418 iops : min= 1, max= 24, avg= 6.36, stdev= 4.83, samples=418 write: IOPS=6, BW=26.9KiB/s (27.5kB/s)(6296KiB/234413msec); 0 zone resets clat (msec): min=34, max=477, avg=118.45, stdev=57.26 lat (msec): min=34, max=477, avg=118.45, stdev=57.26 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 92], 50.00th=[ 103], 60.00th=[ 116], | 70.00th=[ 136], 80.00th=[ 159], 90.00th=[ 199], 95.00th=[ 236], | 99.00th=[ 309], 99.50th=[ 334], 99.90th=[ 397], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 64, per=24.79%, avg=26.52, stdev=12.29, samples=459 iops : min= 1, max= 16, avg= 6.04, stdev= 3.19, samples=459 lat (msec) : 10=6.80%, 20=17.81%, 50=17.25%, 100=29.00%, 250=27.31% lat (msec) : 500=1.79%, 1000=0.03% cpu : usr=0.03%, sys=1.23%, ctx=5251, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144857: Fri Sep 4 19:32:01 2026 read: IOPS=6, BW=25.4KiB/s (25.0kB/s)(5940KiB/233999msec) clat (msec): min=4, max=1108, avg=31.24, stdev=42.11 lat (msec): min=4, max=1108, avg=31.24, stdev=42.11 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 68], 95.00th=[ 94], | 99.00th=[ 159], 99.50th=[ 207], 99.90th=[ 305], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 96, per=28.20%, avg=28.76, stdev=18.29, samples=402 iops : min= 1, max= 24, avg= 6.61, stdev= 4.62, samples=402 write: IOPS=6, BW=27.1KiB/s (27.8kB/s)(6348KiB/233999msec); 0 zone resets clat (msec): min=29, max=476, avg=117.95, stdev=58.31 lat (msec): min=29, max=476, avg=117.95, stdev=58.31 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 90], 50.00th=[ 100], 60.00th=[ 114], | 70.00th=[ 133], 80.00th=[ 163], 90.00th=[ 203], 95.00th=[ 232], | 99.00th=[ 305], 99.50th=[ 338], 99.90th=[ 401], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 56, per=25.02%, avg=26.77, stdev=12.42, samples=460 iops : min= 1, max= 14, avg= 6.10, stdev= 3.20, samples=460 lat (msec) : 10=7.55%, 20=17.42%, 50=16.63%, 100=30.86%, 250=25.85% lat (msec) : 500=1.66%, 2000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5334, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144858: Fri Sep 4 19:32:01 2026 read: IOPS=6, BW=25.8KiB/s (26.4kB/s)(6028KiB/233645msec) clat (msec): min=4, max=408, avg=31.82, stdev=32.31 lat (msec): min=4, max=408, avg=31.83, stdev=32.31 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 70], 95.00th=[ 95], | 99.00th=[ 157], 99.50th=[ 201], 99.90th=[ 292], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 120, per=26.84%, avg=27.38, stdev=19.26, samples=427 iops : min= 1, max= 30, avg= 6.25, stdev= 4.87, samples=427 write: IOPS=6, BW=26.8KiB/s (27.4kB/s)(6260KiB/233645msec); 0 zone resets clat (msec): min=31, max=1118, avg=118.36, stdev=64.33 lat (msec): min=31, max=1118, avg=118.37, stdev=64.33 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 70], | 30.00th=[ 81], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 115], | 70.00th=[ 133], 80.00th=[ 159], 90.00th=[ 201], 95.00th=[ 243], | 99.00th=[ 309], 99.50th=[ 334], 99.90th=[ 481], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 64, per=24.91%, avg=26.65, stdev=12.81, samples=455 iops : min= 1, max= 16, avg= 6.07, stdev= 3.30, samples=455 lat (msec) : 10=5.99%, 20=17.90%, 50=18.20%, 100=29.95%, 250=25.75% lat (msec) : 500=2.18%, 2000=0.03% cpu : usr=0.04%, sys=1.23%, ctx=5257, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144859: Fri Sep 4 19:32:01 2026 read: IOPS=6, BW=26.2KiB/s (26.8kB/s)(6052KiB/231398msec) clat (msec): min=4, max=409, avg=31.03, stdev=35.06 lat (msec): min=4, max=409, avg=31.03, stdev=35.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 68], 95.00th=[ 95], | 99.00th=[ 180], 99.50th=[ 222], 99.90th=[ 384], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 120, per=27.77%, avg=28.33, stdev=19.61, samples=415 iops : min= 1, max= 30, avg= 6.49, stdev= 4.98, samples=415 write: IOPS=6, BW=26.9KiB/s (27.6kB/s)(6236KiB/231398msec); 0 zone resets clat (msec): min=31, max=1116, avg=118.03, stdev=63.35 lat (msec): min=31, max=1116, avg=118.04, stdev=63.35 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 102], 60.00th=[ 116], | 70.00th=[ 136], 80.00th=[ 159], 90.00th=[ 199], 95.00th=[ 234], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 460], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 56, per=24.89%, avg=26.64, stdev=12.67, samples=453 iops : min= 1, max= 14, avg= 6.06, stdev= 3.26, samples=453 lat (msec) : 10=7.00%, 20=18.88%, 50=17.15%, 100=29.26%, 250=25.88% lat (msec) : 500=1.79%, 2000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5437, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=102KiB/s (105kB/s), 25.4KiB/s-26.2KiB/s (25.0kB/s-26.8kB/s), io=23.4MiB (24.6MB), run=231398-234413msec WRITE: bw=107KiB/s (110kB/s), 26.8KiB/s-27.1KiB/s (27.4kB/s-27.8kB/s), io=24.6MiB (25.7MB), run=231398-234413msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144912: Fri Sep 4 19:32:28 2026 read: IOPS=19, BW=315KiB/s (322kB/s)(5920KiB/18805msec) clat (usec): min=32, max=230714, avg=25927.06, stdev=23252.64 lat (usec): min=32, max=230715, avg=25940.21, stdev=23272.74 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 70], 20.00th=[ 4113], | 30.00th=[ 16909], 40.00th=[ 20055], 50.00th=[ 23725], 60.00th=[ 27395], | 70.00th=[ 32637], 80.00th=[ 36963], 90.00th=[ 46400], 95.00th=[ 59507], | 99.00th=[110625], 99.50th=[162530], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 95, max= 603, per=24.91%, avg=314.41, stdev=111.00, samples=37 iops : min= 5, max= 37, avg=19.03, stdev= 7.03, samples=37 write: IOPS=21, BW=339KiB/s (347kB/s)(6368KiB/18805msec); 0 zone resets clat (usec): min=1335, max=139734, avg=23015.78, stdev=23691.51 lat (usec): min=1338, max=139735, avg=23017.83, stdev=23692.20 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1975], 10.00th=[ 2507], 20.00th=[ 4015], | 30.00th=[ 5866], 40.00th=[ 8225], 50.00th=[ 12649], 60.00th=[ 20841], | 70.00th=[ 29492], 80.00th=[ 42206], 90.00th=[ 58983], 95.00th=[ 71828], | 99.00th=[ 99091], 99.50th=[119014], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 126, max= 572, per=25.57%, avg=339.30, stdev=115.36, samples=37 iops : min= 7, max= 35, avg=20.59, stdev= 7.22, samples=37 lat (usec) : 50=0.91%, 100=6.25%, 250=1.69%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.60%, 4=7.81%, 10=13.80%, 20=16.28%, 50=39.06% lat (msec) : 100=10.03%, 250=1.04% cpu : usr=0.08%, sys=10.04%, ctx=1610, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144913: Fri Sep 4 19:32:28 2026 read: IOPS=19, BW=304KiB/s (311kB/s)(5744KiB/18891msec) clat (usec): min=36, max=233558, avg=26301.29, stdev=21570.09 lat (usec): min=36, max=233559, avg=26302.79, stdev=21569.43 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 86], 20.00th=[ 12649], | 30.00th=[ 17171], 40.00th=[ 22152], 50.00th=[ 25297], 60.00th=[ 28443], | 70.00th=[ 33162], 80.00th=[ 39584], 90.00th=[ 46924], 95.00th=[ 53740], | 99.00th=[ 76022], 99.50th=[173016], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 112, max= 476, per=24.04%, avg=303.32, stdev=84.77, samples=37 iops : min= 7, max= 29, avg=18.35, stdev= 5.33, samples=37 write: IOPS=21, BW=346KiB/s (355kB/s)(6544KiB/18891msec); 0 zone resets clat (usec): min=1574, max=254880, avg=22746.87, stdev=24780.50 lat (usec): min=1576, max=254882, avg=22754.90, stdev=24786.31 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2507], 10.00th=[ 3032], 20.00th=[ 4293], | 30.00th=[ 6390], 40.00th=[ 8356], 50.00th=[ 13960], 60.00th=[ 20055], | 70.00th=[ 29492], 80.00th=[ 38536], 90.00th=[ 54264], 95.00th=[ 64226], | 99.00th=[ 92799], 99.50th=[108528], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 187, max= 637, per=26.06%, avg=345.76, stdev=104.21, samples=37 iops : min= 11, max= 39, avg=21.00, stdev= 6.51, samples=37 lat (usec) : 50=0.65%, 100=5.34%, 250=1.95%, 500=0.26% lat (msec) : 2=1.56%, 4=8.20%, 10=13.41%, 20=16.54%, 50=41.93% lat (msec) : 100=9.38%, 250=0.65%, 500=0.13% cpu : usr=0.12%, sys=10.69%, ctx=1602, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144914: Fri Sep 4 19:32:28 2026 read: IOPS=21, BW=346KiB/s (355kB/s)(6256KiB/18070msec) clat (usec): min=40, max=183780, avg=25750.11, stdev=21322.72 lat (usec): min=40, max=183781, avg=25751.09, stdev=21322.70 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 74], 20.00th=[ 955], | 30.00th=[ 15795], 40.00th=[ 20317], 50.00th=[ 23987], 60.00th=[ 27657], | 70.00th=[ 33424], 80.00th=[ 40109], 90.00th=[ 48497], 95.00th=[ 57934], | 99.00th=[ 87557], 99.50th=[164627], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 127, max= 605, per=27.59%, avg=348.14, stdev=100.99, samples=35 iops : min= 7, max= 37, avg=21.17, stdev= 6.32, samples=35 write: IOPS=20, BW=334KiB/s (342kB/s)(6032KiB/18070msec); 0 zone resets clat (usec): min=1398, max=311538, avg=20863.23, stdev=28278.38 lat (usec): min=1399, max=311538, avg=20865.44, stdev=28278.19 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1975], 10.00th=[ 2409], 20.00th=[ 3294], | 30.00th=[ 4555], 40.00th=[ 5866], 50.00th=[ 9765], 60.00th=[ 17433], | 70.00th=[ 24773], 80.00th=[ 35390], 90.00th=[ 53216], 95.00th=[ 64750], | 99.00th=[105382], 99.50th=[233833], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 63, max= 666, per=24.84%, avg=329.63, stdev=116.85, samples=35 iops : min= 3, max= 41, avg=20.00, stdev= 7.40, samples=35 lat (usec) : 50=1.17%, 100=6.38%, 250=2.34%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.60%, 4=10.29%, 10=12.11%, 20=16.02%, 50=38.67% lat (msec) : 100=9.11%, 250=0.78%, 500=0.13% cpu : usr=0.10%, sys=10.43%, ctx=1592, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144915: Fri Sep 4 19:32:28 2026 read: IOPS=19, BW=318KiB/s (325kB/s)(6032KiB/18979msec) clat (usec): min=35, max=231516, avg=26007.36, stdev=26483.52 lat (usec): min=35, max=231517, avg=26008.35, stdev=26483.53 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 128], | 30.00th=[ 15139], 40.00th=[ 19006], 50.00th=[ 22676], 60.00th=[ 27132], | 70.00th=[ 31589], 80.00th=[ 38011], 90.00th=[ 50594], 95.00th=[ 67634], | 99.00th=[168821], 99.50th=[196084], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 158, max= 508, per=24.84%, avg=313.46, stdev=97.40, samples=37 iops : min= 9, max= 31, avg=18.97, stdev= 6.23, samples=37 write: IOPS=20, BW=330KiB/s (338kB/s)(6256KiB/18979msec); 0 zone resets clat (usec): min=1372, max=136201, avg=23079.94, stdev=23435.00 lat (usec): min=1374, max=136202, avg=23085.04, stdev=23438.18 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2278], 10.00th=[ 2966], 20.00th=[ 4817], | 30.00th=[ 6718], 40.00th=[ 9372], 50.00th=[ 15664], 60.00th=[ 20579], | 70.00th=[ 28967], 80.00th=[ 37487], 90.00th=[ 56361], 95.00th=[ 69731], | 99.00th=[108528], 99.50th=[123208], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 126, max= 761, per=24.63%, avg=326.89, stdev=132.91, samples=37 iops : min= 7, max= 47, avg=19.81, stdev= 8.37, samples=37 lat (usec) : 50=0.65%, 100=8.33%, 250=1.56%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.56%, 4=7.03%, 10=13.28%, 20=16.80%, 50=38.28% lat (msec) : 100=10.16%, 250=1.43% cpu : usr=0.09%, sys=10.06%, ctx=1631, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1262KiB/s (1292kB/s), 304KiB/s-346KiB/s (311kB/s-355kB/s), io=23.4MiB (24.5MB), run=18070-18979msec WRITE: bw=1328KiB/s (1360kB/s), 330KiB/s-346KiB/s (338kB/s-355kB/s), io=24.6MiB (25.8MB), run=18070-18979msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144917: Fri Sep 4 19:32:57 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(5920KiB/47222msec) clat (msec): min=6, max=160, avg=25.47, stdev=22.29 lat (msec): min=6, max=160, avg=25.47, stdev=22.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 51], 95.00th=[ 77], | 99.00th=[ 125], 99.50th=[ 136], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 31, max= 352, per=25.31%, avg=126.81, stdev=76.00, samples=91 iops : min= 1, max= 22, avg= 7.31, stdev= 4.95, samples=91 write: IOPS=8, BW=135KiB/s (138kB/s)(6368KiB/47222msec); 0 zone resets clat (msec): min=40, max=329, avg=94.87, stdev=38.86 lat (msec): min=40, max=329, avg=94.88, stdev=38.86 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 55], 20.00th=[ 64], | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 88], 60.00th=[ 96], | 70.00th=[ 105], 80.00th=[ 121], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 257], 99.50th=[ 275], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 32, max= 255, per=25.47%, avg=134.23, stdev=47.55, samples=93 iops : min= 2, max= 15, avg= 7.78, stdev= 3.02, samples=93 lat (msec) : 10=4.04%, 20=24.35%, 50=17.32%, 100=35.03%, 250=18.75% lat (msec) : 500=0.52% cpu : usr=0.03%, sys=2.05%, ctx=1501, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Fri Sep 4 19:32:57 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(5744KiB/47793msec) clat (msec): min=6, max=185, avg=24.55, stdev=24.37 lat (msec): min=6, max=185, avg=24.55, stdev=24.37 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 77], | 99.00th=[ 128], 99.50th=[ 171], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 26, max= 352, per=25.64%, avg=128.47, stdev=73.97, samples=87 iops : min= 1, max= 22, avg= 7.44, stdev= 4.67, samples=87 write: IOPS=8, BW=137KiB/s (140kB/s)(6544KiB/47793msec); 0 zone resets clat (msec): min=34, max=338, avg=95.24, stdev=40.32 lat (msec): min=34, max=338, avg=95.24, stdev=40.32 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 55], 20.00th=[ 62], | 30.00th=[ 72], 40.00th=[ 79], 50.00th=[ 87], 60.00th=[ 93], | 70.00th=[ 104], 80.00th=[ 123], 90.00th=[ 148], 95.00th=[ 174], | 99.00th=[ 222], 99.50th=[ 255], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 224, per=25.70%, avg=135.44, stdev=47.75, samples=94 iops : min= 1, max= 14, avg= 7.86, stdev= 3.07, samples=94 lat (msec) : 10=7.29%, 20=22.14%, 50=16.15%, 100=36.59%, 250=17.45% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.94%, ctx=1374, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Fri Sep 4 19:32:57 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45407msec) clat (msec): min=7, max=166, avg=24.62, stdev=21.93 lat (msec): min=7, max=166, avg=24.62, stdev=21.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 49], 95.00th=[ 69], | 99.00th=[ 133], 99.50th=[ 163], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 31, max= 444, per=27.55%, avg=138.02, stdev=90.78, samples=90 iops : min= 1, max= 27, avg= 8.02, stdev= 5.70, samples=90 write: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45407msec); 0 zone resets clat (msec): min=35, max=283, avg=94.72, stdev=39.85 lat (msec): min=35, max=283, avg=94.72, stdev=39.86 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 64], | 30.00th=[ 72], 40.00th=[ 79], 50.00th=[ 85], 60.00th=[ 93], | 70.00th=[ 104], 80.00th=[ 120], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 239], 99.50th=[ 275], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 32, max= 224, per=25.46%, avg=134.16, stdev=47.92, samples=89 iops : min= 2, max= 14, avg= 7.76, stdev= 3.09, samples=89 lat (msec) : 10=6.64%, 20=22.92%, 50=19.66%, 100=34.11%, 250=16.28% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.94%, ctx=1434, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Fri Sep 4 19:32:57 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(6032KiB/46814msec) clat (msec): min=6, max=162, avg=25.01, stdev=22.69 lat (msec): min=6, max=162, avg=25.01, stdev=22.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 50], 95.00th=[ 72], | 99.00th=[ 136], 99.50th=[ 148], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 26, max= 352, per=26.66%, avg=133.56, stdev=77.40, samples=88 iops : min= 1, max= 22, avg= 7.73, stdev= 4.87, samples=88 write: IOPS=8, BW=134KiB/s (137kB/s)(6256KiB/46814msec); 0 zone resets clat (msec): min=44, max=330, avg=95.49, stdev=38.75 lat (msec): min=44, max=330, avg=95.49, stdev=38.75 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 53], 10.00th=[ 56], 20.00th=[ 64], | 30.00th=[ 71], 40.00th=[ 80], 50.00th=[ 88], 60.00th=[ 97], | 70.00th=[ 106], 80.00th=[ 122], 90.00th=[ 148], 95.00th=[ 176], | 99.00th=[ 215], 99.50th=[ 224], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 32, max= 224, per=25.26%, avg=133.12, stdev=47.78, samples=92 iops : min= 2, max= 14, avg= 7.71, stdev= 3.07, samples=92 lat (msec) : 10=4.56%, 20=23.96%, 50=17.71%, 100=34.38%, 250=19.27% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.93%, ctx=1407, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=501KiB/s (513kB/s), 120KiB/s-138KiB/s (123kB/s-141kB/s), io=23.4MiB (24.5MB), run=45407-47793msec WRITE: bw=527KiB/s (540kB/s), 133KiB/s-137KiB/s (136kB/s-140kB/s), io=24.6MiB (25.8MB), run=45407-47793msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144934: Fri Sep 4 19:33:14 2026 read: IOPS=0, BW=967KiB/s (990kB/s)(7168KiB/7415msec) clat (usec): min=563, max=3486.2k, avg=935952.23, stdev=1411637.16 lat (usec): min=564, max=3486.2k, avg=935953.74, stdev=1411636.96 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], | 20.00th=[ 627], 30.00th=[ 181404], 40.00th=[ 181404], | 50.00th=[ 202376], 60.00th=[ 274727], 70.00th=[ 274727], | 80.00th=[2399142], 90.00th=[3472884], 95.00th=[3472884], | 99.00th=[3472884], 99.50th=[3472884], 99.90th=[3472884], | 99.95th=[3472884], 99.99th=[3472884] bw ( KiB/s): min= 2003, max= 4015, per=100.00%, avg=2518.25, stdev=998.04, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=690KiB/s (707kB/s)(5120KiB/7415msec); 0 zone resets clat (msec): min=75, max=224, avg=142.72, stdev=58.97 lat (msec): min=75, max=224, avg=142.79, stdev=58.98 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 2007, max= 6023, per=100.00%, avg=4015.00, stdev=2839.74, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=16.67% lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, >=2000=16.67% cpu : usr=0.01%, sys=9.23%, ctx=1034, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144935: Fri Sep 4 19:33:14 2026 read: IOPS=0, BW=246KiB/s (252kB/s)(2048KiB/8314msec) clat (msec): min=181, max=236, avg=208.93, stdev=39.31 lat (msec): min=181, max=236, avg=208.93, stdev=39.31 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 1973, max= 2043, per=81.53%, avg=2008.00, stdev=49.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1232KiB/s (1261kB/s)(10.0MiB/8314msec); 0 zone resets clat (msec): min=86, max=2789, avg=776.53, stdev=1006.41 lat (msec): min=86, max=2791, avg=776.93, stdev=1006.68 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 155], | 30.00th=[ 178], 40.00th=[ 222], 50.00th=[ 300], 60.00th=[ 422], | 70.00th=[ 477], 80.00th=[ 617], 90.00th=[ 2534], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 2023, max= 6144, per=100.00%, avg=3599.20, stdev=1703.86, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=16.67% cpu : usr=0.04%, sys=7.54%, ctx=125, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144936: Fri Sep 4 19:33:14 2026 read: IOPS=0, BW=745KiB/s (763kB/s)(6144KiB/8242msec) clat (usec): min=883, max=343728, avg=183853.10, stdev=110318.89 lat (usec): min=884, max=343730, avg=183854.30, stdev=110318.96 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[168821], | 30.00th=[168821], 40.00th=[175113], 50.00th=[175113], 60.00th=[193987], | 70.00th=[221250], 80.00th=[221250], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 2023, max= 4087, per=100.00%, avg=3396.33, stdev=1189.35, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=745KiB/s (763kB/s)(6144KiB/8242msec); 0 zone resets clat (msec): min=100, max=3150, avg=1156.72, stdev=1346.65 lat (msec): min=100, max=3150, avg=1156.80, stdev=1346.63 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 401], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1861, max= 4096, per=69.78%, avg=2406.00, stdev=947.47, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=6.55%, ctx=199, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144938: Fri Sep 4 19:33:14 2026 read: IOPS=0, BW=709KiB/s (726kB/s)(5120KiB/7217msec) clat (usec): min=1152, max=323279, avg=141345.49, stdev=122358.13 lat (usec): min=1154, max=323280, avg=141346.53, stdev=122358.04 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1156], 10.00th=[ 1156], 20.00th=[ 1156], | 30.00th=[ 88605], 40.00th=[ 88605], 50.00th=[100140], 60.00th=[100140], | 70.00th=[193987], 80.00th=[193987], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 2039, max= 5585, per=100.00%, avg=3812.00, stdev=2507.40, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=993KiB/s (1017kB/s)(7168KiB/7217msec); 0 zone resets clat (msec): min=161, max=2931, avg=922.01, stdev=1176.87 lat (msec): min=161, max=2931, avg=922.24, stdev=1176.78 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 176], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 262], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 2299], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1861, max= 4063, per=80.33%, avg=2769.80, stdev=1159.96, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=7.82%, ctx=230, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2463KiB/s (2522kB/s), 246KiB/s-967KiB/s (252kB/s-990kB/s), io=20.0MiB (20.0MB), run=7217-8314msec WRITE: bw=3449KiB/s (3531kB/s), 690KiB/s-1232KiB/s (707kB/s-1261kB/s), io=28.0MiB (29.4MB), run=7217-8314msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144939: Fri Sep 4 19:33:15 2026 read: IOPS=0, BW=871KiB/s (892kB/s)(7168KiB/8226msec) clat (msec): min=65, max=2839, avg=971.55, stdev=1192.76 lat (msec): min=65, max=2839, avg=971.55, stdev=1192.76 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 83], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 92], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 2299], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2023, max= 4071, per=100.00%, avg=2441.40, stdev=911.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=622KiB/s (637kB/s)(5120KiB/8226msec); 0 zone resets clat (msec): min=122, max=240, avg=187.18, stdev=48.39 lat (msec): min=122, max=240, avg=187.25, stdev=48.41 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 4071, max= 4087, per=100.00%, avg=4079.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (msec) : 100=33.33%, 250=41.67%, 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=2.76%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144940: Fri Sep 4 19:33:15 2026 read: IOPS=0, BW=244KiB/s (250kB/s)(2048KiB/8397msec) clat (msec): min=101, max=118, avg=110.14, stdev=11.52 lat (msec): min=101, max=118, avg=110.14, stdev=11.52 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 118], | 70.00th=[ 118], 80.00th=[ 118], 90.00th=[ 118], 95.00th=[ 118], | 99.00th=[ 118], 99.50th=[ 118], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 1406, max= 2048, per=70.84%, avg=1727.00, stdev=453.96, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1219KiB/s (1249kB/s)(10.0MiB/8397msec); 0 zone resets clat (msec): min=118, max=3062, avg=792.93, stdev=1052.49 lat (msec): min=119, max=3062, avg=793.21, stdev=1052.39 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 138], | 30.00th=[ 186], 40.00th=[ 251], 50.00th=[ 300], 60.00th=[ 355], | 70.00th=[ 498], 80.00th=[ 592], 90.00th=[ 2433], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 2015, max= 4096, per=76.84%, avg=2623.29, stdev=1003.04, samples=7 iops : min= 1, max= 4, avg= 1.86, stdev= 1.21, samples=7 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=3.45%, ctx=183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Fri Sep 4 19:33:15 2026 read: IOPS=0, BW=787KiB/s (806kB/s)(6144KiB/7805msec) clat (msec): min=51, max=303, avg=174.10, stdev=107.00 lat (msec): min=51, max=303, avg=174.10, stdev=107.00 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 178], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2031, max= 4071, per=100.00%, avg=2548.25, stdev=1015.19, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=787KiB/s (806kB/s)(6144KiB/7805msec); 0 zone resets clat (msec): min=166, max=3120, avg=1111.83, stdev=1331.43 lat (msec): min=166, max=3120, avg=1111.91, stdev=1331.43 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 342], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 2043, max= 4063, per=80.30%, avg=2741.50, stdev=953.57, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.81%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144942: Fri Sep 4 19:33:15 2026 read: IOPS=0, BW=618KiB/s (633kB/s)(5120KiB/8281msec) clat (msec): min=45, max=668, avg=210.49, stdev=258.44 lat (msec): min=45, max=668, avg=210.49, stdev=258.44 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 104], 60.00th=[ 104], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2035, max= 4096, per=100.00%, avg=2724.67, stdev=1187.62, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=0, BW=866KiB/s (886kB/s)(7168KiB/8281msec); 0 zone resets clat (msec): min=158, max=2989, avg=1015.44, stdev=1258.40 lat (msec): min=158, max=2989, avg=1015.52, stdev=1258.40 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 255], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 321], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 2702], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1436, max= 6119, per=100.00%, avg=3419.25, stdev=2127.91, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=2.64%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2439KiB/s (2498kB/s), 244KiB/s-871KiB/s (250kB/s-892kB/s), io=20.0MiB (20.0MB), run=7805-8397msec WRITE: bw=3415KiB/s (3497kB/s), 622KiB/s-1219KiB/s (637kB/s-1249kB/s), io=28.0MiB (29.4MB), run=7805-8397msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144949: Fri Sep 4 19:33:26 2026 read: IOPS=2, BW=10.4MiB/s (10.9MB/s)(12.0MiB/1159msec) clat (msec): min=191, max=490, avg=378.19, stdev=162.46 lat (msec): min=191, max=490, avg=378.20, stdev=162.46 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 6330, max= 8143, per=100.00%, avg=7236.50, stdev=1281.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=10.54%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144950: Fri Sep 4 19:33:26 2026 read: IOPS=0, BW=1356KiB/s (1388kB/s)(4096KiB/3021msec) clat (nsec): min=777075k, max=777075k, avg=777074760.00, stdev= 0.00 lat (nsec): min=777077k, max=777077k, avg=777077280.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2712KiB/s (2777kB/s)(8192KiB/3021msec); 0 zone resets clat (msec): min=889, max=1334, avg=1111.53, stdev=314.66 lat (msec): min=889, max=1334, avg=1111.81, stdev=314.52 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8175, max= 8175, per=75.37%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.74%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Fri Sep 4 19:33:26 2026 write: IOPS=1, BW=4791KiB/s (4906kB/s)(12.0MiB/2565msec); 0 zone resets clat (msec): min=523, max=1095, avg=822.66, stdev=286.84 lat (msec): min=523, max=1095, avg=824.08, stdev=287.05 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8143, max= 8192, per=75.30%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.61%, ctx=76, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Fri Sep 4 19:33:26 2026 write: IOPS=1, BW=6341KiB/s (6493kB/s)(12.0MiB/1938msec); 0 zone resets clat (msec): min=399, max=918, avg=619.59, stdev=268.56 lat (msec): min=400, max=919, avg=619.90, stdev=268.56 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 5793, max= 8143, per=64.24%, avg=6968.00, stdev=1661.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=7.33%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5423KiB/s (5554kB/s), 1356KiB/s-10.4MiB/s (1388kB/s-10.9MB/s), io=16.0MiB (16.8MB), run=1159-3021msec WRITE: bw=10.6MiB/s (11.1MB/s), 2712KiB/s-6341KiB/s (2777kB/s-6493kB/s), io=32.0MiB (33.6MB), run=1938-3021msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144953: Fri Sep 4 19:33:26 2026 read: IOPS=1, BW=5513KiB/s (5645kB/s)(12.0MiB/2229msec) clat (msec): min=657, max=887, avg=734.46, stdev=132.53 lat (msec): min=657, max=887, avg=734.47, stdev=132.53 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=22.17%, ctx=377, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144954: Fri Sep 4 19:33:26 2026 read: IOPS=0, BW=1793KiB/s (1836kB/s)(4096KiB/2284msec) clat (nsec): min=435854k, max=435854k, avg=435854001.00, stdev= 0.00 lat (nsec): min=435856k, max=435856k, avg=435856260.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3587KiB/s (3673kB/s)(8192KiB/2284msec); 0 zone resets clat (msec): min=796, max=970, avg=883.50, stdev=123.24 lat (msec): min=796, max=970, avg=883.81, stdev=123.20 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8192, max= 8192, per=73.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=7.93%, ctx=133, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144955: Fri Sep 4 19:33:26 2026 write: IOPS=1, BW=4175KiB/s (4276kB/s)(12.0MiB/2943msec); 0 zone resets clat (msec): min=261, max=1361, avg=946.74, stdev=597.60 lat (msec): min=262, max=1362, avg=947.30, stdev=597.79 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8192, max= 8192, per=73.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.70%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Fri Sep 4 19:33:26 2026 write: IOPS=1, BW=6327KiB/s (6479kB/s)(12.0MiB/1942msec); 0 zone resets clat (msec): min=284, max=813, avg=610.27, stdev=284.64 lat (msec): min=285, max=813, avg=610.57, stdev=284.59 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8031, max= 8031, per=72.13%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=10.05%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7173KiB/s (7346kB/s), 1793KiB/s-5513KiB/s (1836kB/s-5645kB/s), io=16.0MiB (16.8MB), run=2229-2284msec WRITE: bw=10.9MiB/s (11.4MB/s), 3587KiB/s-6327KiB/s (3673kB/s-6479kB/s), io=32.0MiB (33.6MB), run=1942-2943msec