== sanity test 398b: DIO and buffer IO race ============== 17:07:01 (1788469621) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.00652 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180201: Thu Sep 3 17:09:38 2026 read: IOPS=11, BW=45.6KiB/s (46.7kB/s)(5992KiB/131394msec) clat (usec): min=20, max=1265.8k, avg=46824.74, stdev=45264.73 lat (usec): min=20, max=1265.8k, avg=46826.59, stdev=45264.99 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8848], 10.00th=[ 15795], | 20.00th=[ 22152], 30.00th=[ 27395], 40.00th=[ 32900], | 50.00th=[ 39060], 60.00th=[ 46924], 70.00th=[ 55313], | 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[ 100140], | 99.00th=[ 168821], 99.50th=[ 198181], 99.90th=[ 367002], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 7, max= 118, per=25.80%, avg=45.67, stdev=21.15, samples=256 iops : min= 1, max= 29, avg=10.80, stdev= 5.34, samples=256 write: IOPS=11, BW=47.9KiB/s (49.1kB/s)(6296KiB/131394msec); 0 zone resets clat (usec): min=696, max=442026, avg=38467.21, stdev=43897.32 lat (usec): min=698, max=442028, avg=38476.37, stdev=43891.88 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1352], 20.00th=[ 3326], | 30.00th=[ 6980], 40.00th=[ 16188], 50.00th=[ 26608], 60.00th=[ 35390], | 70.00th=[ 47973], 80.00th=[ 66847], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[204473], 99.50th=[231736], 99.90th=[325059], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 151, per=26.10%, avg=48.29, stdev=23.79, samples=254 iops : min= 1, max= 37, avg=11.46, stdev= 6.00, samples=254 lat (usec) : 50=0.23%, 100=1.82%, 250=0.13%, 750=0.10%, 1000=0.20% lat (msec) : 2=7.19%, 4=4.17%, 10=6.84%, 20=9.28%, 50=37.79% lat (msec) : 100=25.52%, 250=6.48%, 500=0.23%, 2000=0.03% cpu : usr=0.07%, sys=4.66%, ctx=6130, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180202: Thu Sep 3 17:09:38 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(5940KiB/135466msec) clat (usec): min=38, max=789076, avg=50488.37, stdev=41943.88 lat (usec): min=39, max=789079, avg=50491.64, stdev=41942.81 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11207], 10.00th=[ 17433], 20.00th=[ 23725], | 30.00th=[ 29230], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 50070], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[114820], | 99.00th=[187696], 99.50th=[244319], 99.90th=[429917], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 125, per=24.85%, avg=43.98, stdev=19.19, samples=263 iops : min= 1, max= 31, avg=10.37, stdev= 4.86, samples=263 write: IOPS=11, BW=46.9KiB/s (47.0kB/s)(6348KiB/135466msec); 0 zone resets clat (usec): min=980, max=560481, avg=37702.59, stdev=43144.08 lat (usec): min=981, max=560482, avg=37705.44, stdev=43144.15 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 2933], | 30.00th=[ 7111], 40.00th=[ 15533], 50.00th=[ 25822], 60.00th=[ 35914], | 70.00th=[ 48497], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[185598], 99.50th=[208667], 99.90th=[341836], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 136, per=25.38%, avg=46.95, stdev=21.77, samples=263 iops : min= 1, max= 34, avg=11.11, stdev= 5.52, samples=263 lat (usec) : 50=0.20%, 100=1.69%, 250=0.03%, 1000=0.10% lat (msec) : 2=8.04%, 4=3.68%, 10=5.96%, 20=9.51%, 50=36.62% lat (msec) : 100=26.37%, 250=7.45%, 500=0.29%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.74%, ctx=6228, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180203: Thu Sep 3 17:09:38 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6028KiB/135470msec) clat (usec): min=36, max=394659, avg=48488.79, stdev=36660.76 lat (usec): min=37, max=394659, avg=48490.46, stdev=36660.63 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 125], 10.00th=[ 15533], 20.00th=[ 21890], | 30.00th=[ 28181], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[173016], 99.50th=[202376], 99.90th=[371196], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 104, per=25.27%, avg=44.73, stdev=20.57, samples=263 iops : min= 1, max= 26, avg=10.55, stdev= 5.19, samples=263 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6260KiB/135470msec); 0 zone resets clat (usec): min=766, max=1042.1k, avg=39617.99, stdev=50864.58 lat (usec): min=767, max=1042.1k, avg=39621.83, stdev=50863.32 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1270], | 20.00th=[ 3392], 30.00th=[ 7701], 40.00th=[ 16909], | 50.00th=[ 25560], 60.00th=[ 36963], 70.00th=[ 50070], | 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[ 123208], | 99.00th=[ 187696], 99.50th=[ 210764], 99.90th=[ 566232], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 7, max= 112, per=25.01%, avg=46.26, stdev=23.27, samples=264 iops : min= 1, max= 28, avg=10.94, stdev= 5.87, samples=264 lat (usec) : 50=0.39%, 100=1.95%, 250=0.20%, 500=0.07%, 1000=0.39% lat (msec) : 2=7.75%, 4=2.96%, 10=6.12%, 20=10.58%, 50=35.90% lat (msec) : 100=25.49%, 250=7.91%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.49%, ctx=5914, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180204: Thu Sep 3 17:09:38 2026 read: IOPS=11, BW=44.9KiB/s (45.9kB/s)(6052KiB/134905msec) clat (usec): min=34, max=269618, avg=48697.22, stdev=34035.03 lat (usec): min=35, max=269619, avg=48699.32, stdev=34034.65 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 130], 10.00th=[ 15926], 20.00th=[ 22414], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 41157], 60.00th=[ 49546], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[154141], 99.50th=[189793], 99.90th=[261096], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 120, per=25.48%, avg=45.10, stdev=21.41, samples=262 iops : min= 1, max= 30, avg=10.64, stdev= 5.39, samples=262 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6236KiB/134905msec); 0 zone resets clat (usec): min=608, max=738606, avg=38829.21, stdev=49810.93 lat (usec): min=609, max=738609, avg=38833.07, stdev=49810.36 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3032], | 30.00th=[ 6718], 40.00th=[ 15139], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 44827], 80.00th=[ 64226], 90.00th=[ 94897], 95.00th=[127402], | 99.00th=[206570], 99.50th=[258999], 99.90th=[534774], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 136, per=25.01%, avg=46.27, stdev=21.46, samples=263 iops : min= 1, max= 34, avg=10.95, stdev= 5.42, samples=263 lat (usec) : 50=0.49%, 100=1.86%, 250=0.20%, 750=0.03%, 1000=0.46% lat (msec) : 2=7.55%, 4=3.68%, 10=6.71%, 20=9.77%, 50=36.07% lat (msec) : 100=24.93%, 250=7.88%, 500=0.33%, 750=0.07% cpu : usr=0.07%, sys=4.50%, ctx=6048, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=177KiB/s (182kB/s), 43.8KiB/s-45.6KiB/s (44.9kB/s-46.7kB/s), io=23.4MiB (24.6MB), run=131394-135470msec WRITE: bw=186KiB/s (190kB/s), 46.2KiB/s-47.9KiB/s (47.3kB/s-49.1kB/s), io=24.6MiB (25.7MB), run=131394-135470msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180197: Thu Sep 3 17:10:16 2026 read: IOPS=8, BW=34.5KiB/s (35.3kB/s)(5992KiB/173748msec) clat (msec): min=4, max=1307, avg=45.19, stdev=54.64 lat (msec): min=4, max=1307, avg=45.19, stdev=54.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 69], 90.00th=[ 100], 95.00th=[ 140], | 99.00th=[ 224], 99.50th=[ 251], 99.90th=[ 351], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 135, per=25.95%, avg=35.81, stdev=26.45, samples=324 iops : min= 1, max= 33, avg= 8.28, stdev= 6.67, samples=324 write: IOPS=9, BW=36.2KiB/s (37.1kB/s)(6296KiB/173748msec); 0 zone resets clat (msec): min=10, max=471, avg=67.02, stdev=53.83 lat (msec): min=10, max=471, avg=67.02, stdev=53.83 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 75], 80.00th=[ 101], 90.00th=[ 138], 95.00th=[ 178], | 99.00th=[ 251], 99.50th=[ 309], 99.90th=[ 422], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 6, max= 151, per=25.34%, avg=36.49, stdev=25.90, samples=334 iops : min= 1, max= 37, avg= 8.45, stdev= 6.53, samples=334 lat (msec) : 10=3.39%, 20=16.02%, 50=42.19%, 100=23.44%, 250=14.23% lat (msec) : 500=0.72%, 2000=0.03% cpu : usr=0.05%, sys=1.55%, ctx=4748, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180198: Thu Sep 3 17:10:16 2026 read: IOPS=8, BW=34.2KiB/s (34.0kB/s)(5940KiB/173916msec) clat (msec): min=4, max=808, avg=44.52, stdev=49.19 lat (msec): min=4, max=808, avg=44.52, stdev=49.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 101], 95.00th=[ 136], | 99.00th=[ 230], 99.50th=[ 259], 99.90th=[ 456], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 147, per=26.21%, avg=36.17, stdev=26.60, samples=317 iops : min= 1, max= 36, avg= 8.37, stdev= 6.70, samples=317 write: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6348KiB/173916msec); 0 zone resets clat (msec): min=10, max=565, avg=67.58, stdev=56.25 lat (msec): min=10, max=565, avg=67.58, stdev=56.25 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 99], 90.00th=[ 133], 95.00th=[ 171], | 99.00th=[ 284], 99.50th=[ 347], 99.90th=[ 493], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 6, max= 111, per=25.35%, avg=36.50, stdev=25.04, samples=335 iops : min= 1, max= 27, avg= 8.45, stdev= 6.32, samples=335 lat (msec) : 10=2.99%, 20=16.41%, 50=42.94%, 100=22.88%, 250=13.64% lat (msec) : 500=1.07%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.57%, ctx=4660, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180199: Thu Sep 3 17:10:16 2026 read: IOPS=8, BW=34.7KiB/s (35.6kB/s)(6028KiB/173528msec) clat (msec): min=5, max=378, avg=43.46, stdev=44.11 lat (msec): min=5, max=378, avg=43.46, stdev=44.11 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 97], 95.00th=[ 134], | 99.00th=[ 209], 99.50th=[ 292], 99.90th=[ 334], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 160, per=26.15%, avg=36.08, stdev=26.45, samples=323 iops : min= 1, max= 40, avg= 8.35, stdev= 6.66, samples=323 write: IOPS=9, BW=36.1KiB/s (36.9kB/s)(6260KiB/173528msec); 0 zone resets clat (msec): min=10, max=1093, avg=68.83, stdev=61.74 lat (msec): min=10, max=1093, avg=68.84, stdev=61.74 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 77], 80.00th=[ 100], 90.00th=[ 138], 95.00th=[ 178], | 99.00th=[ 279], 99.50th=[ 368], 99.90th=[ 485], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 112, per=24.95%, avg=35.93, stdev=25.14, samples=336 iops : min= 1, max= 28, avg= 8.31, stdev= 6.34, samples=336 lat (msec) : 10=3.39%, 20=16.31%, 50=42.22%, 100=23.57%, 250=13.44% lat (msec) : 500=1.04%, 2000=0.03% cpu : usr=0.06%, sys=1.57%, ctx=4558, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180200: Thu Sep 3 17:10:16 2026 read: IOPS=8, BW=34.9KiB/s (35.7kB/s)(6052KiB/173448msec) clat (msec): min=4, max=352, avg=44.70, stdev=45.72 lat (msec): min=4, max=352, avg=44.71, stdev=45.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 46], 80.00th=[ 68], 90.00th=[ 103], 95.00th=[ 140], | 99.00th=[ 224], 99.50th=[ 271], 99.90th=[ 338], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 6, max= 159, per=25.99%, avg=35.87, stdev=27.08, samples=326 iops : min= 1, max= 39, avg= 8.30, stdev= 6.83, samples=326 write: IOPS=8, BW=35.0KiB/s (36.8kB/s)(6236KiB/173448msec); 0 zone resets clat (msec): min=11, max=838, avg=67.52, stdev=57.49 lat (msec): min=11, max=838, avg=67.53, stdev=57.49 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 99], 90.00th=[ 133], 95.00th=[ 171], | 99.00th=[ 279], 99.50th=[ 326], 99.90th=[ 514], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 119, per=24.88%, avg=35.82, stdev=25.20, samples=336 iops : min= 1, max= 29, avg= 8.28, stdev= 6.36, samples=336 lat (msec) : 10=3.35%, 20=16.37%, 50=42.09%, 100=23.21%, 250=13.93% lat (msec) : 500=0.94%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.50%, ctx=4707, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=138KiB/s (141kB/s), 34.2KiB/s-34.9KiB/s (34.0kB/s-35.7kB/s), io=23.4MiB (24.6MB), run=173448-173916msec WRITE: bw=145KiB/s (148kB/s), 35.0KiB/s-36.5KiB/s (36.8kB/s-37.4kB/s), io=24.6MiB (25.7MB), run=173448-173916msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180249: Thu Sep 3 17:10:59 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(5920KiB/31516msec) clat (usec): min=31, max=245363, avg=46020.63, stdev=31208.09 lat (usec): min=32, max=245363, avg=46022.40, stdev=31208.32 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 67], 10.00th=[ 10945], 20.00th=[ 23725], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[160433], 99.50th=[179307], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 31, max= 319, per=24.36%, avg=184.92, stdev=63.79, samples=61 iops : min= 1, max= 19, avg=10.77, stdev= 4.01, samples=61 write: IOPS=12, BW=202KiB/s (207kB/s)(6368KiB/31516msec); 0 zone resets clat (usec): min=994, max=300282, avg=36054.85, stdev=37961.14 lat (usec): min=996, max=300285, avg=36088.71, stdev=38001.30 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1811], 10.00th=[ 2343], 20.00th=[ 5342], | 30.00th=[ 10028], 40.00th=[ 18220], 50.00th=[ 25822], 60.00th=[ 33162], | 70.00th=[ 45351], 80.00th=[ 61604], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[179307], 99.50th=[210764], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 503, per=25.14%, avg=200.84, stdev=88.10, samples=61 iops : min= 1, max= 31, avg=11.80, stdev= 5.59, samples=61 lat (usec) : 50=0.65%, 100=3.52%, 250=0.26%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.04%, 4=3.91%, 10=7.68%, 20=9.51%, 50=37.76% lat (msec) : 100=27.47%, 250=4.82%, 500=0.13% cpu : usr=0.04%, sys=5.85%, ctx=1665, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180250: Thu Sep 3 17:10:59 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5744KiB/31447msec) clat (usec): min=46, max=201403, avg=47630.48, stdev=31897.78 lat (usec): min=46, max=201404, avg=47632.72, stdev=31898.27 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 14877], 20.00th=[ 24249], | 30.00th=[ 30540], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[154141], 99.50th=[179307], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 351, per=24.04%, avg=182.48, stdev=68.33, samples=61 iops : min= 1, max= 21, avg=10.62, stdev= 4.26, samples=61 write: IOPS=13, BW=208KiB/s (213kB/s)(6544KiB/31447msec); 0 zone resets clat (usec): min=1225, max=397822, avg=34616.61, stdev=35983.80 lat (usec): min=1226, max=397825, avg=34618.76, stdev=35983.83 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1876], 10.00th=[ 3621], 20.00th=[ 7570], | 30.00th=[ 12649], 40.00th=[ 17957], 50.00th=[ 23987], 60.00th=[ 32900], | 70.00th=[ 40109], 80.00th=[ 56886], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[129500], 99.50th=[162530], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 31, max= 629, per=25.83%, avg=206.39, stdev=95.40, samples=61 iops : min= 1, max= 39, avg=12.13, stdev= 6.06, samples=61 lat (usec) : 50=0.39%, 100=3.12%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=3.26%, 4=2.73%, 10=7.55%, 20=12.24%, 50=39.71% lat (msec) : 100=25.39%, 250=4.95%, 500=0.13% cpu : usr=0.07%, sys=5.72%, ctx=1681, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180251: Thu Sep 3 17:10:59 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(6256KiB/29901msec) clat (usec): min=40, max=230999, avg=41515.69, stdev=30972.23 lat (usec): min=41, max=230999, avg=41517.72, stdev=30972.33 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 97], 20.00th=[ 20579], | 30.00th=[ 27132], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[175113], 99.50th=[204473], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 63, max= 535, per=27.46%, avg=208.41, stdev=96.73, samples=58 iops : min= 3, max= 33, avg=12.24, stdev= 6.12, samples=58 write: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29901msec); 0 zone resets clat (usec): min=1338, max=233783, avg=36068.29, stdev=35916.91 lat (usec): min=1340, max=233785, avg=36084.96, stdev=35923.01 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1876], 10.00th=[ 2704], 20.00th=[ 5604], | 30.00th=[ 9765], 40.00th=[ 17695], 50.00th=[ 26870], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 57934], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[168821], 99.50th=[179307], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 472, per=25.28%, avg=201.96, stdev=88.14, samples=57 iops : min= 1, max= 29, avg=11.82, stdev= 5.54, samples=57 lat (usec) : 50=0.26%, 100=5.08%, 250=0.39%, 500=0.13% lat (msec) : 2=3.52%, 4=4.30%, 10=7.55%, 20=9.90%, 50=39.58% lat (msec) : 100=23.96%, 250=5.34% cpu : usr=0.08%, sys=5.34%, ctx=1573, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180252: Thu Sep 3 17:10:59 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(6032KiB/29455msec) clat (usec): min=44, max=186014, avg=42853.23, stdev=28672.51 lat (usec): min=44, max=186016, avg=42854.59, stdev=28672.46 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 182], 20.00th=[ 22414], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[149947], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 413, per=26.83%, avg=203.63, stdev=84.13, samples=57 iops : min= 1, max= 25, avg=11.95, stdev= 5.29, samples=57 write: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29455msec); 0 zone resets clat (usec): min=1444, max=162874, avg=33385.80, stdev=33306.42 lat (usec): min=1445, max=162878, avg=33391.53, stdev=33307.08 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1795], 10.00th=[ 2474], 20.00th=[ 5735], | 30.00th=[ 8717], 40.00th=[ 14615], 50.00th=[ 22676], 60.00th=[ 32637], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 76022], 95.00th=[101188], | 99.00th=[149947], 99.50th=[152044], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 62, max= 412, per=26.45%, avg=211.32, stdev=81.64, samples=57 iops : min= 3, max= 25, avg=12.42, stdev= 5.17, samples=57 lat (usec) : 50=0.13%, 100=4.43%, 250=0.52%, 1000=0.13% lat (msec) : 2=4.17%, 4=2.99%, 10=10.16%, 20=9.38%, 50=39.71% lat (msec) : 100=23.96%, 250=4.43% cpu : usr=0.08%, sys=5.56%, ctx=1595, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=760KiB/s (778kB/s), 183KiB/s-209KiB/s (187kB/s-214kB/s), io=23.4MiB (24.5MB), run=29455-31516msec WRITE: bw=800KiB/s (819kB/s), 202KiB/s-212KiB/s (207kB/s-217kB/s), io=24.6MiB (25.8MB), run=29455-31516msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180253: Thu Sep 3 17:11:15 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(5920KiB/47231msec) clat (msec): min=7, max=364, avg=52.07, stdev=42.11 lat (msec): min=7, max=364, avg=52.07, stdev=42.11 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 72], 90.00th=[ 105], 95.00th=[ 130], | 99.00th=[ 205], 99.50th=[ 251], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 286, per=24.49%, avg=123.91, stdev=62.48, samples=91 iops : min= 1, max= 17, avg= 6.98, stdev= 3.94, samples=91 write: IOPS=8, BW=135KiB/s (138kB/s)(6368KiB/47231msec); 0 zone resets clat (msec): min=19, max=335, avg=69.70, stdev=39.57 lat (msec): min=20, max=335, avg=69.70, stdev=39.57 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 69], | 70.00th=[ 81], 80.00th=[ 100], 90.00th=[ 124], 95.00th=[ 146], | 99.00th=[ 194], 99.50th=[ 228], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 317, per=25.75%, avg=136.99, stdev=62.60, samples=90 iops : min= 1, max= 19, avg= 7.80, stdev= 3.96, samples=90 lat (msec) : 10=0.78%, 20=5.99%, 50=44.40%, 100=33.46%, 250=14.97% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.64%, ctx=1180, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180254: Thu Sep 3 17:11:15 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(5744KiB/47231msec) clat (msec): min=8, max=174, avg=49.55, stdev=30.16 lat (msec): min=8, max=174, avg=49.56, stdev=30.16 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 50], | 70.00th=[ 60], 80.00th=[ 68], 90.00th=[ 87], 95.00th=[ 113], | 99.00th=[ 157], 99.50th=[ 165], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 22, max= 287, per=24.12%, avg=122.03, stdev=65.63, samples=91 iops : min= 1, max= 17, avg= 6.86, stdev= 4.08, samples=91 write: IOPS=8, BW=139KiB/s (142kB/s)(6544KiB/47231msec); 0 zone resets clat (msec): min=18, max=439, avg=70.95, stdev=43.19 lat (msec): min=18, max=439, avg=70.95, stdev=43.19 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 52], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 82], 80.00th=[ 96], 90.00th=[ 128], 95.00th=[ 146], | 99.00th=[ 207], 99.50th=[ 247], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 31, max= 318, per=25.82%, avg=137.37, stdev=58.93, samples=92 iops : min= 1, max= 19, avg= 7.83, stdev= 3.75, samples=92 lat (msec) : 10=0.39%, 20=4.82%, 50=43.49%, 100=38.41%, 250=12.63% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.78%, ctx=1215, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180255: Thu Sep 3 17:11:15 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(6256KiB/45746msec) clat (msec): min=9, max=347, avg=51.16, stdev=38.01 lat (msec): min=9, max=347, avg=51.17, stdev=38.01 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 99], 95.00th=[ 131], | 99.00th=[ 182], 99.50th=[ 197], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 319, per=27.02%, avg=136.70, stdev=70.18, samples=90 iops : min= 1, max= 19, avg= 7.79, stdev= 4.42, samples=90 write: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45746msec); 0 zone resets clat (msec): min=17, max=212, avg=68.06, stdev=34.02 lat (msec): min=17, max=212, avg=68.06, stdev=34.02 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 62], 60.00th=[ 69], | 70.00th=[ 81], 80.00th=[ 91], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 174], 99.50th=[ 190], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 349, per=24.99%, avg=132.93, stdev=60.78, samples=89 iops : min= 1, max= 21, avg= 7.55, stdev= 3.85, samples=89 lat (msec) : 10=0.13%, 20=6.64%, 50=43.62%, 100=36.98%, 250=12.50% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=1.84%, ctx=1183, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180256: Thu Sep 3 17:11:15 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(6032KiB/47305msec) clat (msec): min=7, max=230, avg=48.63, stdev=32.52 lat (msec): min=7, max=230, avg=48.63, stdev=32.52 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 92], 95.00th=[ 112], | 99.00th=[ 171], 99.50th=[ 184], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 22, max= 285, per=25.83%, avg=130.71, stdev=61.90, samples=90 iops : min= 1, max= 17, avg= 7.41, stdev= 3.86, samples=90 write: IOPS=8, BW=132KiB/s (135kB/s)(6256KiB/47305msec); 0 zone resets clat (msec): min=18, max=446, avg=73.38, stdev=47.01 lat (msec): min=18, max=446, avg=73.38, stdev=47.02 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 72], | 70.00th=[ 82], 80.00th=[ 100], 90.00th=[ 127], 95.00th=[ 161], | 99.00th=[ 241], 99.50th=[ 342], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 350, per=24.75%, avg=131.65, stdev=60.26, samples=93 iops : min= 1, max= 21, avg= 7.46, stdev= 3.83, samples=93 lat (msec) : 10=0.65%, 20=6.64%, 50=42.32%, 100=37.11%, 250=13.02% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.74%, ctx=1265, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=506KiB/s (518kB/s), 122KiB/s-137KiB/s (125kB/s-140kB/s), io=23.4MiB (24.5MB), run=45746-47305msec WRITE: bw=533KiB/s (545kB/s), 132KiB/s-139KiB/s (135kB/s-142kB/s), io=24.6MiB (25.8MB), run=45746-47305msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180274: Thu Sep 3 17:11:35 2026 read: IOPS=1, BW=1462KiB/s (1497kB/s)(7168KiB/4903msec) clat (usec): min=337, max=2915.2k, avg=527077.49, stdev=1060799.51 lat (usec): min=338, max=2915.2k, avg=527078.70, stdev=1060799.73 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], | 20.00th=[ 635], 30.00th=[ 9896], 40.00th=[ 9896], | 50.00th=[ 214959], 60.00th=[ 246416], 70.00th=[ 246416], | 80.00th=[ 304088], 90.00th=[2902459], 95.00th=[2902459], | 99.00th=[2902459], 99.50th=[2902459], 99.90th=[2902459], | 99.95th=[2902459], 99.99th=[2902459] bw ( KiB/s): min= 2043, max= 6131, per=91.59%, avg=3825.67, stdev=2093.52, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1044KiB/s (1069kB/s)(5120KiB/4903msec); 0 zone resets clat (msec): min=113, max=380, avg=242.27, stdev=108.34 lat (msec): min=113, max=380, avg=242.35, stdev=108.33 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2043, max= 4087, per=58.11%, avg=3397.67, stdev=1173.24, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=41.67%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=8.45%, ctx=237, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180275: Thu Sep 3 17:11:35 2026 read: IOPS=0, BW=433KiB/s (444kB/s)(2048KiB/4727msec) clat (msec): min=354, max=420, avg=387.51, stdev=47.36 lat (msec): min=354, max=420, avg=387.51, stdev=47.36 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1681, max= 2039, per=44.53%, avg=1860.00, stdev=253.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2166KiB/s (2218kB/s)(10.0MiB/4727msec); 0 zone resets clat (msec): min=200, max=1210, avg=393.50, stdev=300.60 lat (msec): min=207, max=1210, avg=394.63, stdev=299.89 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 207], | 30.00th=[ 236], 40.00th=[ 247], 50.00th=[ 275], 60.00th=[ 326], | 70.00th=[ 338], 80.00th=[ 430], 90.00th=[ 464], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1681, max= 4015, per=43.14%, avg=2522.33, stdev=969.97, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=58.33%, 2000=8.33% cpu : usr=0.08%, sys=10.43%, ctx=189, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180276: Thu Sep 3 17:11:35 2026 read: IOPS=1, BW=1317KiB/s (1349kB/s)(6144KiB/4664msec) clat (usec): min=1568, max=330799, avg=197381.56, stdev=151846.95 lat (usec): min=1570, max=330801, avg=197382.90, stdev=151846.85 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1565], 10.00th=[ 1565], 20.00th=[ 5997], | 30.00th=[ 5997], 40.00th=[265290], 50.00th=[265290], 60.00th=[270533], | 70.00th=[308282], 80.00th=[308282], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2007, max= 3471, per=59.99%, avg=2505.67, stdev=836.16, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1317KiB/s (1349kB/s)(6144KiB/4664msec); 0 zone resets clat (msec): min=236, max=1272, avg=579.30, stdev=397.05 lat (msec): min=236, max=1272, avg=579.71, stdev=396.83 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 542], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1889, max= 2039, per=33.85%, avg=1979.40, stdev=78.11, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 2=8.33%, 10=8.33%, 250=8.33%, 500=50.00%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=8.56%, ctx=132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180277: Thu Sep 3 17:11:35 2026 read: IOPS=1, BW=1063KiB/s (1089kB/s)(5120KiB/4815msec) clat (usec): min=346, max=318661, avg=92914.59, stdev=139881.08 lat (usec): min=346, max=318662, avg=92915.78, stdev=139881.05 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 4113], 60.00th=[ 4113], | 70.00th=[141558], 80.00th=[141558], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 2039, max= 6023, per=96.50%, avg=4031.00, stdev=2817.11, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1489KiB/s (1524kB/s)(7168KiB/4815msec); 0 zone resets clat (msec): min=260, max=1302, avg=621.16, stdev=438.17 lat (msec): min=261, max=1302, avg=621.24, stdev=438.15 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 275], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 359], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 1167], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1590, max= 2043, per=32.29%, avg=1887.83, stdev=189.47, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=8.33%, 500=41.67%, 750=8.33%, 2000=16.67% cpu : usr=0.02%, sys=7.02%, ctx=96, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4177KiB/s (4277kB/s), 433KiB/s-1462KiB/s (444kB/s-1497kB/s), io=20.0MiB (20.0MB), run=4664-4903msec WRITE: bw=5848KiB/s (5988kB/s), 1044KiB/s-2166KiB/s (1069kB/s-2218kB/s), io=28.0MiB (29.4MB), run=4664-4903msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180268: Thu Sep 3 17:11:35 2026 read: IOPS=2, BW=2426KiB/s (2484kB/s)(7168KiB/2955msec) clat (msec): min=98, max=406, avg=177.62, stdev=103.67 lat (msec): min=98, max=406, avg=177.62, stdev=103.67 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 115], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 157], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 163], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2027, max= 4883, per=100.00%, avg=3665.67, stdev=1473.88, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1733KiB/s (1774kB/s)(5120KiB/2955msec); 0 zone resets clat (msec): min=196, max=562, avg=332.42, stdev=164.24 lat (msec): min=196, max=562, avg=332.62, stdev=164.36 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1627, max= 3737, per=51.28%, avg=2469.00, stdev=1117.65, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.03%, sys=3.89%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180269: Thu Sep 3 17:11:35 2026 read: IOPS=0, BW=404KiB/s (413kB/s)(2048KiB/5073msec) clat (msec): min=149, max=611, avg=380.52, stdev=327.22 lat (msec): min=149, max=611, avg=380.52, stdev=327.21 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1654, max= 1914, per=51.88%, avg=1784.00, stdev=183.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2019KiB/s (2067kB/s)(10.0MiB/5073msec); 0 zone resets clat (msec): min=156, max=1553, avg=411.85, stdev=478.10 lat (msec): min=156, max=1553, avg=411.94, stdev=478.09 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 161], | 30.00th=[ 167], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 207], | 70.00th=[ 232], 80.00th=[ 259], 90.00th=[ 1020], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 1654, max= 6131, per=64.47%, avg=3104.00, stdev=1900.74, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=66.67%, 500=8.33%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.21%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180270: Thu Sep 3 17:11:35 2026 read: IOPS=1, BW=1032KiB/s (1057kB/s)(6144KiB/5954msec) clat (msec): min=97, max=961, avg=444.77, stdev=381.85 lat (msec): min=97, max=961, avg=444.77, stdev=381.85 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 472], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2023, max= 4079, per=95.37%, avg=3279.67, stdev=1101.66, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1032KiB/s (1057kB/s)(6144KiB/5954msec); 0 zone resets clat (msec): min=107, max=1404, avg=538.54, stdev=467.18 lat (msec): min=108, max=1405, avg=538.64, stdev=467.16 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 460], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 2023, max= 3537, per=48.49%, avg=2334.60, stdev=672.22, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.15%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180271: Thu Sep 3 17:11:35 2026 read: IOPS=0, BW=917KiB/s (939kB/s)(5120KiB/5586msec) clat (msec): min=67, max=679, avg=388.15, stdev=267.57 lat (msec): min=67, max=679, avg=388.15, stdev=267.57 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1914, max= 3737, per=74.42%, avg=2559.33, stdev=1021.45, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1283KiB/s (1314kB/s)(7168KiB/5586msec); 0 zone resets clat (msec): min=165, max=1830, avg=506.32, stdev=605.38 lat (msec): min=165, max=1830, avg=506.40, stdev=605.37 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 176], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 262], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 634], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 2023, max= 4087, per=61.72%, avg=2971.75, stdev=1101.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=3.62%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3440KiB/s (3522kB/s), 404KiB/s-2426KiB/s (413kB/s-2484kB/s), io=20.0MiB (20.0MB), run=2955-5954msec WRITE: bw=4816KiB/s (4931kB/s), 1032KiB/s-2019KiB/s (1057kB/s-2067kB/s), io=28.0MiB (29.4MB), run=2955-5954msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180284: Thu Sep 3 17:11:52 2026 read: IOPS=0, BW=3884KiB/s (3977kB/s)(12.0MiB/3164msec) clat (msec): min=792, max=1279, avg=1042.93, stdev=243.75 lat (msec): min=792, max=1279, avg=1042.93, stdev=243.75 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7968, max= 8143, per=100.00%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.99%, ctx=280, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180285: Thu Sep 3 17:11:53 2026 read: IOPS=0, BW=1257KiB/s (1287kB/s)(4096KiB/3258msec) clat (nsec): min=1274.3M, max=1274.3M, avg=1274260198.00, stdev= 0.00 lat (nsec): min=1274.3M, max=1274.3M, avg=1274262149.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2514KiB/s (2575kB/s)(8192KiB/3258msec); 0 zone resets clat (msec): min=819, max=860, avg=840.49, stdev=29.00 lat (msec): min=820, max=861, avg=841.11, stdev=28.71 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8159, max= 8159, per=93.60%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.21%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180286: Thu Sep 3 17:11:53 2026 write: IOPS=0, BW=3269KiB/s (3347kB/s)(12.0MiB/3759msec); 0 zone resets clat (msec): min=883, max=1536, avg=1173.36, stdev=333.01 lat (msec): min=883, max=1539, avg=1174.42, stdev=334.08 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7984, max= 8047, per=91.95%, avg=8015.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.90%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180287: Thu Sep 3 17:11:53 2026 write: IOPS=0, BW=3977KiB/s (4072kB/s)(12.0MiB/3090msec); 0 zone resets clat (msec): min=264, max=2331, avg=956.79, stdev=1190.64 lat (msec): min=264, max=2331, avg=957.14, stdev=1190.63 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 7025, max= 7801, per=85.04%, avg=7413.00, stdev=548.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.69%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5029KiB/s (5150kB/s), 1257KiB/s-3884KiB/s (1287kB/s-3977kB/s), io=16.0MiB (16.8MB), run=3164-3258msec WRITE: bw=8717KiB/s (8926kB/s), 2514KiB/s-3977KiB/s (2575kB/s-4072kB/s), io=32.0MiB (33.6MB), run=3090-3759msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180289: Thu Sep 3 17:11:53 2026 read: IOPS=0, BW=3447KiB/s (3530kB/s)(12.0MiB/3565msec) clat (msec): min=619, max=1776, avg=1181.82, stdev=579.26 lat (msec): min=619, max=1776, avg=1181.82, stdev=579.27 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.44%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180290: Thu Sep 3 17:11:53 2026 read: IOPS=0, BW=1169KiB/s (1197kB/s)(4096KiB/3503msec) clat (nsec): min=2228.5M, max=2228.5M, avg=2228504654.00, stdev= 0.00 lat (nsec): min=2228.5M, max=2228.5M, avg=2228505882.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2232], 5.00th=[ 2232], 10.00th=[ 2232], 20.00th=[ 2232], | 30.00th=[ 2232], 40.00th=[ 2232], 50.00th=[ 2232], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2339KiB/s (2395kB/s)(8192KiB/3503msec); 0 zone resets clat (msec): min=572, max=699, avg=636.11, stdev=90.33 lat (msec): min=572, max=700, avg=636.67, stdev=90.62 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8175, max= 8175, per=94.71%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.03%, sys=3.51%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180291: Thu Sep 3 17:11:53 2026 write: IOPS=0, BW=3237KiB/s (3315kB/s)(12.0MiB/3796msec); 0 zone resets clat (msec): min=554, max=2032, avg=1241.23, stdev=744.47 lat (msec): min=555, max=2032, avg=1241.76, stdev=744.36 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8159, max= 8175, per=94.61%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=1.95%, ctx=29, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180292: Thu Sep 3 17:11:53 2026 write: IOPS=0, BW=4054KiB/s (4151kB/s)(12.0MiB/3031msec); 0 zone resets clat (msec): min=247, max=2509, avg=1008.43, stdev=1300.26 lat (msec): min=248, max=2510, avg=1009.16, stdev=1299.94 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 7907, max= 8175, per=93.15%, avg=8041.00, stdev=189.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=3.60%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4596KiB/s (4706kB/s), 1169KiB/s-3447KiB/s (1197kB/s-3530kB/s), io=16.0MiB (16.8MB), run=3503-3565msec WRITE: bw=8632KiB/s (8839kB/s), 2339KiB/s-4054KiB/s (2395kB/s-4151kB/s), io=32.0MiB (33.6MB), run=3031-3796msec