== sanity test 398b: DIO and buffer IO race ============== 15:06:23 (1790881583) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.58226 s, 19.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192973: Thu Oct 1 15:07:33 2026 read: IOPS=24, BW=97.4KiB/s (99.7kB/s)(5992KiB/61520msec) clat (usec): min=31, max=651933, avg=22684.54, stdev=22554.51 lat (usec): min=32, max=651934, avg=22686.18, stdev=22554.11 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 7111], 10.00th=[ 9110], 20.00th=[ 11469], | 30.00th=[ 13566], 40.00th=[ 16057], 50.00th=[ 19006], 60.00th=[ 21890], | 70.00th=[ 25560], 80.00th=[ 29754], 90.00th=[ 39584], 95.00th=[ 52691], | 99.00th=[ 78119], 99.50th=[ 90702], 99.90th=[191890], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 13, max= 167, per=24.97%, avg=97.39, stdev=32.23, samples=122 iops : min= 3, max= 41, avg=23.88, stdev= 8.12, samples=122 write: IOPS=25, BW=102KiB/s (105kB/s)(6296KiB/61520msec); 0 zone resets clat (usec): min=573, max=180166, avg=17364.53, stdev=17026.51 lat (usec): min=573, max=180167, avg=17366.02, stdev=17026.38 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1270], 10.00th=[ 1926], 20.00th=[ 2966], | 30.00th=[ 5080], 40.00th=[ 10159], 50.00th=[ 13566], 60.00th=[ 17433], | 70.00th=[ 22152], 80.00th=[ 28443], 90.00th=[ 37487], 95.00th=[ 46924], | 99.00th=[ 78119], 99.50th=[ 96994], 99.90th=[139461], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 215, per=25.27%, avg=103.09, stdev=34.51, samples=121 iops : min= 7, max= 53, avg=25.31, stdev= 8.64, samples=121 lat (usec) : 50=0.33%, 100=0.85%, 250=0.39%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=5.27%, 4=8.01%, 10=11.69%, 20=32.94%, 50=35.51% lat (msec) : 100=4.33%, 250=0.33%, 750=0.03% cpu : usr=0.10%, sys=13.40%, ctx=7718, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192975: Thu Oct 1 15:07:33 2026 read: IOPS=25, BW=101KiB/s (104kB/s)(5940KiB/58618msec) clat (usec): min=33, max=161392, avg=20748.29, stdev=14895.93 lat (usec): min=33, max=161392, avg=20749.77, stdev=14895.38 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 6718], 10.00th=[ 8586], 20.00th=[ 10814], | 30.00th=[ 12780], 40.00th=[ 15139], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 23462], 80.00th=[ 27395], 90.00th=[ 34866], 95.00th=[ 44303], | 99.00th=[ 80217], 99.50th=[ 89654], 99.90th=[149947], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 6, max= 175, per=26.01%, avg=101.43, stdev=32.46, samples=116 iops : min= 1, max= 43, avg=24.89, stdev= 8.18, samples=116 write: IOPS=27, BW=108KiB/s (111kB/s)(6348KiB/58618msec); 0 zone resets clat (usec): min=720, max=651228, avg=17380.82, stdev=23649.32 lat (usec): min=720, max=651229, avg=17382.10, stdev=23649.09 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1434], 10.00th=[ 2180], 20.00th=[ 3195], | 30.00th=[ 5538], 40.00th=[ 9634], 50.00th=[ 12649], 60.00th=[ 16057], | 70.00th=[ 20317], 80.00th=[ 26870], 90.00th=[ 36439], 95.00th=[ 46924], | 99.00th=[ 90702], 99.50th=[109577], 99.90th=[223347], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 6, max= 200, per=26.48%, avg=108.05, stdev=40.66, samples=116 iops : min= 1, max= 50, avg=26.54, stdev=10.15, samples=116 lat (usec) : 50=0.20%, 100=0.91%, 250=0.33%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=4.26%, 4=8.07%, 10=14.52%, 20=34.83%, 50=32.29% lat (msec) : 100=3.61%, 250=0.55%, 750=0.03% cpu : usr=0.11%, sys=14.04%, ctx=7672, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192977: Thu Oct 1 15:07:33 2026 read: IOPS=24, BW=99.7KiB/s (102kB/s)(6028KiB/60485msec) clat (usec): min=36, max=175981, avg=21404.02, stdev=15224.73 lat (usec): min=36, max=175982, avg=21407.88, stdev=15225.26 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 6849], 10.00th=[ 8848], 20.00th=[ 11076], | 30.00th=[ 13173], 40.00th=[ 15139], 50.00th=[ 17695], 60.00th=[ 20841], | 70.00th=[ 23987], 80.00th=[ 28443], 90.00th=[ 38011], 95.00th=[ 49546], | 99.00th=[ 79168], 99.50th=[100140], 99.90th=[113771], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 23, max= 183, per=25.75%, avg=100.42, stdev=33.38, samples=119 iops : min= 5, max= 45, avg=24.64, stdev= 8.41, samples=119 write: IOPS=25, BW=103KiB/s (106kB/s)(6260KiB/60485msec); 0 zone resets clat (usec): min=667, max=673737, avg=17902.98, stdev=24218.12 lat (usec): min=668, max=673739, avg=17904.08, stdev=24218.14 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1385], 10.00th=[ 1958], 20.00th=[ 3130], | 30.00th=[ 5669], 40.00th=[ 10028], 50.00th=[ 13435], 60.00th=[ 16909], | 70.00th=[ 21365], 80.00th=[ 27657], 90.00th=[ 38536], 95.00th=[ 47973], | 99.00th=[ 78119], 99.50th=[ 98042], 99.90th=[208667], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 24, max= 207, per=25.54%, avg=104.19, stdev=36.61, samples=119 iops : min= 6, max= 51, avg=25.58, stdev= 9.22, samples=119 lat (usec) : 50=0.13%, 100=0.98%, 250=0.62%, 750=0.03%, 1000=0.13% lat (msec) : 2=5.27%, 4=6.97%, 10=13.41%, 20=34.67%, 50=33.20% lat (msec) : 100=4.10%, 250=0.46%, 750=0.03% cpu : usr=0.13%, sys=13.62%, ctx=7795, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192978: Thu Oct 1 15:07:33 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(6052KiB/60284msec) clat (usec): min=43, max=193289, avg=21401.80, stdev=15521.54 lat (usec): min=44, max=193289, avg=21402.59, stdev=15521.56 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 6915], 10.00th=[ 8717], 20.00th=[ 11207], | 30.00th=[ 13304], 40.00th=[ 15664], 50.00th=[ 18220], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 28443], 90.00th=[ 35914], 95.00th=[ 45351], | 99.00th=[ 83362], 99.50th=[101188], 99.90th=[156238], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 32, max= 192, per=25.90%, avg=100.99, stdev=33.24, samples=118 iops : min= 8, max= 48, avg=24.78, stdev= 8.35, samples=118 write: IOPS=25, BW=103KiB/s (106kB/s)(6236KiB/60284msec); 0 zone resets clat (usec): min=957, max=668981, avg=17756.85, stdev=23857.56 lat (usec): min=957, max=668983, avg=17757.90, stdev=23857.55 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1254], 10.00th=[ 1827], 20.00th=[ 2868], | 30.00th=[ 4555], 40.00th=[ 9372], 50.00th=[ 13042], 60.00th=[ 16450], | 70.00th=[ 22152], 80.00th=[ 28705], 90.00th=[ 40109], 95.00th=[ 49021], | 99.00th=[ 78119], 99.50th=[ 93848], 99.90th=[173016], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 15, max= 183, per=25.51%, avg=104.07, stdev=31.90, samples=118 iops : min= 3, max= 45, avg=25.56, stdev= 8.02, samples=118 lat (usec) : 50=0.29%, 100=0.91%, 250=0.46%, 500=0.10%, 1000=0.20% lat (msec) : 2=5.73%, 4=8.01%, 10=12.86%, 20=32.68%, 50=34.44% lat (msec) : 100=3.87%, 250=0.42%, 750=0.03% cpu : usr=0.11%, sys=13.67%, ctx=7823, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=390KiB/s (400kB/s), 97.4KiB/s-101KiB/s (99.7kB/s-104kB/s), io=23.4MiB (24.6MB), run=58618-61520msec WRITE: bw=409KiB/s (418kB/s), 102KiB/s-108KiB/s (105kB/s-111kB/s), io=24.6MiB (25.7MB), run=58618-61520msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192972: Thu Oct 1 15:07:48 2026 read: IOPS=19, BW=78.3KiB/s (80.1kB/s)(5992KiB/76554msec) clat (msec): min=3, max=657, avg=20.62, stdev=26.65 lat (msec): min=3, max=657, avg=20.62, stdev=26.65 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 45], 95.00th=[ 62], | 99.00th=[ 114], 99.50th=[ 136], 99.90th=[ 262], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 279, per=25.14%, avg=78.67, stdev=53.05, samples=150 iops : min= 1, max= 69, avg=19.23, stdev=13.35, samples=150 write: IOPS=20, BW=82.2KiB/s (84.2kB/s)(6296KiB/76554msec); 0 zone resets clat (msec): min=6, max=231, avg=28.89, stdev=22.92 lat (msec): min=6, max=231, avg=28.89, stdev=22.92 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 54], 95.00th=[ 72], | 99.00th=[ 122], 99.50th=[ 138], 99.90th=[ 220], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7, max= 232, per=25.05%, avg=82.17, stdev=51.61, samples=151 iops : min= 1, max= 58, avg=20.10, stdev=12.96, samples=151 lat (msec) : 4=0.16%, 10=20.25%, 20=38.12%, 50=31.38%, 100=8.56% lat (msec) : 250=1.46%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.18%, ctx=4906, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192974: Thu Oct 1 15:07:48 2026 read: IOPS=19, BW=77.6KiB/s (79.5kB/s)(5940KiB/76521msec) clat (msec): min=3, max=661, avg=20.15, stdev=25.51 lat (msec): min=3, max=661, avg=20.15, stdev=25.51 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 43], 95.00th=[ 57], | 99.00th=[ 100], 99.50th=[ 124], 99.90th=[ 197], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 271, per=25.19%, avg=78.84, stdev=52.14, samples=149 iops : min= 1, max= 67, avg=19.27, stdev=13.09, samples=149 write: IOPS=20, BW=82.0KiB/s (84.9kB/s)(6348KiB/76521msec); 0 zone resets clat (msec): min=6, max=314, avg=29.23, stdev=22.95 lat (msec): min=6, max=314, avg=29.23, stdev=22.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 43], 90.00th=[ 56], 95.00th=[ 68], | 99.00th=[ 117], 99.50th=[ 140], 99.90th=[ 230], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 15, max= 256, per=25.29%, avg=82.95, stdev=50.44, samples=151 iops : min= 3, max= 64, avg=20.30, stdev=12.70, samples=151 lat (msec) : 4=0.20%, 10=19.30%, 20=38.28%, 50=32.32%, 100=8.59% lat (msec) : 250=1.24%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.12%, ctx=4942, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192976: Thu Oct 1 15:07:48 2026 read: IOPS=19, BW=78.7KiB/s (80.6kB/s)(6028KiB/76606msec) clat (msec): min=3, max=255, avg=20.45, stdev=22.04 lat (msec): min=3, max=255, avg=20.45, stdev=22.04 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 60], | 99.00th=[ 111], 99.50th=[ 138], 99.90th=[ 226], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 255, per=25.26%, avg=79.05, stdev=51.69, samples=150 iops : min= 1, max= 63, avg=19.32, stdev=12.99, samples=150 write: IOPS=20, BW=81.7KiB/s (83.7kB/s)(6260KiB/76606msec); 0 zone resets clat (msec): min=6, max=668, avg=29.14, stdev=27.41 lat (msec): min=6, max=668, avg=29.14, stdev=27.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 55], 95.00th=[ 71], | 99.00th=[ 121], 99.50th=[ 144], 99.90th=[ 253], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 232, per=24.99%, avg=81.96, stdev=51.37, samples=150 iops : min= 1, max= 58, avg=20.05, stdev=12.93, samples=150 lat (msec) : 4=0.42%, 10=19.40%, 20=38.12%, 50=31.58%, 100=9.02% lat (msec) : 250=1.37%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.17%, ctx=4916, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192979: Thu Oct 1 15:07:48 2026 read: IOPS=19, BW=79.3KiB/s (81.2kB/s)(6052KiB/76289msec) clat (msec): min=3, max=220, avg=20.20, stdev=19.98 lat (msec): min=3, max=220, avg=20.20, stdev=19.98 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 44], 95.00th=[ 56], | 99.00th=[ 95], 99.50th=[ 124], 99.90th=[ 211], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 15, max= 272, per=25.39%, avg=79.46, stdev=49.91, samples=149 iops : min= 3, max= 68, avg=19.42, stdev=12.55, samples=149 write: IOPS=20, BW=81.7KiB/s (83.7kB/s)(6236KiB/76289msec); 0 zone resets clat (msec): min=6, max=666, avg=29.20, stdev=28.00 lat (msec): min=6, max=666, avg=29.21, stdev=28.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 57], 95.00th=[ 71], | 99.00th=[ 118], 99.50th=[ 133], 99.90th=[ 317], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 248, per=24.83%, avg=81.44, stdev=50.26, samples=150 iops : min= 1, max= 62, avg=19.91, stdev=12.64, samples=150 lat (msec) : 4=0.16%, 10=18.98%, 20=38.09%, 50=33.24%, 100=8.24% lat (msec) : 250=1.24%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.25%, ctx=4984, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=313KiB/s (321kB/s), 77.6KiB/s-79.3KiB/s (79.5kB/s-81.2kB/s), io=23.4MiB (24.6MB), run=76289-76606msec WRITE: bw=328KiB/s (336kB/s), 81.7KiB/s-82.0KiB/s (83.7kB/s-84.9kB/s), io=24.6MiB (25.7MB), run=76289-76606msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193008: Thu Oct 1 15:08:10 2026 read: IOPS=23, BW=377KiB/s (386kB/s)(5920KiB/15723msec) clat (usec): min=45, max=77277, avg=21375.69, stdev=12569.14 lat (usec): min=46, max=77277, avg=21376.52, stdev=12569.14 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 99], 10.00th=[ 8586], 20.00th=[12256], | 30.00th=[14615], 40.00th=[16909], 50.00th=[20055], 60.00th=[22676], | 70.00th=[26346], 80.00th=[29230], 90.00th=[36963], 95.00th=[43779], | 99.00th=[66323], 99.50th=[67634], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 127, max= 672, per=25.24%, avg=376.26, stdev=121.39, samples=31 iops : min= 7, max= 42, avg=22.90, stdev= 7.64, samples=31 write: IOPS=25, BW=405KiB/s (415kB/s)(6368KiB/15723msec); 0 zone resets clat (usec): min=1218, max=81623, avg=19548.87, stdev=15274.53 lat (usec): min=1219, max=81625, avg=19550.38, stdev=15274.58 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2573], 10.00th=[ 3490], 20.00th=[ 5145], | 30.00th=[ 8455], 40.00th=[12387], 50.00th=[16188], 60.00th=[20579], | 70.00th=[25297], 80.00th=[30540], 90.00th=[41681], 95.00th=[50070], | 99.00th=[65274], 99.50th=[65799], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 255, max= 670, per=25.78%, avg=404.19, stdev=96.99, samples=31 iops : min= 15, max= 41, avg=24.65, stdev= 6.13, samples=31 lat (usec) : 50=0.39%, 100=2.08%, 250=1.30% lat (msec) : 2=1.43%, 4=5.21%, 10=13.67%, 20=30.08%, 50=41.93% lat (msec) : 100=3.91% cpu : usr=0.09%, sys=17.95%, ctx=2275, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193009: Thu Oct 1 15:08:10 2026 read: IOPS=23, BW=369KiB/s (378kB/s)(5744KiB/15546msec) clat (usec): min=50, max=100935, avg=22198.01, stdev=13475.25 lat (usec): min=51, max=100936, avg=22198.90, stdev=13475.31 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 145], 10.00th=[ 10028], 20.00th=[ 12649], | 30.00th=[ 15533], 40.00th=[ 17695], 50.00th=[ 20317], 60.00th=[ 22938], | 70.00th=[ 25822], 80.00th=[ 29754], 90.00th=[ 36439], 95.00th=[ 42206], | 99.00th=[ 74974], 99.50th=[ 98042], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 161, max= 574, per=24.88%, avg=371.00, stdev=90.78, samples=30 iops : min= 10, max= 35, avg=22.57, stdev= 5.68, samples=30 write: IOPS=26, BW=421KiB/s (431kB/s)(6544KiB/15546msec); 0 zone resets clat (usec): min=1548, max=94119, avg=18225.72, stdev=14985.12 lat (usec): min=1549, max=94121, avg=18227.20, stdev=14985.14 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2671], 10.00th=[ 3425], 20.00th=[ 5080], | 30.00th=[ 7832], 40.00th=[11338], 50.00th=[13829], 60.00th=[17695], | 70.00th=[22938], 80.00th=[29492], 90.00th=[39060], 95.00th=[48497], | 99.00th=[66847], 99.50th=[73925], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 251, max= 672, per=26.35%, avg=413.17, stdev=100.48, samples=30 iops : min= 15, max= 42, avg=25.20, stdev= 6.33, samples=30 lat (usec) : 100=1.56%, 250=0.91% lat (msec) : 2=1.43%, 4=5.73%, 10=14.45%, 20=33.46%, 50=38.93% lat (msec) : 100=3.39%, 250=0.13% cpu : usr=0.05%, sys=18.19%, ctx=2322, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193010: Thu Oct 1 15:08:10 2026 read: IOPS=24, BW=389KiB/s (399kB/s)(6256KiB/16064msec) clat (usec): min=36, max=89151, avg=22514.03, stdev=13436.47 lat (usec): min=38, max=89152, avg=22515.07, stdev=13436.40 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 130], 10.00th=[ 9110], 20.00th=[12518], | 30.00th=[14746], 40.00th=[18744], 50.00th=[20841], 60.00th=[23462], | 70.00th=[26870], 80.00th=[31589], 90.00th=[39060], 95.00th=[46400], | 99.00th=[71828], 99.50th=[80217], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 220, max= 733, per=25.86%, avg=385.65, stdev=126.64, samples=31 iops : min= 13, max= 45, avg=23.48, stdev= 7.89, samples=31 write: IOPS=23, BW=375KiB/s (385kB/s)(6032KiB/16064msec); 0 zone resets clat (usec): min=1271, max=77598, avg=19022.12, stdev=14925.65 lat (usec): min=1272, max=77601, avg=19024.11, stdev=14925.63 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2474], 10.00th=[ 3359], 20.00th=[ 5211], | 30.00th=[ 9241], 40.00th=[11994], 50.00th=[16057], 60.00th=[19006], | 70.00th=[23725], 80.00th=[30016], 90.00th=[40109], 95.00th=[51119], | 99.00th=[64226], 99.50th=[71828], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 128, max= 544, per=23.00%, avg=360.61, stdev=106.01, samples=31 iops : min= 8, max= 34, avg=21.90, stdev= 6.60, samples=31 lat (usec) : 50=0.39%, 100=1.17%, 250=2.08% lat (msec) : 2=0.65%, 4=5.47%, 10=12.76%, 20=32.03%, 50=41.15% lat (msec) : 100=4.30% cpu : usr=0.12%, sys=17.51%, ctx=2361, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193011: Thu Oct 1 15:08:10 2026 read: IOPS=24, BW=391KiB/s (400kB/s)(6032KiB/15434msec) clat (usec): min=41, max=123752, avg=22411.22, stdev=14558.59 lat (usec): min=42, max=123754, avg=22412.05, stdev=14558.61 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 106], 10.00th=[ 8717], 20.00th=[ 12387], | 30.00th=[ 15139], 40.00th=[ 17171], 50.00th=[ 20841], 60.00th=[ 23725], | 70.00th=[ 27132], 80.00th=[ 30278], 90.00th=[ 40109], 95.00th=[ 46924], | 99.00th=[ 68682], 99.50th=[109577], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 159, max= 638, per=25.82%, avg=385.03, stdev=110.96, samples=30 iops : min= 9, max= 39, avg=23.43, stdev= 6.99, samples=30 write: IOPS=25, BW=405KiB/s (415kB/s)(6256KiB/15434msec); 0 zone resets clat (usec): min=1411, max=98896, avg=17580.24, stdev=15855.51 lat (usec): min=1412, max=98897, avg=17581.76, stdev=15855.53 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2409], 10.00th=[ 3490], 20.00th=[ 4490], | 30.00th=[ 6849], 40.00th=[10290], 50.00th=[12780], 60.00th=[15926], | 70.00th=[21103], 80.00th=[28181], 90.00th=[36963], 95.00th=[51643], | 99.00th=[74974], 99.50th=[87557], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 188, max= 605, per=25.69%, avg=402.83, stdev=104.25, samples=30 iops : min= 11, max= 37, avg=24.57, stdev= 6.40, samples=30 lat (usec) : 50=0.52%, 100=1.17%, 250=2.34%, 500=0.13% lat (msec) : 2=1.95%, 4=5.34%, 10=14.84%, 20=31.77%, 50=37.11% lat (msec) : 100=4.56%, 250=0.26% cpu : usr=0.08%, sys=17.84%, ctx=2265, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1491KiB/s (1527kB/s), 369KiB/s-391KiB/s (378kB/s-400kB/s), io=23.4MiB (24.5MB), run=15434-16064msec WRITE: bw=1569KiB/s (1606kB/s), 375KiB/s-421KiB/s (385kB/s-431kB/s), io=24.6MiB (25.8MB), run=15434-16064msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193012: Thu Oct 1 15:08:13 2026 read: IOPS=19, BW=308KiB/s (315kB/s)(5920KiB/19219msec) clat (msec): min=4, max=101, avg=20.47, stdev=18.18 lat (msec): min=4, max=101, avg=20.48, stdev=18.18 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 32], 90.00th=[ 48], 95.00th=[ 61], | 99.00th=[ 83], 99.50th=[ 101], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 95, max= 960, per=24.55%, avg=305.95, stdev=210.48, samples=38 iops : min= 5, max= 60, avg=18.58, stdev=13.23, samples=38 write: IOPS=20, BW=331KiB/s (339kB/s)(6368KiB/19219msec); 0 zone resets clat (msec): min=6, max=123, avg=29.14, stdev=20.66 lat (msec): min=6, max=123, avg=29.14, stdev=20.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 59], 95.00th=[ 69], | 99.00th=[ 104], 99.50th=[ 108], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 63, max= 894, per=25.23%, avg=330.79, stdev=215.25, samples=38 iops : min= 3, max= 55, avg=20.13, stdev=13.53, samples=38 lat (msec) : 10=20.44%, 20=37.11%, 50=29.95%, 100=11.85%, 250=0.65% cpu : usr=0.08%, sys=6.64%, ctx=1295, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193013: Thu Oct 1 15:08:13 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(5744KiB/19046msec) clat (msec): min=3, max=119, avg=20.25, stdev=18.43 lat (msec): min=3, max=119, avg=20.25, stdev=18.43 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 63], | 99.00th=[ 90], 99.50th=[ 100], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 53, max= 896, per=23.85%, avg=297.14, stdev=199.40, samples=37 iops : min= 3, max= 56, avg=18.03, stdev=12.48, samples=37 write: IOPS=21, BW=344KiB/s (352kB/s)(6544KiB/19046msec); 0 zone resets clat (msec): min=5, max=137, avg=28.36, stdev=19.77 lat (msec): min=5, max=137, avg=28.37, stdev=19.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 43], 90.00th=[ 55], 95.00th=[ 69], | 99.00th=[ 100], 99.50th=[ 104], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 96, max= 958, per=25.35%, avg=332.35, stdev=199.36, samples=37 iops : min= 6, max= 59, avg=20.22, stdev=12.50, samples=37 lat (msec) : 4=0.13%, 10=19.53%, 20=36.20%, 50=33.72%, 100=9.77% lat (msec) : 250=0.65% cpu : usr=0.07%, sys=6.74%, ctx=1249, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193014: Thu Oct 1 15:08:13 2026 read: IOPS=20, BW=330KiB/s (338kB/s)(6256KiB/18934msec) clat (usec): min=3624, max=93166, avg=19095.46, stdev=15526.33 lat (usec): min=3624, max=93167, avg=19096.63, stdev=15526.30 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 5407], 10.00th=[ 5932], 20.00th=[ 7504], | 30.00th=[ 9241], 40.00th=[11338], 50.00th=[13304], 60.00th=[16319], | 70.00th=[20579], 80.00th=[28443], 90.00th=[42206], 95.00th=[52691], | 99.00th=[72877], 99.50th=[91751], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 95, max= 1056, per=26.38%, avg=328.68, stdev=218.58, samples=37 iops : min= 5, max= 66, avg=20.00, stdev=13.67, samples=37 write: IOPS=19, BW=319KiB/s (326kB/s)(6032KiB/18934msec); 0 zone resets clat (msec): min=7, max=135, avg=30.10, stdev=20.79 lat (msec): min=7, max=135, avg=30.11, stdev=20.79 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 47], 90.00th=[ 60], 95.00th=[ 67], | 99.00th=[ 96], 99.50th=[ 122], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 96, max= 864, per=23.81%, avg=312.11, stdev=187.85, samples=37 iops : min= 6, max= 54, avg=18.95, stdev=11.79, samples=37 lat (msec) : 4=0.26%, 10=19.14%, 20=37.89%, 50=31.90%, 100=10.42% lat (msec) : 250=0.39% cpu : usr=0.08%, sys=6.80%, ctx=1279, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193015: Thu Oct 1 15:08:13 2026 read: IOPS=19, BW=315KiB/s (322kB/s)(6032KiB/19156msec) clat (usec): min=4318, max=98478, avg=19764.44, stdev=17943.68 lat (usec): min=4319, max=98480, avg=19765.40, stdev=17943.66 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5342], 10.00th=[ 6390], 20.00th=[ 7439], | 30.00th=[ 8455], 40.00th=[10683], 50.00th=[13435], 60.00th=[16319], | 70.00th=[20579], 80.00th=[26608], 90.00th=[47973], 95.00th=[63177], | 99.00th=[88605], 99.50th=[93848], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 106, max= 832, per=24.17%, avg=301.11, stdev=188.58, samples=37 iops : min= 6, max= 52, avg=18.27, stdev=11.82, samples=37 write: IOPS=20, BW=327KiB/s (334kB/s)(6256KiB/19156msec); 0 zone resets clat (msec): min=7, max=123, avg=29.60, stdev=20.58 lat (msec): min=7, max=123, avg=29.61, stdev=20.58 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 59], 95.00th=[ 71], | 99.00th=[ 101], 99.50th=[ 106], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 158, max= 960, per=24.07%, avg=315.57, stdev=201.15, samples=37 iops : min= 9, max= 60, avg=19.16, stdev=12.60, samples=37 lat (msec) : 10=20.57%, 20=37.11%, 50=30.47%, 100=11.33%, 250=0.52% cpu : usr=0.09%, sys=6.68%, ctx=1289, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1246KiB/s (1276kB/s), 302KiB/s-330KiB/s (309kB/s-338kB/s), io=23.4MiB (24.5MB), run=18934-19219msec WRITE: bw=1311KiB/s (1343kB/s), 319KiB/s-344KiB/s (326kB/s-352kB/s), io=24.6MiB (25.8MB), run=18934-19219msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193022: Thu Oct 1 15:08:22 2026 read: IOPS=1, BW=1968KiB/s (2015kB/s)(7168KiB/3643msec) clat (usec): min=486, max=1539.3k, avg=287668.80, stdev=555254.50 lat (usec): min=487, max=1539.3k, avg=287670.08, stdev=555254.82 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], | 20.00th=[ 914], 30.00th=[ 79168], 40.00th=[ 79168], | 50.00th=[ 101188], 60.00th=[ 131597], 70.00th=[ 131597], | 80.00th=[ 160433], 90.00th=[1535116], 95.00th=[1535116], | 99.00th=[1535116], 99.50th=[1535116], 99.90th=[1535116], | 99.95th=[1535116], 99.99th=[1535116] bw ( KiB/s): min= 2048, max= 6144, per=59.65%, avg=3072.00, stdev=2048.00, samples=4 iops : min= 2, max= 6, avg= 3.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1405KiB/s (1439kB/s)(5120KiB/3643msec); 0 zone resets clat (msec): min=207, max=477, avg=321.21, stdev=99.41 lat (msec): min=207, max=477, avg=321.30, stdev=99.48 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2031, max= 2048, per=28.34%, avg=2043.75, stdev= 8.50, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=27.16%, ctx=1162, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193023: Thu Oct 1 15:08:22 2026 read: IOPS=0, BW=515KiB/s (527kB/s)(2048KiB/3976msec) clat (msec): min=193, max=1639, avg=916.59, stdev=1023.05 lat (msec): min=193, max=1639, avg=916.59, stdev=1023.05 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 2031, max= 2048, per=39.60%, avg=2039.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2575KiB/s (2637kB/s)(10.0MiB/3976msec); 0 zone resets clat (msec): min=104, max=390, avg=207.47, stdev=96.02 lat (msec): min=104, max=391, avg=207.53, stdev=96.02 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 114], | 30.00th=[ 134], 40.00th=[ 163], 50.00th=[ 174], 60.00th=[ 194], | 70.00th=[ 197], 80.00th=[ 268], 90.00th=[ 338], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 4063, max= 6144, per=63.79%, avg=4599.75, stdev=1029.62, samples=4 iops : min= 3, max= 6, avg= 4.25, stdev= 1.26, samples=4 lat (msec) : 250=66.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=38.26%, ctx=599, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193024: Thu Oct 1 15:08:22 2026 read: IOPS=1, BW=1781KiB/s (1824kB/s)(6144KiB/3450msec) clat (usec): min=496, max=207992, avg=101625.53, stdev=103820.23 lat (usec): min=497, max=207994, avg=101626.46, stdev=103820.16 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 660], | 30.00th=[ 660], 40.00th=[ 20579], 50.00th=[ 20579], 60.00th=[187696], | 70.00th=[191890], 80.00th=[191890], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 4063, max= 6144, per=99.10%, avg=5103.50, stdev=1471.49, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1781KiB/s (1824kB/s)(6144KiB/3450msec); 0 zone resets clat (msec): min=127, max=1673, avg=459.14, stdev=601.39 lat (msec): min=127, max=1673, avg=459.22, stdev=601.38 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 205], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 2031, max= 3385, per=32.98%, avg=2378.00, stdev=671.38, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=8.33%, 250=58.33%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=28.96%, ctx=299, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193025: Thu Oct 1 15:08:22 2026 read: IOPS=1, BW=1538KiB/s (1574kB/s)(5120KiB/3330msec) clat (usec): min=475, max=219891, avg=61671.51, stdev=95980.98 lat (usec): min=476, max=219891, avg=61672.45, stdev=95981.01 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 652], 40.00th=[ 652], 50.00th=[ 660], 60.00th=[ 660], | 70.00th=[ 86508], 80.00th=[ 86508], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 2048, max= 6095, per=79.06%, avg=4071.50, stdev=2861.66, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2153KiB/s (2204kB/s)(7168KiB/3330msec); 0 zone resets clat (msec): min=155, max=1707, avg=422.84, stdev=570.65 lat (msec): min=155, max=1707, avg=422.90, stdev=570.66 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 161], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 171], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 338], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1692, max= 4096, per=34.21%, avg=2466.75, stdev=1098.47, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=29.14%, ctx=372, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5151KiB/s (5275kB/s), 515KiB/s-1968KiB/s (527kB/s-2015kB/s), io=20.0MiB (20.0MB), run=3330-3976msec WRITE: bw=7211KiB/s (7384kB/s), 1405KiB/s-2575KiB/s (1439kB/s-2637kB/s), io=28.0MiB (29.4MB), run=3330-3976msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193027: Thu Oct 1 15:08:23 2026 read: IOPS=1, BW=1686KiB/s (1726kB/s)(7168KiB/4252msec) clat (msec): min=57, max=1468, avg=429.78, stdev=541.33 lat (msec): min=57, max=1468, avg=429.78, stdev=541.33 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 77], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 818], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 2007, max= 4039, per=62.34%, avg=3002.25, stdev=1126.81, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1204KiB/s (1233kB/s)(5120KiB/4252msec); 0 zone resets clat (msec): min=113, max=403, avg=231.32, stdev=126.46 lat (msec): min=113, max=403, avg=231.39, stdev=126.46 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2031, max= 6023, per=59.72%, avg=4027.00, stdev=2822.77, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.05%, sys=10.68%, ctx=342, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193028: Thu Oct 1 15:08:23 2026 read: IOPS=0, BW=489KiB/s (501kB/s)(2048KiB/4185msec) clat (msec): min=102, max=1503, avg=802.79, stdev=991.02 lat (msec): min=102, max=1503, avg=802.79, stdev=991.02 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 1957, max= 2043, per=41.53%, avg=2000.00, stdev=60.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2447KiB/s (2506kB/s)(10.0MiB/4185msec); 0 zone resets clat (msec): min=74, max=526, avg=238.72, stdev=147.22 lat (msec): min=74, max=526, avg=238.79, stdev=147.22 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 117], | 30.00th=[ 132], 40.00th=[ 178], 50.00th=[ 186], 60.00th=[ 194], | 70.00th=[ 226], 80.00th=[ 305], 90.00th=[ 451], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2019, max= 6095, per=66.93%, avg=4513.00, stdev=1945.98, samples=4 iops : min= 1, max= 5, avg= 3.50, stdev= 1.91, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.12%, ctx=366, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193029: Thu Oct 1 15:08:23 2026 read: IOPS=1, BW=1473KiB/s (1508kB/s)(6144KiB/4171msec) clat (msec): min=54, max=483, avg=206.77, stdev=188.23 lat (msec): min=54, max=483, avg=206.77, stdev=188.23 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 118], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 2019, max= 6023, per=69.72%, avg=3357.67, stdev=2308.25, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1473KiB/s (1508kB/s)(6144KiB/4171msec); 0 zone resets clat (msec): min=36, max=1806, avg=456.11, stdev=686.77 lat (msec): min=36, max=1806, avg=456.19, stdev=686.77 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 55], | 30.00th=[ 55], 40.00th=[ 77], 50.00th=[ 77], 60.00th=[ 236], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1957, max= 4015, per=42.69%, avg=2878.75, stdev=1048.21, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=9.16%, ctx=117, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193030: Thu Oct 1 15:08:23 2026 read: IOPS=1, BW=1234KiB/s (1264kB/s)(5120KiB/4149msec) clat (msec): min=77, max=195, avg=123.15, stdev=46.70 lat (msec): min=77, max=195, avg=123.15, stdev=46.70 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 108], 60.00th=[ 108], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 7831, max= 7831, per=100.00%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1728KiB/s (1769kB/s)(7168KiB/4149msec); 0 zone resets clat (msec): min=115, max=1772, avg=486.14, stdev=584.52 lat (msec): min=115, max=1773, avg=486.21, stdev=584.50 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 120], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 292], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 535], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 1738, max= 6023, per=51.32%, avg=3460.75, stdev=1997.86, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=12.68%, ctx=143, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4817KiB/s (4932kB/s), 489KiB/s-1686KiB/s (501kB/s-1726kB/s), io=20.0MiB (20.0MB), run=4149-4252msec WRITE: bw=6743KiB/s (6905kB/s), 1204KiB/s-2447KiB/s (1233kB/s-2506kB/s), io=28.0MiB (29.4MB), run=4149-4252msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193036: Thu Oct 1 15:08:31 2026 read: IOPS=2, BW=9394KiB/s (9620kB/s)(12.0MiB/1308msec) clat (msec): min=328, max=494, avg=428.26, stdev=88.26 lat (msec): min=328, max=494, avg=428.26, stdev=88.26 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 5665, max= 8192, per=71.68%, avg=6928.50, stdev=1786.86, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=43.23%, ctx=1526, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193037: Thu Oct 1 15:08:31 2026 read: IOPS=0, BW=2417KiB/s (2475kB/s)(4096KiB/1695msec) clat (nsec): min=388556k, max=388556k, avg=388556350.00, stdev= 0.00 lat (nsec): min=388562k, max=388562k, avg=388561828.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7571, max= 7571, per=78.33%, avg=7571.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4833KiB/s (4949kB/s)(8192KiB/1695msec); 0 zone resets clat (msec): min=446, max=817, avg=632.12, stdev=262.76 lat (msec): min=446, max=818, avg=632.45, stdev=262.69 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8192, max= 8192, per=57.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.06%, ctx=656, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193038: Thu Oct 1 15:08:31 2026 write: IOPS=1, BW=5373KiB/s (5502kB/s)(12.0MiB/2287msec); 0 zone resets clat (msec): min=84, max=1711, avg=743.24, stdev=856.56 lat (msec): min=84, max=1712, avg=743.67, stdev=856.79 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 7772, max= 7772, per=54.25%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.44%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193040: Thu Oct 1 15:08:31 2026 write: IOPS=1, BW=6373KiB/s (6526kB/s)(12.0MiB/1928msec); 0 zone resets clat (msec): min=283, max=1160, avg=620.31, stdev=472.33 lat (msec): min=283, max=1160, avg=623.61, stdev=470.39 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7353, max= 8192, per=54.25%, avg=7772.50, stdev=593.26, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.00%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9666KiB/s (9898kB/s), 2417KiB/s-9394KiB/s (2475kB/s-9620kB/s), io=16.0MiB (16.8MB), run=1308-1695msec WRITE: bw=13.0MiB/s (14.7MB/s), 4833KiB/s-6373KiB/s (4949kB/s-6526kB/s), io=32.0MiB (33.6MB), run=1695-2287msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193041: Thu Oct 1 15:08:31 2026 read: IOPS=1, BW=6035KiB/s (6180kB/s)(12.0MiB/2036msec) clat (msec): min=214, max=1335, avg=660.74, stdev=594.53 lat (msec): min=214, max=1335, avg=660.74, stdev=594.53 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.15%, ctx=74, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193042: Thu Oct 1 15:08:31 2026 read: IOPS=0, BW=2053KiB/s (2102kB/s)(4096KiB/1995msec) clat (nsec): min=386056k, max=386056k, avg=386056141.00, stdev= 0.00 lat (nsec): min=386058k, max=386058k, avg=386057920.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 5490, max= 5490, per=68.22%, avg=5490.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4106KiB/s (4205kB/s)(8192KiB/1995msec); 0 zone resets clat (msec): min=497, max=1094, avg=796.34, stdev=422.19 lat (msec): min=498, max=1095, avg=796.67, stdev=422.16 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8192, max= 8192, per=51.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.99%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193043: Thu Oct 1 15:08:31 2026 write: IOPS=1, BW=7082KiB/s (7252kB/s)(12.0MiB/1735msec); 0 zone resets clat (msec): min=304, max=880, avg=570.50, stdev=290.22 lat (msec): min=304, max=880, avg=570.75, stdev=290.28 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8159, max= 8159, per=51.27%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.06%, sys=13.32%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193044: Thu Oct 1 15:08:31 2026 write: IOPS=1, BW=5968KiB/s (6111kB/s)(12.0MiB/2059msec); 0 zone resets clat (msec): min=464, max=863, avg=678.58, stdev=201.42 lat (msec): min=464, max=864, avg=678.87, stdev=201.44 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8159, max= 8192, per=51.37%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=11.37%, ctx=84, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8047KiB/s (8240kB/s), 2053KiB/s-6035KiB/s (2102kB/s-6180kB/s), io=16.0MiB (16.8MB), run=1995-2036msec WRITE: bw=15.5MiB/s (16.3MB/s), 4106KiB/s-7082KiB/s (4205kB/s-7252kB/s), io=32.0MiB (33.6MB), run=1735-2059msec