== sanity test 398b: DIO and buffer IO race ============== 12:21:38 (1786638098) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.50066 s, 6.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178475: Thu Aug 13 12:24:16 2026 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(5992KiB/132170msec) clat (usec): min=38, max=1182.6k, avg=49025.73, stdev=43185.01 lat (usec): min=38, max=1182.6k, avg=49031.39, stdev=43191.03 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10159], 10.00th=[ 17433], | 20.00th=[ 24249], 30.00th=[ 30540], 40.00th=[ 35390], | 50.00th=[ 42206], 60.00th=[ 48497], 70.00th=[ 56886], | 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[ 105382], | 99.00th=[ 164627], 99.50th=[ 191890], 99.90th=[ 231736], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 119, per=25.13%, avg=45.48, stdev=18.54, samples=256 iops : min= 1, max= 29, avg=10.75, stdev= 4.69, samples=256 write: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6296KiB/132170msec); 0 zone resets clat (usec): min=849, max=350389, avg=37183.30, stdev=38570.00 lat (usec): min=850, max=350390, avg=37186.17, stdev=38571.06 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1549], 20.00th=[ 3884], | 30.00th=[ 8455], 40.00th=[ 17695], 50.00th=[ 26608], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 65274], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[170918], 99.50th=[179307], 99.90th=[312476], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 125, per=25.20%, avg=47.88, stdev=22.69, samples=256 iops : min= 1, max= 31, avg=11.35, stdev= 5.73, samples=256 lat (usec) : 50=0.26%, 100=1.86%, 250=0.07%, 500=0.03%, 1000=0.10% lat (msec) : 2=6.12%, 4=4.23%, 10=6.35%, 20=9.15%, 50=38.25% lat (msec) : 100=26.92%, 250=6.58%, 500=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.02%, ctx=6448, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178476: Thu Aug 13 12:24:16 2026 read: IOPS=11, BW=45.9KiB/s (46.0kB/s)(5940KiB/129539msec) clat (usec): min=34, max=1003.2k, avg=47722.41, stdev=42530.50 lat (usec): min=34, max=1003.2k, avg=47724.89, stdev=42530.65 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9765], 10.00th=[ 16319], | 20.00th=[ 22938], 30.00th=[ 28705], 40.00th=[ 33817], | 50.00th=[ 39584], 60.00th=[ 45876], 70.00th=[ 55313], | 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[ 105382], | 99.00th=[ 181404], 99.50th=[ 208667], 99.90th=[ 450888], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 127, per=25.28%, avg=45.76, stdev=20.82, samples=253 iops : min= 1, max= 31, avg=10.81, stdev= 5.25, samples=253 write: IOPS=12, BW=49.0KiB/s (50.2kB/s)(6348KiB/129539msec); 0 zone resets clat (usec): min=889, max=281797, avg=36869.93, stdev=39628.82 lat (usec): min=891, max=281797, avg=36871.69, stdev=39629.05 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1483], 20.00th=[ 3720], | 30.00th=[ 8455], 40.00th=[ 16450], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 61080], 90.00th=[ 91751], 95.00th=[114820], | 99.00th=[175113], 99.50th=[212861], 99.90th=[267387], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 136, per=25.85%, avg=49.12, stdev=23.80, samples=251 iops : min= 1, max= 34, avg=11.67, stdev= 6.00, samples=251 lat (usec) : 50=0.23%, 100=1.63%, 250=0.07%, 750=0.07%, 1000=0.07% lat (msec) : 2=7.23%, 4=3.61%, 10=6.15%, 20=10.51%, 50=39.26% lat (msec) : 100=24.35%, 250=6.58%, 500=0.23%, 2000=0.03% cpu : usr=0.09%, sys=5.07%, ctx=6343, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178478: Thu Aug 13 12:24:16 2026 read: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6028KiB/130310msec) clat (usec): min=32, max=301784, avg=47317.39, stdev=32834.30 lat (usec): min=33, max=301785, avg=47323.62, stdev=32832.61 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 12256], 10.00th=[ 17171], 20.00th=[ 23725], | 30.00th=[ 28705], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[108528], | 99.00th=[164627], 99.50th=[196084], 99.90th=[295699], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 127, per=25.60%, avg=46.33, stdev=20.46, samples=254 iops : min= 1, max= 31, avg=10.97, stdev= 5.16, samples=254 write: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6260KiB/130310msec); 0 zone resets clat (usec): min=977, max=994038, avg=37558.43, stdev=46109.24 lat (usec): min=978, max=994040, avg=37594.73, stdev=46259.85 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1647], 20.00th=[ 4424], | 30.00th=[ 8225], 40.00th=[ 17171], 50.00th=[ 25822], 60.00th=[ 35390], | 70.00th=[ 46924], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[113771], | 99.00th=[185598], 99.50th=[212861], 99.90th=[256902], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 132, per=25.63%, avg=48.70, stdev=23.71, samples=251 iops : min= 1, max= 33, avg=11.57, stdev= 6.00, samples=251 lat (usec) : 50=0.29%, 100=1.53%, 250=0.13%, 1000=0.13% lat (msec) : 2=5.76%, 4=3.84%, 10=7.36%, 20=9.83%, 50=39.23% lat (msec) : 100=24.87%, 250=6.84%, 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=5.00%, ctx=6321, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178479: Thu Aug 13 12:24:16 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6052KiB/132140msec) clat (usec): min=20, max=381329, avg=47174.34, stdev=33443.74 lat (usec): min=20, max=381330, avg=47177.76, stdev=33444.54 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 2704], 10.00th=[ 17433], 20.00th=[ 22938], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[164627], 99.50th=[196084], 99.90th=[254804], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 111, per=25.25%, avg=45.69, stdev=20.03, samples=258 iops : min= 1, max= 27, avg=10.81, stdev= 5.05, samples=258 write: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6236KiB/132140msec); 0 zone resets clat (usec): min=1101, max=993563, avg=38818.54, stdev=45920.10 lat (usec): min=1102, max=993565, avg=38823.88, stdev=45919.93 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1516], 20.00th=[ 4080], | 30.00th=[ 8586], 40.00th=[ 17957], 50.00th=[ 27657], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 66323], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[177210], 99.50th=[196084], 99.90th=[270533], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 119, per=24.74%, avg=47.00, stdev=23.05, samples=258 iops : min= 1, max= 29, avg=11.14, stdev= 5.82, samples=258 lat (usec) : 50=0.36%, 100=1.79%, 250=0.23%, 500=0.03%, 1000=0.03% lat (msec) : 2=6.35%, 4=3.78%, 10=6.22%, 20=9.70%, 50=38.28% lat (msec) : 100=26.30%, 250=6.80%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.03%, ctx=6415, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=182KiB/s (186kB/s), 45.3KiB/s-46.3KiB/s (46.4kB/s-47.4kB/s), io=23.4MiB (24.6MB), run=129539-132170msec WRITE: bw=190KiB/s (195kB/s), 47.2KiB/s-49.0KiB/s (48.3kB/s-50.2kB/s), io=24.6MiB (25.7MB), run=129539-132170msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178470: Thu Aug 13 12:24:54 2026 read: IOPS=8, BW=35.4KiB/s (36.2kB/s)(5992KiB/169261msec) clat (msec): min=5, max=1297, avg=44.63, stdev=53.91 lat (msec): min=5, max=1297, avg=44.63, stdev=53.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 100], 95.00th=[ 133], | 99.00th=[ 224], 99.50th=[ 255], 99.90th=[ 418], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 166, per=25.80%, avg=36.12, stdev=26.05, samples=322 iops : min= 1, max= 41, avg= 8.35, stdev= 6.57, samples=322 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6296KiB/169261msec); 0 zone resets clat (msec): min=10, max=494, avg=64.70, stdev=46.82 lat (msec): min=10, max=494, avg=64.70, stdev=46.82 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 95], 90.00th=[ 127], 95.00th=[ 157], | 99.00th=[ 224], 99.50th=[ 259], 99.90th=[ 384], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 134, per=25.35%, avg=37.27, stdev=24.64, samples=328 iops : min= 1, max= 33, avg= 8.63, stdev= 6.22, samples=328 lat (msec) : 10=2.51%, 20=15.85%, 50=43.55%, 100=24.12%, 250=13.35% lat (msec) : 500=0.59%, 2000=0.03% cpu : usr=0.05%, sys=2.02%, ctx=4764, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178471: Thu Aug 13 12:24:54 2026 read: IOPS=8, BW=34.9KiB/s (35.7kB/s)(5940KiB/170241msec) clat (msec): min=5, max=1034, avg=43.81, stdev=50.70 lat (msec): min=5, max=1034, avg=43.81, stdev=50.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 93], 95.00th=[ 127], | 99.00th=[ 224], 99.50th=[ 266], 99.90th=[ 409], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 158, per=26.06%, avg=36.49, stdev=27.32, samples=316 iops : min= 1, max= 39, avg= 8.45, stdev= 6.90, samples=316 write: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6348KiB/170241msec); 0 zone resets clat (msec): min=8, max=392, avg=65.92, stdev=50.34 lat (msec): min=8, max=392, avg=65.93, stdev=50.34 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 75], 80.00th=[ 99], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 251], 99.50th=[ 292], 99.90th=[ 363], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 127, per=25.64%, avg=37.69, stdev=24.99, samples=327 iops : min= 1, max= 31, avg= 8.74, stdev= 6.30, samples=327 lat (msec) : 10=2.44%, 20=15.95%, 50=43.98%, 100=23.70%, 250=13.12% lat (msec) : 500=0.78%, 2000=0.03% cpu : usr=0.06%, sys=2.01%, ctx=4891, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178472: Thu Aug 13 12:24:54 2026 read: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6028KiB/170381msec) clat (msec): min=5, max=429, avg=45.44, stdev=44.43 lat (msec): min=5, max=429, avg=45.44, stdev=44.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 67], 90.00th=[ 100], 95.00th=[ 131], | 99.00th=[ 220], 99.50th=[ 264], 99.90th=[ 338], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 183, per=25.66%, avg=35.92, stdev=25.95, samples=325 iops : min= 1, max= 45, avg= 8.30, stdev= 6.54, samples=325 write: IOPS=9, BW=36.7KiB/s (37.6kB/s)(6260KiB/170381msec); 0 zone resets clat (msec): min=11, max=1026, avg=64.73, stdev=52.23 lat (msec): min=11, max=1026, avg=64.73, stdev=52.23 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 93], 90.00th=[ 130], 95.00th=[ 161], | 99.00th=[ 222], 99.50th=[ 259], 99.90th=[ 338], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 127, per=24.93%, avg=36.65, stdev=24.76, samples=331 iops : min= 1, max= 31, avg= 8.49, stdev= 6.25, samples=331 lat (msec) : 10=2.05%, 20=15.85%, 50=43.59%, 100=24.41%, 250=13.51% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.06%, sys=1.95%, ctx=4843, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178473: Thu Aug 13 12:24:54 2026 read: IOPS=8, BW=35.5KiB/s (36.3kB/s)(6052KiB/170614msec) clat (msec): min=4, max=333, avg=45.26, stdev=44.25 lat (msec): min=4, max=333, avg=45.26, stdev=44.25 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 67], 90.00th=[ 103], 95.00th=[ 142], | 99.00th=[ 213], 99.50th=[ 257], 99.90th=[ 330], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 150, per=26.16%, avg=36.63, stdev=26.77, samples=321 iops : min= 1, max= 37, avg= 8.48, stdev= 6.75, samples=321 write: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6236KiB/170614msec); 0 zone resets clat (msec): min=10, max=1037, avg=65.15, stdev=54.48 lat (msec): min=10, max=1037, avg=65.15, stdev=54.48 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 96], 90.00th=[ 133], 95.00th=[ 159], | 99.00th=[ 241], 99.50th=[ 292], 99.90th=[ 506], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 181, per=24.96%, avg=36.68, stdev=25.25, samples=330 iops : min= 1, max= 45, avg= 8.49, stdev= 6.37, samples=330 lat (msec) : 10=2.38%, 20=15.95%, 50=43.85%, 100=23.21%, 250=13.96% lat (msec) : 500=0.59%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.97%, ctx=4804, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=141KiB/s (144kB/s), 34.9KiB/s-35.5KiB/s (35.7kB/s-36.3kB/s), io=23.4MiB (24.6MB), run=169261-170614msec WRITE: bw=147KiB/s (151kB/s), 36.5KiB/s-37.3KiB/s (37.4kB/s-38.2kB/s), io=24.6MiB (25.7MB), run=169261-170614msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178527: Thu Aug 13 12:25:40 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5920KiB/35236msec) clat (usec): min=52, max=296906, avg=51379.24, stdev=36564.26 lat (usec): min=53, max=296907, avg=51380.50, stdev=36564.29 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 11076], 20.00th=[ 26346], | 30.00th=[ 32375], 40.00th=[ 40109], 50.00th=[ 45351], 60.00th=[ 54789], | 70.00th=[ 62653], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[185598], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 62, max= 350, per=24.59%, avg=166.96, stdev=70.15, samples=69 iops : min= 3, max= 21, avg= 9.65, stdev= 4.43, samples=69 write: IOPS=11, BW=181KiB/s (185kB/s)(6368KiB/35236msec); 0 zone resets clat (usec): min=1664, max=197325, avg=40531.12, stdev=38266.50 lat (usec): min=1666, max=197328, avg=40533.87, stdev=38266.27 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2311], 10.00th=[ 4883], 20.00th=[ 7832], | 30.00th=[ 12518], 40.00th=[ 20055], 50.00th=[ 28705], 60.00th=[ 36439], | 70.00th=[ 52691], 80.00th=[ 71828], 90.00th=[100140], 95.00th=[119014], | 99.00th=[164627], 99.50th=[187696], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 350, per=25.14%, avg=179.72, stdev=77.30, samples=69 iops : min= 1, max= 21, avg=10.46, stdev= 4.89, samples=69 lat (usec) : 100=3.65%, 250=0.52%, 750=0.13% lat (msec) : 2=1.30%, 4=3.65%, 10=8.98%, 20=8.98%, 50=34.11% lat (msec) : 100=29.95%, 250=8.46%, 500=0.26% cpu : usr=0.07%, sys=5.83%, ctx=1741, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178528: Thu Aug 13 12:25:40 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(5744KiB/35013msec) clat (usec): min=53, max=195796, avg=50334.86, stdev=33549.45 lat (usec): min=54, max=195798, avg=50336.12, stdev=33549.45 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 63], 10.00th=[ 873], 20.00th=[ 26870], | 30.00th=[ 33424], 40.00th=[ 38536], 50.00th=[ 46400], 60.00th=[ 53740], | 70.00th=[ 60031], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[109577], | 99.00th=[173016], 99.50th=[193987], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 318, per=24.00%, avg=162.96, stdev=64.69, samples=68 iops : min= 1, max= 19, avg= 9.41, stdev= 4.12, samples=68 write: IOPS=11, BW=187KiB/s (191kB/s)(6544KiB/35013msec); 0 zone resets clat (usec): min=1571, max=201001, avg=40961.54, stdev=39768.61 lat (usec): min=1574, max=201003, avg=40966.11, stdev=39767.86 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2180], 10.00th=[ 3130], 20.00th=[ 6718], | 30.00th=[ 11731], 40.00th=[ 19268], 50.00th=[ 28705], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 69731], 90.00th=[105382], 95.00th=[127402], | 99.00th=[152044], 99.50th=[156238], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 440, per=25.96%, avg=185.60, stdev=87.37, samples=68 iops : min= 1, max= 27, avg=10.84, stdev= 5.54, samples=68 lat (usec) : 100=4.30%, 250=0.26%, 1000=0.13% lat (msec) : 2=1.56%, 4=4.82%, 10=8.59%, 20=8.33%, 50=35.03% lat (msec) : 100=26.82%, 250=10.16% cpu : usr=0.10%, sys=5.48%, ctx=1746, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178529: Thu Aug 13 12:25:40 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(6256KiB/34231msec) clat (usec): min=40, max=228090, avg=50225.31, stdev=32087.37 lat (usec): min=40, max=228092, avg=50231.83, stdev=32081.62 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 65], 10.00th=[ 15270], 20.00th=[ 27132], | 30.00th=[ 33424], 40.00th=[ 41157], 50.00th=[ 46924], 60.00th=[ 52691], | 70.00th=[ 60556], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[104334], | 99.00th=[160433], 99.50th=[177210], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 63, max= 347, per=26.91%, avg=182.73, stdev=74.16, samples=67 iops : min= 3, max= 21, avg=10.66, stdev= 4.71, samples=67 write: IOPS=11, BW=176KiB/s (180kB/s)(6032KiB/34231msec); 0 zone resets clat (usec): min=1406, max=168403, avg=38208.97, stdev=36930.40 lat (usec): min=1407, max=168406, avg=38211.49, stdev=36930.49 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1991], 10.00th=[ 2540], 20.00th=[ 6128], | 30.00th=[ 10814], 40.00th=[ 18220], 50.00th=[ 28705], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 64226], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[160433], 99.50th=[166724], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 444, per=24.36%, avg=174.18, stdev=82.41, samples=67 iops : min= 1, max= 27, avg=10.12, stdev= 5.22, samples=67 lat (usec) : 50=0.26%, 100=3.52%, 250=0.78% lat (msec) : 2=2.60%, 4=4.82%, 10=7.16%, 20=8.33%, 50=34.90% lat (msec) : 100=30.60%, 250=7.03% cpu : usr=0.07%, sys=5.59%, ctx=1756, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178530: Thu Aug 13 12:25:40 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(6032KiB/33711msec) clat (usec): min=48, max=193874, avg=47016.20, stdev=34063.18 lat (usec): min=49, max=193875, avg=47028.40, stdev=34069.42 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 20055], | 30.00th=[ 29230], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[112722], | 99.00th=[152044], 99.50th=[175113], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 317, per=26.16%, avg=177.62, stdev=67.13, samples=66 iops : min= 1, max= 19, avg=10.33, stdev= 4.21, samples=66 write: IOPS=11, BW=186KiB/s (190kB/s)(6256KiB/33711msec); 0 zone resets clat (usec): min=1377, max=190135, avg=40254.66, stdev=39712.95 lat (usec): min=1379, max=190138, avg=40258.79, stdev=39714.91 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 1958], 10.00th=[ 2933], 20.00th=[ 7046], | 30.00th=[ 11338], 40.00th=[ 17695], 50.00th=[ 27657], 60.00th=[ 38011], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 98042], 95.00th=[125305], | 99.00th=[170918], 99.50th=[173016], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 30, max= 381, per=25.97%, avg=185.70, stdev=80.59, samples=66 iops : min= 1, max= 23, avg=10.85, stdev= 5.09, samples=66 lat (usec) : 50=0.13%, 100=5.99%, 250=0.39%, 500=0.26%, 750=0.26% lat (msec) : 2=2.99%, 4=4.69%, 10=6.64%, 20=9.77%, 50=33.59% lat (msec) : 100=26.69%, 250=8.59% cpu : usr=0.09%, sys=5.75%, ctx=1690, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=680KiB/s (696kB/s), 164KiB/s-183KiB/s (168kB/s-187kB/s), io=23.4MiB (24.5MB), run=33711-35236msec WRITE: bw=715KiB/s (732kB/s), 176KiB/s-187KiB/s (180kB/s-191kB/s), io=24.6MiB (25.8MB), run=33711-35236msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178532: Thu Aug 13 12:25:51 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(5920KiB/46298msec) clat (msec): min=6, max=275, avg=48.42, stdev=42.17 lat (msec): min=6, max=275, avg=48.42, stdev=42.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 70], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 184], 99.50th=[ 213], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 471, per=25.76%, avg=132.69, stdev=88.35, samples=87 iops : min= 1, max= 29, avg= 7.51, stdev= 5.60, samples=87 write: IOPS=8, BW=138KiB/s (141kB/s)(6368KiB/46298msec); 0 zone resets clat (msec): min=15, max=396, avg=71.17, stdev=50.35 lat (msec): min=15, max=396, avg=71.17, stdev=50.35 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 55], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 102], 90.00th=[ 140], 95.00th=[ 163], | 99.00th=[ 268], 99.50th=[ 313], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 405, per=25.50%, avg=138.20, stdev=83.73, samples=90 iops : min= 1, max= 25, avg= 7.86, stdev= 5.32, samples=90 lat (msec) : 10=2.21%, 20=10.16%, 50=46.22%, 100=24.09%, 250=16.54% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.98%, ctx=1228, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178533: Thu Aug 13 12:25:51 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5744KiB/46456msec) clat (msec): min=6, max=294, avg=50.69, stdev=48.20 lat (msec): min=6, max=294, avg=50.69, stdev=48.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 118], 95.00th=[ 167], | 99.00th=[ 239], 99.50th=[ 279], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 25, max= 445, per=24.48%, avg=126.09, stdev=93.32, samples=88 iops : min= 1, max= 27, avg= 7.09, stdev= 5.95, samples=88 write: IOPS=8, BW=141KiB/s (144kB/s)(6544KiB/46456msec); 0 zone resets clat (msec): min=12, max=397, avg=68.98, stdev=49.65 lat (msec): min=12, max=397, avg=68.99, stdev=49.65 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 106], 90.00th=[ 132], 95.00th=[ 157], | 99.00th=[ 236], 99.50th=[ 288], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 31, max= 408, per=25.61%, avg=138.79, stdev=90.36, samples=91 iops : min= 1, max= 25, avg= 7.89, stdev= 5.71, samples=91 lat (msec) : 10=1.43%, 20=11.59%, 50=44.01%, 100=25.39%, 250=16.80% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=2.01%, ctx=1252, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178534: Thu Aug 13 12:25:51 2026 read: IOPS=8, BW=136KiB/s (140kB/s)(6256KiB/45909msec) clat (msec): min=6, max=227, avg=47.77, stdev=41.26 lat (msec): min=6, max=227, avg=47.77, stdev=41.26 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 74], 90.00th=[ 116], 95.00th=[ 136], | 99.00th=[ 188], 99.50th=[ 218], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 30, max= 534, per=27.08%, avg=139.47, stdev=104.28, samples=88 iops : min= 1, max= 33, avg= 7.94, stdev= 6.60, samples=88 write: IOPS=8, BW=131KiB/s (135kB/s)(6032KiB/45909msec); 0 zone resets clat (msec): min=14, max=394, avg=72.09, stdev=53.10 lat (msec): min=14, max=394, avg=72.10, stdev=53.10 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 68], | 70.00th=[ 82], 80.00th=[ 107], 90.00th=[ 148], 95.00th=[ 186], | 99.00th=[ 253], 99.50th=[ 330], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 477, per=23.86%, avg=129.34, stdev=82.29, samples=90 iops : min= 1, max= 29, avg= 7.30, stdev= 5.23, samples=90 lat (msec) : 10=1.17%, 20=14.06%, 50=42.97%, 100=24.87%, 250=16.41% lat (msec) : 500=0.52% cpu : usr=0.07%, sys=1.93%, ctx=1240, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178535: Thu Aug 13 12:25:51 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/45978msec) clat (msec): min=6, max=246, avg=53.70, stdev=46.67 lat (msec): min=6, max=246, avg=53.70, stdev=46.67 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 57], 80.00th=[ 85], 90.00th=[ 127], 95.00th=[ 167], | 99.00th=[ 199], 99.50th=[ 230], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 414, per=25.45%, avg=131.09, stdev=85.71, samples=89 iops : min= 1, max= 25, avg= 7.40, stdev= 5.42, samples=89 write: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/45978msec); 0 zone resets clat (msec): min=11, max=335, avg=65.71, stdev=45.48 lat (msec): min=11, max=335, avg=65.71, stdev=45.47 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 126], 95.00th=[ 159], | 99.00th=[ 211], 99.50th=[ 317], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 565, per=25.19%, avg=136.52, stdev=91.00, samples=89 iops : min= 1, max= 35, avg= 7.75, stdev= 5.79, samples=89 lat (msec) : 10=0.91%, 20=12.11%, 50=42.84%, 100=27.86%, 250=15.89% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.96%, ctx=1231, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=516KiB/s (528kB/s), 124KiB/s-136KiB/s (127kB/s-140kB/s), io=23.4MiB (24.5MB), run=45909-46456msec WRITE: bw=542KiB/s (555kB/s), 131KiB/s-141KiB/s (135kB/s-144kB/s), io=24.6MiB (25.8MB), run=45909-46456msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178548: Thu Aug 13 12:26:10 2026 read: IOPS=0, BW=964KiB/s (987kB/s)(7168KiB/7435msec) clat (usec): min=408, max=2718.3k, avg=470681.72, stdev=994105.60 lat (usec): min=409, max=2718.3k, avg=470683.37, stdev=994105.99 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 408], 10.00th=[ 408], | 20.00th=[ 644], 30.00th=[ 86508], 40.00th=[ 86508], | 50.00th=[ 113771], 60.00th=[ 177210], 70.00th=[ 177210], | 80.00th=[ 196084], 90.00th=[2734687], 95.00th=[2734687], | 99.00th=[2734687], 99.50th=[2734687], 99.90th=[2734687], | 99.95th=[2734687], 99.99th=[2734687] bw ( KiB/s): min= 2039, max= 5885, per=100.00%, avg=4006.67, stdev=1924.56, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=0, BW=689KiB/s (705kB/s)(5120KiB/7435msec); 0 zone resets clat (msec): min=118, max=2859, avg=792.87, stdev=1160.40 lat (msec): min=118, max=2859, avg=792.95, stdev=1160.40 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1992, max= 4079, per=89.44%, avg=2706.33, stdev=1189.09, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=7.26%, ctx=503, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178549: Thu Aug 13 12:26:10 2026 read: IOPS=0, BW=216KiB/s (221kB/s)(2048KiB/9475msec) clat (usec): min=528, max=2815.7k, avg=1408113.67, stdev=1990626.73 lat (usec): min=529, max=2815.7k, avg=1408116.02, stdev=1990627.32 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], | 20.00th=[ 529], 30.00th=[ 529], 40.00th=[ 529], | 50.00th=[ 529], 60.00th=[2801796], 70.00th=[2801796], | 80.00th=[2801796], 90.00th=[2801796], 95.00th=[2801796], | 99.00th=[2801796], 99.50th=[2801796], 99.90th=[2801796], | 99.95th=[2801796], 99.99th=[2801796] bw ( KiB/s): min= 1961, max= 2043, per=92.64%, avg=2002.00, stdev=57.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1081KiB/s (1107kB/s)(10.0MiB/9475msec); 0 zone resets clat (msec): min=149, max=3025, avg=645.93, stdev=852.84 lat (msec): min=149, max=3025, avg=646.01, stdev=852.85 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 262], | 30.00th=[ 266], 40.00th=[ 300], 50.00th=[ 309], 60.00th=[ 388], | 70.00th=[ 506], 80.00th=[ 518], 90.00th=[ 735], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1910, max= 4096, per=85.21%, avg=2578.43, stdev=1029.49, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=8.33%, 500=41.67%, 750=25.00%, >=2000=16.67% cpu : usr=0.01%, sys=7.11%, ctx=561, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178550: Thu Aug 13 12:26:10 2026 read: IOPS=0, BW=731KiB/s (748kB/s)(6144KiB/8406msec) clat (msec): min=238, max=2566, avg=655.80, stdev=937.54 lat (msec): min=238, max=2566, avg=655.81, stdev=937.54 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 284], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1910, max= 2048, per=92.81%, avg=2005.60, stdev=57.85, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=731KiB/s (748kB/s)(6144KiB/8406msec); 0 zone resets clat (msec): min=221, max=2850, avg=740.40, stdev=1037.87 lat (msec): min=221, max=2850, avg=740.49, stdev=1037.88 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 426], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1910, max= 2856, per=71.71%, avg=2169.80, stdev=387.59, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 250=41.67%, 500=41.67%, >=2000=16.67% cpu : usr=0.00%, sys=7.09%, ctx=677, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178551: Thu Aug 13 12:26:10 2026 read: IOPS=0, BW=608KiB/s (622kB/s)(5120KiB/8427msec) clat (usec): min=491, max=2553.7k, avg=677055.37, stdev=1057462.89 lat (usec): min=493, max=2553.7k, avg=677056.61, stdev=1057463.04 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], | 20.00th=[ 494], 30.00th=[ 191890], 40.00th=[ 191890], | 50.00th=[ 283116], 60.00th=[ 283116], 70.00th=[ 358613], | 80.00th=[ 358613], 90.00th=[2566915], 95.00th=[2566915], | 99.00th=[2566915], 99.50th=[2566915], 99.90th=[2566915], | 99.95th=[2566915], 99.99th=[2566915] bw ( KiB/s): min= 2039, max= 5731, per=100.00%, avg=3885.00, stdev=2610.64, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=851KiB/s (871kB/s)(7168KiB/8427msec); 0 zone resets clat (msec): min=244, max=3041, avg=679.05, stdev=1042.12 lat (msec): min=244, max=3041, avg=679.22, stdev=1042.10 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 255], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 321], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1438, max= 3984, per=88.12%, avg=2666.60, stdev=1156.17, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=16.67%, 500=58.33%, >=2000=16.67% cpu : usr=0.00%, sys=5.71%, ctx=222, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2161KiB/s (2213kB/s), 216KiB/s-964KiB/s (221kB/s-987kB/s), io=20.0MiB (20.0MB), run=7435-9475msec WRITE: bw=3026KiB/s (3099kB/s), 689KiB/s-1081KiB/s (705kB/s-1107kB/s), io=28.0MiB (29.4MB), run=7435-9475msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178553: Thu Aug 13 12:26:10 2026 read: IOPS=0, BW=781KiB/s (799kB/s)(7168KiB/9183msec) clat (msec): min=91, max=2473, avg=602.70, stdev=872.18 lat (msec): min=91, max=2473, avg=602.70, stdev=872.18 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 102], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 144], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 877], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1969, max= 2048, per=96.60%, avg=2019.00, stdev=30.09, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=558KiB/s (571kB/s)(5120KiB/9183msec); 0 zone resets clat (msec): min=255, max=2835, avg=921.51, stdev=1095.66 lat (msec): min=255, max=2835, avg=921.84, stdev=1095.50 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1957, max= 2035, per=68.52%, avg=2004.75, stdev=36.34, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 1000=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=2.40%, ctx=98, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178554: Thu Aug 13 12:26:10 2026 read: IOPS=0, BW=209KiB/s (214kB/s)(2048KiB/9799msec) clat (msec): min=163, max=2850, avg=1507.09, stdev=1899.89 lat (msec): min=163, max=2850, avg=1507.09, stdev=1899.89 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 2836], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2039, max= 2039, per=97.56%, avg=2039.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1045KiB/s (1070kB/s)(10.0MiB/9799msec); 0 zone resets clat (msec): min=91, max=3153, avg=640.21, stdev=901.44 lat (msec): min=91, max=3153, avg=640.30, stdev=901.45 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 199], | 30.00th=[ 224], 40.00th=[ 247], 50.00th=[ 351], 60.00th=[ 422], | 70.00th=[ 451], 80.00th=[ 617], 90.00th=[ 659], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1917, max= 6107, per=100.00%, avg=3011.50, stdev=1711.28, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=3.06%, ctx=113, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178555: Thu Aug 13 12:26:10 2026 read: IOPS=0, BW=649KiB/s (664kB/s)(6144KiB/9469msec) clat (msec): min=100, max=3118, avg=776.38, stdev=1165.76 lat (msec): min=100, max=3118, avg=776.38, stdev=1165.76 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 518], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 2003, max= 3835, per=100.00%, avg=2476.00, stdev=906.12, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=649KiB/s (664kB/s)(6144KiB/9469msec); 0 zone resets clat (msec): min=112, max=3049, avg=775.07, stdev=1124.09 lat (msec): min=112, max=3049, avg=775.16, stdev=1124.11 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 414], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 2039, max= 3976, per=86.24%, avg=2523.25, stdev=968.50, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, >=2000=16.67% cpu : usr=0.00%, sys=1.40%, ctx=62, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178556: Thu Aug 13 12:26:10 2026 read: IOPS=0, BW=542KiB/s (555kB/s)(5120KiB/9449msec) clat (msec): min=69, max=852, avg=346.89, stdev=325.78 lat (msec): min=69, max=852, avg=346.89, stdev=325.78 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1957, max= 3992, per=100.00%, avg=2660.00, stdev=1154.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=759KiB/s (777kB/s)(7168KiB/9449msec); 0 zone resets clat (msec): min=60, max=2963, avg=1050.68, stdev=1296.29 lat (msec): min=61, max=2964, avg=1050.80, stdev=1296.28 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 128], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 514], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 2903], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1969, max= 4063, per=83.02%, avg=2429.20, stdev=913.83, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=2.48%, ctx=116, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2090KiB/s (2140kB/s), 209KiB/s-781KiB/s (214kB/s-799kB/s), io=20.0MiB (20.0MB), run=9183-9799msec WRITE: bw=2926KiB/s (2996kB/s), 558KiB/s-1045KiB/s (571kB/s-1070kB/s), io=28.0MiB (29.4MB), run=9183-9799msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178565: Thu Aug 13 12:26:26 2026 read: IOPS=0, BW=4041KiB/s (4138kB/s)(12.0MiB/3041msec) clat (msec): min=824, max=1045, avg=951.31, stdev=114.02 lat (msec): min=824, max=1045, avg=951.31, stdev=114.02 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7937, max= 8126, per=100.00%, avg=8031.50, stdev=133.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.16%, sys=10.95%, ctx=276, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178566: Thu Aug 13 12:26:26 2026 read: IOPS=0, BW=1159KiB/s (1187kB/s)(4096KiB/3535msec) clat (nsec): min=1092.3M, max=1092.3M, avg=1092301612.00, stdev= 0.00 lat (nsec): min=1092.3M, max=1092.3M, avg=1092304358.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2317KiB/s (2373kB/s)(8192KiB/3535msec); 0 zone resets clat (msec): min=1103, max=1199, avg=1151.50, stdev=67.50 lat (msec): min=1104, max=1199, avg=1151.94, stdev=67.50 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8126, max= 8126, per=87.67%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.08%, sys=4.90%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178567: Thu Aug 13 12:26:26 2026 write: IOPS=1, BW=6447KiB/s (6602kB/s)(12.0MiB/1906msec); 0 zone resets clat (msec): min=483, max=718, avg=616.16, stdev=120.38 lat (msec): min=484, max=721, avg=617.34, stdev=121.15 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7049, max= 7816, per=80.19%, avg=7432.50, stdev=542.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=4.72%, ctx=61, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178568: Thu Aug 13 12:26:26 2026 write: IOPS=0, BW=4059KiB/s (4157kB/s)(12.0MiB/3027msec); 0 zone resets clat (msec): min=690, max=1336, avg=984.90, stdev=327.04 lat (msec): min=694, max=1337, avg=986.49, stdev=325.54 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8094, max= 8110, per=87.41%, avg=8102.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.44%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4635KiB/s (4746kB/s), 1159KiB/s-4041KiB/s (1187kB/s-4138kB/s), io=16.0MiB (16.8MB), run=3041-3535msec WRITE: bw=9270KiB/s (9492kB/s), 2317KiB/s-6447KiB/s (2373kB/s-6602kB/s), io=32.0MiB (33.6MB), run=1906-3535msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178570: Thu Aug 13 12:26:27 2026 read: IOPS=0, BW=3650KiB/s (3737kB/s)(12.0MiB/3367msec) clat (msec): min=732, max=1386, avg=1079.65, stdev=329.04 lat (msec): min=732, max=1386, avg=1079.65, stdev=329.04 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.79%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178571: Thu Aug 13 12:26:27 2026 read: IOPS=0, BW=1113KiB/s (1140kB/s)(4096KiB/3680msec) clat (nsec): min=1655.1M, max=1655.1M, avg=1655078395.00, stdev= 0.00 lat (nsec): min=1655.1M, max=1655.1M, avg=1655082617.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1653], 5.00th=[ 1653], 10.00th=[ 1653], 20.00th=[ 1653], | 30.00th=[ 1653], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7787, max= 7787, per=100.00%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2226KiB/s (2280kB/s)(8192KiB/3680msec); 0 zone resets clat (msec): min=591, max=1128, avg=859.92, stdev=379.23 lat (msec): min=592, max=1128, avg=860.28, stdev=379.40 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8126, max= 8126, per=91.51%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.59%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178572: Thu Aug 13 12:26:27 2026 write: IOPS=0, BW=3348KiB/s (3429kB/s)(12.0MiB/3670msec); 0 zone resets clat (msec): min=546, max=1598, avg=1157.31, stdev=545.91 lat (msec): min=547, max=1599, avg=1157.67, stdev=546.01 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8175, max= 8192, per=92.16%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.62%, ctx=38, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178573: Thu Aug 13 12:26:27 2026 write: IOPS=0, BW=3330KiB/s (3410kB/s)(12.0MiB/3690msec); 0 zone resets clat (msec): min=295, max=2351, avg=1136.99, stdev=1077.25 lat (msec): min=302, max=2355, avg=1141.98, stdev=1076.23 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 7953, max= 7953, per=89.56%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=2.87%, ctx=82, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4452KiB/s (4559kB/s), 1113KiB/s-3650KiB/s (1140kB/s-3737kB/s), io=16.0MiB (16.8MB), run=3367-3680msec WRITE: bw=8880KiB/s (9093kB/s), 2226KiB/s-3348KiB/s (2280kB/s-3429kB/s), io=32.0MiB (33.6MB), run=3670-3690msec