== sanity test 398b: DIO and buffer IO race ============== 03:15:18 (1788851718) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.63343 s, 6.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180300: Tue Sep 8 03:17:50 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(5992KiB/128873msec) clat (usec): min=35, max=627777, avg=47514.55, stdev=33796.09 lat (usec): min=35, max=627779, avg=47517.14, stdev=33795.54 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11469], 10.00th=[ 17171], 20.00th=[ 23725], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[145753], 99.50th=[183501], 99.90th=[231736], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 103, per=24.86%, avg=46.00, stdev=18.43, samples=254 iops : min= 1, max= 25, avg=10.83, stdev= 4.62, samples=254 write: IOPS=12, BW=48.9KiB/s (50.0kB/s)(6296KiB/128873msec); 0 zone resets clat (usec): min=798, max=360002, avg=36510.93, stdev=39995.37 lat (usec): min=799, max=360005, avg=36514.22, stdev=39994.87 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1385], 20.00th=[ 3261], | 30.00th=[ 6980], 40.00th=[ 16057], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[170918], 99.50th=[202376], 99.90th=[312476], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 158, per=25.16%, avg=48.55, stdev=23.38, samples=253 iops : min= 1, max= 39, avg=11.46, stdev= 5.85, samples=253 lat (usec) : 50=0.33%, 100=1.17%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=7.26%, 4=4.10%, 10=6.35%, 20=9.34%, 50=38.96% lat (msec) : 100=25.52%, 250=6.35%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=4.62%, ctx=6431, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180301: Tue Sep 8 03:17:50 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(5940KiB/129685msec) clat (usec): min=41, max=704663, avg=48015.28, stdev=36912.16 lat (usec): min=41, max=704664, avg=48018.46, stdev=36912.34 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12780], 10.00th=[ 17171], 20.00th=[ 23200], | 30.00th=[ 28181], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[164627], 99.50th=[198181], 99.90th=[387974], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 5, max= 102, per=24.70%, avg=45.69, stdev=19.39, samples=253 iops : min= 1, max= 25, avg=10.75, stdev= 4.87, samples=253 write: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6348KiB/129685msec); 0 zone resets clat (usec): min=822, max=322233, avg=36685.73, stdev=39737.85 lat (usec): min=824, max=322235, avg=36690.21, stdev=39737.00 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1434], 20.00th=[ 3687], | 30.00th=[ 7570], 40.00th=[ 17171], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 44303], 80.00th=[ 63701], 90.00th=[ 88605], 95.00th=[113771], | 99.00th=[175113], 99.50th=[202376], 99.90th=[283116], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 128, per=25.27%, avg=48.76, stdev=22.93, samples=253 iops : min= 1, max= 32, avg=11.53, stdev= 5.77, samples=253 lat (usec) : 50=0.13%, 100=1.37%, 250=0.10%, 1000=0.20% lat (msec) : 2=6.74%, 4=4.26%, 10=6.41%, 20=10.19%, 50=38.93% lat (msec) : 100=25.20%, 250=6.32%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=4.59%, ctx=6476, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180302: Tue Sep 8 03:17:50 2026 read: IOPS=11, BW=47.1KiB/s (48.3kB/s)(6028KiB/127911msec) clat (usec): min=37, max=348062, avg=47995.75, stdev=33890.07 lat (usec): min=38, max=348063, avg=47997.23, stdev=33890.07 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 12649], 10.00th=[ 17433], 20.00th=[ 23200], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[177210], 99.50th=[202376], 99.90th=[329253], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 112, per=25.38%, avg=46.95, stdev=18.72, samples=251 iops : min= 1, max= 28, avg=11.06, stdev= 4.72, samples=251 write: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6260KiB/127911msec); 0 zone resets clat (usec): min=732, max=739694, avg=35387.75, stdev=41599.89 lat (usec): min=732, max=739698, avg=35389.89, stdev=41599.67 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1369], 20.00th=[ 3261], | 30.00th=[ 6718], 40.00th=[ 15926], 50.00th=[ 25297], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 84411], 95.00th=[108528], | 99.00th=[173016], 99.50th=[204473], 99.90th=[329253], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 125, per=25.22%, avg=48.67, stdev=22.77, samples=251 iops : min= 1, max= 31, avg=11.50, stdev= 5.72, samples=251 lat (usec) : 50=0.26%, 100=1.07%, 250=0.07%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=7.29%, 4=4.30%, 10=5.83%, 20=10.29%, 50=39.45% lat (msec) : 100=25.00%, 250=6.05%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=4.53%, ctx=6450, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180303: Tue Sep 8 03:17:50 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6052KiB/128047msec) clat (usec): min=33, max=365823, avg=46257.82, stdev=32433.36 lat (usec): min=34, max=365824, avg=46269.37, stdev=32467.31 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 8979], 10.00th=[ 16712], 20.00th=[ 22152], | 30.00th=[ 27395], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 55837], 80.00th=[ 65799], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[162530], 99.50th=[185598], 99.90th=[304088], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 104, per=25.58%, avg=47.32, stdev=19.06, samples=249 iops : min= 1, max= 26, avg=11.17, stdev= 4.79, samples=249 write: IOPS=12, BW=48.7KiB/s (49.9kB/s)(6236KiB/128047msec); 0 zone resets clat (usec): min=841, max=822183, avg=37114.79, stdev=44545.62 lat (usec): min=842, max=822184, avg=37120.27, stdev=44543.46 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1352], 20.00th=[ 3228], | 30.00th=[ 7111], 40.00th=[ 16057], 50.00th=[ 24773], 60.00th=[ 34341], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 90702], 95.00th=[113771], | 99.00th=[183501], 99.50th=[212861], 99.90th=[274727], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 111, per=25.06%, avg=48.36, stdev=20.23, samples=251 iops : min= 1, max= 27, avg=11.42, stdev= 5.10, samples=251 lat (usec) : 50=0.33%, 100=1.82%, 250=0.10%, 750=0.03%, 1000=0.20% lat (msec) : 2=7.23%, 4=4.23%, 10=6.12%, 20=10.25%, 50=37.99% lat (msec) : 100=25.10%, 250=6.41%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=4.77%, ctx=6279, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=185KiB/s (190kB/s), 45.8KiB/s-47.3KiB/s (46.9kB/s-48.4kB/s), io=23.4MiB (24.6MB), run=127911-129685msec WRITE: bw=194KiB/s (199kB/s), 48.7KiB/s-48.9KiB/s (49.9kB/s-50.1kB/s), io=24.6MiB (25.7MB), run=127911-129685msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180294: Tue Sep 8 03:18:37 2026 read: IOPS=8, BW=34.1KiB/s (34.0kB/s)(5992KiB/175550msec) clat (msec): min=4, max=944, avg=45.15, stdev=46.24 lat (msec): min=4, max=944, avg=45.15, stdev=46.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 129], | 99.00th=[ 203], 99.50th=[ 257], 99.90th=[ 368], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 135, per=25.92%, avg=34.99, stdev=22.91, samples=332 iops : min= 1, max= 33, avg= 8.08, stdev= 5.76, samples=332 write: IOPS=8, BW=35.9KiB/s (36.7kB/s)(6296KiB/175550msec); 0 zone resets clat (msec): min=9, max=525, avg=68.25, stdev=49.00 lat (msec): min=9, max=525, avg=68.25, stdev=49.00 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 78], 80.00th=[ 97], 90.00th=[ 130], 95.00th=[ 161], | 99.00th=[ 239], 99.50th=[ 262], 99.90th=[ 422], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 127, per=25.30%, avg=35.67, stdev=21.37, samples=342 iops : min= 1, max= 31, avg= 8.25, stdev= 5.37, samples=342 lat (msec) : 10=1.37%, 20=12.53%, 50=45.02%, 100=27.51%, 250=12.89% lat (msec) : 500=0.62%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.59%, ctx=4610, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180295: Tue Sep 8 03:18:37 2026 read: IOPS=8, BW=33.4KiB/s (34.2kB/s)(5940KiB/177829msec) clat (msec): min=5, max=1036, avg=46.06, stdev=47.66 lat (msec): min=5, max=1036, avg=46.06, stdev=47.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 66], 90.00th=[ 99], 95.00th=[ 134], | 99.00th=[ 194], 99.50th=[ 224], 99.90th=[ 296], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 135, per=25.52%, avg=34.45, stdev=24.85, samples=335 iops : min= 1, max= 33, avg= 7.95, stdev= 6.25, samples=335 write: IOPS=8, BW=35.7KiB/s (36.6kB/s)(6348KiB/177829msec); 0 zone resets clat (msec): min=12, max=453, avg=68.65, stdev=49.56 lat (msec): min=12, max=453, avg=68.65, stdev=49.56 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 100], 90.00th=[ 133], 95.00th=[ 161], | 99.00th=[ 257], 99.50th=[ 284], 99.90th=[ 397], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 127, per=25.21%, avg=35.55, stdev=21.77, samples=347 iops : min= 1, max= 31, avg= 8.22, stdev= 5.48, samples=347 lat (msec) : 10=1.56%, 20=12.73%, 50=44.50%, 100=26.46%, 250=13.96% lat (msec) : 500=0.75%, 2000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4688, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180296: Tue Sep 8 03:18:37 2026 read: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6028KiB/176617msec) clat (msec): min=5, max=370, avg=45.49, stdev=41.83 lat (msec): min=5, max=370, avg=45.49, stdev=41.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 100], 95.00th=[ 133], | 99.00th=[ 207], 99.50th=[ 257], 99.90th=[ 292], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 127, per=25.65%, avg=34.62, stdev=23.24, samples=337 iops : min= 1, max= 31, avg= 7.99, stdev= 5.84, samples=337 write: IOPS=8, BW=35.4KiB/s (36.3kB/s)(6260KiB/176617msec); 0 zone resets clat (msec): min=10, max=1054, avg=68.73, stdev=55.04 lat (msec): min=10, max=1054, avg=68.73, stdev=55.04 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 78], 80.00th=[ 97], 90.00th=[ 134], 95.00th=[ 163], | 99.00th=[ 245], 99.50th=[ 288], 99.90th=[ 527], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 119, per=25.14%, avg=35.45, stdev=21.89, samples=342 iops : min= 1, max= 29, avg= 8.19, stdev= 5.50, samples=342 lat (msec) : 10=1.40%, 20=12.89%, 50=44.76%, 100=26.40%, 250=13.87% lat (msec) : 500=0.62%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.63%, ctx=4740, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180297: Tue Sep 8 03:18:37 2026 read: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6052KiB/177321msec) clat (msec): min=5, max=370, avg=45.00, stdev=40.61 lat (msec): min=5, max=370, avg=45.00, stdev=40.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 102], 95.00th=[ 127], | 99.00th=[ 194], 99.50th=[ 230], 99.90th=[ 288], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 128, per=26.08%, avg=35.21, stdev=23.84, samples=334 iops : min= 1, max= 32, avg= 8.14, stdev= 6.01, samples=334 write: IOPS=8, BW=35.2KiB/s (36.0kB/s)(6236KiB/177321msec); 0 zone resets clat (msec): min=11, max=1064, avg=69.77, stdev=55.15 lat (msec): min=11, max=1064, avg=69.78, stdev=55.15 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 134], 95.00th=[ 163], | 99.00th=[ 253], 99.50th=[ 296], 99.90th=[ 409], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 118, per=24.95%, avg=35.17, stdev=20.75, samples=344 iops : min= 1, max= 29, avg= 8.13, stdev= 5.22, samples=344 lat (msec) : 10=1.63%, 20=12.99%, 50=43.72%, 100=26.92%, 250=14.00% lat (msec) : 500=0.72%, 2000=0.03% cpu : usr=0.06%, sys=1.62%, ctx=4798, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=135KiB/s (138kB/s), 33.4KiB/s-34.1KiB/s (34.2kB/s-34.0kB/s), io=23.4MiB (24.6MB), run=175550-177829msec WRITE: bw=141KiB/s (145kB/s), 35.2KiB/s-35.9KiB/s (36.0kB/s-36.7kB/s), io=24.6MiB (25.7MB), run=175550-177829msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180348: Tue Sep 8 03:19:25 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(5920KiB/34100msec) clat (usec): min=32, max=229089, avg=50140.01, stdev=37901.72 lat (usec): min=32, max=229091, avg=50142.04, stdev=37902.87 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 334], 20.00th=[ 22938], | 30.00th=[ 29492], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[206570], 99.50th=[221250], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 62, max= 541, per=25.52%, avg=173.00, stdev=70.71, samples=67 iops : min= 3, max= 33, avg=10.04, stdev= 4.42, samples=67 write: IOPS=11, BW=187KiB/s (191kB/s)(6368KiB/34100msec); 0 zone resets clat (usec): min=1394, max=226907, avg=38934.34, stdev=39101.57 lat (usec): min=1395, max=226907, avg=38942.99, stdev=39113.05 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1745], 10.00th=[ 2507], 20.00th=[ 5342], | 30.00th=[ 9372], 40.00th=[ 16909], 50.00th=[ 25560], 60.00th=[ 38011], | 70.00th=[ 52167], 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[112722], | 99.00th=[168821], 99.50th=[200279], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 479, per=26.03%, avg=185.88, stdev=90.82, samples=67 iops : min= 1, max= 29, avg=10.85, stdev= 5.67, samples=67 lat (usec) : 50=0.52%, 100=4.04%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=4.43%, 4=3.39%, 10=9.11%, 20=7.03%, 50=35.42% lat (msec) : 100=27.21%, 250=8.46% cpu : usr=0.06%, sys=4.81%, ctx=1562, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180350: Tue Sep 8 03:19:25 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5744KiB/33871msec) clat (usec): min=37, max=250640, avg=52205.62, stdev=39279.81 lat (usec): min=37, max=250641, avg=52206.80, stdev=39279.85 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 90], 20.00th=[ 23462], | 30.00th=[ 31589], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 54264], | 70.00th=[ 63177], 80.00th=[ 78119], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[212861], 99.50th=[225444], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 315, per=24.84%, avg=168.41, stdev=70.75, samples=66 iops : min= 1, max= 19, avg= 9.76, stdev= 4.46, samples=66 write: IOPS=12, BW=193KiB/s (198kB/s)(6544KiB/33871msec); 0 zone resets clat (usec): min=973, max=264552, avg=36498.99, stdev=40840.86 lat (usec): min=974, max=264555, avg=36504.94, stdev=40840.98 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1795], 10.00th=[ 2507], 20.00th=[ 5014], | 30.00th=[ 8225], 40.00th=[ 14091], 50.00th=[ 21627], 60.00th=[ 32375], | 70.00th=[ 44303], 80.00th=[ 62653], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[181404], 99.50th=[196084], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 542, per=26.86%, avg=191.77, stdev=97.35, samples=66 iops : min= 1, max= 33, avg=11.21, stdev= 6.15, samples=66 lat (usec) : 50=0.52%, 100=4.17%, 250=0.13%, 1000=0.26% lat (msec) : 2=4.04%, 4=4.30%, 10=9.64%, 20=9.11%, 50=33.59% lat (msec) : 100=25.52%, 250=8.46%, 500=0.26% cpu : usr=0.05%, sys=4.52%, ctx=1534, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180351: Tue Sep 8 03:19:25 2026 read: IOPS=11, BW=177KiB/s (182kB/s)(6256KiB/35276msec) clat (usec): min=35, max=239216, avg=53095.16, stdev=39316.22 lat (usec): min=36, max=239216, avg=53096.54, stdev=39316.18 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 64], 10.00th=[ 7177], 20.00th=[ 23200], | 30.00th=[ 30802], 40.00th=[ 38011], 50.00th=[ 45876], 60.00th=[ 54264], | 70.00th=[ 64750], 80.00th=[ 79168], 90.00th=[104334], 95.00th=[125305], | 99.00th=[187696], 99.50th=[210764], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 414, per=26.22%, avg=177.78, stdev=74.97, samples=69 iops : min= 1, max= 25, avg=10.33, stdev= 4.75, samples=69 write: IOPS=10, BW=171KiB/s (175kB/s)(6032KiB/35276msec); 0 zone resets clat (usec): min=1259, max=164726, avg=38000.91, stdev=36666.50 lat (usec): min=1261, max=164727, avg=38009.29, stdev=36665.42 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1811], 10.00th=[ 2638], 20.00th=[ 5866], | 30.00th=[ 10159], 40.00th=[ 17171], 50.00th=[ 25297], 60.00th=[ 39060], | 70.00th=[ 49021], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[113771], | 99.00th=[154141], 99.50th=[162530], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 31, max= 384, per=24.01%, avg=171.40, stdev=76.57, samples=68 iops : min= 1, max= 24, avg= 9.94, stdev= 4.83, samples=68 lat (usec) : 50=0.13%, 100=4.30%, 500=0.13%, 1000=0.26% lat (msec) : 2=3.12%, 4=4.04%, 10=7.94%, 20=9.51%, 50=33.85% lat (msec) : 100=26.95%, 250=9.77% cpu : usr=0.05%, sys=4.38%, ctx=1590, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180352: Tue Sep 8 03:19:25 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(6032KiB/33414msec) clat (usec): min=40, max=226583, avg=48900.20, stdev=36436.81 lat (usec): min=40, max=226585, avg=48903.21, stdev=36437.65 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 21890], | 30.00th=[ 30278], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 58459], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[126354], | 99.00th=[181404], 99.50th=[200279], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 317, per=26.17%, avg=177.46, stdev=72.74, samples=65 iops : min= 1, max= 19, avg=10.32, stdev= 4.57, samples=65 write: IOPS=11, BW=187KiB/s (192kB/s)(6256KiB/33414msec); 0 zone resets clat (usec): min=1294, max=221315, avg=37865.54, stdev=37437.98 lat (usec): min=1296, max=221317, avg=37877.61, stdev=37465.18 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1762], 10.00th=[ 2999], 20.00th=[ 5932], | 30.00th=[ 9503], 40.00th=[ 16712], 50.00th=[ 26346], 60.00th=[ 38536], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[156238], 99.50th=[175113], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 440, per=25.93%, avg=185.15, stdev=75.23, samples=65 iops : min= 1, max= 27, avg=10.82, stdev= 4.73, samples=65 lat (usec) : 50=0.39%, 100=5.60%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.91%, 4=3.39%, 10=8.85%, 20=8.46%, 50=33.98% lat (msec) : 100=28.13%, 250=7.03% cpu : usr=0.04%, sys=4.59%, ctx=1493, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=679KiB/s (695kB/s), 170KiB/s-181KiB/s (174kB/s-185kB/s), io=23.4MiB (24.5MB), run=33414-35276msec WRITE: bw=714KiB/s (732kB/s), 171KiB/s-193KiB/s (175kB/s-198kB/s), io=24.6MiB (25.8MB), run=33414-35276msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180354: Tue Sep 8 03:19:41 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5920KiB/50529msec) clat (msec): min=8, max=285, avg=52.27, stdev=39.99 lat (msec): min=8, max=285, avg=52.27, stdev=39.99 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 73], 90.00th=[ 100], 95.00th=[ 131], | 99.00th=[ 220], 99.50th=[ 255], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 351, per=25.34%, avg=119.36, stdev=64.74, samples=96 iops : min= 1, max= 21, avg= 6.62, stdev= 4.08, samples=96 write: IOPS=7, BW=126KiB/s (129kB/s)(6368KiB/50529msec); 0 zone resets clat (msec): min=15, max=318, avg=78.18, stdev=53.43 lat (msec): min=15, max=318, avg=78.18, stdev=53.43 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 70], | 70.00th=[ 86], 80.00th=[ 111], 90.00th=[ 157], 95.00th=[ 188], | 99.00th=[ 268], 99.50th=[ 284], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 286, per=25.75%, avg=127.71, stdev=65.03, samples=97 iops : min= 1, max= 17, avg= 7.15, stdev= 4.13, samples=97 lat (msec) : 10=0.39%, 20=6.77%, 50=42.84%, 100=32.94%, 250=16.02% lat (msec) : 500=1.04% cpu : usr=0.03%, sys=1.53%, ctx=1121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180355: Tue Sep 8 03:19:41 2026 read: IOPS=7, BW=115KiB/s (117kB/s)(5744KiB/50075msec) clat (msec): min=9, max=273, avg=52.24, stdev=43.82 lat (msec): min=9, max=273, avg=52.26, stdev=43.82 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 67], 90.00th=[ 114], 95.00th=[ 144], | 99.00th=[ 224], 99.50th=[ 255], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 24, max= 380, per=25.57%, avg=120.42, stdev=74.72, samples=93 iops : min= 1, max= 23, avg= 6.70, stdev= 4.73, samples=93 write: IOPS=8, BW=131KiB/s (134kB/s)(6544KiB/50075msec); 0 zone resets clat (msec): min=20, max=381, avg=76.39, stdev=49.25 lat (msec): min=20, max=381, avg=76.39, stdev=49.25 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 71], | 70.00th=[ 89], 80.00th=[ 115], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 243], 99.50th=[ 264], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 319, per=27.11%, avg=134.46, stdev=64.52, samples=95 iops : min= 1, max= 19, avg= 7.58, stdev= 4.08, samples=95 lat (msec) : 10=0.13%, 20=6.25%, 50=43.75%, 100=30.73%, 250=18.36% lat (msec) : 500=0.78% cpu : usr=0.07%, sys=1.66%, ctx=1200, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180356: Tue Sep 8 03:19:41 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(6256KiB/50768msec) clat (msec): min=6, max=239, avg=52.94, stdev=40.80 lat (msec): min=6, max=239, avg=52.95, stdev=40.83 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 75], 90.00th=[ 110], 95.00th=[ 140], | 99.00th=[ 220], 99.50th=[ 234], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 319, per=27.31%, avg=128.61, stdev=72.73, samples=96 iops : min= 1, max= 19, avg= 7.22, stdev= 4.61, samples=96 write: IOPS=7, BW=119KiB/s (122kB/s)(6032KiB/50768msec); 0 zone resets clat (msec): min=15, max=386, avg=79.55, stdev=54.15 lat (msec): min=15, max=386, avg=79.56, stdev=54.18 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 41], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 110], 90.00th=[ 150], 95.00th=[ 194], | 99.00th=[ 271], 99.50th=[ 300], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 31, max= 288, per=23.96%, avg=118.82, stdev=62.58, samples=99 iops : min= 1, max= 18, avg= 6.60, stdev= 3.99, samples=99 lat (msec) : 10=0.26%, 20=7.16%, 50=42.19%, 100=32.16%, 250=17.45% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.65%, ctx=1206, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180357: Tue Sep 8 03:19:41 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49344msec) clat (msec): min=8, max=226, avg=53.23, stdev=36.59 lat (msec): min=8, max=226, avg=53.23, stdev=36.59 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 81], 90.00th=[ 104], 95.00th=[ 134], | 99.00th=[ 180], 99.50th=[ 209], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 30, max= 380, per=26.62%, avg=125.36, stdev=67.84, samples=94 iops : min= 1, max= 23, avg= 7.00, stdev= 4.32, samples=94 write: IOPS=7, BW=127KiB/s (130kB/s)(6256KiB/49344msec); 0 zone resets clat (msec): min=17, max=288, avg=74.64, stdev=47.37 lat (msec): min=17, max=288, avg=74.65, stdev=47.37 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 73], | 70.00th=[ 89], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 163], | 99.00th=[ 253], 99.50th=[ 266], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 413, per=25.60%, avg=126.97, stdev=70.95, samples=97 iops : min= 1, max= 25, avg= 7.10, stdev= 4.49, samples=97 lat (msec) : 10=0.26%, 20=6.12%, 50=45.31%, 100=31.77%, 250=16.02% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.57%, ctx=1181, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=472KiB/s (483kB/s), 115KiB/s-123KiB/s (117kB/s-126kB/s), io=23.4MiB (24.5MB), run=49344-50768msec WRITE: bw=496KiB/s (508kB/s), 119KiB/s-131KiB/s (122kB/s-134kB/s), io=24.6MiB (25.8MB), run=49344-50768msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180370: Tue Sep 8 03:19:57 2026 read: IOPS=2, BW=2175KiB/s (2228kB/s)(7168KiB/3295msec) clat (usec): min=777, max=635010, avg=237919.57, stdev=211102.47 lat (usec): min=779, max=635011, avg=237920.84, stdev=211102.41 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], 20.00th=[ 55313], | 30.00th=[156238], 40.00th=[156238], 50.00th=[202376], 60.00th=[270533], | 70.00th=[270533], 80.00th=[341836], 90.00th=[633340], 95.00th=[633340], | 99.00th=[633340], 99.50th=[633340], 99.90th=[633340], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 2007, max= 2976, per=44.63%, avg=2217.00, stdev=424.63, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=1, BW=1554KiB/s (1591kB/s)(5120KiB/3295msec); 0 zone resets clat (msec): min=196, max=416, avg=308.07, stdev=78.97 lat (msec): min=196, max=416, avg=308.39, stdev=79.02 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2015, max= 4047, per=38.87%, avg=2703.33, stdev=1163.77, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=13.75%, ctx=251, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180371: Tue Sep 8 03:19:57 2026 read: IOPS=0, BW=497KiB/s (509kB/s)(2048KiB/4123msec) clat (usec): min=833, max=272406, avg=136620.00, stdev=192031.08 lat (usec): min=834, max=272409, avg=136622.07, stdev=192032.08 clat percentiles (usec): | 1.00th=[ 832], 5.00th=[ 832], 10.00th=[ 832], 20.00th=[ 832], | 30.00th=[ 832], 40.00th=[ 832], 50.00th=[ 832], 60.00th=[270533], | 70.00th=[270533], 80.00th=[270533], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1418, max= 2015, per=34.56%, avg=1716.50, stdev=422.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2484KiB/s (2543kB/s)(10.0MiB/4123msec); 0 zone resets clat (msec): min=74, max=983, avg=380.00, stdev=283.86 lat (msec): min=74, max=983, avg=380.10, stdev=283.83 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 93], | 30.00th=[ 153], 40.00th=[ 224], 50.00th=[ 309], 60.00th=[ 372], | 70.00th=[ 405], 80.00th=[ 527], 90.00th=[ 667], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 2015, max= 4096, per=51.33%, avg=3569.25, stdev=1036.19, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=13.05%, ctx=159, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180372: Tue Sep 8 03:19:57 2026 read: IOPS=1, BW=1703KiB/s (1744kB/s)(6144KiB/3608msec) clat (usec): min=595, max=223049, avg=64125.54, stdev=86689.71 lat (usec): min=596, max=223049, avg=64126.75, stdev=86689.36 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 1029], | 30.00th=[ 1029], 40.00th=[ 2573], 50.00th=[ 2573], 60.00th=[ 71828], | 70.00th=[ 85459], 80.00th=[ 85459], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 2015, max= 4079, per=68.06%, avg=3380.33, stdev=1182.52, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1703KiB/s (1744kB/s)(6144KiB/3608msec); 0 zone resets clat (msec): min=274, max=1120, avg=519.15, stdev=323.21 lat (msec): min=274, max=1120, avg=519.32, stdev=323.16 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 542], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1448, max= 2039, per=27.41%, avg=1906.40, stdev=256.53, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=16.67%, 250=8.33%, 500=25.00% lat (msec) : 750=16.67%, 2000=8.33% cpu : usr=0.06%, sys=10.95%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180373: Tue Sep 8 03:19:57 2026 read: IOPS=1, BW=1380KiB/s (1413kB/s)(5120KiB/3711msec) clat (usec): min=621, max=449997, avg=170119.52, stdev=184882.33 lat (usec): min=622, max=449998, avg=170120.85, stdev=184882.51 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[ 3261], 40.00th=[ 3261], 50.00th=[187696], 60.00th=[187696], | 70.00th=[208667], 80.00th=[208667], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1932KiB/s (1978kB/s)(7168KiB/3711msec); 0 zone resets clat (msec): min=205, max=620, avg=396.84, stdev=193.65 lat (msec): min=205, max=620, avg=397.02, stdev=193.54 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 222], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 330], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 592], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1497, max= 4096, per=34.68%, avg=2411.75, stdev=1150.34, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=12.10%, ctx=161, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4967KiB/s (5086kB/s), 497KiB/s-2175KiB/s (509kB/s-2228kB/s), io=20.0MiB (20.0MB), run=3295-4123msec WRITE: bw=6954KiB/s (7121kB/s), 1554KiB/s-2484KiB/s (1591kB/s-2543kB/s), io=28.0MiB (29.4MB), run=3295-4123msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180375: Tue Sep 8 03:19:58 2026 read: IOPS=1, BW=1697KiB/s (1737kB/s)(7168KiB/4225msec) clat (msec): min=61, max=829, avg=419.71, stdev=347.58 lat (msec): min=61, max=829, avg=419.71, stdev=347.58 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 96], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 347], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 793], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1448, max= 4079, per=51.59%, avg=2391.25, stdev=1156.99, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1212KiB/s (1241kB/s)(5120KiB/4225msec); 0 zone resets clat (msec): min=107, max=452, avg=256.88, stdev=135.51 lat (msec): min=107, max=452, avg=256.98, stdev=135.51 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2011, max= 4047, per=46.68%, avg=3029.00, stdev=1439.67, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=3.55%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180376: Tue Sep 8 03:19:58 2026 read: IOPS=0, BW=481KiB/s (493kB/s)(2048KiB/4255msec) clat (msec): min=77, max=782, avg=430.19, stdev=498.36 lat (msec): min=77, max=782, avg=430.19, stdev=498.36 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 79], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2003, max= 2039, per=43.60%, avg=2021.00, stdev=25.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2407KiB/s (2464kB/s)(10.0MiB/4255msec); 0 zone resets clat (msec): min=107, max=732, avg=334.42, stdev=188.51 lat (msec): min=107, max=732, avg=334.56, stdev=188.55 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 176], | 30.00th=[ 194], 40.00th=[ 220], 50.00th=[ 292], 60.00th=[ 300], | 70.00th=[ 384], 80.00th=[ 401], 90.00th=[ 542], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1899, max= 4079, per=41.30%, avg=2679.67, stdev=1063.55, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=5.78%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180377: Tue Sep 8 03:19:58 2026 read: IOPS=1, BW=1475KiB/s (1510kB/s)(6144KiB/4166msec) clat (msec): min=82, max=268, avg=147.55, stdev=63.70 lat (msec): min=82, max=268, avg=147.55, stdev=63.70 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 144], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 268], 95.00th=[ 268], | 99.00th=[ 268], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 2011, max= 4079, per=72.73%, avg=3371.00, stdev=1178.13, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1475KiB/s (1510kB/s)(6144KiB/4166msec); 0 zone resets clat (msec): min=147, max=760, avg=538.72, stdev=284.81 lat (msec): min=147, max=760, avg=538.97, stdev=284.85 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 726], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2003, max= 4023, per=37.30%, avg=2420.60, stdev=895.88, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=25.00%, 1000=8.33% cpu : usr=0.07%, sys=3.10%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180378: Tue Sep 8 03:19:58 2026 read: IOPS=1, BW=1159KiB/s (1187kB/s)(5120KiB/4418msec) clat (msec): min=79, max=366, avg=221.66, stdev=122.27 lat (msec): min=79, max=366, avg=221.66, stdev=122.27 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2011, max= 4079, per=58.46%, avg=2709.67, stdev=1185.96, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1622KiB/s (1661kB/s)(7168KiB/4418msec); 0 zone resets clat (msec): min=129, max=1286, avg=472.39, stdev=413.63 lat (msec): min=129, max=1286, avg=472.52, stdev=413.63 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 180], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 326], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 709], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1899, max= 2039, per=30.71%, avg=1992.60, stdev=54.08, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.00%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4636KiB/s (4747kB/s), 481KiB/s-1697KiB/s (493kB/s-1737kB/s), io=20.0MiB (20.0MB), run=4166-4418msec WRITE: bw=6490KiB/s (6646kB/s), 1212KiB/s-2407KiB/s (1241kB/s-2464kB/s), io=28.0MiB (29.4MB), run=4166-4418msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180385: Tue Sep 8 03:20:15 2026 read: IOPS=0, BW=2411KiB/s (2469kB/s)(12.0MiB/5096msec) clat (msec): min=973, max=2897, avg=1657.92, stdev=1075.75 lat (msec): min=973, max=2897, avg=1657.93, stdev=1075.75 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 7984, max= 8192, per=100.00%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.73%, ctx=329, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180386: Tue Sep 8 03:20:15 2026 read: IOPS=0, BW=700KiB/s (717kB/s)(4096KiB/5848msec) clat (nsec): min=3075.5M, max=3075.5M, avg=3075520313.00, stdev= 0.00 lat (nsec): min=3075.5M, max=3075.5M, avg=3075523469.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3071], 5.00th=[ 3071], 10.00th=[ 3071], 20.00th=[ 3071], | 30.00th=[ 3071], 40.00th=[ 3071], 50.00th=[ 3071], 60.00th=[ 3071], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1401KiB/s (1434kB/s)(8192KiB/5848msec); 0 zone resets clat (msec): min=238, max=2391, avg=1314.66, stdev=1522.62 lat (msec): min=240, max=2392, avg=1316.47, stdev=1522.32 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] lat (msec) : 250=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=3.90%, ctx=493, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180387: Tue Sep 8 03:20:15 2026 write: IOPS=0, BW=2795KiB/s (2862kB/s)(12.0MiB/4397msec); 0 zone resets clat (msec): min=425, max=2721, avg=1444.24, stdev=1169.50 lat (msec): min=425, max=2722, avg=1444.91, stdev=1170.10 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.96%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180388: Tue Sep 8 03:20:15 2026 write: IOPS=0, BW=2661KiB/s (2725kB/s)(12.0MiB/4617msec); 0 zone resets clat (msec): min=655, max=2650, avg=1512.72, stdev=1026.70 lat (msec): min=665, max=2650, avg=1516.82, stdev=1022.49 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.25%, ctx=43, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2802KiB/s (2869kB/s), 700KiB/s-2411KiB/s (717kB/s-2469kB/s), io=16.0MiB (16.8MB), run=5096-5848msec WRITE: bw=5603KiB/s (5738kB/s), 1401KiB/s-2795KiB/s (1434kB/s-2862kB/s), io=32.0MiB (33.6MB), run=4397-5848msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180390: Tue Sep 8 03:20:15 2026 read: IOPS=0, BW=2440KiB/s (2498kB/s)(12.0MiB/5037msec) clat (msec): min=534, max=3464, avg=1635.90, stdev=1594.85 lat (msec): min=534, max=3464, avg=1635.90, stdev=1594.85 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 7831, max= 8078, per=100.00%, avg=7954.50, stdev=174.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.69%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180391: Tue Sep 8 03:20:15 2026 read: IOPS=0, BW=711KiB/s (728kB/s)(4096KiB/5763msec) clat (nsec): min=2998.8M, max=2998.8M, avg=2998829285.00, stdev= 0.00 lat (nsec): min=2998.8M, max=2998.8M, avg=2998831980.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3004], 5.00th=[ 3004], 10.00th=[ 3004], 20.00th=[ 3004], | 30.00th=[ 3004], 40.00th=[ 3004], 50.00th=[ 3004], 60.00th=[ 3004], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1421KiB/s (1456kB/s)(8192KiB/5763msec); 0 zone resets clat (msec): min=241, max=2412, avg=1327.26, stdev=1534.82 lat (msec): min=242, max=2413, avg=1327.70, stdev=1534.93 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.48%, ctx=33, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180392: Tue Sep 8 03:20:15 2026 write: IOPS=0, BW=2178KiB/s (2231kB/s)(12.0MiB/5641msec); 0 zone resets clat (msec): min=595, max=3928, avg=1842.19, stdev=1818.00 lat (msec): min=597, max=3928, avg=1843.04, stdev=1817.56 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.81%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180393: Tue Sep 8 03:20:15 2026 write: IOPS=0, BW=2494KiB/s (2553kB/s)(12.0MiB/4928msec); 0 zone resets clat (msec): min=377, max=3161, avg=1601.30, stdev=1421.87 lat (msec): min=377, max=3161, avg=1603.29, stdev=1421.50 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 7831, max= 8078, per=100.00%, avg=7954.50, stdev=174.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.55%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2843KiB/s (2911kB/s), 711KiB/s-2440KiB/s (728kB/s-2498kB/s), io=16.0MiB (16.8MB), run=5037-5763msec WRITE: bw=5686KiB/s (5822kB/s), 1421KiB/s-2494KiB/s (1456kB/s-2553kB/s), io=32.0MiB (33.6MB), run=4928-5763msec