== sanity test 398b: DIO and buffer IO race ============== 23:23:51 (1789269831) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.98908 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178757: Sat Sep 12 23:26:21 2026 read: IOPS=11, BW=45.0KiB/s (47.1kB/s)(5992KiB/130320msec) clat (usec): min=34, max=836541, avg=48117.40, stdev=38692.28 lat (usec): min=34, max=836542, avg=48120.86, stdev=38691.83 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8455], 10.00th=[ 16188], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[168821], 99.50th=[208667], 99.90th=[223347], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 120, per=25.07%, avg=46.13, stdev=20.24, samples=253 iops : min= 1, max= 30, avg=10.87, stdev= 5.12, samples=253 write: IOPS=12, BW=48.3KiB/s (49.5kB/s)(6296KiB/130320msec); 0 zone resets clat (usec): min=707, max=245674, avg=36712.63, stdev=38474.53 lat (usec): min=707, max=245675, avg=36720.93, stdev=38482.75 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1385], 20.00th=[ 3687], | 30.00th=[ 7308], 40.00th=[ 17171], 50.00th=[ 26084], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 64226], 90.00th=[ 90702], 95.00th=[116917], | 99.00th=[164627], 99.50th=[183501], 99.90th=[242222], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 180, per=25.03%, avg=48.05, stdev=23.21, samples=255 iops : min= 1, max= 45, avg=11.36, stdev= 5.87, samples=255 lat (usec) : 50=0.23%, 100=1.66%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=7.10%, 4=3.78%, 10=6.32%, 20=10.06%, 50=37.96% lat (msec) : 100=25.23%, 250=7.16%, 1000=0.03% cpu : usr=0.08%, sys=4.92%, ctx=6318, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178758: Sat Sep 12 23:26:21 2026 read: IOPS=11, BW=46.0KiB/s (47.1kB/s)(5940KiB/129022msec) clat (usec): min=40, max=376724, avg=47037.47, stdev=34351.87 lat (usec): min=42, max=376726, avg=47041.51, stdev=34350.97 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 9896], 10.00th=[ 16188], 20.00th=[ 22414], | 30.00th=[ 27657], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 47449], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[170918], 99.50th=[208667], 99.90th=[337642], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 127, per=24.94%, avg=45.89, stdev=20.82, samples=251 iops : min= 1, max= 31, avg=10.81, stdev= 5.24, samples=251 write: IOPS=12, BW=49.2KiB/s (50.4kB/s)(6348KiB/129022msec); 0 zone resets clat (usec): min=880, max=872100, avg=36967.20, stdev=45961.62 lat (usec): min=881, max=872101, avg=36969.20, stdev=45961.54 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1352], 20.00th=[ 3097], | 30.00th=[ 6194], 40.00th=[ 14222], 50.00th=[ 23725], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 62129], 90.00th=[ 90702], 95.00th=[117965], | 99.00th=[185598], 99.50th=[233833], 99.90th=[304088], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 119, per=25.48%, avg=48.92, stdev=22.93, samples=251 iops : min= 1, max= 29, avg=11.57, stdev= 5.78, samples=251 lat (usec) : 50=0.16%, 100=1.60%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=7.81%, 4=4.52%, 10=6.93%, 20=9.80%, 50=37.37% lat (msec) : 100=24.35%, 250=6.97%, 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=4.95%, ctx=6271, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178759: Sat Sep 12 23:26:21 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6028KiB/129447msec) clat (usec): min=30, max=348045, avg=46701.90, stdev=34872.64 lat (usec): min=31, max=348046, avg=46703.80, stdev=34872.40 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 83], 10.00th=[ 15401], 20.00th=[ 21890], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[175113], 99.50th=[219153], 99.90th=[252707], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 111, per=25.25%, avg=46.46, stdev=20.81, samples=252 iops : min= 1, max= 27, avg=10.96, stdev= 5.25, samples=252 write: IOPS=12, BW=48.4KiB/s (49.5kB/s)(6260KiB/129447msec); 0 zone resets clat (usec): min=729, max=856133, avg=37407.70, stdev=46415.51 lat (usec): min=730, max=856134, avg=37412.04, stdev=46416.93 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1352], 20.00th=[ 2900], | 30.00th=[ 6587], 40.00th=[ 14353], 50.00th=[ 23462], 60.00th=[ 33424], | 70.00th=[ 46400], 80.00th=[ 63177], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[187696], 99.50th=[219153], 99.90th=[304088], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 127, per=24.98%, avg=47.96, stdev=22.92, samples=253 iops : min= 1, max= 31, avg=11.34, stdev= 5.77, samples=253 lat (usec) : 50=0.33%, 100=2.15%, 250=0.13%, 750=0.03%, 1000=0.16% lat (msec) : 2=7.49%, 4=4.39%, 10=6.32%, 20=10.58%, 50=37.17% lat (msec) : 100=23.83%, 250=7.23%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.91%, ctx=6275, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178760: Sat Sep 12 23:26:21 2026 read: IOPS=11, BW=46.7KiB/s (47.9kB/s)(6052KiB/129476msec) clat (usec): min=31, max=265469, avg=47577.46, stdev=34677.06 lat (usec): min=31, max=265470, avg=47628.22, stdev=34707.24 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 115], 10.00th=[ 15664], 20.00th=[ 21890], | 30.00th=[ 27395], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 56361], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[114820], | 99.00th=[175113], 99.50th=[200279], 99.90th=[254804], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 120, per=25.41%, avg=46.75, stdev=18.48, samples=252 iops : min= 1, max= 30, avg=11.03, stdev= 4.66, samples=252 write: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6236KiB/129476msec); 0 zone resets clat (usec): min=690, max=1136.1k, avg=36514.58, stdev=48698.32 lat (usec): min=691, max=1136.1k, avg=36518.67, stdev=48697.67 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1172], 10.00th=[ 1287], | 20.00th=[ 2999], 30.00th=[ 6194], 40.00th=[ 14091], | 50.00th=[ 24773], 60.00th=[ 34341], 70.00th=[ 46400], | 80.00th=[ 60031], 90.00th=[ 88605], 95.00th=[ 117965], | 99.00th=[ 179307], 99.50th=[ 219153], 99.90th=[ 312476], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 135, per=24.94%, avg=47.89, stdev=23.05, samples=253 iops : min= 1, max= 33, avg=11.32, stdev= 5.82, samples=253 lat (usec) : 50=0.29%, 100=2.02%, 250=0.33%, 750=0.03%, 1000=0.52% lat (msec) : 2=7.49%, 4=4.13%, 10=6.18%, 20=9.96%, 50=37.30% lat (msec) : 100=24.58%, 250=6.97%, 500=0.16%, 2000=0.03% cpu : usr=0.06%, sys=4.99%, ctx=6351, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=184KiB/s (189kB/s), 45.0KiB/s-46.7KiB/s (47.1kB/s-47.9kB/s), io=23.4MiB (24.6MB), run=129022-130320msec WRITE: bw=193KiB/s (198kB/s), 48.2KiB/s-49.2KiB/s (49.3kB/s-50.4kB/s), io=24.6MiB (25.7MB), run=129022-130320msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178761: Sat Sep 12 23:27:00 2026 read: IOPS=8, BW=35.5KiB/s (36.4kB/s)(5992KiB/168784msec) clat (msec): min=4, max=906, avg=43.90, stdev=49.14 lat (msec): min=4, max=906, avg=43.90, stdev=49.14 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 102], 95.00th=[ 134], | 99.00th=[ 205], 99.50th=[ 243], 99.90th=[ 468], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 191, per=25.79%, avg=36.62, stdev=28.00, samples=318 iops : min= 1, max= 47, avg= 8.53, stdev= 7.06, samples=318 write: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6296KiB/168784msec); 0 zone resets clat (msec): min=8, max=364, avg=65.15, stdev=49.72 lat (msec): min=8, max=364, avg=65.15, stdev=49.72 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 103], 90.00th=[ 134], 95.00th=[ 161], | 99.00th=[ 241], 99.50th=[ 275], 99.90th=[ 326], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 134, per=25.08%, avg=37.12, stdev=27.02, samples=329 iops : min= 1, max= 33, avg= 8.66, stdev= 6.82, samples=329 lat (msec) : 10=3.55%, 20=18.42%, 50=40.36%, 100=22.17%, 250=14.91% lat (msec) : 500=0.55%, 1000=0.03% cpu : usr=0.07%, sys=1.70%, ctx=4792, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178762: Sat Sep 12 23:27:00 2026 read: IOPS=8, BW=35.2KiB/s (36.0kB/s)(5940KiB/168841msec) clat (msec): min=5, max=1229, avg=44.25, stdev=52.05 lat (msec): min=5, max=1229, avg=44.25, stdev=52.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 103], 95.00th=[ 134], | 99.00th=[ 207], 99.50th=[ 232], 99.90th=[ 326], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 128, per=25.29%, avg=35.92, stdev=27.64, samples=321 iops : min= 1, max= 32, avg= 8.35, stdev= 6.98, samples=321 write: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6348KiB/168841msec); 0 zone resets clat (msec): min=10, max=414, avg=64.72, stdev=50.95 lat (msec): min=10, max=414, avg=64.72, stdev=50.95 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 75], 80.00th=[ 102], 90.00th=[ 136], 95.00th=[ 169], | 99.00th=[ 236], 99.50th=[ 268], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 143, per=25.32%, avg=37.48, stdev=27.57, samples=328 iops : min= 1, max= 35, avg= 8.75, stdev= 6.94, samples=328 lat (msec) : 10=3.29%, 20=17.94%, 50=41.47%, 100=21.84%, 250=15.07% lat (msec) : 500=0.36%, 2000=0.03% cpu : usr=0.05%, sys=1.64%, ctx=4676, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178763: Sat Sep 12 23:27:00 2026 read: IOPS=9, BW=36.1KiB/s (36.0kB/s)(6028KiB/167041msec) clat (msec): min=5, max=482, avg=44.75, stdev=45.88 lat (msec): min=5, max=482, avg=44.76, stdev=45.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 100], 95.00th=[ 142], | 99.00th=[ 222], 99.50th=[ 255], 99.90th=[ 321], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 128, per=25.93%, avg=36.82, stdev=26.44, samples=319 iops : min= 1, max= 32, avg= 8.58, stdev= 6.66, samples=319 write: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6260KiB/167041msec); 0 zone resets clat (msec): min=8, max=1283, avg=63.36, stdev=58.15 lat (msec): min=8, max=1283, avg=63.36, stdev=58.15 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 247], 99.50th=[ 275], 99.90th=[ 422], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 150, per=25.66%, avg=37.98, stdev=27.64, samples=321 iops : min= 1, max= 37, avg= 8.87, stdev= 6.97, samples=321 lat (msec) : 10=3.22%, 20=18.68%, 50=41.05%, 100=23.34%, 250=13.05% lat (msec) : 500=0.62%, 2000=0.03% cpu : usr=0.07%, sys=1.68%, ctx=4699, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178764: Sat Sep 12 23:27:00 2026 read: IOPS=9, BW=36.1KiB/s (36.9kB/s)(6052KiB/167824msec) clat (msec): min=4, max=483, avg=43.35, stdev=45.13 lat (msec): min=4, max=483, avg=43.36, stdev=45.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 99], 95.00th=[ 136], | 99.00th=[ 207], 99.50th=[ 243], 99.90th=[ 477], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 151, per=26.36%, avg=37.44, stdev=28.47, samples=314 iops : min= 1, max= 37, avg= 8.74, stdev= 7.18, samples=314 write: IOPS=9, BW=37.2KiB/s (38.0kB/s)(6236KiB/167824msec); 0 zone resets clat (msec): min=10, max=1259, avg=65.32, stdev=57.19 lat (msec): min=10, max=1259, avg=65.32, stdev=57.19 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 61], | 70.00th=[ 79], 80.00th=[ 102], 90.00th=[ 132], 95.00th=[ 165], | 99.00th=[ 230], 99.50th=[ 255], 99.90th=[ 351], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 142, per=25.12%, avg=37.18, stdev=26.37, samples=325 iops : min= 1, max= 35, avg= 8.67, stdev= 6.66, samples=325 lat (msec) : 10=3.29%, 20=18.49%, 50=41.73%, 100=21.39%, 250=14.62% lat (msec) : 500=0.46%, 2000=0.03% cpu : usr=0.06%, sys=1.65%, ctx=4891, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=142KiB/s (146kB/s), 35.2KiB/s-36.1KiB/s (36.0kB/s-36.0kB/s), io=23.4MiB (24.6MB), run=167041-168841msec WRITE: bw=149KiB/s (152kB/s), 37.2KiB/s-37.6KiB/s (38.0kB/s-38.5kB/s), io=24.6MiB (25.7MB), run=167041-168841msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178807: Sat Sep 12 23:27:36 2026 read: IOPS=13, BW=221KiB/s (227kB/s)(5920KiB/26732msec) clat (usec): min=41, max=167253, avg=38049.89, stdev=25832.74 lat (usec): min=41, max=167254, avg=38051.45, stdev=25832.66 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 709], 20.00th=[ 20055], | 30.00th=[ 25822], 40.00th=[ 29492], 50.00th=[ 34341], 60.00th=[ 39060], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[141558], 99.50th=[160433], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 95, max= 352, per=24.38%, avg=217.92, stdev=75.28, samples=52 iops : min= 5, max= 22, avg=12.94, stdev= 4.80, samples=52 write: IOPS=14, BW=238KiB/s (244kB/s)(6368KiB/26732msec); 0 zone resets clat (usec): min=1127, max=207573, avg=31676.05, stdev=31477.52 lat (usec): min=1129, max=207574, avg=31678.45, stdev=31477.89 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1975], 10.00th=[ 2540], 20.00th=[ 4555], | 30.00th=[ 8094], 40.00th=[ 15401], 50.00th=[ 22938], 60.00th=[ 30540], | 70.00th=[ 38536], 80.00th=[ 54789], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[130548], 99.50th=[160433], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 448, per=25.24%, avg=237.21, stdev=83.02, samples=52 iops : min= 1, max= 28, avg=14.13, stdev= 5.31, samples=52 lat (usec) : 50=0.39%, 100=3.52%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=2.60%, 4=6.64%, 10=8.59%, 20=10.55%, 50=44.14% lat (msec) : 100=19.66%, 250=2.99% cpu : usr=0.07%, sys=6.49%, ctx=1658, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178808: Sat Sep 12 23:27:36 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(5744KiB/25982msec) clat (usec): min=50, max=160227, avg=38314.64, stdev=25287.09 lat (usec): min=51, max=160228, avg=38315.78, stdev=25287.11 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 12125], 20.00th=[ 20055], | 30.00th=[ 25035], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[128451], 99.50th=[149947], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 63, max= 352, per=24.74%, avg=221.14, stdev=74.03, samples=51 iops : min= 3, max= 22, avg=13.14, stdev= 4.70, samples=51 write: IOPS=15, BW=252KiB/s (258kB/s)(6544KiB/25982msec); 0 zone resets clat (usec): min=1293, max=185188, avg=29840.08, stdev=30231.32 lat (usec): min=1296, max=185189, avg=29842.37, stdev=30231.49 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1844], 10.00th=[ 3064], 20.00th=[ 5407], | 30.00th=[ 8848], 40.00th=[ 15270], 50.00th=[ 21890], 60.00th=[ 27919], | 70.00th=[ 35390], 80.00th=[ 46924], 90.00th=[ 70779], 95.00th=[ 88605], | 99.00th=[147850], 99.50th=[158335], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 63, max= 507, per=26.75%, avg=251.45, stdev=106.81, samples=51 iops : min= 3, max= 31, avg=15.04, stdev= 6.77, samples=51 lat (usec) : 100=3.52%, 250=0.52% lat (msec) : 2=3.52%, 4=4.95%, 10=9.11%, 20=12.89%, 50=43.36% lat (msec) : 100=18.88%, 250=3.26% cpu : usr=0.12%, sys=6.84%, ctx=1650, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178809: Sat Sep 12 23:27:36 2026 read: IOPS=14, BW=234KiB/s (239kB/s)(6256KiB/26788msec) clat (usec): min=33, max=301326, avg=37387.08, stdev=29183.57 lat (usec): min=34, max=301327, avg=37398.02, stdev=29178.37 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 60], 10.00th=[ 85], 20.00th=[ 19792], | 30.00th=[ 24773], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 38011], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 63177], 95.00th=[ 77071], | 99.00th=[141558], 99.50th=[196084], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 63, max= 416, per=26.16%, avg=233.88, stdev=90.16, samples=52 iops : min= 3, max= 26, avg=13.94, stdev= 5.68, samples=52 write: IOPS=14, BW=225KiB/s (231kB/s)(6032KiB/26788msec); 0 zone resets clat (usec): min=1334, max=219513, avg=32168.60, stdev=31820.45 lat (usec): min=1336, max=219515, avg=32174.47, stdev=31821.50 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1876], 10.00th=[ 3032], 20.00th=[ 5932], | 30.00th=[ 9372], 40.00th=[ 15926], 50.00th=[ 24249], 60.00th=[ 30540], | 70.00th=[ 42730], 80.00th=[ 51643], 90.00th=[ 71828], 95.00th=[100140], | 99.00th=[141558], 99.50th=[160433], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 63, max= 473, per=23.64%, avg=222.17, stdev=91.05, samples=52 iops : min= 3, max= 29, avg=13.21, stdev= 5.71, samples=52 lat (usec) : 50=0.39%, 100=4.95%, 250=0.39% lat (msec) : 2=3.12%, 4=2.86%, 10=9.90%, 20=10.81%, 50=45.18% lat (msec) : 100=18.36%, 250=3.91%, 500=0.13% cpu : usr=0.10%, sys=6.45%, ctx=1721, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178810: Sat Sep 12 23:27:36 2026 read: IOPS=14, BW=235KiB/s (240kB/s)(6032KiB/25687msec) clat (usec): min=38, max=290821, avg=37258.82, stdev=27475.17 lat (usec): min=38, max=290821, avg=37259.96, stdev=27475.12 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 78], 20.00th=[ 18482], | 30.00th=[ 23987], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 39584], | 70.00th=[ 44303], 80.00th=[ 55837], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[108528], 99.50th=[149947], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 94, max= 412, per=25.57%, avg=228.62, stdev=73.10, samples=50 iops : min= 5, max= 25, avg=13.60, stdev= 4.64, samples=50 write: IOPS=15, BW=244KiB/s (249kB/s)(6256KiB/25687msec); 0 zone resets clat (usec): min=1425, max=190463, avg=29684.59, stdev=30452.92 lat (usec): min=1428, max=190463, avg=29688.56, stdev=30453.80 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1876], 10.00th=[ 2638], 20.00th=[ 4686], | 30.00th=[ 8586], 40.00th=[ 13960], 50.00th=[ 20317], 60.00th=[ 26870], | 70.00th=[ 36963], 80.00th=[ 52691], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[147850], 99.50th=[187696], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 475, per=25.58%, avg=240.44, stdev=94.73, samples=50 iops : min= 1, max= 29, avg=14.38, stdev= 5.91, samples=50 lat (usec) : 50=0.39%, 100=5.34%, 250=0.39% lat (msec) : 2=3.26%, 4=5.34%, 10=8.46%, 20=13.02%, 50=41.41% lat (msec) : 100=20.05%, 250=2.21%, 500=0.13% cpu : usr=0.06%, sys=6.56%, ctx=1665, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=894KiB/s (916kB/s), 221KiB/s-235KiB/s (226kB/s-240kB/s), io=23.4MiB (24.5MB), run=25687-26788msec WRITE: bw=941KiB/s (963kB/s), 225KiB/s-252KiB/s (231kB/s-258kB/s), io=24.6MiB (25.8MB), run=25687-26788msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178802: Sat Sep 12 23:27:46 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(5920KiB/36765msec) clat (msec): min=6, max=256, avg=36.79, stdev=31.89 lat (msec): min=6, max=256, avg=36.79, stdev=31.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 79], 95.00th=[ 104], | 99.00th=[ 142], 99.50th=[ 251], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 30, max= 507, per=23.89%, avg=155.53, stdev=98.34, samples=72 iops : min= 1, max= 31, avg= 8.93, stdev= 6.21, samples=72 write: IOPS=10, BW=173KiB/s (177kB/s)(6368KiB/36765msec); 0 zone resets clat (msec): min=11, max=243, avg=58.03, stdev=40.27 lat (msec): min=11, max=243, avg=58.04, stdev=40.27 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 111], 95.00th=[ 150], | 99.00th=[ 201], 99.50th=[ 207], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 411, per=25.11%, avg=171.99, stdev=92.06, samples=71 iops : min= 1, max= 25, avg= 9.97, stdev= 5.84, samples=71 lat (msec) : 10=3.12%, 20=16.28%, 50=47.79%, 100=23.05%, 250=9.64% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=2.09%, ctx=1249, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178803: Sat Sep 12 23:27:46 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5744KiB/36415msec) clat (msec): min=6, max=189, avg=35.74, stdev=28.51 lat (msec): min=6, max=189, avg=35.74, stdev=28.51 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 73], 95.00th=[ 96], | 99.00th=[ 155], 99.50th=[ 165], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 444, per=24.24%, avg=157.83, stdev=100.50, samples=72 iops : min= 1, max= 27, avg= 9.08, stdev= 6.36, samples=72 write: IOPS=11, BW=180KiB/s (184kB/s)(6544KiB/36415msec); 0 zone resets clat (msec): min=13, max=286, avg=57.39, stdev=41.54 lat (msec): min=13, max=286, avg=57.39, stdev=41.54 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 78], 90.00th=[ 113], 95.00th=[ 146], | 99.00th=[ 207], 99.50th=[ 226], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 62, max= 445, per=26.11%, avg=178.82, stdev=97.84, samples=72 iops : min= 3, max= 27, avg=10.40, stdev= 6.18, samples=72 lat (msec) : 10=0.78%, 20=17.71%, 50=51.30%, 100=20.57%, 250=9.38% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=2.26%, ctx=1195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178804: Sat Sep 12 23:27:46 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(6256KiB/35962msec) clat (msec): min=7, max=214, avg=36.02, stdev=30.24 lat (msec): min=7, max=214, avg=36.03, stdev=30.24 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 74], 95.00th=[ 104], | 99.00th=[ 150], 99.50th=[ 163], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 576, per=26.77%, avg=174.28, stdev=118.41, samples=71 iops : min= 1, max= 36, avg=10.11, stdev= 7.53, samples=71 write: IOPS=10, BW=168KiB/s (172kB/s)(6032KiB/35962msec); 0 zone resets clat (msec): min=12, max=272, avg=57.72, stdev=40.12 lat (msec): min=13, max=272, avg=57.72, stdev=40.12 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 85], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 188], 99.50th=[ 259], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 479, per=24.26%, avg=166.20, stdev=91.72, samples=71 iops : min= 1, max= 29, avg= 9.61, stdev= 5.76, samples=71 lat (msec) : 10=1.95%, 20=18.10%, 50=49.87%, 100=20.18%, 250=9.64% lat (msec) : 500=0.26% cpu : usr=0.08%, sys=2.22%, ctx=1162, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178805: Sat Sep 12 23:27:46 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6032KiB/36532msec) clat (msec): min=6, max=191, avg=38.05, stdev=32.57 lat (msec): min=6, max=191, avg=38.05, stdev=32.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 150], 99.50th=[ 190], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 31, max= 447, per=25.41%, avg=165.39, stdev=101.35, samples=71 iops : min= 1, max= 27, avg= 9.56, stdev= 6.41, samples=71 write: IOPS=10, BW=171KiB/s (175kB/s)(6256KiB/36532msec); 0 zone resets clat (msec): min=13, max=266, avg=56.44, stdev=38.57 lat (msec): min=13, max=266, avg=56.45, stdev=38.56 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 52], | 70.00th=[ 61], 80.00th=[ 79], 90.00th=[ 112], 95.00th=[ 138], | 99.00th=[ 186], 99.50th=[ 262], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 507, per=24.82%, avg=170.00, stdev=96.94, samples=72 iops : min= 1, max= 31, avg= 9.85, stdev= 6.13, samples=72 lat (msec) : 10=1.43%, 20=17.58%, 50=50.39%, 100=20.96%, 250=9.38% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.04%, ctx=1199, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=651KiB/s (667kB/s), 158KiB/s-174KiB/s (162kB/s-178kB/s), io=23.4MiB (24.5MB), run=35962-36765msec WRITE: bw=685KiB/s (702kB/s), 168KiB/s-180KiB/s (172kB/s-184kB/s), io=24.6MiB (25.8MB), run=35962-36765msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178824: Sat Sep 12 23:28:01 2026 read: IOPS=2, BW=2182KiB/s (2234kB/s)(7168KiB/3285msec) clat (usec): min=581, max=416331, avg=205223.21, stdev=125710.04 lat (usec): min=582, max=416333, avg=205224.83, stdev=125710.28 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[141558], | 30.00th=[181404], 40.00th=[181404], 50.00th=[206570], 60.00th=[231736], | 70.00th=[231736], 80.00th=[258999], 90.00th=[417334], 95.00th=[417334], | 99.00th=[417334], 99.50th=[417334], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 2003, max= 4101, per=74.33%, avg=3383.67, stdev=1196.00, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1559KiB/s (1596kB/s)(5120KiB/3285msec); 0 zone resets clat (msec): min=99, max=1061, avg=361.51, stdev=395.25 lat (msec): min=99, max=1062, avg=361.97, stdev=395.90 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 2003, max= 4079, per=39.78%, avg=2535.00, stdev=1029.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=11.33%, ctx=168, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178825: Sat Sep 12 23:28:01 2026 read: IOPS=0, BW=455KiB/s (466kB/s)(2048KiB/4499msec) clat (msec): min=112, max=1389, avg=751.42, stdev=902.95 lat (msec): min=112, max=1389, avg=751.42, stdev=902.95 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 113], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 2007, max= 2035, per=44.40%, avg=2021.00, stdev=19.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2276KiB/s (2331kB/s)(10.0MiB/4499msec); 0 zone resets clat (msec): min=132, max=956, avg=289.43, stdev=251.53 lat (msec): min=132, max=956, avg=289.53, stdev=251.52 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 144], | 30.00th=[ 150], 40.00th=[ 178], 50.00th=[ 186], 60.00th=[ 211], | 70.00th=[ 234], 80.00th=[ 253], 90.00th=[ 447], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2039, max= 8143, per=71.52%, avg=4557.00, stdev=2567.11, samples=4 iops : min= 1, max= 7, avg= 3.50, stdev= 2.52, samples=4 lat (msec) : 250=66.67%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=12.78%, ctx=181, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178826: Sat Sep 12 23:28:01 2026 read: IOPS=2, BW=2794KiB/s (2861kB/s)(6144KiB/2199msec) clat (usec): min=548, max=166455, avg=108838.85, stdev=59933.95 lat (usec): min=550, max=166457, avg=108840.22, stdev=59933.70 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[101188], | 30.00th=[101188], 40.00th=[111674], 50.00th=[111674], 60.00th=[111674], | 70.00th=[162530], 80.00th=[162530], 90.00th=[166724], 95.00th=[166724], | 99.00th=[166724], 99.50th=[166724], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 2015, max= 6107, per=74.47%, avg=3390.00, stdev=2353.05, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2794KiB/s (2861kB/s)(6144KiB/2199msec); 0 zone resets clat (msec): min=140, max=332, avg=245.00, stdev=70.78 lat (msec): min=140, max=332, avg=245.08, stdev=70.77 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 259], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1954, max= 4096, per=39.63%, avg=2525.00, stdev=1047.90, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=18.74%, ctx=140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178827: Sat Sep 12 23:28:01 2026 read: IOPS=1, BW=1663KiB/s (1703kB/s)(5120KiB/3078msec) clat (usec): min=509, max=186267, avg=73729.68, stdev=94977.09 lat (usec): min=509, max=186268, avg=73730.78, stdev=94977.07 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 12780], 60.00th=[ 12780], | 70.00th=[168821], 80.00th=[168821], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2329KiB/s (2385kB/s)(7168KiB/3078msec); 0 zone resets clat (msec): min=143, max=1053, avg=378.81, stdev=317.87 lat (msec): min=143, max=1054, avg=379.60, stdev=318.11 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 157], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 300], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 460], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1765, max= 2048, per=30.87%, avg=1966.75, stdev=135.22, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 20=8.33%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=11.28%, ctx=168, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4552KiB/s (4661kB/s), 455KiB/s-2794KiB/s (466kB/s-2861kB/s), io=20.0MiB (20.0MB), run=2199-4499msec WRITE: bw=6373KiB/s (6526kB/s), 1559KiB/s-2794KiB/s (1596kB/s-2861kB/s), io=28.0MiB (29.4MB), run=2199-4499msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178829: Sat Sep 12 23:28:01 2026 read: IOPS=2, BW=2079KiB/s (2129kB/s)(7168KiB/3447msec) clat (msec): min=61, max=327, avg=130.93, stdev=92.06 lat (msec): min=61, max=327, avg=130.93, stdev=92.06 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 66], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 107], 60.00th=[ 108], | 70.00th=[ 108], 80.00th=[ 155], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1698, max= 4071, per=70.69%, avg=3277.33, stdev=1367.75, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1485KiB/s (1521kB/s)(5120KiB/3447msec); 0 zone resets clat (msec): min=123, max=1281, avg=447.53, stdev=487.74 lat (msec): min=123, max=1281, avg=447.72, stdev=487.69 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 2031, max= 4079, per=41.83%, avg=2715.00, stdev=1181.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=50.00%, 500=16.67%, 2000=8.33% cpu : usr=0.03%, sys=5.86%, ctx=120, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178830: Sat Sep 12 23:28:01 2026 read: IOPS=0, BW=472KiB/s (483kB/s)(2048KiB/4341msec) clat (msec): min=91, max=1085, avg=588.17, stdev=702.87 lat (msec): min=91, max=1085, avg=588.17, stdev=702.87 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 91], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2048, max= 2048, per=44.18%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2359KiB/s (2416kB/s)(10.0MiB/4341msec); 0 zone resets clat (msec): min=114, max=708, avg=313.43, stdev=178.66 lat (msec): min=114, max=708, avg=313.55, stdev=178.64 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 125], | 30.00th=[ 222], 40.00th=[ 232], 50.00th=[ 271], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 405], 90.00th=[ 485], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2039, max= 6095, per=56.39%, avg=3660.00, stdev=1693.65, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.48, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=5.94%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178831: Sat Sep 12 23:28:01 2026 read: IOPS=1, BW=1955KiB/s (2002kB/s)(6144KiB/3143msec) clat (msec): min=56, max=878, avg=217.90, stdev=325.45 lat (msec): min=56, max=878, avg=217.90, stdev=325.45 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 66], 50.00th=[ 66], 60.00th=[ 117], | 70.00th=[ 133], 80.00th=[ 133], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2031, max= 4096, per=73.38%, avg=3402.00, stdev=1187.35, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1955KiB/s (2002kB/s)(6144KiB/3143msec); 0 zone resets clat (msec): min=69, max=506, avg=292.30, stdev=164.47 lat (msec): min=69, max=506, avg=292.55, stdev=164.42 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 313], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2035, max= 3785, per=38.11%, avg=2473.50, stdev=874.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.95%, ctx=94, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178832: Sat Sep 12 23:28:01 2026 read: IOPS=1, BW=1159KiB/s (1187kB/s)(5120KiB/4417msec) clat (msec): min=66, max=585, avg=264.47, stdev=200.05 lat (msec): min=66, max=585, avg=264.47, stdev=200.05 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 4079, max= 4087, per=88.07%, avg=4083.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1623KiB/s (1662kB/s)(7168KiB/4417msec); 0 zone resets clat (msec): min=153, max=1603, avg=432.73, stdev=522.44 lat (msec): min=153, max=1603, avg=432.84, stdev=522.45 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 228], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 384], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1939, max= 4063, per=38.82%, avg=2520.00, stdev=1029.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=3.44%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4637KiB/s (4748kB/s), 472KiB/s-2079KiB/s (483kB/s-2129kB/s), io=20.0MiB (20.0MB), run=3143-4417msec WRITE: bw=6491KiB/s (6647kB/s), 1485KiB/s-2359KiB/s (1521kB/s-2416kB/s), io=28.0MiB (29.4MB), run=3143-4417msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178839: Sat Sep 12 23:28:14 2026 read: IOPS=1, BW=4181KiB/s (4281kB/s)(12.0MiB/2939msec) clat (msec): min=414, max=1805, avg=945.95, stdev=751.08 lat (msec): min=414, max=1805, avg=945.95, stdev=751.08 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 7801, max= 7984, per=100.00%, avg=7892.50, stdev=129.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.27%, ctx=38, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178840: Sat Sep 12 23:28:14 2026 read: IOPS=0, BW=1913KiB/s (1959kB/s)(4096KiB/2141msec) clat (nsec): min=186144k, max=186144k, avg=186144291.00, stdev= 0.00 lat (nsec): min=186147k, max=186147k, avg=186147208.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 7049, max= 7049, per=100.00%, avg=7049.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3826KiB/s (3918kB/s)(8192KiB/2141msec); 0 zone resets clat (msec): min=371, max=1533, avg=952.53, stdev=822.14 lat (msec): min=371, max=1534, avg=953.17, stdev=822.48 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7984, max= 7984, per=52.17%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=5.00%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178841: Sat Sep 12 23:28:14 2026 write: IOPS=1, BW=6827KiB/s (6991kB/s)(12.0MiB/1800msec); 0 zone resets clat (msec): min=289, max=808, avg=569.56, stdev=262.00 lat (msec): min=290, max=808, avg=570.21, stdev=261.44 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7937, max= 8159, per=52.59%, avg=8048.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=7.06%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178842: Sat Sep 12 23:28:14 2026 write: IOPS=1, BW=8063KiB/s (8257kB/s)(12.0MiB/1524msec); 0 zone resets clat (msec): min=177, max=879, avg=485.29, stdev=358.56 lat (msec): min=178, max=879, avg=485.75, stdev=358.66 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min=11393, max=11393, per=74.44%, avg=11393.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.89%, ctx=112, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5575KiB/s (5708kB/s), 1913KiB/s-4181KiB/s (1959kB/s-4281kB/s), io=16.0MiB (16.8MB), run=2141-2939msec WRITE: bw=14.9MiB/s (15.7MB/s), 3826KiB/s-8063KiB/s (3918kB/s-8257kB/s), io=32.0MiB (33.6MB), run=1524-2141msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178844: Sat Sep 12 23:28:15 2026 read: IOPS=1, BW=5868KiB/s (6009kB/s)(12.0MiB/2094msec) clat (msec): min=598, max=753, avg=696.87, stdev=85.53 lat (msec): min=598, max=753, avg=696.88, stdev=85.53 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8062, max= 8110, per=100.00%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.00%, ctx=290, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178845: Sat Sep 12 23:28:15 2026 read: IOPS=0, BW=1395KiB/s (1429kB/s)(4096KiB/2936msec) clat (nsec): min=757418k, max=757418k, avg=757417985.00, stdev= 0.00 lat (nsec): min=757420k, max=757420k, avg=757420163.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2790KiB/s (2857kB/s)(8192KiB/2936msec); 0 zone resets clat (msec): min=913, max=1262, avg=1087.85, stdev=247.20 lat (msec): min=913, max=1263, avg=1088.56, stdev=247.22 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8143, max= 8143, per=74.95%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.03%, sys=6.98%, ctx=180, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178846: Sat Sep 12 23:28:15 2026 write: IOPS=0, BW=4074KiB/s (4172kB/s)(12.0MiB/3016msec); 0 zone resets clat (msec): min=308, max=1380, avg=1001.93, stdev=601.18 lat (msec): min=310, max=1380, avg=1003.37, stdev=601.09 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8110, max= 8110, per=74.65%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.78%, ctx=68, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178847: Sat Sep 12 23:28:15 2026 write: IOPS=1, BW=4563KiB/s (4672kB/s)(12.0MiB/2693msec); 0 zone resets clat (msec): min=310, max=1802, avg=895.72, stdev=796.03 lat (msec): min=311, max=1803, avg=896.66, stdev=796.33 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8015, max= 8062, per=73.99%, avg=8038.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.09%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5580KiB/s (5714kB/s), 1395KiB/s-5868KiB/s (1429kB/s-6009kB/s), io=16.0MiB (16.8MB), run=2094-2936msec WRITE: bw=10.6MiB/s (11.1MB/s), 2790KiB/s-4563KiB/s (2857kB/s-4672kB/s), io=32.0MiB (33.6MB), run=2693-3016msec