== sanity test 398b: DIO and buffer IO race ============== 08:14:32 (1787141672) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.10517 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178889: Wed Aug 19 08:17:12 2026 read: IOPS=10, BW=42.9KiB/s (43.0kB/s)(5992KiB/139567msec) clat (usec): min=39, max=817980, avg=51366.99, stdev=38905.75 lat (usec): min=39, max=817981, avg=51369.15, stdev=38905.64 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12256], 10.00th=[ 19530], 20.00th=[ 25822], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[177210], 99.50th=[185598], 99.90th=[312476], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 86, per=24.70%, avg=42.49, stdev=16.17, samples=274 iops : min= 1, max= 21, avg= 9.96, stdev= 4.08, samples=274 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6296KiB/139567msec); 0 zone resets clat (usec): min=791, max=313608, avg=39644.41, stdev=39582.93 lat (usec): min=792, max=313609, avg=39650.02, stdev=39586.98 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1418], 10.00th=[ 1860], 20.00th=[ 4359], | 30.00th=[ 8848], 40.00th=[ 19530], 50.00th=[ 29754], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[162530], 99.50th=[177210], 99.90th=[238027], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 125, per=24.79%, avg=44.62, stdev=20.48, samples=274 iops : min= 1, max= 31, avg=10.50, stdev= 5.14, samples=274 lat (usec) : 50=0.33%, 100=1.53%, 250=0.13%, 500=0.03%, 1000=0.10% lat (msec) : 2=5.63%, 4=4.00%, 10=6.54%, 20=7.52%, 50=38.12% lat (msec) : 100=28.03%, 250=7.91%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=4.35%, ctx=6688, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178890: Wed Aug 19 08:17:12 2026 read: IOPS=10, BW=42.0KiB/s (43.0kB/s)(5940KiB/138258msec) clat (usec): min=38, max=861825, avg=50613.23, stdev=37661.23 lat (usec): min=38, max=861827, avg=50620.85, stdev=37658.00 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 12780], 10.00th=[ 18744], 20.00th=[ 25822], | 30.00th=[ 31851], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[107480], | 99.00th=[162530], 99.50th=[170918], 99.90th=[250610], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 102, per=24.94%, avg=42.89, stdev=16.32, samples=269 iops : min= 1, max= 25, avg=10.07, stdev= 4.11, samples=269 write: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6348KiB/138258msec); 0 zone resets clat (usec): min=1079, max=293818, avg=39625.94, stdev=39778.97 lat (usec): min=1081, max=293819, avg=39636.93, stdev=39775.76 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1418], 10.00th=[ 1991], 20.00th=[ 4490], | 30.00th=[ 8848], 40.00th=[ 21365], 50.00th=[ 29230], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[115868], | 99.00th=[179307], 99.50th=[196084], 99.90th=[246416], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 127, per=25.33%, avg=45.59, stdev=20.51, samples=270 iops : min= 1, max= 31, avg=10.74, stdev= 5.19, samples=270 lat (usec) : 50=0.23%, 100=1.56%, 250=0.23%, 500=0.03% lat (msec) : 2=5.21%, 4=4.49%, 10=6.77%, 20=7.32%, 50=37.96% lat (msec) : 100=29.07%, 250=7.03%, 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=4.22%, ctx=6526, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178891: Wed Aug 19 08:17:12 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6028KiB/135418msec) clat (usec): min=32, max=284050, avg=49938.12, stdev=32226.71 lat (usec): min=33, max=284052, avg=49949.23, stdev=32228.12 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 13829], 10.00th=[ 19792], 20.00th=[ 26084], | 30.00th=[ 31065], 40.00th=[ 35914], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[162530], 99.50th=[196084], 99.90th=[248513], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 111, per=25.68%, avg=44.18, stdev=18.16, samples=266 iops : min= 1, max= 27, avg=10.39, stdev= 4.58, samples=266 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6260KiB/135418msec); 0 zone resets clat (usec): min=947, max=896027, avg=38289.02, stdev=44271.92 lat (usec): min=948, max=896031, avg=38297.84, stdev=44267.57 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1418], 10.00th=[ 1844], 20.00th=[ 4359], | 30.00th=[ 7832], 40.00th=[ 17171], 50.00th=[ 27132], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 65799], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[156238], 99.50th=[173016], 99.90th=[238027], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 111, per=25.47%, avg=45.85, stdev=20.21, samples=266 iops : min= 1, max= 27, avg=10.81, stdev= 5.10, samples=266 lat (usec) : 50=0.16%, 100=1.40%, 250=0.16%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.57%, 4=4.10%, 10=7.55%, 20=8.01%, 50=38.48% lat (msec) : 100=26.95%, 250=7.45%, 500=0.03%, 1000=0.03% cpu : usr=0.06%, sys=4.38%, ctx=6598, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178892: Wed Aug 19 08:17:12 2026 read: IOPS=10, BW=43.9KiB/s (44.9kB/s)(6052KiB/137908msec) clat (usec): min=39, max=245689, avg=49887.09, stdev=31352.08 lat (usec): min=39, max=245690, avg=49894.61, stdev=31362.64 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11863], 10.00th=[ 19006], 20.00th=[ 26346], | 30.00th=[ 31327], 40.00th=[ 38011], 50.00th=[ 43779], 60.00th=[ 51119], | 70.00th=[ 60031], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[104334], | 99.00th=[154141], 99.50th=[179307], 99.90th=[238027], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 95, per=25.43%, avg=43.74, stdev=16.16, samples=270 iops : min= 1, max= 23, avg=10.27, stdev= 4.08, samples=270 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6236KiB/137908msec); 0 zone resets clat (usec): min=1086, max=908784, avg=39911.09, stdev=44727.71 lat (usec): min=1087, max=908786, avg=39917.06, stdev=44731.26 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1434], 10.00th=[ 2114], 20.00th=[ 4817], | 30.00th=[ 9241], 40.00th=[ 20055], 50.00th=[ 29754], 60.00th=[ 39584], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[168821], 99.50th=[185598], 99.90th=[308282], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 127, per=24.91%, avg=44.85, stdev=18.54, samples=271 iops : min= 1, max= 31, avg=10.56, stdev= 4.66, samples=271 lat (usec) : 50=0.10%, 100=1.92%, 500=0.10% lat (msec) : 2=4.85%, 4=3.87%, 10=7.13%, 20=7.85%, 50=38.05% lat (msec) : 100=29.33%, 250=6.74%, 500=0.03%, 1000=0.03% cpu : usr=0.06%, sys=4.26%, ctx=6546, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=172KiB/s (176kB/s), 42.9KiB/s-44.5KiB/s (43.0kB/s-45.6kB/s), io=23.4MiB (24.6MB), run=135418-139567msec WRITE: bw=180KiB/s (184kB/s), 45.1KiB/s-46.2KiB/s (46.2kB/s-47.3kB/s), io=24.6MiB (25.7MB), run=135418-139567msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178884: Wed Aug 19 08:17:58 2026 read: IOPS=8, BW=32.2KiB/s (32.9kB/s)(5992KiB/186273msec) clat (msec): min=5, max=927, avg=49.06, stdev=47.04 lat (msec): min=5, max=927, avg=49.06, stdev=47.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 71], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 194], 99.50th=[ 224], 99.90th=[ 321], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=32.49, stdev=21.50, samples=358 iops : min= 1, max= 29, avg= 7.45, stdev= 5.38, samples=358 write: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6296KiB/186273msec); 0 zone resets clat (msec): min=13, max=336, avg=71.38, stdev=47.44 lat (msec): min=13, max=336, avg=71.38, stdev=47.44 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 105], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 243], 99.50th=[ 279], 99.90th=[ 317], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 119, per=25.10%, avg=33.63, stdev=20.57, samples=363 iops : min= 1, max= 29, avg= 7.73, stdev= 5.16, samples=363 lat (msec) : 10=1.17%, 20=10.74%, 50=43.33%, 100=27.60%, 250=16.60% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.06%, sys=1.78%, ctx=4882, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178885: Wed Aug 19 08:17:58 2026 read: IOPS=8, BW=32.1KiB/s (32.8kB/s)(5940KiB/185242msec) clat (msec): min=5, max=895, avg=49.45, stdev=49.16 lat (msec): min=5, max=895, avg=49.46, stdev=49.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 68], 90.00th=[ 106], 95.00th=[ 140], | 99.00th=[ 228], 99.50th=[ 266], 99.90th=[ 380], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 134, per=25.65%, avg=32.83, stdev=22.67, samples=351 iops : min= 1, max= 33, avg= 7.53, stdev= 5.68, samples=351 write: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6348KiB/185242msec); 0 zone resets clat (msec): min=11, max=376, avg=70.18, stdev=47.55 lat (msec): min=11, max=376, avg=70.19, stdev=47.55 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 83], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 167], | 99.00th=[ 232], 99.50th=[ 275], 99.90th=[ 347], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 95, per=25.33%, avg=33.94, stdev=19.99, samples=363 iops : min= 1, max= 23, avg= 7.81, stdev= 5.02, samples=363 lat (msec) : 10=1.01%, 20=11.17%, 50=43.75%, 100=27.73%, 250=15.69% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.06%, sys=1.83%, ctx=5065, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178886: Wed Aug 19 08:17:58 2026 read: IOPS=8, BW=32.7KiB/s (33.4kB/s)(6028KiB/184545msec) clat (msec): min=5, max=322, avg=48.56, stdev=41.34 lat (msec): min=5, max=322, avg=48.56, stdev=41.34 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 70], 90.00th=[ 105], 95.00th=[ 134], | 99.00th=[ 207], 99.50th=[ 226], 99.90th=[ 296], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 127, per=25.76%, avg=32.97, stdev=20.75, samples=354 iops : min= 1, max= 31, avg= 7.57, stdev= 5.19, samples=354 write: IOPS=8, BW=33.9KiB/s (34.7kB/s)(6260KiB/184545msec); 0 zone resets clat (msec): min=12, max=968, avg=70.87, stdev=53.33 lat (msec): min=12, max=968, avg=70.87, stdev=53.33 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 83], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 165], | 99.00th=[ 259], 99.50th=[ 284], 99.90th=[ 372], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 111, per=25.19%, avg=33.75, stdev=20.48, samples=359 iops : min= 1, max= 27, avg= 7.77, stdev= 5.15, samples=359 lat (msec) : 10=1.07%, 20=10.64%, 50=44.76%, 100=27.64%, 250=15.20% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.05%, sys=1.80%, ctx=4979, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178887: Wed Aug 19 08:17:58 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6052KiB/184811msec) clat (msec): min=5, max=378, avg=49.41, stdev=43.31 lat (msec): min=5, max=378, avg=49.41, stdev=43.31 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 104], 95.00th=[ 140], | 99.00th=[ 201], 99.50th=[ 251], 99.90th=[ 330], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 119, per=25.98%, avg=33.26, stdev=21.97, samples=353 iops : min= 1, max= 29, avg= 7.63, stdev= 5.49, samples=353 write: IOPS=8, BW=33.7KiB/s (34.6kB/s)(6236KiB/184811msec); 0 zone resets clat (msec): min=11, max=972, avg=70.31, stdev=52.92 lat (msec): min=11, max=972, avg=70.31, stdev=52.92 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 68], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 133], 95.00th=[ 161], | 99.00th=[ 247], 99.50th=[ 275], 99.90th=[ 380], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 104, per=25.19%, avg=33.76, stdev=20.61, samples=358 iops : min= 1, max= 26, avg= 7.76, stdev= 5.18, samples=358 lat (msec) : 10=0.94%, 20=11.52%, 50=42.94%, 100=28.16%, 250=15.72% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.05%, sys=1.72%, ctx=4806, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (132kB/s), 32.1KiB/s-32.7KiB/s (32.8kB/s-33.5kB/s), io=23.4MiB (24.6MB), run=184545-186273msec WRITE: bw=135KiB/s (138kB/s), 33.7KiB/s-34.3KiB/s (34.6kB/s-35.1kB/s), io=24.6MiB (25.7MB), run=184545-186273msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178938: Wed Aug 19 08:18:51 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(5920KiB/37978msec) clat (usec): min=41, max=249757, avg=55381.27, stdev=37219.84 lat (usec): min=41, max=249758, avg=55388.12, stdev=37220.76 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 72], 10.00th=[ 1827], 20.00th=[ 26084], | 30.00th=[ 35914], 40.00th=[ 42730], 50.00th=[ 49546], 60.00th=[ 60031], | 70.00th=[ 68682], 80.00th=[ 84411], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[175113], 99.50th=[235930], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 375, per=26.66%, avg=155.69, stdev=60.01, samples=74 iops : min= 1, max= 23, avg= 8.96, stdev= 3.81, samples=74 write: IOPS=10, BW=168KiB/s (172kB/s)(6368KiB/37978msec); 0 zone resets clat (usec): min=1501, max=238407, avg=43443.78, stdev=43573.02 lat (usec): min=1505, max=238408, avg=43448.52, stdev=43574.17 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2147], 10.00th=[ 3294], 20.00th=[ 7111], | 30.00th=[ 11469], 40.00th=[ 19792], 50.00th=[ 31851], 60.00th=[ 42206], | 70.00th=[ 54789], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[132645], | 99.00th=[202376], 99.50th=[231736], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 26, max= 372, per=27.68%, avg=169.97, stdev=84.19, samples=73 iops : min= 1, max= 23, avg= 9.88, stdev= 5.31, samples=73 lat (usec) : 50=0.39%, 100=3.91%, 250=0.13%, 500=0.26% lat (msec) : 2=1.95%, 4=3.91%, 10=8.59%, 20=8.85%, 50=30.73% lat (msec) : 100=31.51%, 250=9.77% cpu : usr=0.06%, sys=4.57%, ctx=1696, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178939: Wed Aug 19 08:18:51 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5744KiB/39932msec) clat (usec): min=48, max=230578, avg=58942.43, stdev=38816.35 lat (usec): min=49, max=230580, avg=58943.71, stdev=38816.41 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 73], 10.00th=[ 19006], 20.00th=[ 31327], | 30.00th=[ 37487], 40.00th=[ 44827], 50.00th=[ 52691], 60.00th=[ 60556], | 70.00th=[ 70779], 80.00th=[ 83362], 90.00th=[107480], 95.00th=[135267], | 99.00th=[187696], 99.50th=[202376], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 26, max= 341, per=25.14%, avg=146.83, stdev=63.30, samples=76 iops : min= 1, max= 21, avg= 8.39, stdev= 4.00, samples=76 write: IOPS=10, BW=164KiB/s (168kB/s)(6544KiB/39932msec); 0 zone resets clat (usec): min=1431, max=259255, avg=44858.06, stdev=44403.08 lat (usec): min=1432, max=259257, avg=44883.97, stdev=44398.50 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2704], 10.00th=[ 3720], 20.00th=[ 7177], | 30.00th=[ 13042], 40.00th=[ 22676], 50.00th=[ 31065], 60.00th=[ 39060], | 70.00th=[ 55837], 80.00th=[ 79168], 90.00th=[112722], 95.00th=[132645], | 99.00th=[175113], 99.50th=[191890], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 500, per=26.70%, avg=163.94, stdev=90.84, samples=78 iops : min= 1, max= 31, avg= 9.49, stdev= 5.73, samples=78 lat (usec) : 50=0.13%, 100=2.86%, 250=0.13% lat (msec) : 2=1.43%, 4=5.21%, 10=6.77%, 20=8.07%, 50=33.20% lat (msec) : 100=29.82%, 250=12.24%, 500=0.13% cpu : usr=0.05%, sys=4.33%, ctx=1728, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178940: Wed Aug 19 08:18:51 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(6256KiB/41012msec) clat (usec): min=43, max=326454, avg=60132.20, stdev=40523.57 lat (usec): min=44, max=326455, avg=60134.97, stdev=40522.28 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 17695], 20.00th=[ 30278], | 30.00th=[ 38536], 40.00th=[ 46924], 50.00th=[ 55837], 60.00th=[ 63177], | 70.00th=[ 70779], 80.00th=[ 84411], 90.00th=[107480], 95.00th=[135267], | 99.00th=[191890], 99.50th=[270533], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 61, max= 256, per=26.57%, avg=155.19, stdev=51.03, samples=79 iops : min= 3, max= 16, avg= 8.92, stdev= 3.27, samples=79 write: IOPS=9, BW=147KiB/s (151kB/s)(6032KiB/41012msec); 0 zone resets clat (usec): min=1361, max=220994, avg=45060.41, stdev=43605.62 lat (usec): min=1364, max=220996, avg=45063.76, stdev=43608.45 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2147], 10.00th=[ 3163], 20.00th=[ 7570], | 30.00th=[ 12780], 40.00th=[ 22676], 50.00th=[ 33817], 60.00th=[ 43779], | 70.00th=[ 53740], 80.00th=[ 80217], 90.00th=[109577], 95.00th=[135267], | 99.00th=[187696], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 335, per=24.70%, avg=151.64, stdev=66.42, samples=77 iops : min= 1, max= 20, avg= 8.70, stdev= 4.16, samples=77 lat (usec) : 50=0.13%, 100=3.39%, 250=0.52%, 500=0.26% lat (msec) : 2=1.69%, 4=4.56%, 10=5.73%, 20=7.81%, 50=29.95% lat (msec) : 100=33.33%, 250=12.37%, 500=0.26% cpu : usr=0.05%, sys=4.32%, ctx=1804, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178941: Wed Aug 19 08:18:51 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37903msec) clat (usec): min=39, max=246549, avg=54661.69, stdev=38553.77 lat (usec): min=41, max=246551, avg=54662.88, stdev=38553.74 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 65], 10.00th=[ 816], 20.00th=[ 26870], | 30.00th=[ 33162], 40.00th=[ 40633], 50.00th=[ 48497], 60.00th=[ 56886], | 70.00th=[ 65274], 80.00th=[ 81265], 90.00th=[108528], 95.00th=[125305], | 99.00th=[183501], 99.50th=[210764], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 318, per=27.90%, avg=162.94, stdev=65.23, samples=72 iops : min= 1, max= 19, avg= 9.42, stdev= 4.12, samples=72 write: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37903msec); 0 zone resets clat (usec): min=1548, max=290051, avg=42905.25, stdev=45552.40 lat (usec): min=1549, max=290054, avg=42907.58, stdev=45552.32 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2212], 10.00th=[ 4817], 20.00th=[ 8160], | 30.00th=[ 11863], 40.00th=[ 17957], 50.00th=[ 27395], 60.00th=[ 38536], | 70.00th=[ 52167], 80.00th=[ 72877], 90.00th=[ 98042], 95.00th=[139461], | 99.00th=[212861], 99.50th=[246416], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 26, max= 352, per=26.97%, avg=165.62, stdev=75.51, samples=74 iops : min= 1, max= 22, avg= 9.59, stdev= 4.81, samples=74 lat (usec) : 50=0.26%, 100=3.91%, 250=0.52%, 1000=0.26% lat (msec) : 2=2.08%, 4=2.99%, 10=8.33%, 20=9.77%, 50=32.03% lat (msec) : 100=29.30%, 250=10.42%, 500=0.13% cpu : usr=0.07%, sys=4.67%, ctx=1751, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=584KiB/s (598kB/s), 144KiB/s-159KiB/s (147kB/s-163kB/s), io=23.4MiB (24.5MB), run=37903-41012msec WRITE: bw=614KiB/s (629kB/s), 147KiB/s-168KiB/s (151kB/s-172kB/s), io=24.6MiB (25.8MB), run=37903-41012msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178933: Wed Aug 19 08:19:02 2026 read: IOPS=7, BW=112KiB/s (115kB/s)(5920KiB/52738msec) clat (msec): min=7, max=248, avg=55.65, stdev=44.58 lat (msec): min=7, max=248, avg=55.65, stdev=44.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 64], 80.00th=[ 80], 90.00th=[ 113], 95.00th=[ 161], | 99.00th=[ 211], 99.50th=[ 239], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 544, per=25.99%, avg=117.45, stdev=84.53, samples=99 iops : min= 1, max= 34, avg= 6.56, stdev= 5.39, samples=99 write: IOPS=7, BW=121KiB/s (124kB/s)(6368KiB/52738msec); 0 zone resets clat (msec): min=13, max=389, avg=80.20, stdev=60.22 lat (msec): min=13, max=389, avg=80.20, stdev=60.22 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 51], 50.00th=[ 65], 60.00th=[ 75], | 70.00th=[ 97], 80.00th=[ 126], 90.00th=[ 165], 95.00th=[ 194], | 99.00th=[ 334], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 29, max= 416, per=26.35%, avg=125.41, stdev=83.59, samples=100 iops : min= 1, max= 26, avg= 7.03, stdev= 5.32, samples=100 lat (msec) : 10=1.95%, 20=8.85%, 50=38.80%, 100=29.43%, 250=19.92% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.74%, ctx=1399, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178934: Wed Aug 19 08:19:02 2026 read: IOPS=6, BW=109KiB/s (111kB/s)(5744KiB/52887msec) clat (msec): min=4, max=348, avg=57.13, stdev=55.40 lat (msec): min=4, max=348, avg=57.13, stdev=55.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 82], 90.00th=[ 133], 95.00th=[ 174], | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 29, max= 384, per=25.86%, avg=116.89, stdev=79.92, samples=95 iops : min= 1, max= 24, avg= 6.52, stdev= 5.02, samples=95 write: IOPS=7, BW=124KiB/s (127kB/s)(6544KiB/52887msec); 0 zone resets clat (msec): min=9, max=392, avg=78.76, stdev=62.93 lat (msec): min=9, max=392, avg=78.78, stdev=62.94 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 30], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 75], | 70.00th=[ 92], 80.00th=[ 122], 90.00th=[ 159], 95.00th=[ 197], | 99.00th=[ 321], 99.50th=[ 342], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 512, per=25.81%, avg=122.87, stdev=89.71, samples=103 iops : min= 1, max= 32, avg= 6.88, stdev= 5.71, samples=103 lat (msec) : 10=1.95%, 20=9.51%, 50=41.93%, 100=25.26%, 250=19.40% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.60%, ctx=1268, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178935: Wed Aug 19 08:19:02 2026 read: IOPS=7, BW=120KiB/s (122kB/s)(6256KiB/52337msec) clat (msec): min=6, max=348, avg=56.39, stdev=50.13 lat (msec): min=6, max=348, avg=56.39, stdev=50.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 59], 80.00th=[ 80], 90.00th=[ 116], 95.00th=[ 153], | 99.00th=[ 253], 99.50th=[ 317], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 539, per=27.24%, avg=123.12, stdev=90.19, samples=100 iops : min= 1, max= 33, avg= 6.89, stdev= 5.70, samples=100 write: IOPS=7, BW=115KiB/s (118kB/s)(6032KiB/52337msec); 0 zone resets clat (msec): min=12, max=331, avg=80.20, stdev=59.74 lat (msec): min=12, max=331, avg=80.23, stdev=59.78 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 35], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 75], | 70.00th=[ 94], 80.00th=[ 116], 90.00th=[ 163], 95.00th=[ 205], | 99.00th=[ 300], 99.50th=[ 326], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 352, per=24.40%, avg=116.13, stdev=72.63, samples=101 iops : min= 1, max= 22, avg= 6.46, stdev= 4.61, samples=101 lat (msec) : 10=1.56%, 20=8.46%, 50=39.71%, 100=30.47%, 250=17.71% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.59%, ctx=1271, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178936: Wed Aug 19 08:19:02 2026 read: IOPS=7, BW=115KiB/s (118kB/s)(6032KiB/52273msec) clat (msec): min=8, max=350, avg=55.88, stdev=46.44 lat (msec): min=8, max=350, avg=55.89, stdev=46.44 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 85], 90.00th=[ 124], 95.00th=[ 146], | 99.00th=[ 207], 99.50th=[ 309], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 351, per=26.91%, avg=121.62, stdev=75.53, samples=97 iops : min= 1, max= 21, avg= 6.80, stdev= 4.77, samples=97 write: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52273msec); 0 zone resets clat (msec): min=13, max=329, avg=78.67, stdev=55.69 lat (msec): min=13, max=329, avg=78.67, stdev=55.69 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 63], 60.00th=[ 78], | 70.00th=[ 94], 80.00th=[ 117], 90.00th=[ 150], 95.00th=[ 199], | 99.00th=[ 305], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 29, max= 448, per=25.41%, avg=120.96, stdev=80.54, samples=102 iops : min= 1, max= 28, avg= 6.75, stdev= 5.09, samples=102 lat (msec) : 10=0.65%, 20=8.72%, 50=41.28%, 100=27.99%, 250=20.57% lat (msec) : 500=0.78% cpu : usr=0.03%, sys=1.79%, ctx=1299, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=453KiB/s (464kB/s), 109KiB/s-120KiB/s (111kB/s-122kB/s), io=23.4MiB (24.5MB), run=52273-52887msec WRITE: bw=476KiB/s (488kB/s), 115KiB/s-124KiB/s (118kB/s-127kB/s), io=24.6MiB (25.8MB), run=52273-52887msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178960: Wed Aug 19 08:19:18 2026 read: IOPS=1, BW=1400KiB/s (1434kB/s)(7168KiB/5119msec) clat (usec): min=607, max=2511.2k, avg=537084.32, stdev=886662.71 lat (usec): min=609, max=2511.2k, avg=537085.75, stdev=886662.60 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], | 20.00th=[ 6783], 30.00th=[ 162530], 40.00th=[ 162530], | 50.00th=[ 256902], 60.00th=[ 396362], 70.00th=[ 396362], | 80.00th=[ 425722], 90.00th=[2499806], 95.00th=[2499806], | 99.00th=[2499806], 99.50th=[2499806], 99.90th=[2499806], | 99.95th=[2499806], 99.99th=[2499806] bw ( KiB/s): min= 1438, max= 2048, per=58.96%, avg=1911.33, stdev=236.07, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=1000KiB/s (1024kB/s)(5120KiB/5119msec); 0 zone resets clat (msec): min=176, max=422, avg=270.39, stdev=106.42 lat (msec): min=176, max=422, avg=270.56, stdev=106.33 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2039, max= 5862, per=87.03%, avg=3950.50, stdev=2703.27, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=33.33%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.80%, ctx=470, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178961: Wed Aug 19 08:19:18 2026 read: IOPS=0, BW=324KiB/s (332kB/s)(2048KiB/6316msec) clat (usec): min=1872, max=154706, avg=78289.70, stdev=108069.79 lat (usec): min=1873, max=154707, avg=78290.88, stdev=108070.09 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 1876], 10.00th=[ 1876], 20.00th=[ 1876], | 30.00th=[ 1876], 40.00th=[ 1876], 50.00th=[ 1876], 60.00th=[154141], | 70.00th=[154141], 80.00th=[154141], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 1368, max= 1954, per=51.23%, avg=1661.00, stdev=414.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1621KiB/s (1660kB/s)(10.0MiB/6316msec); 0 zone resets clat (msec): min=87, max=2817, avg=615.52, stdev=803.06 lat (msec): min=87, max=2817, avg=615.61, stdev=803.06 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 142], | 30.00th=[ 148], 40.00th=[ 205], 50.00th=[ 456], 60.00th=[ 493], | 70.00th=[ 502], 80.00th=[ 592], 90.00th=[ 718], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1872, max= 6119, per=61.34%, avg=2784.40, stdev=1864.90, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 750=25.00% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=7.93%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178962: Wed Aug 19 08:19:18 2026 read: IOPS=1, BW=1112KiB/s (1139kB/s)(6144KiB/5526msec) clat (usec): min=363, max=762694, avg=194182.37, stdev=295275.94 lat (usec): min=364, max=762695, avg=194183.40, stdev=295275.89 clat percentiles (usec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 453], | 30.00th=[ 453], 40.00th=[ 660], 50.00th=[ 660], 60.00th=[193987], | 70.00th=[208667], 80.00th=[208667], 90.00th=[759170], 95.00th=[759170], | 99.00th=[759170], 99.50th=[759170], 99.90th=[759170], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 1954, max= 8159, per=100.00%, avg=5056.50, stdev=4387.60, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1112KiB/s (1139kB/s)(6144KiB/5526msec); 0 zone resets clat (msec): min=160, max=2896, avg=726.64, stdev=1075.64 lat (msec): min=160, max=2896, avg=726.71, stdev=1075.66 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 279], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1950, max= 2880, per=48.60%, avg=2205.75, stdev=451.37, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.67%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178963: Wed Aug 19 08:19:18 2026 read: IOPS=0, BW=941KiB/s (963kB/s)(5120KiB/5442msec) clat (usec): min=556, max=239165, avg=55626.63, stdev=103437.20 lat (usec): min=557, max=239167, avg=55627.78, stdev=103437.37 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 1029], 40.00th=[ 1029], 50.00th=[ 5145], 60.00th=[ 5145], | 70.00th=[ 32375], 80.00th=[ 32375], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1317KiB/s (1349kB/s)(7168KiB/5442msec); 0 zone resets clat (msec): min=118, max=2831, avg=734.67, stdev=939.12 lat (msec): min=118, max=2831, avg=734.76, stdev=939.13 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 230], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 485], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 584], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1477, max= 2039, per=41.68%, avg=1891.80, stdev=235.93, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=8.33%, 50=8.33%, 250=25.00%, 500=16.67% lat (msec) : 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.59%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3243KiB/s (3320kB/s), 324KiB/s-1400KiB/s (332kB/s-1434kB/s), io=20.0MiB (20.0MB), run=5119-6316msec WRITE: bw=4540KiB/s (4649kB/s), 1000KiB/s-1621KiB/s (1024kB/s-1660kB/s), io=28.0MiB (29.4MB), run=5119-6316msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178955: Wed Aug 19 08:19:18 2026 read: IOPS=1, BW=1068KiB/s (1093kB/s)(7168KiB/6713msec) clat (msec): min=119, max=2852, avg=658.05, stdev=1006.88 lat (msec): min=119, max=2852, avg=658.05, stdev=1006.88 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 130], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 186], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 911], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1961, max= 3185, per=75.25%, avg=2295.25, stdev=594.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=763KiB/s (781kB/s)(5120KiB/6713msec); 0 zone resets clat (msec): min=75, max=1033, avg=400.44, stdev=381.62 lat (msec): min=75, max=1033, avg=400.54, stdev=381.61 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 2039, max= 4055, per=63.51%, avg=2712.33, stdev=1162.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=1.79%, ctx=67, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178956: Wed Aug 19 08:19:18 2026 read: IOPS=0, BW=336KiB/s (344kB/s)(2048KiB/6093msec) clat (msec): min=149, max=473, avg=311.41, stdev=229.21 lat (msec): min=149, max=473, avg=311.41, stdev=229.21 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1519, max= 1996, per=57.62%, avg=1757.50, stdev=337.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1681KiB/s (1721kB/s)(10.0MiB/6093msec); 0 zone resets clat (msec): min=110, max=2731, avg=533.63, stdev=790.89 lat (msec): min=110, max=2731, avg=533.80, stdev=790.87 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 131], | 30.00th=[ 133], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 342], | 70.00th=[ 451], 80.00th=[ 468], 90.00th=[ 600], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1865, max= 4055, per=65.93%, avg=2816.00, stdev=1002.18, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=2.97%, ctx=79, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178957: Wed Aug 19 08:19:18 2026 read: IOPS=0, BW=927KiB/s (949kB/s)(6144KiB/6627msec) clat (msec): min=55, max=893, avg=410.60, stdev=285.25 lat (msec): min=55, max=893, avg=410.61, stdev=285.25 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 464], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2027, max= 4087, per=100.00%, avg=3368.67, stdev=1162.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=927KiB/s (949kB/s)(6144KiB/6627msec); 0 zone resets clat (msec): min=52, max=2852, avg=672.48, stdev=1075.39 lat (msec): min=53, max=2852, avg=672.61, stdev=1075.36 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 351], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1961, max= 3084, per=53.31%, avg=2276.75, stdev=539.27, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.49%, ctx=69, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178958: Wed Aug 19 08:19:18 2026 read: IOPS=0, BW=795KiB/s (814kB/s)(5120KiB/6440msec) clat (msec): min=76, max=854, avg=321.72, stdev=336.79 lat (msec): min=76, max=854, avg=321.72, stdev=336.79 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1865, max= 3992, per=86.08%, avg=2625.33, stdev=1186.07, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1113KiB/s (1140kB/s)(7168KiB/6440msec); 0 zone resets clat (msec): min=112, max=2840, avg=685.39, stdev=977.65 lat (msec): min=112, max=2840, avg=685.48, stdev=977.66 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 148], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 264], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 735], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1961, max= 4726, per=62.97%, avg=2689.25, stdev=1358.30, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.84%, ctx=68, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3051KiB/s (3124kB/s), 336KiB/s-1068KiB/s (344kB/s-1093kB/s), io=20.0MiB (20.0MB), run=6093-6713msec WRITE: bw=4271KiB/s (4374kB/s), 763KiB/s-1681KiB/s (781kB/s-1721kB/s), io=28.0MiB (29.4MB), run=6093-6713msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178971: Wed Aug 19 08:19:36 2026 read: IOPS=0, BW=2807KiB/s (2874kB/s)(12.0MiB/4378msec) clat (msec): min=961, max=1948, avg=1376.64, stdev=511.66 lat (msec): min=961, max=1948, avg=1376.64, stdev=511.66 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.05%, sys=9.02%, ctx=569, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178973: Wed Aug 19 08:19:36 2026 read: IOPS=0, BW=844KiB/s (864kB/s)(4096KiB/4854msec) clat (nsec): min=441207k, max=441207k, avg=441207472.00, stdev= 0.00 lat (nsec): min=441210k, max=441210k, avg=441210110.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 5461, max= 5461, per=100.00%, avg=5461.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1688KiB/s (1728kB/s)(8192KiB/4854msec); 0 zone resets clat (msec): min=1518, max=2827, avg=2172.94, stdev=925.40 lat (msec): min=1518, max=2827, avg=2173.25, stdev=925.30 clat percentiles (msec): | 1.00th=[ 1519], 5.00th=[ 1519], 10.00th=[ 1519], 20.00th=[ 1519], | 30.00th=[ 1519], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 2836], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.58%, ctx=216, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178975: Wed Aug 19 08:19:36 2026 write: IOPS=0, BW=2578KiB/s (2640kB/s)(12.0MiB/4766msec); 0 zone resets clat (msec): min=409, max=2656, avg=1558.08, stdev=1124.61 lat (msec): min=409, max=2658, avg=1558.94, stdev=1125.21 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 7641, max= 8175, per=100.00%, avg=7908.00, stdev=377.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.75%, ctx=52, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178977: Wed Aug 19 08:19:36 2026 write: IOPS=0, BW=2757KiB/s (2823kB/s)(12.0MiB/4457msec); 0 zone resets clat (msec): min=227, max=3421, avg=1463.92, stdev=1714.64 lat (msec): min=229, max=3421, avg=1465.17, stdev=1713.88 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.80%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3375KiB/s (3456kB/s), 844KiB/s-2807KiB/s (864kB/s-2874kB/s), io=16.0MiB (16.8MB), run=4378-4854msec WRITE: bw=6751KiB/s (6913kB/s), 1688KiB/s-2757KiB/s (1728kB/s-2823kB/s), io=32.0MiB (33.6MB), run=4457-4854msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178972: Wed Aug 19 08:19:36 2026 read: IOPS=0, BW=2967KiB/s (3039kB/s)(12.0MiB/4141msec) clat (msec): min=220, max=3337, avg=1347.63, stdev=1728.02 lat (msec): min=220, max=3337, avg=1347.63, stdev=1728.01 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 6023, max= 8175, per=100.00%, avg=7099.00, stdev=1521.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.84%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178974: Wed Aug 19 08:19:36 2026 read: IOPS=0, BW=771KiB/s (790kB/s)(4096KiB/5311msec) clat (nsec): min=3945.2M, max=3945.2M, avg=3945181901.00, stdev= 0.00 lat (nsec): min=3945.2M, max=3945.2M, avg=3945185266.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3943], 5.00th=[ 3943], 10.00th=[ 3943], 20.00th=[ 3943], | 30.00th=[ 3943], 40.00th=[ 3943], 50.00th=[ 3943], 60.00th=[ 3943], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1542KiB/s (1579kB/s)(8192KiB/5311msec); 0 zone resets clat (msec): min=376, max=904, avg=640.68, stdev=372.91 lat (msec): min=377, max=906, avg=641.92, stdev=373.99 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.54%, ctx=53, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178976: Wed Aug 19 08:19:36 2026 write: IOPS=0, BW=2456KiB/s (2515kB/s)(12.0MiB/5004msec); 0 zone resets clat (msec): min=360, max=3331, avg=1644.42, stdev=1526.09 lat (msec): min=360, max=3331, avg=1644.75, stdev=1526.12 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.73%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178978: Wed Aug 19 08:19:36 2026 write: IOPS=0, BW=2334KiB/s (2390kB/s)(12.0MiB/5265msec); 0 zone resets clat (msec): min=277, max=2485, avg=1729.63, stdev=1257.97 lat (msec): min=280, max=2486, avg=1731.17, stdev=1256.47 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 2433], 50.00th=[ 2433], 60.00th=[ 2433], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.22%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3085KiB/s (3159kB/s), 771KiB/s-2967KiB/s (790kB/s-3039kB/s), io=16.0MiB (16.8MB), run=4141-5311msec WRITE: bw=6170KiB/s (6318kB/s), 1542KiB/s-2456KiB/s (1579kB/s-2515kB/s), io=32.0MiB (33.6MB), run=5004-5311msec