== sanity test 398b: DIO and buffer IO race ============== 01:02:48 (1788843768) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.16038 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179316: Tue Sep 8 01:05:31 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(5992KiB/143006msec) clat (usec): min=33, max=1030.5k, avg=53072.93, stdev=42757.73 lat (usec): min=33, max=1030.5k, avg=53077.17, stdev=42758.45 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 12780], 10.00th=[ 18482], | 20.00th=[ 25822], 30.00th=[ 32375], 40.00th=[ 39060], | 50.00th=[ 46924], 60.00th=[ 53740], 70.00th=[ 62129], | 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[ 114820], | 99.00th=[ 177210], 99.50th=[ 198181], 99.90th=[ 299893], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 95, per=24.98%, avg=41.72, stdev=16.33, samples=279 iops : min= 1, max= 23, avg= 9.76, stdev= 4.13, samples=279 write: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6296KiB/143006msec); 0 zone resets clat (usec): min=988, max=264439, avg=40008.35, stdev=40295.96 lat (usec): min=989, max=264442, avg=40013.26, stdev=40294.77 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 2008], 20.00th=[ 4883], | 30.00th=[ 8979], 40.00th=[ 19006], 50.00th=[ 28967], 60.00th=[ 39584], | 70.00th=[ 51643], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[173016], 99.50th=[193987], 99.90th=[240124], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 138, per=24.97%, avg=43.69, stdev=20.61, samples=280 iops : min= 1, max= 34, avg=10.26, stdev= 5.18, samples=280 lat (usec) : 50=0.10%, 100=1.56%, 250=0.23%, 500=0.03%, 1000=0.07% lat (msec) : 2=5.14%, 4=3.58%, 10=7.52%, 20=8.43%, 50=35.68% lat (msec) : 100=29.62%, 250=7.91%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=4.81%, ctx=6647, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179319: Tue Sep 8 01:05:31 2026 read: IOPS=10, BW=42.3KiB/s (43.4kB/s)(5940KiB/140274msec) clat (usec): min=36, max=238732, avg=50704.52, stdev=31897.00 lat (usec): min=36, max=238734, avg=50708.14, stdev=31897.72 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 14222], 10.00th=[ 19530], 20.00th=[ 26346], | 30.00th=[ 31851], 40.00th=[ 36963], 50.00th=[ 44303], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[109577], | 99.00th=[160433], 99.50th=[193987], 99.90th=[217056], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 5, max= 95, per=25.13%, avg=41.96, stdev=17.09, samples=276 iops : min= 1, max= 23, avg= 9.82, stdev= 4.29, samples=276 write: IOPS=11, BW=45.3KiB/s (46.3kB/s)(6348KiB/140274msec); 0 zone resets clat (usec): min=1099, max=1013.0k, avg=40638.08, stdev=46826.03 lat (usec): min=1100, max=1013.0k, avg=40640.25, stdev=46826.00 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1418], 10.00th=[ 2212], | 20.00th=[ 5145], 30.00th=[ 9765], 40.00th=[ 18744], | 50.00th=[ 28705], 60.00th=[ 39060], 70.00th=[ 52691], | 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[ 120062], | 99.00th=[ 168821], 99.50th=[ 200279], 99.90th=[ 270533], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 120, per=25.76%, avg=45.08, stdev=20.98, samples=275 iops : min= 1, max= 30, avg=10.60, stdev= 5.29, samples=275 lat (usec) : 50=0.03%, 100=1.20%, 250=0.10%, 500=0.10%, 1000=0.07% lat (msec) : 2=4.43%, 4=4.49%, 10=7.16%, 20=8.50%, 50=37.60% lat (msec) : 100=28.22%, 250=8.04%, 500=0.03%, 2000=0.03% cpu : usr=0.07%, sys=5.00%, ctx=6712, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179321: Tue Sep 8 01:05:31 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6028KiB/140638msec) clat (usec): min=32, max=289726, avg=50131.24, stdev=33722.25 lat (usec): min=33, max=289727, avg=50148.24, stdev=33721.00 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 10421], 10.00th=[ 17957], 20.00th=[ 25035], | 30.00th=[ 31065], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 51119], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[181404], 99.50th=[202376], 99.90th=[261096], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 95, per=25.51%, avg=42.60, stdev=16.62, samples=275 iops : min= 1, max= 23, avg= 9.99, stdev= 4.18, samples=275 write: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6260KiB/140638msec); 0 zone resets clat (usec): min=1018, max=1160.9k, avg=41228.59, stdev=50104.45 lat (usec): min=1019, max=1160.9k, avg=41247.62, stdev=50141.18 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1418], 10.00th=[ 2278], | 20.00th=[ 4686], 30.00th=[ 9110], 40.00th=[ 18744], | 50.00th=[ 30016], 60.00th=[ 39584], 70.00th=[ 51119], | 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[ 123208], | 99.00th=[ 175113], 99.50th=[ 208667], 99.90th=[ 283116], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 111, per=25.26%, avg=44.20, stdev=19.69, samples=275 iops : min= 1, max= 27, avg=10.38, stdev= 4.95, samples=275 lat (usec) : 50=0.10%, 100=1.82%, 250=0.20%, 500=0.10% lat (msec) : 2=4.46%, 4=4.56%, 10=7.26%, 20=8.11%, 50=37.50% lat (msec) : 100=27.96%, 250=7.68%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=4.99%, ctx=6677, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179323: Tue Sep 8 01:05:31 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6052KiB/142097msec) clat (usec): min=33, max=317160, avg=50568.34, stdev=33798.43 lat (usec): min=33, max=317162, avg=50576.96, stdev=33800.23 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 11469], 10.00th=[ 19268], 20.00th=[ 25822], | 30.00th=[ 31327], 40.00th=[ 36439], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[175113], 99.50th=[214959], 99.90th=[278922], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 111, per=25.47%, avg=42.53, stdev=17.31, samples=277 iops : min= 1, max= 27, avg= 9.96, stdev= 4.35, samples=277 write: IOPS=10, BW=43.9KiB/s (44.9kB/s)(6236KiB/142097msec); 0 zone resets clat (usec): min=1005, max=1128.2k, avg=41743.42, stdev=49287.48 lat (usec): min=1005, max=1128.2k, avg=41749.50, stdev=49288.26 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1434], 10.00th=[ 2245], | 20.00th=[ 4948], 30.00th=[ 9765], 40.00th=[ 19268], | 50.00th=[ 30278], 60.00th=[ 40633], 70.00th=[ 54264], | 80.00th=[ 71828], 90.00th=[ 98042], 95.00th=[ 121111], | 99.00th=[ 164627], 99.50th=[ 206570], 99.90th=[ 291505], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 119, per=24.90%, avg=43.57, stdev=19.32, samples=278 iops : min= 1, max= 29, avg=10.22, stdev= 4.86, samples=278 lat (usec) : 50=0.07%, 100=1.82%, 250=0.23%, 500=0.07% lat (msec) : 2=4.36%, 4=4.30%, 10=6.87%, 20=8.53%, 50=36.65% lat (msec) : 100=28.97%, 250=7.88%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=4.87%, ctx=6653, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (172kB/s), 41.9KiB/s-42.9KiB/s (42.9kB/s-43.9kB/s), io=23.4MiB (24.6MB), run=140274-143006msec WRITE: bw=176KiB/s (180kB/s), 43.9KiB/s-45.3KiB/s (44.9kB/s-46.3kB/s), io=24.6MiB (25.7MB), run=140274-143006msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179317: Tue Sep 8 01:06:15 2026 read: IOPS=8, BW=32.1KiB/s (32.8kB/s)(5992KiB/186854msec) clat (msec): min=5, max=1026, avg=50.26, stdev=50.51 lat (msec): min=5, max=1026, avg=50.26, stdev=50.51 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 55], 80.00th=[ 77], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 215], 99.50th=[ 247], 99.90th=[ 292], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 143, per=25.60%, avg=32.77, stdev=23.82, samples=355 iops : min= 1, max= 35, avg= 7.54, stdev= 6.01, samples=355 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6296KiB/186854msec); 0 zone resets clat (msec): min=9, max=361, avg=70.61, stdev=49.43 lat (msec): min=9, max=361, avg=70.61, stdev=49.43 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 67], | 70.00th=[ 85], 80.00th=[ 107], 90.00th=[ 138], 95.00th=[ 167], | 99.00th=[ 239], 99.50th=[ 305], 99.90th=[ 334], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 112, per=25.05%, avg=33.56, stdev=22.35, samples=364 iops : min= 1, max= 28, avg= 7.73, stdev= 5.66, samples=364 lat (msec) : 10=1.69%, 20=11.88%, 50=43.10%, 100=25.20%, 250=17.51% lat (msec) : 500=0.59%, 2000=0.03% cpu : usr=0.06%, sys=1.65%, ctx=4846, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179318: Tue Sep 8 01:06:15 2026 read: IOPS=7, BW=31.0KiB/s (32.7kB/s)(5940KiB/185889msec) clat (msec): min=4, max=1111, avg=48.48, stdev=51.98 lat (msec): min=4, max=1111, avg=48.49, stdev=51.98 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 69], 90.00th=[ 105], 95.00th=[ 136], | 99.00th=[ 226], 99.50th=[ 271], 99.90th=[ 464], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 127, per=25.46%, avg=32.58, stdev=24.13, samples=354 iops : min= 1, max= 31, avg= 7.49, stdev= 6.09, samples=354 write: IOPS=8, BW=34.1KiB/s (34.0kB/s)(6348KiB/185889msec); 0 zone resets clat (msec): min=11, max=328, avg=71.46, stdev=49.74 lat (msec): min=11, max=328, avg=71.46, stdev=49.73 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 110], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 249], 99.50th=[ 279], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 128, per=25.41%, avg=34.06, stdev=21.80, samples=362 iops : min= 1, max= 32, avg= 7.86, stdev= 5.53, samples=362 lat (msec) : 10=1.50%, 20=12.37%, 50=42.58%, 100=26.30%, 250=16.41% lat (msec) : 500=0.81%, 2000=0.03% cpu : usr=0.06%, sys=1.70%, ctx=4839, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179320: Tue Sep 8 01:06:15 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(6028KiB/186664msec) clat (msec): min=5, max=348, avg=47.94, stdev=40.91 lat (msec): min=5, max=348, avg=47.95, stdev=40.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 73], 90.00th=[ 104], 95.00th=[ 132], | 99.00th=[ 201], 99.50th=[ 226], 99.90th=[ 288], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 142, per=25.62%, avg=32.80, stdev=22.62, samples=356 iops : min= 1, max= 35, avg= 7.54, stdev= 5.73, samples=356 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6260KiB/186664msec); 0 zone resets clat (msec): min=12, max=1142, avg=72.82, stdev=57.99 lat (msec): min=12, max=1142, avg=72.82, stdev=57.99 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 171], | 99.00th=[ 271], 99.50th=[ 326], 99.90th=[ 430], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 120, per=24.92%, avg=33.39, stdev=21.93, samples=363 iops : min= 1, max= 30, avg= 7.69, stdev= 5.55, samples=363 lat (msec) : 10=1.14%, 20=11.59%, 50=43.78%, 100=26.69%, 250=16.08% lat (msec) : 500=0.68%, 2000=0.03% cpu : usr=0.06%, sys=1.63%, ctx=4800, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179322: Tue Sep 8 01:06:15 2026 read: IOPS=8, BW=32.4KiB/s (33.2kB/s)(6052KiB/186524msec) clat (msec): min=6, max=449, avg=48.85, stdev=43.63 lat (msec): min=6, max=449, avg=48.85, stdev=43.63 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 255], 99.90th=[ 275], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 120, per=26.28%, avg=33.64, stdev=22.56, samples=349 iops : min= 1, max= 30, avg= 7.76, stdev= 5.71, samples=349 write: IOPS=8, BW=33.4KiB/s (34.2kB/s)(6236KiB/186524msec); 0 zone resets clat (msec): min=9, max=1219, avg=71.94, stdev=57.78 lat (msec): min=9, max=1219, avg=71.94, stdev=57.78 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 67], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 174], | 99.00th=[ 245], 99.50th=[ 275], 99.90th=[ 359], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 112, per=25.04%, avg=33.55, stdev=21.87, samples=360 iops : min= 1, max= 28, avg= 7.73, stdev= 5.54, samples=360 lat (msec) : 10=1.43%, 20=11.85%, 50=43.16%, 100=26.01%, 250=16.89% lat (msec) : 500=0.62%, 2000=0.03% cpu : usr=0.06%, sys=1.68%, ctx=4835, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (132kB/s), 31.0KiB/s-32.4KiB/s (32.7kB/s-33.2kB/s), io=23.4MiB (24.6MB), run=185889-186854msec WRITE: bw=135KiB/s (138kB/s), 33.4KiB/s-34.1KiB/s (34.2kB/s-34.0kB/s), io=24.6MiB (25.7MB), run=185889-186854msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179372: Tue Sep 8 01:07:05 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(5920KiB/39362msec) clat (usec): min=52, max=202200, avg=57468.94, stdev=36418.17 lat (usec): min=54, max=202202, avg=57470.38, stdev=36418.20 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 77], 10.00th=[ 1811], 20.00th=[ 29230], | 30.00th=[ 39584], 40.00th=[ 45351], 50.00th=[ 53740], 60.00th=[ 61604], | 70.00th=[ 71828], 80.00th=[ 85459], 90.00th=[105382], 95.00th=[119014], | 99.00th=[164627], 99.50th=[196084], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 352, per=24.52%, avg=149.06, stdev=57.85, samples=77 iops : min= 1, max= 22, avg= 8.60, stdev= 3.68, samples=77 write: IOPS=10, BW=162KiB/s (166kB/s)(6368KiB/39362msec); 0 zone resets clat (usec): min=1526, max=239866, avg=44715.02, stdev=43111.95 lat (usec): min=1529, max=239868, avg=44717.77, stdev=43112.31 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2212], 10.00th=[ 4146], 20.00th=[ 8291], | 30.00th=[ 14222], 40.00th=[ 22938], 50.00th=[ 33817], 60.00th=[ 41681], | 70.00th=[ 53740], 80.00th=[ 72877], 90.00th=[106431], 95.00th=[141558], | 99.00th=[173016], 99.50th=[231736], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 60, max= 341, per=25.54%, avg=163.45, stdev=60.84, samples=76 iops : min= 3, max= 21, avg= 9.51, stdev= 3.86, samples=76 lat (usec) : 100=4.04%, 250=0.65% lat (msec) : 2=2.08%, 4=3.26%, 10=7.55%, 20=7.81%, 50=31.38% lat (msec) : 100=32.03%, 250=11.20% cpu : usr=0.07%, sys=5.28%, ctx=1701, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179373: Tue Sep 8 01:07:05 2026 read: IOPS=9, BW=149KiB/s (152kB/s)(5744KiB/38653msec) clat (usec): min=40, max=245739, avg=56977.47, stdev=38213.62 lat (usec): min=40, max=245741, avg=56978.96, stdev=38213.55 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 82], 10.00th=[ 725], 20.00th=[ 28443], | 30.00th=[ 35914], 40.00th=[ 42730], 50.00th=[ 50070], 60.00th=[ 62129], | 70.00th=[ 71828], 80.00th=[ 86508], 90.00th=[103285], 95.00th=[125305], | 99.00th=[187696], 99.50th=[217056], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 30, max= 287, per=24.38%, avg=148.21, stdev=58.16, samples=76 iops : min= 1, max= 17, avg= 8.53, stdev= 3.68, samples=76 write: IOPS=10, BW=169KiB/s (173kB/s)(6544KiB/38653msec); 0 zone resets clat (usec): min=1553, max=227336, avg=43499.55, stdev=39608.26 lat (usec): min=1556, max=227339, avg=43508.30, stdev=39603.84 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2835], 10.00th=[ 4686], 20.00th=[ 8979], | 30.00th=[ 13829], 40.00th=[ 22414], 50.00th=[ 31327], 60.00th=[ 42730], | 70.00th=[ 57410], 80.00th=[ 74974], 90.00th=[100140], 95.00th=[123208], | 99.00th=[162530], 99.50th=[168821], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 442, per=26.72%, avg=170.99, stdev=72.47, samples=75 iops : min= 1, max= 27, avg= 9.99, stdev= 4.64, samples=75 lat (usec) : 50=0.13%, 100=3.26%, 250=1.04%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=1.30%, 4=2.60%, 10=8.07%, 20=8.72%, 50=32.03% lat (msec) : 100=31.12%, 250=11.07% cpu : usr=0.08%, sys=5.62%, ctx=1847, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179374: Tue Sep 8 01:07:05 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37446msec) clat (usec): min=45, max=251057, avg=53075.25, stdev=34674.44 lat (usec): min=46, max=251059, avg=53077.34, stdev=34674.25 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 82], 10.00th=[ 1123], 20.00th=[ 28181], | 30.00th=[ 35914], 40.00th=[ 42730], 50.00th=[ 49546], 60.00th=[ 56886], | 70.00th=[ 65799], 80.00th=[ 77071], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[175113], 99.50th=[221250], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 286, per=27.76%, avg=168.78, stdev=58.22, samples=72 iops : min= 1, max= 17, avg= 9.83, stdev= 3.77, samples=72 write: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37446msec); 0 zone resets clat (usec): min=1621, max=297315, avg=43757.52, stdev=40633.55 lat (usec): min=1622, max=297317, avg=43867.76, stdev=40577.80 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 3326], 10.00th=[ 4948], 20.00th=[ 9110], | 30.00th=[ 15533], 40.00th=[ 23462], 50.00th=[ 31851], 60.00th=[ 43254], | 70.00th=[ 56886], 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[119014], | 99.00th=[177210], 99.50th=[250610], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 447, per=24.80%, avg=158.70, stdev=78.04, samples=73 iops : min= 1, max= 27, avg= 9.19, stdev= 4.89, samples=73 lat (usec) : 50=0.13%, 100=3.39%, 250=0.78%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.43%, 4=3.12%, 10=6.64%, 20=8.07%, 50=33.33% lat (msec) : 100=33.85%, 250=8.07%, 500=0.39% cpu : usr=0.09%, sys=5.47%, ctx=1722, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179375: Tue Sep 8 01:07:05 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(6032KiB/38444msec) clat (usec): min=41, max=184072, avg=53143.19, stdev=38540.17 lat (usec): min=41, max=184073, avg=53144.55, stdev=38540.17 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 66], 10.00th=[ 82], 20.00th=[ 21103], | 30.00th=[ 31327], 40.00th=[ 41157], 50.00th=[ 51119], 60.00th=[ 60556], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[104334], 95.00th=[120062], | 99.00th=[158335], 99.50th=[173016], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 362, per=25.84%, avg=157.11, stdev=75.86, samples=74 iops : min= 1, max= 22, avg= 9.09, stdev= 4.82, samples=74 write: IOPS=10, BW=163KiB/s (167kB/s)(6256KiB/38444msec); 0 zone resets clat (usec): min=1567, max=222441, avg=46089.00, stdev=45264.10 lat (usec): min=1568, max=222443, avg=46093.63, stdev=45264.59 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2704], 10.00th=[ 4359], 20.00th=[ 8029], | 30.00th=[ 12780], 40.00th=[ 21890], 50.00th=[ 32375], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 83362], 90.00th=[108528], 95.00th=[143655], | 99.00th=[202376], 99.50th=[212861], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 30, max= 346, per=25.13%, avg=160.84, stdev=68.25, samples=75 iops : min= 1, max= 21, avg= 9.35, stdev= 4.31, samples=75 lat (usec) : 50=0.65%, 100=5.86%, 250=1.56%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.69%, 4=3.52%, 10=8.33%, 20=7.42%, 50=27.21% lat (msec) : 100=30.60%, 250=12.63% cpu : usr=0.08%, sys=5.34%, ctx=1646, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=609KiB/s (623kB/s), 149KiB/s-167KiB/s (152kB/s-171kB/s), io=23.4MiB (24.5MB), run=37446-39362msec WRITE: bw=640KiB/s (656kB/s), 161KiB/s-169KiB/s (165kB/s-173kB/s), io=24.6MiB (25.8MB), run=37446-39362msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179368: Tue Sep 8 01:07:17 2026 read: IOPS=7, BW=115KiB/s (117kB/s)(5920KiB/51596msec) clat (msec): min=6, max=240, avg=52.16, stdev=44.29 lat (msec): min=6, max=240, avg=52.16, stdev=44.29 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 58], 80.00th=[ 81], 90.00th=[ 118], 95.00th=[ 155], | 99.00th=[ 220], 99.50th=[ 239], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 350, per=24.75%, avg=114.85, stdev=76.97, samples=98 iops : min= 1, max= 21, avg= 6.38, stdev= 4.86, samples=98 write: IOPS=7, BW=123KiB/s (126kB/s)(6368KiB/51596msec); 0 zone resets clat (msec): min=15, max=430, avg=80.69, stdev=54.35 lat (msec): min=15, max=430, avg=80.69, stdev=54.35 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 79], | 70.00th=[ 96], 80.00th=[ 117], 90.00th=[ 157], 95.00th=[ 178], | 99.00th=[ 284], 99.50th=[ 355], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 414, per=25.34%, avg=123.64, stdev=75.42, samples=99 iops : min= 1, max= 25, avg= 6.92, stdev= 4.77, samples=99 lat (msec) : 10=0.65%, 20=10.29%, 50=39.19%, 100=28.65%, 250=20.44% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.66%, ctx=1177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179369: Tue Sep 8 01:07:17 2026 read: IOPS=6, BW=112KiB/s (114kB/s)(5744KiB/51441msec) clat (msec): min=10, max=275, avg=52.85, stdev=45.03 lat (msec): min=10, max=275, avg=52.85, stdev=45.03 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 72], 90.00th=[ 107], 95.00th=[ 146], | 99.00th=[ 268], 99.50th=[ 271], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 21, max= 381, per=24.96%, avg=115.82, stdev=74.84, samples=97 iops : min= 1, max= 23, avg= 6.43, stdev= 4.77, samples=97 write: IOPS=7, BW=127KiB/s (130kB/s)(6544KiB/51441msec); 0 zone resets clat (msec): min=17, max=329, avg=78.98, stdev=49.33 lat (msec): min=17, max=329, avg=78.98, stdev=49.33 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 40], | 30.00th=[ 45], 40.00th=[ 54], 50.00th=[ 65], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 121], 90.00th=[ 153], 95.00th=[ 178], | 99.00th=[ 228], 99.50th=[ 253], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 380, per=26.21%, avg=127.89, stdev=74.64, samples=100 iops : min= 1, max= 23, avg= 7.18, stdev= 4.74, samples=100 lat (msec) : 20=7.94%, 50=41.54%, 100=31.90%, 250=17.71%, 500=0.91% cpu : usr=0.06%, sys=1.69%, ctx=1169, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179370: Tue Sep 8 01:07:17 2026 read: IOPS=7, BW=123KiB/s (125kB/s)(6256KiB/51057msec) clat (msec): min=7, max=282, avg=52.70, stdev=47.04 lat (msec): min=7, max=282, avg=52.70, stdev=47.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 74], 90.00th=[ 122], 95.00th=[ 159], | 99.00th=[ 220], 99.50th=[ 275], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 541, per=27.90%, avg=129.47, stdev=90.85, samples=95 iops : min= 1, max= 33, avg= 7.27, stdev= 5.76, samples=95 write: IOPS=7, BW=118KiB/s (121kB/s)(6032KiB/51057msec); 0 zone resets clat (msec): min=10, max=305, avg=79.66, stdev=51.76 lat (msec): min=10, max=305, avg=79.67, stdev=51.77 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 95], 80.00th=[ 122], 90.00th=[ 148], 95.00th=[ 194], | 99.00th=[ 253], 99.50th=[ 264], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 349, per=24.29%, avg=118.56, stdev=69.15, samples=99 iops : min= 1, max= 21, avg= 6.59, stdev= 4.41, samples=99 lat (msec) : 10=0.91%, 20=9.90%, 50=41.41%, 100=27.08%, 250=19.66% lat (msec) : 500=1.04% cpu : usr=0.06%, sys=1.64%, ctx=1210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179371: Tue Sep 8 01:07:17 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(6032KiB/51243msec) clat (msec): min=6, max=278, avg=55.15, stdev=47.41 lat (msec): min=6, max=278, avg=55.15, stdev=47.41 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 83], 90.00th=[ 129], 95.00th=[ 157], | 99.00th=[ 228], 99.50th=[ 253], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 411, per=26.10%, avg=121.10, stdev=81.25, samples=96 iops : min= 1, max= 25, avg= 6.74, stdev= 5.15, samples=96 write: IOPS=7, BW=122KiB/s (125kB/s)(6256KiB/51243msec); 0 zone resets clat (msec): min=18, max=441, avg=77.69, stdev=53.50 lat (msec): min=18, max=441, avg=77.71, stdev=53.50 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 60], 60.00th=[ 70], | 70.00th=[ 89], 80.00th=[ 115], 90.00th=[ 148], 95.00th=[ 180], | 99.00th=[ 296], 99.50th=[ 326], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 31, max= 349, per=24.78%, avg=120.95, stdev=71.65, samples=100 iops : min= 1, max= 21, avg= 6.74, stdev= 4.54, samples=100 lat (msec) : 10=0.26%, 20=7.94%, 50=42.84%, 100=28.26%, 250=19.79% lat (msec) : 500=0.91% cpu : usr=0.06%, sys=1.62%, ctx=1178, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=464KiB/s (475kB/s), 112KiB/s-123KiB/s (114kB/s-125kB/s), io=23.4MiB (24.5MB), run=51057-51596msec WRITE: bw=488KiB/s (500kB/s), 118KiB/s-127KiB/s (121kB/s-130kB/s), io=24.6MiB (25.8MB), run=51057-51596msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179390: Tue Sep 8 01:07:35 2026 read: IOPS=1, BW=1865KiB/s (1909kB/s)(7168KiB/3844msec) clat (msec): min=128, max=946, avg=296.72, stdev=298.73 lat (msec): min=128, max=946, avg=296.72, stdev=298.73 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 138], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 167], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 376], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1878, max= 4777, per=100.00%, avg=3528.33, stdev=1490.66, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1332KiB/s (1364kB/s)(5120KiB/3844msec); 0 zone resets clat (msec): min=124, max=503, avg=311.22, stdev=181.23 lat (msec): min=124, max=503, avg=311.45, stdev=181.13 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1878, max= 4071, per=50.76%, avg=2496.00, stdev=1052.15, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.05%, sys=3.85%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179391: Tue Sep 8 01:07:35 2026 read: IOPS=0, BW=351KiB/s (360kB/s)(2048KiB/5831msec) clat (msec): min=144, max=149, avg=146.99, stdev= 4.02 lat (msec): min=144, max=149, avg=146.99, stdev= 4.02 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 1560, max= 1878, per=48.95%, avg=1719.00, stdev=224.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1756KiB/s (1798kB/s)(10.0MiB/5831msec); 0 zone resets clat (msec): min=193, max=1352, avg=548.04, stdev=365.88 lat (msec): min=193, max=1352, avg=548.33, stdev=365.70 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 218], | 30.00th=[ 220], 40.00th=[ 275], 50.00th=[ 464], 60.00th=[ 609], | 70.00th=[ 625], 80.00th=[ 642], 90.00th=[ 885], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 1560, max= 4087, per=50.72%, avg=2494.00, stdev=1047.35, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.30%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179393: Tue Sep 8 01:07:35 2026 read: IOPS=1, BW=1119KiB/s (1145kB/s)(6144KiB/5493msec) clat (msec): min=119, max=899, avg=334.74, stdev=307.08 lat (msec): min=119, max=899, avg=334.74, stdev=307.08 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 253], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1980, max= 4000, per=71.46%, avg=2509.50, stdev=993.95, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1119KiB/s (1145kB/s)(6144KiB/5493msec); 0 zone resets clat (msec): min=422, max=742, avg=550.87, stdev=126.31 lat (msec): min=422, max=742, avg=550.99, stdev=126.30 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 567], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1878, max= 2035, per=40.10%, avg=1971.60, stdev=58.53, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=3.86%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179394: Tue Sep 8 01:07:35 2026 read: IOPS=1, BW=1419KiB/s (1453kB/s)(5120KiB/3609msec) clat (msec): min=95, max=671, avg=364.91, stdev=265.42 lat (msec): min=95, max=671, avg=364.91, stdev=265.42 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 3757, max= 4071, per=100.00%, avg=3914.00, stdev=222.03, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1986KiB/s (2034kB/s)(7168KiB/3609msec); 0 zone resets clat (msec): min=54, max=532, avg=224.75, stdev=183.50 lat (msec): min=54, max=532, avg=224.92, stdev=183.48 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 120], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 129], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 439], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 3930, max= 4071, per=81.36%, avg=4000.50, stdev=99.70, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=3.52%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3512KiB/s (3597kB/s), 351KiB/s-1865KiB/s (360kB/s-1909kB/s), io=20.0MiB (20.0MB), run=3609-5831msec WRITE: bw=4917KiB/s (5035kB/s), 1119KiB/s-1986KiB/s (1145kB/s-2034kB/s), io=28.0MiB (29.4MB), run=3609-5831msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179388: Tue Sep 8 01:07:35 2026 read: IOPS=1, BW=1644KiB/s (1683kB/s)(7168KiB/4360msec) clat (usec): min=602, max=311144, avg=225703.52, stdev=105634.54 lat (usec): min=603, max=311146, avg=225705.84, stdev=105635.11 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[200279], | 30.00th=[248513], 40.00th=[248513], 50.00th=[252707], 60.00th=[265290], | 70.00th=[265290], 80.00th=[299893], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 1950, max= 4096, per=70.23%, avg=2413.00, stdev=941.58, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=1, BW=1174KiB/s (1202kB/s)(5120KiB/4360msec); 0 zone resets clat (msec): min=297, max=654, avg=468.01, stdev=127.81 lat (msec): min=297, max=654, avg=468.22, stdev=127.79 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1950, max= 3878, per=53.98%, avg=2596.33, stdev=1109.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=66.67%, 750=8.33% cpu : usr=0.00%, sys=13.54%, ctx=285, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179389: Tue Sep 8 01:07:35 2026 read: IOPS=0, BW=344KiB/s (352kB/s)(2048KiB/5960msec) clat (msec): min=248, max=535, avg=391.95, stdev=203.08 lat (msec): min=248, max=535, avg=391.96, stdev=203.08 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1858, max= 2019, per=56.42%, avg=1938.50, stdev=113.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1718KiB/s (1759kB/s)(10.0MiB/5960msec); 0 zone resets clat (msec): min=150, max=1465, avg=506.25, stdev=386.87 lat (msec): min=150, max=1467, avg=506.73, stdev=387.33 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 192], | 30.00th=[ 271], 40.00th=[ 313], 50.00th=[ 347], 60.00th=[ 443], | 70.00th=[ 542], 80.00th=[ 567], 90.00th=[ 785], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1939, max= 4015, per=46.85%, avg=2253.25, stdev=713.29, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=11.65%, ctx=155, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179392: Tue Sep 8 01:07:35 2026 read: IOPS=1, BW=1377KiB/s (1410kB/s)(6144KiB/4461msec) clat (usec): min=577, max=334202, avg=150999.04, stdev=163359.51 lat (usec): min=579, max=334205, avg=151001.18, stdev=163359.73 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 4359], | 30.00th=[ 4359], 40.00th=[ 13435], 50.00th=[ 13435], 60.00th=[225444], | 70.00th=[329253], 80.00th=[329253], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2027, max= 4096, per=98.82%, avg=3395.33, stdev=1185.13, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1377KiB/s (1410kB/s)(6144KiB/4461msec); 0 zone resets clat (msec): min=169, max=820, avg=527.99, stdev=306.26 lat (msec): min=169, max=820, avg=528.41, stdev=306.18 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 776], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1855, max= 4055, per=49.69%, avg=2390.00, stdev=933.85, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 20=8.33%, 250=25.00%, 500=25.00%, 1000=25.00% cpu : usr=0.00%, sys=10.36%, ctx=169, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179395: Tue Sep 8 01:07:35 2026 read: IOPS=0, BW=997KiB/s (1021kB/s)(5120KiB/5137msec) clat (usec): min=739, max=583520, avg=190532.29, stdev=249690.20 lat (usec): min=741, max=583522, avg=190534.20, stdev=249690.24 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 742], | 30.00th=[ 799], 40.00th=[ 799], 50.00th=[ 77071], 60.00th=[ 77071], | 70.00th=[291505], 80.00th=[291505], 90.00th=[583009], 95.00th=[583009], | 99.00th=[583009], 99.50th=[583009], 99.90th=[583009], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1395KiB/s (1429kB/s)(7168KiB/5137msec); 0 zone resets clat (msec): min=218, max=1292, avg=556.30, stdev=376.43 lat (msec): min=220, max=1292, avg=556.57, stdev=376.24 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 253], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 600], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 667], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1939, max= 4079, per=62.63%, avg=3012.50, stdev=1226.91, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=25.00%, 750=33.33%, 2000=8.33% cpu : usr=0.00%, sys=7.36%, ctx=165, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3436KiB/s (3519kB/s), 344KiB/s-1644KiB/s (352kB/s-1683kB/s), io=20.0MiB (20.0MB), run=4360-5960msec WRITE: bw=4811KiB/s (4926kB/s), 1174KiB/s-1718KiB/s (1202kB/s-1759kB/s), io=28.0MiB (29.4MB), run=4360-5960msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179405: Tue Sep 8 01:07:51 2026 read: IOPS=0, BW=3511KiB/s (3595kB/s)(12.0MiB/3500msec) clat (msec): min=1004, max=1143, avg=1085.20, stdev=72.34 lat (msec): min=1004, max=1143, avg=1085.20, stdev=72.34 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=11.80%, ctx=309, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179406: Tue Sep 8 01:07:51 2026 read: IOPS=0, BW=1456KiB/s (1491kB/s)(4096KiB/2814msec) clat (nsec): min=986966k, max=986966k, avg=986965903.00, stdev= 0.00 lat (nsec): min=986970k, max=986970k, avg=986970033.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2911KiB/s (2981kB/s)(8192KiB/2814msec); 0 zone resets clat (msec): min=811, max=854, avg=833.21, stdev=30.26 lat (msec): min=816, max=855, avg=835.99, stdev=27.08 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8110, max= 8110, per=97.86%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=4.30%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179408: Tue Sep 8 01:07:51 2026 write: IOPS=0, BW=3108KiB/s (3182kB/s)(12.0MiB/3954msec); 0 zone resets clat (msec): min=1159, max=1395, avg=1259.55, stdev=122.27 lat (msec): min=1160, max=1396, avg=1260.67, stdev=121.70 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8159, max= 8175, per=98.55%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=6.15%, ctx=134, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179409: Tue Sep 8 01:07:51 2026 write: IOPS=0, BW=3305KiB/s (3384kB/s)(12.0MiB/3718msec); 0 zone resets clat (msec): min=381, max=2352, avg=1140.37, stdev=1060.70 lat (msec): min=381, max=2353, avg=1141.24, stdev=1061.04 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8143, max= 8159, per=98.36%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=4.82%, ctx=95, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4681KiB/s (4793kB/s), 1456KiB/s-3511KiB/s (1491kB/s-3595kB/s), io=16.0MiB (16.8MB), run=2814-3500msec WRITE: bw=8287KiB/s (8486kB/s), 2911KiB/s-3305KiB/s (2981kB/s-3384kB/s), io=32.0MiB (33.6MB), run=2814-3954msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179403: Tue Sep 8 01:07:52 2026 read: IOPS=0, BW=3246KiB/s (3324kB/s)(12.0MiB/3785msec) clat (msec): min=496, max=2019, avg=1160.86, stdev=780.04 lat (msec): min=496, max=2019, avg=1160.86, stdev=780.04 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8047, max= 8143, per=100.00%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.08%, sys=3.17%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179404: Tue Sep 8 01:07:52 2026 read: IOPS=0, BW=1111KiB/s (1138kB/s)(4096KiB/3687msec) clat (nsec): min=1663.8M, max=1663.8M, avg=1663820728.00, stdev= 0.00 lat (nsec): min=1663.8M, max=1663.8M, avg=1663824301.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1670], 5.00th=[ 1670], 10.00th=[ 1670], 20.00th=[ 1670], | 30.00th=[ 1670], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2222KiB/s (2275kB/s)(8192KiB/3687msec); 0 zone resets clat (msec): min=402, max=1320, avg=861.44, stdev=648.76 lat (msec): min=403, max=1321, avg=862.43, stdev=649.71 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.12%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179407: Tue Sep 8 01:07:52 2026 write: IOPS=0, BW=2896KiB/s (2966kB/s)(12.0MiB/4243msec); 0 zone resets clat (msec): min=229, max=2333, avg=1295.86, stdev=1052.64 lat (msec): min=230, max=2335, avg=1297.14, stdev=1053.16 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.66%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179410: Tue Sep 8 01:07:52 2026 write: IOPS=0, BW=4020KiB/s (4116kB/s)(12.0MiB/3057msec); 0 zone resets clat (msec): min=262, max=2104, avg=941.03, stdev=1011.97 lat (msec): min=263, max=2104, avg=941.49, stdev=1011.96 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 5505, max= 8143, per=88.37%, avg=6824.00, stdev=1865.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.73%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4329KiB/s (4433kB/s), 1111KiB/s-3246KiB/s (1138kB/s-3324kB/s), io=16.0MiB (16.8MB), run=3687-3785msec WRITE: bw=7723KiB/s (7908kB/s), 2222KiB/s-4020KiB/s (2275kB/s-4116kB/s), io=32.0MiB (33.6MB), run=3057-4243msec