== sanity test 398b: DIO and buffer IO race ============== 10:20:04 (1787840404) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.44341 s, 11.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180395: Thu Aug 27 10:22:33 2026 read: IOPS=11, BW=46.0KiB/s (47.1kB/s)(5992KiB/130139msec) clat (usec): min=35, max=839761, avg=47988.81, stdev=39237.75 lat (usec): min=35, max=839763, avg=47993.36, stdev=39238.60 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 190], 10.00th=[ 16712], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[102237], | 99.00th=[173016], 99.50th=[208667], 99.90th=[316670], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 142, per=25.24%, avg=45.93, stdev=20.20, samples=255 iops : min= 1, max= 35, avg=10.82, stdev= 5.10, samples=255 write: IOPS=12, BW=48.4KiB/s (49.5kB/s)(6296KiB/130139msec); 0 zone resets clat (usec): min=932, max=300729, avg=36742.62, stdev=38487.04 lat (usec): min=934, max=300730, avg=36745.21, stdev=38486.59 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1909], 20.00th=[ 3851], | 30.00th=[ 7767], 40.00th=[ 16581], 50.00th=[ 26870], 60.00th=[ 36963], | 70.00th=[ 47973], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[170918], 99.50th=[204473], 99.90th=[261096], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 144, per=25.33%, avg=48.39, stdev=22.44, samples=254 iops : min= 1, max= 36, avg=11.44, stdev= 5.67, samples=254 lat (usec) : 50=0.42%, 100=1.89%, 250=0.20%, 1000=0.13% lat (msec) : 2=5.57%, 4=5.05%, 10=7.13%, 20=9.67%, 50=37.47% lat (msec) : 100=26.11%, 250=6.18%, 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=4.94%, ctx=6544, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180398: Thu Aug 27 10:22:33 2026 read: IOPS=11, BW=45.2KiB/s (46.2kB/s)(5940KiB/131513msec) clat (usec): min=33, max=325979, avg=48594.77, stdev=35594.78 lat (usec): min=33, max=325981, avg=48599.31, stdev=35592.85 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10028], 10.00th=[ 16712], 20.00th=[ 23200], | 30.00th=[ 29492], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[191890], 99.50th=[227541], 99.90th=[320865], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 6, max= 95, per=24.55%, avg=44.68, stdev=18.01, samples=258 iops : min= 1, max= 23, avg=10.51, stdev= 4.55, samples=258 write: IOPS=12, BW=48.3KiB/s (49.4kB/s)(6348KiB/131513msec); 0 zone resets clat (usec): min=916, max=798570, avg=37134.66, stdev=41246.02 lat (usec): min=918, max=798571, avg=37137.08, stdev=41246.18 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1614], 20.00th=[ 3884], | 30.00th=[ 7177], 40.00th=[ 17695], 50.00th=[ 28443], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 64226], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[154141], 99.50th=[162530], 99.90th=[248513], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 157, per=25.27%, avg=48.27, stdev=22.18, samples=255 iops : min= 1, max= 39, avg=11.41, stdev= 5.59, samples=255 lat (usec) : 50=0.33%, 100=1.60%, 250=0.23%, 750=0.03%, 1000=0.03% lat (msec) : 2=6.32%, 4=4.49%, 10=7.23%, 20=8.76%, 50=38.15% lat (msec) : 100=25.94%, 250=6.67%, 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=4.98%, ctx=6620, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180400: Thu Aug 27 10:22:33 2026 read: IOPS=11, BW=46.7KiB/s (47.8kB/s)(6028KiB/129157msec) clat (usec): min=34, max=809774, avg=46964.20, stdev=39757.65 lat (usec): min=35, max=809775, avg=46977.63, stdev=39755.36 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 98], 10.00th=[ 15664], 20.00th=[ 22414], | 30.00th=[ 27657], 40.00th=[ 33424], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[185598], 99.50th=[219153], 99.90th=[442500], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 6, max= 103, per=25.59%, avg=46.58, stdev=19.67, samples=253 iops : min= 1, max= 25, avg=10.97, stdev= 4.96, samples=253 write: IOPS=12, BW=48.5KiB/s (49.6kB/s)(6260KiB/129157msec); 0 zone resets clat (usec): min=1044, max=451313, avg=37095.44, stdev=39203.46 lat (usec): min=1044, max=451315, avg=37097.92, stdev=39203.78 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1287], 10.00th=[ 1795], 20.00th=[ 3687], | 30.00th=[ 6521], 40.00th=[ 16057], 50.00th=[ 26084], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[158335], 99.50th=[187696], 99.90th=[229639], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 134, per=25.29%, avg=48.31, stdev=22.46, samples=253 iops : min= 1, max= 33, avg=11.42, stdev= 5.65, samples=253 lat (usec) : 50=0.49%, 100=1.99%, 250=0.36%, 500=0.10%, 1000=0.03% lat (msec) : 2=5.79%, 4=5.24%, 10=7.19%, 20=8.85%, 50=37.43% lat (msec) : 100=25.68%, 250=6.67%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=4.96%, ctx=6416, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180402: Thu Aug 27 10:22:33 2026 read: IOPS=11, BW=46.0KiB/s (47.1kB/s)(6052KiB/131474msec) clat (usec): min=31, max=713926, avg=48680.34, stdev=38624.43 lat (usec): min=32, max=713927, avg=48682.66, stdev=38624.56 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 100], 10.00th=[ 15926], 20.00th=[ 23200], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[183501], 99.50th=[202376], 99.90th=[329253], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 6, max= 118, per=25.08%, avg=45.64, stdev=19.72, samples=258 iops : min= 1, max= 29, avg=10.74, stdev= 4.96, samples=258 write: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6236KiB/131474msec); 0 zone resets clat (usec): min=1009, max=344486, avg=36853.45, stdev=40494.49 lat (usec): min=1010, max=344487, avg=36864.09, stdev=40491.50 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 1844], 20.00th=[ 3621], | 30.00th=[ 6849], 40.00th=[ 14746], 50.00th=[ 25822], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 65274], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[173016], 99.50th=[200279], 99.90th=[287310], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 124, per=24.68%, avg=47.14, stdev=20.78, samples=257 iops : min= 1, max= 31, avg=11.12, stdev= 5.22, samples=257 lat (usec) : 50=0.42%, 100=2.08%, 250=0.13%, 500=0.07%, 750=0.03% lat (msec) : 2=5.60%, 4=5.53%, 10=6.93%, 20=9.15%, 50=37.40% lat (msec) : 100=25.59%, 250=6.80%, 500=0.23%, 750=0.03% cpu : usr=0.06%, sys=4.72%, ctx=6606, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=183KiB/s (187kB/s), 45.2KiB/s-46.7KiB/s (46.2kB/s-47.8kB/s), io=23.4MiB (24.6MB), run=129157-131513msec WRITE: bw=191KiB/s (196kB/s), 47.4KiB/s-48.5KiB/s (48.6kB/s-49.6kB/s), io=24.6MiB (25.7MB), run=129157-131513msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180396: Thu Aug 27 10:23:11 2026 read: IOPS=8, BW=35.5KiB/s (36.4kB/s)(5992KiB/168737msec) clat (msec): min=5, max=846, avg=45.42, stdev=49.10 lat (msec): min=5, max=846, avg=45.43, stdev=49.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 69], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 249], 99.90th=[ 422], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 159, per=25.72%, avg=36.27, stdev=27.29, samples=321 iops : min= 1, max= 39, avg= 8.43, stdev= 6.85, samples=321 write: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6296KiB/168737msec); 0 zone resets clat (msec): min=9, max=428, avg=63.73, stdev=47.77 lat (msec): min=9, max=428, avg=63.73, stdev=47.77 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 97], 90.00th=[ 125], 95.00th=[ 157], | 99.00th=[ 226], 99.50th=[ 259], 99.90th=[ 422], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 119, per=25.36%, avg=37.53, stdev=25.28, samples=326 iops : min= 1, max= 29, avg= 8.74, stdev= 6.37, samples=326 lat (msec) : 10=2.64%, 20=16.50%, 50=43.23%, 100=22.36%, 250=14.68% lat (msec) : 500=0.55%, 1000=0.03% cpu : usr=0.06%, sys=1.71%, ctx=4815, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180397: Thu Aug 27 10:23:11 2026 read: IOPS=8, BW=35.4KiB/s (36.2kB/s)(5940KiB/167957msec) clat (msec): min=5, max=747, avg=43.52, stdev=47.12 lat (msec): min=5, max=747, avg=43.52, stdev=47.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 133], | 99.00th=[ 215], 99.50th=[ 241], 99.90th=[ 376], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 159, per=25.83%, avg=36.42, stdev=27.35, samples=316 iops : min= 1, max= 39, avg= 8.46, stdev= 6.87, samples=316 write: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6348KiB/167957msec); 0 zone resets clat (msec): min=10, max=383, avg=64.89, stdev=48.26 lat (msec): min=10, max=383, avg=64.89, stdev=48.26 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 60], | 70.00th=[ 78], 80.00th=[ 99], 90.00th=[ 128], 95.00th=[ 163], | 99.00th=[ 232], 99.50th=[ 279], 99.90th=[ 355], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 111, per=25.38%, avg=37.56, stdev=25.17, samples=327 iops : min= 1, max= 27, avg= 8.75, stdev= 6.34, samples=327 lat (msec) : 10=2.34%, 20=16.63%, 50=43.23%, 100=23.40%, 250=13.80% lat (msec) : 500=0.55%, 750=0.03% cpu : usr=0.05%, sys=1.71%, ctx=4810, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180399: Thu Aug 27 10:23:11 2026 read: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6028KiB/168362msec) clat (msec): min=5, max=345, avg=44.30, stdev=42.17 lat (msec): min=5, max=345, avg=44.30, stdev=42.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 67], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 203], 99.50th=[ 236], 99.90th=[ 292], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 127, per=26.03%, avg=36.71, stdev=25.83, samples=319 iops : min= 1, max= 31, avg= 8.53, stdev= 6.50, samples=319 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6260KiB/168362msec); 0 zone resets clat (msec): min=9, max=745, avg=64.69, stdev=52.21 lat (msec): min=9, max=745, avg=64.70, stdev=52.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 60], | 70.00th=[ 77], 80.00th=[ 99], 90.00th=[ 127], 95.00th=[ 155], | 99.00th=[ 239], 99.50th=[ 292], 99.90th=[ 550], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 135, per=25.05%, avg=37.08, stdev=26.29, samples=327 iops : min= 1, max= 33, avg= 8.63, stdev= 6.61, samples=327 lat (msec) : 10=2.47%, 20=16.11%, 50=44.11%, 100=22.46%, 250=14.29% lat (msec) : 500=0.49%, 750=0.07% cpu : usr=0.05%, sys=1.69%, ctx=4766, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180401: Thu Aug 27 10:23:11 2026 read: IOPS=8, BW=35.7KiB/s (36.6kB/s)(6052KiB/169293msec) clat (msec): min=6, max=302, avg=43.72, stdev=42.55 lat (msec): min=6, max=302, avg=43.73, stdev=42.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 107], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 213], 99.90th=[ 284], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 140, per=26.01%, avg=36.67, stdev=27.77, samples=320 iops : min= 1, max= 35, avg= 8.53, stdev= 6.99, samples=320 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6236KiB/169293msec); 0 zone resets clat (msec): min=11, max=754, avg=65.91, stdev=54.97 lat (msec): min=11, max=754, avg=65.91, stdev=54.97 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 78], 80.00th=[ 102], 90.00th=[ 134], 95.00th=[ 165], | 99.00th=[ 241], 99.50th=[ 309], 99.90th=[ 558], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 127, per=24.50%, avg=36.26, stdev=26.45, samples=333 iops : min= 1, max= 31, avg= 8.42, stdev= 6.66, samples=333 lat (msec) : 10=2.34%, 20=17.74%, 50=43.42%, 100=20.51%, 250=15.46% lat (msec) : 500=0.46%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.68%, ctx=4852, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=142KiB/s (145kB/s), 35.4KiB/s-35.8KiB/s (36.2kB/s-36.7kB/s), io=23.4MiB (24.6MB), run=167957-169293msec WRITE: bw=148KiB/s (152kB/s), 36.8KiB/s-37.8KiB/s (37.7kB/s-38.7kB/s), io=24.6MiB (25.7MB), run=167957-169293msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180442: Thu Aug 27 10:23:59 2026 read: IOPS=10, BW=162KiB/s (165kB/s)(5920KiB/36630msec) clat (usec): min=45, max=191451, avg=51385.21, stdev=33635.85 lat (usec): min=45, max=191452, avg=51386.83, stdev=33635.69 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 85], 10.00th=[ 16319], 20.00th=[ 26608], | 30.00th=[ 31851], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 53740], | 70.00th=[ 62129], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[166724], 99.50th=[179307], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 315, per=24.21%, avg=158.10, stdev=65.93, samples=71 iops : min= 1, max= 19, avg= 9.10, stdev= 4.20, samples=71 write: IOPS=10, BW=174KiB/s (178kB/s)(6368KiB/36630msec); 0 zone resets clat (usec): min=1383, max=247856, avg=43736.69, stdev=43951.46 lat (usec): min=1384, max=247857, avg=43755.91, stdev=43968.47 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2040], 10.00th=[ 3097], 20.00th=[ 6325], | 30.00th=[ 10945], 40.00th=[ 22152], 50.00th=[ 30802], 60.00th=[ 41681], | 70.00th=[ 54789], 80.00th=[ 73925], 90.00th=[104334], 95.00th=[133694], | 99.00th=[196084], 99.50th=[227541], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 384, per=25.20%, avg=173.11, stdev=73.62, samples=71 iops : min= 1, max= 24, avg=10.04, stdev= 4.68, samples=71 lat (usec) : 50=0.13%, 100=2.60%, 250=0.78%, 500=0.26% lat (msec) : 2=2.34%, 4=4.04%, 10=8.46%, 20=7.29%, 50=34.90% lat (msec) : 100=29.56%, 250=9.64% cpu : usr=0.05%, sys=4.86%, ctx=1739, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180443: Thu Aug 27 10:23:59 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(5744KiB/36631msec) clat (usec): min=36, max=222230, avg=54914.91, stdev=35727.42 lat (usec): min=36, max=222231, avg=54916.24, stdev=35727.44 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 98], 10.00th=[ 20841], 20.00th=[ 28705], | 30.00th=[ 33817], 40.00th=[ 40633], 50.00th=[ 46400], 60.00th=[ 55837], | 70.00th=[ 68682], 80.00th=[ 78119], 90.00th=[103285], 95.00th=[127402], | 99.00th=[166724], 99.50th=[204473], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 346, per=24.12%, avg=157.51, stdev=62.00, samples=71 iops : min= 1, max= 21, avg= 9.06, stdev= 3.97, samples=71 write: IOPS=11, BW=179KiB/s (183kB/s)(6544KiB/36631msec); 0 zone resets clat (usec): min=1409, max=269344, avg=41141.71, stdev=41614.90 lat (usec): min=1411, max=269346, avg=41145.55, stdev=41614.45 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3130], 10.00th=[ 4424], 20.00th=[ 6128], | 30.00th=[ 10683], 40.00th=[ 20317], 50.00th=[ 30540], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[116917], | 99.00th=[177210], 99.50th=[246416], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 380, per=25.72%, avg=176.68, stdev=76.85, samples=72 iops : min= 1, max= 23, avg=10.29, stdev= 4.83, samples=72 lat (usec) : 50=0.39%, 100=2.08%, 250=0.39% lat (msec) : 2=1.69%, 4=2.99%, 10=11.07%, 20=6.64%, 50=36.33% lat (msec) : 100=28.91%, 250=9.24%, 500=0.26% cpu : usr=0.06%, sys=5.21%, ctx=1820, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180444: Thu Aug 27 10:23:59 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36446msec) clat (usec): min=45, max=309243, avg=52347.63, stdev=36891.07 lat (usec): min=45, max=309244, avg=52348.92, stdev=36891.04 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 124], 10.00th=[ 18744], 20.00th=[ 27919], | 30.00th=[ 34866], 40.00th=[ 39060], 50.00th=[ 47973], 60.00th=[ 52691], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[106431], | 99.00th=[204473], 99.50th=[244319], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 349, per=26.27%, avg=171.54, stdev=62.54, samples=72 iops : min= 1, max= 21, avg= 9.96, stdev= 3.97, samples=72 write: IOPS=10, BW=166KiB/s (169kB/s)(6032KiB/36446msec); 0 zone resets clat (usec): min=1577, max=239433, avg=41744.76, stdev=38329.07 lat (usec): min=1578, max=239433, avg=41747.74, stdev=38328.54 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2311], 10.00th=[ 3359], 20.00th=[ 6063], | 30.00th=[ 11863], 40.00th=[ 23200], 50.00th=[ 32375], 60.00th=[ 43779], | 70.00th=[ 54789], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[164627], 99.50th=[170918], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 382, per=23.81%, avg=163.60, stdev=72.37, samples=72 iops : min= 1, max= 23, avg= 9.46, stdev= 4.59, samples=72 lat (usec) : 50=0.13%, 100=2.08%, 250=1.04%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.82%, 4=4.69%, 10=6.90%, 20=7.16%, 50=36.07% lat (msec) : 100=32.42%, 250=7.16%, 500=0.13% cpu : usr=0.05%, sys=4.92%, ctx=1805, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180445: Thu Aug 27 10:23:59 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36170msec) clat (usec): min=46, max=216199, avg=49278.29, stdev=32192.90 lat (usec): min=47, max=216201, avg=49288.99, stdev=32200.30 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 210], 20.00th=[ 26870], | 30.00th=[ 33424], 40.00th=[ 40109], 50.00th=[ 45876], 60.00th=[ 52167], | 70.00th=[ 61604], 80.00th=[ 69731], 90.00th=[ 86508], 95.00th=[ 99091], | 99.00th=[173016], 99.50th=[187696], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 318, per=25.26%, avg=164.93, stdev=69.96, samples=71 iops : min= 1, max= 19, avg= 9.55, stdev= 4.45, samples=71 write: IOPS=10, BW=173KiB/s (177kB/s)(6256KiB/36170msec); 0 zone resets clat (usec): min=1482, max=222181, avg=44439.60, stdev=43321.84 lat (usec): min=1484, max=222183, avg=44443.16, stdev=43320.98 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2474], 10.00th=[ 3556], 20.00th=[ 6718], | 30.00th=[ 13960], 40.00th=[ 22938], 50.00th=[ 30802], 60.00th=[ 41157], | 70.00th=[ 57934], 80.00th=[ 73925], 90.00th=[104334], 95.00th=[137364], | 99.00th=[177210], 99.50th=[208667], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 30, max= 377, per=25.03%, avg=171.96, stdev=73.79, samples=71 iops : min= 1, max= 23, avg=10.00, stdev= 4.64, samples=71 lat (usec) : 50=0.13%, 100=4.04%, 250=0.78%, 500=0.13% lat (msec) : 2=1.56%, 4=4.95%, 10=6.90%, 20=7.16%, 50=35.16% lat (msec) : 100=31.12%, 250=8.07% cpu : usr=0.07%, sys=4.94%, ctx=1755, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=654KiB/s (670kB/s), 157KiB/s-172KiB/s (161kB/s-176kB/s), io=23.4MiB (24.5MB), run=36170-36631msec WRITE: bw=688KiB/s (704kB/s), 166KiB/s-179KiB/s (169kB/s-183kB/s), io=24.6MiB (25.8MB), run=36170-36631msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180447: Thu Aug 27 10:24:12 2026 read: IOPS=7, BW=119KiB/s (121kB/s)(5920KiB/49913msec) clat (msec): min=9, max=328, avg=56.33, stdev=45.69 lat (msec): min=9, max=328, avg=56.33, stdev=45.69 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 61], 80.00th=[ 87], 90.00th=[ 116], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 234], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 447, per=24.80%, avg=118.77, stdev=74.27, samples=97 iops : min= 1, max= 27, avg= 6.61, stdev= 4.71, samples=97 write: IOPS=7, BW=128KiB/s (131kB/s)(6368KiB/49913msec); 0 zone resets clat (msec): min=19, max=271, avg=72.84, stdev=45.94 lat (msec): min=19, max=271, avg=72.85, stdev=45.93 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 82], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 163], | 99.00th=[ 251], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 317, per=25.45%, avg=128.26, stdev=67.93, samples=97 iops : min= 1, max= 19, avg= 7.21, stdev= 4.29, samples=97 lat (msec) : 10=0.26%, 20=6.64%, 50=43.36%, 100=31.64%, 250=17.45% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.58%, ctx=1152, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180448: Thu Aug 27 10:24:12 2026 read: IOPS=7, BW=115KiB/s (118kB/s)(5744KiB/49772msec) clat (msec): min=6, max=299, avg=54.06, stdev=47.41 lat (msec): min=6, max=299, avg=54.06, stdev=47.41 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 78], 90.00th=[ 118], 95.00th=[ 165], | 99.00th=[ 239], 99.50th=[ 275], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 415, per=25.87%, avg=123.90, stdev=76.25, samples=91 iops : min= 1, max= 25, avg= 6.93, stdev= 4.78, samples=91 write: IOPS=8, BW=131KiB/s (135kB/s)(6544KiB/49772msec); 0 zone resets clat (msec): min=16, max=357, avg=74.12, stdev=52.89 lat (msec): min=16, max=357, avg=74.13, stdev=52.89 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 83], 80.00th=[ 102], 90.00th=[ 153], 95.00th=[ 184], | 99.00th=[ 266], 99.50th=[ 288], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 320, per=26.03%, avg=131.21, stdev=72.66, samples=98 iops : min= 1, max= 20, avg= 7.39, stdev= 4.61, samples=98 lat (msec) : 10=0.65%, 20=7.03%, 50=46.61%, 100=28.65%, 250=16.02% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.59%, ctx=1177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180449: Thu Aug 27 10:24:12 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/49910msec) clat (msec): min=5, max=308, avg=51.84, stdev=43.71 lat (msec): min=5, max=308, avg=51.84, stdev=43.71 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 54], 80.00th=[ 68], 90.00th=[ 109], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 232], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 377, per=26.53%, avg=127.08, stdev=83.98, samples=97 iops : min= 1, max= 23, avg= 7.12, stdev= 5.33, samples=97 write: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49910msec); 0 zone resets clat (msec): min=16, max=316, avg=78.43, stdev=52.00 lat (msec): min=16, max=316, avg=78.43, stdev=52.00 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 77], | 70.00th=[ 92], 80.00th=[ 108], 90.00th=[ 150], 95.00th=[ 190], | 99.00th=[ 275], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 351, per=24.14%, avg=121.66, stdev=64.71, samples=96 iops : min= 1, max= 21, avg= 6.79, stdev= 4.08, samples=96 lat (msec) : 10=0.39%, 20=7.29%, 50=44.66%, 100=29.30%, 250=17.71% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.63%, ctx=1173, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180450: Thu Aug 27 10:24:12 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49582msec) clat (msec): min=6, max=308, avg=53.91, stdev=44.76 lat (msec): min=6, max=308, avg=53.91, stdev=44.76 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 77], 90.00th=[ 124], 95.00th=[ 157], | 99.00th=[ 205], 99.50th=[ 245], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 378, per=27.26%, avg=130.56, stdev=73.14, samples=91 iops : min= 1, max= 23, avg= 7.35, stdev= 4.63, samples=91 write: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49582msec); 0 zone resets clat (msec): min=16, max=351, avg=74.74, stdev=51.55 lat (msec): min=16, max=351, avg=74.74, stdev=51.56 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 65], | 70.00th=[ 86], 80.00th=[ 107], 90.00th=[ 146], 95.00th=[ 182], | 99.00th=[ 253], 99.50th=[ 296], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 447, per=25.26%, avg=127.33, stdev=74.25, samples=97 iops : min= 1, max= 27, avg= 7.14, stdev= 4.69, samples=97 lat (msec) : 10=0.65%, 20=8.07%, 50=43.62%, 100=29.04%, 250=17.97% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.54%, ctx=1218, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=480KiB/s (491kB/s), 115KiB/s-125KiB/s (118kB/s-128kB/s), io=23.4MiB (24.5MB), run=49582-49913msec WRITE: bw=505KiB/s (517kB/s), 121KiB/s-131KiB/s (124kB/s-135kB/s), io=24.6MiB (25.8MB), run=49582-49913msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180463: Thu Aug 27 10:24:25 2026 read: IOPS=2, BW=2402KiB/s (2460kB/s)(7168KiB/2984msec) clat (msec): min=93, max=649, avg=266.93, stdev=214.95 lat (msec): min=93, max=649, avg=266.93, stdev=214.95 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 97], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 190], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 481], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2039, max= 5953, per=84.48%, avg=4023.67, stdev=1957.59, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1716KiB/s (1757kB/s)(5120KiB/2984msec); 0 zone resets clat (msec): min=98, max=294, avg=200.21, stdev=89.02 lat (msec): min=98, max=294, avg=200.48, stdev=88.87 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1939, max= 5667, per=48.21%, avg=3215.00, stdev=2124.08, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=5.43%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180464: Thu Aug 27 10:24:25 2026 read: IOPS=0, BW=477KiB/s (489kB/s)(2048KiB/4290msec) clat (msec): min=150, max=452, avg=301.29, stdev=213.45 lat (msec): min=150, max=452, avg=301.29, stdev=213.45 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2027, max= 2039, per=42.68%, avg=2033.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2387KiB/s (2444kB/s)(10.0MiB/4290msec); 0 zone resets clat (msec): min=136, max=599, avg=357.87, stdev=153.95 lat (msec): min=136, max=600, avg=358.01, stdev=153.94 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 155], | 30.00th=[ 222], 40.00th=[ 300], 50.00th=[ 351], 60.00th=[ 430], | 70.00th=[ 435], 80.00th=[ 439], 90.00th=[ 514], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1939, max= 4087, per=38.49%, avg=2567.00, stdev=937.82, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=33.33%, 500=50.00%, 750=16.67% cpu : usr=0.02%, sys=6.41%, ctx=99, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180465: Thu Aug 27 10:24:25 2026 read: IOPS=1, BW=1429KiB/s (1463kB/s)(6144KiB/4299msec) clat (msec): min=82, max=606, avg=324.04, stdev=204.94 lat (msec): min=82, max=606, avg=324.04, stdev=204.94 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 376], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1889, max= 2048, per=42.23%, avg=2011.60, stdev=68.64, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1429KiB/s (1463kB/s)(6144KiB/4299msec); 0 zone resets clat (msec): min=105, max=947, avg=385.93, stdev=304.24 lat (msec): min=105, max=947, avg=386.00, stdev=304.25 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2039, max= 3968, per=37.82%, avg=2522.25, stdev=963.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.05%, sys=6.70%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180466: Thu Aug 27 10:24:25 2026 read: IOPS=1, BW=1997KiB/s (2045kB/s)(5120KiB/2564msec) clat (msec): min=85, max=240, avg=165.10, stdev=59.88 lat (msec): min=85, max=240, avg=165.10, stdev=59.88 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 2039, max= 5667, per=80.89%, avg=3853.00, stdev=2565.38, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2796KiB/s (2863kB/s)(7168KiB/2564msec); 0 zone resets clat (msec): min=126, max=445, avg=233.03, stdev=130.16 lat (msec): min=126, max=446, avg=233.13, stdev=130.16 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 133], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 180], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 393], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2031, max= 3878, per=39.73%, avg=2649.33, stdev=1064.06, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.04%, sys=4.33%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4764KiB/s (4878kB/s), 477KiB/s-2402KiB/s (489kB/s-2460kB/s), io=20.0MiB (20.0MB), run=2564-4299msec WRITE: bw=6669KiB/s (6830kB/s), 1429KiB/s-2796KiB/s (1463kB/s-2863kB/s), io=28.0MiB (29.4MB), run=2564-4299msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180468: Thu Aug 27 10:24:25 2026 read: IOPS=2, BW=2593KiB/s (2656kB/s)(7168KiB/2764msec) clat (usec): min=485, max=325217, avg=200051.46, stdev=107843.75 lat (usec): min=486, max=325218, avg=200052.62, stdev=107843.71 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[147850], | 30.00th=[175113], 40.00th=[175113], 50.00th=[225444], 60.00th=[229639], | 70.00th=[229639], 80.00th=[295699], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 1969, max= 4511, per=54.55%, avg=2630.00, stdev=1254.44, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1852KiB/s (1897kB/s)(5120KiB/2764msec); 0 zone resets clat (msec): min=129, max=408, avg=272.10, stdev=119.51 lat (msec): min=129, max=408, avg=272.50, stdev=119.19 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1992, max= 4007, per=39.74%, avg=2682.33, stdev=1147.54, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=41.67% cpu : usr=0.00%, sys=23.31%, ctx=305, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180469: Thu Aug 27 10:24:25 2026 read: IOPS=0, BW=482KiB/s (494kB/s)(2048KiB/4248msec) clat (msec): min=179, max=319, avg=249.51, stdev=99.00 lat (msec): min=179, max=319, avg=249.51, stdev=98.99 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1488, max= 1969, per=35.85%, avg=1728.50, stdev=340.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2411KiB/s (2468kB/s)(10.0MiB/4248msec); 0 zone resets clat (msec): min=91, max=760, avg=374.67, stdev=232.64 lat (msec): min=92, max=761, avg=374.74, stdev=232.64 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 159], | 30.00th=[ 178], 40.00th=[ 199], 50.00th=[ 211], 60.00th=[ 489], | 70.00th=[ 493], 80.00th=[ 575], 90.00th=[ 592], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1488, max= 4096, per=52.32%, avg=3530.80, stdev=1142.93, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=15.47%, ctx=120, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180470: Thu Aug 27 10:24:25 2026 read: IOPS=1, BW=1700KiB/s (1741kB/s)(6144KiB/3614msec) clat (msec): min=2, max=710, avg=278.35, stdev=308.60 lat (msec): min=2, max=710, avg=278.35, stdev=308.60 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 42], | 30.00th=[ 42], 40.00th=[ 113], 50.00th=[ 113], 60.00th=[ 180], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 3938, max= 3984, per=82.16%, avg=3961.00, stdev=32.53, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1700KiB/s (1741kB/s)(6144KiB/3614msec); 0 zone resets clat (msec): min=79, max=696, avg=323.51, stdev=224.17 lat (msec): min=80, max=696, avg=323.59, stdev=224.15 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 305], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1992, max= 3093, per=33.81%, avg=2281.75, stdev=541.21, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 4=8.33%, 50=8.33%, 100=8.33%, 250=25.00%, 500=25.00% lat (msec) : 750=25.00% cpu : usr=0.00%, sys=16.75%, ctx=109, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180471: Thu Aug 27 10:24:25 2026 read: IOPS=1, BW=1522KiB/s (1559kB/s)(5120KiB/3363msec) clat (msec): min=3, max=419, avg=211.86, stdev=147.52 lat (msec): min=3, max=419, avg=211.86, stdev=147.52 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 3938, max= 4007, per=82.40%, avg=3972.50, stdev=48.79, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2131KiB/s (2183kB/s)(7168KiB/3363msec); 0 zone resets clat (msec): min=158, max=656, avg=327.99, stdev=177.77 lat (msec): min=158, max=656, avg=328.08, stdev=177.77 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 178], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 296], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 456], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1530, max= 4079, per=33.64%, avg=2270.17, stdev=906.48, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 4=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=18.98%, ctx=189, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4821KiB/s (4937kB/s), 482KiB/s-2593KiB/s (494kB/s-2656kB/s), io=20.0MiB (20.0MB), run=2764-4248msec WRITE: bw=6750KiB/s (6912kB/s), 1700KiB/s-2411KiB/s (1741kB/s-2468kB/s), io=28.0MiB (29.4MB), run=2764-4248msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180477: Thu Aug 27 10:24:39 2026 read: IOPS=0, BW=3564KiB/s (3649kB/s)(12.0MiB/3448msec) clat (msec): min=939, max=1153, avg=1066.28, stdev=112.43 lat (msec): min=939, max=1153, avg=1066.28, stdev=112.43 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7907, max= 8126, per=100.00%, avg=8016.50, stdev=154.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.34%, ctx=216, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180478: Thu Aug 27 10:24:39 2026 read: IOPS=0, BW=1069KiB/s (1095kB/s)(4096KiB/3831msec) clat (nsec): min=1086.7M, max=1086.7M, avg=1086738930.00, stdev= 0.00 lat (nsec): min=1086.7M, max=1086.7M, avg=1086740970.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2138KiB/s (2190kB/s)(8192KiB/3831msec); 0 zone resets clat (msec): min=285, max=2307, avg=1296.81, stdev=1429.64 lat (msec): min=286, max=2307, avg=1297.25, stdev=1429.39 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 2299], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=4.65%, ctx=97, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180479: Thu Aug 27 10:24:39 2026 write: IOPS=0, BW=2874KiB/s (2943kB/s)(12.0MiB/4276msec); 0 zone resets clat (msec): min=1173, max=1511, avg=1339.82, stdev=168.84 lat (msec): min=1174, max=1511, avg=1340.18, stdev=168.84 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7907, max= 8015, per=100.00%, avg=7961.00, stdev=76.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=4.16%, ctx=78, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180480: Thu Aug 27 10:24:39 2026 write: IOPS=0, BW=3817KiB/s (3909kB/s)(12.0MiB/3219msec); 0 zone resets clat (msec): min=324, max=2063, avg=983.87, stdev=942.52 lat (msec): min=325, max=2063, avg=984.60, stdev=942.19 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 7907, max= 7922, per=100.00%, avg=7914.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=4.54%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4277KiB/s (4379kB/s), 1069KiB/s-3564KiB/s (1095kB/s-3649kB/s), io=16.0MiB (16.8MB), run=3448-3831msec WRITE: bw=7663KiB/s (7847kB/s), 2138KiB/s-3817KiB/s (2190kB/s-3909kB/s), io=32.0MiB (33.6MB), run=3219-4276msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180482: Thu Aug 27 10:24:39 2026 read: IOPS=0, BW=3000KiB/s (3072kB/s)(12.0MiB/4096msec) clat (msec): min=811, max=1892, avg=1364.90, stdev=541.17 lat (msec): min=811, max=1892, avg=1364.90, stdev=541.17 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 7907, max= 8094, per=100.00%, avg=8000.50, stdev=132.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.71%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180483: Thu Aug 27 10:24:39 2026 read: IOPS=0, BW=1083KiB/s (1109kB/s)(4096KiB/3782msec) clat (nsec): min=1606.5M, max=1606.5M, avg=1606495853.00, stdev= 0.00 lat (nsec): min=1606.5M, max=1606.5M, avg=1606497692.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1603], 5.00th=[ 1603], 10.00th=[ 1603], 20.00th=[ 1603], | 30.00th=[ 1603], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2166KiB/s (2218kB/s)(8192KiB/3782msec); 0 zone resets clat (msec): min=1038, max=1134, avg=1086.32, stdev=67.77 lat (msec): min=1038, max=1134, avg=1086.97, stdev=67.92 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8062, max= 8062, per=94.14%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.94%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180484: Thu Aug 27 10:24:39 2026 write: IOPS=0, BW=3212KiB/s (3289kB/s)(12.0MiB/3826msec); 0 zone resets clat (msec): min=1128, max=1409, avg=1272.29, stdev=140.39 lat (msec): min=1129, max=1409, avg=1274.77, stdev=140.54 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7907, max= 8031, per=93.05%, avg=7969.00, stdev=87.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.12%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180485: Thu Aug 27 10:24:39 2026 write: IOPS=1, BW=4411KiB/s (4516kB/s)(12.0MiB/2786msec); 0 zone resets clat (msec): min=232, max=2237, avg=922.50, stdev=1139.19 lat (msec): min=233, max=2237, avg=923.42, stdev=1138.76 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min=13086, max=13086, per=100.00%, avg=13086.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=5.31%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4000KiB/s (4096kB/s), 1083KiB/s-3000KiB/s (1109kB/s-3072kB/s), io=16.0MiB (16.8MB), run=3782-4096msec WRITE: bw=8565KiB/s (8770kB/s), 2166KiB/s-4411KiB/s (2218kB/s-4516kB/s), io=32.0MiB (33.6MB), run=2786-3826msec