== sanity test 398b: DIO and buffer IO race ============== 14:22:21 (1788805341) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.43095 s, 11.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144988: Mon Sep 7 14:24:16 2026 read: IOPS=14, BW=59.6KiB/s (61.0kB/s)(5992KiB/100579msec) clat (usec): min=31, max=292085, avg=32399.73, stdev=24339.56 lat (usec): min=32, max=292087, avg=32403.97, stdev=24340.49 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 233], 20.00th=[ 15139], | 30.00th=[ 19268], 40.00th=[ 23200], 50.00th=[ 27132], 60.00th=[ 32900], | 70.00th=[ 40109], 80.00th=[ 50594], 90.00th=[ 64226], 95.00th=[ 74974], | 99.00th=[ 99091], 99.50th=[116917], 99.90th=[225444], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 119, per=25.35%, avg=59.07, stdev=22.80, samples=199 iops : min= 1, max= 29, avg=14.16, stdev= 5.75, samples=199 write: IOPS=15, BW=62.6KiB/s (64.1kB/s)(6296KiB/100579msec); 0 zone resets clat (usec): min=945, max=531471, avg=32785.24, stdev=35387.49 lat (usec): min=945, max=531473, avg=32792.17, stdev=35383.69 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1696], 20.00th=[ 3720], | 30.00th=[ 7570], 40.00th=[ 15926], 50.00th=[ 25035], 60.00th=[ 32900], | 70.00th=[ 42206], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[149947], 99.50th=[179307], 99.90th=[295699], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 143, per=25.41%, avg=62.01, stdev=24.24, samples=199 iops : min= 1, max= 35, avg=14.90, stdev= 6.10, samples=199 lat (usec) : 50=0.75%, 100=3.68%, 250=0.46%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.26% lat (msec) : 2=6.09%, 4=4.69%, 10=7.49%, 20=14.49%, 50=40.14% lat (msec) : 100=19.43%, 250=2.28%, 500=0.10%, 750=0.03% cpu : usr=0.10%, sys=6.76%, ctx=6622, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144989: Mon Sep 7 14:24:16 2026 read: IOPS=14, BW=58.5KiB/s (59.9kB/s)(5940KiB/101621msec) clat (usec): min=35, max=367957, avg=33487.88, stdev=28685.87 lat (usec): min=35, max=367958, avg=33490.96, stdev=28685.94 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 113], 20.00th=[ 14484], | 30.00th=[ 19006], 40.00th=[ 22938], 50.00th=[ 27657], 60.00th=[ 33817], | 70.00th=[ 40109], 80.00th=[ 49546], 90.00th=[ 65274], 95.00th=[ 78119], | 99.00th=[127402], 99.50th=[166724], 99.90th=[261096], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 15, max= 128, per=25.00%, avg=58.26, stdev=24.85, samples=200 iops : min= 3, max= 32, avg=13.94, stdev= 6.23, samples=200 write: IOPS=15, BW=62.5KiB/s (63.0kB/s)(6348KiB/101621msec); 0 zone resets clat (usec): min=966, max=603121, avg=32402.69, stdev=36759.62 lat (usec): min=967, max=603122, avg=32404.21, stdev=36759.57 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1516], 20.00th=[ 3556], | 30.00th=[ 6915], 40.00th=[ 15270], 50.00th=[ 23987], 60.00th=[ 31589], | 70.00th=[ 41681], 80.00th=[ 53740], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[156238], 99.50th=[196084], 99.90th=[304088], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 8, max= 135, per=25.28%, avg=61.69, stdev=24.39, samples=201 iops : min= 2, max= 33, avg=14.82, stdev= 6.12, samples=201 lat (usec) : 50=0.68%, 100=4.04%, 250=0.65%, 500=0.20%, 1000=0.13% lat (msec) : 2=6.80%, 4=4.79%, 10=6.87%, 20=15.01%, 50=39.58% lat (msec) : 100=18.10%, 250=2.93%, 500=0.20%, 750=0.03% cpu : usr=0.10%, sys=6.62%, ctx=6511, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144990: Mon Sep 7 14:24:16 2026 read: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6028KiB/100621msec) clat (usec): min=28, max=616826, avg=32562.40, stdev=28457.23 lat (usec): min=28, max=616827, avg=32565.36, stdev=28459.00 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 110], 20.00th=[ 14746], | 30.00th=[ 19268], 40.00th=[ 22938], 50.00th=[ 27132], 60.00th=[ 32375], | 70.00th=[ 39584], 80.00th=[ 47973], 90.00th=[ 63701], 95.00th=[ 76022], | 99.00th=[120062], 99.50th=[139461], 99.90th=[162530], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 135, per=25.64%, avg=59.75, stdev=24.29, samples=198 iops : min= 1, max= 33, avg=14.32, stdev= 6.11, samples=198 write: IOPS=15, BW=62.2KiB/s (63.7kB/s)(6260KiB/100621msec); 0 zone resets clat (usec): min=941, max=566869, avg=32678.28, stdev=37663.86 lat (usec): min=942, max=566871, avg=32681.15, stdev=37664.52 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1565], 20.00th=[ 3064], | 30.00th=[ 5932], 40.00th=[ 12387], 50.00th=[ 22938], 60.00th=[ 31589], | 70.00th=[ 41157], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[189793], 99.90th=[283116], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 15, max= 133, per=25.43%, avg=62.05, stdev=25.15, samples=198 iops : min= 3, max= 33, avg=14.91, stdev= 6.35, samples=198 lat (usec) : 50=0.94%, 100=3.78%, 250=0.78%, 500=0.16%, 1000=0.07% lat (msec) : 2=6.93%, 4=5.27%, 10=7.52%, 20=14.16%, 50=39.00% lat (msec) : 100=18.03%, 250=3.22%, 500=0.07%, 750=0.07% cpu : usr=0.08%, sys=6.63%, ctx=6442, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144991: Mon Sep 7 14:24:16 2026 read: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6052KiB/102891msec) clat (usec): min=32, max=643412, avg=32681.85, stdev=30603.35 lat (usec): min=32, max=643413, avg=32685.87, stdev=30600.46 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 100], 20.00th=[ 13960], | 30.00th=[ 18482], 40.00th=[ 22414], 50.00th=[ 27395], 60.00th=[ 32637], | 70.00th=[ 40109], 80.00th=[ 49021], 90.00th=[ 62129], 95.00th=[ 76022], | 99.00th=[121111], 99.50th=[160433], 99.90th=[329253], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 151, per=24.97%, avg=58.18, stdev=23.96, samples=202 iops : min= 1, max= 37, avg=13.93, stdev= 6.04, samples=202 write: IOPS=15, BW=60.6KiB/s (62.1kB/s)(6236KiB/102891msec); 0 zone resets clat (usec): min=860, max=509809, avg=34011.40, stdev=36829.65 lat (usec): min=861, max=509811, avg=34013.38, stdev=36829.41 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 1827], 20.00th=[ 3687], | 30.00th=[ 6980], 40.00th=[ 14484], 50.00th=[ 24511], 60.00th=[ 34341], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[141558], 99.50th=[170918], 99.90th=[350225], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 143, per=24.52%, avg=59.82, stdev=23.54, samples=203 iops : min= 1, max= 35, avg=14.34, stdev= 5.91, samples=203 lat (usec) : 50=0.65%, 100=4.33%, 250=0.75%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.47%, 4=5.27%, 10=8.20%, 20=14.29%, 50=38.05% lat (msec) : 100=19.27%, 250=3.26%, 500=0.07%, 750=0.07% cpu : usr=0.09%, sys=6.52%, ctx=6601, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=233KiB/s (239kB/s), 58.5KiB/s-59.9KiB/s (59.9kB/s-61.3kB/s), io=23.4MiB (24.6MB), run=100579-102891msec WRITE: bw=244KiB/s (250kB/s), 60.6KiB/s-62.6KiB/s (62.1kB/s-64.1kB/s), io=24.6MiB (25.7MB), run=100579-102891msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144993: Mon Sep 7 14:26:11 2026 read: IOPS=6, BW=27.6KiB/s (28.3kB/s)(5992KiB/216759msec) clat (msec): min=4, max=680, avg=29.66, stdev=33.30 lat (msec): min=4, max=680, avg=29.66, stdev=33.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 61], 95.00th=[ 82], | 99.00th=[ 138], 99.50th=[ 171], 99.90th=[ 393], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 103, per=27.04%, avg=29.75, stdev=19.60, samples=392 iops : min= 1, max= 25, avg= 6.85, stdev= 4.95, samples=392 write: IOPS=7, BW=29.0KiB/s (29.7kB/s)(6296KiB/216759msec); 0 zone resets clat (msec): min=27, max=560, avg=109.41, stdev=57.14 lat (msec): min=27, max=560, avg=109.41, stdev=57.14 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 84], 50.00th=[ 93], 60.00th=[ 104], | 70.00th=[ 118], 80.00th=[ 142], 90.00th=[ 190], 95.00th=[ 226], | 99.00th=[ 321], 99.50th=[ 347], 99.90th=[ 510], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 64, per=24.95%, avg=28.69, stdev=13.12, samples=426 iops : min= 1, max= 16, avg= 6.58, stdev= 3.41, samples=426 lat (msec) : 10=6.90%, 20=16.28%, 50=20.87%, 100=33.01%, 250=21.32% lat (msec) : 500=1.53%, 750=0.10% cpu : usr=0.04%, sys=1.46%, ctx=5599, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144994: Mon Sep 7 14:26:11 2026 read: IOPS=6, BW=27.7KiB/s (28.4kB/s)(5940KiB/214410msec) clat (msec): min=5, max=636, avg=29.22, stdev=32.70 lat (msec): min=5, max=636, avg=29.23, stdev=32.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 55], 95.00th=[ 80], | 99.00th=[ 153], 99.50th=[ 192], 99.90th=[ 439], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 119, per=27.42%, avg=30.16, stdev=19.79, samples=383 iops : min= 1, max= 29, avg= 6.95, stdev= 5.03, samples=383 write: IOPS=7, BW=29.6KiB/s (30.3kB/s)(6348KiB/214410msec); 0 zone resets clat (msec): min=28, max=448, avg=107.69, stdev=54.69 lat (msec): min=28, max=448, avg=107.70, stdev=54.69 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 67], | 30.00th=[ 75], 40.00th=[ 83], 50.00th=[ 91], 60.00th=[ 104], | 70.00th=[ 118], 80.00th=[ 140], 90.00th=[ 184], 95.00th=[ 220], | 99.00th=[ 309], 99.50th=[ 355], 99.90th=[ 384], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 64, per=25.34%, avg=29.14, stdev=12.81, samples=423 iops : min= 1, max= 16, avg= 6.69, stdev= 3.30, samples=423 lat (msec) : 10=5.96%, 20=16.80%, 50=21.78%, 100=32.13%, 250=21.65% lat (msec) : 500=1.66%, 750=0.03% cpu : usr=0.05%, sys=1.46%, ctx=5728, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144995: Mon Sep 7 14:26:11 2026 read: IOPS=6, BW=27.9KiB/s (28.6kB/s)(6028KiB/215921msec) clat (msec): min=5, max=319, avg=30.31, stdev=28.84 lat (msec): min=5, max=319, avg=30.31, stdev=28.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 64], 95.00th=[ 85], | 99.00th=[ 148], 99.50th=[ 178], 99.90th=[ 264], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 111, per=26.51%, avg=29.16, stdev=19.58, samples=401 iops : min= 1, max= 27, avg= 6.71, stdev= 4.95, samples=401 write: IOPS=7, BW=28.0KiB/s (29.7kB/s)(6260KiB/215921msec); 0 zone resets clat (msec): min=31, max=712, avg=108.71, stdev=59.75 lat (msec): min=31, max=712, avg=108.71, stdev=59.75 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 75], 40.00th=[ 83], 50.00th=[ 92], 60.00th=[ 103], | 70.00th=[ 117], 80.00th=[ 142], 90.00th=[ 184], 95.00th=[ 222], | 99.00th=[ 317], 99.50th=[ 393], 99.90th=[ 634], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 63, per=24.95%, avg=28.70, stdev=13.37, samples=423 iops : min= 1, max= 15, avg= 6.58, stdev= 3.45, samples=423 lat (msec) : 10=5.92%, 20=17.02%, 50=20.57%, 100=33.69%, 250=21.45% lat (msec) : 500=1.24%, 750=0.10% cpu : usr=0.05%, sys=1.46%, ctx=5570, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144996: Mon Sep 7 14:26:11 2026 read: IOPS=7, BW=28.3KiB/s (28.9kB/s)(6052KiB/214202msec) clat (msec): min=4, max=382, avg=29.56, stdev=29.38 lat (msec): min=4, max=382, avg=29.56, stdev=29.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 60], 95.00th=[ 82], | 99.00th=[ 146], 99.50th=[ 178], 99.90th=[ 309], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 96, per=27.25%, avg=29.97, stdev=19.53, samples=393 iops : min= 1, max= 24, avg= 6.90, stdev= 4.96, samples=393 write: IOPS=7, BW=29.1KiB/s (29.8kB/s)(6236KiB/214202msec); 0 zone resets clat (msec): min=26, max=711, avg=108.64, stdev=59.58 lat (msec): min=26, max=711, avg=108.64, stdev=59.58 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 56], 20.00th=[ 66], | 30.00th=[ 74], 40.00th=[ 84], 50.00th=[ 93], 60.00th=[ 104], | 70.00th=[ 120], 80.00th=[ 142], 90.00th=[ 184], 95.00th=[ 224], | 99.00th=[ 313], 99.50th=[ 368], 99.90th=[ 584], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 64, per=24.84%, avg=28.56, stdev=13.47, samples=424 iops : min= 1, max= 16, avg= 6.54, stdev= 3.48, samples=424 lat (msec) : 10=6.35%, 20=16.34%, 50=22.88%, 100=31.32%, 250=21.55% lat (msec) : 500=1.46%, 750=0.10% cpu : usr=0.04%, sys=1.49%, ctx=5618, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=111KiB/s (113kB/s), 27.6KiB/s-28.3KiB/s (28.3kB/s-28.9kB/s), io=23.4MiB (24.6MB), run=214202-216759msec WRITE: bw=116KiB/s (119kB/s), 28.0KiB/s-29.6KiB/s (29.7kB/s-30.3kB/s), io=24.6MiB (25.7MB), run=214202-216759msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145048: Mon Sep 7 14:26:42 2026 read: IOPS=17, BW=273KiB/s (279kB/s)(5920KiB/21693msec) clat (usec): min=33, max=141257, avg=29079.03, stdev=23512.91 lat (usec): min=33, max=141259, avg=29080.58, stdev=23513.11 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 70], 20.00th=[ 293], | 30.00th=[ 17957], 40.00th=[ 22414], 50.00th=[ 27132], 60.00th=[ 31327], | 70.00th=[ 35914], 80.00th=[ 43254], 90.00th=[ 59507], 95.00th=[ 70779], | 99.00th=[109577], 99.50th=[129500], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 95, max= 538, per=25.99%, avg=276.00, stdev=84.54, samples=42 iops : min= 5, max= 33, avg=16.57, stdev= 5.37, samples=42 write: IOPS=18, BW=294KiB/s (301kB/s)(6368KiB/21693msec); 0 zone resets clat (usec): min=1408, max=182189, avg=27390.28, stdev=27308.05 lat (usec): min=1410, max=182191, avg=27392.78, stdev=27307.87 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1958], 10.00th=[ 2737], 20.00th=[ 4424], | 30.00th=[ 6325], 40.00th=[ 11469], 50.00th=[ 19792], 60.00th=[ 27657], | 70.00th=[ 34866], 80.00th=[ 47973], 90.00th=[ 66323], 95.00th=[ 79168], | 99.00th=[126354], 99.50th=[149947], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 64, max= 509, per=26.51%, avg=296.43, stdev=104.23, samples=42 iops : min= 4, max= 31, avg=17.86, stdev= 6.53, samples=42 lat (usec) : 50=1.17%, 100=6.64%, 250=1.56%, 500=0.26%, 750=0.13% lat (msec) : 2=2.86%, 4=6.25%, 10=10.94%, 20=13.67%, 50=39.06% lat (msec) : 100=15.76%, 250=1.69% cpu : usr=0.10%, sys=8.49%, ctx=1606, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145049: Mon Sep 7 14:26:42 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(5744KiB/22533msec) clat (usec): min=36, max=132287, avg=30879.12, stdev=22489.39 lat (usec): min=36, max=132289, avg=30881.74, stdev=22488.94 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 12780], | 30.00th=[ 20055], 40.00th=[ 24773], 50.00th=[ 29754], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 46400], 90.00th=[ 57410], 95.00th=[ 67634], | 99.00th=[ 99091], 99.50th=[122160], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 48, max= 446, per=24.51%, avg=260.28, stdev=87.35, samples=43 iops : min= 3, max= 27, avg=15.58, stdev= 5.46, samples=43 write: IOPS=18, BW=290KiB/s (297kB/s)(6544KiB/22533msec); 0 zone resets clat (usec): min=1428, max=239655, avg=27849.81, stdev=32637.65 lat (usec): min=1430, max=239657, avg=27853.65, stdev=32636.49 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2008], 10.00th=[ 2638], 20.00th=[ 4555], | 30.00th=[ 6259], 40.00th=[ 10159], 50.00th=[ 16319], 60.00th=[ 24249], | 70.00th=[ 31327], 80.00th=[ 46400], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[147850], 99.50th=[173016], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 121, max= 572, per=25.94%, avg=290.00, stdev=100.61, samples=44 iops : min= 7, max= 35, avg=17.43, stdev= 6.37, samples=44 lat (usec) : 50=0.65%, 100=6.12%, 250=0.78%, 500=0.13%, 750=0.13% lat (msec) : 2=2.73%, 4=7.03%, 10=11.98%, 20=13.02%, 50=40.23% lat (msec) : 100=14.97%, 250=2.21% cpu : usr=0.12%, sys=8.42%, ctx=1605, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145050: Mon Sep 7 14:26:42 2026 read: IOPS=18, BW=291KiB/s (298kB/s)(6256KiB/21481msec) clat (usec): min=36, max=292847, avg=29155.44, stdev=28886.58 lat (usec): min=37, max=292848, avg=29156.75, stdev=28886.55 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 208], | 30.00th=[ 16909], 40.00th=[ 21365], 50.00th=[ 24773], 60.00th=[ 30540], | 70.00th=[ 37487], 80.00th=[ 43254], 90.00th=[ 57410], 95.00th=[ 72877], | 99.00th=[132645], 99.50th=[212861], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 127, max= 537, per=27.74%, avg=294.57, stdev=88.68, samples=42 iops : min= 7, max= 33, avg=17.74, stdev= 5.64, samples=42 write: IOPS=17, BW=281KiB/s (288kB/s)(6032KiB/21481msec); 0 zone resets clat (usec): min=1397, max=146331, avg=26653.08, stdev=26832.97 lat (usec): min=1400, max=146333, avg=26660.46, stdev=26838.13 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1975], 10.00th=[ 2933], 20.00th=[ 4752], | 30.00th=[ 7832], 40.00th=[ 11600], 50.00th=[ 16909], 60.00th=[ 25035], | 70.00th=[ 32900], 80.00th=[ 46924], 90.00th=[ 63701], 95.00th=[ 81265], | 99.00th=[117965], 99.50th=[143655], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 94, max= 510, per=25.10%, avg=280.67, stdev=103.15, samples=42 iops : min= 5, max= 31, avg=16.86, stdev= 6.46, samples=42 lat (usec) : 50=0.65%, 100=8.33%, 250=1.43%, 500=0.52%, 750=0.26% lat (msec) : 2=2.86%, 4=5.21%, 10=10.55%, 20=15.49%, 50=38.93% lat (msec) : 100=13.54%, 250=2.08%, 500=0.13% cpu : usr=0.12%, sys=8.45%, ctx=1536, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145051: Mon Sep 7 14:26:42 2026 read: IOPS=17, BW=279KiB/s (286kB/s)(6032KiB/21617msec) clat (usec): min=38, max=152601, avg=29735.41, stdev=24602.66 lat (usec): min=38, max=152602, avg=29736.68, stdev=24602.62 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 289], | 30.00th=[ 17957], 40.00th=[ 22938], 50.00th=[ 28181], 60.00th=[ 33162], | 70.00th=[ 39060], 80.00th=[ 44827], 90.00th=[ 58983], 95.00th=[ 71828], | 99.00th=[115868], 99.50th=[139461], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 94, max= 608, per=26.35%, avg=279.79, stdev=105.78, samples=42 iops : min= 5, max= 38, avg=16.81, stdev= 6.68, samples=42 write: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21617msec); 0 zone resets clat (usec): min=1464, max=218086, avg=26526.19, stdev=30164.34 lat (usec): min=1466, max=218088, avg=26528.68, stdev=30164.24 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1958], 10.00th=[ 2737], 20.00th=[ 4228], | 30.00th=[ 5997], 40.00th=[ 8979], 50.00th=[ 15270], 60.00th=[ 23200], | 70.00th=[ 31065], 80.00th=[ 46400], 90.00th=[ 62653], 95.00th=[ 82314], | 99.00th=[141558], 99.50th=[158335], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 94, max= 667, per=26.06%, avg=291.36, stdev=113.87, samples=42 iops : min= 5, max= 41, avg=17.55, stdev= 7.18, samples=42 lat (usec) : 50=0.91%, 100=7.55%, 250=0.91%, 500=0.78%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.60%, 4=6.51%, 10=13.41%, 20=11.72%, 50=37.24% lat (msec) : 100=15.23%, 250=2.73% cpu : usr=0.09%, sys=8.47%, ctx=1582, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1063KiB/s (1088kB/s), 255KiB/s-291KiB/s (261kB/s-298kB/s), io=23.4MiB (24.5MB), run=21481-22533msec WRITE: bw=1118KiB/s (1145kB/s), 281KiB/s-294KiB/s (288kB/s-301kB/s), io=24.6MiB (25.8MB), run=21481-22533msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145043: Mon Sep 7 14:27:14 2026 read: IOPS=6, BW=110KiB/s (112kB/s)(5920KiB/53992msec) clat (msec): min=6, max=211, avg=29.51, stdev=26.54 lat (msec): min=6, max=211, avg=29.52, stdev=26.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 40], 90.00th=[ 67], 95.00th=[ 87], | 99.00th=[ 134], 99.50th=[ 163], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 318, per=25.53%, avg=113.10, stdev=72.18, samples=103 iops : min= 1, max= 19, avg= 6.34, stdev= 4.58, samples=103 write: IOPS=7, BW=118KiB/s (121kB/s)(6368KiB/53992msec); 0 zone resets clat (msec): min=39, max=345, avg=107.90, stdev=45.21 lat (msec): min=39, max=345, avg=107.91, stdev=45.21 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 81], 40.00th=[ 92], 50.00th=[ 100], 60.00th=[ 107], | 70.00th=[ 117], 80.00th=[ 136], 90.00th=[ 167], 95.00th=[ 197], | 99.00th=[ 288], 99.50th=[ 321], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 222, per=25.18%, avg=117.33, stdev=45.19, samples=107 iops : min= 1, max= 13, avg= 6.60, stdev= 2.93, samples=107 lat (msec) : 10=2.86%, 20=21.09%, 50=19.40%, 100=29.82%, 250=26.04% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.75%, ctx=1412, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145044: Mon Sep 7 14:27:14 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(5744KiB/53996msec) clat (msec): min=7, max=211, avg=28.68, stdev=27.02 lat (msec): min=7, max=211, avg=28.69, stdev=27.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 55], 95.00th=[ 86], | 99.00th=[ 144], 99.50th=[ 165], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 29, max= 381, per=25.98%, avg=115.10, stdev=69.02, samples=98 iops : min= 1, max= 23, avg= 6.47, stdev= 4.32, samples=98 write: IOPS=7, BW=121KiB/s (124kB/s)(6544KiB/53996msec); 0 zone resets clat (msec): min=31, max=402, avg=106.48, stdev=44.84 lat (msec): min=31, max=402, avg=106.49, stdev=44.84 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 73], | 30.00th=[ 82], 40.00th=[ 88], 50.00th=[ 95], 60.00th=[ 105], | 70.00th=[ 116], 80.00th=[ 134], 90.00th=[ 171], 95.00th=[ 197], | 99.00th=[ 243], 99.50th=[ 279], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 223, per=25.88%, avg=120.60, stdev=45.72, samples=107 iops : min= 1, max= 13, avg= 6.80, stdev= 3.00, samples=107 lat (msec) : 10=2.08%, 20=22.27%, 50=17.19%, 100=33.85%, 250=24.22% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.73%, ctx=1425, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145045: Mon Sep 7 14:27:14 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52036msec) clat (msec): min=6, max=206, avg=27.35, stdev=25.12 lat (msec): min=6, max=206, avg=27.35, stdev=25.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 55], 95.00th=[ 85], | 99.00th=[ 136], 99.50th=[ 161], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 479, per=28.54%, avg=126.44, stdev=81.62, samples=98 iops : min= 1, max= 29, avg= 7.16, stdev= 5.17, samples=98 write: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/52036msec); 0 zone resets clat (msec): min=41, max=425, avg=109.30, stdev=46.15 lat (msec): min=41, max=425, avg=109.31, stdev=46.15 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 92], 50.00th=[ 101], 60.00th=[ 108], | 70.00th=[ 121], 80.00th=[ 140], 90.00th=[ 169], 95.00th=[ 190], | 99.00th=[ 275], 99.50th=[ 321], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 31, max= 222, per=24.77%, avg=115.41, stdev=42.72, samples=103 iops : min= 1, max= 13, avg= 6.47, stdev= 2.75, samples=103 lat (msec) : 10=3.12%, 20=25.52%, 50=17.45%, 100=28.13%, 250=25.00% lat (msec) : 500=0.78% cpu : usr=0.03%, sys=1.84%, ctx=1339, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145046: Mon Sep 7 14:27:14 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6032KiB/52829msec) clat (msec): min=6, max=156, avg=28.76, stdev=26.81 lat (msec): min=6, max=156, avg=28.76, stdev=26.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 38], 90.00th=[ 59], 95.00th=[ 91], | 99.00th=[ 146], 99.50th=[ 157], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 414, per=26.76%, avg=118.57, stdev=79.53, samples=99 iops : min= 1, max= 25, avg= 6.68, stdev= 5.05, samples=99 write: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/52829msec); 0 zone resets clat (msec): min=42, max=360, avg=107.20, stdev=43.89 lat (msec): min=42, max=360, avg=107.20, stdev=43.89 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 73], | 30.00th=[ 83], 40.00th=[ 89], 50.00th=[ 97], 60.00th=[ 105], | 70.00th=[ 116], 80.00th=[ 136], 90.00th=[ 174], 95.00th=[ 192], | 99.00th=[ 262], 99.50th=[ 284], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 192, per=25.24%, avg=117.60, stdev=44.51, samples=104 iops : min= 1, max= 12, avg= 6.62, stdev= 2.91, samples=104 lat (msec) : 10=4.30%, 20=21.35%, 50=17.97%, 100=31.38%, 250=24.48% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.79%, ctx=1385, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=444KiB/s (454kB/s), 106KiB/s-120KiB/s (109kB/s-123kB/s), io=23.4MiB (24.5MB), run=52036-53996msec WRITE: bw=467KiB/s (478kB/s), 116KiB/s-121KiB/s (119kB/s-124kB/s), io=24.6MiB (25.8MB), run=52036-53996msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145070: Mon Sep 7 14:27:24 2026 read: IOPS=2, BW=2281KiB/s (2335kB/s)(7168KiB/3143msec) clat (msec): min=5, max=377, avg=207.95, stdev=128.70 lat (msec): min=5, max=377, avg=207.95, stdev=128.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 130], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 205], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2027, max= 4117, per=45.42%, avg=2556.50, stdev=1040.36, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1629KiB/s (1668kB/s)(5120KiB/3143msec); 0 zone resets clat (msec): min=148, max=795, avg=336.56, stdev=265.64 lat (msec): min=148, max=797, avg=336.93, stdev=266.10 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2039, max= 4055, per=34.42%, avg=2712.33, stdev=1162.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 250=50.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=25.84%, ctx=227, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145071: Mon Sep 7 14:27:24 2026 read: IOPS=0, BW=563KiB/s (576kB/s)(2048KiB/3638msec) clat (usec): min=1014, max=143791, avg=72403.14, stdev=100958.17 lat (usec): min=1016, max=143793, avg=72404.67, stdev=100958.65 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1012], 10.00th=[ 1012], 20.00th=[ 1012], | 30.00th=[ 1012], 40.00th=[ 1012], 50.00th=[ 1012], 60.00th=[143655], | 70.00th=[143655], 80.00th=[143655], 90.00th=[143655], 95.00th=[143655], | 99.00th=[143655], 99.50th=[143655], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 1383, max= 2043, per=30.43%, avg=1713.00, stdev=466.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2815KiB/s (2882kB/s)(10.0MiB/3638msec); 0 zone resets clat (msec): min=113, max=1059, avg=349.01, stdev=287.34 lat (msec): min=113, max=1059, avg=349.10, stdev=287.32 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 142], | 30.00th=[ 157], 40.00th=[ 171], 50.00th=[ 222], 60.00th=[ 257], | 70.00th=[ 372], 80.00th=[ 477], 90.00th=[ 523], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1383, max= 6119, per=34.58%, avg=2725.40, stdev=1918.40, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=22.16%, ctx=230, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Mon Sep 7 14:27:24 2026 read: IOPS=1, BW=2030KiB/s (2078kB/s)(6144KiB/3027msec) clat (usec): min=947, max=237047, avg=138066.20, stdev=110866.83 lat (usec): min=949, max=237050, avg=138067.53, stdev=110867.09 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 947], 10.00th=[ 947], 20.00th=[ 1254], | 30.00th=[ 1254], 40.00th=[145753], 50.00th=[145753], 60.00th=[219153], | 70.00th=[223347], 80.00th=[223347], 90.00th=[238027], 95.00th=[238027], | 99.00th=[238027], 99.50th=[238027], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 4055, max= 6131, per=90.48%, avg=5093.00, stdev=1467.95, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=2030KiB/s (2078kB/s)(6144KiB/3027msec); 0 zone resets clat (msec): min=134, max=650, avg=364.73, stdev=210.36 lat (msec): min=134, max=650, avg=364.85, stdev=210.35 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 359], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2039, max= 2904, per=28.64%, avg=2257.25, stdev=431.17, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=58.33%, 500=8.33%, 750=16.67% cpu : usr=0.03%, sys=25.02%, ctx=327, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145073: Mon Sep 7 14:27:24 2026 read: IOPS=1, BW=1663KiB/s (1703kB/s)(5120KiB/3078msec) clat (usec): min=397, max=229680, avg=90019.27, stdev=122309.32 lat (usec): min=397, max=229681, avg=90020.21, stdev=122309.35 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 400], | 30.00th=[ 717], 40.00th=[ 717], 50.00th=[ 1123], 60.00th=[ 1123], | 70.00th=[219153], 80.00th=[219153], 90.00th=[229639], 95.00th=[229639], | 99.00th=[229639], 99.50th=[229639], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2329KiB/s (2385kB/s)(7168KiB/3078msec); 0 zone resets clat (msec): min=96, max=864, avg=374.98, stdev=267.95 lat (msec): min=96, max=864, avg=375.08, stdev=267.95 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 106], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 296], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 527], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1477, max= 6083, per=40.62%, avg=3201.00, stdev=2511.88, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=22.13%, ctx=222, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5629KiB/s (5765kB/s), 563KiB/s-2281KiB/s (576kB/s-2335kB/s), io=20.0MiB (20.0MB), run=3027-3638msec WRITE: bw=7881KiB/s (8070kB/s), 1629KiB/s-2815KiB/s (1668kB/s-2882kB/s), io=28.0MiB (29.4MB), run=3027-3638msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145065: Mon Sep 7 14:27:24 2026 read: IOPS=2, BW=2538KiB/s (2599kB/s)(7168KiB/2824msec) clat (msec): min=46, max=289, avg=145.71, stdev=93.71 lat (msec): min=46, max=289, avg=145.71, stdev=93.71 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 87], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 106], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 264], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2043, max= 5678, per=73.66%, avg=3899.00, stdev=1818.72, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1813KiB/s (1857kB/s)(5120KiB/2824msec); 0 zone resets clat (msec): min=230, max=570, avg=349.75, stdev=130.89 lat (msec): min=230, max=570, avg=349.85, stdev=130.90 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1988, max= 3938, per=35.85%, avg=2656.33, stdev=1110.30, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=8.01%, ctx=80, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145066: Mon Sep 7 14:27:24 2026 read: IOPS=0, BW=538KiB/s (551kB/s)(2048KiB/3809msec) clat (msec): min=75, max=112, avg=93.73, stdev=26.19 lat (msec): min=75, max=112, avg=93.73, stdev=26.19 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 113], | 70.00th=[ 113], 80.00th=[ 113], 90.00th=[ 113], 95.00th=[ 113], | 99.00th=[ 113], 99.50th=[ 113], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 1889, max= 2043, per=37.14%, avg=1966.00, stdev=108.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2688KiB/s (2753kB/s)(10.0MiB/3809msec); 0 zone resets clat (msec): min=141, max=1128, avg=360.01, stdev=296.78 lat (msec): min=141, max=1129, avg=360.14, stdev=296.80 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 150], | 30.00th=[ 199], 40.00th=[ 213], 50.00th=[ 234], 60.00th=[ 253], | 70.00th=[ 313], 80.00th=[ 460], 90.00th=[ 510], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1889, max= 5965, per=48.49%, avg=3593.40, stdev=1682.50, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.53%, ctx=233, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145067: Mon Sep 7 14:27:24 2026 read: IOPS=1, BW=1588KiB/s (1626kB/s)(6144KiB/3869msec) clat (msec): min=135, max=767, avg=300.22, stdev=235.10 lat (msec): min=135, max=767, avg=300.22, stdev=235.10 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1969, max= 2043, per=38.12%, avg=2017.80, stdev=30.25, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1588KiB/s (1626kB/s)(6144KiB/3869msec); 0 zone resets clat (msec): min=166, max=579, avg=334.20, stdev=153.75 lat (msec): min=166, max=579, avg=334.84, stdev=153.15 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 334], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1882, max= 2043, per=26.72%, avg=1980.20, stdev=61.80, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=7.73%, ctx=195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145068: Mon Sep 7 14:27:24 2026 read: IOPS=1, BW=1527KiB/s (1564kB/s)(5120KiB/3352msec) clat (msec): min=155, max=438, avg=258.10, stdev=119.07 lat (msec): min=155, max=438, avg=258.11, stdev=119.07 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1969, max= 4087, per=51.00%, avg=2699.67, stdev=1202.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2138KiB/s (2190kB/s)(7168KiB/3352msec); 0 zone resets clat (msec): min=188, max=435, avg=288.28, stdev=94.43 lat (msec): min=188, max=435, avg=288.47, stdev=94.40 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 218], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 253], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 393], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1943, max= 3976, per=32.44%, avg=2404.00, stdev=879.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=50.00% cpu : usr=0.00%, sys=7.61%, ctx=116, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5293KiB/s (5420kB/s), 538KiB/s-2538KiB/s (551kB/s-2599kB/s), io=20.0MiB (20.0MB), run=2824-3869msec WRITE: bw=7411KiB/s (7589kB/s), 1588KiB/s-2688KiB/s (1626kB/s-2753kB/s), io=28.0MiB (29.4MB), run=2824-3869msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145080: Mon Sep 7 14:27:37 2026 read: IOPS=1, BW=6231KiB/s (6381kB/s)(12.0MiB/1972msec) clat (msec): min=538, max=733, avg=624.00, stdev=99.73 lat (msec): min=538, max=733, avg=624.00, stdev=99.73 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 5859, max= 8000, per=89.38%, avg=6929.50, stdev=1513.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=26.33%, ctx=414, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145081: Mon Sep 7 14:27:37 2026 read: IOPS=0, BW=1938KiB/s (1985kB/s)(4096KiB/2113msec) clat (nsec): min=538025k, max=538025k, avg=538024635.00, stdev= 0.00 lat (nsec): min=538027k, max=538027k, avg=538026843.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3877KiB/s (3970kB/s)(8192KiB/2113msec); 0 zone resets clat (msec): min=569, max=819, avg=694.40, stdev=176.65 lat (msec): min=569, max=820, avg=695.36, stdev=177.40 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8192, max= 8192, per=67.40%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.65%, ctx=203, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145082: Mon Sep 7 14:27:37 2026 write: IOPS=1, BW=4558KiB/s (4667kB/s)(12.0MiB/2696msec); 0 zone resets clat (msec): min=447, max=1203, avg=867.42, stdev=384.67 lat (msec): min=448, max=1203, avg=867.83, stdev=384.68 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8000, max= 8000, per=65.82%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.65%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145084: Mon Sep 7 14:27:37 2026 write: IOPS=1, BW=5813KiB/s (5952kB/s)(12.0MiB/2114msec); 0 zone resets clat (msec): min=220, max=1332, avg=637.79, stdev=606.03 lat (msec): min=220, max=1333, avg=638.17, stdev=605.92 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7474, max= 8175, per=64.38%, avg=7824.50, stdev=495.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.37%, ctx=91, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7754KiB/s (7940kB/s), 1938KiB/s-6231KiB/s (1985kB/s-6381kB/s), io=16.0MiB (16.8MB), run=1972-2113msec WRITE: bw=11.9MiB/s (12.4MB/s), 3877KiB/s-5813KiB/s (3970kB/s-5952kB/s), io=32.0MiB (33.6MB), run=2113-2696msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145083: Mon Sep 7 14:27:37 2026 read: IOPS=1, BW=4322KiB/s (4426kB/s)(12.0MiB/2843msec) clat (msec): min=404, max=1326, avg=905.99, stdev=466.45 lat (msec): min=404, max=1326, avg=905.99, stdev=466.45 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.76%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145085: Mon Sep 7 14:27:37 2026 read: IOPS=0, BW=1489KiB/s (1525kB/s)(4096KiB/2750msec) clat (nsec): min=657090k, max=657090k, avg=657089627.00, stdev= 0.00 lat (nsec): min=657091k, max=657091k, avg=657090697.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2979KiB/s (3050kB/s)(8192KiB/2750msec); 0 zone resets clat (msec): min=761, max=1227, avg=994.17, stdev=329.39 lat (msec): min=761, max=1227, avg=994.73, stdev=329.26 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8159, max= 8159, per=79.68%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.95%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145086: Mon Sep 7 14:27:37 2026 write: IOPS=0, BW=3840KiB/s (3932kB/s)(12.0MiB/3200msec); 0 zone resets clat (msec): min=222, max=1511, avg=1019.66, stdev=697.02 lat (msec): min=222, max=1512, avg=1020.07, stdev=696.98 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8110, max= 8110, per=79.20%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.94%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145087: Mon Sep 7 14:27:37 2026 write: IOPS=1, BW=5533KiB/s (5665kB/s)(12.0MiB/2221msec); 0 zone resets clat (msec): min=448, max=1071, avg=679.09, stdev=341.32 lat (msec): min=451, max=1071, avg=680.98, stdev=340.06 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8126, max= 8175, per=79.59%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.91%, ctx=122, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5763KiB/s (5901kB/s), 1489KiB/s-4322KiB/s (1525kB/s-4426kB/s), io=16.0MiB (16.8MB), run=2750-2843msec WRITE: bw=10.0MiB/s (10.5MB/s), 2979KiB/s-5533KiB/s (3050kB/s-5665kB/s), io=32.0MiB (33.6MB), run=2221-3200msec