== sanity test 398b: DIO and buffer IO race ============== 13:21:18 (1784049678) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.06977 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144153: Tue Jul 14 13:23:58 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5992KiB/140768msec) clat (usec): min=33, max=600309, avg=45289.24, stdev=38466.84 lat (usec): min=33, max=600310, avg=45298.06, stdev=38463.26 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 101], 20.00th=[ 18744], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[160433], 99.50th=[196084], 99.90th=[346031], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 5, max= 104, per=24.98%, avg=42.21, stdev=20.83, samples=275 iops : min= 1, max= 26, avg= 9.92, stdev= 5.27, samples=275 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6296KiB/140768msec); 0 zone resets clat (usec): min=873, max=474391, avg=46086.50, stdev=49651.98 lat (usec): min=874, max=474391, avg=46088.54, stdev=49652.43 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1303], 10.00th=[ 1467], 20.00th=[ 4752], | 30.00th=[ 10290], 40.00th=[ 21103], 50.00th=[ 32637], 60.00th=[ 44303], | 70.00th=[ 60031], 80.00th=[ 79168], 90.00th=[107480], 95.00th=[141558], | 99.00th=[200279], 99.50th=[252707], 99.90th=[442500], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 103, per=25.05%, avg=44.35, stdev=20.14, samples=275 iops : min= 1, max= 25, avg=10.46, stdev= 5.09, samples=275 lat (usec) : 50=0.75%, 100=4.10%, 250=0.36%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=6.67%, 4=2.83%, 10=6.18%, 20=9.28%, 50=33.56% lat (msec) : 100=26.33%, 250=9.24%, 500=0.33%, 750=0.03% cpu : usr=0.08%, sys=4.82%, ctx=6226, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144156: Tue Jul 14 13:23:58 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(5940KiB/139705msec) clat (usec): min=31, max=714706, avg=44102.56, stdev=37270.89 lat (usec): min=32, max=714709, avg=44103.66, stdev=37270.92 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 83], 20.00th=[ 19792], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[143655], 99.50th=[168821], 99.90th=[379585], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 120, per=25.38%, avg=42.88, stdev=21.04, samples=269 iops : min= 1, max= 30, avg=10.09, stdev= 5.33, samples=269 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6348KiB/139705msec); 0 zone resets clat (usec): min=924, max=656552, avg=46470.97, stdev=50914.47 lat (usec): min=926, max=656554, avg=46473.12, stdev=50915.16 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1500], 20.00th=[ 4686], | 30.00th=[ 10683], 40.00th=[ 22152], 50.00th=[ 32900], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 79168], 90.00th=[111674], 95.00th=[139461], | 99.00th=[229639], 99.50th=[244319], 99.90th=[413139], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 107, per=25.61%, avg=45.33, stdev=20.10, samples=272 iops : min= 1, max= 26, avg=10.71, stdev= 5.08, samples=272 lat (usec) : 50=0.81%, 100=4.23%, 250=0.33%, 500=0.07%, 1000=0.10% lat (msec) : 2=6.51%, 4=3.09%, 10=5.50%, 20=8.98%, 50=35.64% lat (msec) : 100=24.54%, 250=9.90%, 500=0.23%, 750=0.07% cpu : usr=0.07%, sys=4.92%, ctx=6293, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144158: Tue Jul 14 13:23:58 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(6028KiB/141809msec) clat (usec): min=32, max=280632, avg=44635.86, stdev=34721.82 lat (usec): min=32, max=280634, avg=44640.08, stdev=34723.75 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 108], 20.00th=[ 18744], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 54789], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[156238], 99.50th=[189793], 99.90th=[270533], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 127, per=25.33%, avg=42.80, stdev=20.08, samples=273 iops : min= 1, max= 31, avg=10.06, stdev= 5.06, samples=273 write: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6260KiB/141809msec); 0 zone resets clat (usec): min=917, max=589502, avg=47327.95, stdev=51635.74 lat (usec): min=918, max=589504, avg=47332.24, stdev=51634.67 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1483], 20.00th=[ 4424], | 30.00th=[ 11207], 40.00th=[ 23200], 50.00th=[ 34341], 60.00th=[ 45876], | 70.00th=[ 59507], 80.00th=[ 78119], 90.00th=[110625], 95.00th=[145753], | 99.00th=[227541], 99.50th=[283116], 99.90th=[387974], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 125, per=24.71%, avg=43.74, stdev=21.06, samples=277 iops : min= 1, max= 31, avg=10.31, stdev= 5.33, samples=277 lat (usec) : 50=0.81%, 100=4.04%, 250=0.26%, 750=0.07%, 1000=0.13% lat (msec) : 2=6.74%, 4=2.77%, 10=5.44%, 20=9.51%, 50=34.64% lat (msec) : 100=25.91%, 250=9.28%, 500=0.39%, 750=0.03% cpu : usr=0.08%, sys=4.97%, ctx=6471, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144159: Tue Jul 14 13:23:58 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6052KiB/141802msec) clat (usec): min=21, max=809492, avg=46134.03, stdev=41624.21 lat (usec): min=22, max=809494, avg=46138.02, stdev=41624.82 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 73], 20.00th=[ 19530], | 30.00th=[ 25560], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[187696], 99.50th=[208667], 99.90th=[256902], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 95, per=25.51%, avg=43.11, stdev=18.40, samples=272 iops : min= 1, max= 23, avg=10.14, stdev= 4.65, samples=272 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6236KiB/141802msec); 0 zone resets clat (usec): min=865, max=916374, avg=45924.42, stdev=50669.16 lat (usec): min=867, max=916378, avg=45928.17, stdev=50670.34 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1598], 20.00th=[ 4817], | 30.00th=[ 11207], 40.00th=[ 21103], 50.00th=[ 33162], 60.00th=[ 46400], | 70.00th=[ 60031], 80.00th=[ 79168], 90.00th=[106431], 95.00th=[135267], | 99.00th=[202376], 99.50th=[225444], 99.90th=[270533], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 135, per=24.79%, avg=43.88, stdev=20.46, samples=275 iops : min= 1, max= 33, avg=10.33, stdev= 5.17, samples=275 lat (usec) : 50=0.85%, 100=4.39%, 250=0.39%, 500=0.07%, 1000=0.20% lat (msec) : 2=6.32%, 4=2.77%, 10=5.70%, 20=9.28%, 50=34.28% lat (msec) : 100=26.11%, 250=9.41%, 500=0.20%, 1000=0.07% cpu : usr=0.08%, sys=5.03%, ctx=6361, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=169KiB/s (173kB/s), 42.5KiB/s-42.7KiB/s (43.5kB/s-43.7kB/s), io=23.4MiB (24.6MB), run=139705-141809msec WRITE: bw=177KiB/s (182kB/s), 43.0KiB/s-45.4KiB/s (45.0kB/s-46.5kB/s), io=24.6MiB (25.7MB), run=139705-141809msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144152: Tue Jul 14 13:26:28 2026 read: IOPS=5, BW=20.6KiB/s (21.1kB/s)(5992KiB/291301msec) clat (msec): min=5, max=934, avg=41.30, stdev=49.32 lat (msec): min=5, max=934, avg=41.30, stdev=49.32 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 87], 95.00th=[ 118], | 99.00th=[ 243], 99.50th=[ 300], 99.90th=[ 617], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 112, per=29.09%, avg=23.85, stdev=17.29, samples=485 iops : min= 1, max= 28, avg= 5.34, stdev= 4.39, samples=485 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6296KiB/291301msec); 0 zone resets clat (msec): min=32, max=560, avg=145.54, stdev=83.43 lat (msec): min=32, max=560, avg=145.54, stdev=83.43 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 199], 90.00th=[ 268], 95.00th=[ 317], | 99.00th=[ 435], 99.50th=[ 481], 99.90th=[ 550], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 55, per=25.01%, avg=21.51, stdev=11.39, samples=562 iops : min= 1, max= 13, avg= 4.75, stdev= 2.91, samples=562 lat (msec) : 10=3.55%, 20=12.43%, 50=23.24%, 100=23.89%, 250=30.50% lat (msec) : 500=6.22%, 750=0.13%, 1000=0.03% cpu : usr=0.04%, sys=1.34%, ctx=5647, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144154: Tue Jul 14 13:26:28 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(5940KiB/291044msec) clat (msec): min=5, max=686, avg=40.62, stdev=44.70 lat (msec): min=5, max=686, avg=40.63, stdev=44.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 226], 99.50th=[ 305], 99.90th=[ 468], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 87, per=29.25%, avg=23.99, stdev=16.81, samples=477 iops : min= 1, max= 21, avg= 5.38, stdev= 4.27, samples=477 write: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6348KiB/291044msec); 0 zone resets clat (msec): min=33, max=991, avg=145.16, stdev=88.02 lat (msec): min=33, max=991, avg=145.16, stdev=88.02 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 93], 40.00th=[ 107], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 161], 80.00th=[ 199], 90.00th=[ 264], 95.00th=[ 321], | 99.00th=[ 439], 99.50th=[ 502], 99.90th=[ 743], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 64, per=25.09%, avg=21.58, stdev=11.65, samples=564 iops : min= 1, max= 16, avg= 4.77, stdev= 2.98, samples=564 lat (msec) : 10=3.45%, 20=12.01%, 50=22.79%, 100=25.00%, 250=30.31% lat (msec) : 500=6.15%, 750=0.26%, 1000=0.03% cpu : usr=0.04%, sys=1.30%, ctx=5621, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144155: Tue Jul 14 13:26:28 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6028KiB/289700msec) clat (msec): min=5, max=467, avg=41.16, stdev=40.84 lat (msec): min=5, max=467, avg=41.16, stdev=40.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 115], | 99.00th=[ 199], 99.50th=[ 253], 99.90th=[ 393], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 87, per=28.64%, avg=23.48, stdev=16.58, samples=495 iops : min= 1, max= 21, avg= 5.25, stdev= 4.17, samples=495 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6260KiB/289700msec); 0 zone resets clat (msec): min=37, max=793, avg=145.24, stdev=87.43 lat (msec): min=37, max=793, avg=145.25, stdev=87.43 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 106], 50.00th=[ 121], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 197], 90.00th=[ 259], 95.00th=[ 317], | 99.00th=[ 472], 99.50th=[ 523], 99.90th=[ 634], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 56, per=25.22%, avg=21.69, stdev=11.80, samples=555 iops : min= 1, max= 14, avg= 4.79, stdev= 3.02, samples=555 lat (msec) : 10=3.09%, 20=10.97%, 50=24.93%, 100=25.10%, 250=30.11% lat (msec) : 500=5.40%, 750=0.36%, 1000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5568, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144157: Tue Jul 14 13:26:28 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6052KiB/289172msec) clat (msec): min=4, max=412, avg=39.64, stdev=38.28 lat (msec): min=4, max=412, avg=39.64, stdev=38.28 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 86], 95.00th=[ 112], | 99.00th=[ 197], 99.50th=[ 236], 99.90th=[ 313], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 88, per=30.28%, avg=24.83, stdev=17.21, samples=471 iops : min= 1, max= 22, avg= 5.58, stdev= 4.36, samples=471 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6236KiB/289172msec); 0 zone resets clat (msec): min=37, max=1011, avg=146.80, stdev=90.26 lat (msec): min=37, max=1011, avg=146.81, stdev=90.26 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 165], 80.00th=[ 203], 90.00th=[ 266], 95.00th=[ 313], | 99.00th=[ 451], 99.50th=[ 523], 99.90th=[ 902], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 63, per=24.75%, avg=21.28, stdev=11.53, samples=563 iops : min= 1, max= 15, avg= 4.69, stdev= 2.94, samples=563 lat (msec) : 10=3.32%, 20=12.99%, 50=22.43%, 100=25.68%, 250=29.26% lat (msec) : 500=6.02%, 750=0.23%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.29%, ctx=5517, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=82.4KiB/s (84.4kB/s), 20.4KiB/s-20.9KiB/s (20.9kB/s-21.4kB/s), io=23.4MiB (24.6MB), run=289172-291301msec WRITE: bw=86.3KiB/s (88.4kB/s), 21.6KiB/s-21.8KiB/s (22.1kB/s-22.3kB/s), io=24.6MiB (25.7MB), run=289172-291301msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144224: Tue Jul 14 13:26:59 2026 read: IOPS=18, BW=288KiB/s (295kB/s)(5920KiB/20535msec) clat (usec): min=37, max=145489, avg=26970.93, stdev=24273.41 lat (usec): min=37, max=145491, avg=26972.14, stdev=24273.45 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 58], 20.00th=[ 70], | 30.00th=[ 13304], 40.00th=[ 20841], 50.00th=[ 26346], 60.00th=[ 29492], | 70.00th=[ 36439], 80.00th=[ 43779], 90.00th=[ 55837], 95.00th=[ 65799], | 99.00th=[110625], 99.50th=[145753], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 126, max= 670, per=26.16%, avg=284.12, stdev=102.51, samples=40 iops : min= 7, max= 41, avg=17.07, stdev= 6.41, samples=40 write: IOPS=19, BW=310KiB/s (318kB/s)(6368KiB/20535msec); 0 zone resets clat (usec): min=1131, max=203979, avg=26079.35, stdev=27636.15 lat (usec): min=1133, max=203980, avg=26103.15, stdev=27621.49 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1795], 10.00th=[ 1991], 20.00th=[ 3982], | 30.00th=[ 6521], 40.00th=[ 10028], 50.00th=[ 15926], 60.00th=[ 24249], | 70.00th=[ 34866], 80.00th=[ 45351], 90.00th=[ 64750], 95.00th=[ 79168], | 99.00th=[123208], 99.50th=[154141], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 127, max= 510, per=26.99%, avg=308.53, stdev=104.73, samples=40 iops : min= 7, max= 31, avg=18.63, stdev= 6.66, samples=40 lat (usec) : 50=2.47%, 100=9.90%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=5.34%, 4=5.34%, 10=10.42%, 20=11.85%, 50=37.76% lat (msec) : 100=14.19%, 250=1.56% cpu : usr=0.11%, sys=7.82%, ctx=1355, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144225: Tue Jul 14 13:26:59 2026 read: IOPS=16, BW=263KiB/s (269kB/s)(5744KiB/21859msec) clat (usec): min=27, max=189146, avg=29407.57, stdev=25448.60 lat (usec): min=27, max=189147, avg=29408.86, stdev=25448.74 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 60], 20.00th=[ 78], | 30.00th=[ 15401], 40.00th=[ 21627], 50.00th=[ 27657], 60.00th=[ 33817], | 70.00th=[ 40109], 80.00th=[ 49021], 90.00th=[ 62129], 95.00th=[ 72877], | 99.00th=[107480], 99.50th=[137364], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 29, max= 478, per=24.30%, avg=263.86, stdev=93.79, samples=43 iops : min= 1, max= 29, avg=15.79, stdev= 5.86, samples=43 write: IOPS=18, BW=299KiB/s (307kB/s)(6544KiB/21859msec); 0 zone resets clat (usec): min=1549, max=175933, avg=26897.45, stdev=29850.83 lat (usec): min=1552, max=175933, avg=26899.53, stdev=29850.76 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1876], 10.00th=[ 2180], 20.00th=[ 3916], | 30.00th=[ 5735], 40.00th=[ 9503], 50.00th=[ 15795], 60.00th=[ 24511], | 70.00th=[ 34341], 80.00th=[ 46400], 90.00th=[ 66323], 95.00th=[ 84411], | 99.00th=[127402], 99.50th=[158335], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 93, max= 570, per=26.24%, avg=299.95, stdev=102.98, samples=43 iops : min= 5, max= 35, avg=18.07, stdev= 6.45, samples=43 lat (usec) : 50=2.21%, 100=8.98%, 250=0.39%, 500=0.26% lat (msec) : 2=4.56%, 4=7.16%, 10=11.46%, 20=10.29%, 50=35.55% lat (msec) : 100=17.06%, 250=2.08% cpu : usr=0.09%, sys=7.01%, ctx=1420, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144227: Tue Jul 14 13:26:59 2026 read: IOPS=17, BW=284KiB/s (291kB/s)(6256KiB/22037msec) clat (usec): min=37, max=164521, avg=29378.00, stdev=25664.59 lat (usec): min=37, max=164522, avg=29379.60, stdev=25664.63 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 49], 10.00th=[ 57], 20.00th=[ 69], | 30.00th=[ 14877], 40.00th=[ 22676], 50.00th=[ 28181], 60.00th=[ 33424], | 70.00th=[ 40109], 80.00th=[ 47449], 90.00th=[ 61604], 95.00th=[ 76022], | 99.00th=[103285], 99.50th=[116917], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 59, max= 480, per=26.35%, avg=286.12, stdev=86.45, samples=43 iops : min= 3, max= 30, avg=17.19, stdev= 5.43, samples=43 write: IOPS=17, BW=274KiB/s (280kB/s)(6032KiB/22037msec); 0 zone resets clat (usec): min=1481, max=165074, avg=27183.55, stdev=26775.20 lat (usec): min=1500, max=165077, avg=27188.85, stdev=26772.98 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1909], 10.00th=[ 2769], 20.00th=[ 4555], | 30.00th=[ 6980], 40.00th=[ 11076], 50.00th=[ 19268], 60.00th=[ 26608], | 70.00th=[ 34866], 80.00th=[ 47449], 90.00th=[ 66323], 95.00th=[ 79168], | 99.00th=[111674], 99.50th=[139461], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 64, max= 443, per=23.72%, avg=271.07, stdev=104.23, samples=43 iops : min= 4, max= 27, avg=16.26, stdev= 6.52, samples=43 lat (usec) : 50=2.60%, 100=10.03%, 250=0.52%, 500=0.39%, 1000=0.13% lat (msec) : 2=3.52%, 4=5.21%, 10=10.16%, 20=11.33%, 50=38.54% lat (msec) : 100=16.28%, 250=1.30% cpu : usr=0.10%, sys=7.17%, ctx=1430, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144229: Tue Jul 14 13:26:59 2026 read: IOPS=17, BW=280KiB/s (287kB/s)(6032KiB/21553msec) clat (usec): min=32, max=154611, avg=28912.49, stdev=24528.52 lat (usec): min=32, max=154613, avg=28913.66, stdev=24528.52 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 69], | 30.00th=[ 16909], 40.00th=[ 21627], 50.00th=[ 27657], 60.00th=[ 32113], | 70.00th=[ 38011], 80.00th=[ 50594], 90.00th=[ 61080], 95.00th=[ 70779], | 99.00th=[ 99091], 99.50th=[122160], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 125, max= 479, per=25.47%, avg=276.60, stdev=94.65, samples=42 iops : min= 7, max= 29, avg=16.60, stdev= 5.96, samples=42 write: IOPS=18, BW=290KiB/s (297kB/s)(6256KiB/21553msec); 0 zone resets clat (usec): min=1002, max=290536, avg=27049.98, stdev=32158.32 lat (usec): min=1005, max=290538, avg=27052.04, stdev=32158.32 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1778], 10.00th=[ 2180], 20.00th=[ 3982], | 30.00th=[ 6325], 40.00th=[ 9634], 50.00th=[ 14484], 60.00th=[ 22938], | 70.00th=[ 34341], 80.00th=[ 46400], 90.00th=[ 64226], 95.00th=[ 86508], | 99.00th=[143655], 99.50th=[210764], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 127, max= 509, per=25.17%, avg=287.74, stdev=81.80, samples=42 iops : min= 7, max= 31, avg=17.29, stdev= 5.11, samples=42 lat (usec) : 50=2.21%, 100=9.38%, 250=0.78%, 500=0.13%, 750=0.26% lat (msec) : 2=4.69%, 4=5.99%, 10=10.42%, 20=13.15%, 50=33.72% lat (msec) : 100=17.06%, 250=2.08%, 500=0.13% cpu : usr=0.10%, sys=7.28%, ctx=1368, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1087KiB/s (1113kB/s), 263KiB/s-288KiB/s (269kB/s-295kB/s), io=23.4MiB (24.5MB), run=20535-22037msec WRITE: bw=1144KiB/s (1171kB/s), 274KiB/s-310KiB/s (280kB/s-318kB/s), io=24.6MiB (25.8MB), run=20535-22037msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144226: Tue Jul 14 13:27:36 2026 read: IOPS=6, BW=98.8KiB/s (101kB/s)(5920KiB/59935msec) clat (msec): min=6, max=275, avg=31.77, stdev=29.94 lat (msec): min=6, max=275, avg=31.78, stdev=29.94 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 64], 95.00th=[ 88], | 99.00th=[ 148], 99.50th=[ 211], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 381, per=26.48%, avg=105.66, stdev=63.61, samples=108 iops : min= 1, max= 23, avg= 5.88, stdev= 4.03, samples=108 write: IOPS=6, BW=106KiB/s (109kB/s)(6368KiB/59935msec); 0 zone resets clat (msec): min=29, max=282, avg=120.38, stdev=45.45 lat (msec): min=29, max=282, avg=120.38, stdev=45.45 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 103], 50.00th=[ 111], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 157], 90.00th=[ 182], 95.00th=[ 209], | 99.00th=[ 253], 99.50th=[ 279], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 29, max= 192, per=24.95%, avg=104.78, stdev=36.46, samples=118 iops : min= 1, max= 12, avg= 5.81, stdev= 2.40, samples=118 lat (msec) : 10=3.12%, 20=18.75%, 50=19.66%, 100=24.48%, 250=33.20% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=1.55%, ctx=1327, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144228: Tue Jul 14 13:27:36 2026 read: IOPS=6, BW=96.4KiB/s (98.7kB/s)(5744KiB/59576msec) clat (msec): min=6, max=140, avg=30.84, stdev=24.69 lat (msec): min=6, max=140, avg=30.84, stdev=24.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 63], 95.00th=[ 91], | 99.00th=[ 122], 99.50th=[ 136], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 29, max= 412, per=26.83%, avg=107.06, stdev=70.57, samples=106 iops : min= 1, max= 25, avg= 5.96, stdev= 4.49, samples=106 write: IOPS=6, BW=110KiB/s (112kB/s)(6544KiB/59576msec); 0 zone resets clat (msec): min=38, max=406, avg=117.81, stdev=48.35 lat (msec): min=38, max=406, avg=117.81, stdev=48.35 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 157], 90.00th=[ 180], 95.00th=[ 205], | 99.00th=[ 257], 99.50th=[ 300], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 223, per=26.27%, avg=110.32, stdev=40.68, samples=117 iops : min= 1, max= 13, avg= 6.16, stdev= 2.63, samples=117 lat (msec) : 10=2.34%, 20=17.71%, 50=20.44%, 100=26.82%, 250=31.90% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.68%, ctx=1369, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144230: Tue Jul 14 13:27:36 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6256KiB/57733msec) clat (msec): min=6, max=189, avg=29.38, stdev=23.10 lat (msec): min=6, max=189, avg=29.38, stdev=23.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 55], 95.00th=[ 77], | 99.00th=[ 116], 99.50th=[ 169], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 30, max= 319, per=28.15%, avg=112.31, stdev=68.27, samples=110 iops : min= 1, max= 19, avg= 6.30, stdev= 4.33, samples=110 write: IOPS=6, BW=104KiB/s (107kB/s)(6032KiB/57733msec); 0 zone resets clat (msec): min=42, max=409, avg=121.81, stdev=47.83 lat (msec): min=42, max=409, avg=121.82, stdev=47.83 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 83], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 140], 80.00th=[ 155], 90.00th=[ 180], 95.00th=[ 209], | 99.00th=[ 284], 99.50th=[ 321], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 28, max= 223, per=24.77%, avg=104.03, stdev=39.26, samples=114 iops : min= 1, max= 13, avg= 5.76, stdev= 2.52, samples=114 lat (msec) : 10=2.86%, 20=19.14%, 50=23.31%, 100=23.05%, 250=30.86% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.60%, ctx=1374, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144231: Tue Jul 14 13:27:36 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(6032KiB/59514msec) clat (msec): min=7, max=172, avg=32.31, stdev=27.03 lat (msec): min=7, max=172, avg=32.31, stdev=27.03 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 70], 95.00th=[ 92], | 99.00th=[ 148], 99.50th=[ 157], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 30, max= 287, per=26.65%, avg=106.35, stdev=62.21, samples=110 iops : min= 1, max= 17, avg= 5.93, stdev= 3.91, samples=110 write: IOPS=6, BW=105KiB/s (108kB/s)(6256KiB/59514msec); 0 zone resets clat (msec): min=45, max=271, avg=120.56, stdev=43.41 lat (msec): min=45, max=271, avg=120.56, stdev=43.41 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 114], 60.00th=[ 125], | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 182], 95.00th=[ 205], | 99.00th=[ 259], 99.50th=[ 268], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 30, max= 192, per=24.89%, avg=104.52, stdev=36.21, samples=117 iops : min= 1, max= 12, avg= 5.80, stdev= 2.35, samples=117 lat (msec) : 10=3.26%, 20=15.76%, 50=22.53%, 100=24.09%, 250=33.85% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.56%, ctx=1340, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=400KiB/s (409kB/s), 96.4KiB/s-108KiB/s (98.7kB/s-111kB/s), io=23.4MiB (24.5MB), run=57733-59935msec WRITE: bw=420KiB/s (431kB/s), 104KiB/s-110KiB/s (107kB/s-112kB/s), io=24.6MiB (25.8MB), run=57733-59935msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144250: Tue Jul 14 13:27:52 2026 read: IOPS=1, BW=1460KiB/s (1496kB/s)(7168KiB/4908msec) clat (usec): min=528, max=3089.2k, avg=545059.28, stdev=1130285.38 lat (usec): min=529, max=3089.2k, avg=545060.85, stdev=1130285.37 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], | 20.00th=[ 562], 30.00th=[ 701], 40.00th=[ 701], | 50.00th=[ 166724], 60.00th=[ 181404], 70.00th=[ 181404], | 80.00th=[ 375391], 90.00th=[3103785], 95.00th=[3103785], | 99.00th=[3103785], 99.50th=[3103785], 99.90th=[3103785], | 99.95th=[3103785], 99.99th=[3103785] bw ( KiB/s): min= 1432, max= 6107, per=88.30%, avg=3195.67, stdev=2540.03, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1043KiB/s (1068kB/s)(5120KiB/4908msec); 0 zone resets clat (msec): min=97, max=286, avg=160.20, stdev=73.20 lat (msec): min=97, max=286, avg=160.27, stdev=73.22 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 2035, max= 3923, per=58.80%, avg=2979.00, stdev=1335.02, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=25.00% lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.62%, ctx=333, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144252: Tue Jul 14 13:27:52 2026 read: IOPS=0, BW=362KiB/s (371kB/s)(2048KiB/5659msec) clat (msec): min=174, max=197, avg=186.00, stdev=16.36 lat (msec): min=174, max=197, avg=186.00, stdev=16.36 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1436, max= 2035, per=47.96%, avg=1735.50, stdev=423.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1810KiB/s (1853kB/s)(10.0MiB/5659msec); 0 zone resets clat (msec): min=100, max=1973, avg=497.59, stdev=569.83 lat (msec): min=100, max=1973, avg=500.22, stdev=570.46 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 112], | 30.00th=[ 150], 40.00th=[ 186], 50.00th=[ 205], 60.00th=[ 355], | 70.00th=[ 472], 80.00th=[ 617], 90.00th=[ 810], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 2003, max= 6107, per=64.11%, avg=3248.00, stdev=1823.87, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=8.70%, ctx=117, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144253: Tue Jul 14 13:27:52 2026 read: IOPS=1, BW=1213KiB/s (1242kB/s)(6144KiB/5066msec) clat (usec): min=424, max=291850, avg=161097.71, stdev=130329.33 lat (usec): min=426, max=291851, avg=161099.06, stdev=130329.19 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 2606], | 30.00th=[ 2606], 40.00th=[166724], 50.00th=[166724], 60.00th=[252707], | 70.00th=[252707], 80.00th=[252707], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 4055, max= 4096, per=100.00%, avg=4075.50, stdev=28.99, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1213KiB/s (1242kB/s)(6144KiB/5066msec); 0 zone resets clat (msec): min=209, max=1969, avg=673.21, stdev=684.47 lat (msec): min=210, max=1969, avg=673.29, stdev=684.44 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 380], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 1961, max= 2868, per=43.72%, avg=2214.75, stdev=436.35, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=50.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=7.54%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144254: Tue Jul 14 13:27:52 2026 read: IOPS=1, BW=1073KiB/s (1099kB/s)(5120KiB/4770msec) clat (usec): min=340, max=245333, avg=102565.83, stdev=119672.89 lat (usec): min=340, max=245334, avg=102566.92, stdev=119672.99 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 343], 10.00th=[ 343], 20.00th=[ 343], | 30.00th=[ 474], 40.00th=[ 474], 50.00th=[ 49021], 60.00th=[ 49021], | 70.00th=[217056], 80.00th=[217056], 90.00th=[244319], 95.00th=[244319], | 99.00th=[244319], 99.50th=[244319], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 2048, max= 6083, per=100.00%, avg=4065.50, stdev=2853.18, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1503KiB/s (1539kB/s)(7168KiB/4770msec); 0 zone resets clat (msec): min=218, max=1789, avg=570.03, stdev=574.67 lat (msec): min=218, max=1789, avg=570.14, stdev=574.63 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 305], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 793], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1432, max= 4007, per=53.08%, avg=2689.00, stdev=1191.48, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (usec) : 500=16.67% lat (msec) : 50=8.33%, 250=33.33%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.79%, ctx=129, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3619KiB/s (3706kB/s), 362KiB/s-1460KiB/s (371kB/s-1496kB/s), io=20.0MiB (20.0MB), run=4770-5659msec WRITE: bw=5067KiB/s (5188kB/s), 1043KiB/s-1810KiB/s (1068kB/s-1853kB/s), io=28.0MiB (29.4MB), run=4770-5659msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144255: Tue Jul 14 13:27:52 2026 read: IOPS=2, BW=2247KiB/s (2301kB/s)(7168KiB/3190msec) clat (msec): min=93, max=360, avg=160.97, stdev=91.32 lat (msec): min=93, max=360, avg=160.97, stdev=91.32 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 117], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 122], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 176], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2011, max= 4087, per=85.90%, avg=3003.75, stdev=1137.77, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1605KiB/s (1644kB/s)(5120KiB/3190msec); 0 zone resets clat (msec): min=151, max=989, avg=395.49, stdev=351.42 lat (msec): min=152, max=989, avg=395.67, stdev=351.36 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1935, max= 4063, per=54.53%, avg=2669.67, stdev=1207.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=2.60%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144256: Tue Jul 14 13:27:52 2026 read: IOPS=0, BW=350KiB/s (358kB/s)(2048KiB/5856msec) clat (msec): min=65, max=501, avg=283.31, stdev=308.27 lat (msec): min=65, max=501, avg=283.31, stdev=308.27 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 66], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1368, max= 2015, per=48.37%, avg=1691.50, stdev=457.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1749KiB/s (1791kB/s)(10.0MiB/5856msec); 0 zone resets clat (msec): min=103, max=1872, avg=509.45, stdev=550.84 lat (msec): min=103, max=1872, avg=509.55, stdev=550.84 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 146], | 30.00th=[ 186], 40.00th=[ 199], 50.00th=[ 226], 60.00th=[ 271], | 70.00th=[ 405], 80.00th=[ 818], 90.00th=[ 877], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1946, max= 6095, per=74.19%, avg=3632.40, stdev=2226.51, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.28%, ctx=75, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144257: Tue Jul 14 13:27:52 2026 read: IOPS=1, BW=1087KiB/s (1113kB/s)(6144KiB/5651msec) clat (msec): min=76, max=477, avg=221.32, stdev=150.56 lat (msec): min=76, max=477, avg=221.32, stdev=150.56 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 218], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2023, max= 4063, per=72.67%, avg=2541.25, stdev=1014.55, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1087KiB/s (1113kB/s)(6144KiB/5651msec); 0 zone resets clat (msec): min=168, max=1989, avg=691.25, stdev=692.68 lat (msec): min=168, max=1989, avg=692.73, stdev=691.71 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 600], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 2023, max= 4096, per=52.07%, avg=2549.50, stdev=1031.05, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.73%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144258: Tue Jul 14 13:27:52 2026 read: IOPS=0, BW=947KiB/s (970kB/s)(5120KiB/5406msec) clat (msec): min=77, max=333, avg=165.66, stdev=99.97 lat (msec): min=77, max=333, avg=165.66, stdev=99.97 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 4063, max= 4063, per=100.00%, avg=4063.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1326KiB/s (1358kB/s)(7168KiB/5406msec); 0 zone resets clat (msec): min=136, max=1940, avg=619.75, stdev=638.63 lat (msec): min=137, max=1940, avg=619.95, stdev=638.83 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 178], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 355], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 885], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1946, max= 4096, per=49.61%, avg=2428.80, stdev=932.82, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=3.22%, ctx=76, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3497KiB/s (3581kB/s), 350KiB/s-2247KiB/s (358kB/s-2301kB/s), io=20.0MiB (20.0MB), run=3190-5856msec WRITE: bw=4896KiB/s (5014kB/s), 1087KiB/s-1749KiB/s (1113kB/s-1791kB/s), io=28.0MiB (29.4MB), run=3190-5856msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144267: Tue Jul 14 13:28:06 2026 read: IOPS=1, BW=4763KiB/s (4877kB/s)(12.0MiB/2580msec) clat (msec): min=773, max=852, avg=824.59, stdev=44.32 lat (msec): min=773, max=852, avg=824.59, stdev=44.32 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=16.25%, ctx=514, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144269: Tue Jul 14 13:28:06 2026 read: IOPS=0, BW=1250KiB/s (1280kB/s)(4096KiB/3277msec) clat (nsec): min=944638k, max=944638k, avg=944637859.00, stdev= 0.00 lat (nsec): min=944640k, max=944640k, avg=944640254.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2500KiB/s (2560kB/s)(8192KiB/3277msec); 0 zone resets clat (msec): min=926, max=1339, avg=1133.08, stdev=292.07 lat (msec): min=927, max=1340, avg=1133.67, stdev=291.94 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8192, max= 8192, per=84.51%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.94%, ctx=190, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144271: Tue Jul 14 13:28:06 2026 write: IOPS=0, BW=3636KiB/s (3723kB/s)(12.0MiB/3380msec); 0 zone resets clat (msec): min=920, max=1483, avg=1108.70, stdev=324.85 lat (msec): min=921, max=1484, avg=1109.10, stdev=324.77 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8126, max= 8192, per=84.17%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.65%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144272: Tue Jul 14 13:28:06 2026 write: IOPS=0, BW=3692KiB/s (3781kB/s)(12.0MiB/3328msec); 0 zone resets clat (msec): min=337, max=1650, avg=1071.02, stdev=669.97 lat (msec): min=337, max=1654, avg=1072.53, stdev=671.37 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8126, max= 8143, per=83.91%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.05%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5000KiB/s (5120kB/s), 1250KiB/s-4763KiB/s (1280kB/s-4877kB/s), io=16.0MiB (16.8MB), run=2580-3277msec WRITE: bw=9695KiB/s (9927kB/s), 2500KiB/s-3692KiB/s (2560kB/s-3781kB/s), io=32.0MiB (33.6MB), run=3277-3380msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144265: Tue Jul 14 13:28:07 2026 read: IOPS=0, BW=3439KiB/s (3522kB/s)(12.0MiB/3573msec) clat (msec): min=705, max=1599, avg=1118.74, stdev=450.96 lat (msec): min=705, max=1599, avg=1118.75, stdev=450.96 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.60%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144266: Tue Jul 14 13:28:07 2026 read: IOPS=0, BW=1002KiB/s (1027kB/s)(4096KiB/4086msec) clat (nsec): min=1751.3M, max=1751.3M, avg=1751260422.00, stdev= 0.00 lat (nsec): min=1751.3M, max=1751.3M, avg=1751263147.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1754], 5.00th=[ 1754], 10.00th=[ 1754], 20.00th=[ 1754], | 30.00th=[ 1754], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2005KiB/s (2053kB/s)(8192KiB/4086msec); 0 zone resets clat (msec): min=396, max=1759, avg=1077.78, stdev=963.87 lat (msec): min=396, max=1759, avg=1078.21, stdev=963.64 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.18%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144268: Tue Jul 14 13:28:07 2026 write: IOPS=1, BW=6350KiB/s (6503kB/s)(12.0MiB/1935msec); 0 zone resets clat (msec): min=234, max=1195, avg=625.54, stdev=505.02 lat (msec): min=235, max=1196, avg=626.03, stdev=504.93 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7787, max= 8192, per=99.63%, avg=7989.50, stdev=286.38, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.38%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144270: Tue Jul 14 13:28:07 2026 write: IOPS=1, BW=5238KiB/s (5364kB/s)(12.0MiB/2346msec); 0 zone resets clat (msec): min=339, max=1567, avg=755.88, stdev=702.71 lat (msec): min=339, max=1567, avg=756.46, stdev=702.78 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7599, max= 8192, per=98.46%, avg=7895.50, stdev=419.31, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.09%, sys=4.52%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4010KiB/s (4106kB/s), 1002KiB/s-3439KiB/s (1027kB/s-3522kB/s), io=16.0MiB (16.8MB), run=3573-4086msec WRITE: bw=8020KiB/s (8212kB/s), 2005KiB/s-6350KiB/s (2053kB/s-6503kB/s), io=32.0MiB (33.6MB), run=1935-4086msec