== sanity test 398b: DIO and buffer IO race ============== 11:23:29 (1772468609) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.51577 s, 14.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146088: Mon Mar 2 11:24:56 2026 read: IOPS=20, BW=80.0KiB/s (82.9kB/s)(5992KiB/73997msec) clat (usec): min=84, max=444758, avg=24549.50, stdev=21447.57 lat (usec): min=85, max=444760, avg=24550.66, stdev=21447.67 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 186], 10.00th=[ 6783], 20.00th=[ 11863], | 30.00th=[ 15008], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 23725], | 70.00th=[ 29230], 80.00th=[ 35390], 90.00th=[ 44827], 95.00th=[ 56886], | 99.00th=[ 92799], 99.50th=[103285], 99.90th=[248513], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 28, max= 159, per=25.57%, avg=80.80, stdev=26.17, samples=146 iops : min= 7, max= 39, avg=19.66, stdev= 6.56, samples=146 write: IOPS=21, BW=85.1KiB/s (87.1kB/s)(6296KiB/73997msec); 0 zone resets clat (usec): min=670, max=296450, avg=23598.82, stdev=25384.58 lat (usec): min=670, max=296452, avg=23600.10, stdev=25384.55 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 1123], 10.00th=[ 1385], 20.00th=[ 2442], | 30.00th=[ 4948], 40.00th=[ 11600], 50.00th=[ 17695], 60.00th=[ 23200], | 70.00th=[ 30278], 80.00th=[ 40109], 90.00th=[ 55837], 95.00th=[ 67634], | 99.00th=[108528], 99.50th=[135267], 99.90th=[229639], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 11, max= 160, per=25.71%, avg=84.86, stdev=31.32, samples=146 iops : min= 2, max= 40, avg=20.68, stdev= 7.86, samples=146 lat (usec) : 100=0.07%, 250=3.09%, 500=0.75%, 750=0.23%, 1000=0.81% lat (msec) : 2=8.17%, 4=5.47%, 10=7.98%, 20=25.33%, 50=38.02% lat (msec) : 100=9.21%, 250=0.81%, 500=0.07% cpu : usr=0.10%, sys=8.53%, ctx=6734, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146089: Mon Mar 2 11:24:56 2026 read: IOPS=19, BW=78.6KiB/s (80.5kB/s)(5940KiB/75598msec) clat (usec): min=64, max=532604, avg=25279.38, stdev=22515.63 lat (usec): min=64, max=532605, avg=25280.70, stdev=22515.58 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 180], 10.00th=[ 6652], 20.00th=[ 12125], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 20841], 60.00th=[ 25035], | 70.00th=[ 31065], 80.00th=[ 37487], 90.00th=[ 46924], 95.00th=[ 58459], | 99.00th=[ 80217], 99.50th=[ 91751], 99.90th=[263193], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 5, max= 159, per=24.65%, avg=77.90, stdev=26.83, samples=149 iops : min= 1, max= 39, avg=18.94, stdev= 6.73, samples=149 write: IOPS=20, BW=83.0KiB/s (85.0kB/s)(6348KiB/75598msec); 0 zone resets clat (usec): min=632, max=230542, avg=23915.43, stdev=25460.48 lat (usec): min=633, max=230544, avg=23917.50, stdev=25460.92 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 1123], 10.00th=[ 1369], 20.00th=[ 2540], | 30.00th=[ 4948], 40.00th=[ 10814], 50.00th=[ 17171], 60.00th=[ 23725], | 70.00th=[ 31589], 80.00th=[ 40633], 90.00th=[ 55313], 95.00th=[ 73925], | 99.00th=[111674], 99.50th=[135267], 99.90th=[200279], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 5, max= 173, per=25.11%, avg=82.87, stdev=29.29, samples=149 iops : min= 1, max= 43, avg=20.19, stdev= 7.33, samples=149 lat (usec) : 100=0.13%, 250=2.99%, 500=0.68%, 750=0.29%, 1000=0.81% lat (msec) : 2=8.01%, 4=5.24%, 10=8.89%, 20=24.09%, 50=38.48% lat (msec) : 100=9.41%, 250=0.91%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=8.26%, ctx=6758, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146090: Mon Mar 2 11:24:56 2026 read: IOPS=20, BW=80.9KiB/s (82.9kB/s)(6028KiB/74502msec) clat (usec): min=96, max=153886, avg=24092.18, stdev=16842.31 lat (usec): min=97, max=153887, avg=24093.80, stdev=16842.92 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 196], 10.00th=[ 5669], 20.00th=[ 11994], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 20841], 60.00th=[ 25035], | 70.00th=[ 29492], 80.00th=[ 34866], 90.00th=[ 45351], 95.00th=[ 56886], | 99.00th=[ 78119], 99.50th=[ 88605], 99.90th=[120062], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 23, max= 148, per=25.70%, avg=81.23, stdev=27.51, samples=146 iops : min= 5, max= 37, avg=19.77, stdev= 6.91, samples=146 write: IOPS=21, BW=84.0KiB/s (86.0kB/s)(6260KiB/74502msec); 0 zone resets clat (usec): min=658, max=558104, avg=24343.36, stdev=28704.17 lat (usec): min=659, max=558106, avg=24346.94, stdev=28703.08 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 1139], 10.00th=[ 1352], 20.00th=[ 2540], | 30.00th=[ 5276], 40.00th=[ 11207], 50.00th=[ 16909], 60.00th=[ 23462], | 70.00th=[ 31327], 80.00th=[ 41157], 90.00th=[ 56886], 95.00th=[ 70779], | 99.00th=[107480], 99.50th=[133694], 99.90th=[217056], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 11, max= 168, per=25.32%, avg=83.56, stdev=29.66, samples=147 iops : min= 2, max= 42, avg=20.35, stdev= 7.47, samples=147 lat (usec) : 100=0.03%, 250=3.29%, 500=0.94%, 750=0.23%, 1000=0.98% lat (msec) : 2=7.36%, 4=5.57%, 10=8.14%, 20=24.97%, 50=38.22% lat (msec) : 100=9.44%, 250=0.81%, 750=0.03% cpu : usr=0.09%, sys=8.42%, ctx=6843, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146091: Mon Mar 2 11:24:56 2026 read: IOPS=19, BW=79.7KiB/s (81.6kB/s)(6052KiB/75982msec) clat (usec): min=96, max=186756, avg=24213.43, stdev=19224.69 lat (usec): min=97, max=186757, avg=24214.52, stdev=19225.02 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 169], 10.00th=[ 537], 20.00th=[ 11338], | 30.00th=[ 14222], 40.00th=[ 17171], 50.00th=[ 20579], 60.00th=[ 24773], | 70.00th=[ 29754], 80.00th=[ 36439], 90.00th=[ 45876], 95.00th=[ 53740], | 99.00th=[ 82314], 99.50th=[125305], 99.90th=[185598], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 16, max= 151, per=25.12%, avg=79.38, stdev=25.79, samples=149 iops : min= 4, max= 37, avg=19.30, stdev= 6.46, samples=149 write: IOPS=20, BW=82.1KiB/s (84.0kB/s)(6236KiB/75982msec); 0 zone resets clat (usec): min=729, max=533790, avg=25171.26, stdev=27671.42 lat (usec): min=730, max=533793, avg=25174.90, stdev=27671.32 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1188], 10.00th=[ 1565], 20.00th=[ 2802], | 30.00th=[ 5735], 40.00th=[ 12780], 50.00th=[ 19530], 60.00th=[ 25822], | 70.00th=[ 32637], 80.00th=[ 42730], 90.00th=[ 57934], 95.00th=[ 69731], | 99.00th=[110625], 99.50th=[125305], 99.90th=[196084], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 16, max= 152, per=24.67%, avg=81.43, stdev=27.79, samples=150 iops : min= 4, max= 38, avg=19.83, stdev= 6.96, samples=150 lat (usec) : 100=0.03%, 250=3.84%, 500=1.01%, 750=0.46%, 1000=0.75% lat (msec) : 2=7.03%, 4=5.89%, 10=7.49%, 20=23.01%, 50=39.68% lat (msec) : 100=9.86%, 250=0.91%, 750=0.03% cpu : usr=0.11%, sys=8.32%, ctx=6810, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=316KiB/s (324kB/s), 78.6KiB/s-80.0KiB/s (80.5kB/s-82.9kB/s), io=23.4MiB (24.6MB), run=73997-75982msec WRITE: bw=331KiB/s (339kB/s), 82.1KiB/s-85.1KiB/s (84.0kB/s-87.1kB/s), io=24.6MiB (25.7MB), run=73997-75982msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146083: Mon Mar 2 11:25:58 2026 read: IOPS=10, BW=43.5KiB/s (44.5kB/s)(5992KiB/137853msec) clat (msec): min=3, max=536, avg=21.09, stdev=25.33 lat (msec): min=3, max=536, avg=21.10, stdev=25.32 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 48], 95.00th=[ 65], | 99.00th=[ 95], 99.50th=[ 130], 99.90th=[ 228], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 7, max= 160, per=25.51%, avg=44.38, stdev=30.46, samples=266 iops : min= 1, max= 40, avg=10.59, stdev= 7.70, samples=266 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6296KiB/137853msec); 0 zone resets clat (msec): min=16, max=324, avg=67.35, stdev=39.51 lat (msec): min=16, max=324, avg=67.35, stdev=39.51 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 75], 80.00th=[ 95], 90.00th=[ 123], 95.00th=[ 146], | 99.00th=[ 211], 99.50th=[ 236], 99.90th=[ 284], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 96, per=24.92%, avg=45.36, stdev=23.84, samples=273 iops : min= 1, max= 24, avg=10.84, stdev= 6.07, samples=273 lat (msec) : 4=0.16%, 10=18.65%, 20=14.45%, 50=33.89%, 100=23.01% lat (msec) : 250=9.67%, 500=0.13%, 750=0.03% cpu : usr=0.06%, sys=2.26%, ctx=5598, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146084: Mon Mar 2 11:25:58 2026 read: IOPS=10, BW=43.1KiB/s (44.1kB/s)(5940KiB/137948msec) clat (msec): min=3, max=635, avg=20.62, stdev=27.44 lat (msec): min=3, max=635, avg=20.62, stdev=27.44 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 43], 95.00th=[ 62], | 99.00th=[ 120], 99.50th=[ 140], 99.90th=[ 245], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 128, per=25.62%, avg=44.58, stdev=28.54, samples=262 iops : min= 1, max= 32, avg=10.65, stdev= 7.24, samples=262 write: IOPS=11, BW=46.0KiB/s (47.1kB/s)(6348KiB/137948msec); 0 zone resets clat (msec): min=18, max=456, avg=67.48, stdev=39.97 lat (msec): min=18, max=456, avg=67.48, stdev=39.97 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 95], 90.00th=[ 124], 95.00th=[ 148], | 99.00th=[ 205], 99.50th=[ 239], 99.90th=[ 300], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 104, per=25.23%, avg=45.91, stdev=24.15, samples=272 iops : min= 1, max= 26, avg=10.97, stdev= 6.14, samples=272 lat (msec) : 4=0.10%, 10=19.21%, 20=13.87%, 50=34.38%, 100=22.36% lat (msec) : 250=9.90%, 500=0.16%, 750=0.03% cpu : usr=0.05%, sys=2.32%, ctx=5599, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146085: Mon Mar 2 11:25:58 2026 read: IOPS=10, BW=43.7KiB/s (44.7kB/s)(6028KiB/137950msec) clat (msec): min=3, max=435, avg=21.35, stdev=22.75 lat (msec): min=3, max=435, avg=21.35, stdev=22.75 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 45], 95.00th=[ 61], | 99.00th=[ 104], 99.50th=[ 122], 99.90th=[ 247], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 175, per=25.43%, avg=44.24, stdev=28.75, samples=268 iops : min= 1, max= 43, avg=10.56, stdev= 7.25, samples=268 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6260KiB/137950msec); 0 zone resets clat (msec): min=16, max=637, avg=67.43, stdev=40.69 lat (msec): min=16, max=637, avg=67.44, stdev=40.69 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 55], 60.00th=[ 63], | 70.00th=[ 75], 80.00th=[ 96], 90.00th=[ 122], 95.00th=[ 142], | 99.00th=[ 194], 99.50th=[ 220], 99.90th=[ 347], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 96, per=24.85%, avg=45.23, stdev=23.51, samples=272 iops : min= 1, max= 24, avg=10.80, stdev= 5.99, samples=272 lat (msec) : 4=0.23%, 10=17.25%, 20=13.61%, 50=36.17%, 100=22.88% lat (msec) : 250=9.70%, 500=0.13%, 750=0.03% cpu : usr=0.05%, sys=2.38%, ctx=5677, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146086: Mon Mar 2 11:25:58 2026 read: IOPS=11, BW=44.4KiB/s (45.4kB/s)(6052KiB/136387msec) clat (msec): min=3, max=436, avg=20.42, stdev=24.51 lat (msec): min=3, max=436, avg=20.43, stdev=24.51 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 45], 95.00th=[ 64], | 99.00th=[ 115], 99.50th=[ 140], 99.90th=[ 226], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 176, per=26.23%, avg=45.64, stdev=30.10, samples=261 iops : min= 1, max= 44, avg=10.91, stdev= 7.60, samples=261 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6236KiB/136387msec); 0 zone resets clat (msec): min=18, max=636, avg=67.51, stdev=41.78 lat (msec): min=18, max=636, avg=67.51, stdev=41.78 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 97], 90.00th=[ 122], 95.00th=[ 146], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 338], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 112, per=25.03%, avg=45.56, stdev=23.83, samples=269 iops : min= 1, max= 28, avg=10.88, stdev= 6.08, samples=269 lat (msec) : 4=0.10%, 10=20.05%, 20=14.36%, 50=33.27%, 100=22.10% lat (msec) : 250=9.93%, 500=0.16%, 750=0.03% cpu : usr=0.06%, sys=2.23%, ctx=5502, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.1KiB/s-44.4KiB/s (44.1kB/s-45.4kB/s), io=23.4MiB (24.6MB), run=136387-137950msec WRITE: bw=182KiB/s (187kB/s), 45.4KiB/s-46.0KiB/s (46.5kB/s-47.1kB/s), io=24.6MiB (25.7MB), run=136387-137950msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146127: Mon Mar 2 11:26:16 2026 read: IOPS=27, BW=433KiB/s (443kB/s)(5920KiB/13682msec) clat (usec): min=70, max=117244, avg=18325.71, stdev=14722.35 lat (usec): min=70, max=117245, avg=18326.56, stdev=14722.42 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 172], 10.00th=[ 281], 20.00th=[ 6259], | 30.00th=[ 11207], 40.00th=[ 13698], 50.00th=[ 16188], 60.00th=[ 19268], | 70.00th=[ 22676], 80.00th=[ 27395], 90.00th=[ 36439], 95.00th=[ 46400], | 99.00th=[ 64750], 99.50th=[ 78119], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 287, max= 667, per=24.82%, avg=434.41, stdev=114.03, samples=27 iops : min= 17, max= 41, avg=26.44, stdev= 7.23, samples=27 write: IOPS=29, BW=465KiB/s (477kB/s)(6368KiB/13682msec); 0 zone resets clat (usec): min=1212, max=140117, avg=17253.90, stdev=18564.95 lat (usec): min=1213, max=140117, avg=17255.63, stdev=18564.82 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1778], 10.00th=[ 2245], 20.00th=[ 3064], | 30.00th=[ 4555], 40.00th=[ 7701], 50.00th=[ 11600], 60.00th=[ 16057], | 70.00th=[ 21890], 80.00th=[ 27657], 90.00th=[ 37487], 95.00th=[ 47973], | 99.00th=[103285], 99.50th=[135267], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 160, max= 734, per=25.34%, avg=466.44, stdev=123.07, samples=27 iops : min= 10, max= 45, avg=28.48, stdev= 7.66, samples=27 lat (usec) : 100=0.26%, 250=3.52%, 500=4.17%, 750=0.26% lat (msec) : 2=4.69%, 4=9.64%, 10=13.67%, 20=28.78%, 50=31.25% lat (msec) : 100=3.12%, 250=0.65% cpu : usr=0.09%, sys=15.68%, ctx=1851, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146128: Mon Mar 2 11:26:16 2026 read: IOPS=27, BW=435KiB/s (446kB/s)(5744KiB/13193msec) clat (usec): min=110, max=80368, avg=18586.05, stdev=12912.78 lat (usec): min=111, max=80368, avg=18587.00, stdev=12912.81 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 210], 10.00th=[ 400], 20.00th=[ 8979], | 30.00th=[11863], 40.00th=[15008], 50.00th=[17433], 60.00th=[20579], | 70.00th=[23200], 80.00th=[26870], 90.00th=[33817], 95.00th=[45351], | 99.00th=[57410], 99.50th=[61080], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 167, max= 606, per=24.87%, avg=435.23, stdev=110.84, samples=26 iops : min= 10, max= 37, avg=26.50, stdev= 6.98, samples=26 write: IOPS=31, BW=496KiB/s (508kB/s)(6544KiB/13193msec); 0 zone resets clat (usec): min=1169, max=107937, avg=15651.74, stdev=15214.38 lat (usec): min=1170, max=107939, avg=15660.87, stdev=15227.59 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2114], 10.00th=[ 2671], 20.00th=[ 3687], | 30.00th=[ 4621], 40.00th=[ 6521], 50.00th=[ 10159], 60.00th=[ 14746], | 70.00th=[ 20579], 80.00th=[ 26608], 90.00th=[ 36963], 95.00th=[ 43779], | 99.00th=[ 67634], 99.50th=[ 79168], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 287, max= 796, per=26.98%, avg=496.69, stdev=136.56, samples=26 iops : min= 17, max= 49, avg=30.35, stdev= 8.63, samples=26 lat (usec) : 250=2.34%, 500=3.26%, 750=0.52%, 1000=0.39% lat (msec) : 2=1.82%, 4=11.46%, 10=17.58%, 20=26.69%, 50=33.07% lat (msec) : 100=2.73%, 250=0.13% cpu : usr=0.14%, sys=16.76%, ctx=1853, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146129: Mon Mar 2 11:26:16 2026 read: IOPS=29, BW=468KiB/s (479kB/s)(6256KiB/13379msec) clat (usec): min=68, max=112003, avg=18407.71, stdev=14743.22 lat (usec): min=68, max=112004, avg=18408.89, stdev=14743.30 clat percentiles (usec): | 1.00th=[ 116], 5.00th=[ 159], 10.00th=[ 258], 20.00th=[ 2573], | 30.00th=[ 11207], 40.00th=[ 14353], 50.00th=[ 16909], 60.00th=[ 20055], | 70.00th=[ 23725], 80.00th=[ 27395], 90.00th=[ 36439], 95.00th=[ 40633], | 99.00th=[ 71828], 99.50th=[ 87557], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 195, max= 853, per=27.16%, avg=475.27, stdev=129.31, samples=26 iops : min= 12, max= 53, avg=29.04, stdev= 8.08, samples=26 write: IOPS=28, BW=451KiB/s (462kB/s)(6032KiB/13379msec); 0 zone resets clat (usec): min=1341, max=122048, avg=16093.18, stdev=16022.73 lat (usec): min=1344, max=122049, avg=16094.74, stdev=16022.78 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1926], 10.00th=[ 2507], 20.00th=[ 3884], | 30.00th=[ 5604], 40.00th=[ 7767], 50.00th=[ 10290], 60.00th=[ 15008], | 70.00th=[ 18744], 80.00th=[ 25297], 90.00th=[ 36439], 95.00th=[ 46924], | 99.00th=[ 80217], 99.50th=[ 92799], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 223, max= 666, per=24.54%, avg=451.85, stdev=116.17, samples=26 iops : min= 13, max= 41, avg=27.54, stdev= 7.30, samples=26 lat (usec) : 100=0.39%, 250=4.56%, 500=2.47%, 750=1.30%, 1000=0.65% lat (msec) : 2=3.52%, 4=7.68%, 10=16.02%, 20=29.17%, 50=31.38% lat (msec) : 100=2.60%, 250=0.26% cpu : usr=0.12%, sys=16.37%, ctx=1874, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146131: Mon Mar 2 11:26:16 2026 read: IOPS=28, BW=458KiB/s (469kB/s)(6032KiB/13174msec) clat (usec): min=87, max=77836, avg=17918.12, stdev=13708.12 lat (usec): min=87, max=77836, avg=17919.98, stdev=13708.30 clat percentiles (usec): | 1.00th=[ 123], 5.00th=[ 163], 10.00th=[ 247], 20.00th=[ 1270], | 30.00th=[10945], 40.00th=[14484], 50.00th=[17433], 60.00th=[20317], | 70.00th=[23200], 80.00th=[28443], 90.00th=[34866], 95.00th=[41681], | 99.00th=[60031], 99.50th=[69731], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 112, max= 734, per=26.15%, avg=457.65, stdev=137.05, samples=26 iops : min= 7, max= 45, avg=27.92, stdev= 8.55, samples=26 write: IOPS=29, BW=475KiB/s (486kB/s)(6256KiB/13174msec); 0 zone resets clat (usec): min=1118, max=115214, avg=16070.65, stdev=17201.69 lat (usec): min=1118, max=115216, avg=16076.98, stdev=17204.01 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1762], 10.00th=[ 2147], 20.00th=[ 3458], | 30.00th=[ 4752], 40.00th=[ 6915], 50.00th=[ 10159], 60.00th=[ 14484], | 70.00th=[ 20317], 80.00th=[ 27132], 90.00th=[ 35390], 95.00th=[ 45876], | 99.00th=[ 89654], 99.50th=[110625], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 112, max= 727, per=25.99%, avg=478.46, stdev=148.53, samples=26 iops : min= 7, max= 45, avg=29.23, stdev= 9.25, samples=26 lat (usec) : 100=0.13%, 250=4.82%, 500=3.39%, 750=0.91%, 1000=0.52% lat (msec) : 2=4.95%, 4=8.46%, 10=15.89%, 20=25.52%, 50=32.03% lat (msec) : 100=2.99%, 250=0.39% cpu : usr=0.08%, sys=15.99%, ctx=1835, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1751KiB/s (1793kB/s), 433KiB/s-468KiB/s (443kB/s-479kB/s), io=23.4MiB (24.5MB), run=13174-13682msec WRITE: bw=1842KiB/s (1886kB/s), 451KiB/s-496KiB/s (462kB/s-508kB/s), io=24.6MiB (25.8MB), run=13174-13682msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146130: Mon Mar 2 11:26:35 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(5920KiB/31229msec) clat (msec): min=4, max=146, avg=19.06, stdev=19.58 lat (msec): min=4, max=146, avg=19.06, stdev=19.58 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 25], 90.00th=[ 43], 95.00th=[ 63], | 99.00th=[ 95], 99.50th=[ 142], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 31, max= 447, per=25.15%, avg=189.61, stdev=87.13, samples=62 iops : min= 1, max= 27, avg=11.24, stdev= 5.42, samples=62 write: IOPS=12, BW=204KiB/s (209kB/s)(6368KiB/31229msec); 0 zone resets clat (msec): min=27, max=213, avg=60.38, stdev=22.91 lat (msec): min=27, max=213, avg=60.38, stdev=22.91 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 35], 10.00th=[ 38], 20.00th=[ 43], | 30.00th=[ 47], 40.00th=[ 51], 50.00th=[ 56], 60.00th=[ 61], | 70.00th=[ 66], 80.00th=[ 75], 90.00th=[ 91], 95.00th=[ 107], | 99.00th=[ 140], 99.50th=[ 161], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 352, per=25.69%, avg=203.71, stdev=74.40, samples=62 iops : min= 1, max= 22, avg=12.13, stdev= 4.66, samples=62 lat (msec) : 10=18.10%, 20=17.71%, 50=28.39%, 100=32.16%, 250=3.65% cpu : usr=0.04%, sys=3.11%, ctx=1483, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146132: Mon Mar 2 11:26:35 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(5744KiB/31744msec) clat (msec): min=4, max=211, avg=17.14, stdev=18.97 lat (msec): min=4, max=211, avg=17.14, stdev=18.97 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 20], 90.00th=[ 36], 95.00th=[ 52], | 99.00th=[ 96], 99.50th=[ 99], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 28, max= 447, per=24.43%, avg=184.23, stdev=105.45, samples=62 iops : min= 1, max= 27, avg=10.92, stdev= 6.64, samples=62 write: IOPS=12, BW=206KiB/s (211kB/s)(6544KiB/31744msec); 0 zone resets clat (msec): min=21, max=218, avg=62.15, stdev=24.83 lat (msec): min=21, max=218, avg=62.16, stdev=24.83 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 37], 20.00th=[ 43], | 30.00th=[ 47], 40.00th=[ 52], 50.00th=[ 58], 60.00th=[ 64], | 70.00th=[ 70], 80.00th=[ 78], 90.00th=[ 92], 95.00th=[ 108], | 99.00th=[ 142], 99.50th=[ 165], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 85, max= 384, per=25.91%, avg=205.49, stdev=70.21, samples=63 iops : min= 5, max= 24, avg=12.25, stdev= 4.40, samples=63 lat (msec) : 10=20.31%, 20=17.45%, 50=25.52%, 100=33.07%, 250=3.65% cpu : usr=0.10%, sys=3.03%, ctx=1470, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146133: Mon Mar 2 11:26:35 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30153msec) clat (msec): min=3, max=162, avg=17.37, stdev=17.96 lat (msec): min=3, max=162, avg=17.38, stdev=17.96 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 52], | 99.00th=[ 91], 99.50th=[ 134], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 31, max= 510, per=27.80%, avg=209.63, stdev=118.38, samples=59 iops : min= 1, max= 31, avg=12.51, stdev= 7.43, samples=59 write: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30153msec); 0 zone resets clat (msec): min=23, max=196, avg=61.79, stdev=23.60 lat (msec): min=23, max=196, avg=61.79, stdev=23.60 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 39], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 53], 50.00th=[ 57], 60.00th=[ 64], | 70.00th=[ 70], 80.00th=[ 77], 90.00th=[ 95], 95.00th=[ 105], | 99.00th=[ 133], 99.50th=[ 163], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 63, max= 320, per=25.07%, avg=198.83, stdev=65.48, samples=59 iops : min= 3, max= 20, avg=11.83, stdev= 4.09, samples=59 lat (msec) : 4=0.13%, 10=20.18%, 20=19.53%, 50=24.87%, 100=31.77% lat (msec) : 250=3.52% cpu : usr=0.06%, sys=3.08%, ctx=1439, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146134: Mon Mar 2 11:26:35 2026 read: IOPS=12, BW=194KiB/s (198kB/s)(6032KiB/31134msec) clat (msec): min=4, max=139, avg=18.27, stdev=18.75 lat (msec): min=4, max=139, avg=18.27, stdev=18.75 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 40], 95.00th=[ 57], | 99.00th=[ 96], 99.50th=[ 136], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 63, max= 447, per=25.94%, avg=195.57, stdev=91.54, samples=60 iops : min= 3, max= 27, avg=11.63, stdev= 5.73, samples=60 write: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31134msec); 0 zone resets clat (msec): min=24, max=193, avg=61.68, stdev=23.26 lat (msec): min=24, max=193, avg=61.69, stdev=23.25 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 53], 50.00th=[ 58], 60.00th=[ 64], | 70.00th=[ 69], 80.00th=[ 78], 90.00th=[ 91], 95.00th=[ 105], | 99.00th=[ 140], 99.50th=[ 180], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 63, max= 351, per=25.37%, avg=201.21, stdev=69.86, samples=61 iops : min= 3, max= 21, avg=11.98, stdev= 4.32, samples=61 lat (msec) : 10=19.14%, 20=18.75%, 50=26.04%, 100=32.94%, 250=3.12% cpu : usr=0.07%, sys=3.16%, ctx=1462, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=755KiB/s (773kB/s), 181KiB/s-207KiB/s (185kB/s-212kB/s), io=23.4MiB (24.5MB), run=30153-31744msec WRITE: bw=794KiB/s (813kB/s), 200KiB/s-206KiB/s (205kB/s-211kB/s), io=24.6MiB (25.8MB), run=30153-31744msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146145: Mon Mar 2 11:26:43 2026 read: IOPS=3, BW=3177KiB/s (3254kB/s)(7168KiB/2256msec) clat (usec): min=1091, max=195290, avg=141073.22, stdev=67147.85 lat (usec): min=1092, max=195291, avg=141074.71, stdev=67147.79 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1090], 10.00th=[ 1090], 20.00th=[129500], | 30.00th=[141558], 40.00th=[141558], 50.00th=[143655], 60.00th=[185598], | 70.00th=[185598], 80.00th=[189793], 90.00th=[196084], 95.00th=[196084], | 99.00th=[196084], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 2035, max= 5785, per=70.44%, avg=3963.67, stdev=1877.30, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2270KiB/s (2324kB/s)(5120KiB/2256msec); 0 zone resets clat (msec): min=134, max=433, avg=243.45, stdev=116.63 lat (msec): min=134, max=433, avg=243.54, stdev=116.64 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2035, max= 4071, per=34.46%, avg=2715.00, stdev=1174.33, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.00%, sys=30.38%, ctx=387, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146146: Mon Mar 2 11:26:43 2026 read: IOPS=0, BW=563KiB/s (576kB/s)(2048KiB/3639msec) clat (usec): min=727, max=154465, avg=77596.92, stdev=108709.26 lat (usec): min=729, max=154467, avg=77598.65, stdev=108709.61 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 725], 10.00th=[ 725], 20.00th=[ 725], | 30.00th=[ 725], 40.00th=[ 725], 50.00th=[ 725], 60.00th=[154141], | 70.00th=[154141], 80.00th=[154141], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 1882, max= 2015, per=34.63%, avg=1948.50, stdev=94.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2814KiB/s (2881kB/s)(10.0MiB/3639msec); 0 zone resets clat (msec): min=97, max=693, avg=344.18, stdev=209.26 lat (msec): min=97, max=693, avg=344.26, stdev=209.26 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 109], | 30.00th=[ 184], 40.00th=[ 218], 50.00th=[ 232], 60.00th=[ 342], | 70.00th=[ 464], 80.00th=[ 531], 90.00th=[ 575], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2011, max= 6119, per=46.39%, avg=3655.00, stdev=1711.69, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.03%, sys=19.05%, ctx=183, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146147: Mon Mar 2 11:26:43 2026 read: IOPS=1, BW=1996KiB/s (2044kB/s)(6144KiB/3078msec) clat (msec): min=3, max=415, avg=213.61, stdev=138.93 lat (msec): min=3, max=415, avg=213.62, stdev=138.93 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 213], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2015, max= 4071, per=45.14%, avg=2540.00, stdev=1020.72, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1996KiB/s (2044kB/s)(6144KiB/3078msec); 0 zone resets clat (msec): min=106, max=540, avg=295.19, stdev=182.86 lat (msec): min=106, max=540, avg=295.28, stdev=182.87 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 257], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2015, max= 3716, per=31.11%, avg=2451.25, stdev=843.23, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 4=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.06%, sys=17.26%, ctx=228, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146148: Mon Mar 2 11:26:43 2026 read: IOPS=1, BW=1848KiB/s (1893kB/s)(5120KiB/2770msec) clat (usec): min=1061, max=286689, avg=192900.20, stdev=113494.45 lat (usec): min=1061, max=286690, avg=192901.31, stdev=113494.78 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1057], 10.00th=[ 1057], 20.00th=[ 1057], | 30.00th=[202376], 40.00th=[202376], 50.00th=[206570], 60.00th=[206570], | 70.00th=[267387], 80.00th=[267387], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 4031, max= 4071, per=71.99%, avg=4051.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2588KiB/s (2650kB/s)(7168KiB/2770msec); 0 zone resets clat (msec): min=65, max=480, avg=249.99, stdev=162.93 lat (msec): min=65, max=480, avg=250.06, stdev=162.92 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 81], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 414], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1858, max= 6047, per=44.48%, avg=3504.75, stdev=1971.86, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 2=8.33%, 100=16.67%, 250=33.33%, 500=41.67% cpu : usr=0.00%, sys=24.38%, ctx=448, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5628KiB/s (5763kB/s), 563KiB/s-3177KiB/s (576kB/s-3254kB/s), io=20.0MiB (20.0MB), run=2256-3639msec WRITE: bw=7879KiB/s (8068kB/s), 1996KiB/s-2814KiB/s (2044kB/s-2881kB/s), io=28.0MiB (29.4MB), run=2256-3639msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146150: Mon Mar 2 11:26:44 2026 read: IOPS=2, BW=2402KiB/s (2460kB/s)(7168KiB/2984msec) clat (msec): min=48, max=531, avg=184.85, stdev=165.80 lat (msec): min=48, max=531, avg=184.85, stdev=165.80 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 79], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 138], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 251], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1648, max= 4087, per=61.23%, avg=3274.00, stdev=1408.16, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1716KiB/s (1757kB/s)(5120KiB/2984msec); 0 zone resets clat (msec): min=109, max=604, avg=324.78, stdev=183.16 lat (msec): min=109, max=604, avg=324.84, stdev=183.16 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2043, max= 4087, per=40.94%, avg=3065.00, stdev=1445.33, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=9.42%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146151: Mon Mar 2 11:26:44 2026 read: IOPS=0, BW=539KiB/s (552kB/s)(2048KiB/3798msec) clat (msec): min=111, max=437, avg=274.57, stdev=230.52 lat (msec): min=111, max=437, avg=274.57, stdev=230.52 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1656, max= 2043, per=34.59%, avg=1849.50, stdev=273.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2696KiB/s (2761kB/s)(10.0MiB/3798msec); 0 zone resets clat (msec): min=109, max=525, avg=318.54, stdev=128.24 lat (msec): min=109, max=526, avg=318.74, stdev=128.44 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 169], | 30.00th=[ 226], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 313], | 70.00th=[ 372], 80.00th=[ 401], 90.00th=[ 460], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1980, max= 4087, per=36.04%, avg=2698.00, stdev=1042.85, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=58.33%, 750=8.33% cpu : usr=0.03%, sys=8.32%, ctx=97, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146152: Mon Mar 2 11:26:44 2026 read: IOPS=1, BW=1727KiB/s (1768kB/s)(6144KiB/3558msec) clat (msec): min=76, max=207, avg=132.37, stdev=53.22 lat (msec): min=76, max=207, avg=132.38, stdev=53.22 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 138], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 2035, max= 4087, per=62.86%, avg=3361.00, stdev=1150.08, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1727KiB/s (1768kB/s)(6144KiB/3558msec); 0 zone resets clat (msec): min=210, max=636, avg=434.06, stdev=170.19 lat (msec): min=211, max=636, avg=434.15, stdev=170.17 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 481], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1980, max= 4087, per=33.88%, avg=2536.25, stdev=1034.21, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=7.51%, ctx=271, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146153: Mon Mar 2 11:26:44 2026 read: IOPS=1, BW=1337KiB/s (1369kB/s)(5120KiB/3830msec) clat (msec): min=44, max=367, avg=143.58, stdev=132.80 lat (msec): min=44, max=367, avg=143.58, stdev=132.80 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 81], 60.00th=[ 81], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2035, max= 6000, per=75.14%, avg=4017.50, stdev=2803.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1872KiB/s (1916kB/s)(7168KiB/3830msec); 0 zone resets clat (msec): min=117, max=822, avg=439.27, stdev=307.83 lat (msec): min=117, max=822, avg=439.36, stdev=307.81 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 128], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 506], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 743], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1980, max= 2043, per=26.99%, avg=2020.20, stdev=28.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=8.33%, 750=25.00% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=5.22%, ctx=75, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5347KiB/s (5476kB/s), 539KiB/s-2402KiB/s (552kB/s-2460kB/s), io=20.0MiB (20.0MB), run=2984-3830msec WRITE: bw=7486KiB/s (7666kB/s), 1716KiB/s-2696KiB/s (1757kB/s-2761kB/s), io=28.0MiB (29.4MB), run=2984-3830msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146158: Mon Mar 2 11:26:52 2026 read: IOPS=1, BW=6872KiB/s (7037kB/s)(12.0MiB/1788msec) clat (msec): min=521, max=656, avg=574.63, stdev=71.90 lat (msec): min=521, max=656, avg=574.63, stdev=71.90 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 5505, max= 8143, per=95.51%, avg=6824.00, stdev=1865.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=22.27%, ctx=913, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146159: Mon Mar 2 11:26:52 2026 read: IOPS=0, BW=1786KiB/s (1829kB/s)(4096KiB/2293msec) clat (nsec): min=681924k, max=681924k, avg=681924194.00, stdev= 0.00 lat (nsec): min=681926k, max=681926k, avg=681926235.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5542, max= 5542, per=77.56%, avg=5542.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3573KiB/s (3658kB/s)(8192KiB/2293msec); 0 zone resets clat (msec): min=416, max=1161, avg=788.96, stdev=526.52 lat (msec): min=416, max=1161, avg=789.19, stdev=526.42 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8159, max= 8159, per=57.10%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.42%, ctx=347, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146160: Mon Mar 2 11:26:52 2026 write: IOPS=1, BW=7887KiB/s (8076kB/s)(12.0MiB/1558msec); 0 zone resets clat (msec): min=210, max=1081, avg=512.06, stdev=493.05 lat (msec): min=211, max=1081, avg=512.33, stdev=493.02 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min=15603, max=15603, per=100.00%, avg=15603.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.80%, ctx=63, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146161: Mon Mar 2 11:26:52 2026 write: IOPS=1, BW=7030KiB/s (7198kB/s)(12.0MiB/1748msec); 0 zone resets clat (msec): min=306, max=935, avg=569.60, stdev=326.82 lat (msec): min=314, max=935, avg=572.66, stdev=323.56 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 5483, max= 8143, per=47.68%, avg=6813.00, stdev=1880.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.10%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7145KiB/s (7317kB/s), 1786KiB/s-6872KiB/s (1829kB/s-7037kB/s), io=16.0MiB (16.8MB), run=1788-2293msec WRITE: bw=13.0MiB/s (14.6MB/s), 3573KiB/s-7887KiB/s (3658kB/s-8076kB/s), io=32.0MiB (33.6MB), run=1558-2293msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146163: Mon Mar 2 11:26:52 2026 read: IOPS=1, BW=5911KiB/s (6052kB/s)(12.0MiB/2079msec) clat (msec): min=550, max=915, avg=682.05, stdev=202.87 lat (msec): min=550, max=915, avg=682.05, stdev=202.87 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 5893, max= 8159, per=93.88%, avg=7026.00, stdev=1602.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.02%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146164: Mon Mar 2 11:26:52 2026 read: IOPS=0, BW=1871KiB/s (1916kB/s)(4096KiB/2189msec) clat (nsec): min=748456k, max=748456k, avg=748456033.00, stdev= 0.00 lat (nsec): min=748459k, max=748459k, avg=748458503.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3742KiB/s (3832kB/s)(8192KiB/2189msec); 0 zone resets clat (msec): min=342, max=1013, avg=677.81, stdev=474.24 lat (msec): min=342, max=1013, avg=678.23, stdev=474.30 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8175, max= 8175, per=55.46%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.67%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146165: Mon Mar 2 11:26:52 2026 write: IOPS=1, BW=5528KiB/s (5660kB/s)(12.0MiB/2223msec); 0 zone resets clat (msec): min=222, max=1539, avg=696.15, stdev=732.50 lat (msec): min=223, max=1541, avg=696.89, stdev=733.20 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8143, max= 8175, per=55.35%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.61%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146166: Mon Mar 2 11:26:52 2026 write: IOPS=1, BW=6628KiB/s (6787kB/s)(12.0MiB/1854msec); 0 zone resets clat (msec): min=245, max=1049, avg=584.66, stdev=416.69 lat (msec): min=245, max=1050, avg=585.01, stdev=416.77 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 6400, max= 8143, per=49.33%, avg=7271.50, stdev=1232.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.26%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7485KiB/s (7664kB/s), 1871KiB/s-5911KiB/s (1916kB/s-6052kB/s), io=16.0MiB (16.8MB), run=2079-2189msec WRITE: bw=14.4MiB/s (15.1MB/s), 3742KiB/s-6628KiB/s (3832kB/s-6787kB/s), io=32.0MiB (33.6MB), run=1854-2223msec