== sanity test 398b: DIO and buffer IO race ============== 17:56:08 (1788645368) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.60596 s, 10.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179691: Sat Sep 5 17:58:24 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(5992KiB/118149msec) clat (usec): min=40, max=565433, avg=43883.92, stdev=31863.79 lat (usec): min=40, max=565435, avg=43891.07, stdev=31860.37 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11600], 10.00th=[ 15926], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 61604], 90.00th=[ 82314], 95.00th=[ 95945], | 99.00th=[145753], 99.50th=[166724], 99.90th=[278922], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 15, max= 119, per=25.36%, avg=50.47, stdev=21.35, samples=232 iops : min= 3, max= 29, avg=11.98, stdev= 5.40, samples=232 write: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6296KiB/118149msec); 0 zone resets clat (usec): min=752, max=250315, avg=33065.24, stdev=36634.34 lat (usec): min=754, max=250316, avg=33068.53, stdev=36633.16 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1139], 10.00th=[ 1237], 20.00th=[ 2507], | 30.00th=[ 5669], 40.00th=[ 13042], 50.00th=[ 21627], 60.00th=[ 31065], | 70.00th=[ 42206], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[109577], | 99.00th=[162530], 99.50th=[181404], 99.90th=[227541], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 7, max= 128, per=25.48%, avg=53.01, stdev=23.74, samples=232 iops : min= 1, max= 32, avg=12.62, stdev= 5.97, samples=232 lat (usec) : 50=0.16%, 100=1.27%, 250=0.03%, 500=0.03%, 1000=0.46% lat (msec) : 2=8.76%, 4=4.17%, 10=6.02%, 20=11.95%, 50=39.06% lat (msec) : 100=22.88%, 250=5.11%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.19%, ctx=6198, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Sat Sep 5 17:58:24 2026 read: IOPS=12, BW=49.9KiB/s (51.1kB/s)(5940KiB/119072msec) clat (usec): min=46, max=254829, avg=44534.56, stdev=30528.26 lat (usec): min=47, max=254830, avg=44537.52, stdev=30529.13 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10159], 10.00th=[ 15533], 20.00th=[ 21627], | 30.00th=[ 26870], 40.00th=[ 32113], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[149947], 99.50th=[173016], 99.90th=[244319], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 6, max= 111, per=24.95%, avg=49.66, stdev=19.70, samples=234 iops : min= 1, max= 27, avg=11.77, stdev= 4.94, samples=234 write: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6348KiB/119072msec); 0 zone resets clat (usec): min=710, max=574504, avg=33170.83, stdev=37717.10 lat (usec): min=711, max=574504, avg=33176.34, stdev=37717.35 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 2900], | 30.00th=[ 6128], 40.00th=[ 13304], 50.00th=[ 23462], 60.00th=[ 31851], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[160433], 99.50th=[187696], 99.90th=[233833], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 6, max= 132, per=25.63%, avg=53.32, stdev=24.23, samples=233 iops : min= 1, max= 33, avg=12.70, stdev= 6.09, samples=233 lat (usec) : 50=0.20%, 100=1.04%, 250=0.26%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=8.07%, 4=4.10%, 10=6.90%, 20=11.33%, 50=39.29% lat (msec) : 100=23.27%, 250=5.01%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.18%, ctx=6249, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179693: Sat Sep 5 17:58:24 2026 read: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6028KiB/120452msec) clat (usec): min=27, max=209960, avg=43031.45, stdev=29524.49 lat (usec): min=28, max=209962, avg=43033.37, stdev=29524.44 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10814], 10.00th=[ 14877], 20.00th=[ 21103], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[149947], 99.50th=[175113], 99.90th=[208667], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=49.77, stdev=20.97, samples=235 iops : min= 1, max= 27, avg=11.80, stdev= 5.27, samples=235 write: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6260KiB/120452msec); 0 zone resets clat (usec): min=746, max=558313, avg=35263.03, stdev=38293.63 lat (usec): min=748, max=558315, avg=35265.17, stdev=38293.58 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1156], 10.00th=[ 1270], 20.00th=[ 2933], | 30.00th=[ 7373], 40.00th=[ 16581], 50.00th=[ 25822], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 60031], 90.00th=[ 81265], 95.00th=[105382], | 99.00th=[160433], 99.50th=[175113], 99.90th=[258999], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 119, per=24.77%, avg=51.51, stdev=23.29, samples=235 iops : min= 1, max= 29, avg=12.24, stdev= 5.86, samples=235 lat (usec) : 50=0.33%, 100=1.40%, 250=0.16%, 750=0.03%, 1000=0.46% lat (msec) : 2=7.49%, 4=3.61%, 10=5.86%, 20=12.04%, 50=39.81% lat (msec) : 100=23.27%, 250=5.44%, 500=0.07%, 750=0.03% cpu : usr=0.06%, sys=5.02%, ctx=6334, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179694: Sat Sep 5 17:58:24 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6052KiB/119462msec) clat (usec): min=31, max=232797, avg=44039.62, stdev=30919.37 lat (usec): min=31, max=232799, avg=44043.29, stdev=30917.90 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 355], 10.00th=[ 15139], 20.00th=[ 21365], | 30.00th=[ 26084], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 62129], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[158335], 99.50th=[189793], 99.90th=[223347], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 103, per=25.52%, avg=50.79, stdev=19.86, samples=232 iops : min= 1, max= 25, avg=12.05, stdev= 4.99, samples=232 write: IOPS=13, BW=52.2KiB/s (53.5kB/s)(6236KiB/119462msec); 0 zone resets clat (usec): min=815, max=558516, avg=33643.06, stdev=38341.05 lat (usec): min=816, max=558519, avg=33645.70, stdev=38340.21 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1270], 20.00th=[ 2802], | 30.00th=[ 6456], 40.00th=[ 15926], 50.00th=[ 24773], 60.00th=[ 32375], | 70.00th=[ 42206], 80.00th=[ 57410], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[162530], 99.50th=[206570], 99.90th=[291505], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 142, per=25.03%, avg=52.06, stdev=23.53, samples=233 iops : min= 1, max= 35, avg=12.39, stdev= 5.92, samples=233 lat (usec) : 50=0.36%, 100=1.92%, 250=0.10%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=8.27%, 4=3.65%, 10=5.73%, 20=10.68%, 50=40.49% lat (msec) : 100=23.44%, 250=4.85%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.29%, ctx=6281, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=199KiB/s (204kB/s), 49.9KiB/s-50.7KiB/s (51.1kB/s-51.9kB/s), io=23.4MiB (24.6MB), run=118149-120452msec WRITE: bw=209KiB/s (214kB/s), 51.0KiB/s-53.3KiB/s (53.2kB/s-54.6kB/s), io=24.6MiB (25.7MB), run=118149-120452msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179686: Sat Sep 5 17:59:02 2026 read: IOPS=9, BW=37.0KiB/s (38.9kB/s)(5992KiB/157820msec) clat (msec): min=5, max=623, avg=41.66, stdev=43.36 lat (msec): min=5, max=623, avg=41.66, stdev=43.36 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 96], 95.00th=[ 127], | 99.00th=[ 215], 99.50th=[ 262], 99.90th=[ 317], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 167, per=25.36%, avg=38.55, stdev=26.96, samples=303 iops : min= 1, max= 41, avg= 8.96, stdev= 6.77, samples=303 write: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6296KiB/157820msec); 0 zone resets clat (msec): min=8, max=331, avg=60.38, stdev=45.41 lat (msec): min=8, max=331, avg=60.38, stdev=45.41 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 87], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 228], 99.50th=[ 275], 99.90th=[ 317], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 127, per=25.12%, avg=39.94, stdev=25.74, samples=307 iops : min= 1, max= 31, avg= 9.31, stdev= 6.49, samples=307 lat (msec) : 10=3.12%, 20=17.35%, 50=44.69%, 100=22.79%, 250=11.39% lat (msec) : 500=0.62%, 750=0.03% cpu : usr=0.06%, sys=1.72%, ctx=4648, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179687: Sat Sep 5 17:59:02 2026 read: IOPS=9, BW=37.9KiB/s (38.8kB/s)(5940KiB/156638msec) clat (msec): min=4, max=617, avg=40.90, stdev=41.03 lat (msec): min=4, max=617, avg=40.91, stdev=41.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 90], 95.00th=[ 120], | 99.00th=[ 197], 99.50th=[ 224], 99.90th=[ 284], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 175, per=25.30%, avg=38.45, stdev=27.34, samples=300 iops : min= 1, max= 43, avg= 8.95, stdev= 6.91, samples=300 write: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6348KiB/156638msec); 0 zone resets clat (msec): min=8, max=384, avg=60.18, stdev=45.50 lat (msec): min=8, max=384, avg=60.19, stdev=45.50 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 70], 80.00th=[ 92], 90.00th=[ 122], 95.00th=[ 148], | 99.00th=[ 241], 99.50th=[ 275], 99.90th=[ 355], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 135, per=25.46%, avg=40.49, stdev=25.97, samples=304 iops : min= 1, max= 33, avg= 9.45, stdev= 6.53, samples=304 lat (msec) : 10=3.29%, 20=16.67%, 50=46.00%, 100=21.84%, 250=11.69% lat (msec) : 500=0.49%, 750=0.03% cpu : usr=0.06%, sys=1.82%, ctx=4915, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179688: Sat Sep 5 17:59:02 2026 read: IOPS=9, BW=38.4KiB/s (39.4kB/s)(6028KiB/156779msec) clat (msec): min=4, max=261, avg=40.38, stdev=37.77 lat (msec): min=4, max=261, avg=40.39, stdev=37.77 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 59], 90.00th=[ 90], 95.00th=[ 121], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 255], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 119, per=25.18%, avg=38.27, stdev=25.67, samples=307 iops : min= 1, max= 29, avg= 8.90, stdev= 6.47, samples=307 write: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6260KiB/156779msec); 0 zone resets clat (msec): min=7, max=625, avg=61.04, stdev=46.99 lat (msec): min=7, max=625, avg=61.05, stdev=47.01 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 68], 80.00th=[ 88], 90.00th=[ 121], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 257], 99.90th=[ 384], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 127, per=24.85%, avg=39.52, stdev=25.64, samples=309 iops : min= 1, max= 31, avg= 9.20, stdev= 6.46, samples=309 lat (msec) : 10=2.96%, 20=17.51%, 50=43.23%, 100=24.54%, 250=11.43% lat (msec) : 500=0.29%, 750=0.03% cpu : usr=0.06%, sys=1.77%, ctx=4756, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179689: Sat Sep 5 17:59:02 2026 read: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6052KiB/157630msec) clat (msec): min=5, max=281, avg=41.08, stdev=38.19 lat (msec): min=5, max=281, avg=41.09, stdev=38.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 125], | 99.00th=[ 186], 99.50th=[ 226], 99.90th=[ 266], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 127, per=25.81%, avg=39.23, stdev=26.85, samples=300 iops : min= 1, max= 31, avg= 9.13, stdev= 6.75, samples=300 write: IOPS=9, BW=39.6KiB/s (40.5kB/s)(6236KiB/157630msec); 0 zone resets clat (msec): min=9, max=618, avg=61.00, stdev=46.12 lat (msec): min=9, max=618, avg=61.00, stdev=46.11 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 91], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 251], 99.90th=[ 317], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 127, per=24.86%, avg=39.53, stdev=25.23, samples=306 iops : min= 1, max= 31, avg= 9.21, stdev= 6.36, samples=306 lat (msec) : 10=3.45%, 20=16.34%, 50=44.66%, 100=23.31%, 250=11.88% lat (msec) : 500=0.33%, 750=0.03% cpu : usr=0.06%, sys=1.72%, ctx=4719, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=152KiB/s (156kB/s), 37.9KiB/s-38.4KiB/s (38.8kB/s-39.4kB/s), io=23.4MiB (24.6MB), run=156638-157820msec WRITE: bw=159KiB/s (163kB/s), 39.6KiB/s-40.5KiB/s (40.5kB/s-41.5kB/s), io=24.6MiB (25.7MB), run=156638-157820msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179739: Sat Sep 5 17:59:47 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5920KiB/34663msec) clat (usec): min=36, max=252344, avg=49650.39, stdev=36777.41 lat (usec): min=36, max=252345, avg=49652.43, stdev=36777.02 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 63], 10.00th=[ 12256], 20.00th=[ 24511], | 30.00th=[ 30016], 40.00th=[ 35914], 50.00th=[ 42730], 60.00th=[ 51643], | 70.00th=[ 59507], 80.00th=[ 68682], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[198181], 99.50th=[242222], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 62, max= 383, per=24.54%, avg=169.34, stdev=66.87, samples=68 iops : min= 3, max= 23, avg= 9.78, stdev= 4.20, samples=68 write: IOPS=11, BW=184KiB/s (188kB/s)(6368KiB/34663msec); 0 zone resets clat (usec): min=1279, max=171808, avg=40813.03, stdev=38134.40 lat (usec): min=1281, max=171810, avg=40815.37, stdev=38134.41 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1844], 10.00th=[ 2999], 20.00th=[ 6521], | 30.00th=[ 13173], 40.00th=[ 22152], 50.00th=[ 31065], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 65799], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[158335], 99.50th=[166724], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 478, per=25.18%, avg=182.81, stdev=80.46, samples=68 iops : min= 1, max= 29, avg=10.63, stdev= 5.08, samples=68 lat (usec) : 50=1.04%, 100=3.12%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=2.86%, 4=3.52%, 10=7.16%, 20=8.46%, 50=37.63% lat (msec) : 100=27.99%, 250=7.68%, 500=0.13% cpu : usr=0.10%, sys=5.52%, ctx=1740, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Sat Sep 5 17:59:47 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/34015msec) clat (usec): min=36, max=196993, avg=49386.31, stdev=33375.86 lat (usec): min=37, max=196994, avg=49399.33, stdev=33372.92 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 85], 10.00th=[ 16450], 20.00th=[ 25560], | 30.00th=[ 32375], 40.00th=[ 36963], 50.00th=[ 43779], 60.00th=[ 49546], | 70.00th=[ 56361], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[116917], | 99.00th=[185598], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 447, per=24.28%, avg=167.51, stdev=71.08, samples=67 iops : min= 1, max= 27, avg= 9.67, stdev= 4.46, samples=67 write: IOPS=12, BW=192KiB/s (197kB/s)(6544KiB/34015msec); 0 zone resets clat (usec): min=1157, max=174413, avg=39625.26, stdev=37704.92 lat (usec): min=1159, max=174416, avg=39627.46, stdev=37705.05 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2245], 10.00th=[ 3621], 20.00th=[ 6587], | 30.00th=[ 10814], 40.00th=[ 18220], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 51643], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[115868], | 99.00th=[152044], 99.50th=[173016], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 414, per=26.44%, avg=191.96, stdev=80.77, samples=67 iops : min= 1, max= 25, avg=11.21, stdev= 5.15, samples=67 lat (usec) : 50=0.26%, 100=2.21%, 250=0.39%, 1000=0.13% lat (msec) : 2=2.47%, 4=3.78%, 10=8.59%, 20=10.42%, 50=36.59% lat (msec) : 100=26.82%, 250=8.33% cpu : usr=0.10%, sys=5.42%, ctx=1729, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179741: Sat Sep 5 17:59:47 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6256KiB/33878msec) clat (usec): min=38, max=221991, avg=46697.81, stdev=32416.45 lat (usec): min=38, max=221993, avg=46699.05, stdev=32416.47 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 7701], 20.00th=[ 21627], | 30.00th=[ 28705], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 58459], 80.00th=[ 72877], 90.00th=[ 85459], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[202376], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 62, max= 478, per=26.75%, avg=184.57, stdev=78.97, samples=67 iops : min= 3, max= 29, avg=10.75, stdev= 4.97, samples=67 write: IOPS=11, BW=178KiB/s (182kB/s)(6032KiB/33878msec); 0 zone resets clat (usec): min=1459, max=188638, avg=41346.04, stdev=39927.11 lat (usec): min=1461, max=188640, avg=41348.44, stdev=39927.13 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2024], 10.00th=[ 3294], 20.00th=[ 6259], | 30.00th=[ 12387], 40.00th=[ 22414], 50.00th=[ 29230], 60.00th=[ 39584], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[100140], 95.00th=[124257], | 99.00th=[183501], 99.50th=[187696], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 351, per=24.82%, avg=180.17, stdev=70.68, samples=66 iops : min= 3, max= 21, avg=10.47, stdev= 4.43, samples=66 lat (usec) : 50=0.78%, 100=3.26%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.73%, 4=3.26%, 10=8.33%, 20=8.72%, 50=38.28% lat (msec) : 100=26.95%, 250=7.16% cpu : usr=0.09%, sys=5.49%, ctx=1733, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Sat Sep 5 17:59:47 2026 read: IOPS=11, BW=180KiB/s (185kB/s)(6032KiB/33442msec) clat (usec): min=40, max=189660, avg=50109.91, stdev=31607.83 lat (usec): min=40, max=189661, avg=50111.96, stdev=31608.26 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 1631], 20.00th=[ 26084], | 30.00th=[ 33162], 40.00th=[ 40633], 50.00th=[ 46400], 60.00th=[ 55313], | 70.00th=[ 64226], 80.00th=[ 73925], 90.00th=[ 90702], 95.00th=[104334], | 99.00th=[141558], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 377, per=26.08%, avg=179.92, stdev=74.35, samples=66 iops : min= 1, max= 23, avg=10.47, stdev= 4.64, samples=66 write: IOPS=11, BW=187KiB/s (192kB/s)(6256KiB/33442msec); 0 zone resets clat (usec): min=1468, max=215650, avg=37075.03, stdev=38287.82 lat (usec): min=1469, max=215652, avg=37088.32, stdev=38304.79 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1876], 10.00th=[ 2868], 20.00th=[ 5014], | 30.00th=[ 8455], 40.00th=[ 16581], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 45876], 80.00th=[ 64750], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[162530], 99.50th=[187696], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 62, max= 413, per=26.18%, avg=190.05, stdev=76.80, samples=65 iops : min= 3, max= 25, avg=11.09, stdev= 4.84, samples=65 lat (usec) : 50=0.39%, 100=3.78%, 250=0.39%, 500=0.26% lat (msec) : 2=3.12%, 4=5.73%, 10=7.94%, 20=7.55%, 50=34.90% lat (msec) : 100=28.39%, 250=7.55% cpu : usr=0.08%, sys=5.84%, ctx=1767, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=691KiB/s (708kB/s), 169KiB/s-185KiB/s (173kB/s-189kB/s), io=23.4MiB (24.5MB), run=33442-34663msec WRITE: bw=727KiB/s (744kB/s), 178KiB/s-192KiB/s (182kB/s-197kB/s), io=24.6MiB (25.8MB), run=33442-34663msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179734: Sat Sep 5 17:59:58 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5920KiB/45711msec) clat (msec): min=6, max=263, avg=46.25, stdev=38.86 lat (msec): min=6, max=263, avg=46.26, stdev=38.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 65], 90.00th=[ 109], 95.00th=[ 130], | 99.00th=[ 176], 99.50th=[ 213], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 444, per=25.44%, avg=132.52, stdev=88.54, samples=85 iops : min= 1, max= 27, avg= 7.46, stdev= 5.58, samples=85 write: IOPS=8, BW=139KiB/s (143kB/s)(6368KiB/45711msec); 0 zone resets clat (msec): min=14, max=302, avg=71.65, stdev=48.15 lat (msec): min=14, max=302, avg=71.65, stdev=48.15 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 49], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 107], 90.00th=[ 146], 95.00th=[ 174], | 99.00th=[ 226], 99.50th=[ 288], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 415, per=25.42%, avg=139.28, stdev=83.20, samples=88 iops : min= 1, max= 25, avg= 7.87, stdev= 5.24, samples=88 lat (msec) : 10=0.78%, 20=12.11%, 50=43.49%, 100=26.56%, 250=16.67% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.56%, ctx=1133, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179735: Sat Sep 5 17:59:58 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5744KiB/45697msec) clat (msec): min=6, max=294, avg=47.12, stdev=40.79 lat (msec): min=6, max=294, avg=47.12, stdev=40.79 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 107], 95.00th=[ 138], | 99.00th=[ 201], 99.50th=[ 213], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 415, per=25.31%, avg=131.88, stdev=85.29, samples=85 iops : min= 1, max= 25, avg= 7.42, stdev= 5.40, samples=85 write: IOPS=8, BW=143KiB/s (147kB/s)(6544KiB/45697msec); 0 zone resets clat (msec): min=9, max=254, avg=69.78, stdev=48.19 lat (msec): min=9, max=254, avg=69.78, stdev=48.19 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 66], | 70.00th=[ 80], 80.00th=[ 99], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 220], 99.50th=[ 234], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 533, per=26.00%, avg=142.47, stdev=88.82, samples=90 iops : min= 1, max= 33, avg= 8.11, stdev= 5.63, samples=90 lat (msec) : 10=1.56%, 20=11.20%, 50=45.31%, 100=26.56%, 250=14.97% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.77%, ctx=1155, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179737: Sat Sep 5 17:59:58 2026 read: IOPS=8, BW=137KiB/s (141kB/s)(6256KiB/45593msec) clat (msec): min=8, max=408, avg=46.87, stdev=43.30 lat (msec): min=8, max=408, avg=46.91, stdev=43.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 107], 95.00th=[ 133], | 99.00th=[ 192], 99.50th=[ 279], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 31, max= 440, per=26.61%, avg=138.63, stdev=99.88, samples=89 iops : min= 1, max= 27, avg= 7.88, stdev= 6.30, samples=89 write: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45593msec); 0 zone resets clat (msec): min=12, max=229, avg=71.62, stdev=46.43 lat (msec): min=12, max=229, avg=71.63, stdev=46.44 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 56], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 109], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 213], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 384, per=23.89%, avg=130.91, stdev=79.71, samples=90 iops : min= 1, max= 24, avg= 7.38, stdev= 5.06, samples=90 lat (msec) : 10=0.78%, 20=13.41%, 50=43.88%, 100=24.61%, 250=17.06% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.71%, ctx=1155, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179738: Sat Sep 5 17:59:58 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/45960msec) clat (msec): min=7, max=400, avg=47.21, stdev=44.34 lat (msec): min=7, max=400, avg=47.21, stdev=44.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 53], 80.00th=[ 69], 90.00th=[ 103], 95.00th=[ 138], | 99.00th=[ 203], 99.50th=[ 271], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 445, per=25.36%, avg=132.14, stdev=90.76, samples=86 iops : min= 1, max= 27, avg= 7.45, stdev= 5.76, samples=86 write: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/45960msec); 0 zone resets clat (msec): min=9, max=280, avg=71.39, stdev=52.06 lat (msec): min=9, max=280, avg=71.40, stdev=52.07 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 111], 90.00th=[ 146], 95.00th=[ 174], | 99.00th=[ 253], 99.50th=[ 264], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 376, per=24.05%, avg=131.79, stdev=82.97, samples=90 iops : min= 1, max= 23, avg= 7.44, stdev= 5.24, samples=90 lat (msec) : 10=1.95%, 20=12.76%, 50=43.23%, 100=25.26%, 250=15.89% lat (msec) : 500=0.91% cpu : usr=0.07%, sys=1.63%, ctx=1179, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=521KiB/s (534kB/s), 126KiB/s-137KiB/s (129kB/s-141kB/s), io=23.4MiB (24.5MB), run=45593-45960msec WRITE: bw=548KiB/s (561kB/s), 132KiB/s-143KiB/s (135kB/s-147kB/s), io=24.6MiB (25.8MB), run=45593-45960msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179758: Sat Sep 5 18:00:11 2026 read: IOPS=1, BW=1903KiB/s (1949kB/s)(7168KiB/3766msec) clat (msec): min=80, max=1186, avg=331.78, stdev=405.19 lat (msec): min=80, max=1186, avg=331.78, stdev=405.19 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 116], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 127], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 518], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1950, max= 5657, per=62.72%, avg=3210.00, stdev=2119.48, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1360KiB/s (1392kB/s)(5120KiB/3766msec); 0 zone resets clat (msec): min=75, max=540, avg=280.67, stdev=181.01 lat (msec): min=75, max=540, avg=280.78, stdev=181.03 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1414, max= 3900, per=32.44%, avg=2324.50, stdev=1085.39, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.03%, sys=3.45%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179759: Sat Sep 5 18:00:11 2026 read: IOPS=0, BW=646KiB/s (662kB/s)(2048KiB/3168msec) clat (msec): min=76, max=383, avg=230.04, stdev=216.89 lat (msec): min=76, max=383, avg=230.04, stdev=216.89 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1396, max= 1950, per=32.69%, avg=1673.00, stdev=391.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3232KiB/s (3310kB/s)(10.0MiB/3168msec); 0 zone resets clat (msec): min=93, max=610, avg=255.62, stdev=206.29 lat (msec): min=93, max=610, avg=255.82, stdev=206.19 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 125], 50.00th=[ 153], 60.00th=[ 155], | 70.00th=[ 197], 80.00th=[ 443], 90.00th=[ 584], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1950, max= 5587, per=43.50%, avg=3117.00, stdev=1642.56, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=3.95%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179760: Sat Sep 5 18:00:11 2026 read: IOPS=1, BW=1647KiB/s (1687kB/s)(6144KiB/3730msec) clat (msec): min=82, max=1015, avg=350.25, stdev=349.68 lat (msec): min=82, max=1015, avg=350.25, stdev=349.68 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 262], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1950, max= 2888, per=43.22%, avg=2211.75, stdev=452.96, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=1, BW=1647KiB/s (1687kB/s)(6144KiB/3730msec); 0 zone resets clat (msec): min=83, max=589, avg=248.08, stdev=199.41 lat (msec): min=83, max=589, avg=248.17, stdev=199.40 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 165], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1950, max= 4332, per=38.34%, avg=2747.67, stdev=1372.08, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.49%, ctx=64, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179761: Sat Sep 5 18:00:11 2026 read: IOPS=1, BW=1280KiB/s (1310kB/s)(5120KiB/4001msec) clat (msec): min=74, max=690, avg=306.00, stdev=247.97 lat (msec): min=74, max=690, avg=306.01, stdev=247.97 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 211], 60.00th=[ 211], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 3900, max= 4039, per=77.56%, avg=3969.50, stdev=98.29, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1792KiB/s (1835kB/s)(7168KiB/4001msec); 0 zone resets clat (msec): min=114, max=866, avg=345.41, stdev=338.43 lat (msec): min=114, max=866, avg=345.52, stdev=338.43 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 125], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 178], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 810], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2015, max= 6059, per=46.97%, avg=3365.67, stdev=2332.50, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=3.05%, ctx=61, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5119KiB/s (5242kB/s), 646KiB/s-1903KiB/s (662kB/s-1949kB/s), io=20.0MiB (20.0MB), run=3168-4001msec WRITE: bw=7166KiB/s (7338kB/s), 1360KiB/s-3232KiB/s (1392kB/s-3310kB/s), io=28.0MiB (29.4MB), run=3168-4001msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179763: Sat Sep 5 18:00:11 2026 read: IOPS=2, BW=2277KiB/s (2332kB/s)(7168KiB/3148msec) clat (usec): min=836, max=413429, avg=250100.40, stdev=138616.71 lat (usec): min=837, max=413431, avg=250101.65, stdev=138616.78 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 840], 10.00th=[ 840], 20.00th=[196084], | 30.00th=[212861], 40.00th=[212861], 50.00th=[235930], 60.00th=[299893], | 70.00th=[299893], 80.00th=[392168], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 1659, max= 4087, per=50.00%, avg=2906.50, stdev=1337.62, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1626KiB/s (1665kB/s)(5120KiB/3148msec); 0 zone resets clat (msec): min=160, max=364, avg=279.20, stdev=107.78 lat (msec): min=160, max=364, avg=279.27, stdev=107.78 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1841, max= 4039, per=32.32%, avg=2630.33, stdev=1222.90, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=12.84%, ctx=286, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179764: Sat Sep 5 18:00:11 2026 read: IOPS=0, BW=581KiB/s (595kB/s)(2048KiB/3523msec) clat (usec): min=843, max=256089, avg=128466.18, stdev=180486.27 lat (usec): min=844, max=256091, avg=128467.58, stdev=180486.79 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 840], 10.00th=[ 840], 20.00th=[ 840], | 30.00th=[ 840], 40.00th=[ 840], 50.00th=[ 840], 60.00th=[256902], | 70.00th=[256902], 80.00th=[256902], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 1497, max= 2019, per=30.24%, avg=1758.00, stdev=369.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2907KiB/s (2976kB/s)(10.0MiB/3523msec); 0 zone resets clat (msec): min=105, max=848, avg=326.12, stdev=247.65 lat (msec): min=105, max=848, avg=326.36, stdev=247.75 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 178], 50.00th=[ 199], 60.00th=[ 224], | 70.00th=[ 305], 80.00th=[ 464], 90.00th=[ 642], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 2043, max= 4039, per=38.91%, avg=3166.20, stdev=1035.15, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=15.47%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179765: Sat Sep 5 18:00:11 2026 read: IOPS=1, BW=1970KiB/s (2017kB/s)(6144KiB/3119msec) clat (usec): min=730, max=317699, avg=92642.31, stdev=129220.50 lat (usec): min=731, max=317701, avg=92643.79, stdev=129220.58 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 1336], | 30.00th=[ 1336], 40.00th=[ 2040], 50.00th=[ 2040], 60.00th=[ 59507], | 70.00th=[175113], 80.00th=[175113], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 1841, max= 8078, per=85.32%, avg=4959.50, stdev=4410.22, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1970KiB/s (2017kB/s)(6144KiB/3119msec); 0 zone resets clat (msec): min=261, max=557, avg=426.86, stdev=104.91 lat (msec): min=261, max=557, avg=426.94, stdev=104.91 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 460], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1651, max= 2043, per=23.51%, avg=1913.00, stdev=167.01, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=8.33%, 500=41.67% lat (msec) : 750=16.67% cpu : usr=0.00%, sys=12.48%, ctx=170, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179766: Sat Sep 5 18:00:11 2026 read: IOPS=1, BW=1554KiB/s (1591kB/s)(5120KiB/3295msec) clat (usec): min=524, max=379613, avg=186394.23, stdev=175839.24 lat (usec): min=525, max=379614, avg=186395.14, stdev=175838.94 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 1205], 40.00th=[ 1205], 50.00th=[246416], 60.00th=[246416], | 70.00th=[304088], 80.00th=[304088], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 1841, max= 4039, per=45.25%, avg=2630.33, stdev=1222.90, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2175KiB/s (2228kB/s)(7168KiB/3295msec); 0 zone resets clat (msec): min=175, max=617, avg=336.76, stdev=145.54 lat (msec): min=175, max=617, avg=336.84, stdev=145.51 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 224], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 355], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2043, max= 4087, per=41.59%, avg=3384.33, stdev=1162.07, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=13.24%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5813KiB/s (5953kB/s), 581KiB/s-2277KiB/s (595kB/s-2332kB/s), io=20.0MiB (20.0MB), run=3119-3523msec WRITE: bw=8139KiB/s (8334kB/s), 1626KiB/s-2907KiB/s (1665kB/s-2976kB/s), io=28.0MiB (29.4MB), run=3119-3523msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179775: Sat Sep 5 18:00:26 2026 read: IOPS=1, BW=4577KiB/s (4686kB/s)(12.0MiB/2685msec) clat (msec): min=717, max=855, avg=776.24, stdev=71.12 lat (msec): min=717, max=855, avg=776.24, stdev=71.12 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7816, max= 7953, per=100.00%, avg=7884.50, stdev=96.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=10.13%, ctx=222, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179777: Sat Sep 5 18:00:26 2026 read: IOPS=0, BW=1127KiB/s (1155kB/s)(4096KiB/3633msec) clat (nsec): min=879398k, max=879398k, avg=879398200.00, stdev= 0.00 lat (nsec): min=879399k, max=879399k, avg=879399414.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2255KiB/s (2309kB/s)(8192KiB/3633msec); 0 zone resets clat (msec): min=428, max=2136, avg=1282.69, stdev=1208.01 lat (msec): min=428, max=2144, avg=1286.80, stdev=1213.21 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 2140], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.24%, ctx=116, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179779: Sat Sep 5 18:00:26 2026 write: IOPS=0, BW=3701KiB/s (3790kB/s)(12.0MiB/3320msec); 0 zone resets clat (msec): min=289, max=1414, avg=961.06, stdev=593.25 lat (msec): min=290, max=1414, avg=961.48, stdev=593.18 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8126, max= 8159, per=90.28%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.74%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% rand-rw: (groupid=0, jobs=1): err= 0: pid=179773: Sat Sep 5 18:00:26 2026 read: IOPS=1, BW=4249KiB/s (4351kB/s)(12.0MiB/2892msec) clat (msec): min=775, max=982, avg=864.70, stdev=106.28 lat (msec): min=775, max=982, avg=864.70, stdev=106.28 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=2.91%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179774: Sat Sep 5 18:00:26 2026 read: IOPS=0, BW=1202KiB/s (1230kB/s)(4096KiB/3409msec) clat (nsec): min=482553k, max=482553k, avg=482553369.00, stdev= 0.00 lat (nsec): min=482556k, max=482556k, avg=482555894.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2403KiB/s (2461kB/s)(8192KiB/3409msec); 0 zone resets clat (msec): min=1280, max=1414, avg=1347.27, stdev=94.66 lat (msec): min=1280, max=1414, avg=1347.59, stdev=94.51 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8126, max= 8126, per=91.79%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.84%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179776: Sat Sep 5 18:00:26 2026 write: IOPS=0, BW=3320KiB/s (3400kB/s)(12.0MiB/3701msec); 0 zone resets clat (msec): min=185, max=1908, avg=1151.72, stdev=880.14 lat (msec): min=186, max=1908, avg=1154.41, stdev=880.85 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8126, max= 8126, per=91.79%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.57%, ctx=65, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179778: Sat Sep 5 18:00:26 2026 write: IOPS=1, BW=4699KiB/s (4812kB/s)(12.0MiB/2615msec); 0 zone resets clat (msec): min=302, max=1555, avg=790.55, stdev=671.13 lat (msec): min=303, max=1556, avg=791.53, stdev=670.66 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8110, max= 8110, per=91.61%, avg=8110.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.82%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4806KiB/s (4921kB/s), 1202KiB/s-4249KiB/s (1230kB/s-4351kB/s), io=16.0MiB (16.8MB), run=2892-3409msec WRITE: bw=8854KiB/s (9066kB/s), 2403KiB/s-4699KiB/s (2461kB/s-4812kB/s), io=32.0MiB (33.6MB), run=2615-3701msec complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179780: Sat Sep 5 18:00:26 2026 write: IOPS=0, BW=4077KiB/s (4175kB/s)(12.0MiB/3014msec); 0 zone resets clat (msec): min=503, max=1332, avg=917.12, stdev=414.60 lat (msec): min=504, max=1333, avg=918.14, stdev=414.58 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8094, max= 8159, per=90.10%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.22%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4510KiB/s (4618kB/s), 1127KiB/s-4577KiB/s (1155kB/s-4686kB/s), io=16.0MiB (16.8MB), run=2685-3633msec WRITE: bw=9020KiB/s (9236kB/s), 2255KiB/s-4077KiB/s (2309kB/s-4175kB/s), io=32.0MiB (33.6MB), run=3014-3633msec