== sanity test 398b: DIO and buffer IO race ============== 23:51:09 (1788839469) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.44509 s, 6.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180202: Mon Sep 7 23:53:28 2026 read: IOPS=12, BW=51.6KiB/s (52.8kB/s)(5992KiB/116203msec) clat (usec): min=30, max=1150.9k, avg=42615.11, stdev=39416.34 lat (usec): min=30, max=1150.9k, avg=42619.68, stdev=39416.49 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9765], 10.00th=[ 15533], | 20.00th=[ 21627], 30.00th=[ 26084], 40.00th=[ 31327], | 50.00th=[ 36439], 60.00th=[ 41681], 70.00th=[ 50070], | 80.00th=[ 58983], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[ 141558], 99.50th=[ 158335], 99.90th=[ 208667], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 112, per=25.52%, avg=51.56, stdev=20.59, samples=227 iops : min= 1, max= 28, avg=12.22, stdev= 5.18, samples=227 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6296KiB/116203msec); 0 zone resets clat (usec): min=949, max=252671, avg=32917.72, stdev=34362.92 lat (usec): min=950, max=252673, avg=32920.10, stdev=34362.20 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1401], 20.00th=[ 2900], | 30.00th=[ 6652], 40.00th=[ 15401], 50.00th=[ 24249], 60.00th=[ 32900], | 70.00th=[ 42730], 80.00th=[ 57410], 90.00th=[ 78119], 95.00th=[100140], | 99.00th=[143655], 99.50th=[170918], 99.90th=[248513], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 150, per=25.79%, avg=54.67, stdev=22.72, samples=225 iops : min= 1, max= 37, avg=13.01, stdev= 5.73, samples=225 lat (usec) : 50=0.33%, 100=1.63%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=7.94%, 4=4.10%, 10=6.05%, 20=11.26%, 50=41.73% lat (msec) : 100=22.27%, 250=4.36%, 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.32%, ctx=6437, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180203: Mon Sep 7 23:53:28 2026 read: IOPS=12, BW=50.9KiB/s (52.1kB/s)(5940KiB/116737msec) clat (usec): min=39, max=220850, avg=43082.14, stdev=27173.23 lat (usec): min=40, max=220852, avg=43089.93, stdev=27175.33 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11600], 10.00th=[ 16450], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[128451], 99.50th=[152044], 99.90th=[198181], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 15, max= 109, per=25.16%, avg=50.82, stdev=18.96, samples=228 iops : min= 3, max= 27, avg=12.04, stdev= 4.78, samples=228 write: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6348KiB/116737msec); 0 zone resets clat (usec): min=715, max=908257, avg=32921.37, stdev=41133.88 lat (usec): min=716, max=908258, avg=32923.46, stdev=41133.94 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1352], 20.00th=[ 2900], | 30.00th=[ 5997], 40.00th=[ 13042], 50.00th=[ 21890], 60.00th=[ 31327], | 70.00th=[ 42730], 80.00th=[ 56361], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[152044], 99.50th=[162530], 99.90th=[278922], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 120, per=25.47%, avg=53.99, stdev=22.75, samples=229 iops : min= 1, max= 30, avg=12.84, stdev= 5.72, samples=229 lat (usec) : 50=0.20%, 100=1.27%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.36% lat (msec) : 2=7.42%, 4=5.21%, 10=6.02%, 20=12.04%, 50=39.65% lat (msec) : 100=22.88%, 250=4.65%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.16%, ctx=6351, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180205: Mon Sep 7 23:53:28 2026 read: IOPS=13, BW=52.7KiB/s (53.9kB/s)(6028KiB/114489msec) clat (usec): min=39, max=307716, avg=42065.79, stdev=27830.11 lat (usec): min=40, max=307717, avg=42068.04, stdev=27829.77 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11600], 10.00th=[ 15926], 20.00th=[ 21365], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[158335], 99.90th=[240124], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 118, per=26.06%, avg=52.64, stdev=20.23, samples=224 iops : min= 1, max= 29, avg=12.49, stdev= 5.10, samples=224 write: IOPS=13, BW=54.7KiB/s (55.0kB/s)(6260KiB/114489msec); 0 zone resets clat (usec): min=610, max=1176.0k, avg=32332.56, stdev=43306.20 lat (usec): min=611, max=1176.0k, avg=32336.07, stdev=43306.25 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1401], | 20.00th=[ 3228], 30.00th=[ 6456], 40.00th=[ 12518], | 50.00th=[ 21890], 60.00th=[ 31065], 70.00th=[ 42206], | 80.00th=[ 56361], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[ 129500], 99.50th=[ 137364], 99.90th=[ 219153], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 119, per=25.85%, avg=54.79, stdev=21.93, samples=223 iops : min= 1, max= 29, avg=13.04, stdev= 5.52, samples=223 lat (usec) : 50=0.07%, 100=1.27%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=6.64%, 4=5.14%, 10=6.97%, 20=12.34%, 50=40.20% lat (msec) : 100=22.66%, 250=4.10%, 500=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.26%, ctx=6395, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180207: Mon Sep 7 23:53:28 2026 read: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6052KiB/118317msec) clat (usec): min=37, max=970435, avg=43141.95, stdev=36704.37 lat (usec): min=38, max=970437, avg=43143.77, stdev=36704.30 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 9634], 10.00th=[ 15008], 20.00th=[ 20841], | 30.00th=[ 26608], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[147850], 99.50th=[168821], 99.90th=[217056], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 127, per=25.25%, avg=51.00, stdev=21.12, samples=231 iops : min= 1, max= 31, avg=12.08, stdev= 5.32, samples=231 write: IOPS=13, BW=52.7KiB/s (53.0kB/s)(6236KiB/118317msec); 0 zone resets clat (usec): min=779, max=217382, avg=33684.05, stdev=34965.23 lat (usec): min=781, max=217383, avg=33689.55, stdev=34962.30 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1188], 10.00th=[ 1434], 20.00th=[ 3392], | 30.00th=[ 6718], 40.00th=[ 15008], 50.00th=[ 22938], 60.00th=[ 32113], | 70.00th=[ 43779], 80.00th=[ 58983], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[145753], 99.50th=[156238], 99.90th=[202376], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 143, per=24.75%, avg=52.48, stdev=22.20, samples=231 iops : min= 1, max= 35, avg=12.46, stdev= 5.59, samples=231 lat (usec) : 50=0.23%, 100=1.50%, 250=0.03%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.42% lat (msec) : 2=6.32%, 4=4.65%, 10=6.77%, 20=12.17%, 50=39.45% lat (msec) : 100=23.21%, 250=5.11%, 1000=0.03% cpu : usr=0.07%, sys=5.25%, ctx=6454, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=203KiB/s (208kB/s), 50.9KiB/s-52.7KiB/s (52.1kB/s-53.9kB/s), io=23.4MiB (24.6MB), run=114489-118317msec WRITE: bw=212KiB/s (218kB/s), 52.7KiB/s-54.7KiB/s (53.0kB/s-55.0kB/s), io=24.6MiB (25.7MB), run=114489-118317msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180204: Mon Sep 7 23:54:03 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(5992KiB/153323msec) clat (msec): min=4, max=1298, avg=40.46, stdev=48.93 lat (msec): min=4, max=1298, avg=40.47, stdev=48.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 88], 95.00th=[ 121], | 99.00th=[ 178], 99.50th=[ 205], 99.90th=[ 317], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 135, per=25.59%, avg=39.92, stdev=27.91, samples=292 iops : min= 1, max= 33, avg= 9.33, stdev= 7.00, samples=292 write: IOPS=10, BW=41.1KiB/s (42.0kB/s)(6296KiB/153323msec); 0 zone resets clat (msec): min=9, max=420, avg=58.60, stdev=42.56 lat (msec): min=9, max=420, avg=58.60, stdev=42.56 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 117], 95.00th=[ 142], | 99.00th=[ 199], 99.50th=[ 222], 99.90th=[ 271], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 133, per=25.34%, avg=41.31, stdev=26.96, samples=296 iops : min= 1, max= 33, avg= 9.68, stdev= 6.79, samples=296 lat (msec) : 10=4.30%, 20=17.15%, 50=43.98%, 100=22.69%, 250=11.65% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.06%, sys=1.88%, ctx=4916, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180206: Mon Sep 7 23:54:03 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(5940KiB/153492msec) clat (msec): min=4, max=1024, avg=40.08, stdev=45.47 lat (msec): min=4, max=1024, avg=40.08, stdev=45.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 92], 95.00th=[ 122], | 99.00th=[ 180], 99.50th=[ 207], 99.90th=[ 326], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 150, per=25.25%, avg=39.39, stdev=29.06, samples=294 iops : min= 1, max= 37, avg= 9.20, stdev= 7.31, samples=294 write: IOPS=10, BW=41.4KiB/s (42.3kB/s)(6348KiB/153492msec); 0 zone resets clat (msec): min=6, max=307, avg=58.93, stdev=43.83 lat (msec): min=6, max=307, avg=58.93, stdev=43.83 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 69], 80.00th=[ 89], 90.00th=[ 121], 95.00th=[ 144], | 99.00th=[ 215], 99.50th=[ 253], 99.90th=[ 292], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 151, per=25.58%, avg=41.70, stdev=27.29, samples=297 iops : min= 1, max= 37, avg= 9.77, stdev= 6.85, samples=297 lat (msec) : 10=4.23%, 20=18.36%, 50=43.36%, 100=21.88%, 250=11.85% lat (msec) : 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=1.71%, ctx=4704, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180208: Mon Sep 7 23:54:03 2026 read: IOPS=9, BW=39.3KiB/s (40.3kB/s)(6028KiB/153263msec) clat (msec): min=4, max=314, avg=39.78, stdev=37.67 lat (msec): min=4, max=314, avg=39.79, stdev=37.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 60], 90.00th=[ 91], 95.00th=[ 122], | 99.00th=[ 180], 99.50th=[ 201], 99.90th=[ 232], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 144, per=25.56%, avg=39.88, stdev=28.25, samples=294 iops : min= 1, max= 36, avg= 9.32, stdev= 7.09, samples=294 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6260KiB/153263msec); 0 zone resets clat (msec): min=9, max=882, avg=59.22, stdev=48.15 lat (msec): min=9, max=882, avg=59.23, stdev=48.15 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 117], 95.00th=[ 142], | 99.00th=[ 215], 99.50th=[ 253], 99.90th=[ 305], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 143, per=24.97%, avg=40.71, stdev=27.57, samples=299 iops : min= 1, max= 35, avg= 9.53, stdev= 6.93, samples=299 lat (msec) : 10=4.72%, 20=18.13%, 50=42.58%, 100=23.47%, 250=10.81% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=1.78%, ctx=4737, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180209: Mon Sep 7 23:54:03 2026 read: IOPS=9, BW=39.5KiB/s (40.5kB/s)(6052KiB/153069msec) clat (msec): min=5, max=335, avg=39.62, stdev=37.33 lat (msec): min=5, max=335, avg=39.63, stdev=37.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 91], 95.00th=[ 120], | 99.00th=[ 176], 99.50th=[ 190], 99.90th=[ 236], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 151, per=25.89%, avg=40.39, stdev=28.62, samples=292 iops : min= 1, max= 37, avg= 9.45, stdev= 7.19, samples=292 write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6236KiB/153069msec); 0 zone resets clat (msec): min=7, max=1050, avg=59.44, stdev=49.28 lat (msec): min=7, max=1050, avg=59.44, stdev=49.28 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 118], 95.00th=[ 140], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 426], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 126, per=24.93%, avg=40.63, stdev=27.02, samples=299 iops : min= 1, max= 31, avg= 9.51, stdev= 6.80, samples=299 lat (msec) : 10=4.07%, 20=19.04%, 50=42.32%, 100=22.59%, 250=11.82% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.76%, ctx=4821, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (160kB/s), 38.7KiB/s-39.5KiB/s (39.6kB/s-40.5kB/s), io=23.4MiB (24.6MB), run=153069-153492msec WRITE: bw=164KiB/s (168kB/s), 40.7KiB/s-41.4KiB/s (41.7kB/s-42.3kB/s), io=24.6MiB (25.7MB), run=153069-153492msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180249: Mon Sep 7 23:54:40 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(5920KiB/26895msec) clat (usec): min=40, max=171972, avg=38575.62, stdev=27664.54 lat (usec): min=41, max=171973, avg=38577.89, stdev=27664.08 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 63], 10.00th=[ 104], 20.00th=[ 19792], | 30.00th=[ 24773], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 55313], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[143655], 99.50th=[152044], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 93, max= 379, per=24.19%, avg=215.33, stdev=67.37, samples=52 iops : min= 5, max= 23, avg=12.69, stdev= 4.14, samples=52 write: IOPS=14, BW=237KiB/s (242kB/s)(6368KiB/26895msec); 0 zone resets clat (usec): min=1264, max=181644, avg=31539.11, stdev=31410.95 lat (usec): min=1267, max=181647, avg=31543.46, stdev=31409.17 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1811], 10.00th=[ 2507], 20.00th=[ 4228], | 30.00th=[ 7373], 40.00th=[ 13960], 50.00th=[ 22938], 60.00th=[ 30540], | 70.00th=[ 39584], 80.00th=[ 56886], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[143655], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 64, max= 533, per=25.04%, avg=234.40, stdev=92.01, samples=52 iops : min= 4, max= 33, avg=13.90, stdev= 5.81, samples=52 lat (usec) : 50=0.26%, 100=4.43%, 250=0.91%, 500=0.26% lat (msec) : 2=3.39%, 4=6.64%, 10=8.59%, 20=9.51%, 50=41.80% lat (msec) : 100=20.83%, 250=3.39% cpu : usr=0.07%, sys=6.36%, ctx=1654, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180250: Mon Sep 7 23:54:40 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(5744KiB/26089msec) clat (usec): min=39, max=188359, avg=39969.34, stdev=26386.98 lat (usec): min=39, max=188360, avg=39970.75, stdev=26386.94 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 379], 20.00th=[ 21103], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 85459], | 99.00th=[123208], 99.50th=[137364], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 413, per=24.75%, avg=220.31, stdev=76.18, samples=51 iops : min= 3, max= 25, avg=13.02, stdev= 4.75, samples=51 write: IOPS=15, BW=251KiB/s (257kB/s)(6544KiB/26089msec); 0 zone resets clat (usec): min=1383, max=172794, avg=28403.91, stdev=28498.35 lat (usec): min=1385, max=172796, avg=28414.18, stdev=28492.89 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1795], 10.00th=[ 2409], 20.00th=[ 4686], | 30.00th=[ 7832], 40.00th=[ 13173], 50.00th=[ 20579], 60.00th=[ 26084], | 70.00th=[ 33817], 80.00th=[ 47973], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[120062], 99.50th=[122160], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 476, per=26.75%, avg=250.35, stdev=92.20, samples=51 iops : min= 1, max= 29, avg=14.92, stdev= 5.82, samples=51 lat (usec) : 50=0.65%, 100=3.65%, 250=0.26%, 500=0.13% lat (msec) : 2=3.65%, 4=5.73%, 10=10.03%, 20=11.20%, 50=40.89% lat (msec) : 100=20.83%, 250=2.99% cpu : usr=0.08%, sys=6.78%, ctx=1673, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180251: Mon Sep 7 23:54:40 2026 read: IOPS=14, BW=233KiB/s (239kB/s)(6256KiB/26814msec) clat (usec): min=40, max=177512, avg=36423.00, stdev=27952.55 lat (usec): min=41, max=177514, avg=36432.92, stdev=27945.89 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 77], 20.00th=[ 17695], | 30.00th=[ 22676], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 44303], 80.00th=[ 51119], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[154141], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 93, max= 477, per=26.34%, avg=234.40, stdev=86.70, samples=52 iops : min= 5, max= 29, avg=13.90, stdev= 5.44, samples=52 write: IOPS=14, BW=225KiB/s (230kB/s)(6032KiB/26814msec); 0 zone resets clat (usec): min=1539, max=171476, avg=33059.08, stdev=30841.44 lat (usec): min=1541, max=171478, avg=33062.55, stdev=30842.31 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1876], 10.00th=[ 3064], 20.00th=[ 5211], | 30.00th=[ 8848], 40.00th=[ 17433], 50.00th=[ 24773], 60.00th=[ 34341], | 70.00th=[ 43779], 80.00th=[ 56361], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[143655], 99.50th=[152044], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 62, max= 413, per=23.74%, avg=222.21, stdev=72.23, samples=52 iops : min= 3, max= 25, avg=13.13, stdev= 4.51, samples=52 lat (usec) : 50=0.65%, 100=5.60%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.99%, 4=4.30%, 10=8.59%, 20=11.33%, 50=43.10% lat (msec) : 100=19.92%, 250=3.26% cpu : usr=0.06%, sys=6.34%, ctx=1615, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180252: Mon Sep 7 23:54:40 2026 read: IOPS=14, BW=230KiB/s (235kB/s)(6032KiB/26247msec) clat (usec): min=35, max=158297, avg=37597.56, stdev=26235.66 lat (usec): min=35, max=158298, avg=37610.58, stdev=26224.70 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 81], 20.00th=[ 19530], | 30.00th=[ 23200], 40.00th=[ 29230], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 56361], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[129500], 99.50th=[137364], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 63, max= 412, per=25.71%, avg=228.86, stdev=79.88, samples=51 iops : min= 3, max= 25, avg=13.55, stdev= 5.05, samples=51 write: IOPS=14, BW=238KiB/s (244kB/s)(6256KiB/26247msec); 0 zone resets clat (usec): min=1414, max=181352, avg=30630.16, stdev=30993.95 lat (usec): min=1416, max=181356, avg=30632.40, stdev=30993.90 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1926], 10.00th=[ 2573], 20.00th=[ 4555], | 30.00th=[ 7832], 40.00th=[ 12649], 50.00th=[ 21103], 60.00th=[ 29492], | 70.00th=[ 37487], 80.00th=[ 55837], 90.00th=[ 70779], 95.00th=[ 93848], | 99.00th=[124257], 99.50th=[162530], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 667, per=25.50%, avg=238.67, stdev=108.00, samples=51 iops : min= 3, max= 41, avg=14.20, stdev= 6.75, samples=51 lat (usec) : 50=0.78%, 100=4.82%, 250=0.52%, 750=0.13% lat (msec) : 2=3.12%, 4=6.12%, 10=9.24%, 20=10.55%, 50=38.80% lat (msec) : 100=22.40%, 250=3.52% cpu : usr=0.11%, sys=6.32%, ctx=1612, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=891KiB/s (912kB/s), 220KiB/s-233KiB/s (225kB/s-239kB/s), io=23.4MiB (24.5MB), run=26089-26895msec WRITE: bw=937KiB/s (959kB/s), 225KiB/s-251KiB/s (230kB/s-257kB/s), io=24.6MiB (25.8MB), run=26089-26895msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180254: Mon Sep 7 23:54:51 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(5920KiB/36528msec) clat (msec): min=6, max=220, avg=38.55, stdev=36.26 lat (msec): min=6, max=220, avg=38.55, stdev=36.26 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 77], 95.00th=[ 120], | 99.00th=[ 197], 99.50th=[ 218], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 479, per=24.25%, avg=157.65, stdev=99.74, samples=71 iops : min= 1, max= 29, avg= 9.13, stdev= 6.29, samples=71 write: IOPS=10, BW=174KiB/s (179kB/s)(6368KiB/36528msec); 0 zone resets clat (msec): min=12, max=229, avg=55.87, stdev=36.10 lat (msec): min=12, max=229, avg=55.87, stdev=36.10 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 69], 80.00th=[ 85], 90.00th=[ 106], 95.00th=[ 125], | 99.00th=[ 203], 99.50th=[ 209], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 448, per=25.12%, avg=171.83, stdev=99.36, samples=71 iops : min= 1, max= 28, avg=10.03, stdev= 6.32, samples=71 lat (msec) : 10=2.47%, 20=17.19%, 50=47.27%, 100=23.57%, 250=9.51% cpu : usr=0.05%, sys=1.93%, ctx=1123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180255: Mon Sep 7 23:54:51 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(5744KiB/36536msec) clat (msec): min=7, max=200, avg=37.86, stdev=33.00 lat (msec): min=7, max=200, avg=37.86, stdev=33.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 85], 95.00th=[ 114], | 99.00th=[ 176], 99.50th=[ 180], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 480, per=24.69%, avg=160.51, stdev=103.55, samples=69 iops : min= 1, max= 30, avg= 9.32, stdev= 6.58, samples=69 write: IOPS=11, BW=179KiB/s (183kB/s)(6544KiB/36536msec); 0 zone resets clat (msec): min=13, max=203, avg=55.98, stdev=38.12 lat (msec): min=13, max=203, avg=55.98, stdev=38.12 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 52], | 70.00th=[ 62], 80.00th=[ 77], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 188], 99.50th=[ 190], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 31, max= 475, per=25.41%, avg=173.77, stdev=97.68, samples=71 iops : min= 1, max= 29, avg=10.14, stdev= 6.17, samples=71 lat (msec) : 10=1.95%, 20=17.45%, 50=47.92%, 100=22.27%, 250=10.42% cpu : usr=0.05%, sys=1.87%, ctx=1252, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180256: Mon Sep 7 23:54:51 2026 read: IOPS=10, BW=172KiB/s (177kB/s)(6256KiB/36268msec) clat (msec): min=6, max=172, avg=37.01, stdev=29.90 lat (msec): min=6, max=172, avg=37.01, stdev=29.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 100], | 99.00th=[ 146], 99.50th=[ 161], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 31, max= 447, per=27.02%, avg=175.64, stdev=107.25, samples=70 iops : min= 1, max= 27, avg=10.26, stdev= 6.82, samples=70 write: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36268msec); 0 zone resets clat (msec): min=13, max=207, avg=57.70, stdev=36.34 lat (msec): min=13, max=207, avg=57.70, stdev=36.34 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 71], 80.00th=[ 86], 90.00th=[ 110], 95.00th=[ 128], | 99.00th=[ 188], 99.50th=[ 192], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 506, per=23.93%, avg=163.68, stdev=89.01, samples=71 iops : min= 1, max= 31, avg= 9.52, stdev= 5.64, samples=71 lat (msec) : 10=1.43%, 20=17.32%, 50=48.83%, 100=23.70%, 250=8.72% cpu : usr=0.06%, sys=1.91%, ctx=1121, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180257: Mon Sep 7 23:54:51 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36829msec) clat (msec): min=6, max=220, avg=40.79, stdev=36.23 lat (msec): min=6, max=220, avg=40.79, stdev=36.22 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 92], 95.00th=[ 122], | 99.00th=[ 174], 99.50th=[ 180], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 447, per=24.85%, avg=161.50, stdev=103.43, samples=72 iops : min= 1, max= 27, avg= 9.38, stdev= 6.51, samples=72 write: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36829msec); 0 zone resets clat (msec): min=8, max=226, avg=54.80, stdev=36.32 lat (msec): min=8, max=226, avg=54.80, stdev=36.32 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 49], | 70.00th=[ 62], 80.00th=[ 88], 90.00th=[ 107], 95.00th=[ 125], | 99.00th=[ 190], 99.50th=[ 194], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 31, max= 538, per=24.49%, avg=167.51, stdev=105.55, samples=72 iops : min= 1, max= 33, avg= 9.75, stdev= 6.69, samples=72 lat (msec) : 10=2.73%, 20=17.32%, 50=48.31%, 100=20.96%, 250=10.68% cpu : usr=0.07%, sys=1.86%, ctx=1185, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=650KiB/s (666kB/s), 157KiB/s-172KiB/s (161kB/s-177kB/s), io=23.4MiB (24.5MB), run=36268-36829msec WRITE: bw=684KiB/s (701kB/s), 166KiB/s-179KiB/s (170kB/s-183kB/s), io=24.6MiB (25.8MB), run=36268-36829msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180272: Mon Sep 7 23:55:09 2026 read: IOPS=1, BW=1111KiB/s (1137kB/s)(7168KiB/6454msec) clat (msec): min=137, max=2471, avg=762.65, stdev=977.13 lat (msec): min=137, max=2471, avg=762.65, stdev=977.13 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 171], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 249], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 1871], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 2031, max= 4087, per=100.00%, avg=2447.00, stdev=916.80, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=793KiB/s (812kB/s)(5120KiB/6454msec); 0 zone resets clat (msec): min=155, max=266, avg=211.59, stdev=41.54 lat (msec): min=156, max=266, avg=211.73, stdev=41.54 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 2035, max= 4063, per=79.35%, avg=2712.33, stdev=1169.71, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.02%, ctx=1163, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180273: Mon Sep 7 23:55:09 2026 read: IOPS=0, BW=244KiB/s (250kB/s)(2048KiB/8387msec) clat (usec): min=497, max=140118, avg=70308.32, stdev=98727.08 lat (usec): min=499, max=140121, avg=70310.38, stdev=98727.92 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[139461], | 70.00th=[139461], 80.00th=[139461], 90.00th=[139461], 95.00th=[139461], | 99.00th=[139461], 99.50th=[139461], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 1535, max= 2039, per=73.21%, avg=1787.00, stdev=356.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1221KiB/s (1250kB/s)(10.0MiB/8387msec); 0 zone resets clat (msec): min=115, max=4476, avg=799.07, stdev=1328.29 lat (msec): min=115, max=4476, avg=799.17, stdev=1328.28 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 121], | 30.00th=[ 239], 40.00th=[ 262], 50.00th=[ 288], 60.00th=[ 296], | 70.00th=[ 481], 80.00th=[ 550], 90.00th=[ 1167], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 2039, max= 4079, per=95.00%, avg=3247.00, stdev=1103.00, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.67%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180274: Mon Sep 7 23:55:09 2026 read: IOPS=0, BW=827KiB/s (847kB/s)(6144KiB/7426msec) clat (usec): min=541, max=330605, avg=104397.14, stdev=160278.62 lat (usec): min=542, max=330606, avg=104398.14, stdev=160278.68 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 1565], 50.00th=[ 1565], 60.00th=[ 2376], | 70.00th=[291505], 80.00th=[291505], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2039, max= 4087, per=100.00%, avg=3399.00, stdev=1177.82, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=827KiB/s (847kB/s)(6144KiB/7426msec); 0 zone resets clat (msec): min=204, max=5060, avg=1085.75, stdev=1949.12 lat (msec): min=204, max=5060, avg=1085.85, stdev=1949.16 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 359], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 5067], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 1510, max= 2043, per=56.58%, avg=1934.00, stdev=237.05, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.04%, sys=6.15%, ctx=138, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180275: Mon Sep 7 23:55:09 2026 read: IOPS=0, BW=685KiB/s (701kB/s)(5120KiB/7475msec) clat (usec): min=1035, max=243647, avg=67036.30, stdev=105113.42 lat (usec): min=1036, max=243648, avg=67037.18, stdev=105113.61 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1037], 10.00th=[ 1037], 20.00th=[ 1037], | 30.00th=[ 1876], 40.00th=[ 1876], 50.00th=[ 3261], 60.00th=[ 3261], | 70.00th=[ 85459], 80.00th=[ 85459], 90.00th=[244319], 95.00th=[244319], | 99.00th=[244319], 99.50th=[244319], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=0, BW=959KiB/s (982kB/s)(7168KiB/7475msec); 0 zone resets clat (msec): min=205, max=4870, avg=986.06, stdev=1715.05 lat (msec): min=206, max=4870, avg=986.33, stdev=1714.96 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 243], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 422], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 1635, max= 4071, per=71.50%, avg=2444.00, stdev=1100.94, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 2=16.67%, 4=8.33%, 100=8.33%, 250=25.00%, 500=33.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.99%, ctx=142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2442KiB/s (2500kB/s), 244KiB/s-1111KiB/s (250kB/s-1137kB/s), io=20.0MiB (20.0MB), run=6454-8387msec WRITE: bw=3419KiB/s (3501kB/s), 793KiB/s-1221KiB/s (812kB/s-1250kB/s), io=28.0MiB (29.4MB), run=6454-8387msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180268: Mon Sep 7 23:55:09 2026 read: IOPS=0, BW=830KiB/s (850kB/s)(7168KiB/8639msec) clat (msec): min=49, max=3957, avg=1074.54, stdev=1502.97 lat (msec): min=49, max=3957, avg=1074.54, stdev=1502.97 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 61], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 313], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 2299], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 1917, max= 4023, per=100.00%, avg=2509.00, stdev=1011.22, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=0, BW=593KiB/s (607kB/s)(5120KiB/8639msec); 0 zone resets clat (msec): min=43, max=506, avg=175.74, stdev=188.75 lat (msec): min=43, max=507, avg=175.87, stdev=188.74 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 44], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 114], 60.00th=[ 114], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2011, max= 2011, per=60.61%, avg=2011.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 50=16.67%, 100=16.67%, 250=25.00%, 500=8.33%, 750=16.67% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=2.06%, ctx=89, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180269: Mon Sep 7 23:55:09 2026 read: IOPS=0, BW=244KiB/s (250kB/s)(2048KiB/8389msec) clat (msec): min=105, max=192, avg=149.17, stdev=61.97 lat (msec): min=105, max=192, avg=149.18, stdev=61.97 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 194], 95.00th=[ 194], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 1450, max= 2027, per=73.35%, avg=1738.50, stdev=408.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1221KiB/s (1250kB/s)(10.0MiB/8389msec); 0 zone resets clat (msec): min=90, max=4522, avg=803.93, stdev=1360.24 lat (msec): min=90, max=4522, avg=804.15, stdev=1360.22 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 117], | 30.00th=[ 194], 40.00th=[ 215], 50.00th=[ 259], 60.00th=[ 262], | 70.00th=[ 393], 80.00th=[ 609], 90.00th=[ 1368], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1917, max= 6059, per=90.68%, avg=3008.83, stdev=1718.91, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.83, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.61%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180270: Mon Sep 7 23:55:09 2026 read: IOPS=0, BW=741KiB/s (759kB/s)(6144KiB/8287msec) clat (msec): min=103, max=656, avg=257.36, stdev=214.61 lat (msec): min=103, max=656, avg=257.36, stdev=214.61 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 188], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1943, max= 4055, per=100.00%, avg=2500.25, stdev=1036.90, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=741KiB/s (759kB/s)(6144KiB/8287msec); 0 zone resets clat (msec): min=139, max=4720, avg=1097.23, stdev=1789.48 lat (msec): min=139, max=4721, avg=1097.49, stdev=1789.44 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 600], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1917, max= 3580, per=69.31%, avg=2299.80, stdev=717.56, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=58.33%, 500=8.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=1.79%, ctx=69, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180271: Mon Sep 7 23:55:09 2026 read: IOPS=0, BW=709KiB/s (726kB/s)(5120KiB/7217msec) clat (msec): min=64, max=225, avg=136.38, stdev=58.39 lat (msec): min=64, max=225, avg=136.39, stdev=58.39 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 130], 60.00th=[ 130], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 3886, max= 3984, per=100.00%, avg=3935.00, stdev=69.30, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=993KiB/s (1017kB/s)(7168KiB/7217msec); 0 zone resets clat (msec): min=112, max=4456, avg=914.89, stdev=1573.00 lat (msec): min=112, max=4457, avg=915.05, stdev=1572.96 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 317], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 676], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1530, max= 4039, per=71.04%, avg=2357.25, stdev=1136.96, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.03%, ctx=129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2371KiB/s (2428kB/s), 244KiB/s-830KiB/s (250kB/s-850kB/s), io=20.0MiB (20.0MB), run=7217-8639msec WRITE: bw=3319KiB/s (3399kB/s), 593KiB/s-1221KiB/s (607kB/s-1250kB/s), io=28.0MiB (29.4MB), run=7217-8639msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180282: Mon Sep 7 23:55:23 2026 read: IOPS=2, BW=9886KiB/s (10.1MB/s)(12.0MiB/1243msec) clat (msec): min=287, max=441, avg=375.25, stdev=79.07 lat (msec): min=287, max=441, avg=375.25, stdev=79.07 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=7.57%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180284: Mon Sep 7 23:55:23 2026 read: IOPS=0, BW=1369KiB/s (1401kB/s)(4096KiB/2993msec) clat (nsec): min=1621.8M, max=1621.8M, avg=1621787146.00, stdev= 0.00 lat (nsec): min=1621.8M, max=1621.8M, avg=1621790338.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1620], 5.00th=[ 1620], 10.00th=[ 1620], 20.00th=[ 1620], | 30.00th=[ 1620], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2737KiB/s (2803kB/s)(8192KiB/2993msec); 0 zone resets clat (msec): min=279, max=1030, avg=654.84, stdev=531.27 lat (msec): min=279, max=1030, avg=655.33, stdev=531.12 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.61%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180285: Mon Sep 7 23:55:23 2026 write: IOPS=0, BW=4043KiB/s (4140kB/s)(12.0MiB/3039msec); 0 zone resets clat (msec): min=760, max=1188, avg=986.20, stdev=215.05 lat (msec): min=760, max=1188, avg=986.65, stdev=215.10 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8126, max= 8175, per=75.59%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.48%, ctx=61, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180286: Mon Sep 7 23:55:23 2026 write: IOPS=1, BW=4774KiB/s (4888kB/s)(12.0MiB/2574msec); 0 zone resets clat (msec): min=318, max=1037, avg=786.35, stdev=405.95 lat (msec): min=318, max=1049, avg=790.57, stdev=409.49 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7123, max= 8175, per=70.94%, avg=7649.00, stdev=743.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.08%, sys=4.90%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5474KiB/s (5605kB/s), 1369KiB/s-9886KiB/s (1401kB/s-10.1MB/s), io=16.0MiB (16.8MB), run=1243-2993msec WRITE: bw=10.5MiB/s (11.0MB/s), 2737KiB/s-4774KiB/s (2803kB/s-4888kB/s), io=32.0MiB (33.6MB), run=2574-3039msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180287: Mon Sep 7 23:55:23 2026 read: IOPS=1, BW=5352KiB/s (5480kB/s)(12.0MiB/2296msec) clat (msec): min=599, max=794, avg=727.82, stdev=111.06 lat (msec): min=599, max=794, avg=727.82, stdev=111.06 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.81%, ctx=547, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180288: Mon Sep 7 23:55:23 2026 read: IOPS=0, BW=1714KiB/s (1755kB/s)(4096KiB/2390msec) clat (nsec): min=721522k, max=721522k, avg=721522220.00, stdev= 0.00 lat (nsec): min=721525k, max=721525k, avg=721524973.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3428KiB/s (3510kB/s)(8192KiB/2390msec); 0 zone resets clat (msec): min=559, max=1026, avg=793.30, stdev=330.36 lat (msec): min=561, max=1027, avg=794.32, stdev=329.70 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8094, max= 8094, per=79.52%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=5.69%, ctx=99, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180289: Mon Sep 7 23:55:23 2026 write: IOPS=0, BW=3817KiB/s (3909kB/s)(12.0MiB/3219msec); 0 zone resets clat (msec): min=433, max=1428, avg=1046.20, stdev=535.96 lat (msec): min=433, max=1428, avg=1046.63, stdev=536.08 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8094, max= 8094, per=79.52%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.11%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180290: Mon Sep 7 23:55:23 2026 write: IOPS=1, BW=4772KiB/s (4887kB/s)(12.0MiB/2575msec); 0 zone resets clat (msec): min=482, max=1056, avg=808.33, stdev=294.62 lat (msec): min=483, max=1056, avg=809.03, stdev=294.75 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8159, max= 8159, per=80.16%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=5.44%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6855KiB/s (7020kB/s), 1714KiB/s-5352KiB/s (1755kB/s-5480kB/s), io=16.0MiB (16.8MB), run=2296-2390msec WRITE: bw=9.94MiB/s (10.4MB/s), 3428KiB/s-4772KiB/s (3510kB/s-4887kB/s), io=32.0MiB (33.6MB), run=2390-3219msec