== sanity test 398b: DIO and buffer IO race ============== 06:06:07 (1789293967) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.0719 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179173: Sun Sep 13 06:08:28 2026 read: IOPS=12, BW=49.0KiB/s (51.2kB/s)(5992KiB/119947msec) clat (usec): min=40, max=237981, avg=44173.74, stdev=29855.01 lat (usec): min=41, max=237981, avg=44174.90, stdev=29855.01 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11863], 10.00th=[ 16188], 20.00th=[ 22152], | 30.00th=[ 26870], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[102237], | 99.00th=[152044], 99.50th=[173016], 99.90th=[219153], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=49.88, stdev=20.30, samples=233 iops : min= 1, max= 29, avg=11.83, stdev= 5.10, samples=233 write: IOPS=13, BW=52.5KiB/s (53.7kB/s)(6296KiB/119947msec); 0 zone resets clat (usec): min=748, max=1310.7k, avg=33876.33, stdev=48204.21 lat (usec): min=750, max=1310.7k, avg=33877.72, stdev=48204.27 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1106], 10.00th=[ 1221], | 20.00th=[ 2442], 30.00th=[ 5800], 40.00th=[ 14484], | 50.00th=[ 23200], 60.00th=[ 31589], 70.00th=[ 42730], | 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[ 104334], | 99.00th=[ 158335], 99.50th=[ 189793], 99.90th=[ 278922], | 99.95th=[1317012], 99.99th=[1317012] bw ( KiB/s): min= 7, max= 143, per=25.06%, avg=52.37, stdev=23.97, samples=233 iops : min= 1, max= 35, avg=12.46, stdev= 6.01, samples=233 lat (usec) : 50=0.29%, 100=1.11%, 250=0.13%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.59% lat (msec) : 2=8.59%, 4=3.97%, 10=5.70%, 20=10.16%, 50=41.15% lat (msec) : 100=22.72%, 250=5.44%, 500=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.33%, ctx=6180, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179174: Sun Sep 13 06:08:28 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(5940KiB/119752msec) clat (usec): min=42, max=379374, avg=44116.06, stdev=31238.84 lat (usec): min=43, max=379374, avg=44120.27, stdev=31239.43 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11469], 10.00th=[ 15926], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 63177], 90.00th=[ 81265], 95.00th=[ 94897], | 99.00th=[149947], 99.50th=[191890], 99.90th=[346031], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 6, max= 125, per=24.86%, avg=49.71, stdev=20.36, samples=233 iops : min= 1, max= 31, avg=11.79, stdev= 5.13, samples=233 write: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6348KiB/119752msec); 0 zone resets clat (usec): min=702, max=1356.6k, avg=33866.04, stdev=48395.81 lat (usec): min=703, max=1356.6k, avg=33867.52, stdev=48395.81 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1237], | 20.00th=[ 2442], 30.00th=[ 6063], 40.00th=[ 14615], | 50.00th=[ 23200], 60.00th=[ 31851], 70.00th=[ 43779], | 80.00th=[ 57934], 90.00th=[ 80217], 95.00th=[ 102237], | 99.00th=[ 147850], 99.50th=[ 177210], 99.90th=[ 333448], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 143, per=25.25%, avg=52.77, stdev=24.46, samples=234 iops : min= 1, max= 35, avg=12.55, stdev= 6.15, samples=234 lat (usec) : 50=0.20%, 100=1.04%, 250=0.03%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=8.63%, 4=3.97%, 10=5.63%, 20=12.24%, 50=39.68% lat (msec) : 100=23.31%, 250=4.75%, 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=4.59%, ctx=6384, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179175: Sun Sep 13 06:08:28 2026 read: IOPS=12, BW=50.9KiB/s (52.1kB/s)(6028KiB/118426msec) clat (usec): min=32, max=266065, avg=42788.42, stdev=28132.06 lat (usec): min=32, max=266065, avg=42793.06, stdev=28134.54 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 8717], 10.00th=[ 15139], 20.00th=[ 20841], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[137364], 99.50th=[152044], 99.90th=[223347], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 119, per=25.64%, avg=51.27, stdev=20.20, samples=229 iops : min= 1, max= 29, avg=12.17, stdev= 5.08, samples=229 write: IOPS=13, BW=52.9KiB/s (54.1kB/s)(6260KiB/118426msec); 0 zone resets clat (usec): min=816, max=1444.5k, avg=34126.71, stdev=50303.75 lat (usec): min=817, max=1444.5k, avg=34129.77, stdev=50303.70 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1139], 10.00th=[ 1254], | 20.00th=[ 2638], 30.00th=[ 6652], 40.00th=[ 15008], | 50.00th=[ 22676], 60.00th=[ 31589], 70.00th=[ 43254], | 80.00th=[ 56886], 90.00th=[ 83362], 95.00th=[ 102237], | 99.00th=[ 149947], 99.50th=[ 177210], 99.90th=[ 287310], | 99.95th=[1451230], 99.99th=[1451230] bw ( KiB/s): min= 7, max= 120, per=25.32%, avg=52.91, stdev=24.51, samples=230 iops : min= 1, max= 30, avg=12.58, stdev= 6.20, samples=230 lat (usec) : 50=0.49%, 100=1.46%, 250=0.03%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.36% lat (msec) : 2=8.20%, 4=3.87%, 10=5.99%, 20=12.27%, 50=39.29% lat (msec) : 100=23.08%, 250=4.75%, 500=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.70%, ctx=6210, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179178: Sun Sep 13 06:08:28 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6052KiB/119812msec) clat (usec): min=38, max=1350.7k, avg=43734.41, stdev=43920.29 lat (usec): min=38, max=1350.7k, avg=43736.98, stdev=43920.72 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10552], 10.00th=[ 15401], | 20.00th=[ 20317], 30.00th=[ 25297], 40.00th=[ 31327], | 50.00th=[ 38011], 60.00th=[ 44303], 70.00th=[ 51119], | 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[ 147850], 99.50th=[ 160433], 99.90th=[ 270533], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 6, max= 119, per=25.27%, avg=50.55, stdev=20.40, samples=233 iops : min= 1, max= 29, avg=11.99, stdev= 5.13, samples=233 write: IOPS=13, BW=52.0KiB/s (53.3kB/s)(6236KiB/119812msec); 0 zone resets clat (usec): min=849, max=273299, avg=34097.99, stdev=35819.81 lat (usec): min=850, max=273301, avg=34101.47, stdev=35818.44 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1139], 10.00th=[ 1270], 20.00th=[ 2966], | 30.00th=[ 6456], 40.00th=[ 14222], 50.00th=[ 23987], 60.00th=[ 33162], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[143655], 99.50th=[164627], 99.90th=[214959], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 142, per=24.80%, avg=51.83, stdev=23.02, samples=234 iops : min= 1, max= 35, avg=12.32, stdev= 5.78, samples=234 lat (usec) : 50=0.36%, 100=1.27%, 250=0.03%, 1000=0.59% lat (msec) : 2=7.68%, 4=3.94%, 10=6.18%, 20=12.27%, 50=38.25% lat (msec) : 100=24.32%, 250=5.01%, 500=0.07%, 2000=0.03% cpu : usr=0.06%, sys=4.51%, ctx=6295, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=200KiB/s (205kB/s), 49.6KiB/s-50.9KiB/s (50.8kB/s-52.1kB/s), io=23.4MiB (24.6MB), run=118426-119947msec WRITE: bw=210KiB/s (215kB/s), 52.0KiB/s-53.0KiB/s (53.3kB/s-54.3kB/s), io=24.6MiB (25.7MB), run=118426-119947msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179172: Sun Sep 13 06:09:06 2026 read: IOPS=9, BW=38.0KiB/s (38.9kB/s)(5992KiB/157672msec) clat (msec): min=4, max=1322, avg=41.36, stdev=51.31 lat (msec): min=4, max=1322, avg=41.36, stdev=51.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 91], 95.00th=[ 126], | 99.00th=[ 199], 99.50th=[ 239], 99.90th=[ 321], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 165, per=25.42%, avg=38.65, stdev=26.90, samples=302 iops : min= 1, max= 41, avg= 9.00, stdev= 6.78, samples=302 write: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6296KiB/157672msec); 0 zone resets clat (msec): min=10, max=411, avg=60.49, stdev=45.33 lat (msec): min=10, max=411, avg=60.49, stdev=45.33 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 121], 95.00th=[ 157], | 99.00th=[ 215], 99.50th=[ 247], 99.90th=[ 317], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 175, per=25.10%, avg=39.91, stdev=26.44, samples=307 iops : min= 1, max= 43, avg= 9.31, stdev= 6.64, samples=307 lat (msec) : 10=3.19%, 20=18.03%, 50=44.37%, 100=22.33%, 250=11.65% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.05%, sys=1.59%, ctx=4829, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179176: Sun Sep 13 06:09:06 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(5940KiB/157865msec) clat (msec): min=4, max=1416, avg=42.33, stdev=53.47 lat (msec): min=4, max=1416, avg=42.33, stdev=53.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 92], 95.00th=[ 129], | 99.00th=[ 205], 99.50th=[ 226], 99.90th=[ 321], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 151, per=25.14%, avg=38.21, stdev=27.58, samples=302 iops : min= 1, max= 37, avg= 8.88, stdev= 6.93, samples=302 write: IOPS=10, BW=40.2KiB/s (41.2kB/s)(6348KiB/157865msec); 0 zone resets clat (msec): min=10, max=306, avg=59.63, stdev=43.42 lat (msec): min=10, max=306, avg=59.63, stdev=43.42 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 87], 90.00th=[ 117], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 241], 99.90th=[ 268], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 143, per=25.45%, avg=40.47, stdev=26.15, samples=304 iops : min= 1, max= 35, avg= 9.45, stdev= 6.58, samples=304 lat (msec) : 10=3.35%, 20=17.68%, 50=43.98%, 100=23.14%, 250=11.62% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.05%, sys=1.60%, ctx=4768, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179177: Sun Sep 13 06:09:06 2026 read: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6028KiB/157839msec) clat (msec): min=4, max=238, avg=40.07, stdev=36.18 lat (msec): min=4, max=238, avg=40.07, stdev=36.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 88], 95.00th=[ 120], | 99.00th=[ 178], 99.50th=[ 213], 99.90th=[ 232], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7, max= 166, per=25.40%, avg=38.61, stdev=27.05, samples=303 iops : min= 1, max= 41, avg= 8.99, stdev= 6.82, samples=303 write: IOPS=9, BW=39.7KiB/s (40.6kB/s)(6260KiB/157839msec); 0 zone resets clat (msec): min=8, max=1451, avg=62.00, stdev=57.46 lat (msec): min=8, max=1451, avg=62.01, stdev=57.46 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 125], 95.00th=[ 155], | 99.00th=[ 222], 99.50th=[ 247], 99.90th=[ 418], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 7, max= 127, per=24.95%, avg=39.67, stdev=25.69, samples=306 iops : min= 1, max= 31, avg= 9.25, stdev= 6.46, samples=306 lat (msec) : 10=3.16%, 20=17.74%, 50=43.62%, 100=23.05%, 250=12.24% lat (msec) : 500=0.16%, 2000=0.03% cpu : usr=0.06%, sys=1.62%, ctx=4677, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179179: Sun Sep 13 06:09:06 2026 read: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6052KiB/157217msec) clat (msec): min=5, max=326, avg=41.07, stdev=39.58 lat (msec): min=5, max=326, avg=41.07, stdev=39.58 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 121], | 99.00th=[ 188], 99.50th=[ 218], 99.90th=[ 321], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 159, per=25.94%, avg=39.43, stdev=28.73, samples=299 iops : min= 1, max= 39, avg= 9.19, stdev= 7.22, samples=299 write: IOPS=9, BW=39.7KiB/s (40.6kB/s)(6236KiB/157217msec); 0 zone resets clat (msec): min=10, max=1345, avg=60.64, stdev=55.41 lat (msec): min=10, max=1345, avg=60.65, stdev=55.41 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 120], 95.00th=[ 153], | 99.00th=[ 224], 99.50th=[ 255], 99.90th=[ 376], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 143, per=25.12%, avg=39.94, stdev=26.61, samples=304 iops : min= 1, max= 35, avg= 9.32, stdev= 6.70, samples=304 lat (msec) : 10=3.61%, 20=18.95%, 50=42.94%, 100=22.49%, 250=11.59% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=1.64%, ctx=4730, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=152KiB/s (156kB/s), 37.6KiB/s-38.5KiB/s (38.5kB/s-39.4kB/s), io=23.4MiB (24.6MB), run=157217-157865msec WRITE: bw=159KiB/s (163kB/s), 39.7KiB/s-40.2KiB/s (40.6kB/s-41.2kB/s), io=24.6MiB (25.7MB), run=157217-157865msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179214: Sun Sep 13 06:09:41 2026 read: IOPS=15, BW=243KiB/s (248kB/s)(5920KiB/24399msec) clat (usec): min=47, max=176090, avg=36422.02, stdev=26673.61 lat (usec): min=47, max=176091, avg=36423.15, stdev=26673.54 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 60], 10.00th=[ 10290], 20.00th=[ 18744], | 30.00th=[ 23462], 40.00th=[ 26084], 50.00th=[ 31327], 60.00th=[ 36439], | 70.00th=[ 43254], 80.00th=[ 51643], 90.00th=[ 64750], 95.00th=[ 79168], | 99.00th=[170918], 99.50th=[175113], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 95, max= 478, per=26.10%, avg=240.67, stdev=86.67, samples=48 iops : min= 5, max= 29, avg=14.25, stdev= 5.44, samples=48 write: IOPS=16, BW=261KiB/s (267kB/s)(6368KiB/24399msec); 0 zone resets clat (usec): min=1075, max=246901, avg=27265.67, stdev=30000.05 lat (usec): min=1076, max=246904, avg=27286.28, stdev=30013.33 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1696], 10.00th=[ 1942], 20.00th=[ 3785], | 30.00th=[ 6456], 40.00th=[ 11338], 50.00th=[ 19268], 60.00th=[ 26084], | 70.00th=[ 34341], 80.00th=[ 44303], 90.00th=[ 63177], 95.00th=[ 82314], | 99.00th=[139461], 99.50th=[183501], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 95, max= 447, per=26.87%, avg=260.62, stdev=88.21, samples=48 iops : min= 5, max= 27, avg=15.52, stdev= 5.50, samples=48 lat (usec) : 50=0.13%, 100=4.17% lat (msec) : 2=5.73%, 4=5.08%, 10=8.98%, 20=13.93%, 50=42.84% lat (msec) : 100=16.93%, 250=2.21% cpu : usr=0.05%, sys=6.41%, ctx=1569, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179215: Sun Sep 13 06:09:41 2026 read: IOPS=14, BW=226KiB/s (231kB/s)(5744KiB/25449msec) clat (usec): min=34, max=170811, avg=38146.65, stdev=27024.31 lat (usec): min=35, max=170812, avg=38152.59, stdev=27023.41 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 12125], 20.00th=[ 19006], | 30.00th=[ 22938], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 39060], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[137364], 99.50th=[149947], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 58, max= 416, per=24.26%, avg=223.72, stdev=80.16, samples=50 iops : min= 3, max= 26, avg=13.20, stdev= 5.10, samples=50 write: IOPS=16, BW=257KiB/s (263kB/s)(6544KiB/25449msec); 0 zone resets clat (usec): min=1067, max=144326, avg=28178.72, stdev=26631.28 lat (usec): min=1069, max=144328, avg=28180.52, stdev=26631.29 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1696], 10.00th=[ 2008], 20.00th=[ 4146], | 30.00th=[ 7701], 40.00th=[ 13960], 50.00th=[ 21103], 60.00th=[ 29754], | 70.00th=[ 36963], 80.00th=[ 50070], 90.00th=[ 67634], 95.00th=[ 78119], | 99.00th=[111674], 99.50th=[135267], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 63, max= 608, per=26.32%, avg=255.28, stdev=100.48, samples=50 iops : min= 3, max= 38, avg=15.20, stdev= 6.33, samples=50 lat (usec) : 50=0.26%, 100=3.39%, 250=0.26%, 1000=0.13% lat (msec) : 2=5.21%, 4=5.21%, 10=7.55%, 20=14.19%, 50=42.45% lat (msec) : 100=18.49%, 250=2.86% cpu : usr=0.07%, sys=6.27%, ctx=1667, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179216: Sun Sep 13 06:09:41 2026 read: IOPS=15, BW=241KiB/s (247kB/s)(6256KiB/25961msec) clat (usec): min=38, max=199051, avg=35675.86, stdev=23966.43 lat (usec): min=38, max=199052, avg=35678.71, stdev=23967.95 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 7111], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 28181], 50.00th=[ 32900], 60.00th=[ 38011], | 70.00th=[ 43254], 80.00th=[ 51643], 90.00th=[ 61604], 95.00th=[ 74974], | 99.00th=[121111], 99.50th=[135267], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 29, max= 477, per=26.15%, avg=241.14, stdev=97.37, samples=51 iops : min= 1, max= 29, avg=14.29, stdev= 6.12, samples=51 write: IOPS=14, BW=232KiB/s (238kB/s)(6032KiB/25961msec); 0 zone resets clat (usec): min=1099, max=202824, avg=31245.48, stdev=30957.75 lat (usec): min=1101, max=202825, avg=31247.89, stdev=30957.33 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1745], 10.00th=[ 2245], 20.00th=[ 5014], | 30.00th=[ 9765], 40.00th=[ 15139], 50.00th=[ 22414], 60.00th=[ 30016], | 70.00th=[ 41157], 80.00th=[ 53216], 90.00th=[ 70779], 95.00th=[ 91751], | 99.00th=[152044], 99.50th=[170918], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 63, max= 510, per=23.51%, avg=228.00, stdev=99.74, samples=51 iops : min= 3, max= 31, avg=13.47, stdev= 6.27, samples=51 lat (usec) : 50=0.52%, 100=3.91%, 250=0.26%, 500=0.13% lat (msec) : 2=4.17%, 4=4.04%, 10=7.29%, 20=14.32%, 50=43.75% lat (msec) : 100=18.88%, 250=2.73% cpu : usr=0.09%, sys=5.74%, ctx=1670, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179217: Sun Sep 13 06:09:41 2026 read: IOPS=15, BW=247KiB/s (253kB/s)(6032KiB/24407msec) clat (usec): min=43, max=127174, avg=35605.59, stdev=24061.99 lat (usec): min=44, max=127176, avg=35607.52, stdev=24060.89 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 17957], | 30.00th=[ 22152], 40.00th=[ 26346], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 44303], 80.00th=[ 53216], 90.00th=[ 69731], 95.00th=[ 81265], | 99.00th=[105382], 99.50th=[109577], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 63, max= 415, per=26.71%, avg=246.23, stdev=90.22, samples=48 iops : min= 3, max= 25, avg=14.60, stdev= 5.63, samples=48 write: IOPS=16, BW=256KiB/s (262kB/s)(6256KiB/24407msec); 0 zone resets clat (usec): min=1012, max=145322, avg=27764.62, stdev=27343.42 lat (usec): min=1014, max=145325, avg=27766.56, stdev=27343.36 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1795], 10.00th=[ 2311], 20.00th=[ 4113], | 30.00th=[ 7570], 40.00th=[ 14615], 50.00th=[ 20317], 60.00th=[ 26608], | 70.00th=[ 34341], 80.00th=[ 45351], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[127402], 99.50th=[143655], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 63, max= 476, per=26.52%, avg=257.29, stdev=99.85, samples=48 iops : min= 3, max= 29, avg=15.31, stdev= 6.31, samples=48 lat (usec) : 50=0.65%, 100=4.95%, 250=0.39% lat (msec) : 2=4.04%, 4=5.73%, 10=8.33%, 20=13.54%, 50=41.28% lat (msec) : 100=19.14%, 250=1.95% cpu : usr=0.08%, sys=6.09%, ctx=1644, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=923KiB/s (945kB/s), 226KiB/s-247KiB/s (231kB/s-253kB/s), io=23.4MiB (24.5MB), run=24399-25961msec WRITE: bw=971KiB/s (994kB/s), 232KiB/s-261KiB/s (238kB/s-267kB/s), io=24.6MiB (25.8MB), run=24399-25961msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179219: Sun Sep 13 06:09:50 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5920KiB/34872msec) clat (msec): min=7, max=237, avg=37.14, stdev=32.62 lat (msec): min=7, max=237, avg=37.15, stdev=32.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 83], 95.00th=[ 110], | 99.00th=[ 163], 99.50th=[ 184], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 447, per=24.21%, avg=165.09, stdev=97.80, samples=68 iops : min= 1, max= 27, avg= 9.57, stdev= 6.20, samples=68 write: IOPS=11, BW=183KiB/s (187kB/s)(6368KiB/34872msec); 0 zone resets clat (msec): min=10, max=210, avg=52.21, stdev=34.24 lat (msec): min=10, max=210, avg=52.21, stdev=34.24 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 58], 80.00th=[ 73], 90.00th=[ 100], 95.00th=[ 134], | 99.00th=[ 167], 99.50th=[ 201], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 26, max= 448, per=25.11%, avg=180.28, stdev=101.34, samples=68 iops : min= 1, max= 28, avg=10.51, stdev= 6.42, samples=68 lat (msec) : 10=2.08%, 20=17.71%, 50=51.04%, 100=21.48%, 250=7.68% cpu : usr=0.06%, sys=1.83%, ctx=1086, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179220: Sun Sep 13 06:09:50 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(5744KiB/35093msec) clat (msec): min=5, max=221, avg=36.14, stdev=31.25 lat (msec): min=5, max=221, avg=36.14, stdev=31.25 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 83], 95.00th=[ 107], | 99.00th=[ 153], 99.50th=[ 163], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 26, max= 443, per=23.75%, avg=161.96, stdev=105.98, samples=69 iops : min= 1, max= 27, avg= 9.36, stdev= 6.73, samples=69 write: IOPS=11, BW=186KiB/s (191kB/s)(6544KiB/35093msec); 0 zone resets clat (msec): min=11, max=215, avg=53.31, stdev=33.16 lat (msec): min=11, max=215, avg=53.31, stdev=33.16 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 102], 95.00th=[ 124], | 99.00th=[ 144], 99.50th=[ 163], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 509, per=26.08%, avg=187.22, stdev=103.33, samples=68 iops : min= 1, max= 31, avg=10.96, stdev= 6.51, samples=68 lat (msec) : 10=2.08%, 20=19.40%, 50=47.40%, 100=23.05%, 250=8.07% cpu : usr=0.06%, sys=1.90%, ctx=1176, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179221: Sun Sep 13 06:09:50 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(6256KiB/34944msec) clat (msec): min=6, max=157, avg=34.00, stdev=26.93 lat (msec): min=6, max=157, avg=34.00, stdev=26.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 72], 95.00th=[ 95], | 99.00th=[ 133], 99.50th=[ 155], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 31, max= 733, per=26.68%, avg=181.97, stdev=127.45, samples=68 iops : min= 1, max= 45, avg=10.62, stdev= 7.99, samples=68 write: IOPS=10, BW=173KiB/s (177kB/s)(6032KiB/34944msec); 0 zone resets clat (msec): min=12, max=220, avg=57.20, stdev=40.31 lat (msec): min=12, max=220, avg=57.21, stdev=40.31 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 117], 95.00th=[ 144], | 99.00th=[ 201], 99.50th=[ 211], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 62, max= 446, per=23.94%, avg=171.90, stdev=95.03, samples=69 iops : min= 3, max= 27, avg= 9.99, stdev= 6.04, samples=69 lat (msec) : 10=2.86%, 20=20.57%, 50=45.44%, 100=22.53%, 250=8.59% cpu : usr=0.04%, sys=1.79%, ctx=1153, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179222: Sun Sep 13 06:09:50 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34732msec) clat (msec): min=6, max=251, avg=37.07, stdev=32.23 lat (msec): min=6, max=251, avg=37.07, stdev=32.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 157], 99.50th=[ 178], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 544, per=25.56%, avg=174.30, stdev=111.03, samples=67 iops : min= 1, max= 34, avg=10.15, stdev= 7.04, samples=67 write: IOPS=11, BW=180KiB/s (184kB/s)(6256KiB/34732msec); 0 zone resets clat (msec): min=12, max=202, avg=52.34, stdev=36.03 lat (msec): min=12, max=202, avg=52.35, stdev=36.03 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 58], 80.00th=[ 78], 90.00th=[ 104], 95.00th=[ 134], | 99.00th=[ 184], 99.50th=[ 199], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 30, max= 478, per=24.76%, avg=177.78, stdev=102.54, samples=68 iops : min= 1, max= 29, avg=10.35, stdev= 6.48, samples=68 lat (msec) : 10=1.82%, 20=19.92%, 50=48.83%, 100=21.61%, 250=7.68% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.94%, ctx=1155, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=683KiB/s (699kB/s), 164KiB/s-179KiB/s (168kB/s-183kB/s), io=23.4MiB (24.5MB), run=34732-35093msec WRITE: bw=718KiB/s (735kB/s), 173KiB/s-186KiB/s (177kB/s-191kB/s), io=24.6MiB (25.8MB), run=34732-35093msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179239: Sun Sep 13 06:10:07 2026 read: IOPS=1, BW=1194KiB/s (1223kB/s)(7168KiB/6001msec) clat (usec): min=640, max=3045.0k, avg=569153.02, stdev=1096364.74 lat (usec): min=641, max=3045.0k, avg=569154.54, stdev=1096364.52 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], | 20.00th=[ 66323], 30.00th=[ 145753], 40.00th=[ 145753], | 50.00th=[ 221250], 60.00th=[ 244319], 70.00th=[ 244319], | 80.00th=[ 261096], 90.00th=[3036677], 95.00th=[3036677], | 99.00th=[3036677], 99.50th=[3036677], 99.90th=[3036677], | 99.95th=[3036677], 99.99th=[3036677] bw ( KiB/s): min= 1368, max= 4039, per=77.73%, avg=2249.60, stdev=1032.61, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=853KiB/s (874kB/s)(5120KiB/6001msec); 0 zone resets clat (msec): min=249, max=525, avg=356.26, stdev=111.54 lat (msec): min=253, max=525, avg=357.13, stdev=110.63 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1861, max= 4039, per=64.82%, avg=2626.67, stdev=1224.56, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.00%, ctx=635, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179240: Sun Sep 13 06:10:07 2026 read: IOPS=0, BW=289KiB/s (296kB/s)(2048KiB/7075msec) clat (msec): min=353, max=591, avg=472.83, stdev=168.26 lat (msec): min=353, max=591, avg=472.84, stdev=168.26 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2019, max= 2035, per=70.04%, avg=2027.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1447KiB/s (1482kB/s)(10.0MiB/7075msec); 0 zone resets clat (msec): min=183, max=2530, avg=597.05, stdev=719.68 lat (msec): min=183, max=2530, avg=597.15, stdev=719.67 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 197], | 30.00th=[ 236], 40.00th=[ 271], 50.00th=[ 288], 60.00th=[ 372], | 70.00th=[ 388], 80.00th=[ 514], 90.00th=[ 995], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1973, max= 4047, per=65.91%, avg=2670.50, stdev=1033.47, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.18%, ctx=127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179241: Sun Sep 13 06:10:07 2026 read: IOPS=1, BW=1064KiB/s (1090kB/s)(6144KiB/5774msec) clat (usec): min=510, max=403690, avg=176535.96, stdev=155393.88 lat (usec): min=512, max=403690, avg=176537.26, stdev=155393.46 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 8586], | 30.00th=[ 8586], 40.00th=[158335], 50.00th=[158335], 60.00th=[229639], | 70.00th=[258999], 80.00th=[258999], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 4000, max= 4039, per=100.00%, avg=4019.50, stdev=27.58, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1064KiB/s (1090kB/s)(6144KiB/5774msec); 0 zone resets clat (msec): min=134, max=3107, avg=775.61, stdev=1150.60 lat (msec): min=134, max=3107, avg=775.79, stdev=1150.59 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 372], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1356, max= 2035, per=45.59%, avg=1847.50, stdev=328.48, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=7.15%, ctx=144, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179242: Sun Sep 13 06:10:07 2026 read: IOPS=0, BW=747KiB/s (765kB/s)(5120KiB/6856msec) clat (usec): min=527, max=269377, avg=145208.91, stdev=133741.47 lat (usec): min=529, max=269379, avg=145210.56, stdev=133741.31 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 996], 40.00th=[ 996], 50.00th=[206570], 60.00th=[206570], | 70.00th=[248513], 80.00th=[248513], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 3723, max= 4039, per=100.00%, avg=3881.00, stdev=223.45, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1046KiB/s (1071kB/s)(7168KiB/6856msec); 0 zone resets clat (msec): min=273, max=3093, avg=837.91, stdev=1004.02 lat (msec): min=273, max=3093, avg=837.99, stdev=1004.02 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 321], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 527], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 667], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 2000, max= 3961, per=61.82%, avg=2504.75, stdev=970.94, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=5.53%, ctx=108, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2895KiB/s (2964kB/s), 289KiB/s-1194KiB/s (296kB/s-1223kB/s), io=20.0MiB (20.0MB), run=5774-7075msec WRITE: bw=4053KiB/s (4150kB/s), 853KiB/s-1447KiB/s (874kB/s-1482kB/s), io=28.0MiB (29.4MB), run=5774-7075msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179234: Sun Sep 13 06:10:07 2026 read: IOPS=1, BW=1208KiB/s (1237kB/s)(7168KiB/5933msec) clat (msec): min=102, max=2561, avg=583.17, stdev=880.69 lat (msec): min=102, max=2561, avg=583.17, stdev=880.69 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 116], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 334], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 414], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1992, max= 2856, per=75.35%, avg=2195.60, stdev=369.86, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=0, BW=863KiB/s (884kB/s)(5120KiB/5933msec); 0 zone resets clat (msec): min=249, max=544, avg=355.19, stdev=116.05 lat (msec): min=249, max=547, avg=355.92, stdev=117.39 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1976, max= 3835, per=64.21%, avg=2619.67, stdev=1053.13, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.41%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179235: Sun Sep 13 06:10:07 2026 read: IOPS=0, BW=291KiB/s (298kB/s)(2048KiB/7027msec) clat (msec): min=111, max=123, avg=117.44, stdev= 8.47 lat (msec): min=111, max=123, avg=117.44, stdev= 8.47 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 124], | 70.00th=[ 124], 80.00th=[ 124], 90.00th=[ 124], 95.00th=[ 124], | 99.00th=[ 124], 99.50th=[ 124], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 1582, max= 1976, per=61.05%, avg=1779.00, stdev=278.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1457KiB/s (1492kB/s)(10.0MiB/7027msec); 0 zone resets clat (msec): min=121, max=2445, avg=662.76, stdev=689.32 lat (msec): min=121, max=2445, avg=662.88, stdev=689.30 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 279], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 384], 60.00th=[ 393], | 70.00th=[ 558], 80.00th=[ 726], 90.00th=[ 1133], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1976, max= 4096, per=56.75%, avg=2315.57, stdev=785.56, samples=7 iops : min= 1, max= 4, avg= 1.57, stdev= 1.13, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.83%, ctx=122, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179236: Sun Sep 13 06:10:07 2026 read: IOPS=0, BW=884KiB/s (905kB/s)(6144KiB/6953msec) clat (msec): min=94, max=612, avg=324.49, stdev=178.95 lat (msec): min=94, max=612, avg=324.49, stdev=178.95 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 330], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1917, max= 2048, per=68.47%, avg=1995.20, stdev=53.77, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=884KiB/s (905kB/s)(6144KiB/6953msec); 0 zone resets clat (msec): min=121, max=3020, avg=809.42, stdev=1101.10 lat (msec): min=121, max=3020, avg=809.51, stdev=1101.10 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 527], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1486, max= 2048, per=47.24%, avg=1927.50, stdev=218.23, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.62%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179238: Sun Sep 13 06:10:07 2026 read: IOPS=0, BW=879KiB/s (900kB/s)(5120KiB/5824msec) clat (msec): min=96, max=181, avg=121.17, stdev=35.62 lat (msec): min=96, max=181, avg=121.17, stdev=35.62 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 102], 60.00th=[ 102], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1992, max= 5930, per=100.00%, avg=3961.00, stdev=2784.59, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1231KiB/s (1260kB/s)(7168KiB/5824msec); 0 zone resets clat (msec): min=115, max=3423, avg=734.45, stdev=1192.07 lat (msec): min=115, max=3423, avg=734.59, stdev=1192.06 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 167], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 347], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 464], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 1575, max= 5976, per=83.06%, avg=3388.75, stdev=2052.41, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=2.58%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2914KiB/s (2984kB/s), 291KiB/s-1208KiB/s (298kB/s-1237kB/s), io=20.0MiB (20.0MB), run=5824-7027msec WRITE: bw=4080KiB/s (4178kB/s), 863KiB/s-1457KiB/s (884kB/s-1492kB/s), io=28.0MiB (29.4MB), run=5824-7027msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179249: Sun Sep 13 06:10:21 2026 read: IOPS=1, BW=5928KiB/s (6070kB/s)(12.0MiB/2073msec) clat (msec): min=537, max=739, avg=631.12, stdev=101.76 lat (msec): min=537, max=739, avg=631.12, stdev=101.76 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7984, max= 8143, per=100.00%, avg=8063.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=20.08%, ctx=396, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179250: Sun Sep 13 06:10:21 2026 read: IOPS=0, BW=1806KiB/s (1849kB/s)(4096KiB/2268msec) clat (nsec): min=525143k, max=525143k, avg=525143419.00, stdev= 0.00 lat (nsec): min=525145k, max=525145k, avg=525144899.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3612KiB/s (3699kB/s)(8192KiB/2268msec); 0 zone resets clat (msec): min=191, max=1397, avg=794.58, stdev=853.10 lat (msec): min=192, max=1398, avg=795.48, stdev=852.23 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7984, max= 7984, per=63.11%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.93%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179251: Sun Sep 13 06:10:21 2026 write: IOPS=1, BW=5207KiB/s (5332kB/s)(12.0MiB/2360msec); 0 zone resets clat (msec): min=514, max=988, avg=720.55, stdev=242.70 lat (msec): min=515, max=988, avg=720.96, stdev=242.57 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7984, max= 8192, per=63.93%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.02%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179252: Sun Sep 13 06:10:21 2026 write: IOPS=1, BW=4744KiB/s (4858kB/s)(12.0MiB/2590msec); 0 zone resets clat (msec): min=218, max=1959, avg=804.33, stdev=1000.11 lat (msec): min=219, max=1960, avg=805.06, stdev=1000.68 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 7111, max= 7984, per=59.66%, avg=7547.50, stdev=617.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.10%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7224KiB/s (7397kB/s), 1806KiB/s-5928KiB/s (1849kB/s-6070kB/s), io=16.0MiB (16.8MB), run=2073-2268msec WRITE: bw=12.4MiB/s (12.0MB/s), 3612KiB/s-5207KiB/s (3699kB/s-5332kB/s), io=32.0MiB (33.6MB), run=2268-2590msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179253: Sun Sep 13 06:10:22 2026 read: IOPS=0, BW=4082KiB/s (4180kB/s)(12.0MiB/3010msec) clat (msec): min=230, max=1392, avg=932.76, stdev=617.74 lat (msec): min=230, max=1392, avg=932.76, stdev=617.74 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.49%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179254: Sun Sep 13 06:10:22 2026 read: IOPS=0, BW=1409KiB/s (1443kB/s)(4096KiB/2907msec) clat (nsec): min=1840.5M, max=1840.5M, avg=1840475361.00, stdev= 0.00 lat (nsec): min=1840.5M, max=1840.5M, avg=1840477634.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1838], 5.00th=[ 1838], 10.00th=[ 1838], 20.00th=[ 1838], | 30.00th=[ 1838], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2818KiB/s (2886kB/s)(8192KiB/2907msec); 0 zone resets clat (msec): min=353, max=462, avg=408.12, stdev=77.04 lat (msec): min=353, max=462, avg=408.46, stdev=77.07 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 8126, max= 8126, per=72.09%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.27%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179255: Sun Sep 13 06:10:22 2026 write: IOPS=1, BW=4378KiB/s (4483kB/s)(12.0MiB/2807msec); 0 zone resets clat (msec): min=299, max=1359, avg=901.51, stdev=544.66 lat (msec): min=299, max=1359, avg=901.80, stdev=544.65 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8126, max= 8175, per=72.31%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.10%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179256: Sun Sep 13 06:10:22 2026 write: IOPS=1, BW=4446KiB/s (4552kB/s)(12.0MiB/2764msec); 0 zone resets clat (msec): min=272, max=1691, avg=837.30, stdev=752.17 lat (msec): min=273, max=1691, avg=837.68, stdev=752.14 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 6860, max= 8143, per=66.55%, avg=7501.50, stdev=907.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.94%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5443KiB/s (5574kB/s), 1409KiB/s-4082KiB/s (1443kB/s-4180kB/s), io=16.0MiB (16.8MB), run=2907-3010msec WRITE: bw=11.0MiB/s (11.5MB/s), 2818KiB/s-4446KiB/s (2886kB/s-4552kB/s), io=32.0MiB (33.6MB), run=2764-2907msec