== sanity test 398b: DIO and buffer IO race ============== 09:35:24 (1787751324) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.31718 s, 6.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178503: Wed Aug 26 09:38:17 2026 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(5992KiB/147433msec) clat (usec): min=48, max=1189.3k, avg=54648.48, stdev=46404.02 lat (usec): min=49, max=1189.3k, avg=54650.19, stdev=46404.00 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 13566], 10.00th=[ 19792], | 20.00th=[ 26608], 30.00th=[ 33424], 40.00th=[ 39584], | 50.00th=[ 45876], 60.00th=[ 52691], 70.00th=[ 62653], | 80.00th=[ 76022], 90.00th=[ 96994], 95.00th=[ 120062], | 99.00th=[ 183501], 99.50th=[ 208667], 99.90th=[ 320865], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 103, per=25.21%, avg=40.59, stdev=17.46, samples=288 iops : min= 1, max= 25, avg= 9.49, stdev= 4.37, samples=288 write: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6296KiB/147433msec); 0 zone resets clat (usec): min=1020, max=304128, avg=41219.93, stdev=42263.93 lat (usec): min=1021, max=304130, avg=41227.25, stdev=42264.95 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1401], 10.00th=[ 2147], 20.00th=[ 5080], | 30.00th=[ 9765], 40.00th=[ 19792], 50.00th=[ 30540], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[128451], | 99.00th=[185598], 99.50th=[223347], 99.90th=[295699], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 6, max= 135, per=25.32%, avg=42.79, stdev=20.74, samples=287 iops : min= 1, max= 33, avg=10.04, stdev= 5.22, samples=287 lat (usec) : 50=0.03%, 100=1.04%, 250=0.13%, 500=0.03%, 1000=0.10% lat (msec) : 2=4.98%, 4=3.71%, 10=7.10%, 20=8.40%, 50=36.49% lat (msec) : 100=28.68%, 250=8.98%, 500=0.29%, 2000=0.03% cpu : usr=0.09%, sys=4.76%, ctx=6713, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178504: Wed Aug 26 09:38:17 2026 read: IOPS=10, BW=40.9KiB/s (41.9kB/s)(5940KiB/145085msec) clat (usec): min=36, max=1271.1k, avg=53932.87, stdev=47927.01 lat (usec): min=36, max=1271.1k, avg=53938.93, stdev=47927.46 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 13698], 10.00th=[ 19268], | 20.00th=[ 26346], 30.00th=[ 31327], 40.00th=[ 38011], | 50.00th=[ 45876], 60.00th=[ 53216], 70.00th=[ 62653], | 80.00th=[ 76022], 90.00th=[ 95945], 95.00th=[ 121111], | 99.00th=[ 175113], 99.50th=[ 221250], 99.90th=[ 337642], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=40.87, stdev=18.08, samples=283 iops : min= 1, max= 25, avg= 9.55, stdev= 4.56, samples=283 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6348KiB/145085msec); 0 zone resets clat (usec): min=1050, max=400411, avg=40516.73, stdev=42769.97 lat (usec): min=1051, max=400414, avg=40522.69, stdev=42768.31 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1450], 10.00th=[ 2245], 20.00th=[ 5080], | 30.00th=[ 9634], 40.00th=[ 17957], 50.00th=[ 28967], 60.00th=[ 39060], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 98042], 95.00th=[126354], | 99.00th=[181404], 99.50th=[204473], 99.90th=[387974], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 111, per=25.81%, avg=43.62, stdev=20.50, samples=283 iops : min= 1, max= 27, avg=10.25, stdev= 5.14, samples=283 lat (usec) : 50=0.07%, 100=1.24%, 250=0.29%, 750=0.03% lat (msec) : 2=4.59%, 4=3.97%, 10=7.32%, 20=9.38%, 50=36.10% lat (msec) : 100=27.73%, 250=9.08%, 500=0.16%, 2000=0.03% cpu : usr=0.09%, sys=4.87%, ctx=6606, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178505: Wed Aug 26 09:38:17 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6028KiB/144703msec) clat (usec): min=42, max=491605, avg=53236.90, stdev=36305.40 lat (usec): min=42, max=491607, avg=53239.86, stdev=36305.64 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 13829], 10.00th=[ 20317], 20.00th=[ 26346], | 30.00th=[ 33162], 40.00th=[ 40109], 50.00th=[ 46924], 60.00th=[ 54264], | 70.00th=[ 62653], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[113771], | 99.00th=[166724], 99.50th=[221250], 99.90th=[379585], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 7, max= 111, per=25.74%, avg=41.45, stdev=17.45, samples=283 iops : min= 1, max= 27, avg= 9.71, stdev= 4.38, samples=283 write: IOPS=10, BW=43.3KiB/s (44.3kB/s)(6260KiB/144703msec); 0 zone resets clat (usec): min=894, max=1217.4k, avg=40774.85, stdev=50824.69 lat (usec): min=895, max=1217.4k, avg=40784.25, stdev=50822.56 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1434], 10.00th=[ 2073], | 20.00th=[ 4817], 30.00th=[ 8979], 40.00th=[ 18220], | 50.00th=[ 28443], 60.00th=[ 38536], 70.00th=[ 52167], | 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[ 122160], | 99.00th=[ 173016], 99.50th=[ 208667], 99.90th=[ 325059], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 111, per=25.56%, avg=43.20, stdev=20.45, samples=282 iops : min= 1, max= 27, avg=10.15, stdev= 5.15, samples=282 lat (usec) : 50=0.13%, 100=1.53%, 250=0.07%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.79%, 4=4.20%, 10=7.19%, 20=7.91%, 50=35.55% lat (msec) : 100=29.98%, 250=8.30%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=4.87%, ctx=6704, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178506: Wed Aug 26 09:38:17 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6052KiB/148300msec) clat (usec): min=46, max=367012, avg=54381.74, stdev=36634.26 lat (usec): min=47, max=367014, avg=54384.44, stdev=36633.91 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 14615], 10.00th=[ 20055], 20.00th=[ 26608], | 30.00th=[ 33162], 40.00th=[ 39584], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 78119], 90.00th=[ 96994], 95.00th=[120062], | 99.00th=[170918], 99.50th=[212861], 99.90th=[329253], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 95, per=25.28%, avg=40.71, stdev=17.10, samples=289 iops : min= 1, max= 23, avg= 9.51, stdev= 4.30, samples=289 write: IOPS=10, BW=42.0KiB/s (43.1kB/s)(6236KiB/148300msec); 0 zone resets clat (usec): min=990, max=1208.7k, avg=41941.08, stdev=51880.36 lat (usec): min=990, max=1208.7k, avg=41950.76, stdev=51878.53 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1401], 10.00th=[ 2212], | 20.00th=[ 5014], 30.00th=[ 9634], 40.00th=[ 19006], | 50.00th=[ 28443], 60.00th=[ 40109], 70.00th=[ 53740], | 80.00th=[ 69731], 90.00th=[ 100140], 95.00th=[ 128451], | 99.00th=[ 183501], 99.50th=[ 217056], 99.90th=[ 299893], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 104, per=24.90%, avg=42.08, stdev=19.47, samples=287 iops : min= 1, max= 26, avg= 9.87, stdev= 4.90, samples=287 lat (usec) : 50=0.03%, 100=0.94%, 250=0.23%, 750=0.07%, 1000=0.07% lat (msec) : 2=4.85%, 4=3.61%, 10=7.26%, 20=8.66%, 50=36.00% lat (msec) : 100=28.78%, 250=9.21%, 500=0.26%, 2000=0.03% cpu : usr=0.09%, sys=4.74%, ctx=6621, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=162KiB/s (166kB/s), 40.6KiB/s-41.7KiB/s (41.6kB/s-42.7kB/s), io=23.4MiB (24.6MB), run=144703-148300msec WRITE: bw=170KiB/s (174kB/s), 42.0KiB/s-43.8KiB/s (43.1kB/s-44.8kB/s), io=24.6MiB (25.7MB), run=144703-148300msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178508: Wed Aug 26 09:39:06 2026 read: IOPS=7, BW=30.4KiB/s (31.2kB/s)(5992KiB/196842msec) clat (msec): min=4, max=1281, avg=50.70, stdev=55.42 lat (msec): min=4, max=1281, avg=50.71, stdev=55.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 106], 95.00th=[ 148], | 99.00th=[ 230], 99.50th=[ 266], 99.90th=[ 422], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 127, per=25.88%, avg=31.32, stdev=21.20, samples=370 iops : min= 1, max= 31, avg= 7.15, stdev= 5.32, samples=370 write: IOPS=7, BW=31.0KiB/s (32.8kB/s)(6296KiB/196842msec); 0 zone resets clat (msec): min=13, max=477, avg=76.68, stdev=52.54 lat (msec): min=13, max=477, avg=76.69, stdev=52.54 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 72], | 70.00th=[ 87], 80.00th=[ 111], 90.00th=[ 146], 95.00th=[ 182], | 99.00th=[ 262], 99.50th=[ 300], 99.90th=[ 397], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 95, per=25.13%, avg=31.91, stdev=17.87, samples=381 iops : min= 1, max= 23, avg= 7.30, stdev= 4.49, samples=381 lat (msec) : 10=1.11%, 20=9.67%, 50=42.64%, 100=28.81%, 250=16.76% lat (msec) : 500=0.98%, 2000=0.03% cpu : usr=0.07%, sys=1.71%, ctx=4758, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178509: Wed Aug 26 09:39:06 2026 read: IOPS=7, BW=30.1KiB/s (30.8kB/s)(5940KiB/197333msec) clat (msec): min=6, max=1248, avg=51.11, stdev=54.62 lat (msec): min=6, max=1248, avg=51.12, stdev=54.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 115], 95.00th=[ 148], | 99.00th=[ 232], 99.50th=[ 257], 99.90th=[ 305], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 119, per=25.51%, avg=30.87, stdev=20.76, samples=372 iops : min= 1, max= 29, avg= 7.04, stdev= 5.21, samples=372 write: IOPS=8, BW=32.2KiB/s (32.9kB/s)(6348KiB/197333msec); 0 zone resets clat (msec): min=12, max=409, avg=76.36, stdev=51.91 lat (msec): min=12, max=409, avg=76.37, stdev=51.91 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 72], | 70.00th=[ 90], 80.00th=[ 112], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 257], 99.50th=[ 317], 99.90th=[ 401], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 95, per=25.18%, avg=31.98, stdev=18.43, samples=383 iops : min= 1, max= 23, avg= 7.31, stdev= 4.63, samples=383 lat (msec) : 10=1.04%, 20=10.03%, 50=41.63%, 100=28.58%, 250=17.90% lat (msec) : 500=0.78%, 2000=0.03% cpu : usr=0.07%, sys=1.64%, ctx=4747, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178510: Wed Aug 26 09:39:06 2026 read: IOPS=7, BW=30.6KiB/s (31.4kB/s)(6028KiB/196864msec) clat (msec): min=5, max=390, avg=51.25, stdev=46.03 lat (msec): min=5, max=390, avg=51.26, stdev=46.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 74], 90.00th=[ 110], 95.00th=[ 157], | 99.00th=[ 213], 99.50th=[ 255], 99.90th=[ 309], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 112, per=25.72%, avg=31.13, stdev=19.63, samples=374 iops : min= 1, max= 28, avg= 7.10, stdev= 4.94, samples=374 write: IOPS=7, BW=31.8KiB/s (32.6kB/s)(6260KiB/196864msec); 0 zone resets clat (msec): min=13, max=1345, avg=76.34, stdev=61.27 lat (msec): min=13, max=1345, avg=76.34, stdev=61.27 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 109], 90.00th=[ 142], 95.00th=[ 180], | 99.00th=[ 247], 99.50th=[ 334], 99.90th=[ 498], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 103, per=24.92%, avg=31.65, stdev=18.93, samples=382 iops : min= 1, max= 25, avg= 7.24, stdev= 4.75, samples=382 lat (msec) : 10=0.88%, 20=9.15%, 50=42.97%, 100=28.91%, 250=17.32% lat (msec) : 500=0.75%, 2000=0.03% cpu : usr=0.06%, sys=1.63%, ctx=4676, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178511: Wed Aug 26 09:39:06 2026 read: IOPS=7, BW=30.8KiB/s (31.5kB/s)(6052KiB/196693msec) clat (msec): min=6, max=426, avg=51.19, stdev=47.10 lat (msec): min=6, max=426, avg=51.19, stdev=47.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 71], 90.00th=[ 115], 95.00th=[ 157], | 99.00th=[ 222], 99.50th=[ 264], 99.90th=[ 380], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 111, per=26.34%, avg=31.87, stdev=20.72, samples=368 iops : min= 1, max= 27, avg= 7.29, stdev= 5.21, samples=368 write: IOPS=7, BW=31.7KiB/s (32.5kB/s)(6236KiB/196693msec); 0 zone resets clat (msec): min=10, max=1337, avg=76.39, stdev=60.54 lat (msec): min=10, max=1337, avg=76.39, stdev=60.54 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 72], | 70.00th=[ 87], 80.00th=[ 108], 90.00th=[ 140], 95.00th=[ 178], | 99.00th=[ 259], 99.50th=[ 300], 99.90th=[ 481], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 87, per=25.00%, avg=31.74, stdev=17.79, samples=380 iops : min= 1, max= 21, avg= 7.26, stdev= 4.47, samples=380 lat (msec) : 10=1.01%, 20=9.57%, 50=42.38%, 100=29.46%, 250=16.67% lat (msec) : 500=0.88%, 2000=0.03% cpu : usr=0.05%, sys=1.64%, ctx=4750, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=122KiB/s (125kB/s), 30.1KiB/s-30.8KiB/s (30.8kB/s-31.5kB/s), io=23.4MiB (24.6MB), run=196693-197333msec WRITE: bw=127KiB/s (130kB/s), 31.7KiB/s-32.2KiB/s (32.5kB/s-32.9kB/s), io=24.6MiB (25.7MB), run=196693-197333msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178559: Wed Aug 26 09:39:58 2026 read: IOPS=9, BW=148KiB/s (152kB/s)(5920KiB/39867msec) clat (usec): min=42, max=322193, avg=59138.11, stdev=39100.75 lat (usec): min=42, max=322194, avg=59139.72, stdev=39100.88 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 82], 10.00th=[ 19792], 20.00th=[ 31589], | 30.00th=[ 40633], 40.00th=[ 46924], 50.00th=[ 53740], 60.00th=[ 61604], | 70.00th=[ 70779], 80.00th=[ 82314], 90.00th=[101188], 95.00th=[120062], | 99.00th=[191890], 99.50th=[263193], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 288, per=24.51%, avg=147.08, stdev=56.90, samples=78 iops : min= 1, max= 18, avg= 8.41, stdev= 3.64, samples=78 write: IOPS=9, BW=160KiB/s (164kB/s)(6368KiB/39867msec); 0 zone resets clat (usec): min=1553, max=230031, avg=44666.09, stdev=43710.05 lat (usec): min=1556, max=230033, avg=44677.36, stdev=43702.43 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2147], 10.00th=[ 4228], 20.00th=[ 8291], | 30.00th=[ 13042], 40.00th=[ 20579], 50.00th=[ 31327], 60.00th=[ 41157], | 70.00th=[ 56361], 80.00th=[ 76022], 90.00th=[107480], 95.00th=[135267], | 99.00th=[200279], 99.50th=[214959], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 31, max= 319, per=25.19%, avg=159.23, stdev=68.43, samples=78 iops : min= 1, max= 19, avg= 9.18, stdev= 4.34, samples=78 lat (usec) : 50=0.26%, 100=2.99%, 250=0.26% lat (msec) : 2=1.95%, 4=2.73%, 10=7.42%, 20=9.51%, 50=30.60% lat (msec) : 100=33.20%, 250=10.68%, 500=0.39% cpu : usr=0.08%, sys=5.18%, ctx=1722, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178560: Wed Aug 26 09:39:58 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(5744KiB/38903msec) clat (usec): min=38, max=270515, avg=59264.24, stdev=38378.13 lat (usec): min=38, max=270517, avg=59269.35, stdev=38376.37 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 82], 10.00th=[ 21627], 20.00th=[ 32900], | 30.00th=[ 38536], 40.00th=[ 43779], 50.00th=[ 52167], 60.00th=[ 62129], | 70.00th=[ 73925], 80.00th=[ 85459], 90.00th=[104334], 95.00th=[126354], | 99.00th=[204473], 99.50th=[212861], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 286, per=24.60%, avg=147.57, stdev=58.37, samples=75 iops : min= 1, max= 17, avg= 8.43, stdev= 3.71, samples=75 write: IOPS=10, BW=168KiB/s (172kB/s)(6544KiB/38903msec); 0 zone resets clat (usec): min=1552, max=325301, avg=42630.99, stdev=44147.56 lat (usec): min=1554, max=325304, avg=42675.23, stdev=44148.02 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 3163], 10.00th=[ 4490], 20.00th=[ 8848], | 30.00th=[ 13960], 40.00th=[ 22152], 50.00th=[ 29754], 60.00th=[ 39060], | 70.00th=[ 48497], 80.00th=[ 67634], 90.00th=[ 98042], 95.00th=[129500], | 99.00th=[191890], 99.50th=[227541], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 377, per=26.34%, avg=166.49, stdev=76.63, samples=76 iops : min= 1, max= 23, avg= 9.62, stdev= 4.89, samples=76 lat (usec) : 50=0.13%, 100=2.73%, 250=0.52% lat (msec) : 2=0.65%, 4=4.30%, 10=6.64%, 20=8.72%, 50=36.85% lat (msec) : 100=28.78%, 250=10.29%, 500=0.39% cpu : usr=0.07%, sys=5.51%, ctx=1744, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178561: Wed Aug 26 09:39:58 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(6256KiB/39317msec) clat (usec): min=50, max=281965, avg=55676.02, stdev=36797.17 lat (usec): min=50, max=281966, avg=55677.71, stdev=36797.15 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 77], 10.00th=[ 701], 20.00th=[ 28705], | 30.00th=[ 35914], 40.00th=[ 43254], 50.00th=[ 52167], 60.00th=[ 58983], | 70.00th=[ 68682], 80.00th=[ 80217], 90.00th=[102237], 95.00th=[122160], | 99.00th=[166724], 99.50th=[181404], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 287, per=26.44%, avg=158.66, stdev=62.12, samples=77 iops : min= 1, max= 17, avg= 9.13, stdev= 3.93, samples=77 write: IOPS=9, BW=153KiB/s (157kB/s)(6032KiB/39317msec); 0 zone resets clat (usec): min=1469, max=286579, avg=46327.88, stdev=47812.87 lat (usec): min=1473, max=286581, avg=46330.91, stdev=47812.78 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 3064], 10.00th=[ 5080], 20.00th=[ 8717], | 30.00th=[ 13566], 40.00th=[ 21627], 50.00th=[ 32113], 60.00th=[ 42206], | 70.00th=[ 55837], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[135267], | 99.00th=[231736], 99.50th=[242222], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 30, max= 327, per=24.04%, avg=151.93, stdev=67.06, samples=76 iops : min= 1, max= 20, avg= 8.70, stdev= 4.23, samples=76 lat (usec) : 100=3.78%, 250=0.78%, 500=0.39%, 750=0.26%, 1000=0.13% lat (msec) : 2=1.17%, 4=2.08%, 10=8.07%, 20=7.94%, 50=31.90% lat (msec) : 100=32.03%, 250=11.20%, 500=0.26% cpu : usr=0.08%, sys=5.18%, ctx=1761, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178562: Wed Aug 26 09:39:58 2026 read: IOPS=9, BW=157KiB/s (160kB/s)(6032KiB/38512msec) clat (usec): min=51, max=249234, avg=56943.70, stdev=39791.08 lat (usec): min=52, max=249236, avg=56945.43, stdev=39790.72 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 79], 10.00th=[ 5735], 20.00th=[ 27919], | 30.00th=[ 35914], 40.00th=[ 42206], 50.00th=[ 52691], 60.00th=[ 59507], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[106431], 95.00th=[129500], | 99.00th=[204473], 99.50th=[235930], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 286, per=25.99%, avg=155.92, stdev=63.81, samples=76 iops : min= 1, max= 17, avg= 8.96, stdev= 4.07, samples=76 write: IOPS=10, BW=162KiB/s (166kB/s)(6256KiB/38512msec); 0 zone resets clat (usec): min=1848, max=268105, avg=43134.98, stdev=43265.65 lat (usec): min=1852, max=268107, avg=43140.64, stdev=43266.94 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 2769], 10.00th=[ 4424], 20.00th=[ 7111], | 30.00th=[ 11863], 40.00th=[ 19006], 50.00th=[ 29492], 60.00th=[ 40633], | 70.00th=[ 57410], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[127402], | 99.00th=[185598], 99.50th=[223347], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 352, per=25.63%, avg=161.99, stdev=80.41, samples=76 iops : min= 1, max= 22, avg= 9.33, stdev= 5.08, samples=76 lat (usec) : 100=3.91%, 250=0.52%, 500=0.13% lat (msec) : 2=1.04%, 4=3.65%, 10=9.64%, 20=8.59%, 50=29.95% lat (msec) : 100=31.25%, 250=11.20%, 500=0.13% cpu : usr=0.07%, sys=5.14%, ctx=1753, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=601KiB/s (615kB/s), 148KiB/s-159KiB/s (151kB/s-163kB/s), io=23.4MiB (24.5MB), run=38512-39867msec WRITE: bw=632KiB/s (647kB/s), 153KiB/s-168KiB/s (157kB/s-172kB/s), io=24.6MiB (25.8MB), run=38512-39867msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178564: Wed Aug 26 09:40:15 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(5920KiB/55461msec) clat (msec): min=10, max=276, avg=60.06, stdev=46.87 lat (msec): min=10, max=276, avg=60.06, stdev=46.87 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 83], 90.00th=[ 124], 95.00th=[ 159], | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 318, per=26.20%, avg=111.36, stdev=61.72, samples=104 iops : min= 1, max= 19, avg= 6.12, stdev= 3.89, samples=104 write: IOPS=7, BW=115KiB/s (118kB/s)(6368KiB/55461msec); 0 zone resets clat (msec): min=14, max=330, avg=83.02, stdev=51.82 lat (msec): min=14, max=330, avg=83.03, stdev=51.82 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 45], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 67], 60.00th=[ 77], | 70.00th=[ 92], 80.00th=[ 120], 90.00th=[ 161], 95.00th=[ 184], | 99.00th=[ 266], 99.50th=[ 296], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 287, per=26.09%, avg=116.62, stdev=58.69, samples=107 iops : min= 1, max= 17, avg= 6.46, stdev= 3.68, samples=107 lat (msec) : 20=4.04%, 50=39.19%, 100=36.07%, 250=19.53%, 500=1.17% cpu : usr=0.06%, sys=1.60%, ctx=1259, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178565: Wed Aug 26 09:40:15 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(5744KiB/56347msec) clat (msec): min=11, max=272, avg=59.12, stdev=48.56 lat (msec): min=11, max=272, avg=59.13, stdev=48.57 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 48], | 70.00th=[ 63], 80.00th=[ 88], 90.00th=[ 130], 95.00th=[ 171], | 99.00th=[ 228], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 29, max= 312, per=26.62%, avg=113.12, stdev=71.71, samples=100 iops : min= 1, max= 19, avg= 6.24, stdev= 4.50, samples=100 write: IOPS=7, BW=116KiB/s (119kB/s)(6544KiB/56347msec); 0 zone resets clat (msec): min=19, max=356, avg=85.63, stdev=57.62 lat (msec): min=19, max=356, avg=85.63, stdev=57.62 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 51], 40.00th=[ 59], 50.00th=[ 67], 60.00th=[ 80], | 70.00th=[ 94], 80.00th=[ 118], 90.00th=[ 176], 95.00th=[ 207], | 99.00th=[ 292], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 29, max= 319, per=25.84%, avg=115.51, stdev=64.29, samples=111 iops : min= 1, max= 19, avg= 6.39, stdev= 4.07, samples=111 lat (msec) : 20=5.34%, 50=39.71%, 100=32.42%, 250=21.09%, 500=1.43% cpu : usr=0.06%, sys=1.60%, ctx=1278, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178566: Wed Aug 26 09:40:15 2026 read: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55739msec) clat (msec): min=9, max=285, avg=60.36, stdev=49.30 lat (msec): min=9, max=285, avg=60.36, stdev=49.30 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 89], 90.00th=[ 126], 95.00th=[ 165], | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 351, per=26.62%, avg=113.13, stdev=72.37, samples=108 iops : min= 1, max= 21, avg= 6.24, stdev= 4.55, samples=108 write: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55739msec); 0 zone resets clat (msec): min=20, max=343, avg=85.12, stdev=56.39 lat (msec): min=20, max=343, avg=85.13, stdev=56.39 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 67], 60.00th=[ 77], | 70.00th=[ 96], 80.00th=[ 122], 90.00th=[ 167], 95.00th=[ 197], | 99.00th=[ 317], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 255, per=24.24%, avg=108.36, stdev=54.72, samples=107 iops : min= 1, max= 15, avg= 5.93, stdev= 3.45, samples=107 lat (msec) : 10=0.52%, 20=4.82%, 50=38.93%, 100=34.64%, 250=19.53% lat (msec) : 500=1.56% cpu : usr=0.06%, sys=1.66%, ctx=1353, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178567: Wed Aug 26 09:40:15 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54699msec) clat (msec): min=8, max=259, avg=58.31, stdev=45.12 lat (msec): min=8, max=259, avg=58.31, stdev=45.12 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 82], 90.00th=[ 115], 95.00th=[ 165], | 99.00th=[ 243], 99.50th=[ 259], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 379, per=27.23%, avg=115.73, stdev=64.46, samples=101 iops : min= 1, max= 23, avg= 6.40, stdev= 4.06, samples=101 write: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54699msec); 0 zone resets clat (msec): min=22, max=375, avg=83.50, stdev=54.95 lat (msec): min=22, max=375, avg=83.50, stdev=54.95 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 57], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 94], 80.00th=[ 118], 90.00th=[ 161], 95.00th=[ 201], | 99.00th=[ 313], 99.50th=[ 334], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 30, max= 316, per=25.72%, avg=114.95, stdev=63.80, samples=106 iops : min= 1, max= 19, avg= 6.35, stdev= 4.03, samples=106 lat (msec) : 10=0.26%, 20=5.47%, 50=38.15%, 100=35.94%, 250=19.01% lat (msec) : 500=1.17% cpu : usr=0.06%, sys=1.63%, ctx=1197, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=425KiB/s (435kB/s), 102KiB/s-112KiB/s (104kB/s-115kB/s), io=23.4MiB (24.5MB), run=54699-56347msec WRITE: bw=447KiB/s (458kB/s), 108KiB/s-116KiB/s (111kB/s-119kB/s), io=24.6MiB (25.8MB), run=54699-56347msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178580: Wed Aug 26 09:40:31 2026 read: IOPS=1, BW=1166KiB/s (1194kB/s)(7168KiB/6146msec) clat (usec): min=591, max=2446.3k, avg=540395.75, stdev=853451.79 lat (usec): min=592, max=2446.4k, avg=540397.31, stdev=853451.92 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], | 20.00th=[ 85459], 30.00th=[ 200279], 40.00th=[ 200279], | 50.00th=[ 252707], 60.00th=[ 379585], 70.00th=[ 379585], | 80.00th=[ 417334], 90.00th=[2432697], 95.00th=[2432697], | 99.00th=[2432697], 99.50th=[2432697], 99.90th=[2432697], | 99.95th=[2432697], 99.99th=[2432697] bw ( KiB/s): min= 1528, max= 2039, per=57.84%, avg=1927.17, stdev=198.64, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=833KiB/s (853kB/s)(5120KiB/6146msec); 0 zone resets clat (msec): min=290, max=690, avg=459.12, stdev=189.10 lat (msec): min=291, max=690, avg=459.98, stdev=189.46 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2023, max= 4079, per=58.17%, avg=2713.67, stdev=1182.44, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=50.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=10.33%, ctx=396, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178581: Wed Aug 26 09:40:31 2026 read: IOPS=0, BW=372KiB/s (381kB/s)(2048KiB/5501msec) clat (msec): min=208, max=254, avg=231.56, stdev=32.50 lat (msec): min=208, max=254, avg=231.56, stdev=32.50 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 1458, max= 1950, per=51.14%, avg=1704.00, stdev=347.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1861KiB/s (1906kB/s)(10.0MiB/5501msec); 0 zone resets clat (msec): min=225, max=1028, avg=492.17, stdev=237.86 lat (msec): min=225, max=1029, avg=492.51, stdev=238.06 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 241], | 30.00th=[ 342], 40.00th=[ 401], 50.00th=[ 468], 60.00th=[ 472], | 70.00th=[ 502], 80.00th=[ 518], 90.00th=[ 726], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1950, max= 4000, per=54.87%, avg=2559.71, stdev=960.66, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=14.13%, ctx=250, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178582: Wed Aug 26 09:40:31 2026 read: IOPS=1, BW=1259KiB/s (1289kB/s)(6144KiB/4882msec) clat (usec): min=652, max=441608, avg=193322.30, stdev=202134.21 lat (usec): min=654, max=441609, avg=193323.98, stdev=202134.13 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 2835], | 30.00th=[ 2835], 40.00th=[ 33162], 50.00th=[ 33162], 60.00th=[333448], | 70.00th=[350225], 80.00th=[350225], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 2039, max= 4007, per=99.96%, avg=3330.67, stdev=1119.03, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1259KiB/s (1289kB/s)(6144KiB/4882msec); 0 zone resets clat (msec): min=159, max=1354, avg=610.96, stdev=564.26 lat (msec): min=159, max=1354, avg=611.19, stdev=564.17 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 1973, max= 3093, per=47.62%, avg=2221.60, stdev=487.69, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 50=8.33%, 250=16.67%, 500=41.67%, 2000=16.67% cpu : usr=0.00%, sys=11.70%, ctx=211, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178583: Wed Aug 26 09:40:31 2026 read: IOPS=1, BW=1106KiB/s (1133kB/s)(5120KiB/4628msec) clat (usec): min=848, max=231905, avg=116512.45, stdev=104578.19 lat (usec): min=849, max=231906, avg=116514.07, stdev=104578.50 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[ 848], | 30.00th=[ 21627], 40.00th=[ 21627], 50.00th=[122160], 60.00th=[122160], | 70.00th=[206570], 80.00th=[206570], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 2003, max= 5919, per=100.00%, avg=3961.00, stdev=2769.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1549KiB/s (1586kB/s)(7168KiB/4628msec); 0 zone resets clat (msec): min=190, max=1395, avg=574.87, stdev=469.56 lat (msec): min=190, max=1395, avg=575.13, stdev=469.51 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 262], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 338], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 1083], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1501, max= 4079, per=61.70%, avg=2878.25, stdev=1317.94, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 50=8.33%, 250=33.33%, 500=33.33%, 2000=16.67% cpu : usr=0.02%, sys=13.59%, ctx=100, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3332KiB/s (3412kB/s), 372KiB/s-1259KiB/s (381kB/s-1289kB/s), io=20.0MiB (20.0MB), run=4628-6146msec WRITE: bw=4665KiB/s (4777kB/s), 833KiB/s-1861KiB/s (853kB/s-1906kB/s), io=28.0MiB (29.4MB), run=4628-6146msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178585: Wed Aug 26 09:40:31 2026 read: IOPS=1, BW=1153KiB/s (1180kB/s)(7168KiB/6219msec) clat (msec): min=107, max=1468, avg=553.93, stdev=525.16 lat (msec): min=107, max=1468, avg=553.93, stdev=525.16 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 126], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 262], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 1020], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1882, max= 4087, per=73.03%, avg=2404.80, stdev=942.64, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=823KiB/s (843kB/s)(5120KiB/6219msec); 0 zone resets clat (msec): min=313, max=670, avg=455.52, stdev=145.85 lat (msec): min=314, max=670, avg=455.65, stdev=145.84 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2011, max= 4079, per=55.05%, avg=2538.00, stdev=1027.40, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 2000=16.67% cpu : usr=0.00%, sys=3.51%, ctx=138, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178586: Wed Aug 26 09:40:31 2026 read: IOPS=0, BW=340KiB/s (348kB/s)(2048KiB/6028msec) clat (msec): min=158, max=436, avg=297.31, stdev=196.23 lat (msec): min=158, max=436, avg=297.32, stdev=196.23 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2011, max= 2039, per=61.49%, avg=2025.00, stdev=19.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1699KiB/s (1740kB/s)(10.0MiB/6028msec); 0 zone resets clat (msec): min=142, max=1258, avg=526.80, stdev=387.73 lat (msec): min=142, max=1258, avg=526.96, stdev=387.67 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 182], | 30.00th=[ 203], 40.00th=[ 247], 50.00th=[ 363], 60.00th=[ 372], | 70.00th=[ 726], 80.00th=[ 810], 90.00th=[ 969], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1973, max= 4087, per=65.89%, avg=3037.33, stdev=1132.54, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.05%, sys=5.21%, ctx=126, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178587: Wed Aug 26 09:40:31 2026 read: IOPS=1, BW=1066KiB/s (1091kB/s)(6144KiB/5766msec) clat (msec): min=154, max=692, avg=441.34, stdev=232.07 lat (msec): min=154, max=692, avg=441.34, stdev=232.07 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 542], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2011, max= 4047, per=76.89%, avg=2532.00, stdev=1010.08, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1066KiB/s (1091kB/s)(6144KiB/5766msec); 0 zone resets clat (msec): min=114, max=1244, avg=505.85, stdev=428.14 lat (msec): min=119, max=1244, avg=506.84, stdev=427.16 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 477], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1835, max= 4047, per=51.09%, avg=2355.20, stdev=948.10, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, 2000=8.33% cpu : usr=0.00%, sys=4.23%, ctx=131, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178588: Wed Aug 26 09:40:31 2026 read: IOPS=0, BW=899KiB/s (920kB/s)(5120KiB/5696msec) clat (msec): min=126, max=769, avg=278.71, stdev=275.22 lat (msec): min=126, max=769, avg=278.71, stdev=275.22 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1910, max= 4023, per=80.74%, avg=2658.67, stdev=1183.42, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1258KiB/s (1289kB/s)(7168KiB/5696msec); 0 zone resets clat (msec): min=298, max=1287, avg=606.66, stdev=319.45 lat (msec): min=298, max=1287, avg=606.82, stdev=319.42 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 405], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 542], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 600], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1973, max= 4047, per=51.12%, avg=2356.67, stdev=828.48, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=16.67%, 750=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=4.50%, ctx=144, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3293KiB/s (3372kB/s), 340KiB/s-1153KiB/s (348kB/s-1180kB/s), io=20.0MiB (20.0MB), run=5696-6219msec WRITE: bw=4610KiB/s (4721kB/s), 823KiB/s-1699KiB/s (843kB/s-1740kB/s), io=28.0MiB (29.4MB), run=5696-6219msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178595: Wed Aug 26 09:40:47 2026 read: IOPS=1, BW=6774KiB/s (6937kB/s)(12.0MiB/1814msec) clat (msec): min=371, max=958, avg=579.66, stdev=328.63 lat (msec): min=371, max=958, avg=579.66, stdev=328.63 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 6692, max= 7670, per=100.00%, avg=7181.00, stdev=691.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.14%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178596: Wed Aug 26 09:40:47 2026 read: IOPS=0, BW=1226KiB/s (1256kB/s)(4096KiB/3340msec) clat (nsec): min=1342.8M, max=1342.8M, avg=1342805749.00, stdev= 0.00 lat (nsec): min=1342.8M, max=1342.8M, avg=1342807913.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7670, max= 7670, per=100.00%, avg=7670.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2453KiB/s (2512kB/s)(8192KiB/3340msec); 0 zone resets clat (msec): min=678, max=1232, avg=955.44, stdev=391.92 lat (msec): min=679, max=1233, avg=956.48, stdev=391.27 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7699, max= 7699, per=91.57%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.64%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178597: Wed Aug 26 09:40:47 2026 write: IOPS=0, BW=3153KiB/s (3229kB/s)(12.0MiB/3897msec); 0 zone resets clat (msec): min=829, max=1707, avg=1221.51, stdev=446.38 lat (msec): min=830, max=1708, avg=1222.23, stdev=446.86 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7699, max= 8110, per=94.01%, avg=7904.50, stdev=290.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.85%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178598: Wed Aug 26 09:40:47 2026 write: IOPS=1, BW=6107KiB/s (6254kB/s)(12.0MiB/2012msec); 0 zone resets clat (msec): min=378, max=1033, avg=642.54, stdev=345.71 lat (msec): min=380, max=1034, avg=643.81, stdev=344.77 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 6660, max= 8110, per=87.83%, avg=7385.00, stdev=1025.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=5.12%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4905KiB/s (5023kB/s), 1226KiB/s-6774KiB/s (1256kB/s-6937kB/s), io=16.0MiB (16.8MB), run=1814-3340msec WRITE: bw=8409KiB/s (8610kB/s), 2453KiB/s-6107KiB/s (2512kB/s-6254kB/s), io=32.0MiB (33.6MB), run=2012-3897msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178600: Wed Aug 26 09:40:50 2026 read: IOPS=0, BW=3280KiB/s (3359kB/s)(12.0MiB/3746msec) clat (msec): min=1101, max=1305, avg=1225.65, stdev=108.77 lat (msec): min=1101, max=1305, avg=1225.65, stdev=108.76 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.03%, sys=9.80%, ctx=325, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178601: Wed Aug 26 09:40:50 2026 read: IOPS=0, BW=978KiB/s (1002kB/s)(4096KiB/4186msec) clat (nsec): min=1342.3M, max=1342.3M, avg=1342252349.00, stdev= 0.00 lat (nsec): min=1342.3M, max=1342.3M, avg=1342254065.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1957KiB/s (2004kB/s)(8192KiB/4186msec); 0 zone resets clat (msec): min=1248, max=1593, avg=1421.02, stdev=243.36 lat (msec): min=1249, max=1593, avg=1421.38, stdev=243.58 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.87%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178602: Wed Aug 26 09:40:50 2026 write: IOPS=0, BW=2618KiB/s (2681kB/s)(12.0MiB/4693msec); 0 zone resets clat (msec): min=296, max=2569, avg=1562.52, stdev=1158.46 lat (msec): min=296, max=2570, avg=1564.09, stdev=1158.93 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1821], 50.00th=[ 1821], 60.00th=[ 1821], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.09%, sys=3.69%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178603: Wed Aug 26 09:40:50 2026 write: IOPS=0, BW=2927KiB/s (2997kB/s)(12.0MiB/4198msec); 0 zone resets clat (msec): min=519, max=2079, avg=1394.80, stdev=797.37 lat (msec): min=519, max=2079, avg=1395.22, stdev=797.40 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.86%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3914KiB/s (4008kB/s), 978KiB/s-3280KiB/s (1002kB/s-3359kB/s), io=16.0MiB (16.8MB), run=3746-4186msec WRITE: bw=6982KiB/s (7150kB/s), 1957KiB/s-2927KiB/s (2004kB/s-2997kB/s), io=32.0MiB (33.6MB), run=4186-4693msec