== sanity test 398b: DIO and buffer IO race ============== 09:56:38 (1788443798) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.72728 s, 6.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180325: Thu Sep 3 09:59:32 2026 read: IOPS=9, BW=39.2KiB/s (40.2kB/s)(5992KiB/152778msec) clat (usec): min=38, max=767100, avg=56269.65, stdev=40268.24 lat (usec): min=38, max=767101, avg=56279.56, stdev=40268.80 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 8979], 10.00th=[ 19792], 20.00th=[ 28181], | 30.00th=[ 34341], 40.00th=[ 41157], 50.00th=[ 47973], 60.00th=[ 56886], | 70.00th=[ 67634], 80.00th=[ 82314], 90.00th=[104334], 95.00th=[125305], | 99.00th=[170918], 99.50th=[193987], 99.90th=[256902], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 95, per=25.47%, avg=38.97, stdev=16.31, samples=298 iops : min= 1, max= 23, avg= 9.06, stdev= 4.09, samples=298 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6296KiB/152778msec); 0 zone resets clat (usec): min=669, max=365040, avg=43251.46, stdev=44988.05 lat (usec): min=670, max=365042, avg=43256.14, stdev=44986.76 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1352], 10.00th=[ 1745], 20.00th=[ 4359], | 30.00th=[ 9765], 40.00th=[ 20317], 50.00th=[ 31327], 60.00th=[ 42206], | 70.00th=[ 55837], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[130548], | 99.00th=[187696], 99.50th=[214959], 99.90th=[358613], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 111, per=25.57%, avg=40.91, stdev=19.78, samples=298 iops : min= 1, max= 27, avg= 9.56, stdev= 5.00, samples=298 lat (usec) : 50=0.23%, 100=1.60%, 250=0.26%, 750=0.13%, 1000=0.13% lat (msec) : 2=5.63%, 4=4.04%, 10=5.99%, 20=7.29%, 50=34.08% lat (msec) : 100=29.46%, 250=10.97%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=4.24%, ctx=6407, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180326: Thu Sep 3 09:59:32 2026 read: IOPS=9, BW=38.5KiB/s (39.4kB/s)(5940KiB/154253msec) clat (usec): min=33, max=308449, avg=57928.30, stdev=36892.47 lat (usec): min=33, max=308451, avg=57933.26, stdev=36892.82 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 15401], 10.00th=[ 22152], 20.00th=[ 30016], | 30.00th=[ 36439], 40.00th=[ 43254], 50.00th=[ 51119], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 82314], 90.00th=[103285], 95.00th=[125305], | 99.00th=[193987], 99.50th=[219153], 99.90th=[270533], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 95, per=24.95%, avg=38.17, stdev=16.83, samples=302 iops : min= 1, max= 23, avg= 8.86, stdev= 4.22, samples=302 write: IOPS=10, BW=41.2KiB/s (42.1kB/s)(6348KiB/154253msec); 0 zone resets clat (usec): min=902, max=889941, avg=42691.99, stdev=48871.30 lat (usec): min=904, max=889942, avg=42694.59, stdev=48871.41 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1336], 10.00th=[ 1631], 20.00th=[ 4228], | 30.00th=[ 8356], 40.00th=[ 18220], 50.00th=[ 30278], 60.00th=[ 40633], | 70.00th=[ 54264], 80.00th=[ 73925], 90.00th=[105382], 95.00th=[129500], | 99.00th=[198181], 99.50th=[214959], 99.90th=[295699], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 143, per=25.46%, avg=40.73, stdev=20.97, samples=303 iops : min= 1, max= 35, avg= 9.51, stdev= 5.27, samples=303 lat (usec) : 50=0.13%, 100=1.30%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.45%, 4=3.39%, 10=7.00%, 20=6.61%, 50=32.62% lat (msec) : 100=31.15%, 250=10.74%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=4.21%, ctx=6423, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180327: Thu Sep 3 09:59:32 2026 read: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6028KiB/156480msec) clat (usec): min=27, max=914314, avg=57666.47, stdev=45041.54 lat (usec): min=27, max=914314, avg=57669.68, stdev=45040.76 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 12780], 10.00th=[ 20055], 20.00th=[ 27657], | 30.00th=[ 34341], 40.00th=[ 40633], 50.00th=[ 48497], 60.00th=[ 57410], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[106431], 95.00th=[127402], | 99.00th=[185598], 99.50th=[229639], 99.90th=[413139], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 109, per=25.00%, avg=38.25, stdev=16.36, samples=305 iops : min= 1, max= 27, avg= 8.88, stdev= 4.12, samples=305 write: IOPS=10, BW=40.0KiB/s (40.0kB/s)(6260KiB/156480msec); 0 zone resets clat (usec): min=953, max=305265, avg=44153.04, stdev=42864.09 lat (usec): min=954, max=305267, avg=44167.76, stdev=42854.36 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1385], 10.00th=[ 1926], 20.00th=[ 4817], | 30.00th=[ 9634], 40.00th=[ 20579], 50.00th=[ 33817], 60.00th=[ 45876], | 70.00th=[ 61080], 80.00th=[ 79168], 90.00th=[104334], 95.00th=[125305], | 99.00th=[175113], 99.50th=[189793], 99.90th=[295699], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 117, per=24.80%, avg=39.68, stdev=18.79, samples=305 iops : min= 1, max= 29, avg= 9.24, stdev= 4.73, samples=305 lat (usec) : 50=0.13%, 100=1.33%, 250=0.20%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.24%, 4=3.81%, 10=6.67%, 20=7.45%, 50=32.42% lat (msec) : 100=30.96%, 250=11.36%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=4.17%, ctx=6558, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180328: Thu Sep 3 09:59:32 2026 read: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6052KiB/155723msec) clat (usec): min=44, max=917216, avg=56676.58, stdev=42435.47 lat (usec): min=46, max=917217, avg=56688.79, stdev=42434.76 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 10421], 10.00th=[ 20317], 20.00th=[ 28443], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 49546], 60.00th=[ 57934], | 70.00th=[ 67634], 80.00th=[ 81265], 90.00th=[102237], 95.00th=[123208], | 99.00th=[177210], 99.50th=[219153], 99.90th=[304088], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 111, per=25.14%, avg=38.47, stdev=16.72, samples=305 iops : min= 1, max= 27, avg= 8.93, stdev= 4.20, samples=305 write: IOPS=10, BW=40.0KiB/s (41.0kB/s)(6236KiB/155723msec); 0 zone resets clat (usec): min=815, max=318292, avg=44602.16, stdev=45358.13 lat (usec): min=817, max=318295, avg=44606.42, stdev=45358.84 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1352], 10.00th=[ 1876], 20.00th=[ 4490], | 30.00th=[ 9110], 40.00th=[ 21365], 50.00th=[ 33424], 60.00th=[ 43779], | 70.00th=[ 58983], 80.00th=[ 78119], 90.00th=[107480], 95.00th=[137364], | 99.00th=[196084], 99.50th=[221250], 99.90th=[261096], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 118, per=24.78%, avg=39.65, stdev=18.67, samples=305 iops : min= 1, max= 29, avg= 9.24, stdev= 4.72, samples=305 lat (usec) : 50=0.07%, 100=1.76%, 250=0.29%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=5.14%, 4=3.87%, 10=6.84%, 20=6.25%, 50=33.66% lat (msec) : 100=30.47%, 250=11.17%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=4.11%, ctx=6489, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=153KiB/s (157kB/s), 38.5KiB/s-39.2KiB/s (39.4kB/s-40.2kB/s), io=23.4MiB (24.6MB), run=152778-156480msec WRITE: bw=161KiB/s (165kB/s), 40.0KiB/s-41.2KiB/s (40.0kB/s-42.2kB/s), io=24.6MiB (25.7MB), run=152778-156480msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180330: Thu Sep 3 10:00:17 2026 read: IOPS=7, BW=29.0KiB/s (30.7kB/s)(5992KiB/199864msec) clat (msec): min=5, max=793, avg=51.90, stdev=52.95 lat (msec): min=5, max=793, avg=51.91, stdev=52.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 117], 95.00th=[ 155], | 99.00th=[ 253], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 125, per=26.35%, avg=31.35, stdev=23.04, samples=370 iops : min= 1, max= 31, avg= 7.15, stdev= 5.79, samples=370 write: IOPS=7, BW=31.5KiB/s (32.3kB/s)(6296KiB/199864msec); 0 zone resets clat (msec): min=12, max=432, avg=77.41, stdev=58.63 lat (msec): min=12, max=432, avg=77.41, stdev=58.63 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 58], 60.00th=[ 72], | 70.00th=[ 91], 80.00th=[ 117], 90.00th=[ 157], 95.00th=[ 197], | 99.00th=[ 292], 99.50th=[ 326], 99.90th=[ 426], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 143, per=25.35%, avg=31.69, stdev=22.66, samples=384 iops : min= 1, max= 35, avg= 7.23, stdev= 5.70, samples=384 lat (msec) : 10=1.04%, 20=12.99%, 50=40.76%, 100=25.16%, 250=18.62% lat (msec) : 500=1.40%, 1000=0.03% cpu : usr=0.06%, sys=1.49%, ctx=4775, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180331: Thu Sep 3 10:00:17 2026 read: IOPS=7, BW=29.9KiB/s (30.6kB/s)(5940KiB/198673msec) clat (msec): min=6, max=965, avg=52.03, stdev=55.63 lat (msec): min=6, max=965, avg=52.04, stdev=55.63 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 74], 90.00th=[ 114], 95.00th=[ 155], | 99.00th=[ 257], 99.50th=[ 313], 99.90th=[ 397], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 135, per=26.11%, avg=31.07, stdev=22.90, samples=368 iops : min= 1, max= 33, avg= 7.08, stdev= 5.76, samples=368 write: IOPS=7, BW=31.0KiB/s (32.7kB/s)(6348KiB/198673msec); 0 zone resets clat (msec): min=11, max=409, avg=76.35, stdev=56.05 lat (msec): min=11, max=409, avg=76.36, stdev=56.05 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 72], | 70.00th=[ 92], 80.00th=[ 117], 90.00th=[ 155], 95.00th=[ 182], | 99.00th=[ 259], 99.50th=[ 292], 99.90th=[ 405], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 134, per=25.23%, avg=31.53, stdev=22.49, samples=387 iops : min= 1, max= 33, avg= 7.19, stdev= 5.66, samples=387 lat (msec) : 10=1.82%, 20=11.36%, 50=41.99%, 100=24.84%, 250=18.82% lat (msec) : 500=1.14%, 1000=0.03% cpu : usr=0.07%, sys=1.51%, ctx=4752, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180332: Thu Sep 3 10:00:17 2026 read: IOPS=7, BW=30.1KiB/s (30.8kB/s)(6028KiB/200182msec) clat (msec): min=5, max=393, avg=53.39, stdev=52.42 lat (msec): min=5, max=393, avg=53.42, stdev=52.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 56], 80.00th=[ 79], 90.00th=[ 125], 95.00th=[ 159], | 99.00th=[ 264], 99.50th=[ 305], 99.90th=[ 372], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 118, per=25.71%, avg=30.59, stdev=23.12, samples=379 iops : min= 1, max= 29, avg= 6.96, stdev= 5.82, samples=379 write: IOPS=7, BW=31.3KiB/s (32.0kB/s)(6260KiB/200182msec); 0 zone resets clat (msec): min=10, max=964, avg=76.28, stdev=60.20 lat (msec): min=10, max=964, avg=76.28, stdev=60.20 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 46], 50.00th=[ 57], 60.00th=[ 72], | 70.00th=[ 91], 80.00th=[ 118], 90.00th=[ 155], 95.00th=[ 186], | 99.00th=[ 262], 99.50th=[ 292], 99.90th=[ 447], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 127, per=24.90%, avg=31.12, stdev=22.74, samples=387 iops : min= 1, max= 31, avg= 7.09, stdev= 5.72, samples=387 lat (msec) : 10=1.86%, 20=11.52%, 50=41.50%, 100=24.77%, 250=19.11% lat (msec) : 500=1.20%, 1000=0.03% cpu : usr=0.06%, sys=1.49%, ctx=4708, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180333: Thu Sep 3 10:00:17 2026 read: IOPS=7, BW=30.1KiB/s (30.9kB/s)(6052KiB/200743msec) clat (msec): min=5, max=421, avg=52.59, stdev=51.86 lat (msec): min=5, max=421, avg=52.59, stdev=51.86 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 77], 90.00th=[ 124], 95.00th=[ 163], | 99.00th=[ 245], 99.50th=[ 309], 99.90th=[ 380], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 127, per=26.47%, avg=31.50, stdev=23.92, samples=372 iops : min= 1, max= 31, avg= 7.17, stdev= 6.01, samples=372 write: IOPS=7, BW=31.1KiB/s (31.8kB/s)(6236KiB/200743msec); 0 zone resets clat (msec): min=11, max=888, avg=77.51, stdev=62.79 lat (msec): min=11, max=888, avg=77.51, stdev=62.79 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 70], | 70.00th=[ 89], 80.00th=[ 115], 90.00th=[ 159], 95.00th=[ 201], | 99.00th=[ 296], 99.50th=[ 338], 99.90th=[ 422], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=31.26, stdev=21.98, samples=386 iops : min= 1, max= 27, avg= 7.12, stdev= 5.53, samples=386 lat (msec) : 10=1.40%, 20=12.21%, 50=41.99%, 100=24.45%, 250=18.55% lat (msec) : 500=1.37%, 1000=0.03% cpu : usr=0.06%, sys=1.49%, ctx=4959, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=120KiB/s (122kB/s), 29.9KiB/s-30.1KiB/s (30.6kB/s-30.9kB/s), io=23.4MiB (24.6MB), run=198673-200743msec WRITE: bw=125KiB/s (128kB/s), 31.1KiB/s-31.0KiB/s (31.8kB/s-32.7kB/s), io=24.6MiB (25.7MB), run=198673-200743msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180379: Thu Sep 3 10:01:10 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(5920KiB/40760msec) clat (usec): min=45, max=255052, avg=59439.56, stdev=37369.91 lat (usec): min=46, max=255054, avg=59448.19, stdev=37368.41 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 101], 10.00th=[ 19530], 20.00th=[ 31065], | 30.00th=[ 39060], 40.00th=[ 46924], 50.00th=[ 53740], 60.00th=[ 61080], | 70.00th=[ 71828], 80.00th=[ 84411], 90.00th=[102237], 95.00th=[120062], | 99.00th=[187696], 99.50th=[235930], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 344, per=25.33%, avg=144.88, stdev=58.25, samples=80 iops : min= 1, max= 21, avg= 8.25, stdev= 3.72, samples=80 write: IOPS=9, BW=156KiB/s (160kB/s)(6368KiB/40760msec); 0 zone resets clat (usec): min=1207, max=447036, avg=46744.52, stdev=48124.07 lat (usec): min=1208, max=447038, avg=46777.73, stdev=48111.83 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2278], 10.00th=[ 4113], 20.00th=[ 7570], | 30.00th=[ 13829], 40.00th=[ 23200], 50.00th=[ 32113], 60.00th=[ 44303], | 70.00th=[ 61604], 80.00th=[ 77071], 90.00th=[109577], 95.00th=[139461], | 99.00th=[200279], 99.50th=[244319], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 31, max= 377, per=25.90%, avg=155.94, stdev=71.43, samples=80 iops : min= 1, max= 23, avg= 8.96, stdev= 4.53, samples=80 lat (usec) : 50=0.13%, 100=2.21%, 250=0.52%, 1000=0.13% lat (msec) : 2=2.08%, 4=3.12%, 10=7.81%, 20=7.68%, 50=31.25% lat (msec) : 100=33.46%, 250=11.33%, 500=0.26% cpu : usr=0.07%, sys=4.47%, ctx=1725, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180380: Thu Sep 3 10:01:10 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(5744KiB/40519msec) clat (usec): min=45, max=317102, avg=61519.18, stdev=42381.40 lat (usec): min=46, max=317104, avg=61521.49, stdev=42381.34 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 99], 10.00th=[ 22676], 20.00th=[ 30540], | 30.00th=[ 37487], 40.00th=[ 45351], 50.00th=[ 51643], 60.00th=[ 62129], | 70.00th=[ 74974], 80.00th=[ 89654], 90.00th=[114820], 95.00th=[133694], | 99.00th=[204473], 99.50th=[283116], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 285, per=24.61%, avg=140.77, stdev=60.50, samples=79 iops : min= 1, max= 17, avg= 8.00, stdev= 3.84, samples=79 write: IOPS=10, BW=162KiB/s (165kB/s)(6544KiB/40519msec); 0 zone resets clat (usec): min=1461, max=375449, avg=44558.58, stdev=46787.62 lat (usec): min=1462, max=375452, avg=44563.93, stdev=46787.01 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2008], 10.00th=[ 2737], 20.00th=[ 6259], | 30.00th=[ 11994], 40.00th=[ 21365], 50.00th=[ 30016], 60.00th=[ 40633], | 70.00th=[ 58459], 80.00th=[ 74974], 90.00th=[103285], 95.00th=[133694], | 99.00th=[187696], 99.50th=[204473], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 31, max= 380, per=27.01%, avg=162.58, stdev=69.30, samples=78 iops : min= 1, max= 23, avg= 9.37, stdev= 4.39, samples=78 lat (usec) : 50=0.13%, 100=2.21%, 250=0.13%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.60%, 4=3.78%, 10=8.20%, 20=6.77%, 50=32.68% lat (msec) : 100=30.47%, 250=12.37%, 500=0.39% cpu : usr=0.05%, sys=4.50%, ctx=1741, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180381: Thu Sep 3 10:01:10 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(6256KiB/41839msec) clat (usec): min=41, max=315694, avg=62164.05, stdev=44958.39 lat (usec): min=41, max=315695, avg=62165.93, stdev=44958.49 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 21103], 20.00th=[ 30540], | 30.00th=[ 39584], 40.00th=[ 45876], 50.00th=[ 54264], 60.00th=[ 63701], | 70.00th=[ 74974], 80.00th=[ 88605], 90.00th=[111674], 95.00th=[139461], | 99.00th=[267387], 99.50th=[283116], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 255, per=26.10%, avg=149.30, stdev=59.62, samples=82 iops : min= 1, max= 15, avg= 8.54, stdev= 3.79, samples=82 write: IOPS=9, BW=144KiB/s (148kB/s)(6032KiB/41839msec); 0 zone resets clat (usec): min=1089, max=298584, avg=45987.28, stdev=47238.12 lat (usec): min=1092, max=298587, avg=45989.96, stdev=47238.17 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1991], 10.00th=[ 3556], 20.00th=[ 6849], | 30.00th=[ 12387], 40.00th=[ 21890], 50.00th=[ 31065], 60.00th=[ 45351], | 70.00th=[ 60031], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[133694], | 99.00th=[240124], 99.50th=[246416], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 317, per=24.34%, avg=146.51, stdev=71.98, samples=80 iops : min= 1, max= 19, avg= 8.35, stdev= 4.58, samples=80 lat (usec) : 50=0.13%, 100=2.99%, 250=0.39%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.60%, 4=3.12%, 10=7.81%, 20=5.86%, 50=30.86% lat (msec) : 100=32.55%, 250=12.37%, 500=0.78% cpu : usr=0.07%, sys=4.17%, ctx=1746, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180382: Thu Sep 3 10:01:10 2026 read: IOPS=9, BW=148KiB/s (152kB/s)(6032KiB/40642msec) clat (usec): min=39, max=241282, avg=60506.88, stdev=42556.40 lat (usec): min=39, max=241284, avg=60508.56, stdev=42556.41 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 72], 10.00th=[ 433], 20.00th=[ 29230], | 30.00th=[ 37487], 40.00th=[ 46400], 50.00th=[ 54789], 60.00th=[ 62653], | 70.00th=[ 72877], 80.00th=[ 88605], 90.00th=[112722], 95.00th=[129500], | 99.00th=[214959], 99.50th=[240124], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 28, max= 285, per=25.68%, avg=146.87, stdev=54.11, samples=79 iops : min= 1, max= 17, avg= 8.38, stdev= 3.43, samples=79 write: IOPS=9, BW=154KiB/s (158kB/s)(6256KiB/40642msec); 0 zone resets clat (usec): min=1402, max=326124, avg=44745.38, stdev=46829.05 lat (usec): min=1403, max=326128, avg=44748.40, stdev=46828.94 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2008], 10.00th=[ 3294], 20.00th=[ 6521], | 30.00th=[ 12125], 40.00th=[ 20579], 50.00th=[ 29492], 60.00th=[ 40633], | 70.00th=[ 56361], 80.00th=[ 79168], 90.00th=[108528], 95.00th=[141558], | 99.00th=[212861], 99.50th=[242222], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 382, per=25.45%, avg=153.23, stdev=83.86, samples=79 iops : min= 1, max= 23, avg= 8.78, stdev= 5.31, samples=79 lat (usec) : 50=0.52%, 100=3.91%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.60%, 4=4.04%, 10=7.29%, 20=7.42%, 50=28.26% lat (msec) : 100=32.29%, 250=12.89%, 500=0.13% cpu : usr=0.06%, sys=4.47%, ctx=1732, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=572KiB/s (586kB/s), 142KiB/s-150KiB/s (145kB/s-153kB/s), io=23.4MiB (24.5MB), run=40519-41839msec WRITE: bw=602KiB/s (617kB/s), 144KiB/s-162KiB/s (148kB/s-165kB/s), io=24.6MiB (25.8MB), run=40519-41839msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180384: Thu Sep 3 10:01:27 2026 read: IOPS=6, BW=103KiB/s (105kB/s)(5920KiB/57668msec) clat (msec): min=10, max=303, avg=61.08, stdev=52.70 lat (msec): min=10, max=303, avg=61.09, stdev=52.71 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 64], 80.00th=[ 79], 90.00th=[ 136], 95.00th=[ 180], | 99.00th=[ 259], 99.50th=[ 292], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 29, max= 287, per=26.00%, avg=106.88, stdev=62.49, samples=107 iops : min= 1, max= 17, avg= 5.81, stdev= 3.95, samples=107 write: IOPS=6, BW=110KiB/s (113kB/s)(6368KiB/57668msec); 0 zone resets clat (msec): min=15, max=408, avg=87.69, stdev=57.35 lat (msec): min=15, max=408, avg=87.70, stdev=57.39 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 35], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 61], 50.00th=[ 72], 60.00th=[ 85], | 70.00th=[ 100], 80.00th=[ 125], 90.00th=[ 165], 95.00th=[ 201], | 99.00th=[ 292], 99.50th=[ 313], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 27, max= 287, per=25.86%, avg=111.71, stdev=60.14, samples=111 iops : min= 1, max= 17, avg= 6.12, stdev= 3.79, samples=111 lat (msec) : 20=5.73%, 50=37.63%, 100=33.72%, 250=21.22%, 500=1.69% cpu : usr=0.05%, sys=1.32%, ctx=1081, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180385: Thu Sep 3 10:01:27 2026 read: IOPS=6, BW=98.7KiB/s (101kB/s)(5744KiB/58207msec) clat (msec): min=9, max=276, avg=60.46, stdev=48.84 lat (msec): min=9, max=276, avg=60.46, stdev=48.84 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 91], 90.00th=[ 131], 95.00th=[ 167], | 99.00th=[ 241], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 27, max= 318, per=24.88%, avg=102.24, stdev=69.42, samples=108 iops : min= 1, max= 19, avg= 5.52, stdev= 4.37, samples=108 write: IOPS=7, BW=112KiB/s (115kB/s)(6544KiB/58207msec); 0 zone resets clat (msec): min=10, max=499, avg=88.40, stdev=68.95 lat (msec): min=10, max=499, avg=88.41, stdev=68.95 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 78], | 70.00th=[ 104], 80.00th=[ 130], 90.00th=[ 182], 95.00th=[ 226], | 99.00th=[ 313], 99.50th=[ 372], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 27, max= 382, per=26.07%, avg=112.60, stdev=68.06, samples=111 iops : min= 1, max= 23, avg= 6.17, stdev= 4.29, samples=111 lat (msec) : 10=0.26%, 20=7.03%, 50=37.89%, 100=30.08%, 250=22.92% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.38%, ctx=1246, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180386: Thu Sep 3 10:01:27 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6256KiB/57738msec) clat (msec): min=8, max=371, avg=62.06, stdev=55.25 lat (msec): min=8, max=371, avg=62.06, stdev=55.25 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 65], 80.00th=[ 85], 90.00th=[ 131], 95.00th=[ 180], | 99.00th=[ 300], 99.50th=[ 342], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 447, per=27.82%, avg=114.34, stdev=74.17, samples=107 iops : min= 1, max= 27, avg= 6.27, stdev= 4.66, samples=107 write: IOPS=6, BW=104KiB/s (107kB/s)(6032KiB/57738msec); 0 zone resets clat (msec): min=20, max=350, avg=88.13, stdev=54.12 lat (msec): min=20, max=350, avg=88.13, stdev=54.12 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 46], | 30.00th=[ 53], 40.00th=[ 61], 50.00th=[ 71], 60.00th=[ 84], | 70.00th=[ 104], 80.00th=[ 129], 90.00th=[ 163], 95.00th=[ 201], | 99.00th=[ 271], 99.50th=[ 288], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 255, per=24.36%, avg=105.25, stdev=55.09, samples=110 iops : min= 1, max= 15, avg= 5.71, stdev= 3.47, samples=110 lat (msec) : 10=0.26%, 20=5.73%, 50=36.20%, 100=33.85%, 250=22.01% lat (msec) : 500=1.95% cpu : usr=0.05%, sys=1.46%, ctx=1210, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180387: Thu Sep 3 10:01:27 2026 read: IOPS=6, BW=106KiB/s (108kB/s)(6032KiB/57129msec) clat (msec): min=9, max=344, avg=61.11, stdev=51.99 lat (msec): min=9, max=344, avg=61.11, stdev=51.99 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 65], 80.00th=[ 84], 90.00th=[ 128], 95.00th=[ 178], | 99.00th=[ 255], 99.50th=[ 296], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 29, max= 318, per=27.22%, avg=111.87, stdev=62.60, samples=105 iops : min= 1, max= 19, avg= 6.12, stdev= 3.95, samples=105 write: IOPS=6, BW=110KiB/s (112kB/s)(6256KiB/57129msec); 0 zone resets clat (msec): min=21, max=494, avg=86.35, stdev=58.62 lat (msec): min=21, max=494, avg=86.36, stdev=58.62 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 31], 10.00th=[ 37], 20.00th=[ 44], | 30.00th=[ 52], 40.00th=[ 60], 50.00th=[ 69], 60.00th=[ 83], | 70.00th=[ 96], 80.00th=[ 117], 90.00th=[ 153], 95.00th=[ 203], | 99.00th=[ 275], 99.50th=[ 464], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 29, max= 383, per=26.30%, avg=113.61, stdev=60.21, samples=108 iops : min= 1, max= 23, avg= 6.24, stdev= 3.77, samples=108 lat (msec) : 10=0.13%, 20=6.12%, 50=34.90%, 100=37.37%, 250=20.31% lat (msec) : 500=1.17% cpu : usr=0.06%, sys=1.49%, ctx=1177, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=411KiB/s (421kB/s), 98.7KiB/s-108KiB/s (101kB/s-111kB/s), io=23.4MiB (24.5MB), run=57129-58207msec WRITE: bw=433KiB/s (443kB/s), 104KiB/s-112KiB/s (107kB/s-115kB/s), io=24.6MiB (25.8MB), run=57129-58207msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180413: Thu Sep 3 10:01:53 2026 read: IOPS=1, BW=1581KiB/s (1619kB/s)(7168KiB/4535msec) clat (usec): min=564, max=789933, avg=307667.37, stdev=242142.63 lat (usec): min=566, max=789935, avg=307669.31, stdev=242142.54 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[168821], | 30.00th=[254804], 40.00th=[254804], 50.00th=[270533], 60.00th=[333448], | 70.00th=[333448], 80.00th=[333448], 90.00th=[792724], 95.00th=[792724], | 99.00th=[792724], 99.50th=[792724], 99.90th=[792724], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 1703, max= 3494, per=93.78%, avg=2211.40, stdev=726.02, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1129KiB/s (1156kB/s)(5120KiB/4535msec); 0 zone resets clat (msec): min=213, max=882, avg=465.16, stdev=264.37 lat (msec): min=213, max=883, avg=465.60, stdev=265.09 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2011, max= 3690, per=78.09%, avg=2578.67, stdev=962.52, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=12.26%, ctx=218, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180414: Thu Sep 3 10:01:53 2026 read: IOPS=0, BW=236KiB/s (242kB/s)(2048KiB/8682msec) clat (usec): min=882, max=125385, avg=63134.22, stdev=88037.28 lat (usec): min=884, max=125390, avg=63137.49, stdev=88038.64 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 881], | 30.00th=[ 881], 40.00th=[ 881], 50.00th=[ 881], 60.00th=[125305], | 70.00th=[125305], 80.00th=[125305], 90.00th=[125305], 95.00th=[125305], | 99.00th=[125305], 99.50th=[125305], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 1759, max= 1845, per=76.42%, avg=1802.00, stdev=60.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1179KiB/s (1208kB/s)(10.0MiB/8682msec); 0 zone resets clat (msec): min=164, max=4010, avg=845.41, stdev=1166.75 lat (msec): min=164, max=4010, avg=845.64, stdev=1166.78 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 226], | 30.00th=[ 249], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 359], | 70.00th=[ 718], 80.00th=[ 902], 90.00th=[ 1250], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 1845, max= 4071, per=80.60%, avg=2661.50, stdev=1087.90, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=6.90%, ctx=127, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180415: Thu Sep 3 10:01:53 2026 read: IOPS=1, BW=1324KiB/s (1356kB/s)(6144KiB/4641msec) clat (usec): min=680, max=320738, avg=200695.38, stdev=136824.85 lat (usec): min=683, max=320739, avg=200697.46, stdev=136824.62 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[ 62129], | 30.00th=[ 62129], 40.00th=[225444], 50.00th=[225444], 60.00th=[278922], | 70.00th=[316670], 80.00th=[316670], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 4023, max= 5752, per=100.00%, avg=4887.50, stdev=1222.59, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1324KiB/s (1356kB/s)(6144KiB/4641msec); 0 zone resets clat (msec): min=139, max=1465, avg=553.86, stdev=466.99 lat (msec): min=139, max=1465, avg=553.97, stdev=466.97 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 405], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1845, max= 3407, per=68.91%, avg=2275.25, stdev=755.45, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=10.19%, ctx=141, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180416: Thu Sep 3 10:01:53 2026 read: IOPS=0, BW=639KiB/s (654kB/s)(5120KiB/8013msec) clat (usec): min=1725, max=3347.2k, avg=899054.54, stdev=1385363.75 lat (usec): min=1726, max=3347.2k, avg=899056.58, stdev=1385363.99 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1729], 10.00th=[ 1729], | 20.00th=[ 1729], 30.00th=[ 189793], 40.00th=[ 189793], | 50.00th=[ 375391], 60.00th=[ 375391], 70.00th=[ 583009], | 80.00th=[ 583009], 90.00th=[3338666], 95.00th=[3338666], | 99.00th=[3338666], 99.50th=[3338666], 99.90th=[3338666], | 99.95th=[3338666], 99.99th=[3338666] bw ( KiB/s): min= 1845, max= 4047, per=100.00%, avg=2634.33, stdev=1226.22, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=895KiB/s (916kB/s)(7168KiB/8013msec); 0 zone resets clat (msec): min=214, max=1173, avg=496.64, stdev=357.83 lat (msec): min=214, max=1174, avg=496.74, stdev=357.82 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 228], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 300], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 701], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1703, max= 4087, per=71.28%, avg=2353.60, stdev=977.83, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.05%, sys=8.57%, ctx=543, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2359KiB/s (2416kB/s), 236KiB/s-1581KiB/s (242kB/s-1619kB/s), io=20.0MiB (20.0MB), run=4535-8682msec WRITE: bw=3302KiB/s (3382kB/s), 895KiB/s-1324KiB/s (916kB/s-1356kB/s), io=28.0MiB (29.4MB), run=4535-8682msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180418: Thu Sep 3 10:01:54 2026 read: IOPS=0, BW=986KiB/s (1009kB/s)(7168KiB/7273msec) clat (msec): min=77, max=2922, avg=704.65, stdev=999.97 lat (msec): min=77, max=2922, avg=704.66, stdev=999.97 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 130], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 460], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 659], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1935, max= 2663, per=93.60%, avg=2135.00, stdev=297.93, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=704KiB/s (721kB/s)(5120KiB/7273msec); 0 zone resets clat (msec): min=338, max=645, avg=467.41, stdev=124.33 lat (msec): min=338, max=645, avg=467.67, stdev=124.20 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1882, max= 2043, per=60.87%, avg=1943.50, stdev=69.82, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=3.08%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180419: Thu Sep 3 10:01:54 2026 read: IOPS=0, BW=228KiB/s (234kB/s)(2048KiB/8977msec) clat (msec): min=172, max=1066, avg=619.25, stdev=632.01 lat (msec): min=172, max=1066, avg=619.25, stdev=632.01 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1988, max= 2035, per=88.19%, avg=2011.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1141KiB/s (1168kB/s)(10.0MiB/8977msec); 0 zone resets clat (msec): min=142, max=4039, avg=763.25, stdev=1165.50 lat (msec): min=142, max=4039, avg=763.40, stdev=1165.50 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 236], | 30.00th=[ 249], 40.00th=[ 317], 50.00th=[ 321], 60.00th=[ 464], | 70.00th=[ 550], 80.00th=[ 575], 90.00th=[ 735], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 1988, max= 4087, per=94.13%, avg=3005.67, stdev=1090.01, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=2.77%, ctx=126, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180420: Thu Sep 3 10:01:54 2026 read: IOPS=0, BW=731KiB/s (749kB/s)(6144KiB/8403msec) clat (msec): min=83, max=409, avg=203.42, stdev=110.24 lat (msec): min=83, max=409, avg=203.43, stdev=110.24 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 194], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 3764, max= 4047, per=100.00%, avg=3905.50, stdev=200.11, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=731KiB/s (749kB/s)(6144KiB/8403msec); 0 zone resets clat (msec): min=187, max=3904, avg=1194.02, stdev=1364.94 lat (msec): min=197, max=3904, avg=1195.81, stdev=1363.46 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 852], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1935, max= 2035, per=62.86%, avg=2007.00, stdev=40.89, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=1.94%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180421: Thu Sep 3 10:01:54 2026 read: IOPS=0, BW=580KiB/s (594kB/s)(5120KiB/8832msec) clat (msec): min=106, max=3968, avg=912.45, stdev=1709.03 lat (msec): min=106, max=3968, avg=912.45, stdev=1709.03 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 3828, max= 4031, per=100.00%, avg=3929.50, stdev=143.54, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=812KiB/s (831kB/s)(7168KiB/8832msec); 0 zone resets clat (msec): min=94, max=1389, avg=609.55, stdev=466.81 lat (msec): min=94, max=1390, avg=609.70, stdev=466.92 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 305], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 510], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 1099], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1882, max= 2035, per=61.87%, avg=1975.40, stdev=71.78, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=16.67%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=2.32%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2281KiB/s (2336kB/s), 228KiB/s-986KiB/s (234kB/s-1009kB/s), io=20.0MiB (20.0MB), run=7273-8977msec WRITE: bw=3194KiB/s (3271kB/s), 704KiB/s-1141KiB/s (721kB/s-1168kB/s), io=28.0MiB (29.4MB), run=7273-8977msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180428: Thu Sep 3 10:02:11 2026 read: IOPS=0, BW=3503KiB/s (3587kB/s)(12.0MiB/3508msec) clat (msec): min=789, max=1744, avg=1111.68, stdev=548.47 lat (msec): min=789, max=1744, avg=1111.68, stdev=548.47 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.11%, sys=3.93%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180429: Thu Sep 3 10:02:11 2026 read: IOPS=0, BW=983KiB/s (1007kB/s)(4096KiB/4165msec) clat (nsec): min=1248.2M, max=1248.2M, avg=1248202803.00, stdev= 0.00 lat (nsec): min=1248.2M, max=1248.2M, avg=1248206208.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1967KiB/s (2014kB/s)(8192KiB/4165msec); 0 zone resets clat (msec): min=1000, max=1859, avg=1430.36, stdev=607.29 lat (msec): min=1001, max=1860, avg=1430.88, stdev=607.30 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.51%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180430: Thu Sep 3 10:02:11 2026 write: IOPS=1, BW=7699KiB/s (7884kB/s)(12.0MiB/1596msec); 0 zone resets clat (msec): min=319, max=843, avg=502.15, stdev=295.98 lat (msec): min=319, max=848, avg=504.21, stdev=298.50 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 6131, max= 8126, per=90.61%, avg=7128.50, stdev=1410.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.33%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180431: Thu Sep 3 10:02:11 2026 write: IOPS=1, BW=5196KiB/s (5320kB/s)(12.0MiB/2365msec); 0 zone resets clat (msec): min=375, max=1237, avg=765.96, stdev=436.47 lat (msec): min=376, max=1237, avg=766.54, stdev=436.56 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 6460, max= 8126, per=92.70%, avg=7293.00, stdev=1178.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.92%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3934KiB/s (4028kB/s), 983KiB/s-3503KiB/s (1007kB/s-3587kB/s), io=16.0MiB (16.8MB), run=3508-4165msec WRITE: bw=7867KiB/s (8056kB/s), 1967KiB/s-7699KiB/s (2014kB/s-7884kB/s), io=32.0MiB (33.6MB), run=1596-4165msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180433: Thu Sep 3 10:02:11 2026 read: IOPS=1, BW=4874KiB/s (4991kB/s)(12.0MiB/2521msec) clat (msec): min=798, max=908, avg=837.42, stdev=61.77 lat (msec): min=798, max=908, avg=837.42, stdev=61.77 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8015, max= 8159, per=100.00%, avg=8087.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.79%, ctx=198, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180434: Thu Sep 3 10:02:11 2026 read: IOPS=0, BW=1204KiB/s (1233kB/s)(4096KiB/3401msec) clat (nsec): min=738541k, max=738541k, avg=738540645.00, stdev= 0.00 lat (nsec): min=738545k, max=738545k, avg=738544653.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2409KiB/s (2467kB/s)(8192KiB/3401msec); 0 zone resets clat (msec): min=678, max=1971, avg=1324.92, stdev=914.39 lat (msec): min=681, max=1971, avg=1326.63, stdev=912.55 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 1972], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8094, max= 8094, per=85.77%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.44%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180435: Thu Sep 3 10:02:11 2026 write: IOPS=0, BW=3539KiB/s (3624kB/s)(12.0MiB/3472msec); 0 zone resets clat (msec): min=353, max=1781, avg=1156.43, stdev=730.15 lat (msec): min=354, max=1781, avg=1156.85, stdev=730.10 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8094, max= 8143, per=86.03%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.20%, sys=2.68%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180436: Thu Sep 3 10:02:11 2026 write: IOPS=1, BW=4153KiB/s (4252kB/s)(12.0MiB/2959msec); 0 zone resets clat (msec): min=438, max=1366, avg=962.91, stdev=475.38 lat (msec): min=439, max=1366, avg=963.36, stdev=475.50 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8143, max= 8143, per=86.29%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.02%, ctx=38, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4817KiB/s (4933kB/s), 1204KiB/s-4874KiB/s (1233kB/s-4991kB/s), io=16.0MiB (16.8MB), run=2521-3401msec WRITE: bw=9438KiB/s (9664kB/s), 2409KiB/s-4153KiB/s (2467kB/s-4252kB/s), io=32.0MiB (33.6MB), run=2959-3472msec