== sanity test 398b: DIO and buffer IO race ============== 21:20:39 (1783646439) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.73382 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154960: Thu Jul 9 21:22:53 2026 read: IOPS=13, BW=53.5KiB/s (54.8kB/s)(5992KiB/111958msec) clat (usec): min=33, max=632026, avg=36458.71, stdev=32347.29 lat (usec): min=34, max=632028, avg=36462.75, stdev=32347.66 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 334], 20.00th=[ 16319], | 30.00th=[ 21365], 40.00th=[ 25822], 50.00th=[ 30016], 60.00th=[ 36963], | 70.00th=[ 44827], 80.00th=[ 53740], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[125305], 99.50th=[156238], 99.90th=[417334], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 5, max= 143, per=25.03%, avg=53.31, stdev=23.21, samples=220 iops : min= 1, max= 35, avg=12.70, stdev= 5.82, samples=220 write: IOPS=14, BW=56.2KiB/s (57.6kB/s)(6296KiB/111958msec); 0 zone resets clat (usec): min=895, max=314849, avg=36346.65, stdev=37240.18 lat (usec): min=895, max=314851, avg=36348.26, stdev=37240.20 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 1713], 20.00th=[ 4228], | 30.00th=[ 9241], 40.00th=[ 17171], 50.00th=[ 26608], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 62653], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[164627], 99.50th=[193987], 99.90th=[254804], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 198, per=25.10%, avg=55.97, stdev=24.15, samples=220 iops : min= 1, max= 49, avg=13.37, stdev= 6.05, samples=220 lat (usec) : 50=0.72%, 100=3.55%, 250=0.55%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.99%, 4=3.87%, 10=6.90%, 20=12.70%, 50=40.14% lat (msec) : 100=20.54%, 250=4.62%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.96%, ctx=6538, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154961: Thu Jul 9 21:22:53 2026 read: IOPS=13, BW=54.5KiB/s (55.8kB/s)(5940KiB/108948msec) clat (usec): min=31, max=613050, avg=36325.07, stdev=32875.59 lat (usec): min=32, max=613053, avg=36331.25, stdev=32878.64 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 96], 20.00th=[ 15795], | 30.00th=[ 21103], 40.00th=[ 25822], 50.00th=[ 30540], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 52691], 90.00th=[ 67634], 95.00th=[ 87557], | 99.00th=[133694], 99.50th=[168821], 99.90th=[354419], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 5, max= 111, per=25.66%, avg=54.65, stdev=20.72, samples=213 iops : min= 1, max= 27, avg=13.05, stdev= 5.21, samples=213 write: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6348KiB/108948msec); 0 zone resets clat (usec): min=953, max=343863, avg=34557.83, stdev=35015.05 lat (usec): min=954, max=343865, avg=34561.71, stdev=35014.81 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1696], 20.00th=[ 4228], | 30.00th=[ 8291], 40.00th=[ 16188], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[143655], 99.50th=[164627], 99.90th=[287310], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 8, max= 134, per=26.09%, avg=58.19, stdev=22.58, samples=214 iops : min= 2, max= 33, avg=13.93, stdev= 5.69, samples=214 lat (usec) : 50=0.68%, 100=4.20%, 250=0.36%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.02%, 4=3.84%, 10=7.39%, 20=14.00%, 50=38.70% lat (msec) : 100=20.80%, 250=3.65%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=5.85%, ctx=6493, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154962: Thu Jul 9 21:22:53 2026 read: IOPS=13, BW=53.6KiB/s (54.9kB/s)(6028KiB/112519msec) clat (usec): min=27, max=471521, avg=35836.84, stdev=29636.40 lat (usec): min=27, max=471521, avg=35840.11, stdev=29634.58 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 105], 20.00th=[ 15664], | 30.00th=[ 20841], 40.00th=[ 25035], 50.00th=[ 30278], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[128451], 99.50th=[152044], 99.90th=[231736], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 126, per=25.00%, avg=53.25, stdev=22.89, samples=221 iops : min= 1, max= 31, avg=12.68, stdev= 5.75, samples=221 write: IOPS=13, BW=55.6KiB/s (56.0kB/s)(6260KiB/112519msec); 0 zone resets clat (usec): min=954, max=749753, avg=37300.93, stdev=41543.46 lat (usec): min=956, max=749756, avg=37307.94, stdev=41547.69 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1647], 20.00th=[ 3884], | 30.00th=[ 8586], 40.00th=[ 18482], 50.00th=[ 27919], 60.00th=[ 38011], | 70.00th=[ 48497], 80.00th=[ 62653], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[164627], 99.50th=[196084], 99.90th=[337642], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 166, per=24.79%, avg=55.27, stdev=22.53, samples=221 iops : min= 1, max= 41, avg=13.20, stdev= 5.66, samples=221 lat (usec) : 50=0.88%, 100=4.00%, 250=0.33%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=6.32%, 4=4.07%, 10=6.38%, 20=12.70%, 50=39.52% lat (msec) : 100=21.19%, 250=4.26%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=6.07%, ctx=6538, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154963: Thu Jul 9 21:22:53 2026 read: IOPS=13, BW=55.3KiB/s (56.6kB/s)(6052KiB/109529msec) clat (usec): min=32, max=258616, avg=34491.31, stdev=27113.03 lat (usec): min=32, max=258617, avg=34493.67, stdev=27113.28 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 89], 20.00th=[ 15139], | 30.00th=[ 20055], 40.00th=[ 24511], 50.00th=[ 29754], 60.00th=[ 34866], | 70.00th=[ 42206], 80.00th=[ 52167], 90.00th=[ 66323], 95.00th=[ 81265], | 99.00th=[123208], 99.50th=[149947], 99.90th=[225444], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 139, per=25.96%, avg=55.29, stdev=24.11, samples=214 iops : min= 1, max= 34, avg=13.21, stdev= 6.05, samples=214 write: IOPS=14, BW=56.9KiB/s (58.3kB/s)(6236KiB/109529msec); 0 zone resets clat (usec): min=931, max=766975, avg=36707.09, stdev=42308.31 lat (usec): min=944, max=766978, avg=36710.88, stdev=42307.58 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 1827], 20.00th=[ 4015], | 30.00th=[ 8848], 40.00th=[ 17957], 50.00th=[ 27657], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[106431], | 99.00th=[175113], 99.50th=[219153], 99.90th=[350225], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 15, max= 126, per=25.55%, avg=56.97, stdev=24.03, samples=214 iops : min= 3, max= 31, avg=13.63, stdev= 6.03, samples=214 lat (usec) : 50=0.85%, 100=4.17%, 250=0.39%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.70%, 4=4.46%, 10=6.58%, 20=13.48%, 50=39.26% lat (msec) : 100=20.28%, 250=4.33%, 500=0.16%, 1000=0.03% cpu : usr=0.10%, sys=6.28%, ctx=6539, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=213KiB/s (219kB/s), 53.5KiB/s-55.3KiB/s (54.8kB/s-56.6kB/s), io=23.4MiB (24.6MB), run=108948-112519msec WRITE: bw=223KiB/s (229kB/s), 55.6KiB/s-58.3KiB/s (56.0kB/s-59.7kB/s), io=24.6MiB (25.7MB), run=108948-112519msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154955: Thu Jul 9 21:25:41 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(5992KiB/279740msec) clat (msec): min=4, max=984, avg=34.17, stdev=38.79 lat (msec): min=4, max=984, avg=34.18, stdev=38.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 68], 95.00th=[ 93], | 99.00th=[ 157], 99.50th=[ 178], 99.90th=[ 393], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 95, per=27.90%, avg=23.72, stdev=16.00, samples=488 iops : min= 1, max= 23, avg= 5.32, stdev= 4.05, samples=488 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6296KiB/279740msec); 0 zone resets clat (msec): min=26, max=569, avg=144.96, stdev=64.45 lat (msec): min=26, max=569, avg=144.96, stdev=64.45 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 73], 20.00th=[ 91], | 30.00th=[ 106], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 228], 95.00th=[ 264], | 99.00th=[ 359], 99.50th=[ 388], 99.90th=[ 489], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 56, per=24.68%, avg=21.97, stdev= 9.77, samples=551 iops : min= 1, max= 14, avg= 4.89, stdev= 2.50, samples=551 lat (msec) : 10=4.13%, 20=15.04%, 50=21.91%, 100=19.21%, 250=36.43% lat (msec) : 500=3.22%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.30%, ctx=5171, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154956: Thu Jul 9 21:25:41 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(5940KiB/280330msec) clat (msec): min=4, max=935, avg=33.80, stdev=39.59 lat (msec): min=4, max=935, avg=33.80, stdev=39.59 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 67], 95.00th=[ 89], | 99.00th=[ 157], 99.50th=[ 224], 99.90th=[ 472], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 87, per=29.02%, avg=24.66, stdev=15.89, samples=465 iops : min= 1, max= 21, avg= 5.58, stdev= 4.02, samples=465 write: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6348KiB/280330msec); 0 zone resets clat (msec): min=37, max=510, avg=144.78, stdev=63.55 lat (msec): min=37, max=510, avg=144.78, stdev=63.56 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 77], 20.00th=[ 91], | 30.00th=[ 105], 40.00th=[ 120], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 190], 90.00th=[ 232], 95.00th=[ 266], | 99.00th=[ 351], 99.50th=[ 380], 99.90th=[ 456], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 56, per=24.99%, avg=22.24, stdev= 9.23, samples=549 iops : min= 1, max= 14, avg= 4.96, stdev= 2.36, samples=549 lat (msec) : 10=3.78%, 20=14.94%, 50=22.04%, 100=19.86%, 250=35.61% lat (msec) : 500=3.71%, 750=0.03%, 1000=0.03% cpu : usr=0.03%, sys=1.26%, ctx=5120, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154957: Thu Jul 9 21:25:41 2026 read: IOPS=5, BW=21.5KiB/s (21.0kB/s)(6028KiB/280591msec) clat (msec): min=4, max=388, avg=34.00, stdev=30.32 lat (msec): min=4, max=388, avg=34.00, stdev=30.32 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 70], 95.00th=[ 93], | 99.00th=[ 140], 99.50th=[ 174], 99.90th=[ 296], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 96, per=28.05%, avg=23.84, stdev=15.89, samples=488 iops : min= 1, max= 24, avg= 5.36, stdev= 4.03, samples=488 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6260KiB/280591msec); 0 zone resets clat (msec): min=39, max=1065, avg=146.31, stdev=66.92 lat (msec): min=39, max=1065, avg=146.31, stdev=66.92 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 91], | 30.00th=[ 107], 40.00th=[ 121], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 171], 80.00th=[ 192], 90.00th=[ 230], 95.00th=[ 264], | 99.00th=[ 347], 99.50th=[ 384], 99.90th=[ 464], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 64, per=24.59%, avg=21.88, stdev= 9.29, samples=550 iops : min= 1, max= 16, avg= 4.87, stdev= 2.39, samples=550 lat (msec) : 10=3.52%, 20=15.89%, 50=21.06%, 100=19.66%, 250=36.46% lat (msec) : 500=3.39%, 2000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=4924, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154958: Thu Jul 9 21:25:41 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6052KiB/280442msec) clat (msec): min=4, max=469, avg=34.60, stdev=33.89 lat (msec): min=4, max=469, avg=34.60, stdev=33.89 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 94], | 99.00th=[ 165], 99.50th=[ 220], 99.90th=[ 313], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 109, per=28.06%, avg=23.85, stdev=15.99, samples=490 iops : min= 1, max= 27, avg= 5.37, stdev= 4.07, samples=490 write: IOPS=5, BW=22.2KiB/s (22.8kB/s)(6236KiB/280442msec); 0 zone resets clat (msec): min=32, max=1062, avg=146.07, stdev=67.49 lat (msec): min=32, max=1062, avg=146.08, stdev=67.48 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 228], 95.00th=[ 266], | 99.00th=[ 338], 99.50th=[ 388], 99.90th=[ 542], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 48, per=24.57%, avg=21.87, stdev= 9.30, samples=549 iops : min= 1, max= 12, avg= 4.87, stdev= 2.38, samples=549 lat (msec) : 10=3.55%, 20=16.21%, 50=21.26%, 100=19.30%, 250=36.23% lat (msec) : 500=3.39%, 750=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.23%, ctx=5034, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=85.6KiB/s (87.6kB/s), 21.2KiB/s-21.6KiB/s (21.7kB/s-22.1kB/s), io=23.4MiB (24.6MB), run=279740-280591msec WRITE: bw=89.6KiB/s (91.7kB/s), 22.2KiB/s-22.6KiB/s (22.8kB/s-23.2kB/s), io=24.6MiB (25.7MB), run=279740-280591msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155023: Thu Jul 9 21:26:29 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(5920KiB/31992msec) clat (usec): min=37, max=533834, avg=45609.30, stdev=48375.58 lat (usec): min=37, max=533835, avg=45615.94, stdev=48371.50 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 93], | 30.00th=[ 22938], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 46400], | 70.00th=[ 57934], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[128451], | 99.00th=[187696], 99.50th=[221250], 99.90th=[534774], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 31, max= 476, per=25.16%, avg=185.19, stdev=93.30, samples=63 iops : min= 1, max= 29, avg=10.83, stdev= 5.86, samples=63 write: IOPS=12, BW=199KiB/s (204kB/s)(6368KiB/31992msec); 0 zone resets clat (usec): min=1551, max=232582, avg=37696.14, stdev=40250.60 lat (usec): min=1553, max=232584, avg=37700.42, stdev=40248.70 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1827], 10.00th=[ 2671], 20.00th=[ 5669], | 30.00th=[ 9634], 40.00th=[ 14353], 50.00th=[ 22676], 60.00th=[ 34866], | 70.00th=[ 50070], 80.00th=[ 64750], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[181404], 99.50th=[227541], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 30, max= 509, per=25.68%, avg=198.73, stdev=105.09, samples=63 iops : min= 1, max= 31, avg=11.68, stdev= 6.62, samples=63 lat (usec) : 50=1.82%, 100=8.20%, 250=1.82%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.04%, 4=4.17%, 10=8.33%, 20=9.38%, 50=28.78% lat (msec) : 100=24.22%, 250=8.59%, 750=0.13% cpu : usr=0.07%, sys=5.08%, ctx=1385, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155024: Thu Jul 9 21:26:29 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5744KiB/32537msec) clat (usec): min=36, max=268249, avg=46461.73, stdev=43923.08 lat (usec): min=37, max=268250, avg=46463.28, stdev=43922.99 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 79], | 30.00th=[ 20579], 40.00th=[ 32375], 50.00th=[ 40633], 60.00th=[ 51119], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[135267], | 99.00th=[196084], 99.50th=[219153], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 30, max= 383, per=23.84%, avg=175.48, stdev=93.01, samples=64 iops : min= 1, max= 23, avg=10.20, stdev= 5.85, samples=64 write: IOPS=12, BW=201KiB/s (206kB/s)(6544KiB/32537msec); 0 zone resets clat (usec): min=1376, max=394747, avg=37942.23, stdev=46430.81 lat (usec): min=1378, max=394751, avg=37944.74, stdev=46430.67 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1860], 10.00th=[ 2573], 20.00th=[ 5932], | 30.00th=[ 8717], 40.00th=[ 13435], 50.00th=[ 19530], 60.00th=[ 30278], | 70.00th=[ 48497], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[204473], 99.50th=[263193], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 30, max= 623, per=25.93%, avg=200.72, stdev=117.33, samples=64 iops : min= 1, max= 38, avg=11.78, stdev= 7.42, samples=64 lat (usec) : 50=1.56%, 100=8.59%, 250=1.04%, 500=0.26% lat (msec) : 2=4.30%, 4=4.17%, 10=9.24%, 20=11.20%, 50=25.26% lat (msec) : 100=26.30%, 250=7.55%, 500=0.52% cpu : usr=0.07%, sys=5.82%, ctx=1367, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155025: Thu Jul 9 21:26:29 2026 read: IOPS=12, BW=194KiB/s (198kB/s)(6256KiB/32326msec) clat (usec): min=36, max=290704, avg=45214.46, stdev=41528.49 lat (usec): min=37, max=290705, avg=45215.48, stdev=41528.49 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 78], | 30.00th=[ 21890], 40.00th=[ 31851], 50.00th=[ 39060], 60.00th=[ 48497], | 70.00th=[ 62129], 80.00th=[ 77071], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[189793], 99.50th=[212861], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 30, max= 541, per=26.54%, avg=195.37, stdev=104.48, samples=63 iops : min= 1, max= 33, avg=11.46, stdev= 6.57, samples=63 write: IOPS=11, BW=187KiB/s (191kB/s)(6032KiB/32326msec); 0 zone resets clat (usec): min=1522, max=210988, avg=38075.41, stdev=39142.56 lat (usec): min=1524, max=210989, avg=38204.85, stdev=39424.96 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1811], 10.00th=[ 2638], 20.00th=[ 5080], | 30.00th=[ 8717], 40.00th=[ 15008], 50.00th=[ 27657], 60.00th=[ 36439], | 70.00th=[ 46400], 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[120062], | 99.00th=[170918], 99.50th=[189793], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 571, per=24.33%, avg=188.34, stdev=107.92, samples=62 iops : min= 1, max= 35, avg=11.02, stdev= 6.80, samples=62 lat (usec) : 50=1.30%, 100=10.16%, 250=0.91%, 1000=0.26% lat (msec) : 2=3.78%, 4=4.95%, 10=8.46%, 20=7.29%, 50=29.82% lat (msec) : 100=24.22%, 250=8.72%, 500=0.13% cpu : usr=0.04%, sys=5.33%, ctx=1387, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155027: Thu Jul 9 21:26:29 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31895msec) clat (usec): min=32, max=250791, avg=44250.45, stdev=42860.99 lat (usec): min=32, max=250792, avg=44251.44, stdev=42860.96 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 75], | 30.00th=[ 15795], 40.00th=[ 28967], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 57934], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[128451], | 99.00th=[181404], 99.50th=[248513], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 60, max= 415, per=26.42%, avg=194.47, stdev=104.58, samples=60 iops : min= 3, max= 25, avg=11.42, stdev= 6.60, samples=60 write: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31895msec); 0 zone resets clat (usec): min=1469, max=435033, avg=38305.88, stdev=48500.42 lat (usec): min=1470, max=435036, avg=38310.42, stdev=48501.58 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1745], 10.00th=[ 2040], 20.00th=[ 5735], | 30.00th=[ 8979], 40.00th=[ 12387], 50.00th=[ 20055], 60.00th=[ 30278], | 70.00th=[ 44303], 80.00th=[ 65274], 90.00th=[ 94897], 95.00th=[131597], | 99.00th=[214959], 99.50th=[329253], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 30, max= 447, per=25.37%, avg=196.34, stdev=96.97, samples=62 iops : min= 1, max= 27, avg=11.53, stdev= 6.08, samples=62 lat (usec) : 50=1.56%, 100=10.42%, 250=0.65%, 500=0.26% lat (msec) : 2=5.86%, 4=2.99%, 10=9.90%, 20=9.90%, 50=27.34% lat (msec) : 100=21.09%, 250=9.51%, 500=0.52% cpu : usr=0.07%, sys=5.39%, ctx=1380, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=736KiB/s (754kB/s), 177KiB/s-194KiB/s (181kB/s-198kB/s), io=23.4MiB (24.5MB), run=31895-32537msec WRITE: bw=775KiB/s (793kB/s), 187KiB/s-201KiB/s (191kB/s-206kB/s), io=24.6MiB (25.8MB), run=31895-32537msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155028: Thu Jul 9 21:26:56 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(5920KiB/58365msec) clat (msec): min=6, max=375, avg=33.95, stdev=46.75 lat (msec): min=6, max=375, avg=33.96, stdev=46.75 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 43], 90.00th=[ 75], 95.00th=[ 128], | 99.00th=[ 251], 99.50th=[ 288], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 28, max= 447, per=29.15%, avg=118.95, stdev=86.87, samples=98 iops : min= 1, max= 27, avg= 6.70, stdev= 5.46, samples=98 write: IOPS=6, BW=109KiB/s (112kB/s)(6368KiB/58365msec); 0 zone resets clat (msec): min=29, max=589, avg=114.97, stdev=95.62 lat (msec): min=29, max=589, avg=114.97, stdev=95.62 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 42], 10.00th=[ 49], 20.00th=[ 57], | 30.00th=[ 64], 40.00th=[ 70], 50.00th=[ 78], 60.00th=[ 90], | 70.00th=[ 107], 80.00th=[ 155], 90.00th=[ 241], 95.00th=[ 351], | 99.00th=[ 493], 99.50th=[ 542], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 28, max= 288, per=26.28%, avg=112.73, stdev=73.12, samples=111 iops : min= 1, max= 18, avg= 6.29, stdev= 4.66, samples=111 lat (msec) : 10=8.07%, 20=20.31%, 50=17.71%, 100=33.20%, 250=15.49% lat (msec) : 500=4.82%, 750=0.39% cpu : usr=0.05%, sys=1.60%, ctx=1475, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155029: Thu Jul 9 21:26:56 2026 read: IOPS=6, BW=97.9KiB/s (100kB/s)(5744KiB/58693msec) clat (msec): min=5, max=388, avg=34.69, stdev=49.61 lat (msec): min=5, max=388, avg=34.70, stdev=49.61 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 48], 90.00th=[ 83], 95.00th=[ 129], | 99.00th=[ 284], 99.50th=[ 317], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 30, max= 479, per=30.00%, avg=122.40, stdev=94.10, samples=93 iops : min= 1, max= 29, avg= 6.92, stdev= 5.93, samples=93 write: IOPS=6, BW=111KiB/s (114kB/s)(6544KiB/58693msec); 0 zone resets clat (msec): min=29, max=974, avg=112.93, stdev=101.96 lat (msec): min=29, max=974, avg=112.93, stdev=101.96 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 44], 10.00th=[ 48], 20.00th=[ 56], | 30.00th=[ 63], 40.00th=[ 69], 50.00th=[ 75], 60.00th=[ 86], | 70.00th=[ 105], 80.00th=[ 148], 90.00th=[ 222], 95.00th=[ 321], | 99.00th=[ 481], 99.50th=[ 584], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 28, max= 319, per=27.15%, avg=116.49, stdev=74.17, samples=111 iops : min= 1, max= 19, avg= 6.53, stdev= 4.73, samples=111 lat (msec) : 10=8.20%, 20=19.92%, 50=17.19%, 100=34.38%, 250=14.97% lat (msec) : 500=4.82%, 750=0.39%, 1000=0.13% cpu : usr=0.03%, sys=1.62%, ctx=1380, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155030: Thu Jul 9 21:26:56 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6256KiB/56742msec) clat (msec): min=5, max=227, avg=31.69, stdev=35.75 lat (msec): min=5, max=227, avg=31.69, stdev=35.75 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 44], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 174], 99.50th=[ 213], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 28, max= 447, per=31.65%, avg=129.11, stdev=100.63, samples=96 iops : min= 1, max= 27, avg= 7.33, stdev= 6.40, samples=96 write: IOPS=6, BW=106KiB/s (109kB/s)(6032KiB/56742msec); 0 zone resets clat (msec): min=32, max=675, avg=117.47, stdev=100.68 lat (msec): min=32, max=675, avg=117.48, stdev=100.68 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 45], 10.00th=[ 50], 20.00th=[ 55], | 30.00th=[ 63], 40.00th=[ 70], 50.00th=[ 79], 60.00th=[ 90], | 70.00th=[ 107], 80.00th=[ 159], 90.00th=[ 253], 95.00th=[ 338], | 99.00th=[ 506], 99.50th=[ 642], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 30, max= 256, per=25.69%, avg=110.22, stdev=71.45, samples=108 iops : min= 1, max= 16, avg= 6.14, stdev= 4.56, samples=108 lat (msec) : 10=7.81%, 20=22.27%, 50=16.67%, 100=33.85%, 250=14.45% lat (msec) : 500=4.43%, 750=0.52% cpu : usr=0.02%, sys=1.46%, ctx=1408, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155031: Thu Jul 9 21:26:56 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(6032KiB/57757msec) clat (msec): min=4, max=386, avg=36.37, stdev=52.96 lat (msec): min=4, max=386, avg=36.37, stdev=52.96 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 30], 80.00th=[ 51], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 292], 99.50th=[ 384], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 28, max= 414, per=29.71%, avg=121.24, stdev=89.48, samples=97 iops : min= 1, max= 25, avg= 6.85, stdev= 5.62, samples=97 write: IOPS=6, BW=108KiB/s (111kB/s)(6256KiB/57757msec); 0 zone resets clat (msec): min=32, max=708, avg=112.55, stdev=94.72 lat (msec): min=32, max=708, avg=112.55, stdev=94.71 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 46], 10.00th=[ 50], 20.00th=[ 56], | 30.00th=[ 62], 40.00th=[ 68], 50.00th=[ 77], 60.00th=[ 87], | 70.00th=[ 104], 80.00th=[ 144], 90.00th=[ 239], 95.00th=[ 334], | 99.00th=[ 498], 99.50th=[ 609], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 28, max= 255, per=26.66%, avg=114.37, stdev=72.14, samples=107 iops : min= 1, max= 15, avg= 6.41, stdev= 4.60, samples=107 lat (msec) : 10=9.64%, 20=19.01%, 50=15.89%, 100=36.85%, 250=12.76% lat (msec) : 500=5.47%, 750=0.39% cpu : usr=0.06%, sys=1.54%, ctx=1452, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=408KiB/s (418kB/s), 97.9KiB/s-110KiB/s (100kB/s-113kB/s), io=23.4MiB (24.5MB), run=56742-58693msec WRITE: bw=429KiB/s (440kB/s), 106KiB/s-111KiB/s (109kB/s-114kB/s), io=24.6MiB (25.8MB), run=56742-58693msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155048: Thu Jul 9 21:27:06 2026 read: IOPS=2, BW=2923KiB/s (2993kB/s)(7168KiB/2452msec) clat (usec): min=422, max=711672, avg=191358.08, stdev=241159.26 lat (usec): min=424, max=711673, avg=191359.31, stdev=241159.07 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 1434], | 30.00th=[133694], 40.00th=[133694], 50.00th=[156238], 60.00th=[162530], | 70.00th=[162530], 80.00th=[173016], 90.00th=[708838], 95.00th=[708838], | 99.00th=[708838], 99.50th=[708838], 99.90th=[708838], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 2007, max= 4071, per=54.58%, avg=2717.75, stdev=963.63, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=2, BW=2088KiB/s (2138kB/s)(5120KiB/2452msec); 0 zone resets clat (msec): min=74, max=291, avg=193.10, stdev=95.31 lat (msec): min=74, max=291, avg=193.19, stdev=95.29 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 4015, max= 4071, per=58.00%, avg=4043.00, stdev=39.60, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=26.81%, ctx=412, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155049: Thu Jul 9 21:27:06 2026 read: IOPS=0, BW=562KiB/s (575kB/s)(2048KiB/3645msec) clat (msec): min=204, max=420, avg=312.63, stdev=152.81 lat (msec): min=204, max=420, avg=312.63, stdev=152.81 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2015, max= 2015, per=40.47%, avg=2015.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2809KiB/s (2877kB/s)(10.0MiB/3645msec); 0 zone resets clat (msec): min=115, max=634, avg=286.17, stdev=193.81 lat (msec): min=115, max=634, avg=286.39, stdev=194.05 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 124], | 30.00th=[ 130], 40.00th=[ 131], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 347], 80.00th=[ 359], 90.00th=[ 592], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2015, max= 6119, per=52.31%, avg=3646.40, stdev=2213.64, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=20.01%, ctx=169, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155051: Thu Jul 9 21:27:06 2026 read: IOPS=2, BW=2318KiB/s (2373kB/s)(6144KiB/2651msec) clat (usec): min=521, max=193553, avg=114475.34, stdev=70831.23 lat (usec): min=522, max=193554, avg=114923.95, stdev=71123.38 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 59507], | 30.00th=[ 59507], 40.00th=[137364], 50.00th=[137364], 60.00th=[145753], | 70.00th=[152044], 80.00th=[152044], 90.00th=[193987], 95.00th=[193987], | 99.00th=[193987], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 2027, max= 4096, per=68.30%, avg=3400.67, stdev=1189.66, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2318KiB/s (2373kB/s)(6144KiB/2651msec); 0 zone resets clat (msec): min=126, max=831, avg=318.82, stdev=280.81 lat (msec): min=126, max=831, avg=318.93, stdev=280.83 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 209], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2015, max= 4096, per=42.96%, avg=2994.50, stdev=1122.56, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 1000=8.33% cpu : usr=0.04%, sys=22.19%, ctx=301, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155053: Thu Jul 9 21:27:06 2026 read: IOPS=1, BW=1245KiB/s (1275kB/s)(5120KiB/4113msec) clat (usec): min=905, max=147408, avg=85174.23, stdev=77040.88 lat (usec): min=906, max=147409, avg=85177.02, stdev=77042.38 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 906], 10.00th=[ 906], 20.00th=[ 906], | 30.00th=[ 930], 40.00th=[ 930], 50.00th=[135267], 60.00th=[135267], | 70.00th=[141558], 80.00th=[141558], 90.00th=[147850], 95.00th=[147850], | 99.00th=[147850], 99.50th=[147850], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 2043, max= 6023, per=81.00%, avg=4033.00, stdev=2814.28, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1743KiB/s (1785kB/s)(7168KiB/4113msec); 0 zone resets clat (msec): min=107, max=1015, avg=486.65, stdev=325.00 lat (msec): min=107, max=1015, avg=486.74, stdev=325.00 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 288], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 372], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 852], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 2039, max= 6083, per=51.00%, avg=3555.00, stdev=1934.35, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 1000=16.67% lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.52%, ctx=288, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4979KiB/s (5099kB/s), 562KiB/s-2923KiB/s (575kB/s-2993kB/s), io=20.0MiB (20.0MB), run=2452-4113msec WRITE: bw=6971KiB/s (7138kB/s), 1743KiB/s-2809KiB/s (1785kB/s-2877kB/s), io=28.0MiB (29.4MB), run=2452-4113msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155050: Thu Jul 9 21:27:06 2026 read: IOPS=2, BW=2132KiB/s (2183kB/s)(7168KiB/3362msec) clat (msec): min=58, max=588, avg=221.15, stdev=186.21 lat (msec): min=58, max=588, avg=221.15, stdev=186.21 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 85], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 144], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 300], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1992, max= 3676, per=49.44%, avg=2438.75, stdev=825.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1523KiB/s (1559kB/s)(5120KiB/3362msec); 0 zone resets clat (msec): min=139, max=876, avg=308.94, stdev=317.99 lat (msec): min=139, max=876, avg=309.04, stdev=317.98 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2039, max= 6119, per=59.06%, avg=4079.00, stdev=2885.00, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=6.90%, ctx=160, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155052: Thu Jul 9 21:27:06 2026 read: IOPS=0, BW=493KiB/s (505kB/s)(2048KiB/4151msec) clat (msec): min=200, max=419, avg=309.87, stdev=155.21 lat (msec): min=200, max=419, avg=309.87, stdev=155.21 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1961, max= 2048, per=40.63%, avg=2004.50, stdev=61.52, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2467KiB/s (2526kB/s)(10.0MiB/4151msec); 0 zone resets clat (msec): min=164, max=687, avg=349.82, stdev=166.75 lat (msec): min=164, max=687, avg=349.94, stdev=166.78 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 199], | 30.00th=[ 218], 40.00th=[ 262], 50.00th=[ 279], 60.00th=[ 296], | 70.00th=[ 405], 80.00th=[ 481], 90.00th=[ 510], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2019, max= 4079, per=43.27%, avg=2988.67, stdev=1054.48, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=8.41%, ctx=88, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155054: Thu Jul 9 21:27:06 2026 read: IOPS=1, BW=1862KiB/s (1907kB/s)(6144KiB/3299msec) clat (msec): min=52, max=160, avg=85.64, stdev=39.81 lat (msec): min=52, max=160, avg=85.64, stdev=39.81 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 55], | 30.00th=[ 55], 40.00th=[ 74], 50.00th=[ 74], 60.00th=[ 81], | 70.00th=[ 92], 80.00th=[ 92], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 2048, max= 4096, per=66.27%, avg=3269.00, stdev=1079.35, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1862KiB/s (1907kB/s)(6144KiB/3299msec); 0 zone resets clat (msec): min=130, max=813, avg=441.40, stdev=275.85 lat (msec): min=130, max=813, avg=441.49, stdev=275.84 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 405], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1831, max= 2756, per=31.43%, avg=2170.75, stdev=403.35, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (msec) : 100=41.67%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.09%, ctx=84, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155055: Thu Jul 9 21:27:06 2026 read: IOPS=1, BW=1398KiB/s (1432kB/s)(5120KiB/3662msec) clat (msec): min=57, max=447, avg=185.76, stdev=165.05 lat (msec): min=57, max=447, avg=185.76, stdev=165.05 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 87], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2023, max= 4096, per=55.19%, avg=2722.33, stdev=1189.70, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1957KiB/s (2004kB/s)(7168KiB/3662msec); 0 zone resets clat (msec): min=138, max=788, avg=372.29, stdev=217.42 lat (msec): min=138, max=788, avg=372.38, stdev=217.42 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 188], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 397], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 439], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1372, max= 3663, per=32.96%, avg=2276.50, stdev=975.87, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=16.67%, 500=50.00%, 1000=8.33% cpu : usr=0.00%, sys=5.38%, ctx=79, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4934KiB/s (5052kB/s), 493KiB/s-2132KiB/s (505kB/s-2183kB/s), io=20.0MiB (20.0MB), run=3299-4151msec WRITE: bw=6907KiB/s (7073kB/s), 1523KiB/s-2467KiB/s (1559kB/s-2526kB/s), io=28.0MiB (29.4MB), run=3299-4151msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155066: Thu Jul 9 21:27:15 2026 read: IOPS=1, BW=7420KiB/s (7598kB/s)(12.0MiB/1656msec) clat (msec): min=544, max=558, avg=551.22, stdev= 6.79 lat (msec): min=544, max=558, avg=551.22, stdev= 6.79 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 6177, max= 8159, per=92.36%, avg=7168.00, stdev=1401.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=25.50%, ctx=570, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155067: Thu Jul 9 21:27:15 2026 read: IOPS=0, BW=1940KiB/s (1987kB/s)(4096KiB/2111msec) clat (nsec): min=669661k, max=669661k, avg=669661481.00, stdev= 0.00 lat (nsec): min=669663k, max=669663k, avg=669663204.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3881KiB/s (3974kB/s)(8192KiB/2111msec); 0 zone resets clat (msec): min=610, max=827, avg=719.35, stdev=153.24 lat (msec): min=611, max=828, avg=719.70, stdev=153.17 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8143, max= 8143, per=52.46%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.92%, ctx=145, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155068: Thu Jul 9 21:27:15 2026 write: IOPS=1, BW=5891KiB/s (6032kB/s)(12.0MiB/2086msec); 0 zone resets clat (msec): min=266, max=950, avg=694.64, stdev=372.79 lat (msec): min=267, max=951, avg=695.12, stdev=372.91 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8159, max= 8159, per=52.56%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=10.98%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155069: Thu Jul 9 21:27:15 2026 write: IOPS=1, BW=6804KiB/s (6967kB/s)(12.0MiB/1806msec); 0 zone resets clat (msec): min=269, max=793, avg=600.58, stdev=288.09 lat (msec): min=269, max=794, avg=601.58, stdev=288.62 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8159, max= 8159, per=52.56%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=7.87%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7761KiB/s (7948kB/s), 1940KiB/s-7420KiB/s (1987kB/s-7598kB/s), io=16.0MiB (16.8MB), run=1656-2111msec WRITE: bw=15.2MiB/s (15.9MB/s), 3881KiB/s-6804KiB/s (3974kB/s-6967kB/s), io=32.0MiB (33.6MB), run=1806-2111msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155061: Thu Jul 9 21:27:16 2026 read: IOPS=2, BW=9143KiB/s (9362kB/s)(12.0MiB/1344msec) clat (msec): min=237, max=637, avg=433.58, stdev=200.23 lat (msec): min=237, max=637, avg=433.58, stdev=200.23 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=8.27%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155062: Thu Jul 9 21:27:16 2026 read: IOPS=0, BW=2454KiB/s (2513kB/s)(4096KiB/1669msec) clat (nsec): min=194030k, max=194030k, avg=194030279.00, stdev= 0.00 lat (nsec): min=194035k, max=194035k, avg=194034606.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 194], 95.00th=[ 194], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 6725, max= 6725, per=68.51%, avg=6725.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4908KiB/s (5026kB/s)(8192KiB/1669msec); 0 zone resets clat (msec): min=703, max=721, avg=712.11, stdev=12.65 lat (msec): min=703, max=722, avg=712.94, stdev=13.36 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8175, max= 8175, per=65.96%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.24%, sys=14.81%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155063: Thu Jul 9 21:27:16 2026 write: IOPS=1, BW=4648KiB/s (4759kB/s)(12.0MiB/2644msec); 0 zone resets clat (msec): min=143, max=1695, avg=863.42, stdev=781.70 lat (msec): min=144, max=1695, avg=863.82, stdev=781.69 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8192, max= 8192, per=66.10%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.35%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155064: Thu Jul 9 21:27:16 2026 write: IOPS=2, BW=8416KiB/s (8618kB/s)(12.0MiB/1460msec); 0 zone resets clat (msec): min=256, max=710, avg=454.88, stdev=232.06 lat (msec): min=257, max=710, avg=455.46, stdev=232.15 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 6253, max= 8175, per=58.21%, avg=7214.00, stdev=1359.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.14%, sys=12.27%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9817KiB/s (10.1MB/s), 2454KiB/s-9143KiB/s (2513kB/s-9362kB/s), io=16.0MiB (16.8MB), run=1344-1669msec WRITE: bw=12.1MiB/s (12.7MB/s), 4648KiB/s-8416KiB/s (4759kB/s-8618kB/s), io=32.0MiB (33.6MB), run=1460-2644msec