== sanity test 398b: DIO and buffer IO race ============== 18:27:37 (1781216857) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.33506 s, 6.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178916: Thu Jun 11 18:30:09 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(5992KiB/131140msec) clat (usec): min=39, max=952728, avg=48436.06, stdev=39731.45 lat (usec): min=40, max=952730, avg=48439.11, stdev=39730.93 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 6915], 10.00th=[ 17171], 20.00th=[ 23987], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[173016], 99.50th=[204473], 99.90th=[287310], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 118, per=24.93%, avg=45.38, stdev=19.70, samples=258 iops : min= 1, max= 29, avg=10.68, stdev= 4.94, samples=258 write: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6296KiB/131140msec); 0 zone resets clat (usec): min=860, max=245097, avg=36816.61, stdev=37859.42 lat (usec): min=861, max=245099, avg=36819.48, stdev=37858.13 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1713], 20.00th=[ 4424], | 30.00th=[ 7898], 40.00th=[ 15926], 50.00th=[ 25560], 60.00th=[ 36439], | 70.00th=[ 47449], 80.00th=[ 64750], 90.00th=[ 91751], 95.00th=[111674], | 99.00th=[170918], 99.50th=[185598], 99.90th=[233833], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 144, per=25.11%, avg=47.96, stdev=22.02, samples=256 iops : min= 1, max= 36, avg=11.34, stdev= 5.54, samples=256 lat (usec) : 50=0.29%, 100=1.73%, 250=0.13%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.89%, 4=3.55%, 10=7.94%, 20=9.93%, 50=37.04% lat (msec) : 100=26.63%, 250=6.48%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.17%, ctx=6518, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178917: Thu Jun 11 18:30:09 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(5940KiB/130638msec) clat (usec): min=36, max=285424, avg=48169.16, stdev=31168.71 lat (usec): min=36, max=285425, avg=48171.54, stdev=31169.82 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12125], 10.00th=[ 18482], 20.00th=[ 25297], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[162530], 99.50th=[183501], 99.90th=[242222], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 6, max= 110, per=24.90%, avg=45.32, stdev=17.35, samples=256 iops : min= 1, max= 27, avg=10.67, stdev= 4.36, samples=256 write: IOPS=12, BW=48.6KiB/s (49.8kB/s)(6348KiB/130638msec); 0 zone resets clat (usec): min=825, max=655795, avg=36816.44, stdev=40712.99 lat (usec): min=825, max=655796, avg=36819.15, stdev=40712.73 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1991], 20.00th=[ 4817], | 30.00th=[ 8979], 40.00th=[ 17957], 50.00th=[ 26870], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[164627], 99.50th=[208667], 99.90th=[320865], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 6, max= 134, per=25.38%, avg=48.48, stdev=22.76, samples=256 iops : min= 1, max= 33, avg=11.46, stdev= 5.72, samples=256 lat (usec) : 50=0.23%, 100=1.69%, 250=0.10%, 500=0.03%, 1000=0.10% lat (msec) : 2=5.14%, 4=3.97%, 10=7.26%, 20=8.72%, 50=40.27% lat (msec) : 100=25.81%, 250=6.51%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.22%, ctx=6459, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178918: Thu Jun 11 18:30:09 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6028KiB/131488msec) clat (usec): min=33, max=693519, avg=48680.74, stdev=37312.88 lat (usec): min=33, max=693520, avg=48682.28, stdev=37312.86 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11207], 10.00th=[ 17695], 20.00th=[ 23462], | 30.00th=[ 29492], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[170918], 99.50th=[202376], 99.90th=[283116], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 103, per=25.16%, avg=45.80, stdev=18.31, samples=256 iops : min= 1, max= 25, avg=10.79, stdev= 4.62, samples=256 write: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6260KiB/131488msec); 0 zone resets clat (usec): min=889, max=218376, avg=36726.71, stdev=36267.83 lat (usec): min=890, max=218377, avg=36731.62, stdev=36266.77 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 1729], 20.00th=[ 4228], | 30.00th=[ 7767], 40.00th=[ 18482], 50.00th=[ 27395], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 64750], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[147850], 99.50th=[177210], 99.90th=[210764], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 133, per=24.72%, avg=47.21, stdev=21.72, samples=257 iops : min= 1, max= 33, avg=11.15, stdev= 5.48, samples=257 lat (usec) : 50=0.29%, 100=1.53%, 250=0.13%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.83%, 4=4.13%, 10=7.32%, 20=8.33%, 50=38.87% lat (msec) : 100=27.12%, 250=6.18%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.03%, ctx=6508, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178919: Thu Jun 11 18:30:09 2026 read: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6052KiB/130716msec) clat (usec): min=38, max=699310, avg=48609.89, stdev=36446.75 lat (usec): min=38, max=699311, avg=48613.59, stdev=36445.24 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 12911], 10.00th=[ 17957], 20.00th=[ 24511], | 30.00th=[ 30016], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[183501], 99.50th=[210764], 99.90th=[287310], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 104, per=25.36%, avg=46.16, stdev=18.90, samples=256 iops : min= 1, max= 26, avg=10.88, stdev= 4.76, samples=256 write: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6236KiB/130716msec); 0 zone resets clat (usec): min=802, max=250666, avg=36271.31, stdev=37426.61 lat (usec): min=802, max=250667, avg=36275.88, stdev=37424.42 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1614], 20.00th=[ 4178], | 30.00th=[ 7898], 40.00th=[ 16712], 50.00th=[ 26346], 60.00th=[ 35914], | 70.00th=[ 46400], 80.00th=[ 60556], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[160433], 99.50th=[179307], 99.90th=[229639], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 7, max= 126, per=24.87%, avg=47.50, stdev=20.54, samples=256 iops : min= 1, max= 31, avg=11.22, stdev= 5.17, samples=256 lat (usec) : 50=0.26%, 100=1.56%, 250=0.10%, 500=0.07%, 1000=0.10% lat (msec) : 2=5.96%, 4=3.84%, 10=7.29%, 20=8.92%, 50=39.52% lat (msec) : 100=26.20%, 250=6.05%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.09%, ctx=6456, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=183KiB/s (187kB/s), 45.5KiB/s-46.3KiB/s (46.6kB/s-47.4kB/s), io=23.4MiB (24.6MB), run=130638-131488msec WRITE: bw=191KiB/s (196kB/s), 47.6KiB/s-48.6KiB/s (48.8kB/s-49.8kB/s), io=24.6MiB (25.7MB), run=130638-131488msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178920: Thu Jun 11 18:30:53 2026 read: IOPS=8, BW=34.4KiB/s (35.2kB/s)(5992KiB/174374msec) clat (msec): min=5, max=987, avg=45.02, stdev=46.96 lat (msec): min=5, max=987, avg=45.03, stdev=46.96 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 99], 95.00th=[ 128], | 99.00th=[ 199], 99.50th=[ 239], 99.90th=[ 338], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 144, per=25.47%, avg=34.89, stdev=24.30, samples=333 iops : min= 1, max= 36, avg= 8.06, stdev= 6.13, samples=333 write: IOPS=9, BW=36.1KiB/s (36.0kB/s)(6296KiB/174374msec); 0 zone resets clat (msec): min=10, max=315, avg=67.60, stdev=47.56 lat (msec): min=10, max=315, avg=67.60, stdev=47.56 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 80], 80.00th=[ 104], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 228], 99.50th=[ 271], 99.90th=[ 313], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 120, per=25.20%, avg=36.03, stdev=22.55, samples=339 iops : min= 1, max= 30, avg= 8.33, stdev= 5.66, samples=339 lat (msec) : 10=1.27%, 20=13.70%, 50=45.77%, 100=23.99%, 250=14.81% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.05%, sys=2.02%, ctx=4914, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178921: Thu Jun 11 18:30:53 2026 read: IOPS=8, BW=33.0KiB/s (34.8kB/s)(5940KiB/174938msec) clat (msec): min=6, max=711, avg=45.37, stdev=44.56 lat (msec): min=6, max=711, avg=45.37, stdev=44.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 199], 99.50th=[ 232], 99.90th=[ 443], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 128, per=25.30%, avg=34.67, stdev=23.91, samples=332 iops : min= 1, max= 32, avg= 7.99, stdev= 6.02, samples=332 write: IOPS=9, BW=36.3KiB/s (37.2kB/s)(6348KiB/174938msec); 0 zone resets clat (msec): min=10, max=338, avg=67.48, stdev=47.37 lat (msec): min=10, max=338, avg=67.48, stdev=47.37 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 99], 90.00th=[ 133], 95.00th=[ 163], | 99.00th=[ 228], 99.50th=[ 275], 99.90th=[ 317], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 111, per=25.33%, avg=36.22, stdev=22.70, samples=339 iops : min= 1, max= 27, avg= 8.38, stdev= 5.70, samples=339 lat (msec) : 10=1.46%, 20=12.34%, 50=46.26%, 100=24.84%, 250=14.65% lat (msec) : 500=0.42%, 750=0.03% cpu : usr=0.07%, sys=1.99%, ctx=4948, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178922: Thu Jun 11 18:30:53 2026 read: IOPS=8, BW=34.9KiB/s (35.7kB/s)(6028KiB/172886msec) clat (msec): min=6, max=227, avg=44.43, stdev=37.56 lat (msec): min=6, max=227, avg=44.43, stdev=37.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 97], 95.00th=[ 129], | 99.00th=[ 180], 99.50th=[ 190], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 143, per=25.35%, avg=34.72, stdev=22.57, samples=336 iops : min= 1, max= 35, avg= 8.01, stdev= 5.68, samples=336 write: IOPS=9, BW=36.2KiB/s (37.1kB/s)(6260KiB/172886msec); 0 zone resets clat (msec): min=10, max=722, avg=67.38, stdev=48.24 lat (msec): min=10, max=722, avg=67.38, stdev=48.24 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 79], 80.00th=[ 95], 90.00th=[ 132], 95.00th=[ 161], | 99.00th=[ 222], 99.50th=[ 259], 99.90th=[ 334], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 119, per=25.21%, avg=36.05, stdev=22.31, samples=336 iops : min= 1, max= 29, avg= 8.34, stdev= 5.62, samples=336 lat (msec) : 10=1.14%, 20=12.21%, 50=46.65%, 100=26.14%, 250=13.61% lat (msec) : 500=0.23%, 750=0.03% cpu : usr=0.07%, sys=2.11%, ctx=4864, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178923: Thu Jun 11 18:30:53 2026 read: IOPS=8, BW=34.6KiB/s (35.4kB/s)(6052KiB/175056msec) clat (msec): min=5, max=439, avg=46.11, stdev=42.75 lat (msec): min=5, max=439, avg=46.11, stdev=42.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 69], 90.00th=[ 100], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 224], 99.90th=[ 338], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 135, per=25.41%, avg=34.81, stdev=24.08, samples=338 iops : min= 1, max= 33, avg= 8.03, stdev= 6.05, samples=338 write: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6236KiB/175056msec); 0 zone resets clat (msec): min=13, max=690, avg=67.21, stdev=47.25 lat (msec): min=13, max=690, avg=67.21, stdev=47.25 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 100], 90.00th=[ 129], 95.00th=[ 153], | 99.00th=[ 226], 99.50th=[ 275], 99.90th=[ 313], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 112, per=24.86%, avg=35.55, stdev=21.86, samples=341 iops : min= 1, max= 28, avg= 8.22, stdev= 5.49, samples=341 lat (msec) : 10=1.56%, 20=13.41%, 50=43.95%, 100=26.43%, 250=14.23% lat (msec) : 500=0.39%, 750=0.03% cpu : usr=0.06%, sys=1.98%, ctx=4866, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=137KiB/s (140kB/s), 33.0KiB/s-34.9KiB/s (34.8kB/s-35.7kB/s), io=23.4MiB (24.6MB), run=172886-175056msec WRITE: bw=144KiB/s (147kB/s), 35.6KiB/s-36.3KiB/s (36.5kB/s-37.2kB/s), io=24.6MiB (25.7MB), run=172886-175056msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178968: Thu Jun 11 18:31:39 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(5920KiB/33863msec) clat (usec): min=31, max=212569, avg=48440.45, stdev=32752.38 lat (usec): min=32, max=212571, avg=48441.50, stdev=32752.38 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 63], 10.00th=[ 83], 20.00th=[ 25035], | 30.00th=[ 30802], 40.00th=[ 39060], 50.00th=[ 44303], 60.00th=[ 52691], | 70.00th=[ 58983], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[162530], 99.50th=[177210], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 62, max= 380, per=24.63%, avg=171.21, stdev=69.20, samples=66 iops : min= 3, max= 23, avg= 9.91, stdev= 4.37, samples=66 write: IOPS=11, BW=188KiB/s (193kB/s)(6368KiB/33863msec); 0 zone resets clat (usec): min=1614, max=269220, avg=39344.23, stdev=37967.49 lat (usec): min=1615, max=269223, avg=39358.65, stdev=37967.30 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2057], 10.00th=[ 3884], 20.00th=[ 7635], | 30.00th=[ 12256], 40.00th=[ 18482], 50.00th=[ 26608], 60.00th=[ 39060], | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 91751], 95.00th=[117965], | 99.00th=[160433], 99.50th=[185598], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 346, per=25.85%, avg=188.94, stdev=75.00, samples=65 iops : min= 1, max= 21, avg=11.05, stdev= 4.72, samples=65 lat (usec) : 50=0.39%, 100=4.56%, 250=0.13% lat (msec) : 2=2.47%, 4=3.52%, 10=7.68%, 20=10.42%, 50=34.51% lat (msec) : 100=29.30%, 250=6.90%, 500=0.13% cpu : usr=0.08%, sys=5.76%, ctx=1743, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178969: Thu Jun 11 18:31:39 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5744KiB/34210msec) clat (usec): min=43, max=208996, avg=48931.66, stdev=33710.91 lat (usec): min=44, max=208997, avg=48932.71, stdev=33710.95 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 135], 20.00th=[ 24249], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[113771], | 99.00th=[164627], 99.50th=[181404], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 28, max= 343, per=24.53%, avg=170.47, stdev=74.54, samples=66 iops : min= 1, max= 21, avg= 9.86, stdev= 4.73, samples=66 write: IOPS=11, BW=191KiB/s (196kB/s)(6544KiB/34210msec); 0 zone resets clat (usec): min=1538, max=186929, avg=40083.35, stdev=37810.24 lat (usec): min=1539, max=186932, avg=40102.57, stdev=37797.18 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2376], 10.00th=[ 4047], 20.00th=[ 7177], | 30.00th=[ 11994], 40.00th=[ 20579], 50.00th=[ 28967], 60.00th=[ 39060], | 70.00th=[ 50070], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[113771], | 99.00th=[160433], 99.50th=[168821], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 414, per=26.16%, avg=191.25, stdev=87.97, samples=67 iops : min= 1, max= 25, avg=11.18, stdev= 5.57, samples=67 lat (usec) : 50=0.26%, 100=4.30%, 250=0.26%, 750=0.13% lat (msec) : 2=1.43%, 4=3.78%, 10=9.51%, 20=8.59%, 50=36.33% lat (msec) : 100=26.56%, 250=8.85% cpu : usr=0.05%, sys=5.99%, ctx=1739, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178970: Thu Jun 11 18:31:39 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(6256KiB/34442msec) clat (usec): min=38, max=247881, avg=49026.60, stdev=34182.14 lat (usec): min=39, max=247882, avg=49027.76, stdev=34182.17 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 10421], 20.00th=[ 23462], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 45351], 60.00th=[ 52691], | 70.00th=[ 61604], 80.00th=[ 70779], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[170918], 99.50th=[225444], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 351, per=26.02%, avg=180.85, stdev=68.85, samples=67 iops : min= 1, max= 21, avg=10.54, stdev= 4.34, samples=67 write: IOPS=10, BW=175KiB/s (179kB/s)(6032KiB/34442msec); 0 zone resets clat (usec): min=1487, max=192320, avg=40236.24, stdev=34964.75 lat (usec): min=1490, max=192321, avg=40238.59, stdev=34964.77 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2180], 10.00th=[ 3720], 20.00th=[ 8356], | 30.00th=[ 14091], 40.00th=[ 25297], 50.00th=[ 31589], 60.00th=[ 40633], | 70.00th=[ 51643], 80.00th=[ 67634], 90.00th=[ 95945], 95.00th=[108528], | 99.00th=[147850], 99.50th=[152044], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 441, per=23.87%, avg=174.52, stdev=81.42, samples=66 iops : min= 1, max= 27, avg=10.14, stdev= 5.17, samples=66 lat (usec) : 50=0.26%, 100=4.43%, 250=0.26%, 1000=0.13% lat (msec) : 2=2.21%, 4=2.99%, 10=6.12%, 20=8.59%, 50=38.41% lat (msec) : 100=29.82%, 250=6.77% cpu : usr=0.07%, sys=5.73%, ctx=1760, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178971: Thu Jun 11 18:31:39 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(6032KiB/33528msec) clat (usec): min=34, max=329739, avg=48647.19, stdev=38200.83 lat (usec): min=35, max=329740, avg=48648.20, stdev=38200.81 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 21103], | 30.00th=[ 30278], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 52167], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[181404], 99.50th=[252707], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 379, per=26.23%, avg=182.32, stdev=64.96, samples=65 iops : min= 1, max= 23, avg=10.62, stdev= 4.10, samples=65 write: IOPS=11, BW=187KiB/s (191kB/s)(6256KiB/33528msec); 0 zone resets clat (usec): min=1458, max=231600, avg=38206.62, stdev=39136.60 lat (usec): min=1460, max=231601, avg=38208.83, stdev=39136.68 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2024], 10.00th=[ 3130], 20.00th=[ 5997], | 30.00th=[ 9110], 40.00th=[ 15270], 50.00th=[ 23725], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 66847], 90.00th=[ 92799], 95.00th=[119014], | 99.00th=[162530], 99.50th=[181404], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 61, max= 379, per=25.54%, avg=186.67, stdev=74.71, samples=66 iops : min= 3, max= 23, avg=10.89, stdev= 4.72, samples=66 lat (usec) : 50=0.52%, 100=6.25%, 250=0.39% lat (msec) : 2=2.60%, 4=4.17%, 10=9.64%, 20=9.11%, 50=30.34% lat (msec) : 100=29.56%, 250=7.16%, 500=0.26% cpu : usr=0.10%, sys=5.82%, ctx=1678, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=695KiB/s (712kB/s), 168KiB/s-182KiB/s (172kB/s-186kB/s), io=23.4MiB (24.5MB), run=33528-34442msec WRITE: bw=732KiB/s (749kB/s), 175KiB/s-191KiB/s (179kB/s-196kB/s), io=24.6MiB (25.8MB), run=33528-34442msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178964: Thu Jun 11 18:31:51 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(5920KiB/45937msec) clat (msec): min=8, max=300, avg=48.99, stdev=44.19 lat (msec): min=8, max=300, avg=49.01, stdev=44.19 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 72], 90.00th=[ 111], 95.00th=[ 146], | 99.00th=[ 203], 99.50th=[ 259], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 349, per=25.38%, avg=132.21, stdev=84.19, samples=86 iops : min= 1, max= 21, avg= 7.44, stdev= 5.33, samples=86 write: IOPS=8, BW=139KiB/s (142kB/s)(6368KiB/45937msec); 0 zone resets clat (msec): min=14, max=363, avg=69.70, stdev=48.97 lat (msec): min=14, max=363, avg=69.71, stdev=48.97 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 67], | 70.00th=[ 82], 80.00th=[ 105], 90.00th=[ 136], 95.00th=[ 171], | 99.00th=[ 257], 99.50th=[ 284], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 383, per=25.33%, avg=138.80, stdev=84.77, samples=89 iops : min= 1, max= 23, avg= 7.85, stdev= 5.39, samples=89 lat (msec) : 10=1.04%, 20=10.68%, 50=46.48%, 100=25.39%, 250=15.63% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=2.08%, ctx=1271, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178965: Thu Jun 11 18:31:51 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(5744KiB/45813msec) clat (msec): min=7, max=354, avg=48.32, stdev=42.76 lat (msec): min=7, max=354, avg=48.32, stdev=42.76 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 64], 90.00th=[ 113], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 292], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 415, per=24.14%, avg=125.75, stdev=86.17, samples=89 iops : min= 1, max= 25, avg= 7.03, stdev= 5.45, samples=89 write: IOPS=8, BW=143KiB/s (146kB/s)(6544KiB/45813msec); 0 zone resets clat (msec): min=14, max=330, avg=69.28, stdev=46.24 lat (msec): min=14, max=330, avg=69.28, stdev=46.24 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 104], 90.00th=[ 132], 95.00th=[ 167], | 99.00th=[ 215], 99.50th=[ 251], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 447, per=26.10%, avg=143.04, stdev=89.93, samples=89 iops : min= 1, max= 27, avg= 8.12, stdev= 5.72, samples=89 lat (msec) : 10=0.52%, 20=10.68%, 50=45.31%, 100=26.95%, 250=15.89% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.94%, ctx=1210, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178966: Thu Jun 11 18:31:51 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/45943msec) clat (msec): min=7, max=275, avg=46.16, stdev=39.00 lat (msec): min=7, max=275, avg=46.17, stdev=39.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 67], 90.00th=[ 104], 95.00th=[ 128], | 99.00th=[ 180], 99.50th=[ 224], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 468, per=26.30%, avg=137.01, stdev=100.73, samples=89 iops : min= 1, max= 29, avg= 7.75, stdev= 6.39, samples=89 write: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/45943msec); 0 zone resets clat (msec): min=12, max=373, avg=73.37, stdev=52.30 lat (msec): min=12, max=373, avg=73.37, stdev=52.30 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 47], 50.00th=[ 59], 60.00th=[ 68], | 70.00th=[ 87], 80.00th=[ 109], 90.00th=[ 157], 95.00th=[ 178], | 99.00th=[ 236], 99.50th=[ 279], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 30, max= 415, per=23.78%, avg=130.30, stdev=77.66, samples=89 iops : min= 1, max= 25, avg= 7.33, stdev= 4.93, samples=89 lat (msec) : 10=0.91%, 20=12.76%, 50=44.01%, 100=25.39%, 250=16.54% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=1.95%, ctx=1272, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178967: Thu Jun 11 18:31:51 2026 read: IOPS=8, BW=132KiB/s (136kB/s)(6032KiB/45576msec) clat (msec): min=5, max=293, avg=49.65, stdev=45.12 lat (msec): min=5, max=293, avg=49.66, stdev=45.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 71], 90.00th=[ 108], 95.00th=[ 153], | 99.00th=[ 209], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 478, per=25.78%, avg=134.33, stdev=91.39, samples=88 iops : min= 1, max= 29, avg= 7.58, stdev= 5.78, samples=88 write: IOPS=8, BW=137KiB/s (141kB/s)(6256KiB/45576msec); 0 zone resets clat (msec): min=10, max=313, avg=67.81, stdev=42.21 lat (msec): min=10, max=313, avg=67.82, stdev=42.21 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 97], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 203], 99.50th=[ 275], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 381, per=25.34%, avg=138.84, stdev=84.07, samples=89 iops : min= 1, max= 23, avg= 7.87, stdev= 5.34, samples=89 lat (msec) : 10=1.43%, 20=10.68%, 50=44.14%, 100=28.26%, 250=14.84% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=2.04%, ctx=1253, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=521KiB/s (534kB/s), 125KiB/s-136KiB/s (128kB/s-139kB/s), io=23.4MiB (24.5MB), run=45576-45943msec WRITE: bw=549KiB/s (562kB/s), 131KiB/s-143KiB/s (134kB/s-146kB/s), io=24.6MiB (25.8MB), run=45576-45943msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178988: Thu Jun 11 18:32:10 2026 read: IOPS=1, BW=1159KiB/s (1187kB/s)(7168KiB/6186msec) clat (msec): min=115, max=425, avg=261.15, stdev=104.47 lat (msec): min=115, max=425, avg=261.15, stdev=104.47 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 155], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 284], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 317], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1517, max= 3567, per=69.39%, avg=2219.20, stdev=783.10, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=828KiB/s (848kB/s)(5120KiB/6186msec); 0 zone resets clat (msec): min=249, max=3006, avg=870.89, stdev=1197.10 lat (msec): min=249, max=3006, avg=871.28, stdev=1196.91 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1950, max= 4007, per=59.44%, avg=2661.33, stdev=1166.02, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.11%, ctx=182, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178989: Thu Jun 11 18:32:10 2026 read: IOPS=0, BW=361KiB/s (369kB/s)(2048KiB/5678msec) clat (msec): min=118, max=318, avg=218.31, stdev=141.21 lat (msec): min=118, max=318, avg=218.31, stdev=141.21 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1855, max= 1950, per=59.49%, avg=1902.50, stdev=67.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1803KiB/s (1847kB/s)(10.0MiB/5678msec); 0 zone resets clat (msec): min=101, max=2146, avg=523.92, stdev=613.26 lat (msec): min=101, max=2146, avg=524.03, stdev=613.24 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 140], | 30.00th=[ 201], 40.00th=[ 226], 50.00th=[ 296], 60.00th=[ 313], | 70.00th=[ 326], 80.00th=[ 743], 90.00th=[ 751], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 1517, max= 6131, per=78.89%, avg=3532.00, stdev=1858.55, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.23%, ctx=132, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178990: Thu Jun 11 18:32:10 2026 read: IOPS=1, BW=1691KiB/s (1731kB/s)(6144KiB/3634msec) clat (usec): min=605, max=436621, avg=184966.04, stdev=171361.77 lat (usec): min=607, max=436622, avg=184967.44, stdev=171361.69 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 17957], | 30.00th=[ 17957], 40.00th=[116917], 50.00th=[116917], 60.00th=[229639], | 70.00th=[308282], 80.00th=[308282], 90.00th=[438305], 95.00th=[438305], | 99.00th=[438305], 99.50th=[438305], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 1950, max= 4071, per=100.00%, avg=3342.67, stdev=1206.51, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1691KiB/s (1731kB/s)(6144KiB/3634msec); 0 zone resets clat (msec): min=264, max=799, avg=419.48, stdev=209.59 lat (msec): min=264, max=799, avg=419.61, stdev=209.62 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 401], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1517, max= 2027, per=42.43%, avg=1899.40, stdev=215.60, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=9.17%, ctx=129, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178991: Thu Jun 11 18:32:10 2026 read: IOPS=0, BW=800KiB/s (819kB/s)(5120KiB/6404msec) clat (usec): min=481, max=2595.1k, avg=660775.07, stdev=1096073.69 lat (usec): min=483, max=2595.1k, avg=660776.46, stdev=1096073.75 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], | 20.00th=[ 482], 30.00th=[ 660], 40.00th=[ 660], | 50.00th=[ 312476], 60.00th=[ 312476], 70.00th=[ 396362], | 80.00th=[ 396362], 90.00th=[2600469], 95.00th=[2600469], | 99.00th=[2600469], 99.50th=[2600469], 99.90th=[2600469], | 99.95th=[2600469], 99.99th=[2600469] bw ( KiB/s): min= 1950, max= 6083, per=100.00%, avg=4016.50, stdev=2922.47, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1119KiB/s (1146kB/s)(7168KiB/6404msec); 0 zone resets clat (msec): min=116, max=988, avg=438.98, stdev=347.95 lat (msec): min=116, max=988, avg=439.06, stdev=347.95 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 124], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 363], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 852], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1815, max= 4087, per=53.46%, avg=2393.40, stdev=951.04, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=25.00%, 500=33.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.79%, ctx=482, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3198KiB/s (3275kB/s), 361KiB/s-1691KiB/s (369kB/s-1731kB/s), io=20.0MiB (20.0MB), run=3634-6404msec WRITE: bw=4477KiB/s (4585kB/s), 828KiB/s-1803KiB/s (848kB/s-1847kB/s), io=28.0MiB (29.4MB), run=3634-6404msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178983: Thu Jun 11 18:32:10 2026 read: IOPS=1, BW=1141KiB/s (1169kB/s)(7168KiB/6280msec) clat (msec): min=143, max=350, avg=231.13, stdev=70.20 lat (msec): min=143, max=350, avg=231.13, stdev=70.20 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 182], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 211], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 296], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1939, max= 3930, per=98.20%, avg=2749.50, stdev=957.34, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=815KiB/s (835kB/s)(5120KiB/6280msec); 0 zone resets clat (msec): min=176, max=2963, avg=898.86, stdev=1171.25 lat (msec): min=176, max=2963, avg=901.32, stdev=1170.56 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1939, max= 2035, per=50.77%, avg=1990.60, stdev=38.27, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=2.31%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178984: Thu Jun 11 18:32:10 2026 read: IOPS=0, BW=297KiB/s (304kB/s)(2048KiB/6892msec) clat (msec): min=163, max=604, avg=384.23, stdev=311.80 lat (msec): min=163, max=604, avg=384.23, stdev=311.80 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1514, max= 1961, per=62.05%, avg=1737.50, stdev=316.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1486KiB/s (1521kB/s)(10.0MiB/6892msec); 0 zone resets clat (msec): min=188, max=1943, avg=594.28, stdev=531.49 lat (msec): min=188, max=1943, avg=594.37, stdev=531.48 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 224], | 30.00th=[ 342], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 368], | 70.00th=[ 451], 80.00th=[ 760], 90.00th=[ 969], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1514, max= 4087, per=64.13%, avg=2514.71, stdev=1037.94, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.03%, sys=4.51%, ctx=96, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178985: Thu Jun 11 18:32:10 2026 read: IOPS=0, BW=840KiB/s (860kB/s)(6144KiB/7312msec) clat (msec): min=105, max=3050, avg=784.81, stdev=1141.21 lat (msec): min=105, max=3050, avg=784.81, stdev=1141.21 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 313], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1961, max= 2035, per=71.56%, avg=2003.80, stdev=37.38, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=840KiB/s (860kB/s)(6144KiB/7312msec); 0 zone resets clat (msec): min=126, max=940, avg=425.36, stdev=325.03 lat (msec): min=126, max=940, avg=425.53, stdev=325.05 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 550], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1965, max= 4071, per=70.94%, avg=2781.75, stdev=993.66, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=50.00%, 500=8.33%, 750=16.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=1.82%, ctx=59, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178986: Thu Jun 11 18:32:10 2026 read: IOPS=1, BW=1500KiB/s (1536kB/s)(5120KiB/3414msec) clat (msec): min=97, max=458, avg=203.64, stdev=146.15 lat (msec): min=97, max=458, avg=203.64, stdev=146.15 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 3930, max= 4055, per=100.00%, avg=3992.50, stdev=88.39, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2100KiB/s (2150kB/s)(7168KiB/3414msec); 0 zone resets clat (msec): min=130, max=481, avg=312.01, stdev=131.22 lat (msec): min=130, max=481, avg=319.42, stdev=130.19 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 171], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 305], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 435], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1939, max= 3103, per=55.56%, avg=2178.67, stdev=454.31, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.03%, sys=4.04%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2801KiB/s (2868kB/s), 297KiB/s-1500KiB/s (304kB/s-1536kB/s), io=20.0MiB (20.0MB), run=3414-7312msec WRITE: bw=3921KiB/s (4015kB/s), 815KiB/s-2100KiB/s (835kB/s-2150kB/s), io=28.0MiB (29.4MB), run=3414-7312msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179003: Thu Jun 11 18:32:26 2026 read: IOPS=1, BW=4151KiB/s (4251kB/s)(12.0MiB/2960msec) clat (msec): min=708, max=1092, avg=921.90, stdev=195.61 lat (msec): min=708, max=1092, avg=921.90, stdev=195.61 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7968, max= 8143, per=100.00%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.28%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179004: Thu Jun 11 18:32:26 2026 read: IOPS=0, BW=1343KiB/s (1376kB/s)(4096KiB/3049msec) clat (nsec): min=1519.1M, max=1519.1M, avg=1519119952.00, stdev= 0.00 lat (nsec): min=1519.1M, max=1519.1M, avg=1519122562.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1519], 5.00th=[ 1519], 10.00th=[ 1519], 20.00th=[ 1519], | 30.00th=[ 1519], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2687KiB/s (2751kB/s)(8192KiB/3049msec); 0 zone resets clat (msec): min=477, max=757, avg=617.80, stdev=197.82 lat (msec): min=478, max=758, avg=618.18, stdev=197.87 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7968, max= 7968, per=85.82%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.61%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179005: Thu Jun 11 18:32:26 2026 write: IOPS=0, BW=3482KiB/s (3566kB/s)(12.0MiB/3529msec); 0 zone resets clat (msec): min=263, max=1974, avg=1068.65, stdev=859.94 lat (msec): min=263, max=1974, avg=1069.20, stdev=860.09 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 7968, max= 7968, per=85.82%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.83%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179006: Thu Jun 11 18:32:26 2026 write: IOPS=0, BW=3507KiB/s (3591kB/s)(12.0MiB/3504msec); 0 zone resets clat (msec): min=557, max=2290, avg=1135.74, stdev=1000.39 lat (msec): min=557, max=2292, avg=1136.58, stdev=1000.91 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8110, max= 8143, per=87.52%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.74%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5374KiB/s (5503kB/s), 1343KiB/s-4151KiB/s (1376kB/s-4251kB/s), io=16.0MiB (16.8MB), run=2960-3049msec WRITE: bw=9285KiB/s (9508kB/s), 2687KiB/s-3507KiB/s (2751kB/s-3591kB/s), io=32.0MiB (33.6MB), run=3049-3529msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178999: Thu Jun 11 18:32:26 2026 read: IOPS=0, BW=3991KiB/s (4087kB/s)(12.0MiB/3079msec) clat (msec): min=932, max=1121, avg=1007.85, stdev=100.10 lat (msec): min=932, max=1121, avg=1007.85, stdev=100.10 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7937, max= 7953, per=100.00%, avg=7945.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.37%, ctx=255, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179000: Thu Jun 11 18:32:26 2026 read: IOPS=0, BW=1796KiB/s (1840kB/s)(4096KiB/2280msec) clat (nsec): min=1115.9M, max=1115.9M, avg=1115880752.00, stdev= 0.00 lat (nsec): min=1115.9M, max=1115.9M, avg=1115881742.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3593KiB/s (3679kB/s)(8192KiB/2280msec); 0 zone resets clat (msec): min=328, max=723, avg=526.11, stdev=279.21 lat (msec): min=329, max=726, avg=527.81, stdev=281.07 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8062, max= 8062, per=99.26%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.90%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179001: Thu Jun 11 18:32:26 2026 write: IOPS=0, BW=3046KiB/s (3119kB/s)(12.0MiB/4034msec); 0 zone resets clat (msec): min=146, max=3293, avg=1275.08, stdev=1752.07 lat (msec): min=146, max=3293, avg=1279.54, stdev=1749.04 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 3306], 80.00th=[ 3306], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 8015, max= 8015, per=98.68%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=4.07%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179002: Thu Jun 11 18:32:26 2026 write: IOPS=0, BW=3854KiB/s (3947kB/s)(12.0MiB/3188msec); 0 zone resets clat (msec): min=323, max=2382, avg=1046.90, stdev=1158.29 lat (msec): min=324, max=2383, avg=1047.38, stdev=1158.20 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 6627, max= 7937, per=89.66%, avg=7282.00, stdev=926.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.86%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5321KiB/s (5449kB/s), 1796KiB/s-3991KiB/s (1840kB/s-4087kB/s), io=16.0MiB (16.8MB), run=2280-3079msec WRITE: bw=8123KiB/s (8318kB/s), 3046KiB/s-3854KiB/s (3119kB/s-3947kB/s), io=32.0MiB (33.6MB), run=2280-4034msec