== sanity test 398b: DIO and buffer IO race ============== 20:51:58 (1788742318) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.93048 s, 10.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192114: Sun Sep 6 20:54:05 2026 read: IOPS=13, BW=54.4KiB/s (55.7kB/s)(5992KiB/110193msec) clat (usec): min=37, max=311576, avg=40483.68, stdev=28390.30 lat (usec): min=37, max=311577, avg=40485.76, stdev=28389.25 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 6783], 10.00th=[ 14353], 20.00th=[ 19530], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[145753], 99.50th=[168821], 99.90th=[265290], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 119, per=25.06%, avg=54.13, stdev=22.41, samples=217 iops : min= 1, max= 29, avg=12.89, stdev= 5.62, samples=217 write: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6296KiB/110193msec); 0 zone resets clat (usec): min=955, max=749442, avg=31204.93, stdev=37094.49 lat (usec): min=956, max=749444, avg=31210.15, stdev=37093.73 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1680], 20.00th=[ 3490], | 30.00th=[ 6915], 40.00th=[ 13829], 50.00th=[ 21890], 60.00th=[ 30278], | 70.00th=[ 39584], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[181404], 99.90th=[248513], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 181, per=25.18%, avg=56.91, stdev=26.44, samples=217 iops : min= 1, max= 45, avg=13.59, stdev= 6.61, samples=217 lat (usec) : 50=0.55%, 100=1.56%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.38%, 4=4.92%, 10=7.10%, 20=13.54%, 50=40.62% lat (msec) : 100=21.45%, 250=3.45%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.71%, ctx=6440, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192115: Sun Sep 6 20:54:05 2026 read: IOPS=13, BW=54.4KiB/s (55.7kB/s)(5940KiB/109265msec) clat (usec): min=37, max=239028, avg=40635.65, stdev=27019.50 lat (usec): min=38, max=239028, avg=40639.96, stdev=27020.37 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11207], 10.00th=[ 15139], 20.00th=[ 20317], | 30.00th=[ 24249], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[137364], 99.50th=[152044], 99.90th=[212861], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 103, per=25.03%, avg=54.06, stdev=20.19, samples=215 iops : min= 1, max= 25, avg=12.88, stdev= 5.04, samples=215 write: IOPS=14, BW=58.1KiB/s (59.5kB/s)(6348KiB/109265msec); 0 zone resets clat (usec): min=880, max=768533, avg=30547.42, stdev=37503.66 lat (usec): min=881, max=768534, avg=30551.26, stdev=37502.61 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1582], 20.00th=[ 3097], | 30.00th=[ 5997], 40.00th=[ 12649], 50.00th=[ 20579], 60.00th=[ 28967], | 70.00th=[ 39060], 80.00th=[ 51119], 90.00th=[ 73925], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[173016], 99.90th=[258999], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 159, per=25.54%, avg=57.72, stdev=26.55, samples=215 iops : min= 1, max= 39, avg=13.80, stdev= 6.67, samples=215 lat (usec) : 50=0.07%, 100=1.20%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=6.67%, 4=5.34%, 10=7.42%, 20=13.54%, 50=41.24% lat (msec) : 100=20.38%, 250=3.61%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=6.02%, ctx=6516, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192116: Sun Sep 6 20:54:05 2026 read: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6028KiB/110840msec) clat (usec): min=36, max=292108, avg=40245.16, stdev=29433.76 lat (usec): min=36, max=292109, avg=40254.29, stdev=29430.95 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 8848], 10.00th=[ 13960], 20.00th=[ 18744], | 30.00th=[ 23462], 40.00th=[ 27919], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[143655], 99.50th=[181404], 99.90th=[287310], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 110, per=25.11%, avg=54.23, stdev=21.20, samples=217 iops : min= 1, max= 27, avg=12.93, stdev= 5.32, samples=217 write: IOPS=14, BW=56.5KiB/s (57.8kB/s)(6260KiB/110840msec); 0 zone resets clat (usec): min=1003, max=879206, avg=31781.32, stdev=40397.24 lat (usec): min=1004, max=879208, avg=31785.14, stdev=40399.22 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1647], 20.00th=[ 3064], | 30.00th=[ 5932], 40.00th=[ 13566], 50.00th=[ 21103], 60.00th=[ 29754], | 70.00th=[ 40109], 80.00th=[ 53216], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[152044], 99.50th=[177210], 99.90th=[383779], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 126, per=24.96%, avg=56.41, stdev=23.89, samples=217 iops : min= 1, max= 31, avg=13.46, stdev= 5.99, samples=217 lat (usec) : 50=0.42%, 100=1.56%, 250=0.13%, 750=0.03%, 1000=0.03% lat (msec) : 2=6.74%, 4=5.37%, 10=6.71%, 20=14.58%, 50=39.16% lat (msec) : 100=21.42%, 250=3.68%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=5.60%, ctx=6465, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192117: Sun Sep 6 20:54:05 2026 read: IOPS=13, BW=55.3KiB/s (56.7kB/s)(6052KiB/109355msec) clat (usec): min=37, max=871153, avg=40162.74, stdev=34287.66 lat (usec): min=37, max=871154, avg=40165.99, stdev=34287.80 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9503], 10.00th=[ 14484], 20.00th=[ 19530], | 30.00th=[ 23462], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[131597], 99.50th=[160433], 99.90th=[219153], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 126, per=25.48%, avg=55.04, stdev=22.26, samples=215 iops : min= 1, max= 31, avg=13.13, stdev= 5.58, samples=215 write: IOPS=14, BW=57.0KiB/s (58.4kB/s)(6236KiB/109355msec); 0 zone resets clat (usec): min=997, max=265968, avg=30879.17, stdev=32564.70 lat (usec): min=999, max=265970, avg=30885.11, stdev=32566.82 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1729], 20.00th=[ 3425], | 30.00th=[ 6390], 40.00th=[ 13566], 50.00th=[ 21627], 60.00th=[ 29754], | 70.00th=[ 40109], 80.00th=[ 53740], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[183501], 99.90th=[206570], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 134, per=25.18%, avg=56.92, stdev=23.57, samples=214 iops : min= 1, max= 33, avg=13.60, stdev= 5.91, samples=214 lat (usec) : 50=0.33%, 100=1.53%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.09%, 4=5.37%, 10=7.19%, 20=13.90%, 50=40.62% lat (msec) : 100=21.03%, 250=3.48%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.80%, ctx=6510, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=217KiB/s (222kB/s), 54.4KiB/s-55.3KiB/s (55.7kB/s-56.7kB/s), io=23.4MiB (24.6MB), run=109265-110840msec WRITE: bw=227KiB/s (232kB/s), 56.5KiB/s-58.1KiB/s (57.8kB/s-59.5kB/s), io=24.6MiB (25.7MB), run=109265-110840msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192120: Sun Sep 6 20:54:47 2026 read: IOPS=9, BW=39.8KiB/s (40.8kB/s)(5992KiB/150465msec) clat (msec): min=5, max=842, avg=39.23, stdev=41.00 lat (msec): min=5, max=842, avg=39.23, stdev=41.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 171], 99.50th=[ 197], 99.90th=[ 292], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 143, per=25.21%, avg=39.83, stdev=27.49, samples=294 iops : min= 1, max= 35, avg= 9.30, stdev= 6.91, samples=294 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6296KiB/150465msec); 0 zone resets clat (msec): min=9, max=335, avg=58.17, stdev=40.32 lat (msec): min=9, max=335, avg=58.18, stdev=40.32 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 136], | 99.00th=[ 201], 99.50th=[ 255], 99.90th=[ 317], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 128, per=25.28%, avg=41.72, stdev=25.74, samples=295 iops : min= 1, max= 32, avg= 9.77, stdev= 6.48, samples=295 lat (msec) : 10=3.78%, 20=17.09%, 50=44.53%, 100=24.84%, 250=9.41% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.88%, ctx=4731, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192121: Sun Sep 6 20:54:47 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(5940KiB/150656msec) clat (msec): min=4, max=949, avg=38.58, stdev=42.51 lat (msec): min=4, max=949, avg=38.58, stdev=42.51 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 114], | 99.00th=[ 174], 99.50th=[ 209], 99.90th=[ 347], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 151, per=25.45%, avg=40.21, stdev=27.88, samples=288 iops : min= 1, max= 37, avg= 9.40, stdev= 7.03, samples=288 write: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6348KiB/150656msec); 0 zone resets clat (msec): min=10, max=320, avg=58.76, stdev=41.12 lat (msec): min=10, max=320, avg=58.76, stdev=41.12 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 207], 99.50th=[ 243], 99.90th=[ 300], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 136, per=25.39%, avg=41.89, stdev=26.28, samples=295 iops : min= 1, max= 34, avg= 9.82, stdev= 6.61, samples=295 lat (msec) : 10=3.61%, 20=18.65%, 50=43.07%, 100=24.38%, 250=10.03% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=1.87%, ctx=4796, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192122: Sun Sep 6 20:54:47 2026 read: IOPS=9, BW=39.7KiB/s (40.7kB/s)(6028KiB/151819msec) clat (msec): min=3, max=331, avg=40.76, stdev=39.78 lat (msec): min=3, max=331, avg=40.76, stdev=39.78 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 95], 95.00th=[ 123], | 99.00th=[ 194], 99.50th=[ 232], 99.90th=[ 326], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 159, per=25.14%, avg=39.72, stdev=26.62, samples=295 iops : min= 1, max= 39, avg= 9.27, stdev= 6.71, samples=295 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6260KiB/151819msec); 0 zone resets clat (msec): min=11, max=1024, avg=57.70, stdev=47.27 lat (msec): min=11, max=1024, avg=57.71, stdev=47.27 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 110], 95.00th=[ 136], | 99.00th=[ 203], 99.50th=[ 239], 99.90th=[ 464], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 151, per=24.93%, avg=41.14, stdev=27.26, samples=295 iops : min= 1, max= 37, avg= 9.63, stdev= 6.86, samples=295 lat (msec) : 4=0.03%, 10=4.00%, 20=17.09%, 50=44.11%, 100=24.38% lat (msec) : 250=10.03%, 500=0.33%, 2000=0.03% cpu : usr=0.07%, sys=1.91%, ctx=4872, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192123: Sun Sep 6 20:54:47 2026 read: IOPS=10, BW=40.7KiB/s (41.6kB/s)(6052KiB/148829msec) clat (msec): min=4, max=333, avg=38.94, stdev=35.40 lat (msec): min=4, max=333, avg=38.95, stdev=35.40 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 86], 95.00th=[ 111], | 99.00th=[ 163], 99.50th=[ 188], 99.90th=[ 321], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 159, per=26.12%, avg=41.26, stdev=27.41, samples=286 iops : min= 1, max= 39, avg= 9.66, stdev= 6.90, samples=286 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6236KiB/148829msec); 0 zone resets clat (msec): min=9, max=1019, avg=57.59, stdev=46.23 lat (msec): min=9, max=1019, avg=57.59, stdev=46.23 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 81], 90.00th=[ 106], 95.00th=[ 132], | 99.00th=[ 192], 99.50th=[ 232], 99.90th=[ 468], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 143, per=25.49%, avg=42.07, stdev=25.52, samples=289 iops : min= 1, max= 35, avg= 9.86, stdev= 6.42, samples=289 lat (msec) : 10=3.42%, 20=18.16%, 50=43.65%, 100=25.46%, 250=9.05% lat (msec) : 500=0.23%, 2000=0.03% cpu : usr=0.07%, sys=1.88%, ctx=4689, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (162kB/s), 39.4KiB/s-40.7KiB/s (40.4kB/s-41.6kB/s), io=23.4MiB (24.6MB), run=148829-151819msec WRITE: bw=166KiB/s (170kB/s), 41.2KiB/s-42.1KiB/s (42.2kB/s-43.1kB/s), io=24.6MiB (25.7MB), run=148829-151819msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192157: Sun Sep 6 20:55:22 2026 read: IOPS=13, BW=216KiB/s (222kB/s)(5920KiB/27362msec) clat (usec): min=49, max=189826, avg=38148.75, stdev=26553.68 lat (usec): min=49, max=189828, avg=38150.28, stdev=26553.53 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 87], 10.00th=[ 12518], 20.00th=[ 18220], | 30.00th=[ 23725], 40.00th=[ 28181], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 46924], 80.00th=[ 53216], 90.00th=[ 65799], 95.00th=[ 79168], | 99.00th=[154141], 99.50th=[185598], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 62, max= 448, per=24.75%, avg=216.54, stdev=84.34, samples=54 iops : min= 3, max= 28, avg=12.89, stdev= 5.35, samples=54 write: IOPS=14, BW=233KiB/s (238kB/s)(6368KiB/27362msec); 0 zone resets clat (usec): min=1784, max=234018, avg=33056.43, stdev=32941.15 lat (usec): min=1787, max=234020, avg=33058.75, stdev=32941.07 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2835], 10.00th=[ 4293], 20.00th=[ 6325], | 30.00th=[ 10159], 40.00th=[ 15533], 50.00th=[ 22676], 60.00th=[ 30278], | 70.00th=[ 39584], 80.00th=[ 53740], 90.00th=[ 78119], 95.00th=[100140], | 99.00th=[139461], 99.50th=[149947], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 62, max= 448, per=25.34%, avg=233.17, stdev=86.30, samples=54 iops : min= 3, max= 28, avg=13.93, stdev= 5.53, samples=54 lat (usec) : 50=0.13%, 100=2.73%, 250=0.91%, 1000=0.13% lat (msec) : 2=0.65%, 4=3.65%, 10=11.46%, 20=14.71%, 50=42.06% lat (msec) : 100=19.92%, 250=3.65% cpu : usr=0.11%, sys=7.95%, ctx=1870, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192158: Sun Sep 6 20:55:22 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5744KiB/27030msec) clat (usec): min=45, max=202394, avg=39516.12, stdev=26354.76 lat (usec): min=46, max=202398, avg=39518.27, stdev=26354.62 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 100], 10.00th=[ 13829], 20.00th=[ 21627], | 30.00th=[ 25560], 40.00th=[ 30016], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 87557], | 99.00th=[117965], 99.50th=[187696], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 56, max= 416, per=24.27%, avg=212.36, stdev=75.02, samples=53 iops : min= 3, max= 26, avg=12.62, stdev= 4.83, samples=53 write: IOPS=15, BW=242KiB/s (248kB/s)(6544KiB/27030msec); 0 zone resets clat (usec): min=1571, max=187634, avg=31008.27, stdev=30270.53 lat (usec): min=1574, max=187637, avg=31012.62, stdev=30270.75 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2933], 10.00th=[ 3884], 20.00th=[ 6259], | 30.00th=[ 9765], 40.00th=[ 15664], 50.00th=[ 21890], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 49546], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[137364], 99.50th=[147850], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 505, per=26.26%, avg=241.57, stdev=102.89, samples=53 iops : min= 1, max= 31, avg=14.45, stdev= 6.45, samples=53 lat (usec) : 50=0.26%, 100=2.08%, 250=0.65%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.17%, 4=4.30%, 10=10.81%, 20=13.54%, 50=43.75% lat (msec) : 100=19.40%, 250=3.65% cpu : usr=0.10%, sys=8.15%, ctx=1835, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192159: Sun Sep 6 20:55:22 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(6256KiB/26730msec) clat (usec): min=35, max=121332, avg=34476.16, stdev=23999.96 lat (usec): min=35, max=121333, avg=34479.54, stdev=24002.14 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 104], 20.00th=[ 17433], | 30.00th=[ 22676], 40.00th=[ 26346], 50.00th=[ 30540], 60.00th=[ 36439], | 70.00th=[ 42206], 80.00th=[ 51643], 90.00th=[ 65274], 95.00th=[ 81265], | 99.00th=[109577], 99.50th=[120062], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 62, max= 541, per=26.83%, avg=234.77, stdev=108.54, samples=52 iops : min= 3, max= 33, avg=14.02, stdev= 6.92, samples=52 write: IOPS=14, BW=226KiB/s (231kB/s)(6032KiB/26730msec); 0 zone resets clat (usec): min=1336, max=196911, avg=34805.30, stdev=34210.85 lat (usec): min=1338, max=196913, avg=34807.70, stdev=34210.78 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 3130], 10.00th=[ 4146], 20.00th=[ 6915], | 30.00th=[ 11076], 40.00th=[ 17171], 50.00th=[ 24511], 60.00th=[ 33817], | 70.00th=[ 42730], 80.00th=[ 54789], 90.00th=[ 81265], 95.00th=[107480], | 99.00th=[162530], 99.50th=[185598], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 576, per=24.31%, avg=223.63, stdev=98.28, samples=52 iops : min= 1, max= 36, avg=13.33, stdev= 6.28, samples=52 lat (usec) : 50=0.65%, 100=4.30%, 250=1.69%, 500=0.26%, 1000=0.13% lat (msec) : 2=0.78%, 4=3.91%, 10=9.11%, 20=12.24%, 50=43.88% lat (msec) : 100=19.27%, 250=3.78% cpu : usr=0.08%, sys=7.83%, ctx=1869, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192160: Sun Sep 6 20:55:22 2026 read: IOPS=14, BW=226KiB/s (232kB/s)(6032KiB/26645msec) clat (usec): min=48, max=188856, avg=37688.77, stdev=27798.14 lat (usec): min=50, max=188857, avg=37690.24, stdev=27798.09 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 130], 20.00th=[ 18744], | 30.00th=[ 23725], 40.00th=[ 27657], 50.00th=[ 33424], 60.00th=[ 38011], | 70.00th=[ 46924], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[135267], 99.50th=[149947], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 94, max= 447, per=25.78%, avg=225.60, stdev=86.85, samples=52 iops : min= 5, max= 27, avg=13.46, stdev= 5.51, samples=52 write: IOPS=14, BW=235KiB/s (240kB/s)(6256KiB/26645msec); 0 zone resets clat (usec): min=1435, max=175754, avg=31657.43, stdev=30543.37 lat (usec): min=1437, max=175757, avg=31666.41, stdev=30544.58 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2474], 10.00th=[ 3425], 20.00th=[ 5473], | 30.00th=[ 8979], 40.00th=[ 16450], 50.00th=[ 24249], 60.00th=[ 30802], | 70.00th=[ 39584], 80.00th=[ 52691], 90.00th=[ 69731], 95.00th=[ 96994], | 99.00th=[141558], 99.50th=[160433], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 62, max= 544, per=25.62%, avg=235.75, stdev=99.27, samples=52 iops : min= 3, max= 34, avg=14.10, stdev= 6.37, samples=52 lat (usec) : 50=0.13%, 100=4.17%, 250=1.30%, 500=0.13%, 750=0.13% lat (msec) : 2=1.17%, 4=5.34%, 10=10.16%, 20=11.33%, 50=42.97% lat (msec) : 100=18.75%, 250=4.43% cpu : usr=0.10%, sys=7.93%, ctx=1814, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=875KiB/s (896kB/s), 213KiB/s-234KiB/s (218kB/s-240kB/s), io=23.4MiB (24.5MB), run=26645-27362msec WRITE: bw=921KiB/s (943kB/s), 226KiB/s-242KiB/s (231kB/s-248kB/s), io=24.6MiB (25.8MB), run=26645-27362msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192162: Sun Sep 6 20:55:32 2026 read: IOPS=10, BW=165KiB/s (168kB/s)(5920KiB/35981msec) clat (msec): min=7, max=182, avg=37.23, stdev=29.81 lat (msec): min=7, max=182, avg=37.23, stdev=29.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 104], | 99.00th=[ 148], 99.50th=[ 176], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 31, max= 448, per=25.33%, avg=166.69, stdev=94.60, samples=70 iops : min= 1, max= 28, avg= 9.64, stdev= 6.05, samples=70 write: IOPS=11, BW=177KiB/s (181kB/s)(6368KiB/35981msec); 0 zone resets clat (msec): min=13, max=268, avg=54.84, stdev=39.34 lat (msec): min=13, max=268, avg=54.84, stdev=39.34 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 62], 80.00th=[ 77], 90.00th=[ 104], 95.00th=[ 132], | 99.00th=[ 205], 99.50th=[ 253], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 32, max= 506, per=25.87%, avg=179.01, stdev=95.83, samples=70 iops : min= 2, max= 31, avg=10.41, stdev= 6.04, samples=70 lat (msec) : 10=2.08%, 20=17.19%, 50=48.05%, 100=24.74%, 250=7.68% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.62%, ctx=1246, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192163: Sun Sep 6 20:55:32 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5744KiB/36050msec) clat (msec): min=6, max=214, avg=36.83, stdev=34.12 lat (msec): min=6, max=214, avg=36.83, stdev=34.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 108], | 99.00th=[ 194], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 29, max= 448, per=24.43%, avg=160.73, stdev=103.34, samples=70 iops : min= 1, max= 28, avg= 9.26, stdev= 6.56, samples=70 write: IOPS=11, BW=182KiB/s (186kB/s)(6544KiB/36050msec); 0 zone resets clat (msec): min=11, max=250, avg=55.20, stdev=37.69 lat (msec): min=11, max=250, avg=55.20, stdev=37.69 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 77], 90.00th=[ 109], 95.00th=[ 128], | 99.00th=[ 197], 99.50th=[ 201], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 29, max= 447, per=26.07%, avg=180.44, stdev=99.38, samples=71 iops : min= 1, max= 27, avg=10.51, stdev= 6.28, samples=71 lat (msec) : 10=2.08%, 20=17.45%, 50=50.00%, 100=21.48%, 250=8.85% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.65%, ctx=1212, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192164: Sun Sep 6 20:55:32 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36297msec) clat (msec): min=6, max=220, avg=38.63, stdev=33.69 lat (msec): min=6, max=220, avg=38.63, stdev=33.69 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 85], 95.00th=[ 110], | 99.00th=[ 182], 99.50th=[ 213], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 570, per=25.98%, avg=170.94, stdev=122.92, samples=71 iops : min= 1, max= 35, avg= 9.92, stdev= 7.81, samples=71 write: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36297msec); 0 zone resets clat (msec): min=13, max=260, avg=55.90, stdev=37.64 lat (msec): min=13, max=260, avg=55.91, stdev=37.65 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 63], 80.00th=[ 86], 90.00th=[ 109], 95.00th=[ 140], | 99.00th=[ 176], 99.50th=[ 199], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 447, per=23.55%, avg=163.00, stdev=89.24, samples=71 iops : min= 1, max= 27, avg= 9.41, stdev= 5.64, samples=71 lat (msec) : 10=2.60%, 20=17.84%, 50=48.18%, 100=21.35%, 250=9.90% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=2.50%, ctx=1323, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192165: Sun Sep 6 20:55:32 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36369msec) clat (msec): min=6, max=226, avg=38.73, stdev=34.92 lat (msec): min=6, max=226, avg=38.73, stdev=34.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 86], 95.00th=[ 113], | 99.00th=[ 186], 99.50th=[ 213], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 410, per=25.74%, avg=169.39, stdev=99.05, samples=70 iops : min= 1, max= 25, avg= 9.81, stdev= 6.33, samples=70 write: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36369msec); 0 zone resets clat (msec): min=11, max=249, avg=54.82, stdev=39.51 lat (msec): min=11, max=249, avg=54.82, stdev=39.51 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 61], 80.00th=[ 77], 90.00th=[ 106], 95.00th=[ 144], | 99.00th=[ 199], 99.50th=[ 220], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 506, per=24.90%, avg=172.28, stdev=101.26, samples=72 iops : min= 1, max= 31, avg= 9.99, stdev= 6.39, samples=72 lat (msec) : 10=2.34%, 20=18.88%, 50=46.22%, 100=23.70%, 250=8.85% cpu : usr=0.07%, sys=2.49%, ctx=1192, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=659KiB/s (674kB/s), 159KiB/s-172KiB/s (163kB/s-176kB/s), io=23.4MiB (24.5MB), run=35981-36369msec WRITE: bw=693KiB/s (710kB/s), 166KiB/s-182KiB/s (170kB/s-186kB/s), io=24.6MiB (25.8MB), run=35981-36369msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192181: Sun Sep 6 20:55:44 2026 read: IOPS=2, BW=2841KiB/s (2909kB/s)(7168KiB/2523msec) clat (usec): min=612, max=250519, avg=153333.66, stdev=75674.51 lat (usec): min=613, max=250520, avg=153335.47, stdev=75674.52 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[145753], | 30.00th=[156238], 40.00th=[156238], 50.00th=[158335], 60.00th=[175113], | 70.00th=[175113], 80.00th=[185598], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 2043, max= 4517, per=56.92%, avg=2869.33, stdev=1426.92, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=2029KiB/s (2078kB/s)(5120KiB/2523msec); 0 zone resets clat (msec): min=171, max=357, avg=259.65, stdev=67.76 lat (msec): min=171, max=357, avg=259.77, stdev=67.76 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2043, max= 4087, per=38.62%, avg=2726.00, stdev=1178.66, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=31.13%, ctx=277, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192182: Sun Sep 6 20:55:44 2026 read: IOPS=0, BW=504KiB/s (516kB/s)(2048KiB/4062msec) clat (msec): min=123, max=144, avg=133.94, stdev=14.53 lat (msec): min=123, max=144, avg=133.95, stdev=14.53 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 144], 95.00th=[ 144], | 99.00th=[ 144], 99.50th=[ 144], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 1378, max= 2031, per=33.81%, avg=1704.50, stdev=461.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2521KiB/s (2581kB/s)(10.0MiB/4062msec); 0 zone resets clat (msec): min=115, max=872, avg=373.64, stdev=253.11 lat (msec): min=115, max=872, avg=373.88, stdev=253.26 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 215], | 30.00th=[ 234], 40.00th=[ 253], 50.00th=[ 257], 60.00th=[ 259], | 70.00th=[ 271], 80.00th=[ 502], 90.00th=[ 760], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1378, max= 4096, per=36.98%, avg=2610.33, stdev=1169.51, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=22.31%, ctx=146, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192183: Sun Sep 6 20:55:44 2026 read: IOPS=1, BW=1545KiB/s (1582kB/s)(6144KiB/3977msec) clat (usec): min=551, max=241390, avg=152813.49, stdev=88053.30 lat (usec): min=552, max=241391, avg=152814.94, stdev=88053.41 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[117965], | 30.00th=[117965], 40.00th=[143655], 50.00th=[143655], 60.00th=[187696], | 70.00th=[225444], 80.00th=[225444], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 2043, max= 4071, per=67.29%, avg=3392.33, stdev=1168.56, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1545KiB/s (1582kB/s)(6144KiB/3977msec); 0 zone resets clat (msec): min=167, max=991, avg=476.91, stdev=335.26 lat (msec): min=167, max=991, avg=477.01, stdev=335.30 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 531], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 2035, max= 4096, per=36.19%, avg=2554.25, stdev=1027.84, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=19.84%, ctx=185, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192184: Sun Sep 6 20:55:44 2026 read: IOPS=2, BW=2259KiB/s (2314kB/s)(5120KiB/2266msec) clat (usec): min=584, max=303902, avg=65044.67, stdev=133597.41 lat (usec): min=586, max=303903, avg=65046.06, stdev=133597.07 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 586], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 8848], 60.00th=[ 8848], | 70.00th=[ 10552], 80.00th=[ 10552], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2048, max= 6131, per=81.12%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=3, BW=3163KiB/s (3239kB/s)(7168KiB/2266msec); 0 zone resets clat (msec): min=112, max=363, avg=264.14, stdev=86.11 lat (msec): min=113, max=363, avg=264.35, stdev=86.03 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 215], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 262], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 359], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2043, max= 4096, per=39.51%, avg=2788.50, stdev=975.49, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=8.33%, 20=8.33%, 250=16.67%, 500=50.00% cpu : usr=0.00%, sys=33.69%, ctx=184, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5042KiB/s (5163kB/s), 504KiB/s-2841KiB/s (516kB/s-2909kB/s), io=20.0MiB (20.0MB), run=2266-4062msec WRITE: bw=7059KiB/s (7228kB/s), 1545KiB/s-3163KiB/s (1582kB/s-3239kB/s), io=28.0MiB (29.4MB), run=2266-4062msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192185: Sun Sep 6 20:55:44 2026 read: IOPS=1, BW=1645KiB/s (1684kB/s)(7168KiB/4358msec) clat (msec): min=121, max=584, avg=361.26, stdev=213.56 lat (msec): min=121, max=584, avg=361.26, stdev=213.56 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 129], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 443], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 575], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2000, max= 2048, per=45.90%, avg=2027.33, stdev=17.07, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=1, BW=1175KiB/s (1203kB/s)(5120KiB/4358msec); 0 zone resets clat (msec): min=189, max=456, avg=296.52, stdev=103.19 lat (msec): min=189, max=457, avg=296.61, stdev=103.18 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2015, max= 2048, per=32.86%, avg=2032.25, stdev=13.60, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=6.40%, ctx=100, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192186: Sun Sep 6 20:55:44 2026 read: IOPS=0, BW=448KiB/s (458kB/s)(2048KiB/4574msec) clat (msec): min=152, max=614, avg=383.41, stdev=327.00 lat (msec): min=152, max=614, avg=383.42, stdev=327.00 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1486, max= 2048, per=40.00%, avg=1767.00, stdev=397.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2239KiB/s (2292kB/s)(10.0MiB/4574msec); 0 zone resets clat (msec): min=95, max=834, avg=376.01, stdev=263.05 lat (msec): min=95, max=834, avg=376.26, stdev=262.99 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 107], | 30.00th=[ 144], 40.00th=[ 197], 50.00th=[ 321], 60.00th=[ 326], | 70.00th=[ 426], 80.00th=[ 584], 90.00th=[ 726], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2000, max= 4071, per=39.46%, avg=2440.40, stdev=911.74, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=5.75%, ctx=107, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192187: Sun Sep 6 20:55:44 2026 read: IOPS=1, BW=1382KiB/s (1415kB/s)(6144KiB/4445msec) clat (msec): min=80, max=149, avg=111.76, stdev=27.70 lat (msec): min=80, max=149, avg=111.76, stdev=27.70 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 104], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 2035, max= 4096, per=76.69%, avg=3387.33, stdev=1171.61, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1382KiB/s (1415kB/s)(6144KiB/4445msec); 0 zone resets clat (msec): min=170, max=1318, avg=594.55, stdev=489.52 lat (msec): min=170, max=1318, avg=594.64, stdev=489.53 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 388], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2000, max= 2048, per=32.77%, avg=2026.60, stdev=18.98, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 2000=16.67% cpu : usr=0.00%, sys=6.59%, ctx=133, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192188: Sun Sep 6 20:55:44 2026 read: IOPS=1, BW=1104KiB/s (1131kB/s)(5120KiB/4636msec) clat (msec): min=49, max=480, avg=245.21, stdev=185.92 lat (msec): min=49, max=480, avg=245.21, stdev=185.92 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2035, max= 4031, per=61.23%, avg=2704.67, stdev=1148.66, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1546KiB/s (1583kB/s)(7168KiB/4636msec); 0 zone resets clat (msec): min=110, max=1249, avg=439.03, stdev=501.58 lat (msec): min=110, max=1249, avg=439.14, stdev=501.61 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 125], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 1083], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2031, max= 4071, per=43.86%, avg=2712.33, stdev=1176.64, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 250=58.33%, 500=16.67%, 2000=16.67% cpu : usr=0.00%, sys=6.97%, ctx=131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4418KiB/s (4524kB/s), 448KiB/s-1645KiB/s (458kB/s-1684kB/s), io=20.0MiB (20.0MB), run=4358-4636msec WRITE: bw=6185KiB/s (6333kB/s), 1175KiB/s-2239KiB/s (1203kB/s-2292kB/s), io=28.0MiB (29.4MB), run=4358-4636msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192198: Sun Sep 6 20:56:00 2026 read: IOPS=0, BW=3275KiB/s (3354kB/s)(12.0MiB/3752msec) clat (msec): min=788, max=1906, avg=1220.82, stdev=600.55 lat (msec): min=788, max=1906, avg=1220.82, stdev=600.55 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.01%, ctx=561, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192200: Sun Sep 6 20:56:00 2026 read: IOPS=0, BW=823KiB/s (843kB/s)(4096KiB/4974msec) clat (nsec): min=603389k, max=603389k, avg=603389004.00, stdev= 0.00 lat (nsec): min=603392k, max=603392k, avg=603391524.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1647KiB/s (1686kB/s)(8192KiB/4974msec); 0 zone resets clat (msec): min=1022, max=3291, avg=2157.30, stdev=1604.23 lat (msec): min=1023, max=3292, avg=2157.73, stdev=1604.31 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 3306], | 70.00th=[ 3306], 80.00th=[ 3306], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.66%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192202: Sun Sep 6 20:56:00 2026 write: IOPS=0, BW=2509KiB/s (2569kB/s)(12.0MiB/4898msec); 0 zone resets clat (msec): min=400, max=3435, avg=1594.37, stdev=1618.09 lat (msec): min=400, max=3436, avg=1594.85, stdev=1618.13 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 8110, max= 8159, per=100.00%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.29%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192203: Sun Sep 6 20:56:00 2026 write: IOPS=0, BW=2847KiB/s (2915kB/s)(12.0MiB/4316msec); 0 zone resets clat (msec): min=330, max=2424, avg=1404.80, stdev=1048.03 lat (msec): min=337, max=2425, avg=1407.24, stdev=1044.76 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.43%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3294KiB/s (3373kB/s), 823KiB/s-3275KiB/s (843kB/s-3354kB/s), io=16.0MiB (16.8MB), run=3752-4974msec WRITE: bw=6588KiB/s (6746kB/s), 1647KiB/s-2847KiB/s (1686kB/s-2915kB/s), io=32.0MiB (33.6MB), run=4316-4974msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192196: Sun Sep 6 20:56:00 2026 read: IOPS=0, BW=2739KiB/s (2804kB/s)(12.0MiB/4487msec) clat (msec): min=613, max=1956, avg=1464.36, stdev=740.10 lat (msec): min=613, max=1956, avg=1464.36, stdev=740.10 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 1821], 50.00th=[ 1821], 60.00th=[ 1821], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8047, max= 8159, per=100.00%, avg=8103.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.56%, ctx=49, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192197: Sun Sep 6 20:56:00 2026 read: IOPS=0, BW=824KiB/s (844kB/s)(4096KiB/4971msec) clat (nsec): min=2385.2M, max=2385.2M, avg=2385167123.00, stdev= 0.00 lat (nsec): min=2385.2M, max=2385.2M, avg=2385169907.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2400], 5.00th=[ 2400], 10.00th=[ 2400], 20.00th=[ 2400], | 30.00th=[ 2400], 40.00th=[ 2400], 50.00th=[ 2400], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1648KiB/s (1688kB/s)(8192KiB/4971msec); 0 zone resets clat (msec): min=879, max=1606, avg=1243.10, stdev=514.62 lat (msec): min=883, max=1607, avg=1245.62, stdev=511.92 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.05%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192199: Sun Sep 6 20:56:00 2026 write: IOPS=0, BW=2718KiB/s (2783kB/s)(12.0MiB/4521msec); 0 zone resets clat (msec): min=342, max=3035, avg=1457.07, stdev=1405.17 lat (msec): min=342, max=3035, avg=1457.38, stdev=1405.17 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.63%, ctx=63, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192201: Sun Sep 6 20:56:00 2026 write: IOPS=0, BW=2840KiB/s (2908kB/s)(12.0MiB/4327msec); 0 zone resets clat (msec): min=402, max=2226, avg=1423.70, stdev=931.28 lat (msec): min=403, max=2227, avg=1425.88, stdev=932.01 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8047, max= 8143, per=100.00%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=2.82%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3296KiB/s (3375kB/s), 824KiB/s-2739KiB/s (844kB/s-2804kB/s), io=16.0MiB (16.8MB), run=4487-4971msec WRITE: bw=6592KiB/s (6750kB/s), 1648KiB/s-2840KiB/s (1688kB/s-2908kB/s), io=32.0MiB (33.6MB), run=4327-4971msec