== sanity test 398b: DIO and buffer IO race ============== 16:15:32 (1775852132) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.80564 s, 10.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189475: Fri Apr 10 16:17:54 2026 read: IOPS=12, BW=48.7KiB/s (49.9kB/s)(5992KiB/123009msec) clat (usec): min=35, max=229437, avg=45467.85, stdev=29720.14 lat (usec): min=36, max=229438, avg=45469.30, stdev=29719.94 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10552], 10.00th=[ 17433], 20.00th=[ 23725], | 30.00th=[ 28705], 40.00th=[ 33424], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[187696], 99.90th=[225444], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 95, per=25.21%, avg=48.41, stdev=17.31, samples=242 iops : min= 1, max= 23, avg=11.45, stdev= 4.36, samples=242 write: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6296KiB/123009msec); 0 zone resets clat (usec): min=1036, max=1054.7k, avg=34647.09, stdev=45047.72 lat (usec): min=1037, max=1054.7k, avg=34649.91, stdev=45047.43 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1729], | 20.00th=[ 3785], 30.00th=[ 7308], 40.00th=[ 14484], | 50.00th=[ 23987], 60.00th=[ 32113], 70.00th=[ 42730], | 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[ 107480], | 99.00th=[ 166724], 99.50th=[ 210764], 99.90th=[ 299893], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 134, per=25.40%, avg=51.05, stdev=22.48, samples=241 iops : min= 1, max= 33, avg=12.11, stdev= 5.66, samples=241 lat (usec) : 50=0.33%, 100=1.66%, 250=0.07%, 500=0.10% lat (msec) : 2=6.12%, 4=4.69%, 10=7.26%, 20=10.12%, 50=39.39% lat (msec) : 100=25.10%, 250=5.05%, 500=0.10%, 2000=0.03% cpu : usr=0.06%, sys=5.45%, ctx=6511, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189477: Fri Apr 10 16:17:54 2026 read: IOPS=12, BW=48.4KiB/s (49.5kB/s)(5940KiB/122792msec) clat (usec): min=41, max=1116.4k, avg=46188.08, stdev=41477.53 lat (usec): min=42, max=1116.4k, avg=46197.08, stdev=41496.78 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 12125], 10.00th=[ 17433], | 20.00th=[ 22676], 30.00th=[ 27919], 40.00th=[ 33162], | 50.00th=[ 39584], 60.00th=[ 46400], 70.00th=[ 54789], | 80.00th=[ 63701], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[ 152044], 99.50th=[ 177210], 99.90th=[ 421528], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 95, per=25.10%, avg=48.20, stdev=17.52, samples=240 iops : min= 1, max= 23, avg=11.39, stdev= 4.41, samples=240 write: IOPS=12, BW=51.7KiB/s (52.9kB/s)(6348KiB/122792msec); 0 zone resets clat (usec): min=1095, max=247282, avg=33911.81, stdev=34751.08 lat (usec): min=1096, max=247283, avg=33921.07, stdev=34751.49 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1319], 10.00th=[ 1663], 20.00th=[ 3818], | 30.00th=[ 7308], 40.00th=[ 15139], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[141558], 99.50th=[185598], 99.90th=[223347], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 126, per=25.70%, avg=51.66, stdev=22.51, samples=239 iops : min= 1, max= 31, avg=12.27, stdev= 5.66, samples=239 lat (usec) : 50=0.29%, 100=1.60%, 250=0.03%, 500=0.03%, 750=0.03% lat (msec) : 2=5.96%, 4=4.82%, 10=7.10%, 20=10.19%, 50=39.91% lat (msec) : 100=25.20%, 250=4.75%, 500=0.07%, 2000=0.03% cpu : usr=0.07%, sys=5.32%, ctx=6447, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189479: Fri Apr 10 16:17:54 2026 read: IOPS=12, BW=48.3KiB/s (49.5kB/s)(6028KiB/124811msec) clat (usec): min=30, max=203339, avg=45117.61, stdev=27892.74 lat (usec): min=30, max=203340, avg=45125.14, stdev=27898.59 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10421], 10.00th=[ 16909], 20.00th=[ 23987], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 64226], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[168821], 99.90th=[196084], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 103, per=25.20%, avg=48.39, stdev=18.41, samples=242 iops : min= 1, max= 25, avg=11.44, stdev= 4.65, samples=242 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6260KiB/124811msec); 0 zone resets clat (usec): min=1055, max=1168.2k, avg=36062.43, stdev=47318.52 lat (usec): min=1057, max=1168.2k, avg=36067.79, stdev=47320.91 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1336], 10.00th=[ 1778], | 20.00th=[ 4047], 30.00th=[ 7439], 40.00th=[ 16057], | 50.00th=[ 25560], 60.00th=[ 33424], 70.00th=[ 43779], | 80.00th=[ 61604], 90.00th=[ 85459], 95.00th=[ 107480], | 99.00th=[ 156238], 99.50th=[ 204473], 99.90th=[ 371196], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 119, per=24.79%, avg=49.84, stdev=21.78, samples=244 iops : min= 1, max= 29, avg=11.80, stdev= 5.50, samples=244 lat (usec) : 50=0.23%, 100=1.73%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.92%, 4=4.23%, 10=7.26%, 20=9.21%, 50=40.07% lat (msec) : 100=25.98%, 250=5.01%, 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=5.36%, ctx=6490, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189482: Fri Apr 10 16:17:54 2026 read: IOPS=12, BW=49.8KiB/s (50.0kB/s)(6052KiB/121561msec) clat (usec): min=34, max=522544, avg=44433.99, stdev=31716.06 lat (usec): min=34, max=522544, avg=44435.15, stdev=31716.10 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 6259], 10.00th=[ 17433], 20.00th=[ 23200], | 30.00th=[ 27919], 40.00th=[ 33424], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[149947], 99.50th=[162530], 99.90th=[396362], 99.95th=[522191], | 99.99th=[522191] bw ( KiB/s): min= 7, max= 119, per=26.00%, avg=49.93, stdev=18.66, samples=237 iops : min= 1, max= 29, avg=11.82, stdev= 4.70, samples=237 write: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6236KiB/121561msec); 0 zone resets clat (usec): min=1055, max=1107.3k, avg=34563.71, stdev=43560.68 lat (usec): min=1057, max=1107.3k, avg=34565.41, stdev=43560.77 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1795], | 20.00th=[ 4228], 30.00th=[ 7898], 40.00th=[ 15533], | 50.00th=[ 25035], 60.00th=[ 33817], 70.00th=[ 43779], | 80.00th=[ 59507], 90.00th=[ 82314], 95.00th=[ 102237], | 99.00th=[ 145753], 99.50th=[ 166724], 99.90th=[ 270533], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 119, per=25.46%, avg=51.17, stdev=21.61, samples=238 iops : min= 1, max= 29, avg=12.14, stdev= 5.44, samples=238 lat (usec) : 50=0.49%, 100=1.73%, 250=0.13%, 500=0.03% lat (msec) : 2=5.73%, 4=3.97%, 10=7.65%, 20=9.77%, 50=40.95% lat (msec) : 100=24.84%, 250=4.59%, 500=0.07%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.42%, ctx=6449, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=192KiB/s (197kB/s), 48.3KiB/s-49.8KiB/s (49.5kB/s-50.0kB/s), io=23.4MiB (24.6MB), run=121561-124811msec WRITE: bw=201KiB/s (206kB/s), 50.2KiB/s-51.7KiB/s (51.4kB/s-52.9kB/s), io=24.6MiB (25.7MB), run=121561-124811msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189476: Fri Apr 10 16:18:34 2026 read: IOPS=9, BW=36.5KiB/s (37.3kB/s)(5992KiB/164322msec) clat (msec): min=5, max=1224, avg=44.24, stdev=49.66 lat (msec): min=5, max=1224, avg=44.24, stdev=49.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 100], 95.00th=[ 129], | 99.00th=[ 190], 99.50th=[ 215], 99.90th=[ 305], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 143, per=25.57%, avg=37.07, stdev=25.44, samples=313 iops : min= 1, max= 35, avg= 8.61, stdev= 6.39, samples=313 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6296KiB/164322msec); 0 zone resets clat (msec): min=10, max=517, avg=62.08, stdev=45.39 lat (msec): min=10, max=517, avg=62.08, stdev=45.39 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 89], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 224], 99.50th=[ 247], 99.90th=[ 368], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 119, per=25.29%, avg=38.44, stdev=24.06, samples=318 iops : min= 1, max= 29, avg= 8.95, stdev= 6.07, samples=318 lat (msec) : 10=1.79%, 20=14.91%, 50=45.93%, 100=24.58%, 250=12.40% lat (msec) : 500=0.33%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=2.16%, ctx=5128, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189478: Fri Apr 10 16:18:34 2026 read: IOPS=9, BW=36.1KiB/s (36.9kB/s)(5940KiB/164714msec) clat (msec): min=5, max=1131, avg=43.24, stdev=48.58 lat (msec): min=5, max=1131, avg=43.24, stdev=48.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 127], | 99.00th=[ 197], 99.50th=[ 226], 99.90th=[ 309], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 143, per=25.08%, avg=36.37, stdev=25.98, samples=317 iops : min= 1, max= 35, avg= 8.44, stdev= 6.55, samples=317 write: IOPS=9, BW=38.5KiB/s (39.5kB/s)(6348KiB/164714msec); 0 zone resets clat (msec): min=10, max=444, avg=63.11, stdev=45.76 lat (msec): min=10, max=444, avg=63.11, stdev=45.76 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 93], 90.00th=[ 121], 95.00th=[ 146], | 99.00th=[ 226], 99.50th=[ 288], 99.90th=[ 418], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 111, per=25.38%, avg=38.57, stdev=23.89, samples=319 iops : min= 1, max= 27, avg= 8.98, stdev= 6.02, samples=319 lat (msec) : 10=2.05%, 20=14.71%, 50=45.93%, 100=24.06%, 250=12.70% lat (msec) : 500=0.52%, 2000=0.03% cpu : usr=0.06%, sys=2.08%, ctx=5045, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189480: Fri Apr 10 16:18:34 2026 read: IOPS=9, BW=36.7KiB/s (37.5kB/s)(6028KiB/164428msec) clat (msec): min=5, max=382, avg=42.78, stdev=38.41 lat (msec): min=5, max=382, avg=42.78, stdev=38.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 92], 95.00th=[ 124], | 99.00th=[ 182], 99.50th=[ 211], 99.90th=[ 313], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 126, per=25.37%, avg=36.78, stdev=24.90, samples=319 iops : min= 1, max= 31, avg= 8.54, stdev= 6.29, samples=319 write: IOPS=9, BW=38.1KiB/s (38.0kB/s)(6260KiB/164428msec); 0 zone resets clat (msec): min=9, max=1161, avg=63.67, stdev=55.55 lat (msec): min=9, max=1161, avg=63.68, stdev=55.55 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 121], 95.00th=[ 157], | 99.00th=[ 239], 99.50th=[ 292], 99.90th=[ 523], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 119, per=24.89%, avg=37.83, stdev=24.64, samples=322 iops : min= 1, max= 29, avg= 8.80, stdev= 6.20, samples=322 lat (msec) : 10=1.73%, 20=14.45%, 50=47.23%, 100=24.06%, 250=11.98% lat (msec) : 500=0.49%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=2.20%, ctx=5121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189481: Fri Apr 10 16:18:34 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6052KiB/162775msec) clat (msec): min=5, max=387, avg=41.74, stdev=40.06 lat (msec): min=5, max=387, avg=41.74, stdev=40.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 93], 95.00th=[ 125], | 99.00th=[ 194], 99.50th=[ 245], 99.90th=[ 317], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 126, per=26.08%, avg=37.82, stdev=25.62, samples=311 iops : min= 1, max= 31, avg= 8.80, stdev= 6.43, samples=311 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6236KiB/162775msec); 0 zone resets clat (msec): min=11, max=1113, avg=63.67, stdev=52.98 lat (msec): min=11, max=1113, avg=63.67, stdev=52.98 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 122], 95.00th=[ 150], | 99.00th=[ 222], 99.50th=[ 275], 99.90th=[ 468], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 119, per=25.21%, avg=38.32, stdev=24.07, samples=316 iops : min= 1, max= 29, avg= 8.92, stdev= 6.07, samples=316 lat (msec) : 10=2.47%, 20=15.95%, 50=44.79%, 100=24.74%, 250=11.49% lat (msec) : 500=0.52%, 2000=0.03% cpu : usr=0.05%, sys=2.18%, ctx=5136, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=146KiB/s (149kB/s), 36.1KiB/s-37.2KiB/s (36.9kB/s-38.1kB/s), io=23.4MiB (24.6MB), run=162775-164714msec WRITE: bw=153KiB/s (156kB/s), 38.1KiB/s-38.5KiB/s (38.0kB/s-39.5kB/s), io=24.6MiB (25.7MB), run=162775-164714msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189530: Fri Apr 10 16:19:16 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(5920KiB/30611msec) clat (usec): min=33, max=205518, avg=43262.50, stdev=29502.86 lat (usec): min=33, max=205520, avg=43263.65, stdev=29502.90 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 13960], 20.00th=[ 23462], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 60031], 90.00th=[ 72877], 95.00th=[ 92799], | 99.00th=[154141], 99.50th=[189793], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 377, per=25.55%, avg=192.17, stdev=75.70, samples=60 iops : min= 1, max= 23, avg=11.20, stdev= 4.80, samples=60 write: IOPS=13, BW=208KiB/s (213kB/s)(6368KiB/30611msec); 0 zone resets clat (usec): min=1609, max=186537, avg=36388.84, stdev=34807.17 lat (usec): min=1610, max=186538, avg=36390.89, stdev=34807.41 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1909], 10.00th=[ 2835], 20.00th=[ 6456], | 30.00th=[ 11600], 40.00th=[ 17695], 50.00th=[ 28967], 60.00th=[ 36439], | 70.00th=[ 46400], 80.00th=[ 58459], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[168821], 99.50th=[181404], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 94, max= 476, per=26.23%, avg=207.48, stdev=79.32, samples=60 iops : min= 5, max= 29, avg=12.17, stdev= 4.99, samples=60 lat (usec) : 50=0.65%, 100=2.99%, 250=0.26%, 500=0.13% lat (msec) : 2=3.26%, 4=3.78%, 10=7.29%, 20=10.81%, 50=41.54% lat (msec) : 100=23.83%, 250=5.47% cpu : usr=0.07%, sys=6.33%, ctx=1799, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189531: Fri Apr 10 16:19:16 2026 read: IOPS=11, BW=191KiB/s (196kB/s)(5744KiB/30079msec) clat (usec): min=44, max=172053, avg=43975.49, stdev=26716.68 lat (usec): min=45, max=172054, avg=43976.71, stdev=26716.70 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 73], 10.00th=[ 14091], 20.00th=[ 23200], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 90702], | 99.00th=[130548], 99.50th=[154141], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 318, per=25.59%, avg=192.46, stdev=69.25, samples=59 iops : min= 1, max= 19, avg=11.24, stdev= 4.28, samples=59 write: IOPS=13, BW=218KiB/s (223kB/s)(6544KiB/30079msec); 0 zone resets clat (usec): min=1414, max=193437, avg=34297.38, stdev=33711.18 lat (usec): min=1415, max=193438, avg=34300.97, stdev=33711.12 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2008], 10.00th=[ 2802], 20.00th=[ 5473], | 30.00th=[ 8717], 40.00th=[ 15926], 50.00th=[ 24249], 60.00th=[ 33162], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[104334], | 99.00th=[139461], 99.50th=[143655], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 570, per=27.52%, avg=217.64, stdev=104.89, samples=59 iops : min= 1, max= 35, avg=12.83, stdev= 6.63, samples=59 lat (usec) : 50=0.26%, 100=2.47%, 250=0.26%, 500=0.13% lat (msec) : 2=2.73%, 4=5.73%, 10=8.72%, 20=11.20%, 50=38.02% lat (msec) : 100=26.30%, 250=4.17% cpu : usr=0.07%, sys=6.19%, ctx=1765, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189532: Fri Apr 10 16:19:16 2026 read: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31850msec) clat (usec): min=31, max=211826, avg=44093.44, stdev=29902.72 lat (usec): min=32, max=211828, avg=44094.52, stdev=29902.75 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 12518], 20.00th=[ 22414], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[ 90702], | 99.00th=[152044], 99.50th=[191890], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 383, per=26.27%, avg=197.58, stdev=78.07, samples=62 iops : min= 1, max= 23, avg=11.56, stdev= 4.88, samples=62 write: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31850msec); 0 zone resets clat (usec): min=1733, max=166216, avg=37919.73, stdev=33885.52 lat (usec): min=1735, max=166218, avg=37933.87, stdev=33889.72 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2024], 10.00th=[ 3654], 20.00th=[ 7373], | 30.00th=[ 12780], 40.00th=[ 22938], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 62653], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[145753], 99.50th=[162530], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 63, max= 350, per=23.66%, avg=187.18, stdev=66.72, samples=62 iops : min= 3, max= 21, avg=10.92, stdev= 4.16, samples=62 lat (usec) : 50=0.13%, 100=4.04%, 250=0.65%, 750=0.13% lat (msec) : 2=2.34%, 4=3.39%, 10=7.16%, 20=8.59%, 50=42.06% lat (msec) : 100=26.17%, 250=5.34% cpu : usr=0.07%, sys=5.76%, ctx=1839, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189533: Fri Apr 10 16:19:16 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(6032KiB/29378msec) clat (usec): min=27, max=168745, avg=43786.03, stdev=31633.51 lat (usec): min=28, max=168745, avg=43787.06, stdev=31633.51 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 78], 20.00th=[ 21627], | 30.00th=[ 27919], 40.00th=[ 32637], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 65799], 90.00th=[ 83362], 95.00th=[109577], | 99.00th=[147850], 99.50th=[160433], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 63, max= 476, per=26.66%, avg=200.47, stdev=77.96, samples=57 iops : min= 3, max= 29, avg=11.75, stdev= 4.92, samples=57 write: IOPS=13, BW=213KiB/s (218kB/s)(6256KiB/29378msec); 0 zone resets clat (usec): min=1687, max=186403, avg=32203.61, stdev=31719.06 lat (usec): min=1690, max=186404, avg=32205.66, stdev=31719.08 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 1991], 10.00th=[ 3195], 20.00th=[ 5735], | 30.00th=[ 9503], 40.00th=[ 15401], 50.00th=[ 23462], 60.00th=[ 31065], | 70.00th=[ 39060], 80.00th=[ 51119], 90.00th=[ 78119], 95.00th=[100140], | 99.00th=[141558], 99.50th=[145753], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 63, max= 444, per=26.61%, avg=210.49, stdev=92.22, samples=57 iops : min= 3, max= 27, avg=12.39, stdev= 5.77, samples=57 lat (usec) : 50=0.39%, 100=5.21%, 250=0.26% lat (msec) : 2=2.73%, 4=4.69%, 10=8.72%, 20=10.29%, 50=40.23% lat (msec) : 100=22.40%, 250=5.08% cpu : usr=0.06%, sys=6.27%, ctx=1761, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=752KiB/s (770kB/s), 191KiB/s-205KiB/s (196kB/s-210kB/s), io=23.4MiB (24.5MB), run=29378-31850msec WRITE: bw=791KiB/s (810kB/s), 189KiB/s-218KiB/s (194kB/s-223kB/s), io=24.6MiB (25.8MB), run=29378-31850msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189526: Fri Apr 10 16:19:26 2026 read: IOPS=8, BW=141KiB/s (145kB/s)(5920KiB/41931msec) clat (msec): min=6, max=206, avg=42.63, stdev=34.86 lat (msec): min=6, max=206, avg=42.63, stdev=34.86 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 182], 99.50th=[ 203], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 403, per=24.51%, avg=139.44, stdev=88.43, samples=82 iops : min= 1, max= 25, avg= 7.91, stdev= 5.57, samples=82 write: IOPS=9, BW=152KiB/s (156kB/s)(6368KiB/41931msec); 0 zone resets clat (msec): min=14, max=239, avg=65.06, stdev=40.11 lat (msec): min=14, max=239, avg=65.07, stdev=40.10 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 99], 90.00th=[ 125], 95.00th=[ 150], | 99.00th=[ 192], 99.50th=[ 194], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 415, per=25.21%, avg=151.00, stdev=79.58, samples=82 iops : min= 1, max= 25, avg= 8.65, stdev= 4.98, samples=82 lat (msec) : 10=1.43%, 20=11.33%, 50=47.14%, 100=26.69%, 250=13.41% cpu : usr=0.06%, sys=2.20%, ctx=1235, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189527: Fri Apr 10 16:19:26 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(5744KiB/42023msec) clat (msec): min=7, max=257, avg=43.13, stdev=36.67 lat (msec): min=7, max=257, avg=43.13, stdev=36.67 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 94], 95.00th=[ 118], | 99.00th=[ 192], 99.50th=[ 215], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 415, per=26.25%, avg=149.35, stdev=91.34, samples=74 iops : min= 1, max= 25, avg= 8.54, stdev= 5.72, samples=74 write: IOPS=9, BW=156KiB/s (159kB/s)(6544KiB/42023msec); 0 zone resets clat (msec): min=12, max=332, avg=64.33, stdev=44.00 lat (msec): min=12, max=332, avg=64.34, stdev=44.00 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 95], 90.00th=[ 127], 95.00th=[ 148], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 383, per=25.80%, avg=154.54, stdev=86.78, samples=81 iops : min= 1, max= 23, avg= 8.86, stdev= 5.44, samples=81 lat (msec) : 10=0.65%, 20=13.80%, 50=47.53%, 100=25.13%, 250=12.50% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=2.22%, ctx=1255, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189528: Fri Apr 10 16:19:26 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(6256KiB/41798msec) clat (msec): min=7, max=265, avg=44.06, stdev=40.24 lat (msec): min=7, max=265, avg=44.06, stdev=40.24 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 104], 95.00th=[ 130], | 99.00th=[ 203], 99.50th=[ 228], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 479, per=26.69%, avg=151.84, stdev=97.27, samples=81 iops : min= 1, max= 29, avg= 8.69, stdev= 6.09, samples=81 write: IOPS=9, BW=144KiB/s (148kB/s)(6032KiB/41798msec); 0 zone resets clat (msec): min=15, max=304, avg=64.98, stdev=44.38 lat (msec): min=15, max=304, avg=64.99, stdev=44.38 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 75], 80.00th=[ 95], 90.00th=[ 126], 95.00th=[ 159], | 99.00th=[ 220], 99.50th=[ 249], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 415, per=23.85%, avg=142.85, stdev=85.02, samples=82 iops : min= 1, max= 25, avg= 8.13, stdev= 5.32, samples=82 lat (msec) : 10=0.78%, 20=14.84%, 50=47.66%, 100=23.18%, 250=13.28% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=2.27%, ctx=1274, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189529: Fri Apr 10 16:19:26 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(6032KiB/41752msec) clat (msec): min=7, max=190, avg=43.88, stdev=34.80 lat (msec): min=7, max=190, avg=43.88, stdev=34.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 94], 95.00th=[ 120], | 99.00th=[ 153], 99.50th=[ 186], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 415, per=25.50%, avg=145.10, stdev=87.74, samples=81 iops : min= 1, max= 25, avg= 8.27, stdev= 5.48, samples=81 write: IOPS=9, BW=150KiB/s (153kB/s)(6256KiB/41752msec); 0 zone resets clat (msec): min=14, max=306, avg=63.75, stdev=40.85 lat (msec): min=14, max=306, avg=63.75, stdev=40.85 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 74], 80.00th=[ 90], 90.00th=[ 120], 95.00th=[ 142], | 99.00th=[ 230], 99.50th=[ 251], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 383, per=24.98%, avg=149.65, stdev=83.03, samples=82 iops : min= 1, max= 23, avg= 8.56, stdev= 5.22, samples=82 lat (msec) : 10=1.04%, 20=12.50%, 50=47.27%, 100=26.69%, 250=12.24% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.38%, ctx=1272, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=570KiB/s (584kB/s), 137KiB/s-150KiB/s (140kB/s-153kB/s), io=23.4MiB (24.5MB), run=41752-42023msec WRITE: bw=600KiB/s (614kB/s), 144KiB/s-156KiB/s (148kB/s-159kB/s), io=24.6MiB (25.8MB), run=41752-42023msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189549: Fri Apr 10 16:19:39 2026 read: IOPS=2, BW=2172KiB/s (2224kB/s)(7168KiB/3300msec) clat (msec): min=14, max=305, avg=138.76, stdev=95.04 lat (msec): min=14, max=305, avg=138.83, stdev=94.97 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 15], 10.00th=[ 15], 20.00th=[ 49], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 142], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 188], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1992, max= 6144, per=72.03%, avg=3387.67, stdev=2387.12, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1552KiB/s (1589kB/s)(5120KiB/3300msec); 0 zone resets clat (msec): min=208, max=692, avg=457.63, stdev=223.98 lat (msec): min=208, max=692, avg=457.69, stdev=223.98 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1943, max= 4096, per=40.65%, avg=2677.00, stdev=1229.13, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 20=8.33%, 50=8.33%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=14.79%, ctx=199, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189551: Fri Apr 10 16:19:39 2026 read: IOPS=0, BW=470KiB/s (482kB/s)(2048KiB/4354msec) clat (msec): min=194, max=276, avg=235.16, stdev=58.18 lat (msec): min=194, max=276, avg=235.20, stdev=58.12 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1378, max= 2048, per=36.42%, avg=1713.00, stdev=473.76, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2352KiB/s (2408kB/s)(10.0MiB/4354msec); 0 zone resets clat (msec): min=116, max=924, avg=362.82, stdev=277.17 lat (msec): min=116, max=924, avg=363.39, stdev=277.07 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 184], | 30.00th=[ 201], 40.00th=[ 222], 50.00th=[ 243], 60.00th=[ 264], | 70.00th=[ 309], 80.00th=[ 347], 90.00th=[ 818], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1976, max= 6107, per=39.48%, avg=2600.00, stdev=1546.63, samples=7 iops : min= 1, max= 5, avg= 1.71, stdev= 1.50, samples=7 lat (msec) : 250=50.00%, 500=33.33%, 1000=16.67% cpu : usr=0.02%, sys=17.11%, ctx=201, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189552: Fri Apr 10 16:19:39 2026 read: IOPS=1, BW=1863KiB/s (1908kB/s)(6144KiB/3298msec) clat (usec): min=765, max=274836, avg=157904.08, stdev=122222.69 lat (usec): min=767, max=274837, avg=157905.08, stdev=122222.67 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[ 8455], | 30.00th=[ 8455], 40.00th=[193987], 50.00th=[193987], 60.00th=[212861], | 70.00th=[256902], 80.00th=[256902], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 3886, max= 4055, per=84.42%, avg=3970.50, stdev=119.50, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1863KiB/s (1908kB/s)(6144KiB/3298msec); 0 zone resets clat (msec): min=160, max=513, avg=346.50, stdev=167.52 lat (msec): min=160, max=513, avg=346.66, stdev=167.44 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 477], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1943, max= 4023, per=37.99%, avg=2501.50, stdev=1015.24, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 10=8.33%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=17.56%, ctx=151, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189553: Fri Apr 10 16:19:39 2026 read: IOPS=1, BW=1672KiB/s (1712kB/s)(5120KiB/3063msec) clat (usec): min=492, max=184227, avg=60777.85, stdev=85125.83 lat (usec): min=493, max=184227, avg=60778.78, stdev=85125.60 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 494], | 30.00th=[ 783], 40.00th=[ 783], 50.00th=[ 2147], 60.00th=[ 2147], | 70.00th=[115868], 80.00th=[115868], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2340KiB/s (2396kB/s)(7168KiB/3063msec); 0 zone resets clat (msec): min=164, max=533, avg=358.45, stdev=127.26 lat (msec): min=164, max=533, avg=358.59, stdev=127.30 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 262], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 401], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 447], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 2000, max= 4047, per=45.58%, avg=3001.75, stdev=1153.32, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=18.45%, ctx=207, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4704KiB/s (4817kB/s), 470KiB/s-2172KiB/s (482kB/s-2224kB/s), io=20.0MiB (20.0MB), run=3063-4354msec WRITE: bw=6585KiB/s (6743kB/s), 1552KiB/s-2352KiB/s (1589kB/s-2408kB/s), io=28.0MiB (29.4MB), run=3063-4354msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189546: Fri Apr 10 16:19:40 2026 read: IOPS=2, BW=2341KiB/s (2397kB/s)(7168KiB/3062msec) clat (msec): min=88, max=503, avg=212.78, stdev=149.89 lat (msec): min=88, max=503, avg=212.78, stdev=149.89 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 92], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 155], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 321], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2003, max= 5941, per=94.74%, avg=4013.33, stdev=1970.30, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=1672KiB/s (1712kB/s)(5120KiB/3062msec); 0 zone resets clat (msec): min=146, max=610, avg=307.42, stdev=182.21 lat (msec): min=146, max=610, avg=307.50, stdev=182.20 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1939, max= 6011, per=56.19%, avg=3332.67, stdev=2320.14, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=5.78%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189547: Fri Apr 10 16:19:40 2026 read: IOPS=0, BW=481KiB/s (493kB/s)(2048KiB/4257msec) clat (msec): min=84, max=462, avg=273.35, stdev=267.51 lat (msec): min=84, max=462, avg=273.35, stdev=267.51 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 85], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1361, max= 2035, per=40.08%, avg=1698.00, stdev=476.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2405KiB/s (2463kB/s)(10.0MiB/4257msec); 0 zone resets clat (msec): min=139, max=670, avg=359.28, stdev=171.30 lat (msec): min=139, max=670, avg=359.80, stdev=171.52 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 180], | 30.00th=[ 207], 40.00th=[ 236], 50.00th=[ 351], 60.00th=[ 405], | 70.00th=[ 426], 80.00th=[ 439], 90.00th=[ 550], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1361, max= 4087, per=37.84%, avg=2244.00, stdev=940.08, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=5.85%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189548: Fri Apr 10 16:19:40 2026 read: IOPS=1, BW=1604KiB/s (1642kB/s)(6144KiB/3831msec) clat (msec): min=67, max=443, avg=219.45, stdev=148.82 lat (msec): min=67, max=443, avg=219.45, stdev=148.82 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 262], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2031, max= 3820, per=58.63%, avg=2483.50, stdev=891.03, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1604KiB/s (1642kB/s)(6144KiB/3831msec); 0 zone resets clat (msec): min=159, max=944, avg=405.93, stdev=288.07 lat (msec): min=160, max=944, avg=406.01, stdev=288.08 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 384], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1910, max= 2809, per=36.57%, avg=2169.00, stdev=362.34, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 1000=8.33% cpu : usr=0.00%, sys=6.92%, ctx=112, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189550: Fri Apr 10 16:19:40 2026 read: IOPS=1, BW=1059KiB/s (1085kB/s)(5120KiB/4834msec) clat (msec): min=53, max=509, avg=256.77, stdev=203.69 lat (msec): min=53, max=509, avg=256.77, stdev=203.69 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2000, max= 4007, per=63.28%, avg=2680.67, stdev=1148.77, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1483KiB/s (1518kB/s)(7168KiB/4834msec); 0 zone resets clat (msec): min=117, max=1239, avg=481.86, stdev=446.01 lat (msec): min=117, max=1239, avg=481.97, stdev=445.99 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 157], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 321], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 986], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1939, max= 2023, per=33.46%, avg=1984.60, stdev=36.16, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=6.75%, ctx=117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4237KiB/s (4338kB/s), 481KiB/s-2341KiB/s (493kB/s-2397kB/s), io=20.0MiB (20.0MB), run=3062-4834msec WRITE: bw=5931KiB/s (6074kB/s), 1483KiB/s-2405KiB/s (1518kB/s-2463kB/s), io=28.0MiB (29.4MB), run=3062-4834msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189564: Fri Apr 10 16:19:52 2026 read: IOPS=1, BW=5608KiB/s (5743kB/s)(12.0MiB/2191msec) clat (msec): min=691, max=759, avg=729.75, stdev=34.92 lat (msec): min=691, max=759, avg=729.75, stdev=34.92 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.85%, ctx=385, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189565: Fri Apr 10 16:19:52 2026 read: IOPS=0, BW=1652KiB/s (1691kB/s)(4096KiB/2480msec) clat (nsec): min=657320k, max=657320k, avg=657320075.00, stdev= 0.00 lat (nsec): min=657321k, max=657321k, avg=657321483.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3303KiB/s (3383kB/s)(8192KiB/2480msec); 0 zone resets clat (msec): min=505, max=1315, avg=910.40, stdev=573.11 lat (msec): min=505, max=1316, avg=910.77, stdev=573.12 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8192, max= 8192, per=73.88%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.86%, ctx=75, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189566: Fri Apr 10 16:19:52 2026 write: IOPS=1, BW=4158KiB/s (4258kB/s)(12.0MiB/2955msec); 0 zone resets clat (msec): min=219, max=1500, avg=983.93, stdev=675.26 lat (msec): min=220, max=1501, avg=984.40, stdev=675.35 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8192, max= 8192, per=73.88%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.45%, ctx=34, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189567: Fri Apr 10 16:19:52 2026 write: IOPS=1, BW=6457KiB/s (6612kB/s)(12.0MiB/1903msec); 0 zone resets clat (msec): min=451, max=804, avg=633.55, stdev=176.59 lat (msec): min=452, max=805, avg=633.93, stdev=176.59 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8126, max= 8192, per=73.58%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.99%, ctx=43, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6606KiB/s (6765kB/s), 1652KiB/s-5608KiB/s (1691kB/s-5743kB/s), io=16.0MiB (16.8MB), run=2191-2480msec WRITE: bw=10.8MiB/s (11.4MB/s), 3303KiB/s-6457KiB/s (3383kB/s-6612kB/s), io=32.0MiB (33.6MB), run=1903-2955msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189559: Fri Apr 10 16:19:52 2026 read: IOPS=1, BW=4339KiB/s (4443kB/s)(12.0MiB/2832msec) clat (msec): min=204, max=1413, avg=892.09, stdev=621.29 lat (msec): min=204, max=1413, avg=892.09, stdev=621.29 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 5809, max= 8159, per=100.00%, avg=6984.00, stdev=1661.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.08%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189560: Fri Apr 10 16:19:52 2026 read: IOPS=0, BW=1171KiB/s (1199kB/s)(4096KiB/3497msec) clat (nsec): min=1235.0M, max=1235.0M, avg=1235034917.00, stdev= 0.00 lat (nsec): min=1235.0M, max=1235.0M, avg=1235037448.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2343KiB/s (2399kB/s)(8192KiB/3497msec); 0 zone resets clat (msec): min=869, max=1233, avg=1051.77, stdev=257.36 lat (msec): min=869, max=1234, avg=1052.03, stdev=257.47 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8143, max= 8143, per=86.91%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.09%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189561: Fri Apr 10 16:19:52 2026 write: IOPS=0, BW=3819KiB/s (3910kB/s)(12.0MiB/3218msec); 0 zone resets clat (msec): min=352, max=2277, avg=1017.07, stdev=1091.89 lat (msec): min=353, max=2277, avg=1017.94, stdev=1091.57 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 5785, max= 5785, per=61.74%, avg=5785.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.94%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189562: Fri Apr 10 16:19:52 2026 write: IOPS=1, BW=5364KiB/s (5492kB/s)(12.0MiB/2291msec); 0 zone resets clat (msec): min=199, max=1633, avg=712.93, stdev=799.38 lat (msec): min=199, max=1635, avg=713.72, stdev=800.01 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min=11719, max=11719, per=100.00%, avg=11719.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.13%, sys=7.25%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4685KiB/s (4798kB/s), 1171KiB/s-4339KiB/s (1199kB/s-4443kB/s), io=16.0MiB (16.8MB), run=2832-3497msec WRITE: bw=9370KiB/s (9595kB/s), 2343KiB/s-5364KiB/s (2399kB/s-5492kB/s), io=32.0MiB (33.6MB), run=2291-3497msec