== sanity test 398b: DIO and buffer IO race ============== 13:59:21 (1784051961) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.96586 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178983: Tue Jul 14 14:01:33 2026 read: IOPS=13, BW=52.7KiB/s (53.0kB/s)(5992KiB/113643msec) clat (usec): min=34, max=819735, avg=42452.30, stdev=34104.92 lat (usec): min=34, max=819737, avg=42464.50, stdev=34106.92 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10421], 10.00th=[ 15664], 20.00th=[ 21627], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 49546], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[162530], 99.90th=[267387], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 119, per=24.75%, avg=52.22, stdev=19.46, samples=223 iops : min= 1, max= 29, avg=12.41, stdev= 4.90, samples=223 write: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6296KiB/113643msec); 0 zone resets clat (usec): min=946, max=246809, avg=31562.03, stdev=31488.16 lat (usec): min=947, max=246810, avg=31565.14, stdev=31488.61 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1516], 20.00th=[ 3851], | 30.00th=[ 7570], 40.00th=[ 15533], 50.00th=[ 24249], 60.00th=[ 31589], | 70.00th=[ 40633], 80.00th=[ 53740], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[156238], 99.90th=[196084], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 127, per=25.01%, avg=55.27, stdev=23.90, samples=222 iops : min= 1, max= 31, avg=13.17, stdev= 6.03, samples=222 lat (usec) : 50=0.33%, 100=1.46%, 1000=0.20% lat (msec) : 2=6.64%, 4=3.84%, 10=6.93%, 20=12.08%, 50=42.84% lat (msec) : 100=21.88%, 250=3.74%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.58%, ctx=6605, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178984: Tue Jul 14 14:01:33 2026 read: IOPS=13, BW=52.7KiB/s (53.0kB/s)(5940KiB/112691msec) clat (usec): min=35, max=266028, avg=42018.73, stdev=27813.90 lat (usec): min=35, max=266030, avg=42022.87, stdev=27813.06 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11076], 10.00th=[ 15533], 20.00th=[ 21103], | 30.00th=[ 26346], 40.00th=[ 31589], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[147850], 99.50th=[158335], 99.90th=[202376], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 119, per=24.86%, avg=52.45, stdev=19.24, samples=221 iops : min= 1, max= 29, avg=12.47, stdev= 4.85, samples=221 write: IOPS=14, BW=56.3KiB/s (57.7kB/s)(6348KiB/112691msec); 0 zone resets clat (usec): min=917, max=822048, avg=31466.68, stdev=37408.42 lat (usec): min=918, max=822049, avg=31477.04, stdev=37403.01 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 1614], 20.00th=[ 3884], | 30.00th=[ 7701], 40.00th=[ 15270], 50.00th=[ 22152], 60.00th=[ 29492], | 70.00th=[ 39584], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[132645], 99.50th=[173016], 99.90th=[221250], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 143, per=25.43%, avg=56.20, stdev=24.53, samples=220 iops : min= 1, max= 35, avg=13.41, stdev= 6.17, samples=220 lat (usec) : 50=0.23%, 100=1.37%, 250=0.03%, 750=0.03%, 1000=0.10% lat (msec) : 2=6.22%, 4=4.43%, 10=6.97%, 20=13.22%, 50=42.51% lat (msec) : 100=21.03%, 250=3.81%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=5.59%, ctx=6430, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178985: Tue Jul 14 14:01:33 2026 read: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6028KiB/113009msec) clat (usec): min=38, max=239575, avg=41821.26, stdev=27222.17 lat (usec): min=39, max=239576, avg=41823.38, stdev=27222.28 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11469], 10.00th=[ 16319], 20.00th=[ 22152], | 30.00th=[ 26608], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 58983], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[145753], 99.50th=[166724], 99.90th=[227541], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 109, per=25.31%, avg=53.41, stdev=18.92, samples=221 iops : min= 1, max= 27, avg=12.71, stdev= 4.80, samples=221 write: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6260KiB/113009msec); 0 zone resets clat (usec): min=962, max=734216, avg=31705.23, stdev=36764.02 lat (usec): min=963, max=734220, avg=31712.25, stdev=36765.49 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 1844], 20.00th=[ 4113], | 30.00th=[ 7963], 40.00th=[ 15795], 50.00th=[ 22938], 60.00th=[ 29754], | 70.00th=[ 39584], 80.00th=[ 52691], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[137364], 99.50th=[149947], 99.90th=[379585], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 128, per=24.96%, avg=55.16, stdev=22.55, samples=222 iops : min= 1, max= 32, avg=13.16, stdev= 5.69, samples=222 lat (usec) : 50=0.29%, 100=1.37%, 250=0.07%, 500=0.03%, 1000=0.07% lat (msec) : 2=5.47%, 4=4.33%, 10=7.36%, 20=12.50%, 50=43.62% lat (msec) : 100=21.42%, 250=3.42%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.55%, ctx=6546, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178986: Tue Jul 14 14:01:33 2026 read: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6052KiB/113387msec) clat (usec): min=32, max=204303, avg=41177.70, stdev=26162.00 lat (usec): min=32, max=204304, avg=41179.39, stdev=26161.87 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9896], 10.00th=[ 16057], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 31065], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[137364], 99.50th=[164627], 99.90th=[200279], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 7, max= 119, per=25.27%, avg=53.32, stdev=19.95, samples=222 iops : min= 1, max= 29, avg=12.69, stdev= 5.04, samples=222 write: IOPS=13, BW=54.0KiB/s (56.3kB/s)(6236KiB/113387msec); 0 zone resets clat (usec): min=811, max=732392, avg=32545.21, stdev=37865.73 lat (usec): min=812, max=732393, avg=32552.77, stdev=37871.36 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1565], 20.00th=[ 3785], | 30.00th=[ 7308], 40.00th=[ 15139], 50.00th=[ 23462], 60.00th=[ 31327], | 70.00th=[ 40633], 80.00th=[ 56361], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[152044], 99.50th=[198181], 99.90th=[274727], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 143, per=24.77%, avg=54.74, stdev=21.93, samples=223 iops : min= 1, max= 35, avg=13.05, stdev= 5.52, samples=223 lat (usec) : 50=0.26%, 100=1.73%, 250=0.03%, 1000=0.16% lat (msec) : 2=5.99%, 4=4.49%, 10=7.42%, 20=11.59%, 50=42.12% lat (msec) : 100=22.72%, 250=3.42%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.57%, ctx=6519, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=211KiB/s (216kB/s), 52.7KiB/s-53.4KiB/s (53.0kB/s-54.7kB/s), io=23.4MiB (24.6MB), run=112691-113643msec WRITE: bw=221KiB/s (227kB/s), 54.0KiB/s-56.3KiB/s (56.3kB/s-57.7kB/s), io=24.6MiB (25.7MB), run=112691-113643msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178979: Tue Jul 14 14:02:22 2026 read: IOPS=9, BW=36.8KiB/s (37.7kB/s)(5992KiB/162639msec) clat (msec): min=5, max=854, avg=42.12, stdev=41.66 lat (msec): min=5, max=854, avg=42.12, stdev=41.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 83], 95.00th=[ 122], | 99.00th=[ 192], 99.50th=[ 220], 99.90th=[ 279], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 119, per=25.44%, avg=37.40, stdev=21.89, samples=312 iops : min= 1, max= 29, avg= 8.68, stdev= 5.50, samples=312 write: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6296KiB/162639msec); 0 zone resets clat (msec): min=10, max=536, avg=62.99, stdev=40.62 lat (msec): min=10, max=536, avg=63.00, stdev=40.62 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 71], 80.00th=[ 87], 90.00th=[ 117], 95.00th=[ 144], | 99.00th=[ 199], 99.50th=[ 232], 99.90th=[ 271], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 7, max= 108, per=25.11%, avg=38.67, stdev=19.38, samples=317 iops : min= 1, max= 27, avg= 9.01, stdev= 4.88, samples=317 lat (msec) : 10=1.60%, 20=12.96%, 50=47.04%, 100=27.57%, 250=10.58% lat (msec) : 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=2.07%, ctx=4789, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178980: Tue Jul 14 14:02:22 2026 read: IOPS=9, BW=36.6KiB/s (37.5kB/s)(5940KiB/162097msec) clat (msec): min=5, max=699, avg=42.16, stdev=38.43 lat (msec): min=5, max=699, avg=42.16, stdev=38.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 59], 90.00th=[ 85], 95.00th=[ 113], | 99.00th=[ 186], 99.50th=[ 207], 99.90th=[ 262], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 127, per=25.20%, avg=37.05, stdev=22.49, samples=311 iops : min= 1, max= 31, avg= 8.59, stdev= 5.65, samples=311 write: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6348KiB/162097msec); 0 zone resets clat (msec): min=9, max=317, avg=62.43, stdev=39.92 lat (msec): min=9, max=317, avg=62.43, stdev=39.92 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 60], | 70.00th=[ 71], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 203], 99.50th=[ 226], 99.90th=[ 300], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 116, per=25.35%, avg=39.04, stdev=20.23, samples=315 iops : min= 1, max= 29, avg= 9.10, stdev= 5.10, samples=315 lat (msec) : 10=1.63%, 20=12.27%, 50=47.17%, 100=28.13%, 250=10.58% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.06%, sys=2.16%, ctx=5039, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178981: Tue Jul 14 14:02:22 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6028KiB/161846msec) clat (msec): min=6, max=283, avg=42.58, stdev=36.27 lat (msec): min=6, max=283, avg=42.58, stdev=36.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 87], 95.00th=[ 114], | 99.00th=[ 192], 99.50th=[ 224], 99.90th=[ 279], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 127, per=25.82%, avg=37.95, stdev=21.49, samples=309 iops : min= 1, max= 31, avg= 8.83, stdev= 5.38, samples=309 write: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6260KiB/161846msec); 0 zone resets clat (msec): min=9, max=721, avg=62.15, stdev=44.73 lat (msec): min=9, max=721, avg=62.16, stdev=44.73 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 59], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 241], 99.90th=[ 542], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 126, per=25.02%, avg=38.53, stdev=20.71, samples=316 iops : min= 1, max= 31, avg= 8.96, stdev= 5.21, samples=316 lat (msec) : 10=1.46%, 20=13.28%, 50=46.39%, 100=28.06%, 250=10.51% lat (msec) : 500=0.23%, 750=0.07% cpu : usr=0.07%, sys=2.18%, ctx=4990, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178982: Tue Jul 14 14:02:22 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6052KiB/160944msec) clat (msec): min=5, max=294, avg=41.33, stdev=34.81 lat (msec): min=5, max=294, avg=41.33, stdev=34.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 112], | 99.00th=[ 178], 99.50th=[ 205], 99.90th=[ 279], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 140, per=25.75%, avg=37.86, stdev=20.71, samples=311 iops : min= 1, max= 35, avg= 8.80, stdev= 5.21, samples=311 write: IOPS=9, BW=38.7KiB/s (39.7kB/s)(6236KiB/160944msec); 0 zone resets clat (msec): min=11, max=715, avg=62.87, stdev=42.84 lat (msec): min=11, max=715, avg=62.87, stdev=42.84 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 144], | 99.00th=[ 213], 99.50th=[ 243], 99.90th=[ 330], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 119, per=25.17%, avg=38.77, stdev=19.97, samples=313 iops : min= 1, max= 29, avg= 9.03, stdev= 5.02, samples=313 lat (msec) : 10=1.73%, 20=12.92%, 50=47.07%, 100=28.06%, 250=9.90% lat (msec) : 500=0.29%, 750=0.03% cpu : usr=0.07%, sys=2.13%, ctx=4932, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=148KiB/s (151kB/s), 36.6KiB/s-37.6KiB/s (37.5kB/s-38.5kB/s), io=23.4MiB (24.6MB), run=160944-162639msec WRITE: bw=155KiB/s (158kB/s), 38.7KiB/s-39.2KiB/s (39.6kB/s-40.1kB/s), io=24.6MiB (25.7MB), run=160944-162639msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179036: Tue Jul 14 14:03:15 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(5920KiB/40147msec) clat (usec): min=45, max=284369, avg=59149.82, stdev=40818.19 lat (usec): min=45, max=284369, avg=59151.23, stdev=40818.20 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 85], 10.00th=[ 19792], 20.00th=[ 29754], | 30.00th=[ 36963], 40.00th=[ 44303], 50.00th=[ 50070], 60.00th=[ 57934], | 70.00th=[ 69731], 80.00th=[ 84411], 90.00th=[110625], 95.00th=[132645], | 99.00th=[193987], 99.50th=[248513], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 343, per=24.55%, avg=146.29, stdev=66.02, samples=78 iops : min= 1, max= 21, avg= 8.35, stdev= 4.16, samples=78 write: IOPS=9, BW=159KiB/s (162kB/s)(6368KiB/40147msec); 0 zone resets clat (usec): min=1608, max=262700, avg=45330.39, stdev=43029.09 lat (usec): min=1610, max=262703, avg=45332.77, stdev=43029.11 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2024], 10.00th=[ 4047], 20.00th=[ 8848], | 30.00th=[ 17171], 40.00th=[ 24511], 50.00th=[ 34341], 60.00th=[ 43779], | 70.00th=[ 54264], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[124257], | 99.00th=[200279], 99.50th=[250610], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 448, per=25.94%, avg=162.64, stdev=68.13, samples=76 iops : min= 1, max= 28, avg= 9.37, stdev= 4.32, samples=76 lat (usec) : 50=0.13%, 100=2.60%, 250=0.26%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.60%, 4=2.86%, 10=6.64%, 20=6.77%, 50=36.33% lat (msec) : 100=29.43%, 250=11.59%, 500=0.52% cpu : usr=0.07%, sys=4.80%, ctx=1797, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179037: Tue Jul 14 14:03:15 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(5744KiB/39000msec) clat (usec): min=52, max=238375, avg=59780.81, stdev=37994.40 lat (usec): min=53, max=238376, avg=59782.17, stdev=37994.45 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 22938], 20.00th=[ 31327], | 30.00th=[ 39060], 40.00th=[ 45351], 50.00th=[ 52691], 60.00th=[ 60556], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[111674], 95.00th=[132645], | 99.00th=[183501], 99.50th=[210764], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 44, max= 383, per=24.82%, avg=147.91, stdev=62.79, samples=75 iops : min= 2, max= 23, avg= 8.44, stdev= 3.97, samples=75 write: IOPS=10, BW=168KiB/s (172kB/s)(6544KiB/39000msec); 0 zone resets clat (usec): min=1402, max=253276, avg=42443.42, stdev=41990.93 lat (usec): min=1404, max=253278, avg=42445.90, stdev=41991.02 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2474], 10.00th=[ 4359], 20.00th=[ 7963], | 30.00th=[ 12387], 40.00th=[ 20579], 50.00th=[ 27919], 60.00th=[ 40109], | 70.00th=[ 54264], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[124257], | 99.00th=[173016], 99.50th=[229639], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 383, per=26.44%, avg=165.75, stdev=79.38, samples=76 iops : min= 1, max= 23, avg= 9.57, stdev= 4.98, samples=76 lat (usec) : 100=2.60%, 250=0.39% lat (msec) : 2=1.82%, 4=2.86%, 10=9.38%, 20=8.07%, 50=32.29% lat (msec) : 100=31.12%, 250=11.33%, 500=0.13% cpu : usr=0.05%, sys=5.62%, ctx=1751, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179038: Tue Jul 14 14:03:15 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6256KiB/38993msec) clat (usec): min=51, max=222625, avg=58378.21, stdev=35680.56 lat (usec): min=51, max=222626, avg=58430.68, stdev=35672.58 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 86], 10.00th=[ 20055], 20.00th=[ 30540], | 30.00th=[ 39584], 40.00th=[ 46400], 50.00th=[ 52691], 60.00th=[ 61080], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[106431], 95.00th=[131597], | 99.00th=[164627], 99.50th=[189793], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 345, per=26.88%, avg=160.22, stdev=68.97, samples=76 iops : min= 1, max= 21, avg= 9.21, stdev= 4.34, samples=76 write: IOPS=9, BW=155KiB/s (158kB/s)(6032KiB/38993msec); 0 zone resets clat (usec): min=1590, max=260273, avg=42639.42, stdev=43515.15 lat (usec): min=1591, max=260275, avg=42667.92, stdev=43545.69 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2442], 10.00th=[ 4146], 20.00th=[ 7308], | 30.00th=[ 12125], 40.00th=[ 19006], 50.00th=[ 28705], 60.00th=[ 39584], | 70.00th=[ 51119], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[129500], | 99.00th=[196084], 99.50th=[238027], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 351, per=24.54%, avg=153.88, stdev=75.06, samples=75 iops : min= 1, max= 21, avg= 8.83, stdev= 4.75, samples=75 lat (usec) : 100=2.99%, 250=0.26% lat (msec) : 2=1.56%, 4=3.12%, 10=8.07%, 20=9.11%, 50=31.64% lat (msec) : 100=31.77%, 250=11.33%, 500=0.13% cpu : usr=0.06%, sys=4.90%, ctx=1758, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179039: Tue Jul 14 14:03:15 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37611msec) clat (usec): min=39, max=316127, avg=57418.93, stdev=42355.66 lat (usec): min=40, max=316129, avg=57421.44, stdev=42354.15 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 178], 20.00th=[ 27132], | 30.00th=[ 36439], 40.00th=[ 43254], 50.00th=[ 50070], 60.00th=[ 57934], | 70.00th=[ 67634], 80.00th=[ 85459], 90.00th=[109577], 95.00th=[129500], | 99.00th=[206570], 99.50th=[248513], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 62, max= 287, per=26.71%, avg=159.18, stdev=62.33, samples=73 iops : min= 3, max= 17, avg= 9.15, stdev= 3.95, samples=73 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37611msec); 0 zone resets clat (usec): min=1528, max=250276, avg=40301.12, stdev=40446.39 lat (usec): min=1530, max=250278, avg=40306.04, stdev=40446.31 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2057], 10.00th=[ 3589], 20.00th=[ 7111], | 30.00th=[ 11469], 40.00th=[ 20317], 50.00th=[ 29230], 60.00th=[ 35390], | 70.00th=[ 49546], 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[120062], | 99.00th=[177210], 99.50th=[238027], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 30, max= 440, per=26.58%, avg=166.64, stdev=84.64, samples=73 iops : min= 1, max= 27, avg= 9.63, stdev= 5.35, samples=73 lat (usec) : 50=0.39%, 100=4.43%, 250=0.26%, 500=0.13% lat (msec) : 2=2.34%, 4=3.65%, 10=7.94%, 20=7.55%, 50=34.24% lat (msec) : 100=27.86%, 250=10.94%, 500=0.26% cpu : usr=0.11%, sys=5.11%, ctx=1651, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=597KiB/s (611kB/s), 147KiB/s-160KiB/s (151kB/s-164kB/s), io=23.4MiB (24.5MB), run=37611-40147msec WRITE: bw=628KiB/s (643kB/s), 155KiB/s-168KiB/s (158kB/s-172kB/s), io=24.6MiB (25.8MB), run=37611-40147msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179041: Tue Jul 14 14:03:28 2026 read: IOPS=7, BW=112KiB/s (115kB/s)(5920KiB/52692msec) clat (msec): min=9, max=287, avg=58.37, stdev=50.25 lat (msec): min=9, max=287, avg=58.37, stdev=50.25 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 62], 80.00th=[ 87], 90.00th=[ 127], 95.00th=[ 178], | 99.00th=[ 222], 99.50th=[ 255], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 343, per=24.48%, avg=111.14, stdev=72.90, samples=102 iops : min= 1, max= 21, avg= 6.16, stdev= 4.64, samples=102 write: IOPS=7, BW=121KiB/s (124kB/s)(6368KiB/52692msec); 0 zone resets clat (msec): min=15, max=346, avg=77.99, stdev=55.86 lat (msec): min=15, max=346, avg=77.99, stdev=55.86 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 72], | 70.00th=[ 85], 80.00th=[ 113], 90.00th=[ 155], 95.00th=[ 194], | 99.00th=[ 284], 99.50th=[ 334], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 352, per=25.80%, avg=123.32, stdev=76.92, samples=100 iops : min= 1, max= 22, avg= 6.92, stdev= 4.89, samples=100 lat (msec) : 10=0.13%, 20=6.90%, 50=44.14%, 100=28.13%, 250=19.53% lat (msec) : 500=1.17% cpu : usr=0.06%, sys=1.85%, ctx=1252, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179042: Tue Jul 14 14:03:28 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(5744KiB/52283msec) clat (msec): min=6, max=309, avg=54.14, stdev=47.26 lat (msec): min=6, max=309, avg=54.14, stdev=47.26 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 57], 80.00th=[ 84], 90.00th=[ 120], 95.00th=[ 163], | 99.00th=[ 218], 99.50th=[ 228], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 384, per=24.76%, avg=112.40, stdev=72.92, samples=100 iops : min= 1, max= 24, avg= 6.24, stdev= 4.65, samples=100 write: IOPS=7, BW=125KiB/s (128kB/s)(6544KiB/52283msec); 0 zone resets clat (msec): min=17, max=462, avg=80.06, stdev=54.68 lat (msec): min=17, max=462, avg=80.06, stdev=54.68 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 93], 80.00th=[ 117], 90.00th=[ 157], 95.00th=[ 178], | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 416, per=26.31%, avg=125.76, stdev=75.65, samples=102 iops : min= 1, max= 26, avg= 7.08, stdev= 4.80, samples=102 lat (msec) : 10=0.65%, 20=7.42%, 50=41.28%, 100=29.17%, 250=20.57% lat (msec) : 500=0.91% cpu : usr=0.07%, sys=1.72%, ctx=1198, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179043: Tue Jul 14 14:03:28 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52016msec) clat (msec): min=6, max=255, avg=52.85, stdev=43.42 lat (msec): min=6, max=255, avg=52.85, stdev=43.42 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 78], 90.00th=[ 117], 95.00th=[ 150], | 99.00th=[ 213], 99.50th=[ 247], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 30, max= 350, per=27.08%, avg=122.96, stdev=83.49, samples=100 iops : min= 1, max= 21, avg= 6.90, stdev= 5.29, samples=100 write: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/52016msec); 0 zone resets clat (msec): min=19, max=290, avg=82.92, stdev=52.06 lat (msec): min=19, max=290, avg=82.92, stdev=52.06 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 41], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 66], 60.00th=[ 80], | 70.00th=[ 95], 80.00th=[ 126], 90.00th=[ 157], 95.00th=[ 194], | 99.00th=[ 262], 99.50th=[ 275], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 318, per=24.12%, avg=115.31, stdev=62.71, samples=101 iops : min= 1, max= 19, avg= 6.43, stdev= 4.02, samples=101 lat (msec) : 10=0.26%, 20=7.16%, 50=41.80%, 100=30.34%, 250=19.79% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.74%, ctx=1177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179044: Tue Jul 14 14:03:28 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/52005msec) clat (msec): min=8, max=300, avg=56.06, stdev=50.21 lat (msec): min=8, max=300, avg=56.06, stdev=50.21 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 47], | 70.00th=[ 61], 80.00th=[ 83], 90.00th=[ 120], 95.00th=[ 171], | 99.00th=[ 249], 99.50th=[ 292], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 352, per=26.85%, avg=121.91, stdev=78.74, samples=96 iops : min= 1, max= 22, avg= 6.83, stdev= 5.04, samples=96 write: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52005msec); 0 zone resets clat (msec): min=16, max=296, avg=78.81, stdev=52.25 lat (msec): min=16, max=296, avg=78.81, stdev=52.25 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 73], | 70.00th=[ 96], 80.00th=[ 115], 90.00th=[ 159], 95.00th=[ 186], | 99.00th=[ 232], 99.50th=[ 279], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 350, per=25.46%, avg=121.68, stdev=78.83, samples=101 iops : min= 1, max= 21, avg= 6.79, stdev= 4.97, samples=101 lat (msec) : 10=0.65%, 20=8.98%, 50=39.71%, 100=28.65%, 250=21.35% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.80%, ctx=1225, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=455KiB/s (465kB/s), 110KiB/s-120KiB/s (113kB/s-123kB/s), io=23.4MiB (24.5MB), run=52005-52692msec WRITE: bw=478KiB/s (490kB/s), 116KiB/s-125KiB/s (119kB/s-128kB/s), io=24.6MiB (25.8MB), run=52005-52692msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179059: Tue Jul 14 14:03:52 2026 read: IOPS=1, BW=1537KiB/s (1573kB/s)(7168KiB/4665msec) clat (usec): min=529, max=392564, avg=212500.27, stdev=153875.10 lat (usec): min=530, max=392565, avg=212501.77, stdev=153875.32 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 537], | 30.00th=[246416], 40.00th=[246416], 50.00th=[248513], 60.00th=[265290], | 70.00th=[265290], 80.00th=[333448], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 1831, max= 3938, per=64.41%, avg=2324.40, stdev=906.44, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1098KiB/s (1124kB/s)(5120KiB/4665msec); 0 zone resets clat (msec): min=199, max=1247, avg=621.58, stdev=405.08 lat (msec): min=200, max=1247, avg=621.73, stdev=404.97 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1838, max= 2039, per=39.13%, avg=1977.00, stdev=94.18, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=8.51%, ctx=171, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179060: Tue Jul 14 14:03:52 2026 read: IOPS=0, BW=361KiB/s (370kB/s)(2048KiB/5674msec) clat (msec): min=299, max=866, avg=582.90, stdev=401.35 lat (msec): min=299, max=866, avg=582.90, stdev=401.35 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2015, max= 2031, per=56.05%, avg=2023.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1805KiB/s (1848kB/s)(10.0MiB/5674msec); 0 zone resets clat (msec): min=172, max=1057, avg=440.31, stdev=269.10 lat (msec): min=172, max=1057, avg=440.55, stdev=269.17 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 178], | 30.00th=[ 275], 40.00th=[ 279], 50.00th=[ 351], 60.00th=[ 376], | 70.00th=[ 481], 80.00th=[ 609], 90.00th=[ 634], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1838, max= 6083, per=63.04%, avg=3185.60, stdev=1848.68, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.79%, ctx=188, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179061: Tue Jul 14 14:03:52 2026 read: IOPS=1, BW=1441KiB/s (1475kB/s)(6144KiB/4264msec) clat (msec): min=4, max=457, avg=237.78, stdev=188.65 lat (msec): min=4, max=457, avg=237.79, stdev=188.65 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 11], | 30.00th=[ 11], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 326], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1924, max= 2043, per=55.11%, avg=1988.80, stdev=52.81, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1441KiB/s (1475kB/s)(6144KiB/4264msec); 0 zone resets clat (msec): min=214, max=843, avg=458.14, stdev=232.03 lat (msec): min=214, max=843, avg=458.60, stdev=232.35 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 372], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1408, max= 2043, per=36.49%, avg=1844.00, stdev=249.76, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 10=16.67%, 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=11.33%, ctx=192, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179062: Tue Jul 14 14:03:52 2026 read: IOPS=1, BW=1127KiB/s (1154kB/s)(5120KiB/4543msec) clat (usec): min=344, max=405712, avg=87051.36, stdev=178521.83 lat (usec): min=344, max=405713, avg=87054.91, stdev=178520.82 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[ 1012], 60.00th=[ 1012], | 70.00th=[ 27657], 80.00th=[ 27657], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7699, max= 7699, per=100.00%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1578KiB/s (1616kB/s)(7168KiB/4543msec); 0 zone resets clat (msec): min=470, max=618, avg=559.91, stdev=51.33 lat (msec): min=470, max=618, avg=560.15, stdev=51.29 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 523], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 567], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 609], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1899, max= 2043, per=39.42%, avg=1991.67, stdev=57.88, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 50=8.33%, 500=16.67%, 750=50.00% cpu : usr=0.00%, sys=8.48%, ctx=176, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3609KiB/s (3696kB/s), 361KiB/s-1537KiB/s (370kB/s-1573kB/s), io=20.0MiB (20.0MB), run=4264-5674msec WRITE: bw=5053KiB/s (5175kB/s), 1098KiB/s-1805KiB/s (1124kB/s-1848kB/s), io=28.0MiB (29.4MB), run=4264-5674msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179063: Tue Jul 14 14:03:53 2026 read: IOPS=1, BW=1312KiB/s (1343kB/s)(7168KiB/5465msec) clat (msec): min=122, max=297, avg=211.80, stdev=70.14 lat (msec): min=122, max=297, avg=211.81, stdev=70.14 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 144], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 192], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 288], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1896, max= 4079, per=97.87%, avg=2994.75, stdev=1229.32, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=937KiB/s (959kB/s)(5120KiB/5465msec); 0 zone resets clat (msec): min=420, max=1341, avg=763.01, stdev=388.83 lat (msec): min=420, max=1341, avg=763.10, stdev=388.83 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1896, max= 3447, per=54.03%, avg=2315.00, stdev=756.28, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.72%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179064: Tue Jul 14 14:03:53 2026 read: IOPS=0, BW=308KiB/s (316kB/s)(2048KiB/6641msec) clat (msec): min=135, max=375, avg=255.35, stdev=169.24 lat (msec): min=135, max=375, avg=255.35, stdev=169.24 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1896, max= 1924, per=62.42%, avg=1910.00, stdev=19.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1542KiB/s (1579kB/s)(10.0MiB/6641msec); 0 zone resets clat (msec): min=150, max=1571, avg=603.71, stdev=451.76 lat (msec): min=150, max=1571, avg=604.00, stdev=451.73 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 203], | 30.00th=[ 228], 40.00th=[ 317], 50.00th=[ 464], 60.00th=[ 550], | 70.00th=[ 600], 80.00th=[ 894], 90.00th=[ 1062], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1825, max= 3984, per=52.37%, avg=2244.00, stdev=770.78, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.05%, sys=4.23%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179065: Tue Jul 14 14:03:53 2026 read: IOPS=0, BW=968KiB/s (991kB/s)(6144KiB/6347msec) clat (msec): min=146, max=911, avg=435.72, stdev=291.11 lat (msec): min=146, max=911, avg=435.72, stdev=291.11 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 489], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1692, max= 2035, per=61.69%, avg=1887.60, stdev=140.61, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=968KiB/s (991kB/s)(6144KiB/6347msec); 0 zone resets clat (msec): min=226, max=1127, avg=596.32, stdev=367.13 lat (msec): min=226, max=1127, avg=597.64, stdev=366.03 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 600], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1910, max= 2035, per=46.45%, avg=1990.20, stdev=48.66, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.18%, ctx=97, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179066: Tue Jul 14 14:03:53 2026 read: IOPS=0, BW=765KiB/s (784kB/s)(5120KiB/6691msec) clat (msec): min=121, max=1067, avg=612.97, stdev=354.71 lat (msec): min=121, max=1067, avg=612.97, stdev=354.71 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1896, max= 2043, per=64.75%, avg=1981.50, stdev=62.08, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1071KiB/s (1097kB/s)(7168KiB/6691msec); 0 zone resets clat (msec): min=175, max=1276, avg=501.32, stdev=411.27 lat (msec): min=176, max=1276, avg=501.83, stdev=410.91 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 207], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 338], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 852], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1812, max= 4071, per=68.69%, avg=2943.25, stdev=1192.55, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 1000=16.67%, 2000=16.67% cpu : usr=0.00%, sys=3.74%, ctx=106, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3061KiB/s (3134kB/s), 308KiB/s-1312KiB/s (316kB/s-1343kB/s), io=20.0MiB (20.0MB), run=5465-6691msec WRITE: bw=4285KiB/s (4388kB/s), 937KiB/s-1542KiB/s (959kB/s-1579kB/s), io=28.0MiB (29.4MB), run=5465-6691msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179073: Tue Jul 14 14:04:09 2026 read: IOPS=0, BW=3747KiB/s (3837kB/s)(12.0MiB/3279msec) clat (msec): min=923, max=1148, avg=1051.57, stdev=115.95 lat (msec): min=923, max=1148, avg=1051.58, stdev=115.95 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7984, max= 8175, per=100.00%, avg=8079.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.31%, ctx=169, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179074: Tue Jul 14 14:04:09 2026 read: IOPS=0, BW=990KiB/s (1014kB/s)(4096KiB/4138msec) clat (nsec): min=1077.3M, max=1077.3M, avg=1077336876.00, stdev= 0.00 lat (nsec): min=1077.3M, max=1077.3M, avg=1077339458.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1980KiB/s (2027kB/s)(8192KiB/4138msec); 0 zone resets clat (msec): min=1402, max=1607, avg=1505.22, stdev=145.22 lat (msec): min=1402, max=1608, avg=1505.59, stdev=145.26 clat percentiles (msec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.22%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179075: Tue Jul 14 14:04:09 2026 write: IOPS=0, BW=2647KiB/s (2711kB/s)(12.0MiB/4642msec); 0 zone resets clat (msec): min=282, max=2923, avg=1497.30, stdev=1333.45 lat (msec): min=282, max=2924, avg=1497.68, stdev=1333.53 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.82%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179076: Tue Jul 14 14:04:09 2026 write: IOPS=0, BW=3236KiB/s (3314kB/s)(12.0MiB/3797msec); 0 zone resets clat (msec): min=912, max=1678, avg=1240.63, stdev=394.33 lat (msec): min=912, max=1678, avg=1242.06, stdev=393.92 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 7892, max= 8175, per=100.00%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.37%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3959KiB/s (4054kB/s), 990KiB/s-3747KiB/s (1014kB/s-3837kB/s), io=16.0MiB (16.8MB), run=3279-4138msec WRITE: bw=7059KiB/s (7228kB/s), 1980KiB/s-3236KiB/s (2027kB/s-3314kB/s), io=32.0MiB (33.6MB), run=3797-4642msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179078: Tue Jul 14 14:04:09 2026 read: IOPS=0, BW=3472KiB/s (3555kB/s)(12.0MiB/3539msec) clat (msec): min=385, max=1724, avg=1147.98, stdev=688.75 lat (msec): min=385, max=1724, avg=1147.98, stdev=688.76 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 7585, max= 7585, per=100.00%, avg=7585.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.19%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179079: Tue Jul 14 14:04:09 2026 read: IOPS=0, BW=958KiB/s (981kB/s)(4096KiB/4274msec) clat (nsec): min=1345.2M, max=1345.2M, avg=1345188844.00, stdev= 0.00 lat (nsec): min=1345.2M, max=1345.2M, avg=1345190391.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1917KiB/s (1963kB/s)(8192KiB/4274msec); 0 zone resets clat (msec): min=1311, max=1614, avg=1462.91, stdev=213.90 lat (msec): min=1312, max=1614, avg=1463.81, stdev=213.41 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.05%, sys=2.81%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179080: Tue Jul 14 14:04:09 2026 write: IOPS=0, BW=2895KiB/s (2965kB/s)(12.0MiB/4244msec); 0 zone resets clat (msec): min=362, max=2673, avg=1398.14, stdev=1174.10 lat (msec): min=363, max=2674, avg=1398.49, stdev=1174.09 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.16%, sys=2.14%, ctx=47, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179081: Tue Jul 14 14:04:09 2026 write: IOPS=0, BW=3626KiB/s (3713kB/s)(12.0MiB/3389msec); 0 zone resets clat (msec): min=651, max=1379, avg=1117.34, stdev=404.84 lat (msec): min=651, max=1380, avg=1119.33, stdev=406.15 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7571, max= 8031, per=100.00%, avg=7801.00, stdev=325.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.74%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3833KiB/s (3925kB/s), 958KiB/s-3472KiB/s (981kB/s-3555kB/s), io=16.0MiB (16.8MB), run=3539-4274msec WRITE: bw=7667KiB/s (7851kB/s), 1917KiB/s-3626KiB/s (1963kB/s-3713kB/s), io=32.0MiB (33.6MB), run=3389-4274msec