== sanity test 398b: DIO and buffer IO race ============== 16:52:13 (1782247933) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.65328 s, 7.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179949: Tue Jun 23 16:54:55 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(5992KiB/140944msec) clat (usec): min=34, max=257806, avg=52461.32, stdev=32992.56 lat (usec): min=34, max=257807, avg=52464.08, stdev=32994.53 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 15008], 10.00th=[ 20055], 20.00th=[ 27132], | 30.00th=[ 33162], 40.00th=[ 39060], 50.00th=[ 46400], 60.00th=[ 53216], | 70.00th=[ 62129], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[170918], 99.50th=[196084], 99.90th=[244319], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 7, max= 104, per=24.95%, avg=42.41, stdev=16.02, samples=275 iops : min= 1, max= 26, avg= 9.93, stdev= 4.05, samples=275 write: IOPS=11, BW=44.7KiB/s (45.7kB/s)(6296KiB/140944msec); 0 zone resets clat (usec): min=1074, max=1067.4k, avg=39251.91, stdev=46059.74 lat (usec): min=1076, max=1067.4k, avg=39256.89, stdev=46061.13 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1549], 10.00th=[ 2573], | 20.00th=[ 5014], 30.00th=[ 8979], 40.00th=[ 18744], | 50.00th=[ 28443], 60.00th=[ 37487], 70.00th=[ 49546], | 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[ 113771], | 99.00th=[ 158335], 99.50th=[ 175113], 99.90th=[ 235930], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 119, per=24.84%, avg=44.21, stdev=21.61, samples=277 iops : min= 1, max= 29, avg=10.40, stdev= 5.46, samples=277 lat (usec) : 50=0.07%, 100=1.04%, 250=0.26%, 500=0.03%, 1000=0.10% lat (msec) : 2=3.97%, 4=4.65%, 10=7.71%, 20=8.43%, 50=36.88% lat (msec) : 100=28.55%, 250=8.24%, 500=0.03%, 2000=0.03% cpu : usr=0.10%, sys=5.33%, ctx=6933, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179950: Tue Jun 23 16:54:55 2026 read: IOPS=10, BW=43.1KiB/s (44.2kB/s)(5940KiB/137700msec) clat (usec): min=50, max=867800, avg=51372.96, stdev=39005.34 lat (usec): min=51, max=867803, avg=51381.13, stdev=39000.34 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 12911], 10.00th=[ 19268], 20.00th=[ 26870], | 30.00th=[ 32375], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 51119], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[175113], 99.50th=[196084], 99.90th=[252707], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 96, per=25.28%, avg=42.97, stdev=16.44, samples=268 iops : min= 1, max= 24, avg=10.07, stdev= 4.15, samples=268 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6348KiB/137700msec); 0 zone resets clat (usec): min=1145, max=224113, avg=38342.46, stdev=37245.05 lat (usec): min=1146, max=224114, avg=38346.51, stdev=37243.21 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1647], 10.00th=[ 2769], 20.00th=[ 5407], | 30.00th=[ 9372], 40.00th=[ 19006], 50.00th=[ 28705], 60.00th=[ 37487], | 70.00th=[ 47973], 80.00th=[ 66847], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[149947], 99.50th=[175113], 99.90th=[206570], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 128, per=25.48%, avg=45.36, stdev=20.30, samples=270 iops : min= 1, max= 32, avg=10.69, stdev= 5.13, samples=270 lat (usec) : 100=1.33%, 250=0.55%, 750=0.07%, 1000=0.03% lat (msec) : 2=3.91%, 4=3.94%, 10=8.40%, 20=8.04%, 50=39.06% lat (msec) : 100=27.15%, 250=7.45%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.49%, ctx=6927, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179951: Tue Jun 23 16:54:55 2026 read: IOPS=11, BW=44.4KiB/s (45.5kB/s)(6028KiB/135811msec) clat (usec): min=37, max=1117.0k, avg=50358.34, stdev=41537.07 lat (usec): min=37, max=1117.0k, avg=50367.65, stdev=41541.01 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11731], 10.00th=[ 19792], | 20.00th=[ 25822], 30.00th=[ 31589], 40.00th=[ 36963], | 50.00th=[ 44303], 60.00th=[ 50594], 70.00th=[ 58983], | 80.00th=[ 70779], 90.00th=[ 85459], 95.00th=[ 105382], | 99.00th=[ 162530], 99.50th=[ 185598], 99.90th=[ 244319], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 88, per=25.84%, avg=43.94, stdev=16.45, samples=267 iops : min= 1, max= 22, avg=10.33, stdev= 4.18, samples=267 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6260KiB/135811msec); 0 zone resets clat (usec): min=1141, max=231256, avg=37975.25, stdev=37328.25 lat (usec): min=1142, max=231258, avg=37978.84, stdev=37329.84 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1614], 10.00th=[ 2540], 20.00th=[ 5145], | 30.00th=[ 9634], 40.00th=[ 17957], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 65799], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[162530], 99.50th=[200279], 99.90th=[229639], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 104, per=25.76%, avg=45.85, stdev=20.75, samples=266 iops : min= 1, max= 26, avg=10.80, stdev= 5.23, samples=266 lat (usec) : 50=0.26%, 100=1.56%, 250=0.16%, 750=0.07%, 1000=0.03% lat (msec) : 2=4.00%, 4=4.00%, 10=7.71%, 20=8.43%, 50=38.61% lat (msec) : 100=28.84%, 250=6.28%, 2000=0.03% cpu : usr=0.07%, sys=5.49%, ctx=6996, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179952: Tue Jun 23 16:54:55 2026 read: IOPS=10, BW=43.7KiB/s (44.7kB/s)(6052KiB/138569msec) clat (usec): min=50, max=1072.2k, avg=51281.57, stdev=42579.26 lat (usec): min=51, max=1072.2k, avg=51284.80, stdev=42580.23 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 11994], 10.00th=[ 19268], | 20.00th=[ 25560], 30.00th=[ 31589], 40.00th=[ 38011], | 50.00th=[ 43779], 60.00th=[ 51643], 70.00th=[ 59507], | 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[ 107480], | 99.00th=[ 173016], 99.50th=[ 210764], 99.90th=[ 274727], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 95, per=25.67%, avg=43.63, stdev=16.34, samples=270 iops : min= 1, max= 23, avg=10.24, stdev= 4.12, samples=270 write: IOPS=11, BW=45.0KiB/s (46.1kB/s)(6236KiB/138569msec); 0 zone resets clat (usec): min=1120, max=299682, avg=38786.72, stdev=37716.77 lat (usec): min=1121, max=299684, avg=38794.49, stdev=37718.21 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1598], 10.00th=[ 2573], 20.00th=[ 5604], | 30.00th=[ 9896], 40.00th=[ 19530], 50.00th=[ 29492], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[154141], 99.50th=[175113], 99.90th=[225444], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 110, per=25.05%, avg=44.59, stdev=20.30, samples=272 iops : min= 1, max= 27, avg=10.49, stdev= 5.10, samples=272 lat (usec) : 100=1.76%, 250=0.39%, 500=0.07% lat (msec) : 2=3.81%, 4=3.87%, 10=7.88%, 20=8.17%, 50=38.31% lat (msec) : 100=28.55%, 250=7.06%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=5.39%, ctx=6920, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=170KiB/s (174kB/s), 42.5KiB/s-44.4KiB/s (43.5kB/s-45.5kB/s), io=23.4MiB (24.6MB), run=135811-140944msec WRITE: bw=178KiB/s (183kB/s), 44.7KiB/s-46.1KiB/s (45.7kB/s-47.2kB/s), io=24.6MiB (25.7MB), run=135811-140944msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179954: Tue Jun 23 16:55:39 2026 read: IOPS=8, BW=32.7KiB/s (33.4kB/s)(5992KiB/183493msec) clat (msec): min=6, max=924, avg=47.14, stdev=44.55 lat (msec): min=6, max=924, avg=47.15, stdev=44.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 101], 95.00th=[ 132], | 99.00th=[ 182], 99.50th=[ 203], 99.90th=[ 296], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 118, per=25.47%, avg=33.11, stdev=21.69, samples=350 iops : min= 1, max= 29, avg= 7.60, stdev= 5.47, samples=350 write: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6296KiB/183493msec); 0 zone resets clat (msec): min=13, max=312, avg=71.57, stdev=47.00 lat (msec): min=13, max=312, avg=71.57, stdev=47.00 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 67], | 70.00th=[ 85], 80.00th=[ 105], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 241], 99.50th=[ 271], 99.90th=[ 309], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 96, per=24.85%, avg=33.80, stdev=19.80, samples=360 iops : min= 1, max= 24, avg= 7.77, stdev= 4.98, samples=360 lat (msec) : 10=0.75%, 20=10.06%, 50=45.83%, 100=27.08%, 250=15.82% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.06%, sys=2.11%, ctx=4995, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179955: Tue Jun 23 16:55:39 2026 read: IOPS=8, BW=32.2KiB/s (32.9kB/s)(5940KiB/184695msec) clat (msec): min=7, max=1114, avg=48.32, stdev=49.73 lat (msec): min=7, max=1114, avg=48.32, stdev=49.73 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 69], 90.00th=[ 110], 95.00th=[ 136], | 99.00th=[ 215], 99.50th=[ 234], 99.90th=[ 279], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 103, per=25.21%, avg=32.77, stdev=21.98, samples=351 iops : min= 1, max= 25, avg= 7.52, stdev= 5.54, samples=351 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6348KiB/184695msec); 0 zone resets clat (msec): min=13, max=336, avg=71.03, stdev=47.14 lat (msec): min=13, max=336, avg=71.04, stdev=47.13 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 106], 90.00th=[ 138], 95.00th=[ 163], | 99.00th=[ 243], 99.50th=[ 275], 99.90th=[ 313], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 118, per=25.16%, avg=34.21, stdev=20.72, samples=360 iops : min= 1, max= 29, avg= 7.88, stdev= 5.22, samples=360 lat (msec) : 10=0.72%, 20=10.68%, 50=45.74%, 100=25.75%, 250=16.50% lat (msec) : 500=0.59%, 2000=0.03% cpu : usr=0.06%, sys=2.08%, ctx=5076, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179956: Tue Jun 23 16:55:39 2026 read: IOPS=8, BW=32.8KiB/s (33.6kB/s)(6028KiB/183814msec) clat (msec): min=6, max=363, avg=48.13, stdev=41.98 lat (msec): min=6, max=363, avg=48.14, stdev=41.98 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 201], 99.50th=[ 234], 99.90th=[ 284], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 119, per=25.42%, avg=33.05, stdev=21.65, samples=353 iops : min= 1, max= 29, avg= 7.58, stdev= 5.45, samples=353 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6260KiB/183814msec); 0 zone resets clat (msec): min=11, max=1216, avg=70.96, stdev=55.36 lat (msec): min=11, max=1216, avg=70.97, stdev=55.36 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 81], 80.00th=[ 101], 90.00th=[ 138], 95.00th=[ 161], | 99.00th=[ 255], 99.50th=[ 279], 99.90th=[ 342], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 95, per=24.81%, avg=33.74, stdev=20.74, samples=359 iops : min= 1, max= 23, avg= 7.75, stdev= 5.23, samples=359 lat (msec) : 10=0.88%, 20=10.25%, 50=45.83%, 100=27.25%, 250=15.10% lat (msec) : 500=0.65%, 2000=0.03% cpu : usr=0.06%, sys=2.14%, ctx=5005, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179957: Tue Jun 23 16:55:39 2026 read: IOPS=8, BW=33.0KiB/s (33.8kB/s)(6052KiB/183113msec) clat (msec): min=6, max=370, avg=47.32, stdev=40.47 lat (msec): min=6, max=370, avg=47.32, stdev=40.47 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 67], 90.00th=[ 104], 95.00th=[ 136], | 99.00th=[ 194], 99.50th=[ 226], 99.90th=[ 262], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 118, per=25.83%, avg=33.58, stdev=21.90, samples=350 iops : min= 1, max= 29, avg= 7.71, stdev= 5.51, samples=350 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6236KiB/183113msec); 0 zone resets clat (msec): min=13, max=1218, avg=71.40, stdev=55.35 lat (msec): min=13, max=1218, avg=71.41, stdev=55.35 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 80], 80.00th=[ 101], 90.00th=[ 136], 95.00th=[ 169], | 99.00th=[ 255], 99.50th=[ 275], 99.90th=[ 334], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 95, per=25.01%, avg=34.01, stdev=19.80, samples=356 iops : min= 1, max= 23, avg= 7.81, stdev= 5.00, samples=356 lat (msec) : 10=0.62%, 20=9.77%, 50=46.61%, 100=27.51%, 250=14.88% lat (msec) : 500=0.59%, 2000=0.03% cpu : usr=0.07%, sys=2.17%, ctx=4941, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=130KiB/s (133kB/s), 32.2KiB/s-33.0KiB/s (32.9kB/s-33.8kB/s), io=23.4MiB (24.6MB), run=183113-184695msec WRITE: bw=136KiB/s (139kB/s), 34.1KiB/s-34.4KiB/s (34.9kB/s-35.2kB/s), io=24.6MiB (25.7MB), run=183113-184695msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180003: Tue Jun 23 16:56:28 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5920KiB/34845msec) clat (usec): min=47, max=192220, avg=50129.62, stdev=32674.77 lat (usec): min=48, max=192222, avg=50133.48, stdev=32671.99 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 1582], 20.00th=[ 26870], | 30.00th=[ 33424], 40.00th=[ 39060], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 62653], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[109577], | 99.00th=[154141], 99.50th=[168821], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 91, max= 318, per=25.71%, avg=169.72, stdev=54.85, samples=67 iops : min= 5, max= 19, avg= 9.85, stdev= 3.42, samples=67 write: IOPS=11, BW=183KiB/s (187kB/s)(6368KiB/34845msec); 0 zone resets clat (usec): min=1648, max=255363, avg=40797.21, stdev=40009.28 lat (usec): min=1651, max=255366, avg=40801.65, stdev=40009.46 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2442], 10.00th=[ 3326], 20.00th=[ 6587], | 30.00th=[ 11731], 40.00th=[ 20579], 50.00th=[ 28443], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 99091], 95.00th=[123208], | 99.00th=[152044], 99.50th=[210764], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 317, per=26.09%, avg=181.09, stdev=71.23, samples=68 iops : min= 1, max= 19, avg=10.56, stdev= 4.51, samples=68 lat (usec) : 50=0.13%, 100=4.30%, 500=0.13% lat (msec) : 2=1.95%, 4=4.69%, 10=8.33%, 20=7.81%, 50=36.46% lat (msec) : 100=27.60%, 250=8.46%, 500=0.13% cpu : usr=0.10%, sys=5.78%, ctx=1703, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180004: Tue Jun 23 16:56:28 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5744KiB/36276msec) clat (usec): min=49, max=258975, avg=54821.75, stdev=37896.08 lat (usec): min=49, max=258977, avg=54826.32, stdev=37891.41 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 76], 10.00th=[ 16712], 20.00th=[ 30540], | 30.00th=[ 35390], 40.00th=[ 40633], 50.00th=[ 48497], 60.00th=[ 56361], | 70.00th=[ 65799], 80.00th=[ 78119], 90.00th=[ 94897], 95.00th=[122160], | 99.00th=[189793], 99.50th=[242222], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 318, per=23.86%, avg=157.45, stdev=57.62, samples=71 iops : min= 1, max= 19, avg= 9.07, stdev= 3.62, samples=71 write: IOPS=11, BW=180KiB/s (185kB/s)(6544KiB/36276msec); 0 zone resets clat (usec): min=1632, max=203157, avg=40401.33, stdev=37604.16 lat (usec): min=1634, max=203158, avg=40410.70, stdev=37599.42 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2671], 10.00th=[ 4080], 20.00th=[ 8029], | 30.00th=[ 12911], 40.00th=[ 21103], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[147850], 99.50th=[158335], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 350, per=25.98%, avg=180.32, stdev=71.67, samples=71 iops : min= 1, max= 21, avg=10.52, stdev= 4.53, samples=71 lat (usec) : 50=0.13%, 100=3.39%, 250=0.52%, 500=0.26% lat (msec) : 2=1.17%, 4=4.04%, 10=7.68%, 20=8.07%, 50=35.94% lat (msec) : 100=29.69%, 250=8.98%, 500=0.13% cpu : usr=0.09%, sys=6.02%, ctx=1785, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180005: Tue Jun 23 16:56:28 2026 read: IOPS=10, BW=172KiB/s (177kB/s)(6256KiB/36273msec) clat (usec): min=44, max=308416, avg=54194.16, stdev=38078.83 lat (usec): min=44, max=308417, avg=54195.58, stdev=38078.76 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 12387], 20.00th=[ 26608], | 30.00th=[ 35914], 40.00th=[ 42730], 50.00th=[ 49546], 60.00th=[ 55837], | 70.00th=[ 63701], 80.00th=[ 77071], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[177210], 99.50th=[304088], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 32, max= 318, per=26.22%, avg=173.03, stdev=58.99, samples=71 iops : min= 2, max= 19, avg=10.06, stdev= 3.64, samples=71 write: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36273msec); 0 zone resets clat (usec): min=1650, max=299620, avg=39825.94, stdev=37466.47 lat (usec): min=1651, max=299621, avg=39840.48, stdev=37478.79 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2245], 10.00th=[ 3589], 20.00th=[ 6915], | 30.00th=[ 13435], 40.00th=[ 21627], 50.00th=[ 31065], 60.00th=[ 40109], | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 91751], 95.00th=[109577], | 99.00th=[162530], 99.50th=[193987], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 320, per=23.64%, avg=164.03, stdev=79.79, samples=71 iops : min= 1, max= 20, avg= 9.49, stdev= 5.05, samples=71 lat (usec) : 50=0.26%, 100=3.91%, 250=0.52%, 750=0.13% lat (msec) : 2=1.69%, 4=3.65%, 10=6.77%, 20=8.20%, 50=35.42% lat (msec) : 100=31.90%, 250=7.16%, 500=0.39% cpu : usr=0.06%, sys=5.95%, ctx=1790, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180006: Tue Jun 23 16:56:28 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(6032KiB/34328msec) clat (usec): min=30, max=258049, avg=52527.57, stdev=35066.07 lat (usec): min=30, max=258050, avg=52529.10, stdev=35066.03 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 174], 20.00th=[ 25822], | 30.00th=[ 33817], 40.00th=[ 41681], 50.00th=[ 47449], 60.00th=[ 56361], | 70.00th=[ 65799], 80.00th=[ 78119], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[162530], 99.50th=[173016], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 376, per=26.48%, avg=174.78, stdev=67.27, samples=67 iops : min= 1, max= 23, avg=10.18, stdev= 4.31, samples=67 write: IOPS=11, BW=182KiB/s (187kB/s)(6256KiB/34328msec); 0 zone resets clat (usec): min=1618, max=156398, avg=36986.82, stdev=34385.79 lat (usec): min=1620, max=156687, avg=36992.98, stdev=34385.90 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2540], 10.00th=[ 4293], 20.00th=[ 7373], | 30.00th=[ 10683], 40.00th=[ 16909], 50.00th=[ 27395], 60.00th=[ 36439], | 70.00th=[ 47973], 80.00th=[ 61604], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[137364], 99.50th=[147850], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 31, max= 380, per=26.34%, avg=182.79, stdev=77.66, samples=67 iops : min= 1, max= 23, avg=10.67, stdev= 4.88, samples=67 lat (usec) : 50=0.26%, 100=4.17%, 250=0.52%, 500=0.13% lat (msec) : 2=1.30%, 4=3.39%, 10=10.16%, 20=8.85%, 50=33.07% lat (msec) : 100=30.47%, 250=7.55%, 500=0.13% cpu : usr=0.08%, sys=5.60%, ctx=1642, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=660KiB/s (676kB/s), 158KiB/s-176KiB/s (162kB/s-180kB/s), io=23.4MiB (24.5MB), run=34328-36276msec WRITE: bw=695KiB/s (711kB/s), 166KiB/s-183KiB/s (170kB/s-187kB/s), io=24.6MiB (25.8MB), run=34328-36276msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179998: Tue Jun 23 16:56:44 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(5920KiB/52426msec) clat (msec): min=11, max=274, avg=55.57, stdev=43.40 lat (msec): min=11, max=274, avg=55.57, stdev=43.40 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 60], 80.00th=[ 78], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 218], 99.50th=[ 226], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 318, per=25.15%, avg=114.68, stdev=61.54, samples=100 iops : min= 1, max= 19, avg= 6.33, stdev= 3.89, samples=100 write: IOPS=7, BW=121KiB/s (124kB/s)(6368KiB/52426msec); 0 zone resets clat (msec): min=12, max=342, avg=79.65, stdev=49.45 lat (msec): min=12, max=342, avg=79.66, stdev=49.44 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 49], 40.00th=[ 56], 50.00th=[ 66], 60.00th=[ 74], | 70.00th=[ 89], 80.00th=[ 114], 90.00th=[ 155], 95.00th=[ 174], | 99.00th=[ 262], 99.50th=[ 292], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 318, per=25.29%, avg=121.39, stdev=62.34, samples=102 iops : min= 1, max= 19, avg= 6.76, stdev= 3.93, samples=102 lat (msec) : 20=5.08%, 50=42.19%, 100=32.68%, 250=19.40%, 500=0.65% cpu : usr=0.05%, sys=2.07%, ctx=1303, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179999: Tue Jun 23 16:56:44 2026 read: IOPS=6, BW=111KiB/s (113kB/s)(5744KiB/51977msec) clat (msec): min=9, max=249, avg=51.71, stdev=38.92 lat (msec): min=9, max=249, avg=51.72, stdev=38.92 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 107], 95.00th=[ 146], | 99.00th=[ 197], 99.50th=[ 211], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 318, per=25.42%, avg=115.92, stdev=70.82, samples=96 iops : min= 1, max= 19, avg= 6.42, stdev= 4.48, samples=96 write: IOPS=7, BW=126KiB/s (129kB/s)(6544KiB/51977msec); 0 zone resets clat (msec): min=16, max=459, avg=81.23, stdev=53.98 lat (msec): min=16, max=459, avg=81.23, stdev=53.98 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 78], | 70.00th=[ 92], 80.00th=[ 116], 90.00th=[ 161], 95.00th=[ 186], | 99.00th=[ 243], 99.50th=[ 264], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 31, max= 383, per=26.13%, avg=125.45, stdev=63.99, samples=101 iops : min= 1, max= 23, avg= 7.02, stdev= 4.02, samples=101 lat (msec) : 10=0.26%, 20=5.86%, 50=43.88%, 100=30.60%, 250=19.01% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.05%, ctx=1301, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180000: Tue Jun 23 16:56:44 2026 read: IOPS=7, BW=121KiB/s (123kB/s)(6256KiB/51896msec) clat (msec): min=9, max=275, avg=54.90, stdev=41.10 lat (msec): min=9, max=275, avg=54.90, stdev=41.10 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 78], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 268], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 347, per=27.17%, avg=123.89, stdev=74.37, samples=99 iops : min= 1, max= 21, avg= 6.99, stdev= 4.70, samples=99 write: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/51896msec); 0 zone resets clat (msec): min=19, max=420, avg=80.56, stdev=51.95 lat (msec): min=19, max=420, avg=80.56, stdev=51.95 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 109], 90.00th=[ 148], 95.00th=[ 190], | 99.00th=[ 262], 99.50th=[ 284], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 31, max= 319, per=24.54%, avg=117.81, stdev=57.50, samples=100 iops : min= 1, max= 19, avg= 6.60, stdev= 3.65, samples=100 lat (msec) : 10=0.13%, 20=5.21%, 50=41.67%, 100=34.51%, 250=17.58% lat (msec) : 500=0.91% cpu : usr=0.06%, sys=2.00%, ctx=1295, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180001: Tue Jun 23 16:56:44 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(6032KiB/51611msec) clat (msec): min=9, max=258, avg=54.24, stdev=40.81 lat (msec): min=9, max=258, avg=54.24, stdev=40.81 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 48], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 222], 99.50th=[ 236], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 351, per=25.84%, avg=117.83, stdev=70.46, samples=99 iops : min= 1, max= 21, avg= 6.61, stdev= 4.48, samples=99 write: IOPS=7, BW=121KiB/s (124kB/s)(6256KiB/51611msec); 0 zone resets clat (msec): min=19, max=450, avg=79.24, stdev=52.80 lat (msec): min=19, max=450, avg=79.24, stdev=52.80 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 77], | 70.00th=[ 90], 80.00th=[ 112], 90.00th=[ 138], 95.00th=[ 186], | 99.00th=[ 292], 99.50th=[ 342], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 31, max= 351, per=25.17%, avg=120.83, stdev=64.44, samples=101 iops : min= 1, max= 21, avg= 6.78, stdev= 4.07, samples=101 lat (msec) : 10=0.26%, 20=4.56%, 50=43.23%, 100=33.07%, 250=17.97% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=2.06%, ctx=1275, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=457KiB/s (468kB/s), 111KiB/s-121KiB/s (113kB/s-123kB/s), io=23.4MiB (24.5MB), run=51611-52426msec WRITE: bw=481KiB/s (492kB/s), 116KiB/s-126KiB/s (119kB/s-129kB/s), io=24.6MiB (25.8MB), run=51611-52426msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180019: Tue Jun 23 16:57:00 2026 read: IOPS=1, BW=1653KiB/s (1692kB/s)(7168KiB/4337msec) clat (msec): min=77, max=344, avg=192.27, stdev=104.71 lat (msec): min=77, max=344, avg=192.28, stdev=104.71 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 148], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 284], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1973, max= 4407, per=60.62%, avg=2601.75, stdev=1203.74, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1181KiB/s (1209kB/s)(5120KiB/4337msec); 0 zone resets clat (msec): min=306, max=1521, avg=589.99, stdev=522.69 lat (msec): min=306, max=1521, avg=590.17, stdev=522.77 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1973, max= 3886, per=43.57%, avg=2618.33, stdev=1097.89, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=16.67%, 500=58.33%, 2000=8.33% cpu : usr=0.02%, sys=3.64%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180020: Tue Jun 23 16:57:00 2026 read: IOPS=0, BW=429KiB/s (440kB/s)(2048KiB/4771msec) clat (msec): min=146, max=850, avg=498.70, stdev=498.22 lat (msec): min=146, max=850, avg=498.70, stdev=498.22 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1376, max= 1865, per=37.76%, avg=1620.50, stdev=345.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2146KiB/s (2198kB/s)(10.0MiB/4771msec); 0 zone resets clat (msec): min=97, max=1042, avg=371.68, stdev=293.49 lat (msec): min=97, max=1042, avg=372.00, stdev=293.46 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 106], | 30.00th=[ 118], 40.00th=[ 253], 50.00th=[ 255], 60.00th=[ 326], | 70.00th=[ 376], 80.00th=[ 531], 90.00th=[ 617], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1376, max= 5988, per=50.39%, avg=3028.00, stdev=1884.24, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=5.14%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180021: Tue Jun 23 16:57:00 2026 read: IOPS=1, BW=1289KiB/s (1320kB/s)(6144KiB/4767msec) clat (msec): min=86, max=890, avg=363.56, stdev=383.49 lat (msec): min=86, max=890, avg=363.57, stdev=383.49 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 167], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1892, max= 4063, per=58.11%, avg=2494.00, stdev=1047.94, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1289KiB/s (1320kB/s)(6144KiB/4767msec); 0 zone resets clat (msec): min=203, max=611, avg=423.86, stdev=162.16 lat (msec): min=203, max=611, avg=423.95, stdev=162.15 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 498], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1471, max= 2048, per=31.58%, avg=1897.80, stdev=241.94, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=4.87%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180022: Tue Jun 23 16:57:00 2026 read: IOPS=1, BW=1321KiB/s (1352kB/s)(5120KiB/3877msec) clat (msec): min=105, max=907, avg=320.32, stdev=332.19 lat (msec): min=105, max=907, avg=320.32, stdev=332.19 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1865, max= 3946, per=60.22%, avg=2584.67, stdev=1179.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1849KiB/s (1893kB/s)(7168KiB/3877msec); 0 zone resets clat (msec): min=144, max=593, avg=321.45, stdev=182.24 lat (msec): min=144, max=594, avg=321.62, stdev=182.35 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 176], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 275], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 550], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1479, max= 5678, per=54.83%, avg=3295.00, stdev=1920.07, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.37%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4293KiB/s (4396kB/s), 429KiB/s-1653KiB/s (440kB/s-1692kB/s), io=20.0MiB (20.0MB), run=3877-4771msec WRITE: bw=6010KiB/s (6154kB/s), 1181KiB/s-2146KiB/s (1209kB/s-2198kB/s), io=28.0MiB (29.4MB), run=3877-4771msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180024: Tue Jun 23 16:57:00 2026 read: IOPS=1, BW=1717KiB/s (1758kB/s)(7168KiB/4175msec) clat (usec): min=596, max=454762, avg=270409.98, stdev=160773.30 lat (usec): min=597, max=454763, avg=270411.36, stdev=160773.56 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[189793], | 30.00th=[193987], 40.00th=[193987], 50.00th=[261096], 60.00th=[350225], | 70.00th=[350225], 80.00th=[442500], 90.00th=[455082], 95.00th=[455082], | 99.00th=[455082], 99.50th=[455082], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 1851, max= 3900, per=52.20%, avg=2335.40, stdev=877.79, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1226KiB/s (1256kB/s)(5120KiB/4175msec); 0 zone resets clat (msec): min=172, max=1174, avg=456.15, stdev=410.20 lat (msec): min=172, max=1174, avg=456.25, stdev=410.19 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1950, max= 3038, per=37.24%, avg=2333.00, stdev=611.31, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=50.00%, 2000=8.33% cpu : usr=0.00%, sys=13.39%, ctx=147, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180025: Tue Jun 23 16:57:00 2026 read: IOPS=0, BW=447KiB/s (458kB/s)(2048KiB/4577msec) clat (msec): min=186, max=236, avg=211.39, stdev=35.42 lat (msec): min=186, max=236, avg=211.39, stdev=35.43 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 1777, max= 2048, per=42.75%, avg=1912.50, stdev=191.63, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2237KiB/s (2291kB/s)(10.0MiB/4577msec); 0 zone resets clat (msec): min=135, max=1007, avg=414.82, stdev=255.56 lat (msec): min=137, max=1007, avg=415.10, stdev=255.43 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 211], | 30.00th=[ 215], 40.00th=[ 249], 50.00th=[ 338], 60.00th=[ 414], | 70.00th=[ 485], 80.00th=[ 527], 90.00th=[ 575], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1519, max= 4096, per=35.44%, avg=2219.86, stdev=846.89, samples=7 iops : min= 1, max= 4, avg= 1.57, stdev= 1.13, samples=7 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.11%, sys=15.23%, ctx=185, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180026: Tue Jun 23 16:57:00 2026 read: IOPS=1, BW=1590KiB/s (1629kB/s)(6144KiB/3863msec) clat (usec): min=504, max=190843, avg=32804.89, stdev=77425.70 lat (usec): min=505, max=190845, avg=32806.11, stdev=77425.71 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 742], | 30.00th=[ 742], 40.00th=[ 807], 50.00th=[ 807], 60.00th=[ 1795], | 70.00th=[ 2147], 80.00th=[ 2147], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 2048, max= 3785, per=66.09%, avg=2957.00, stdev=871.33, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 write: IOPS=1, BW=1590KiB/s (1629kB/s)(6144KiB/3863msec); 0 zone resets clat (msec): min=230, max=954, avg=610.57, stdev=238.89 lat (msec): min=230, max=954, avg=610.67, stdev=238.89 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 642], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1519, max= 4096, per=36.45%, avg=2283.00, stdev=1030.72, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=16.67%, 750=33.33%, 1000=8.33% cpu : usr=0.03%, sys=10.33%, ctx=114, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180027: Tue Jun 23 16:57:00 2026 read: IOPS=1, BW=1333KiB/s (1365kB/s)(5120KiB/3841msec) clat (usec): min=570, max=415699, avg=146963.04, stdev=179650.97 lat (usec): min=572, max=415701, avg=146964.55, stdev=179651.29 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 2008], 40.00th=[ 2008], 50.00th=[ 73925], 60.00th=[ 73925], | 70.00th=[242222], 80.00th=[242222], 90.00th=[417334], 95.00th=[417334], | 99.00th=[417334], 99.50th=[417334], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 6077, max= 6077, per=100.00%, avg=6077.00, stdev= 0.00, samples=1 iops : min= 5, max= 5, avg= 5.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1866KiB/s (1911kB/s)(7168KiB/3841msec); 0 zone resets clat (msec): min=132, max=799, avg=442.79, stdev=223.10 lat (msec): min=132, max=801, avg=443.17, stdev=223.69 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 220], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 468], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 575], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1892, max= 4023, per=38.11%, avg=2387.20, stdev=916.50, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=13.41%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4475KiB/s (4582kB/s), 447KiB/s-1717KiB/s (458kB/s-1758kB/s), io=20.0MiB (20.0MB), run=3841-4577msec WRITE: bw=6264KiB/s (6415kB/s), 1226KiB/s-2237KiB/s (1256kB/s-2291kB/s), io=28.0MiB (29.4MB), run=3841-4577msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180038: Tue Jun 23 16:57:15 2026 read: IOPS=1, BW=4414KiB/s (4520kB/s)(12.0MiB/2784msec) clat (msec): min=648, max=1014, avg=863.43, stdev=190.76 lat (msec): min=648, max=1014, avg=863.43, stdev=190.76 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.15%, ctx=454, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180040: Tue Jun 23 16:57:15 2026 read: IOPS=0, BW=1606KiB/s (1645kB/s)(4096KiB/2550msec) clat (nsec): min=897264k, max=897264k, avg=897263629.00, stdev= 0.00 lat (nsec): min=897267k, max=897267k, avg=897266551.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3213KiB/s (3290kB/s)(8192KiB/2550msec); 0 zone resets clat (msec): min=631, max=909, avg=770.46, stdev=196.91 lat (msec): min=632, max=910, avg=771.44, stdev=196.09 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7937, max= 7937, per=88.27%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.71%, ctx=119, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180041: Tue Jun 23 16:57:15 2026 write: IOPS=0, BW=3372KiB/s (3453kB/s)(12.0MiB/3644msec); 0 zone resets clat (msec): min=544, max=2207, avg=1188.61, stdev=892.45 lat (msec): min=545, max=2208, avg=1189.80, stdev=892.16 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 7892, max= 8000, per=88.37%, avg=7946.00, stdev=76.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.82%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180042: Tue Jun 23 16:57:15 2026 write: IOPS=0, BW=3548KiB/s (3634kB/s)(12.0MiB/3463msec); 0 zone resets clat (msec): min=885, max=1564, avg=1131.89, stdev=375.42 lat (msec): min=886, max=1564, avg=1133.15, stdev=374.80 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7937, max= 8175, per=89.59%, avg=8056.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.60%, ctx=75, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5885KiB/s (6026kB/s), 1606KiB/s-4414KiB/s (1645kB/s-4520kB/s), io=16.0MiB (16.8MB), run=2550-2784msec WRITE: bw=8992KiB/s (9208kB/s), 3213KiB/s-3548KiB/s (3290kB/s-3634kB/s), io=32.0MiB (33.6MB), run=2550-3644msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180035: Tue Jun 23 16:57:16 2026 read: IOPS=1, BW=7484KiB/s (7663kB/s)(12.0MiB/1642msec) clat (msec): min=269, max=818, avg=491.47, stdev=289.01 lat (msec): min=269, max=818, avg=491.47, stdev=289.01 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 5893, max= 7937, per=100.00%, avg=6915.00, stdev=1445.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=8.10%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180036: Tue Jun 23 16:57:16 2026 read: IOPS=0, BW=1145KiB/s (1173kB/s)(4096KiB/3577msec) clat (nsec): min=1112.3M, max=1112.3M, avg=1112349106.00, stdev= 0.00 lat (nsec): min=1112.3M, max=1112.3M, avg=1112350046.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2290KiB/s (2345kB/s)(8192KiB/3577msec); 0 zone resets clat (msec): min=385, max=1963, avg=1174.52, stdev=1116.10 lat (msec): min=385, max=1964, avg=1175.00, stdev=1115.99 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 1972], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.07%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180037: Tue Jun 23 16:57:16 2026 write: IOPS=0, BW=3134KiB/s (3209kB/s)(12.0MiB/3921msec); 0 zone resets clat (msec): min=179, max=3136, avg=1288.72, stdev=1611.18 lat (msec): min=180, max=3138, avg=1290.99, stdev=1610.58 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 8062, max= 8062, per=96.47%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.27%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180039: Tue Jun 23 16:57:16 2026 write: IOPS=1, BW=4351KiB/s (4456kB/s)(12.0MiB/2824msec); 0 zone resets clat (msec): min=448, max=1601, avg=864.26, stdev=640.00 lat (msec): min=452, max=1601, avg=866.18, stdev=638.85 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 5468, max= 7937, per=80.20%, avg=6702.50, stdev=1745.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.35%, ctx=75, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4580KiB/s (4690kB/s), 1145KiB/s-7484KiB/s (1173kB/s-7663kB/s), io=16.0MiB (16.8MB), run=1642-3577msec WRITE: bw=8357KiB/s (8558kB/s), 2290KiB/s-4351KiB/s (2345kB/s-4456kB/s), io=32.0MiB (33.6MB), run=2824-3921msec