== sanity test 398b: DIO and buffer IO race ============== 23:08:52 (1787800132) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.45675 s, 9.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179359: Wed Aug 26 23:11:28 2026 read: IOPS=10, BW=43.4KiB/s (44.5kB/s)(5992KiB/137947msec) clat (usec): min=50, max=1123.0k, avg=51237.44, stdev=43623.62 lat (usec): min=51, max=1123.0k, avg=51241.03, stdev=43623.33 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 12911], 10.00th=[ 19006], | 20.00th=[ 25822], 30.00th=[ 31065], 40.00th=[ 36963], | 50.00th=[ 42730], 60.00th=[ 49546], 70.00th=[ 58459], | 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[ 114820], | 99.00th=[ 175113], 99.50th=[ 198181], 99.90th=[ 263193], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 5, max= 95, per=24.80%, avg=43.14, stdev=17.48, samples=271 iops : min= 1, max= 23, avg=10.12, stdev= 4.42, samples=271 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6296KiB/137947msec); 0 zone resets clat (usec): min=1001, max=294780, avg=38600.62, stdev=40109.51 lat (usec): min=1002, max=294782, avg=38609.10, stdev=40108.39 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 1876], 20.00th=[ 4490], | 30.00th=[ 8848], 40.00th=[ 17433], 50.00th=[ 26870], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 65799], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[170918], 99.50th=[214959], 99.90th=[250610], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 119, per=25.08%, avg=45.65, stdev=21.09, samples=269 iops : min= 1, max= 29, avg=10.75, stdev= 5.31, samples=269 lat (usec) : 100=1.63%, 250=0.10%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.44%, 4=4.20%, 10=6.77%, 20=8.98%, 50=38.09% lat (msec) : 100=26.43%, 250=8.14%, 500=0.13%, 2000=0.03% cpu : usr=0.09%, sys=5.02%, ctx=6760, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179360: Wed Aug 26 23:11:28 2026 read: IOPS=10, BW=43.3KiB/s (44.4kB/s)(5940KiB/137110msec) clat (usec): min=47, max=419445, avg=50139.73, stdev=33807.81 lat (usec): min=47, max=419446, avg=50149.92, stdev=33820.81 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 13042], 10.00th=[ 18744], 20.00th=[ 25297], | 30.00th=[ 30540], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[164627], 99.50th=[177210], 99.90th=[287310], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 5, max= 102, per=24.88%, avg=43.30, stdev=18.28, samples=267 iops : min= 1, max= 25, avg=10.16, stdev= 4.59, samples=267 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6348KiB/137110msec); 0 zone resets clat (usec): min=936, max=1073.5k, avg=39157.18, stdev=47536.65 lat (usec): min=937, max=1073.5k, avg=39163.60, stdev=47541.58 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1401], 10.00th=[ 1975], | 20.00th=[ 4490], 30.00th=[ 8848], 40.00th=[ 18482], | 50.00th=[ 27919], 60.00th=[ 37487], 70.00th=[ 49021], | 80.00th=[ 64226], 90.00th=[ 93848], 95.00th=[ 117965], | 99.00th=[ 177210], 99.50th=[ 202376], 99.90th=[ 263193], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 127, per=25.38%, avg=46.19, stdev=21.06, samples=267 iops : min= 1, max= 31, avg=10.89, stdev= 5.30, samples=267 lat (usec) : 50=0.07%, 100=1.46%, 250=0.16%, 500=0.07%, 1000=0.07% lat (msec) : 2=5.21%, 4=4.10%, 10=7.06%, 20=9.02%, 50=37.70% lat (msec) : 100=27.25%, 250=7.71%, 500=0.10%, 2000=0.03% cpu : usr=0.09%, sys=5.10%, ctx=6656, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179361: Wed Aug 26 23:11:28 2026 read: IOPS=11, BW=44.2KiB/s (45.2kB/s)(6028KiB/136438msec) clat (usec): min=35, max=1097.5k, avg=51374.22, stdev=42899.45 lat (usec): min=35, max=1097.5k, avg=51380.75, stdev=42900.91 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 13698], 10.00th=[ 19530], | 20.00th=[ 26608], 30.00th=[ 32113], 40.00th=[ 37487], | 50.00th=[ 44303], 60.00th=[ 50594], 70.00th=[ 58459], | 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[ 111674], | 99.00th=[ 168821], 99.50th=[ 206570], 99.90th=[ 295699], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 5, max= 103, per=25.24%, avg=43.92, stdev=17.50, samples=268 iops : min= 1, max= 25, avg=10.32, stdev= 4.40, samples=268 write: IOPS=11, BW=45.9KiB/s (46.0kB/s)(6260KiB/136438msec); 0 zone resets clat (usec): min=1009, max=235661, avg=37427.56, stdev=38672.64 lat (usec): min=1011, max=235663, avg=37430.69, stdev=38672.10 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1401], 10.00th=[ 2311], 20.00th=[ 5014], | 30.00th=[ 8848], 40.00th=[ 17695], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 62653], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[175113], 99.50th=[198181], 99.90th=[223347], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 134, per=25.32%, avg=46.09, stdev=21.13, samples=265 iops : min= 1, max= 33, avg=10.87, stdev= 5.32, samples=265 lat (usec) : 50=0.07%, 100=1.43%, 250=0.23% lat (msec) : 2=4.43%, 4=4.49%, 10=7.55%, 20=8.85%, 50=38.64% lat (msec) : 100=26.69%, 250=7.45%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=5.03%, ctx=6641, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179362: Wed Aug 26 23:11:28 2026 read: IOPS=11, BW=44.1KiB/s (45.1kB/s)(6052KiB/137283msec) clat (usec): min=47, max=464486, avg=50998.91, stdev=35656.95 lat (usec): min=48, max=464487, avg=51010.19, stdev=35656.04 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 13829], 10.00th=[ 19268], 20.00th=[ 26084], | 30.00th=[ 31589], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[173016], 99.50th=[187696], 99.90th=[299893], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 110, per=25.39%, avg=44.19, stdev=18.09, samples=267 iops : min= 1, max= 27, avg=10.39, stdev= 4.56, samples=267 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6236KiB/137283msec); 0 zone resets clat (usec): min=1018, max=917075, avg=38248.23, stdev=45534.49 lat (usec): min=1019, max=917076, avg=38256.29, stdev=45535.00 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 1876], 20.00th=[ 4490], | 30.00th=[ 8455], 40.00th=[ 16319], 50.00th=[ 25035], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 65274], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[166724], 99.50th=[183501], 99.90th=[258999], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 103, per=24.80%, avg=45.13, stdev=20.21, samples=269 iops : min= 1, max= 25, avg=10.62, stdev= 5.08, samples=269 lat (usec) : 50=0.03%, 100=1.40%, 250=0.10%, 500=0.07%, 750=0.07% lat (msec) : 2=5.47%, 4=3.97%, 10=7.49%, 20=9.51%, 50=38.09% lat (msec) : 100=25.39%, 250=8.24%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=4.95%, ctx=6711, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.3KiB/s-44.2KiB/s (44.4kB/s-45.2kB/s), io=23.4MiB (24.6MB), run=136438-137947msec WRITE: bw=182KiB/s (187kB/s), 45.4KiB/s-46.3KiB/s (46.5kB/s-47.4kB/s), io=24.6MiB (25.7MB), run=136438-137947msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179363: Wed Aug 26 23:12:11 2026 read: IOPS=8, BW=33.2KiB/s (34.0kB/s)(5992KiB/180315msec) clat (msec): min=5, max=1107, avg=48.09, stdev=51.94 lat (msec): min=5, max=1107, avg=48.09, stdev=51.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 108], 95.00th=[ 144], | 99.00th=[ 228], 99.50th=[ 249], 99.90th=[ 418], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 135, per=25.43%, avg=33.82, stdev=23.71, samples=343 iops : min= 1, max= 33, avg= 7.76, stdev= 5.94, samples=343 write: IOPS=8, BW=34.9KiB/s (35.8kB/s)(6296KiB/180315msec); 0 zone resets clat (msec): min=12, max=530, avg=68.58, stdev=50.41 lat (msec): min=12, max=530, avg=68.59, stdev=50.41 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 78], 80.00th=[ 99], 90.00th=[ 134], 95.00th=[ 167], | 99.00th=[ 255], 99.50th=[ 292], 99.90th=[ 414], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 118, per=25.26%, avg=35.11, stdev=22.34, samples=347 iops : min= 1, max= 29, avg= 8.09, stdev= 5.62, samples=347 lat (msec) : 10=1.60%, 20=12.43%, 50=45.15%, 100=25.75%, 250=14.26% lat (msec) : 500=0.75%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.71%, ctx=4666, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179364: Wed Aug 26 23:12:11 2026 read: IOPS=8, BW=33.1KiB/s (33.9kB/s)(5940KiB/179324msec) clat (msec): min=5, max=945, avg=46.31, stdev=48.29 lat (msec): min=5, max=945, avg=46.31, stdev=48.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 68], 90.00th=[ 104], 95.00th=[ 134], | 99.00th=[ 222], 99.50th=[ 253], 99.90th=[ 305], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 143, per=25.63%, avg=34.08, stdev=24.35, samples=338 iops : min= 1, max= 35, avg= 7.82, stdev= 6.11, samples=338 write: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6348KiB/179324msec); 0 zone resets clat (msec): min=12, max=527, avg=69.45, stdev=51.39 lat (msec): min=12, max=527, avg=69.46, stdev=51.39 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 81], 80.00th=[ 104], 90.00th=[ 133], 95.00th=[ 161], | 99.00th=[ 268], 99.50th=[ 330], 99.90th=[ 418], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 126, per=25.42%, avg=35.33, stdev=22.04, samples=348 iops : min= 1, max= 31, avg= 8.14, stdev= 5.54, samples=348 lat (msec) : 10=1.76%, 20=13.35%, 50=44.11%, 100=24.67%, 250=15.20% lat (msec) : 500=0.85%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.76%, ctx=4754, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179365: Wed Aug 26 23:12:11 2026 read: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6028KiB/179056msec) clat (msec): min=5, max=413, avg=47.24, stdev=44.75 lat (msec): min=5, max=413, avg=47.25, stdev=44.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 69], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 222], 99.50th=[ 264], 99.90th=[ 326], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 119, per=25.58%, avg=34.02, stdev=22.66, samples=344 iops : min= 1, max= 29, avg= 7.81, stdev= 5.69, samples=344 write: IOPS=8, BW=34.0KiB/s (35.8kB/s)(6260KiB/179056msec); 0 zone resets clat (msec): min=12, max=885, avg=68.65, stdev=53.96 lat (msec): min=12, max=885, avg=68.65, stdev=53.96 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 79], 80.00th=[ 100], 90.00th=[ 132], 95.00th=[ 169], | 99.00th=[ 264], 99.50th=[ 330], 99.90th=[ 414], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 127, per=25.28%, avg=35.14, stdev=22.57, samples=346 iops : min= 1, max= 31, avg= 8.10, stdev= 5.67, samples=346 lat (msec) : 10=2.05%, 20=12.50%, 50=44.66%, 100=25.20%, 250=14.71% lat (msec) : 500=0.85%, 1000=0.03% cpu : usr=0.06%, sys=1.73%, ctx=4701, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179366: Wed Aug 26 23:12:11 2026 read: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6052KiB/180208msec) clat (msec): min=6, max=325, avg=47.67, stdev=44.27 lat (msec): min=6, max=325, avg=47.68, stdev=44.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 112], 95.00th=[ 142], | 99.00th=[ 203], 99.50th=[ 245], 99.90th=[ 309], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 167, per=25.96%, avg=34.52, stdev=24.87, samples=340 iops : min= 1, max= 41, avg= 7.94, stdev= 6.24, samples=340 write: IOPS=8, BW=34.6KiB/s (35.4kB/s)(6236KiB/180208msec); 0 zone resets clat (msec): min=14, max=910, avg=69.04, stdev=56.04 lat (msec): min=14, max=910, avg=69.04, stdev=56.04 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 101], 90.00th=[ 136], 95.00th=[ 169], | 99.00th=[ 268], 99.50th=[ 330], 99.90th=[ 485], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 120, per=24.90%, avg=34.61, stdev=22.42, samples=349 iops : min= 1, max= 30, avg= 7.96, stdev= 5.64, samples=349 lat (msec) : 10=2.15%, 20=13.18%, 50=43.72%, 100=24.87%, 250=15.20% lat (msec) : 500=0.85%, 1000=0.03% cpu : usr=0.07%, sys=1.73%, ctx=4814, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=133KiB/s (136kB/s), 33.1KiB/s-33.7KiB/s (33.9kB/s-34.5kB/s), io=23.4MiB (24.6MB), run=179056-180315msec WRITE: bw=139KiB/s (143kB/s), 34.6KiB/s-35.4KiB/s (35.4kB/s-36.2kB/s), io=24.6MiB (25.7MB), run=179056-180315msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179411: Wed Aug 26 23:12:52 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(5920KiB/30453msec) clat (usec): min=40, max=175095, avg=43019.34, stdev=28277.78 lat (usec): min=40, max=175096, avg=43020.80, stdev=28277.83 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 80], 10.00th=[ 363], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 62653], 90.00th=[ 76022], 95.00th=[ 87557], | 99.00th=[147850], 99.50th=[158335], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 476, per=25.89%, avg=193.65, stdev=79.26, samples=60 iops : min= 1, max= 29, avg=11.42, stdev= 4.99, samples=60 write: IOPS=13, BW=209KiB/s (214kB/s)(6368KiB/30453msec); 0 zone resets clat (usec): min=1356, max=172629, avg=36101.81, stdev=35208.94 lat (usec): min=1360, max=172631, avg=36105.50, stdev=35207.89 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2376], 10.00th=[ 3228], 20.00th=[ 5407], | 30.00th=[ 8455], 40.00th=[ 15270], 50.00th=[ 23987], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 65274], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[145753], 99.50th=[154141], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 63, max= 539, per=26.58%, avg=209.17, stdev=86.73, samples=60 iops : min= 3, max= 33, avg=12.38, stdev= 5.43, samples=60 lat (usec) : 50=0.52%, 100=3.39%, 250=0.78%, 500=0.39% lat (msec) : 2=1.43%, 4=6.25%, 10=9.77%, 20=9.11%, 50=37.50% lat (msec) : 100=25.91%, 250=4.95% cpu : usr=0.10%, sys=6.34%, ctx=1705, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179412: Wed Aug 26 23:12:52 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(5744KiB/31946msec) clat (usec): min=52, max=262103, avg=48692.73, stdev=32475.66 lat (usec): min=53, max=262105, avg=48700.13, stdev=32479.20 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 82], 10.00th=[ 17433], 20.00th=[ 26346], | 30.00th=[ 32113], 40.00th=[ 36963], 50.00th=[ 45876], 60.00th=[ 50070], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[105382], | 99.00th=[143655], 99.50th=[231736], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 63, max= 348, per=24.08%, avg=180.11, stdev=55.96, samples=63 iops : min= 3, max= 21, avg=10.54, stdev= 3.52, samples=63 write: IOPS=12, BW=205KiB/s (210kB/s)(6544KiB/31946msec); 0 zone resets clat (usec): min=1504, max=193618, avg=35204.99, stdev=35001.53 lat (usec): min=1507, max=193621, avg=35207.42, stdev=35001.49 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2802], 10.00th=[ 4047], 20.00th=[ 6128], | 30.00th=[ 9896], 40.00th=[ 15139], 50.00th=[ 24773], 60.00th=[ 33162], | 70.00th=[ 43779], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[106431], | 99.00th=[154141], 99.50th=[175113], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 480, per=25.91%, avg=203.92, stdev=92.17, samples=63 iops : min= 1, max= 30, avg=12.05, stdev= 5.83, samples=63 lat (usec) : 100=3.39%, 250=0.65%, 500=0.13% lat (msec) : 2=1.04%, 4=4.17%, 10=10.81%, 20=9.77%, 50=38.28% lat (msec) : 100=26.17%, 250=5.47%, 500=0.13% cpu : usr=0.09%, sys=6.33%, ctx=1750, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179413: Wed Aug 26 23:12:52 2026 read: IOPS=12, BW=196KiB/s (200kB/s)(6256KiB/31996msec) clat (usec): min=50, max=175617, avg=45448.27, stdev=30215.17 lat (usec): min=51, max=175618, avg=45450.13, stdev=30215.14 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 72], 10.00th=[ 12387], 20.00th=[ 24773], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 64750], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[160433], 99.50th=[175113], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 63, max= 443, per=26.09%, avg=195.14, stdev=74.84, samples=63 iops : min= 3, max= 27, avg=11.49, stdev= 4.69, samples=63 write: IOPS=11, BW=189KiB/s (193kB/s)(6032KiB/31996msec); 0 zone resets clat (usec): min=1438, max=212518, avg=37273.63, stdev=38398.09 lat (usec): min=1441, max=212519, avg=37282.39, stdev=38396.59 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2540], 10.00th=[ 3785], 20.00th=[ 6652], | 30.00th=[ 9241], 40.00th=[ 15401], 50.00th=[ 25822], 60.00th=[ 34341], | 70.00th=[ 45876], 80.00th=[ 61080], 90.00th=[ 91751], 95.00th=[120062], | 99.00th=[175113], 99.50th=[204473], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 63, max= 347, per=23.59%, avg=185.62, stdev=68.87, samples=63 iops : min= 3, max= 21, avg=10.87, stdev= 4.35, samples=63 lat (usec) : 100=4.04%, 250=0.39%, 500=0.26% lat (msec) : 2=1.56%, 4=3.78%, 10=10.29%, 20=8.20%, 50=40.62% lat (msec) : 100=24.87%, 250=5.99% cpu : usr=0.09%, sys=5.87%, ctx=1700, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179414: Wed Aug 26 23:12:52 2026 read: IOPS=11, BW=191KiB/s (195kB/s)(6032KiB/31631msec) clat (usec): min=42, max=207671, avg=45970.91, stdev=31714.25 lat (usec): min=42, max=207672, avg=45972.95, stdev=31714.17 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 67], 10.00th=[ 86], 20.00th=[ 22938], | 30.00th=[ 31851], 40.00th=[ 34866], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[166724], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 379, per=25.36%, avg=189.68, stdev=73.36, samples=62 iops : min= 1, max= 23, avg=11.15, stdev= 4.64, samples=62 write: IOPS=12, BW=198KiB/s (203kB/s)(6256KiB/31631msec); 0 zone resets clat (usec): min=1548, max=173656, avg=36147.83, stdev=35243.34 lat (usec): min=1549, max=173657, avg=36154.29, stdev=35241.85 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2442], 10.00th=[ 3949], 20.00th=[ 6128], | 30.00th=[ 9503], 40.00th=[ 15533], 50.00th=[ 25560], 60.00th=[ 33424], | 70.00th=[ 46924], 80.00th=[ 65274], 90.00th=[ 94897], 95.00th=[111674], | 99.00th=[137364], 99.50th=[162530], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 382, per=25.20%, avg=198.31, stdev=73.74, samples=62 iops : min= 1, max= 23, avg=11.68, stdev= 4.60, samples=62 lat (usec) : 50=0.13%, 100=5.21%, 250=0.52%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.56%, 4=4.17%, 10=10.29%, 20=9.11%, 50=37.11% lat (msec) : 100=25.65%, 250=5.86% cpu : usr=0.07%, sys=6.00%, ctx=1681, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=749KiB/s (767kB/s), 180KiB/s-196KiB/s (184kB/s-200kB/s), io=23.4MiB (24.5MB), run=30453-31996msec WRITE: bw=788KiB/s (807kB/s), 189KiB/s-209KiB/s (193kB/s-214kB/s), io=24.6MiB (25.8MB), run=30453-31996msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179416: Wed Aug 26 23:13:04 2026 read: IOPS=8, BW=137KiB/s (141kB/s)(5920KiB/43068msec) clat (msec): min=7, max=251, avg=47.03, stdev=43.74 lat (msec): min=7, max=251, avg=47.03, stdev=43.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 114], 95.00th=[ 157], | 99.00th=[ 209], 99.50th=[ 222], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 413, per=24.79%, avg=136.82, stdev=86.50, samples=83 iops : min= 1, max= 25, avg= 7.76, stdev= 5.48, samples=83 write: IOPS=9, BW=148KiB/s (151kB/s)(6368KiB/43068msec); 0 zone resets clat (msec): min=14, max=331, avg=63.97, stdev=41.45 lat (msec): min=14, max=331, avg=63.97, stdev=41.46 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 124], 95.00th=[ 140], | 99.00th=[ 207], 99.50th=[ 234], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 22, max= 412, per=25.30%, avg=147.00, stdev=93.93, samples=84 iops : min= 1, max= 25, avg= 8.38, stdev= 5.98, samples=84 lat (msec) : 10=1.56%, 20=12.63%, 50=46.35%, 100=23.96%, 250=15.23% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.93%, ctx=1201, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179417: Wed Aug 26 23:13:04 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(5744KiB/43318msec) clat (msec): min=6, max=291, avg=43.59, stdev=41.78 lat (msec): min=6, max=291, avg=43.59, stdev=41.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 107], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 266], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 23, max= 377, per=24.46%, avg=135.00, stdev=93.55, samples=83 iops : min= 1, max= 23, avg= 7.63, stdev= 5.94, samples=83 write: IOPS=9, BW=151KiB/s (155kB/s)(6544KiB/43318msec); 0 zone resets clat (msec): min=15, max=268, avg=67.30, stdev=47.17 lat (msec): min=15, max=268, avg=67.31, stdev=47.17 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 75], 80.00th=[ 101], 90.00th=[ 133], 95.00th=[ 163], | 99.00th=[ 234], 99.50th=[ 241], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 446, per=25.88%, avg=150.38, stdev=92.35, samples=85 iops : min= 1, max= 27, avg= 8.60, stdev= 5.86, samples=85 lat (msec) : 10=1.04%, 20=14.19%, 50=45.96%, 100=22.79%, 250=15.63% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.92%, ctx=1277, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179418: Wed Aug 26 23:13:04 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(6256KiB/42474msec) clat (msec): min=6, max=234, avg=45.20, stdev=39.96 lat (msec): min=6, max=234, avg=45.20, stdev=39.96 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 106], 95.00th=[ 128], | 99.00th=[ 209], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 23, max= 441, per=26.84%, avg=148.17, stdev=97.51, samples=83 iops : min= 1, max= 27, avg= 8.46, stdev= 6.19, samples=83 write: IOPS=8, BW=142KiB/s (145kB/s)(6032KiB/42474msec); 0 zone resets clat (msec): min=16, max=330, avg=65.52, stdev=44.76 lat (msec): min=16, max=330, avg=65.53, stdev=44.76 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 75], 80.00th=[ 97], 90.00th=[ 128], 95.00th=[ 159], | 99.00th=[ 224], 99.50th=[ 241], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 383, per=24.22%, avg=140.73, stdev=80.42, samples=83 iops : min= 1, max= 23, avg= 8.00, stdev= 5.11, samples=83 lat (msec) : 10=1.04%, 20=14.58%, 50=46.48%, 100=23.18%, 250=14.58% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.89%, ctx=1161, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179419: Wed Aug 26 23:13:04 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43062msec) clat (msec): min=7, max=304, avg=45.30, stdev=43.46 lat (msec): min=7, max=304, avg=45.30, stdev=43.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 103], 95.00th=[ 140], | 99.00th=[ 215], 99.50th=[ 271], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 23, max= 444, per=26.04%, avg=143.77, stdev=93.45, samples=81 iops : min= 1, max= 27, avg= 8.19, stdev= 5.92, samples=81 write: IOPS=9, BW=145KiB/s (149kB/s)(6256KiB/43062msec); 0 zone resets clat (msec): min=15, max=314, avg=65.98, stdev=45.99 lat (msec): min=15, max=314, avg=65.99, stdev=45.99 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 78], 80.00th=[ 92], 90.00th=[ 128], 95.00th=[ 167], | 99.00th=[ 251], 99.50th=[ 284], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 29, max= 383, per=24.79%, avg=144.01, stdev=91.86, samples=84 iops : min= 1, max= 23, avg= 8.19, stdev= 5.84, samples=84 lat (msec) : 10=1.17%, 20=13.67%, 50=45.83%, 100=25.13%, 250=13.41% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.76%, ctx=1209, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=553KiB/s (566kB/s), 133KiB/s-147KiB/s (136kB/s-151kB/s), io=23.4MiB (24.5MB), run=42474-43318msec WRITE: bw=582KiB/s (596kB/s), 142KiB/s-151KiB/s (145kB/s-155kB/s), io=24.6MiB (25.8MB), run=42474-43318msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179432: Wed Aug 26 23:13:23 2026 read: IOPS=1, BW=1408KiB/s (1442kB/s)(7168KiB/5090msec) clat (msec): min=4, max=2755, avg=540.59, stdev=980.41 lat (msec): min=4, max=2755, avg=540.59, stdev=980.41 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 148], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 213], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 275], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1365, max= 4079, per=100.00%, avg=3051.33, stdev=1472.02, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=1006KiB/s (1030kB/s)(5120KiB/5090msec); 0 zone resets clat (msec): min=141, max=434, avg=246.86, stdev=112.22 lat (msec): min=141, max=438, avg=248.01, stdev=113.73 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1855, max= 4047, per=86.62%, avg=2647.00, stdev=1215.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 250=66.67%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=13.58%, ctx=601, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179433: Wed Aug 26 23:13:23 2026 read: IOPS=0, BW=219KiB/s (224kB/s)(2048KiB/9344msec) clat (msec): min=441, max=2396, avg=1418.90, stdev=1382.28 lat (msec): min=441, max=2396, avg=1418.90, stdev=1382.28 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1996, max= 2048, per=92.62%, avg=2022.00, stdev=36.77, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1096KiB/s (1122kB/s)(10.0MiB/9344msec); 0 zone resets clat (msec): min=130, max=2612, avg=642.49, stdev=743.48 lat (msec): min=130, max=2612, avg=642.62, stdev=743.48 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 207], | 30.00th=[ 228], 40.00th=[ 241], 50.00th=[ 334], 60.00th=[ 363], | 70.00th=[ 527], 80.00th=[ 877], 90.00th=[ 902], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2023, max= 4079, per=97.95%, avg=2993.50, stdev=1059.88, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67%, >=2000=16.67% cpu : usr=0.02%, sys=9.49%, ctx=583, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179434: Wed Aug 26 23:13:23 2026 read: IOPS=0, BW=655KiB/s (671kB/s)(6144KiB/9380msec) clat (msec): min=181, max=332, avg=226.06, stdev=55.87 lat (msec): min=181, max=332, avg=226.06, stdev=55.87 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 222], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1996, max= 4047, per=100.00%, avg=2530.25, stdev=1011.38, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=655KiB/s (671kB/s)(6144KiB/9380msec); 0 zone resets clat (msec): min=291, max=2464, avg=1277.70, stdev=1064.07 lat (msec): min=292, max=2465, avg=1277.94, stdev=1064.01 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 1754], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 2023, max= 4079, per=79.94%, avg=2443.00, stdev=914.58, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 2000=8.33%, >=2000=16.67% cpu : usr=0.03%, sys=7.99%, ctx=205, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179435: Wed Aug 26 23:13:23 2026 read: IOPS=0, BW=578KiB/s (591kB/s)(5120KiB/8865msec) clat (usec): min=1069, max=2740.3k, avg=670880.96, stdev=1160310.84 lat (usec): min=1071, max=2740.3k, avg=670883.30, stdev=1160310.90 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1074], 10.00th=[ 1074], | 20.00th=[ 1074], 30.00th=[ 179307], 40.00th=[ 179307], | 50.00th=[ 208667], 60.00th=[ 208667], 70.00th=[ 225444], | 80.00th=[ 225444], 90.00th=[2734687], 95.00th=[2734687], | 99.00th=[2734687], 99.50th=[2734687], 99.90th=[2734687], | 99.95th=[2734687], 99.99th=[2734687] bw ( KiB/s): min= 4047, max= 4087, per=100.00%, avg=4067.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=809KiB/s (828kB/s)(7168KiB/8865msec); 0 zone resets clat (msec): min=209, max=2562, avg=768.76, stdev=819.64 lat (msec): min=209, max=2562, avg=768.88, stdev=819.62 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 262], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 625], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 735], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1855, max= 2048, per=65.57%, avg=2003.83, stdev=73.55, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, >=2000=16.67% cpu : usr=0.02%, sys=9.06%, ctx=551, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2183KiB/s (2236kB/s), 219KiB/s-1408KiB/s (224kB/s-1442kB/s), io=20.0MiB (20.0MB), run=5090-9380msec WRITE: bw=3057KiB/s (3130kB/s), 655KiB/s-1096KiB/s (671kB/s-1122kB/s), io=28.0MiB (29.4MB), run=5090-9380msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179436: Wed Aug 26 23:13:24 2026 read: IOPS=0, BW=904KiB/s (926kB/s)(7168KiB/7927msec) clat (msec): min=117, max=2735, avg=812.54, stdev=1043.53 lat (msec): min=117, max=2735, avg=812.54, stdev=1043.53 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 178], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 288], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 1838], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1368, max= 4096, per=100.00%, avg=2841.75, stdev=1384.10, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=646KiB/s (661kB/s)(5120KiB/7927msec); 0 zone resets clat (msec): min=112, max=563, avg=434.75, stdev=189.17 lat (msec): min=112, max=563, avg=435.16, stdev=189.37 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1872, max= 2048, per=66.56%, avg=1971.40, stdev=66.89, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=3.20%, ctx=83, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179437: Wed Aug 26 23:13:24 2026 read: IOPS=0, BW=213KiB/s (218kB/s)(2048KiB/9636msec) clat (msec): min=159, max=2264, avg=1212.15, stdev=1488.10 lat (msec): min=159, max=2264, avg=1212.15, stdev=1488.10 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1957, max= 2035, per=94.33%, avg=1996.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1063KiB/s (1088kB/s)(10.0MiB/9636msec); 0 zone resets clat (msec): min=94, max=2263, avg=691.36, stdev=655.87 lat (msec): min=94, max=2263, avg=691.82, stdev=655.62 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 228], | 30.00th=[ 321], 40.00th=[ 351], 50.00th=[ 368], 60.00th=[ 489], | 70.00th=[ 625], 80.00th=[ 860], 90.00th=[ 1318], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1872, max= 4087, per=89.30%, avg=2645.00, stdev=1064.67, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=3.27%, ctx=143, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179438: Wed Aug 26 23:13:24 2026 read: IOPS=0, BW=666KiB/s (682kB/s)(6144KiB/9226msec) clat (msec): min=102, max=531, avg=256.24, stdev=185.77 lat (msec): min=102, max=531, avg=256.24, stdev=185.77 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 228], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1872, max= 3915, per=100.00%, avg=2450.75, stdev=978.69, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=666KiB/s (682kB/s)(6144KiB/9226msec); 0 zone resets clat (msec): min=244, max=3041, avg=1236.20, stdev=1172.20 lat (msec): min=244, max=3041, avg=1236.31, stdev=1172.20 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 927], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1957, max= 2048, per=68.06%, avg=2015.83, stdev=39.93, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=3.13%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179439: Wed Aug 26 23:13:24 2026 read: IOPS=0, BW=529KiB/s (542kB/s)(5120KiB/9678msec) clat (msec): min=79, max=769, avg=279.79, stdev=279.67 lat (msec): min=79, max=769, avg=279.80, stdev=279.67 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1957, max= 2043, per=95.49%, avg=2020.50, stdev=42.38, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=741KiB/s (758kB/s)(7168KiB/9678msec); 0 zone resets clat (msec): min=119, max=2597, avg=1144.80, stdev=1086.78 lat (msec): min=119, max=2597, avg=1144.96, stdev=1086.83 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 150], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 558], 60.00th=[ 1687], | 70.00th=[ 1687], 80.00th=[ 2467], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1872, max= 2048, per=66.75%, avg=1977.00, stdev=72.40, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=3.33%, ctx=152, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2116KiB/s (2167kB/s), 213KiB/s-904KiB/s (218kB/s-926kB/s), io=20.0MiB (20.0MB), run=7927-9678msec WRITE: bw=2963KiB/s (3034kB/s), 646KiB/s-1063KiB/s (661kB/s-1088kB/s), io=28.0MiB (29.4MB), run=7927-9678msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179447: Wed Aug 26 23:13:37 2026 read: IOPS=1, BW=4963KiB/s (5082kB/s)(12.0MiB/2476msec) clat (msec): min=543, max=947, avg=740.36, stdev=202.29 lat (msec): min=543, max=947, avg=740.36, stdev=202.29 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.41%, ctx=338, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179448: Wed Aug 26 23:13:37 2026 read: IOPS=0, BW=1450KiB/s (1485kB/s)(4096KiB/2824msec) clat (nsec): min=699016k, max=699016k, avg=699016085.00, stdev= 0.00 lat (nsec): min=699019k, max=699019k, avg=699018587.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2901KiB/s (2970kB/s)(8192KiB/2824msec); 0 zone resets clat (msec): min=440, max=1394, avg=917.68, stdev=674.94 lat (msec): min=440, max=1395, avg=918.12, stdev=675.06 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8143, max= 8143, per=70.18%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.99%, ctx=130, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179449: Wed Aug 26 23:13:37 2026 write: IOPS=1, BW=4373KiB/s (4478kB/s)(12.0MiB/2810msec); 0 zone resets clat (msec): min=331, max=1361, avg=911.57, stdev=527.49 lat (msec): min=334, max=1365, avg=914.18, stdev=527.22 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7684, max= 8143, per=68.20%, avg=7913.50, stdev=324.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.59%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179450: Wed Aug 26 23:13:37 2026 write: IOPS=1, BW=5508KiB/s (5640kB/s)(12.0MiB/2231msec); 0 zone resets clat (msec): min=315, max=1316, avg=708.54, stdev=533.91 lat (msec): min=319, max=1316, avg=710.08, stdev=532.66 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7173, max= 8192, per=66.21%, avg=7682.50, stdev=720.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.59%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5802KiB/s (5941kB/s), 1450KiB/s-4963KiB/s (1485kB/s-5082kB/s), io=16.0MiB (16.8MB), run=2476-2824msec WRITE: bw=11.3MiB/s (11.9MB/s), 2901KiB/s-5508KiB/s (2970kB/s-5640kB/s), io=32.0MiB (33.6MB), run=2231-2824msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179451: Wed Aug 26 23:13:38 2026 read: IOPS=1, BW=4395KiB/s (4500kB/s)(12.0MiB/2796msec) clat (msec): min=260, max=1285, avg=888.10, stdev=549.81 lat (msec): min=260, max=1285, avg=888.10, stdev=549.81 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.18%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179452: Wed Aug 26 23:13:38 2026 read: IOPS=0, BW=1291KiB/s (1322kB/s)(4096KiB/3173msec) clat (nsec): min=1244.2M, max=1244.2M, avg=1244156520.00, stdev= 0.00 lat (nsec): min=1244.2M, max=1244.2M, avg=1244158845.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2582KiB/s (2644kB/s)(8192KiB/3173msec); 0 zone resets clat (msec): min=575, max=1085, avg=830.15, stdev=360.72 lat (msec): min=575, max=1085, avg=830.59, stdev=360.63 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8159, max= 8159, per=87.45%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.56%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179453: Wed Aug 26 23:13:38 2026 write: IOPS=0, BW=3499KiB/s (3583kB/s)(12.0MiB/3512msec); 0 zone resets clat (msec): min=146, max=2417, avg=1152.45, stdev=1157.31 lat (msec): min=147, max=2420, avg=1153.92, stdev=1158.76 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8143, max= 8143, per=87.28%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.85%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179454: Wed Aug 26 23:13:38 2026 write: IOPS=0, BW=3897KiB/s (3991kB/s)(12.0MiB/3153msec); 0 zone resets clat (msec): min=204, max=2243, avg=989.89, stdev=1097.10 lat (msec): min=204, max=2243, avg=990.33, stdev=1097.19 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 5704, max= 5704, per=61.14%, avg=5704.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.97%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5164KiB/s (5287kB/s), 1291KiB/s-4395KiB/s (1322kB/s-4500kB/s), io=16.0MiB (16.8MB), run=2796-3173msec WRITE: bw=9330KiB/s (9554kB/s), 2582KiB/s-3897KiB/s (2644kB/s-3991kB/s), io=32.0MiB (33.6MB), run=3153-3512msec