== sanity test 398b: DIO and buffer IO race ============== 21:11:05 (1787447465) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.72821 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178171: Sat Aug 22 21:13:46 2026 read: IOPS=10, BW=42.3KiB/s (43.4kB/s)(5992KiB/141516msec) clat (usec): min=52, max=792415, avg=50909.03, stdev=38535.79 lat (usec): min=53, max=792416, avg=50910.81, stdev=38535.75 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 12125], 10.00th=[ 18744], 20.00th=[ 25560], | 30.00th=[ 31851], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 51119], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[110625], | 99.00th=[179307], 99.50th=[210764], 99.90th=[291505], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 110, per=25.04%, avg=42.32, stdev=17.27, samples=275 iops : min= 1, max= 27, avg= 9.89, stdev= 4.36, samples=275 write: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6296KiB/141516msec); 0 zone resets clat (usec): min=922, max=236767, avg=41166.00, stdev=42248.66 lat (usec): min=924, max=236769, avg=41169.53, stdev=42247.82 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1336], 10.00th=[ 1614], 20.00th=[ 4047], | 30.00th=[ 8717], 40.00th=[ 18482], 50.00th=[ 30278], 60.00th=[ 41157], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[102237], 95.00th=[130548], | 99.00th=[177210], 99.50th=[208667], 99.90th=[231736], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 6, max= 127, per=24.86%, avg=44.00, stdev=19.64, samples=278 iops : min= 1, max= 31, avg=10.31, stdev= 4.93, samples=278 lat (usec) : 100=1.53%, 250=0.23%, 500=0.07%, 750=0.03%, 1000=0.07% lat (msec) : 2=6.35%, 4=3.87%, 10=6.54%, 20=8.01%, 50=36.95% lat (msec) : 100=27.18%, 250=9.05%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=4.58%, ctx=6594, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178172: Sat Aug 22 21:13:46 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5940KiB/139493msec) clat (usec): min=38, max=275083, avg=51327.38, stdev=32480.24 lat (usec): min=39, max=275085, avg=51331.40, stdev=32478.64 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 14877], 10.00th=[ 19530], 20.00th=[ 26346], | 30.00th=[ 31589], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 52691], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[106431], | 99.00th=[166724], 99.50th=[210764], 99.90th=[267387], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 87, per=25.13%, avg=42.47, stdev=16.76, samples=272 iops : min= 1, max= 21, avg= 9.93, stdev= 4.23, samples=272 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6348KiB/139493msec); 0 zone resets clat (usec): min=857, max=753472, avg=39568.30, stdev=44730.16 lat (usec): min=858, max=753473, avg=39571.05, stdev=44730.87 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1418], 10.00th=[ 1926], 20.00th=[ 4228], | 30.00th=[ 8586], 40.00th=[ 18220], 50.00th=[ 28967], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[119014], | 99.00th=[189793], 99.50th=[227541], 99.90th=[312476], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 120, per=25.54%, avg=45.21, stdev=20.78, samples=273 iops : min= 1, max= 30, avg=10.62, stdev= 5.23, samples=273 lat (usec) : 50=0.07%, 100=1.11%, 250=0.16%, 500=0.07%, 1000=0.10% lat (msec) : 2=5.50%, 4=4.46%, 10=7.06%, 20=7.71%, 50=36.82% lat (msec) : 100=29.43%, 250=7.29%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=4.74%, ctx=6571, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178173: Sat Aug 22 21:13:46 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6028KiB/141333msec) clat (usec): min=35, max=792827, avg=52038.73, stdev=38300.60 lat (usec): min=35, max=792829, avg=52046.89, stdev=38297.47 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11731], 10.00th=[ 18220], 20.00th=[ 26346], | 30.00th=[ 32900], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 92799], 95.00th=[109577], | 99.00th=[168821], 99.50th=[200279], 99.90th=[270533], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 119, per=24.96%, avg=42.19, stdev=17.73, samples=276 iops : min= 1, max= 29, avg= 9.85, stdev= 4.45, samples=276 write: IOPS=11, BW=44.3KiB/s (45.4kB/s)(6260KiB/141333msec); 0 zone resets clat (usec): min=1005, max=289932, avg=39931.87, stdev=40201.15 lat (usec): min=1006, max=289934, avg=39939.92, stdev=40210.21 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1385], 10.00th=[ 1876], 20.00th=[ 4490], | 30.00th=[ 9110], 40.00th=[ 20055], 50.00th=[ 30278], 60.00th=[ 40633], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[173016], 99.50th=[200279], 99.90th=[254804], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 110, per=24.68%, avg=43.68, stdev=19.91, samples=276 iops : min= 1, max= 27, avg=10.23, stdev= 5.00, samples=276 lat (usec) : 50=0.23%, 100=1.56%, 250=0.29%, 750=0.03%, 1000=0.03% lat (msec) : 2=5.47%, 4=4.07%, 10=6.54%, 20=7.94%, 50=36.88% lat (msec) : 100=28.65%, 250=8.14%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=4.58%, ctx=6612, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178174: Sat Aug 22 21:13:46 2026 read: IOPS=10, BW=42.8KiB/s (43.9kB/s)(6052KiB/141294msec) clat (usec): min=41, max=331673, avg=51866.59, stdev=32801.97 lat (usec): min=41, max=331674, avg=51875.98, stdev=32795.37 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 11076], 10.00th=[ 18744], 20.00th=[ 26608], | 30.00th=[ 33424], 40.00th=[ 39584], 50.00th=[ 45876], 60.00th=[ 54264], | 70.00th=[ 62653], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[111674], | 99.00th=[154141], 99.50th=[179307], 99.90th=[299893], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 111, per=25.22%, avg=42.62, stdev=16.10, samples=275 iops : min= 1, max= 27, avg= 9.96, stdev= 4.04, samples=275 write: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6236KiB/141294msec); 0 zone resets clat (usec): min=853, max=832916, avg=39985.93, stdev=45258.62 lat (usec): min=854, max=832918, avg=39989.89, stdev=45259.00 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 1860], 20.00th=[ 4359], | 30.00th=[ 8455], 40.00th=[ 18220], 50.00th=[ 28181], 60.00th=[ 39584], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[175113], 99.50th=[200279], 99.90th=[270533], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 110, per=24.78%, avg=43.87, stdev=19.40, samples=275 iops : min= 1, max= 27, avg=10.29, stdev= 4.90, samples=275 lat (usec) : 50=0.03%, 100=1.73%, 250=0.33%, 750=0.07%, 1000=0.03% lat (msec) : 2=5.53%, 4=4.13%, 10=6.90%, 20=7.75%, 50=35.77% lat (msec) : 100=29.65%, 250=7.91%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=4.66%, ctx=6687, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=170KiB/s (174kB/s), 42.3KiB/s-42.8KiB/s (43.4kB/s-43.9kB/s), io=23.4MiB (24.6MB), run=139493-141516msec WRITE: bw=178KiB/s (182kB/s), 44.1KiB/s-45.5KiB/s (45.2kB/s-46.6kB/s), io=24.6MiB (25.7MB), run=139493-141516msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178176: Sat Aug 22 21:14:27 2026 read: IOPS=8, BW=32.8KiB/s (33.6kB/s)(5992KiB/182532msec) clat (msec): min=4, max=851, avg=48.42, stdev=49.88 lat (msec): min=4, max=851, avg=48.42, stdev=49.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 72], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 211], 99.50th=[ 268], 99.90th=[ 443], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 151, per=25.54%, avg=33.45, stdev=24.46, samples=347 iops : min= 1, max= 37, avg= 7.69, stdev= 6.14, samples=347 write: IOPS=8, BW=34.5KiB/s (35.3kB/s)(6296KiB/182532msec); 0 zone resets clat (msec): min=11, max=325, avg=69.78, stdev=51.52 lat (msec): min=11, max=325, avg=69.78, stdev=51.52 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 82], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 171], | 99.00th=[ 262], 99.50th=[ 296], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 127, per=24.96%, avg=34.20, stdev=23.55, samples=356 iops : min= 1, max= 31, avg= 7.89, stdev= 5.94, samples=356 lat (msec) : 10=2.02%, 20=14.32%, 50=41.89%, 100=24.84%, 250=16.02% lat (msec) : 500=0.88%, 1000=0.03% cpu : usr=0.07%, sys=1.64%, ctx=4796, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178177: Sat Aug 22 21:14:27 2026 read: IOPS=8, BW=32.8KiB/s (33.6kB/s)(5940KiB/180961msec) clat (msec): min=5, max=805, avg=47.15, stdev=48.57 lat (msec): min=5, max=805, avg=47.16, stdev=48.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 65], 90.00th=[ 108], 95.00th=[ 142], | 99.00th=[ 220], 99.50th=[ 249], 99.90th=[ 368], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 190, per=25.71%, avg=33.68, stdev=25.47, samples=342 iops : min= 1, max= 47, avg= 7.76, stdev= 6.42, samples=342 write: IOPS=8, BW=35.1KiB/s (35.9kB/s)(6348KiB/180961msec); 0 zone resets clat (msec): min=9, max=359, avg=69.78, stdev=51.72 lat (msec): min=9, max=359, avg=69.78, stdev=51.72 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 102], 90.00th=[ 142], 95.00th=[ 174], | 99.00th=[ 262], 99.50th=[ 309], 99.90th=[ 334], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 127, per=25.45%, avg=34.87, stdev=22.61, samples=353 iops : min= 1, max= 31, avg= 8.06, stdev= 5.69, samples=353 lat (msec) : 10=2.18%, 20=13.09%, 50=43.82%, 100=24.80%, 250=15.27% lat (msec) : 500=0.81%, 1000=0.03% cpu : usr=0.06%, sys=1.56%, ctx=4533, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178178: Sat Aug 22 21:14:27 2026 read: IOPS=8, BW=33.0KiB/s (33.8kB/s)(6028KiB/182585msec) clat (msec): min=5, max=456, avg=48.22, stdev=46.63 lat (msec): min=5, max=456, avg=48.23, stdev=46.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 109], 95.00th=[ 144], | 99.00th=[ 211], 99.50th=[ 239], 99.90th=[ 368], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 159, per=25.48%, avg=33.38, stdev=24.63, samples=349 iops : min= 1, max= 39, avg= 7.68, stdev= 6.22, samples=349 write: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6260KiB/182585msec); 0 zone resets clat (msec): min=11, max=934, avg=70.12, stdev=56.59 lat (msec): min=11, max=934, avg=70.12, stdev=56.58 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 245], 99.50th=[ 305], 99.90th=[ 384], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 143, per=24.92%, avg=34.15, stdev=23.68, samples=354 iops : min= 1, max= 35, avg= 7.88, stdev= 5.98, samples=354 lat (msec) : 10=1.92%, 20=14.10%, 50=42.38%, 100=24.93%, 250=16.05% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.07%, sys=1.59%, ctx=4665, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178179: Sat Aug 22 21:14:27 2026 read: IOPS=8, BW=33.3KiB/s (34.1kB/s)(6052KiB/181519msec) clat (msec): min=5, max=357, avg=47.72, stdev=42.75 lat (msec): min=5, max=357, avg=47.72, stdev=42.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 53], 80.00th=[ 73], 90.00th=[ 107], 95.00th=[ 146], | 99.00th=[ 199], 99.50th=[ 222], 99.90th=[ 266], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 126, per=25.97%, avg=34.02, stdev=24.04, samples=345 iops : min= 1, max= 31, avg= 7.85, stdev= 6.05, samples=345 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6236KiB/181519msec); 0 zone resets clat (msec): min=12, max=937, avg=70.00, stdev=55.87 lat (msec): min=12, max=937, avg=70.01, stdev=55.87 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 101], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 384], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 135, per=24.98%, avg=34.23, stdev=23.43, samples=353 iops : min= 1, max= 33, avg= 7.90, stdev= 5.90, samples=353 lat (msec) : 10=1.56%, 20=13.57%, 50=43.23%, 100=25.88%, 250=15.10% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.07%, sys=1.67%, ctx=4786, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=132KiB/s (135kB/s), 32.8KiB/s-33.3KiB/s (33.6kB/s-34.1kB/s), io=23.4MiB (24.6MB), run=180961-182585msec WRITE: bw=138KiB/s (141kB/s), 34.3KiB/s-35.1KiB/s (35.1kB/s-35.9kB/s), io=24.6MiB (25.7MB), run=180961-182585msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178227: Sat Aug 22 21:15:20 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5920KiB/37144msec) clat (usec): min=43, max=247520, avg=52404.62, stdev=39127.22 lat (usec): min=43, max=247522, avg=52406.20, stdev=39127.28 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 151], 20.00th=[ 25297], | 30.00th=[ 30802], 40.00th=[ 39060], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 63701], 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[124257], | 99.00th=[193987], 99.50th=[246416], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 284, per=25.48%, avg=159.25, stdev=60.70, samples=73 iops : min= 1, max= 17, avg= 9.16, stdev= 3.85, samples=73 write: IOPS=10, BW=171KiB/s (176kB/s)(6368KiB/37144msec); 0 zone resets clat (usec): min=1410, max=323654, avg=44355.97, stdev=42958.65 lat (usec): min=1411, max=323657, avg=44358.87, stdev=42958.76 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2376], 10.00th=[ 3785], 20.00th=[ 8455], | 30.00th=[ 13566], 40.00th=[ 22414], 50.00th=[ 32637], 60.00th=[ 42206], | 70.00th=[ 56361], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[122160], | 99.00th=[179307], 99.50th=[261096], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 372, per=25.97%, avg=170.90, stdev=72.45, samples=73 iops : min= 1, max= 23, avg= 9.90, stdev= 4.60, samples=73 lat (usec) : 50=0.39%, 100=3.91%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=1.30%, 4=4.30%, 10=7.29%, 20=8.07%, 50=35.29% lat (msec) : 100=28.26%, 250=10.03%, 500=0.26% cpu : usr=0.08%, sys=5.19%, ctx=1859, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178228: Sat Aug 22 21:15:20 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(5744KiB/35588msec) clat (usec): min=54, max=174596, avg=52693.74, stdev=33855.21 lat (usec): min=55, max=174598, avg=52695.43, stdev=33855.24 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 82], 10.00th=[ 9110], 20.00th=[ 25035], | 30.00th=[ 33424], 40.00th=[ 40633], 50.00th=[ 47449], 60.00th=[ 57410], | 70.00th=[ 66323], 80.00th=[ 81265], 90.00th=[ 95945], 95.00th=[111674], | 99.00th=[154141], 99.50th=[166724], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 28, max= 315, per=25.68%, avg=160.51, stdev=66.80, samples=69 iops : min= 1, max= 19, avg= 9.23, stdev= 4.23, samples=69 write: IOPS=11, BW=184KiB/s (188kB/s)(6544KiB/35588msec); 0 zone resets clat (usec): min=1353, max=313084, avg=40532.46, stdev=41506.81 lat (usec): min=1355, max=313086, avg=40561.77, stdev=41497.93 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2212], 10.00th=[ 3818], 20.00th=[ 7111], | 30.00th=[ 12387], 40.00th=[ 19268], 50.00th=[ 28967], 60.00th=[ 37487], | 70.00th=[ 51119], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[122160], | 99.00th=[170918], 99.50th=[233833], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 351, per=27.80%, avg=182.93, stdev=76.31, samples=69 iops : min= 1, max= 21, avg=10.65, stdev= 4.85, samples=69 lat (usec) : 100=3.26%, 250=0.91%, 500=0.13% lat (msec) : 2=1.43%, 4=4.30%, 10=8.20%, 20=9.64%, 50=33.20% lat (msec) : 100=30.73%, 250=7.94%, 500=0.26% cpu : usr=0.08%, sys=5.35%, ctx=1787, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178229: Sat Aug 22 21:15:20 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(6256KiB/38276msec) clat (usec): min=43, max=286126, avg=53825.92, stdev=35395.66 lat (usec): min=44, max=286127, avg=53827.75, stdev=35395.67 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 91], 10.00th=[ 19792], 20.00th=[ 28705], | 30.00th=[ 36439], 40.00th=[ 42206], 50.00th=[ 48497], 60.00th=[ 54789], | 70.00th=[ 64750], 80.00th=[ 76022], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[191890], 99.50th=[212861], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 318, per=26.08%, avg=163.01, stdev=66.51, samples=75 iops : min= 1, max= 19, avg= 9.37, stdev= 4.17, samples=75 write: IOPS=9, BW=158KiB/s (161kB/s)(6032KiB/38276msec); 0 zone resets clat (usec): min=1565, max=274662, avg=45555.89, stdev=42213.44 lat (usec): min=1567, max=274664, avg=45572.64, stdev=42207.74 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2311], 10.00th=[ 4359], 20.00th=[ 8717], | 30.00th=[ 16319], 40.00th=[ 26346], 50.00th=[ 35390], 60.00th=[ 45351], | 70.00th=[ 57410], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[133694], | 99.00th=[187696], 99.50th=[212861], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 351, per=23.87%, avg=157.05, stdev=62.42, samples=74 iops : min= 1, max= 21, avg= 9.01, stdev= 3.94, samples=74 lat (usec) : 50=0.13%, 100=2.47%, 250=0.78%, 500=0.26%, 750=0.13% lat (msec) : 2=1.69%, 4=3.12%, 10=7.03%, 20=6.25%, 50=37.50% lat (msec) : 100=31.25%, 250=9.11%, 500=0.26% cpu : usr=0.11%, sys=5.39%, ctx=1919, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178230: Sat Aug 22 21:15:20 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36255msec) clat (usec): min=48, max=264839, avg=55237.85, stdev=38710.03 lat (usec): min=48, max=264839, avg=55239.55, stdev=38710.00 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 79], 10.00th=[ 182], 20.00th=[ 27395], | 30.00th=[ 34866], 40.00th=[ 42206], 50.00th=[ 50070], 60.00th=[ 58459], | 70.00th=[ 69731], 80.00th=[ 79168], 90.00th=[ 95945], 95.00th=[125305], | 99.00th=[196084], 99.50th=[265290], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 30, max= 309, per=26.82%, avg=167.61, stdev=68.84, samples=70 iops : min= 1, max= 19, avg= 9.67, stdev= 4.34, samples=70 write: IOPS=10, BW=173KiB/s (177kB/s)(6256KiB/36255msec); 0 zone resets clat (usec): min=1190, max=197264, avg=39287.50, stdev=40063.77 lat (usec): min=1193, max=197267, avg=39290.85, stdev=40063.35 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1975], 10.00th=[ 3130], 20.00th=[ 5997], | 30.00th=[ 8848], 40.00th=[ 15139], 50.00th=[ 23725], 60.00th=[ 36963], | 70.00th=[ 53216], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[120062], | 99.00th=[170918], 99.50th=[185598], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 379, per=26.60%, avg=175.00, stdev=69.48, samples=70 iops : min= 1, max= 23, avg=10.16, stdev= 4.38, samples=70 lat (usec) : 50=0.26%, 100=3.26%, 250=1.56%, 500=0.13% lat (msec) : 2=2.60%, 4=3.91%, 10=10.68%, 20=7.29%, 50=29.82% lat (msec) : 100=31.38%, 250=8.85%, 500=0.26% cpu : usr=0.09%, sys=5.42%, ctx=1801, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=626KiB/s (641kB/s), 159KiB/s-166KiB/s (163kB/s-170kB/s), io=23.4MiB (24.5MB), run=35588-38276msec WRITE: bw=658KiB/s (674kB/s), 158KiB/s-184KiB/s (161kB/s-188kB/s), io=24.6MiB (25.8MB), run=35588-38276msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178222: Sat Aug 22 21:15:30 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(5920KiB/49593msec) clat (msec): min=7, max=277, avg=52.88, stdev=48.96 lat (msec): min=7, max=277, avg=52.89, stdev=48.96 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 43], | 70.00th=[ 56], 80.00th=[ 83], 90.00th=[ 112], 95.00th=[ 163], | 99.00th=[ 257], 99.50th=[ 266], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 444, per=25.20%, avg=121.48, stdev=83.53, samples=93 iops : min= 1, max= 27, avg= 6.83, stdev= 5.30, samples=93 write: IOPS=8, BW=128KiB/s (131kB/s)(6368KiB/49593msec); 0 zone resets clat (msec): min=16, max=364, avg=74.81, stdev=50.05 lat (msec): min=16, max=364, avg=74.82, stdev=50.05 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 72], | 70.00th=[ 85], 80.00th=[ 111], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 259], 99.50th=[ 275], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 349, per=25.48%, avg=129.46, stdev=73.47, samples=95 iops : min= 1, max= 21, avg= 7.33, stdev= 4.71, samples=95 lat (msec) : 10=0.78%, 20=10.94%, 50=39.97%, 100=29.43%, 250=17.58% lat (msec) : 500=1.30% cpu : usr=0.07%, sys=1.74%, ctx=1228, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178223: Sat Aug 22 21:15:30 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5744KiB/49209msec) clat (msec): min=7, max=268, avg=50.99, stdev=41.89 lat (msec): min=7, max=268, avg=50.99, stdev=41.89 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 109], 95.00th=[ 150], | 99.00th=[ 194], 99.50th=[ 222], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 26, max= 444, per=25.00%, avg=120.51, stdev=84.73, samples=92 iops : min= 1, max= 27, avg= 6.77, stdev= 5.40, samples=92 write: IOPS=8, BW=133KiB/s (136kB/s)(6544KiB/49209msec); 0 zone resets clat (msec): min=14, max=358, avg=74.95, stdev=53.29 lat (msec): min=14, max=358, avg=74.96, stdev=53.30 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 71], | 70.00th=[ 90], 80.00th=[ 113], 90.00th=[ 153], 95.00th=[ 182], | 99.00th=[ 236], 99.50th=[ 279], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 480, per=25.83%, avg=131.21, stdev=85.92, samples=96 iops : min= 1, max= 30, avg= 7.44, stdev= 5.52, samples=96 lat (msec) : 10=1.04%, 20=8.20%, 50=45.44%, 100=26.04%, 250=18.62% lat (msec) : 500=0.65% cpu : usr=0.07%, sys=1.69%, ctx=1213, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178224: Sat Aug 22 21:15:30 2026 read: IOPS=8, BW=128KiB/s (131kB/s)(6256KiB/48789msec) clat (msec): min=7, max=338, avg=52.15, stdev=46.70 lat (msec): min=7, max=338, avg=52.19, stdev=46.70 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 75], 90.00th=[ 106], 95.00th=[ 144], | 99.00th=[ 243], 99.50th=[ 309], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 448, per=27.19%, avg=131.04, stdev=87.78, samples=94 iops : min= 1, max= 28, avg= 7.44, stdev= 5.64, samples=94 write: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48789msec); 0 zone resets clat (msec): min=16, max=363, avg=75.03, stdev=53.02 lat (msec): min=16, max=363, avg=75.05, stdev=53.03 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 87], 80.00th=[ 105], 90.00th=[ 150], 95.00th=[ 180], | 99.00th=[ 275], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 352, per=24.21%, avg=122.99, stdev=72.11, samples=96 iops : min= 1, max= 22, avg= 6.92, stdev= 4.62, samples=96 lat (msec) : 10=0.65%, 20=8.72%, 50=44.66%, 100=28.78%, 250=16.15% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.74%, ctx=1208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178225: Sat Aug 22 21:15:30 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48545msec) clat (msec): min=6, max=430, avg=53.14, stdev=51.63 lat (msec): min=6, max=430, avg=53.14, stdev=51.63 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 73], 90.00th=[ 110], 95.00th=[ 148], | 99.00th=[ 288], 99.50th=[ 351], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 26, max= 448, per=25.81%, avg=124.43, stdev=81.53, samples=94 iops : min= 1, max= 28, avg= 7.01, stdev= 5.23, samples=94 write: IOPS=8, BW=129KiB/s (132kB/s)(6256KiB/48545msec); 0 zone resets clat (msec): min=12, max=294, avg=72.18, stdev=45.98 lat (msec): min=12, max=294, avg=72.18, stdev=45.98 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 69], | 70.00th=[ 82], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 165], | 99.00th=[ 236], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 29, max= 447, per=25.88%, avg=131.45, stdev=80.64, samples=93 iops : min= 1, max= 27, avg= 7.45, stdev= 5.15, samples=93 lat (msec) : 10=0.39%, 20=9.77%, 50=42.06%, 100=30.99%, 250=15.89% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.72%, ctx=1196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=483KiB/s (495kB/s), 117KiB/s-128KiB/s (120kB/s-131kB/s), io=23.4MiB (24.5MB), run=48545-49593msec WRITE: bw=508KiB/s (520kB/s), 124KiB/s-133KiB/s (127kB/s-136kB/s), io=24.6MiB (25.8MB), run=48545-49593msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178248: Sat Aug 22 21:15:47 2026 read: IOPS=1, BW=1228KiB/s (1258kB/s)(7168KiB/5837msec) clat (msec): min=150, max=1978, avg=519.14, stdev=648.47 lat (msec): min=150, max=1978, avg=519.14, stdev=648.47 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 271], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 409], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 1921, max= 2832, per=70.74%, avg=2143.40, stdev=388.36, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=0, BW=877KiB/s (898kB/s)(5120KiB/5837msec); 0 zone resets clat (msec): min=248, max=648, avg=438.92, stdev=160.08 lat (msec): min=249, max=648, avg=439.37, stdev=160.25 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1928, max= 3442, per=57.90%, avg=2456.67, stdev=854.08, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=10.86%, ctx=414, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178249: Sat Aug 22 21:15:47 2026 read: IOPS=0, BW=303KiB/s (310kB/s)(2048KiB/6757msec) clat (msec): min=273, max=299, avg=286.84, stdev=18.56 lat (msec): min=273, max=299, avg=286.84, stdev=18.56 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1744, max= 2015, per=62.03%, avg=1879.50, stdev=191.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1515KiB/s (1552kB/s)(10.0MiB/6757msec); 0 zone resets clat (msec): min=94, max=1929, avg=617.98, stdev=561.62 lat (msec): min=94, max=1929, avg=618.19, stdev=561.55 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 174], | 30.00th=[ 251], 40.00th=[ 300], 50.00th=[ 313], 60.00th=[ 531], | 70.00th=[ 617], 80.00th=[ 827], 90.00th=[ 1133], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1744, max= 4087, per=52.22%, avg=2215.50, stdev=763.67, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 100=8.33%, 250=8.33%, 500=41.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=9.41%, ctx=141, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178250: Sat Aug 22 21:15:47 2026 read: IOPS=0, BW=980KiB/s (1004kB/s)(6144KiB/6267msec) clat (usec): min=394, max=430638, avg=235199.69, stdev=194313.63 lat (usec): min=396, max=430639, avg=235201.34, stdev=194313.73 clat percentiles (usec): | 1.00th=[ 396], 5.00th=[ 396], 10.00th=[ 396], 20.00th=[ 3785], | 30.00th=[ 3785], 40.00th=[223347], 50.00th=[223347], 60.00th=[350225], | 70.00th=[404751], 80.00th=[404751], 90.00th=[429917], 95.00th=[429917], | 99.00th=[429917], 99.50th=[429917], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 1744, max= 3976, per=100.00%, avg=3232.00, stdev=1288.65, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=980KiB/s (1004kB/s)(6144KiB/6267msec); 0 zone resets clat (msec): min=193, max=2773, avg=808.41, stdev=988.98 lat (msec): min=193, max=2773, avg=808.86, stdev=988.72 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 659], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1744, max= 4023, per=55.56%, avg=2357.20, stdev=938.38, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.37%, ctx=173, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178251: Sat Aug 22 21:15:47 2026 read: IOPS=0, BW=826KiB/s (846kB/s)(5120KiB/6199msec) clat (usec): min=343, max=120714, avg=24663.14, stdev=53696.19 lat (usec): min=344, max=120715, avg=24664.10, stdev=53696.51 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 343], 10.00th=[ 343], 20.00th=[ 343], | 30.00th=[ 404], 40.00th=[ 404], 50.00th=[ 429], 60.00th=[ 429], | 70.00th=[ 1434], 80.00th=[ 1434], 90.00th=[121111], 95.00th=[121111], | 99.00th=[121111], 99.50th=[121111], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 6977, max= 6977, per=100.00%, avg=6977.00, stdev= 0.00, samples=1 iops : min= 6, max= 6, avg= 6.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1156KiB/s (1184kB/s)(7168KiB/6199msec); 0 zone resets clat (msec): min=250, max=2737, avg=865.04, stdev=871.68 lat (msec): min=250, max=2737, avg=865.15, stdev=871.69 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 305], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 498], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 1083], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1744, max= 2023, per=44.31%, avg=1880.20, stdev=131.71, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=25.00% lat (msec) : 2=8.33%, 250=8.33%, 500=33.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=6.45%, ctx=105, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3031KiB/s (3104kB/s), 303KiB/s-1228KiB/s (310kB/s-1258kB/s), io=20.0MiB (20.0MB), run=5837-6757msec WRITE: bw=4243KiB/s (4345kB/s), 877KiB/s-1515KiB/s (898kB/s-1552kB/s), io=28.0MiB (29.4MB), run=5837-6757msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178243: Sat Aug 22 21:15:48 2026 read: IOPS=1, BW=1056KiB/s (1082kB/s)(7168KiB/6786msec) clat (msec): min=91, max=2437, avg=536.67, stdev=851.15 lat (msec): min=91, max=2437, avg=536.67, stdev=851.14 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 102], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 226], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 518], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1910, max= 5763, per=100.00%, avg=2934.75, stdev=1886.41, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=0, BW=754KiB/s (773kB/s)(5120KiB/6786msec); 0 zone resets clat (msec): min=322, max=921, avg=598.87, stdev=246.80 lat (msec): min=322, max=921, avg=598.98, stdev=246.79 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1935, max= 4087, per=68.80%, avg=2507.75, stdev=1053.94, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.24%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178244: Sat Aug 22 21:15:48 2026 read: IOPS=0, BW=260KiB/s (267kB/s)(2048KiB/7866msec) clat (msec): min=207, max=1087, avg=647.68, stdev=622.11 lat (msec): min=207, max=1087, avg=647.69, stdev=622.11 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2019, max= 2043, per=78.03%, avg=2031.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1302KiB/s (1333kB/s)(10.0MiB/7866msec); 0 zone resets clat (msec): min=221, max=1784, avg=647.90, stdev=471.72 lat (msec): min=223, max=1785, avg=648.72, stdev=471.42 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 292], | 30.00th=[ 309], 40.00th=[ 405], 50.00th=[ 489], 60.00th=[ 542], | 70.00th=[ 617], 80.00th=[ 751], 90.00th=[ 1070], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1910, max= 4015, per=61.54%, avg=2243.25, stdev=717.69, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 250=16.67%, 500=33.33%, 750=25.00%, 2000=25.00% cpu : usr=0.00%, sys=5.23%, ctx=121, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178245: Sat Aug 22 21:15:48 2026 read: IOPS=0, BW=948KiB/s (971kB/s)(6144KiB/6479msec) clat (msec): min=139, max=671, avg=369.73, stdev=206.79 lat (msec): min=139, max=671, avg=369.73, stdev=206.79 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 439], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1935, max= 3820, per=94.49%, avg=2459.50, stdev=908.40, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=948KiB/s (971kB/s)(6144KiB/6479msec); 0 zone resets clat (msec): min=112, max=2136, avg=695.09, stdev=779.97 lat (msec): min=113, max=2136, avg=695.63, stdev=779.77 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 409], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 2007, max= 3968, per=66.26%, avg=2415.20, stdev=868.15, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.41%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178246: Sat Aug 22 21:15:48 2026 read: IOPS=0, BW=904KiB/s (926kB/s)(5120KiB/5662msec) clat (msec): min=151, max=413, avg=300.14, stdev=97.17 lat (msec): min=151, max=413, avg=300.14, stdev=97.17 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2007, max= 3820, per=100.00%, avg=2616.67, stdev=1042.15, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1266KiB/s (1296kB/s)(7168KiB/5662msec); 0 zone resets clat (msec): min=153, max=2131, avg=580.69, stdev=696.18 lat (msec): min=153, max=2136, avg=581.68, stdev=697.70 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 205], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 355], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 550], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 1935, max= 3923, per=65.42%, avg=2384.60, stdev=860.87, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.58%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2604KiB/s (2666kB/s), 260KiB/s-1056KiB/s (267kB/s-1082kB/s), io=20.0MiB (20.0MB), run=5662-7866msec WRITE: bw=3645KiB/s (3733kB/s), 754KiB/s-1302KiB/s (773kB/s-1333kB/s), io=28.0MiB (29.4MB), run=5662-7866msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178258: Sat Aug 22 21:16:05 2026 read: IOPS=0, BW=1858KiB/s (1902kB/s)(12.0MiB/6614msec) clat (msec): min=1071, max=4017, avg=2170.68, stdev=1608.75 lat (msec): min=1071, max=4017, avg=2170.69, stdev=1608.76 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=6.70%, ctx=632, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178260: Sat Aug 22 21:16:05 2026 read: IOPS=0, BW=643KiB/s (658kB/s)(4096KiB/6373msec) clat (nsec): min=3881.8M, max=3881.8M, avg=3881788309.00, stdev= 0.00 lat (nsec): min=3881.8M, max=3881.8M, avg=3881791314.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3876], 5.00th=[ 3876], 10.00th=[ 3876], 20.00th=[ 3876], | 30.00th=[ 3876], 40.00th=[ 3876], 50.00th=[ 3876], 60.00th=[ 3876], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1285KiB/s (1316kB/s)(8192KiB/6373msec); 0 zone resets clat (msec): min=742, max=1615, avg=1178.82, stdev=617.50 lat (msec): min=742, max=1616, avg=1179.31, stdev=617.77 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.62%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178261: Sat Aug 22 21:16:05 2026 write: IOPS=0, BW=1911KiB/s (1957kB/s)(12.0MiB/6431msec); 0 zone resets clat (msec): min=792, max=3918, avg=2031.32, stdev=1660.64 lat (msec): min=794, max=3921, avg=2033.28, stdev=1661.32 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 3910], 80.00th=[ 3910], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.99%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178264: Sat Aug 22 21:16:05 2026 write: IOPS=0, BW=1815KiB/s (1858kB/s)(12.0MiB/6772msec); 0 zone resets clat (msec): min=535, max=3420, avg=2183.96, stdev=1486.11 lat (msec): min=535, max=3421, avg=2184.89, stdev=1486.38 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 2601], 50.00th=[ 2601], 60.00th=[ 2601], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.04%, sys=1.70%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2477KiB/s (2537kB/s), 643KiB/s-1858KiB/s (658kB/s-1902kB/s), io=16.0MiB (16.8MB), run=6373-6614msec WRITE: bw=4839KiB/s (4955kB/s), 1285KiB/s-1911KiB/s (1316kB/s-1957kB/s), io=32.0MiB (33.6MB), run=6373-6772msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178259: Sat Aug 22 21:16:06 2026 read: IOPS=0, BW=1725KiB/s (1766kB/s)(12.0MiB/7124msec) clat (msec): min=442, max=5672, avg=2350.12, stdev=2887.62 lat (msec): min=442, max=5672, avg=2350.12, stdev=2887.62 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 5671], 80.00th=[ 5671], 90.00th=[ 5671], 95.00th=[ 5671], | 99.00th=[ 5671], 99.50th=[ 5671], 99.90th=[ 5671], 99.95th=[ 5671], | 99.99th=[ 5671] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.61%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178262: Sat Aug 22 21:16:06 2026 read: IOPS=0, BW=578KiB/s (592kB/s)(4096KiB/7090msec) clat (nsec): min=5111.9M, max=5111.9M, avg=5111921570.00, stdev= 0.00 lat (nsec): min=5111.9M, max=5111.9M, avg=5111924630.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 5134], 5.00th=[ 5134], 10.00th=[ 5134], 20.00th=[ 5134], | 30.00th=[ 5134], 40.00th=[ 5134], 50.00th=[ 5134], 60.00th=[ 5134], | 70.00th=[ 5134], 80.00th=[ 5134], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1155KiB/s (1183kB/s)(8192KiB/7090msec); 0 zone resets clat (msec): min=259, max=1590, avg=924.95, stdev=941.42 lat (msec): min=260, max=1591, avg=926.03, stdev=940.64 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.42%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178263: Sat Aug 22 21:16:06 2026 write: IOPS=0, BW=1725KiB/s (1766kB/s)(12.0MiB/7124msec); 0 zone resets clat (msec): min=1077, max=4662, avg=2326.16, stdev=2025.19 lat (msec): min=1078, max=4663, avg=2327.08, stdev=2024.74 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 7922, max= 8062, per=100.00%, avg=7992.00, stdev=98.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.01%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178265: Sat Aug 22 21:16:06 2026 write: IOPS=0, BW=1722KiB/s (1764kB/s)(12.0MiB/7135msec); 0 zone resets clat (msec): min=1272, max=3979, avg=2290.20, stdev=1473.04 lat (msec): min=1275, max=3979, avg=2291.99, stdev=1471.85 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.04%, sys=2.16%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2300KiB/s (2355kB/s), 578KiB/s-1725KiB/s (592kB/s-1766kB/s), io=16.0MiB (16.8MB), run=7090-7124msec WRITE: bw=4593KiB/s (4703kB/s), 1155KiB/s-1725KiB/s (1183kB/s-1766kB/s), io=32.0MiB (33.6MB), run=7090-7135msec