== sanity test 398b: DIO and buffer IO race ============== 18:10:32 (1787868632) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.1727 s, 7.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145061: Thu Aug 27 18:13:15 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5992KiB/140704msec) clat (usec): min=27, max=995246, avg=43867.10, stdev=43423.14 lat (usec): min=27, max=995247, avg=43869.50, stdev=43422.82 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 75], 20.00th=[ 17957], | 30.00th=[ 23725], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 52691], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[160433], 99.50th=[183501], 99.90th=[413139], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 120, per=24.99%, avg=42.48, stdev=19.54, samples=274 iops : min= 1, max= 30, avg= 9.99, stdev= 4.92, samples=274 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6296KiB/140704msec); 0 zone resets clat (usec): min=977, max=412624, avg=47437.12, stdev=47740.03 lat (usec): min=978, max=412625, avg=47439.97, stdev=47739.64 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 1778], 20.00th=[ 4817], | 30.00th=[ 9765], 40.00th=[ 23462], 50.00th=[ 36963], 60.00th=[ 49021], | 70.00th=[ 62653], 80.00th=[ 81265], 90.00th=[109577], 95.00th=[137364], | 99.00th=[214959], 99.50th=[233833], 99.90th=[295699], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 7, max= 157, per=24.92%, avg=44.36, stdev=20.44, samples=276 iops : min= 1, max= 39, avg=10.46, stdev= 5.15, samples=276 lat (usec) : 50=0.75%, 100=4.88%, 250=0.59%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.10% lat (msec) : 2=5.89%, 4=3.29%, 10=6.77%, 20=7.85%, 50=33.43% lat (msec) : 100=26.14%, 250=9.64%, 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=4.79%, ctx=6514, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145062: Thu Aug 27 18:13:15 2026 read: IOPS=10, BW=43.6KiB/s (44.7kB/s)(5940KiB/136095msec) clat (usec): min=30, max=207413, avg=41843.15, stdev=33875.20 lat (usec): min=30, max=207414, avg=41844.99, stdev=33875.41 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 16057], | 30.00th=[ 22938], 40.00th=[ 27919], 50.00th=[ 34866], 60.00th=[ 42730], | 70.00th=[ 52691], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[152044], 99.50th=[166724], 99.90th=[181404], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 5, max= 115, per=25.61%, avg=43.54, stdev=20.53, samples=266 iops : min= 1, max= 28, avg=10.25, stdev= 5.18, samples=266 write: IOPS=11, BW=46.6KiB/s (47.8kB/s)(6348KiB/136095msec); 0 zone resets clat (usec): min=1035, max=961317, avg=46379.80, stdev=53309.24 lat (usec): min=1036, max=961318, avg=46387.44, stdev=53312.11 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1598], 20.00th=[ 4047], | 30.00th=[ 8979], 40.00th=[ 22414], 50.00th=[ 35390], 60.00th=[ 46400], | 70.00th=[ 59507], 80.00th=[ 76022], 90.00th=[107480], 95.00th=[137364], | 99.00th=[217056], 99.50th=[267387], 99.90th=[425722], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 5, max= 104, per=25.90%, avg=46.09, stdev=18.97, samples=268 iops : min= 1, max= 26, avg=10.90, stdev= 4.75, samples=268 lat (usec) : 50=0.65%, 100=5.86%, 250=0.59%, 500=0.29%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.58%, 4=3.97%, 10=6.22%, 20=7.81%, 50=33.04% lat (msec) : 100=25.29%, 250=9.31%, 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=5.06%, ctx=6434, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145063: Thu Aug 27 18:13:15 2026 read: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6028KiB/137670msec) clat (usec): min=31, max=276370, avg=41617.41, stdev=34513.32 lat (usec): min=32, max=276371, avg=41618.93, stdev=34513.74 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 15533], | 30.00th=[ 23462], 40.00th=[ 28705], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[152044], 99.50th=[175113], 99.90th=[246416], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 110, per=26.35%, avg=44.79, stdev=20.02, samples=263 iops : min= 1, max= 27, avg=10.57, stdev= 5.03, samples=263 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6260KiB/137670msec); 0 zone resets clat (usec): min=1013, max=1014.7k, avg=47607.96, stdev=55574.39 lat (usec): min=1014, max=1014.7k, avg=47612.53, stdev=55572.77 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1827], | 20.00th=[ 4555], 30.00th=[ 9110], 40.00th=[ 22414], | 50.00th=[ 36439], 60.00th=[ 48497], 70.00th=[ 61080], | 80.00th=[ 78119], 90.00th=[ 111674], 95.00th=[ 141558], | 99.00th=[ 193987], 99.50th=[ 235930], 99.90th=[ 683672], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 103, per=25.59%, avg=45.56, stdev=18.39, samples=268 iops : min= 1, max= 25, avg=10.76, stdev= 4.66, samples=268 lat (usec) : 50=1.01%, 100=6.05%, 250=0.49%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.76%, 4=3.74%, 10=7.03%, 20=7.88%, 50=32.16% lat (msec) : 100=26.14%, 250=9.21%, 500=0.13%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.93%, ctx=6426, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145064: Thu Aug 27 18:13:15 2026 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6052KiB/135670msec) clat (usec): min=32, max=512211, avg=41354.29, stdev=35308.00 lat (usec): min=33, max=512212, avg=41355.65, stdev=35308.07 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 16188], | 30.00th=[ 22152], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 65799], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[145753], 99.50th=[158335], 99.90th=[238027], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 7, max= 120, per=26.59%, avg=45.20, stdev=20.22, samples=261 iops : min= 1, max= 30, avg=10.67, stdev= 5.10, samples=261 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6236KiB/135670msec); 0 zone resets clat (usec): min=996, max=994461, avg=46630.34, stdev=53810.61 lat (usec): min=996, max=994464, avg=46633.26, stdev=53810.99 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1811], 20.00th=[ 4178], | 30.00th=[ 8455], 40.00th=[ 18744], 50.00th=[ 33817], 60.00th=[ 45876], | 70.00th=[ 62129], 80.00th=[ 81265], 90.00th=[112722], 95.00th=[137364], | 99.00th=[212861], 99.50th=[254804], 99.90th=[404751], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 126, per=25.70%, avg=45.75, stdev=20.11, samples=265 iops : min= 1, max= 31, avg=10.81, stdev= 5.05, samples=265 lat (usec) : 50=1.01%, 100=5.53%, 250=0.36%, 500=0.16%, 750=0.16% lat (usec) : 1000=0.10% lat (msec) : 2=5.89%, 4=4.26%, 10=6.67%, 20=9.44%, 50=32.19% lat (msec) : 100=24.54%, 250=9.38%, 500=0.23%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.00%, ctx=6389, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.6KiB/s-44.6KiB/s (43.6kB/s-45.7kB/s), io=23.4MiB (24.6MB), run=135670-140704msec WRITE: bw=179KiB/s (183kB/s), 44.7KiB/s-46.6KiB/s (45.8kB/s-47.8kB/s), io=24.6MiB (25.7MB), run=135670-140704msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145057: Thu Aug 27 18:15:58 2026 read: IOPS=4, BW=19.7KiB/s (20.2kB/s)(5992KiB/303656msec) clat (msec): min=6, max=1032, avg=41.45, stdev=45.21 lat (msec): min=6, max=1032, avg=41.46, stdev=45.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 192], 99.50th=[ 220], 99.90th=[ 384], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 96, per=28.94%, avg=22.87, stdev=15.13, samples=504 iops : min= 1, max= 24, avg= 5.07, stdev= 3.81, samples=504 write: IOPS=5, BW=20.7KiB/s (21.2kB/s)(6296KiB/303656msec); 0 zone resets clat (msec): min=33, max=715, avg=153.22, stdev=72.28 lat (msec): min=33, max=715, avg=153.22, stdev=72.28 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 99], | 30.00th=[ 111], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 203], 90.00th=[ 247], 95.00th=[ 292], | 99.00th=[ 414], 99.50th=[ 451], 99.90th=[ 518], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 47, per=24.86%, avg=20.38, stdev= 9.07, samples=591 iops : min= 1, max= 11, avg= 4.44, stdev= 2.31, samples=591 lat (msec) : 10=1.92%, 20=12.40%, 50=23.24%, 100=18.78%, 250=38.61% lat (msec) : 500=4.88%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.09%, ctx=5436, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145058: Thu Aug 27 18:15:58 2026 read: IOPS=4, BW=19.6KiB/s (20.0kB/s)(5940KiB/303529msec) clat (msec): min=6, max=963, avg=41.48, stdev=47.42 lat (msec): min=6, max=963, avg=41.48, stdev=47.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 80], 95.00th=[ 110], | 99.00th=[ 203], 99.50th=[ 230], 99.90th=[ 667], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 6, max= 88, per=28.51%, avg=22.52, stdev=15.38, samples=507 iops : min= 1, max= 22, avg= 4.98, stdev= 3.88, samples=507 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6348KiB/303529msec); 0 zone resets clat (msec): min=41, max=565, avg=152.20, stdev=69.92 lat (msec): min=41, max=565, avg=152.21, stdev=69.92 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 171], 80.00th=[ 199], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 380], 99.50th=[ 414], 99.90th=[ 493], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 47, per=25.00%, avg=20.50, stdev= 9.10, samples=593 iops : min= 1, max= 11, avg= 4.47, stdev= 2.32, samples=593 lat (msec) : 10=1.79%, 20=12.17%, 50=23.18%, 100=19.95%, 250=37.96% lat (msec) : 500=4.85%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.06%, ctx=5295, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145059: Thu Aug 27 18:15:58 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6028KiB/303776msec) clat (msec): min=6, max=494, avg=43.21, stdev=41.04 lat (msec): min=6, max=494, avg=43.21, stdev=41.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 87], 95.00th=[ 120], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 376], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 6, max= 72, per=27.62%, avg=21.82, stdev=14.33, samples=530 iops : min= 1, max= 18, avg= 4.81, stdev= 3.60, samples=530 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6260KiB/303776msec); 0 zone resets clat (msec): min=41, max=1059, avg=152.25, stdev=72.64 lat (msec): min=41, max=1059, avg=152.25, stdev=72.64 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 83], 20.00th=[ 97], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 201], 90.00th=[ 243], 95.00th=[ 292], | 99.00th=[ 380], 99.50th=[ 430], 99.90th=[ 584], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 47, per=24.85%, avg=20.38, stdev= 8.91, samples=587 iops : min= 1, max= 11, avg= 4.44, stdev= 2.27, samples=587 lat (msec) : 10=1.76%, 20=11.65%, 50=23.08%, 100=19.92%, 250=39.13% lat (msec) : 500=4.36%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5284, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145060: Thu Aug 27 18:15:58 2026 read: IOPS=4, BW=19.0KiB/s (20.5kB/s)(6052KiB/302761msec) clat (msec): min=5, max=503, avg=42.24, stdev=41.61 lat (msec): min=5, max=503, avg=42.24, stdev=41.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 85], 95.00th=[ 116], | 99.00th=[ 188], 99.50th=[ 279], 99.90th=[ 472], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 6, max= 86, per=29.17%, avg=23.05, stdev=14.93, samples=505 iops : min= 1, max= 21, avg= 5.12, stdev= 3.76, samples=505 write: IOPS=5, BW=20.6KiB/s (21.1kB/s)(6236KiB/302761msec); 0 zone resets clat (msec): min=40, max=1064, avg=152.97, stdev=73.93 lat (msec): min=40, max=1064, avg=152.97, stdev=73.93 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 96], | 30.00th=[ 111], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 284], | 99.00th=[ 401], 99.50th=[ 447], 99.90th=[ 718], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 47, per=24.92%, avg=20.43, stdev= 9.04, samples=584 iops : min= 1, max= 11, avg= 4.45, stdev= 2.29, samples=584 lat (msec) : 10=1.76%, 20=11.78%, 50=24.06%, 100=19.47%, 250=38.09% lat (msec) : 500=4.72%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=5373, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=79.0KiB/s (80.9kB/s), 19.6KiB/s-19.0KiB/s (20.0kB/s-20.5kB/s), io=23.4MiB (24.6MB), run=302761-303776msec WRITE: bw=82.8KiB/s (84.7kB/s), 20.6KiB/s-20.9KiB/s (21.1kB/s-21.4kB/s), io=24.6MiB (25.7MB), run=302761-303776msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145133: Thu Aug 27 18:16:44 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(5920KiB/32065msec) clat (usec): min=33, max=267278, avg=43875.72, stdev=39349.63 lat (usec): min=33, max=267278, avg=43877.05, stdev=39349.60 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 302], | 30.00th=[ 23987], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 46924], | 70.00th=[ 54264], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[120062], | 99.00th=[179307], 99.50th=[210764], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 63, max= 414, per=25.71%, avg=183.08, stdev=71.11, samples=62 iops : min= 3, max= 25, avg=10.63, stdev= 4.49, samples=62 write: IOPS=12, BW=199KiB/s (203kB/s)(6368KiB/32065msec); 0 zone resets clat (usec): min=1588, max=530407, avg=38753.74, stdev=46530.29 lat (usec): min=1590, max=530407, avg=38780.03, stdev=46530.29 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2409], 10.00th=[ 3818], 20.00th=[ 5932], | 30.00th=[ 9503], 40.00th=[ 14484], 50.00th=[ 20579], 60.00th=[ 32900], | 70.00th=[ 45876], 80.00th=[ 68682], 90.00th=[ 99091], 95.00th=[123208], | 99.00th=[185598], 99.50th=[196084], 99.90th=[530580], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 22, max= 383, per=26.63%, avg=199.45, stdev=95.87, samples=62 iops : min= 1, max= 23, avg=11.66, stdev= 6.03, samples=62 lat (usec) : 50=1.04%, 100=7.03%, 250=1.30%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=1.95%, 4=4.69%, 10=10.68%, 20=10.16%, 50=30.99% lat (msec) : 100=22.79%, 250=8.07%, 500=0.13%, 750=0.13% cpu : usr=0.08%, sys=5.13%, ctx=1521, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145135: Thu Aug 27 18:16:44 2026 read: IOPS=11, BW=191KiB/s (195kB/s)(5744KiB/30111msec) clat (usec): min=37, max=182927, avg=42362.87, stdev=34785.54 lat (usec): min=37, max=182928, avg=42364.17, stdev=34785.55 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 89], | 30.00th=[ 24511], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 58983], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[160433], 99.50th=[166724], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 44, max= 351, per=26.93%, avg=191.76, stdev=69.11, samples=59 iops : min= 2, max= 21, avg=11.17, stdev= 4.36, samples=59 write: IOPS=13, BW=217KiB/s (223kB/s)(6544KiB/30111msec); 0 zone resets clat (usec): min=1464, max=204533, avg=35940.51, stdev=36365.65 lat (usec): min=1466, max=204536, avg=35948.25, stdev=36362.31 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1991], 10.00th=[ 3064], 20.00th=[ 5473], | 30.00th=[ 7898], 40.00th=[ 12649], 50.00th=[ 23725], 60.00th=[ 35390], | 70.00th=[ 47973], 80.00th=[ 65274], 90.00th=[ 89654], 95.00th=[106431], | 99.00th=[141558], 99.50th=[173016], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 441, per=28.92%, avg=216.58, stdev=92.55, samples=59 iops : min= 1, max= 27, avg=12.75, stdev= 5.82, samples=59 lat (usec) : 50=1.56%, 100=8.07%, 250=1.30%, 500=0.39%, 1000=0.26% lat (msec) : 2=2.99%, 4=4.04%, 10=11.85%, 20=8.20%, 50=27.73% lat (msec) : 100=27.86%, 250=5.73% cpu : usr=0.09%, sys=5.73%, ctx=1516, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145137: Thu Aug 27 18:16:44 2026 read: IOPS=11, BW=186KiB/s (191kB/s)(6256KiB/33628msec) clat (usec): min=36, max=301183, avg=42346.46, stdev=35800.38 lat (usec): min=37, max=301184, avg=42348.31, stdev=35800.42 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 103], | 30.00th=[ 25297], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 67634], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[252707], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 63, max= 411, per=26.64%, avg=189.68, stdev=77.01, samples=65 iops : min= 3, max= 25, avg=11.05, stdev= 4.89, samples=65 write: IOPS=11, BW=179KiB/s (184kB/s)(6032KiB/33628msec); 0 zone resets clat (usec): min=1488, max=464038, avg=44212.06, stdev=46879.31 lat (usec): min=1490, max=464041, avg=44217.16, stdev=46878.13 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2180], 10.00th=[ 3425], 20.00th=[ 6980], | 30.00th=[ 10421], 40.00th=[ 17695], 50.00th=[ 32900], 60.00th=[ 46924], | 70.00th=[ 58983], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[125305], | 99.00th=[181404], 99.50th=[265290], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 44, max= 446, per=23.97%, avg=179.53, stdev=86.17, samples=66 iops : min= 2, max= 27, avg=10.39, stdev= 5.43, samples=66 lat (usec) : 50=1.56%, 100=8.33%, 250=1.17%, 750=0.26% lat (msec) : 2=2.08%, 4=4.82%, 10=8.20%, 20=6.77%, 50=28.26% lat (msec) : 100=31.25%, 250=6.77%, 500=0.52% cpu : usr=0.07%, sys=5.31%, ctx=1636, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145138: Thu Aug 27 18:16:44 2026 read: IOPS=11, BW=191KiB/s (195kB/s)(6032KiB/31611msec) clat (usec): min=35, max=184846, avg=42442.99, stdev=36322.79 lat (usec): min=35, max=184848, avg=42485.26, stdev=36300.00 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 106], | 30.00th=[ 20579], 40.00th=[ 30540], 50.00th=[ 38536], 60.00th=[ 47973], | 70.00th=[ 59507], 80.00th=[ 74974], 90.00th=[ 93848], 95.00th=[105382], | 99.00th=[143655], 99.50th=[164627], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 414, per=27.32%, avg=194.52, stdev=80.88, samples=61 iops : min= 1, max= 25, avg=11.34, stdev= 5.11, samples=61 write: IOPS=12, BW=198KiB/s (203kB/s)(6256KiB/31611msec); 0 zone resets clat (usec): min=1514, max=417993, avg=38830.20, stdev=46258.40 lat (usec): min=1516, max=417994, avg=38833.74, stdev=46258.07 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2212], 10.00th=[ 3228], 20.00th=[ 5604], | 30.00th=[ 8848], 40.00th=[ 12518], 50.00th=[ 21627], 60.00th=[ 33424], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[119014], | 99.00th=[217056], 99.50th=[252707], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 22, max= 379, per=26.55%, avg=198.82, stdev=73.73, samples=62 iops : min= 1, max= 23, avg=11.63, stdev= 4.64, samples=62 lat (usec) : 50=1.43%, 100=8.20%, 250=2.08%, 500=0.52%, 1000=0.26% lat (msec) : 2=2.86%, 4=5.08%, 10=9.77%, 20=9.24%, 50=26.82% lat (msec) : 100=27.08%, 250=6.38%, 500=0.26% cpu : usr=0.07%, sys=5.53%, ctx=1527, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=712KiB/s (729kB/s), 185KiB/s-191KiB/s (189kB/s-195kB/s), io=23.4MiB (24.5MB), run=30111-33628msec WRITE: bw=749KiB/s (767kB/s), 179KiB/s-217KiB/s (184kB/s-223kB/s), io=24.6MiB (25.8MB), run=30111-33628msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145131: Thu Aug 27 18:17:27 2026 read: IOPS=4, BW=77.6KiB/s (79.5kB/s)(5920KiB/76240msec) clat (msec): min=7, max=274, avg=44.65, stdev=46.36 lat (msec): min=7, max=274, avg=44.65, stdev=46.36 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 61], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 253], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 256, per=28.14%, avg=88.35, stdev=51.78, samples=130 iops : min= 1, max= 16, avg= 4.78, stdev= 3.35, samples=130 write: IOPS=5, BW=83.5KiB/s (85.5kB/s)(6368KiB/76240msec); 0 zone resets clat (msec): min=49, max=581, avg=149.77, stdev=64.29 lat (msec): min=49, max=581, avg=149.77, stdev=64.29 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 88], 20.00th=[ 100], | 30.00th=[ 115], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 167], 80.00th=[ 186], 90.00th=[ 232], 95.00th=[ 268], | 99.00th=[ 422], 99.50th=[ 439], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 30, max= 160, per=25.95%, avg=85.63, stdev=34.64, samples=145 iops : min= 1, max= 10, avg= 4.60, stdev= 2.27, samples=145 lat (msec) : 10=1.69%, 20=13.02%, 50=22.14%, 100=16.28%, 250=43.10% lat (msec) : 500=3.65%, 750=0.13% cpu : usr=0.04%, sys=1.11%, ctx=1239, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145132: Thu Aug 27 18:17:27 2026 read: IOPS=4, BW=75.5KiB/s (77.3kB/s)(5744KiB/76084msec) clat (msec): min=7, max=348, avg=39.79, stdev=40.26 lat (msec): min=7, max=348, avg=39.79, stdev=40.26 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 123], | 99.00th=[ 174], 99.50th=[ 330], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 21, max= 381, per=28.86%, avg=90.61, stdev=64.54, samples=125 iops : min= 1, max= 23, avg= 4.93, stdev= 4.10, samples=125 write: IOPS=5, BW=86.0KiB/s (88.1kB/s)(6544KiB/76084msec); 0 zone resets clat (msec): min=55, max=468, avg=149.98, stdev=62.89 lat (msec): min=55, max=468, avg=149.99, stdev=62.89 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 77], 10.00th=[ 86], 20.00th=[ 102], | 30.00th=[ 114], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 165], 80.00th=[ 186], 90.00th=[ 228], 95.00th=[ 284], | 99.00th=[ 359], 99.50th=[ 368], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 31, max= 160, per=26.82%, avg=88.52, stdev=34.19, samples=145 iops : min= 1, max= 10, avg= 4.78, stdev= 2.22, samples=145 lat (msec) : 10=1.17%, 20=14.97%, 50=20.05%, 100=17.45%, 250=42.19% lat (msec) : 500=4.17% cpu : usr=0.02%, sys=1.11%, ctx=1335, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145134: Thu Aug 27 18:17:27 2026 read: IOPS=5, BW=84.6KiB/s (86.7kB/s)(6256KiB/73923msec) clat (msec): min=6, max=397, avg=39.61, stdev=38.77 lat (msec): min=6, max=397, avg=39.61, stdev=38.77 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 84], 95.00th=[ 109], | 99.00th=[ 213], 99.50th=[ 236], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 317, per=29.36%, avg=92.18, stdev=60.07, samples=134 iops : min= 1, max= 19, avg= 5.00, stdev= 3.82, samples=134 write: IOPS=5, BW=81.6KiB/s (83.6kB/s)(6032KiB/73923msec); 0 zone resets clat (msec): min=52, max=586, avg=154.06, stdev=63.72 lat (msec): min=52, max=586, avg=154.06, stdev=63.72 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 81], 10.00th=[ 91], 20.00th=[ 107], | 30.00th=[ 115], 40.00th=[ 127], 50.00th=[ 142], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 199], 90.00th=[ 232], 95.00th=[ 275], | 99.00th=[ 359], 99.50th=[ 376], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 30, max= 160, per=24.73%, avg=81.61, stdev=31.49, samples=144 iops : min= 1, max= 10, avg= 4.33, stdev= 2.08, samples=144 lat (msec) : 10=0.78%, 20=13.80%, 50=25.78%, 100=14.97%, 250=41.02% lat (msec) : 500=3.52%, 750=0.13% cpu : usr=0.04%, sys=1.17%, ctx=1205, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145136: Thu Aug 27 18:17:27 2026 read: IOPS=5, BW=80.5KiB/s (82.4kB/s)(6032KiB/74960msec) clat (msec): min=6, max=313, avg=40.66, stdev=38.62 lat (msec): min=6, max=313, avg=40.66, stdev=38.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 122], | 99.00th=[ 226], 99.50th=[ 275], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 255, per=29.60%, avg=92.95, stdev=56.42, samples=126 iops : min= 1, max= 15, avg= 5.05, stdev= 3.50, samples=126 write: IOPS=5, BW=83.5KiB/s (85.5kB/s)(6256KiB/74960msec); 0 zone resets clat (msec): min=55, max=440, avg=151.66, stdev=62.12 lat (msec): min=55, max=440, avg=151.66, stdev=62.12 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 79], 10.00th=[ 89], 20.00th=[ 104], | 30.00th=[ 116], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 153], | 70.00th=[ 165], 80.00th=[ 194], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 363], 99.50th=[ 422], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 30, max= 192, per=25.32%, avg=83.54, stdev=33.31, samples=146 iops : min= 1, max= 12, avg= 4.46, stdev= 2.22, samples=146 lat (msec) : 10=1.30%, 20=13.02%, 50=23.83%, 100=16.93%, 250=40.76% lat (msec) : 500=4.17% cpu : usr=0.04%, sys=1.24%, ctx=1348, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=314KiB/s (322kB/s), 75.5KiB/s-84.6KiB/s (77.3kB/s-86.7kB/s), io=23.4MiB (24.5MB), run=73923-76240msec WRITE: bw=331KiB/s (338kB/s), 81.6KiB/s-86.0KiB/s (83.6kB/s-88.1kB/s), io=24.6MiB (25.8MB), run=73923-76240msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145156: Thu Aug 27 18:17:43 2026 read: IOPS=1, BW=1502KiB/s (1538kB/s)(7168KiB/4773msec) clat (usec): min=546, max=2328.3k, avg=486572.53, stdev=817471.90 lat (usec): min=547, max=2328.3k, avg=486574.15, stdev=817472.15 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], | 20.00th=[ 160433], 30.00th=[ 168821], 40.00th=[ 168821], | 50.00th=[ 202376], 60.00th=[ 240124], 70.00th=[ 240124], | 80.00th=[ 304088], 90.00th=[2332034], 95.00th=[2332034], | 99.00th=[2332034], 99.50th=[2332034], 99.90th=[2332034], | 99.95th=[2332034], 99.99th=[2332034] bw ( KiB/s): min= 2035, max= 4047, per=85.01%, avg=2752.50, stdev=949.23, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1073KiB/s (1098kB/s)(5120KiB/4773msec); 0 zone resets clat (msec): min=149, max=396, avg=256.31, stdev=92.28 lat (msec): min=151, max=396, avg=256.81, stdev=91.73 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2023, max= 2048, per=44.90%, avg=2035.25, stdev=10.21, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=11.46%, ctx=482, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145157: Thu Aug 27 18:17:43 2026 read: IOPS=0, BW=324KiB/s (332kB/s)(2048KiB/6324msec) clat (msec): min=2, max=184, avg=93.69, stdev=128.63 lat (msec): min=2, max=184, avg=93.70, stdev=128.63 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 1402, max= 2048, per=53.27%, avg=1725.00, stdev=456.79, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1619KiB/s (1658kB/s)(10.0MiB/6324msec); 0 zone resets clat (msec): min=111, max=2916, avg=610.57, stdev=837.47 lat (msec): min=111, max=2916, avg=610.71, stdev=837.47 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 155], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 342], 60.00th=[ 397], | 70.00th=[ 418], 80.00th=[ 592], 90.00th=[ 793], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 2019, max= 4096, per=67.25%, avg=3048.67, stdev=1111.69, samples=6 iops : min= 1, max= 4, avg= 2.33, stdev= 1.21, samples=6 lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=10.87%, ctx=168, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145158: Thu Aug 27 18:17:43 2026 read: IOPS=1, BW=1157KiB/s (1185kB/s)(6144KiB/5308msec) clat (usec): min=1094, max=345638, avg=199802.77, stdev=111924.31 lat (usec): min=1096, max=345640, avg=199804.15, stdev=111924.30 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1090], 10.00th=[ 1090], 20.00th=[196084], | 30.00th=[196084], 40.00th=[200279], 50.00th=[200279], 60.00th=[212861], | 70.00th=[240124], 80.00th=[240124], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 2048, max= 4071, per=100.00%, avg=3396.67, stdev=1167.98, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1157KiB/s (1185kB/s)(6144KiB/5308msec); 0 zone resets clat (msec): min=200, max=2690, avg=675.09, stdev=990.98 lat (msec): min=200, max=2690, avg=675.29, stdev=990.92 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 309], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 2019, max= 2929, per=48.82%, avg=2213.20, stdev=400.28, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 2=8.33%, 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=9.59%, ctx=298, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145159: Thu Aug 27 18:17:43 2026 read: IOPS=0, BW=975KiB/s (998kB/s)(5120KiB/5253msec) clat (usec): min=879, max=454192, avg=249234.53, stdev=165255.39 lat (usec): min=880, max=454193, avg=249235.92, stdev=165255.45 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 881], | 30.00th=[212861], 40.00th=[212861], 50.00th=[267387], 60.00th=[267387], | 70.00th=[312476], 80.00th=[312476], 90.00th=[455082], 95.00th=[455082], | 99.00th=[455082], 99.50th=[455082], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 4071, max= 4096, per=100.00%, avg=4083.50, stdev=17.68, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1365KiB/s (1397kB/s)(7168KiB/5253msec); 0 zone resets clat (msec): min=148, max=2525, avg=560.17, stdev=872.48 lat (msec): min=148, max=2525, avg=560.25, stdev=872.49 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 157], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 186], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 380], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1434, max= 4047, per=60.02%, avg=2720.60, stdev=1232.41, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=41.67%, >=2000=8.33% cpu : usr=0.02%, sys=9.60%, ctx=168, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3238KiB/s (3316kB/s), 324KiB/s-1502KiB/s (332kB/s-1538kB/s), io=20.0MiB (20.0MB), run=4773-6324msec WRITE: bw=4534KiB/s (4643kB/s), 1073KiB/s-1619KiB/s (1098kB/s-1658kB/s), io=28.0MiB (29.4MB), run=4773-6324msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145161: Thu Aug 27 18:17:43 2026 read: IOPS=1, BW=1255KiB/s (1285kB/s)(7168KiB/5710msec) clat (msec): min=75, max=2706, avg=559.19, stdev=949.99 lat (msec): min=75, max=2706, avg=559.19, stdev=949.99 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 169], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 209], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 305], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1398, max= 3878, per=72.89%, avg=2326.75, stdev=1074.43, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=897KiB/s (918kB/s)(5120KiB/5710msec); 0 zone resets clat (msec): min=251, max=504, avg=332.19, stdev=102.88 lat (msec): min=251, max=504, avg=333.21, stdev=102.04 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2000, max= 2039, per=45.36%, avg=2027.25, stdev=18.55, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.07%, sys=3.99%, ctx=163, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145162: Thu Aug 27 18:17:43 2026 read: IOPS=0, BW=319KiB/s (327kB/s)(2048KiB/6415msec) clat (msec): min=120, max=121, avg=121.00, stdev= 1.05 lat (msec): min=120, max=121, avg=121.00, stdev= 1.05 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 121], 60.00th=[ 123], | 70.00th=[ 123], 80.00th=[ 123], 90.00th=[ 123], 95.00th=[ 123], | 99.00th=[ 123], 99.50th=[ 123], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 1544, max= 2039, per=56.12%, avg=1791.50, stdev=350.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1596KiB/s (1635kB/s)(10.0MiB/6415msec); 0 zone resets clat (msec): min=102, max=2152, avg=604.04, stdev=639.53 lat (msec): min=102, max=2153, avg=604.29, stdev=639.55 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 178], | 30.00th=[ 182], 40.00th=[ 288], 50.00th=[ 368], 60.00th=[ 384], | 70.00th=[ 523], 80.00th=[ 592], 90.00th=[ 1284], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1939, max= 3968, per=51.20%, avg=2288.00, stdev=741.75, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=3.20%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145163: Thu Aug 27 18:17:43 2026 read: IOPS=0, BW=1024KiB/s (1048kB/s)(6144KiB/6002msec) clat (msec): min=99, max=458, avg=223.99, stdev=158.96 lat (msec): min=99, max=458, avg=223.99, stdev=158.96 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1992, max= 4079, per=79.52%, avg=2538.25, stdev=1027.43, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=1024KiB/s (1048kB/s)(6144KiB/6002msec); 0 zone resets clat (msec): min=143, max=2874, avg=748.91, stdev=1059.48 lat (msec): min=143, max=2874, avg=749.17, stdev=1059.71 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 317], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1992, max= 2043, per=45.27%, avg=2023.20, stdev=20.60, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.45%, ctx=69, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145164: Thu Aug 27 18:17:43 2026 read: IOPS=0, BW=803KiB/s (822kB/s)(5120KiB/6378msec) clat (msec): min=92, max=304, avg=150.73, stdev=88.61 lat (msec): min=92, max=304, avg=150.73, stdev=88.61 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 116], 60.00th=[ 116], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 4079, max= 4079, per=100.00%, avg=4079.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1124KiB/s (1151kB/s)(7168KiB/6378msec); 0 zone resets clat (msec): min=165, max=2792, avg=765.40, stdev=925.48 lat (msec): min=165, max=2792, avg=765.62, stdev=925.47 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 279], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 313], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 776], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1851, max= 3968, per=53.22%, avg=2378.60, stdev=891.90, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=3.14%, ctx=95, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3193KiB/s (3269kB/s), 319KiB/s-1255KiB/s (327kB/s-1285kB/s), io=20.0MiB (20.0MB), run=5710-6415msec WRITE: bw=4470KiB/s (4577kB/s), 897KiB/s-1596KiB/s (918kB/s-1635kB/s), io=28.0MiB (29.4MB), run=5710-6415msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145171: Thu Aug 27 18:17:56 2026 read: IOPS=1, BW=7224KiB/s (7397kB/s)(12.0MiB/1701msec) clat (msec): min=294, max=968, avg=551.80, stdev=364.38 lat (msec): min=294, max=968, avg=551.80, stdev=364.38 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 5649, max= 8175, per=100.00%, avg=6912.00, stdev=1786.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=5.71%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145172: Thu Aug 27 18:17:56 2026 read: IOPS=0, BW=1255KiB/s (1285kB/s)(4096KiB/3263msec) clat (nsec): min=907418k, max=907418k, avg=907417805.00, stdev= 0.00 lat (nsec): min=907420k, max=907420k, avg=907420169.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2511KiB/s (2571kB/s)(8192KiB/3263msec); 0 zone resets clat (msec): min=1009, max=1297, avg=1153.43, stdev=204.26 lat (msec): min=1009, max=1299, avg=1154.75, stdev=204.87 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8175, max= 8175, per=84.95%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.97%, ctx=41, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145173: Thu Aug 27 18:17:56 2026 write: IOPS=0, BW=3609KiB/s (3695kB/s)(12.0MiB/3405msec); 0 zone resets clat (msec): min=585, max=1696, avg=1129.22, stdev=556.12 lat (msec): min=585, max=1697, avg=1129.73, stdev=556.02 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 6272, max= 8110, per=74.73%, avg=7191.00, stdev=1299.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.26%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145174: Thu Aug 27 18:17:56 2026 write: IOPS=1, BW=5750KiB/s (5888kB/s)(12.0MiB/2137msec); 0 zone resets clat (msec): min=434, max=900, avg=711.34, stdev=245.38 lat (msec): min=434, max=901, avg=711.92, stdev=245.37 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 6792, max= 8126, per=77.51%, avg=7459.00, stdev=943.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.57%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5021KiB/s (5142kB/s), 1255KiB/s-7224KiB/s (1285kB/s-7397kB/s), io=16.0MiB (16.8MB), run=1701-3263msec WRITE: bw=9623KiB/s (9854kB/s), 2511KiB/s-5750KiB/s (2571kB/s-5888kB/s), io=32.0MiB (33.6MB), run=2137-3405msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145176: Thu Aug 27 18:17:56 2026 read: IOPS=1, BW=5170KiB/s (5294kB/s)(12.0MiB/2377msec) clat (msec): min=481, max=1148, avg=791.52, stdev=336.09 lat (msec): min=481, max=1148, avg=791.52, stdev=336.09 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.78%, ctx=273, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145177: Thu Aug 27 18:17:56 2026 read: IOPS=0, BW=1276KiB/s (1306kB/s)(4096KiB/3211msec) clat (nsec): min=791219k, max=791219k, avg=791219017.00, stdev= 0.00 lat (nsec): min=791222k, max=791222k, avg=791222010.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2551KiB/s (2612kB/s)(8192KiB/3211msec); 0 zone resets clat (msec): min=1191, max=1225, avg=1208.24, stdev=23.99 lat (msec): min=1191, max=1225, avg=1208.81, stdev=24.04 clat percentiles (msec): | 1.00th=[ 1200], 5.00th=[ 1200], 10.00th=[ 1200], 20.00th=[ 1200], | 30.00th=[ 1200], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8094, max= 8094, per=80.21%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.40%, ctx=101, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145178: Thu Aug 27 18:17:56 2026 write: IOPS=0, BW=3784KiB/s (3875kB/s)(12.0MiB/3247msec); 0 zone resets clat (msec): min=984, max=1151, avg=1072.64, stdev=83.81 lat (msec): min=985, max=1178, avg=1081.88, stdev=96.38 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7984, max= 8192, per=80.15%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.87%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145179: Thu Aug 27 18:17:56 2026 write: IOPS=1, BW=4531KiB/s (4640kB/s)(12.0MiB/2712msec); 0 zone resets clat (msec): min=323, max=1357, avg=902.78, stdev=528.26 lat (msec): min=323, max=1357, avg=903.38, stdev=528.33 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7984, max= 8192, per=80.15%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.21%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5102KiB/s (5225kB/s), 1276KiB/s-5170KiB/s (1306kB/s-5294kB/s), io=16.0MiB (16.8MB), run=2377-3211msec WRITE: bw=9.85MiB/s (10.3MB/s), 2551KiB/s-4531KiB/s (2612kB/s-4640kB/s), io=32.0MiB (33.6MB), run=2712-3247msec