== sanity test 398b: DIO and buffer IO race ============== 16:34:38 (1788467678) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.79301 s, 10.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145802: Thu Sep 3 16:37:00 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5992KiB/127999msec) clat (usec): min=29, max=709347, avg=40830.65, stdev=40765.04 lat (usec): min=30, max=709348, avg=40832.01, stdev=40765.08 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 74], 20.00th=[ 16057], | 30.00th=[ 22414], 40.00th=[ 27395], 50.00th=[ 32900], 60.00th=[ 40109], | 70.00th=[ 50070], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[149947], 99.50th=[223347], 99.90th=[658506], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 127, per=24.95%, avg=46.66, stdev=21.15, samples=251 iops : min= 1, max= 31, avg=11.03, stdev= 5.28, samples=251 write: IOPS=12, BW=49.2KiB/s (50.4kB/s)(6296KiB/127999msec); 0 zone resets clat (usec): min=921, max=620158, avg=42254.37, stdev=46199.67 lat (usec): min=921, max=620159, avg=42256.14, stdev=46200.07 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1205], 10.00th=[ 1762], 20.00th=[ 3818], | 30.00th=[ 7570], 40.00th=[ 18220], 50.00th=[ 30540], 60.00th=[ 42206], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[100140], 95.00th=[131597], | 99.00th=[189793], 99.50th=[210764], 99.90th=[320865], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 143, per=25.12%, avg=49.24, stdev=22.88, samples=250 iops : min= 1, max= 35, avg=11.68, stdev= 5.75, samples=250 lat (usec) : 50=0.88%, 100=4.56%, 250=0.49%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=5.53%, 4=5.05%, 10=7.19%, 20=9.51%, 50=33.92% lat (msec) : 100=25.20%, 250=6.77%, 500=0.20%, 750=0.10% cpu : usr=0.08%, sys=5.44%, ctx=6612, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145803: Thu Sep 3 16:37:00 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5940KiB/126900msec) clat (usec): min=26, max=330682, avg=38006.76, stdev=32548.88 lat (usec): min=26, max=330683, avg=38007.97, stdev=32548.88 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 67], 20.00th=[ 15401], | 30.00th=[ 20841], 40.00th=[ 26346], 50.00th=[ 31589], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 58459], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[179307], 99.90th=[316670], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 6, max= 112, per=25.02%, avg=46.79, stdev=22.61, samples=247 iops : min= 1, max= 28, avg=11.06, stdev= 5.68, samples=247 write: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6348KiB/126900msec); 0 zone resets clat (usec): min=956, max=859574, avg=44164.67, stdev=50973.68 lat (usec): min=957, max=859576, avg=44172.88, stdev=50978.68 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1696], 20.00th=[ 4424], | 30.00th=[ 8717], 40.00th=[ 19006], 50.00th=[ 31851], 60.00th=[ 43779], | 70.00th=[ 57410], 80.00th=[ 74974], 90.00th=[103285], 95.00th=[130548], | 99.00th=[198181], 99.50th=[238027], 99.90th=[599786], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 6, max= 143, per=25.38%, avg=49.74, stdev=20.72, samples=248 iops : min= 1, max= 35, avg=11.81, stdev= 5.19, samples=248 lat (usec) : 50=1.24%, 100=5.34%, 250=0.46%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=6.02%, 4=3.74%, 10=7.39%, 20=9.93%, 50=33.98% lat (msec) : 100=23.60%, 250=7.62%, 500=0.23%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.32%, ctx=6458, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145804: Thu Sep 3 16:37:00 2026 read: IOPS=11, BW=47.0KiB/s (48.2kB/s)(6028KiB/128135msec) clat (usec): min=32, max=439122, avg=38007.61, stdev=31498.77 lat (usec): min=32, max=439123, avg=38009.50, stdev=31498.36 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 75], 20.00th=[ 16319], | 30.00th=[ 21627], 40.00th=[ 26608], 50.00th=[ 31851], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[131597], 99.50th=[164627], 99.90th=[304088], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 7, max= 135, per=25.24%, avg=47.20, stdev=22.66, samples=249 iops : min= 1, max= 33, avg=11.17, stdev= 5.71, samples=249 write: IOPS=12, BW=48.9KiB/s (50.0kB/s)(6260KiB/128135msec); 0 zone resets clat (usec): min=858, max=926714, avg=45064.09, stdev=52013.91 lat (usec): min=859, max=926715, avg=45065.98, stdev=52014.10 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1221], 10.00th=[ 1614], 20.00th=[ 4228], | 30.00th=[ 8455], 40.00th=[ 19006], 50.00th=[ 32637], 60.00th=[ 44303], | 70.00th=[ 59507], 80.00th=[ 77071], 90.00th=[106431], 95.00th=[133694], | 99.00th=[210764], 99.50th=[244319], 99.90th=[408945], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 150, per=24.95%, avg=48.90, stdev=20.09, samples=250 iops : min= 1, max= 37, avg=11.59, stdev= 5.05, samples=250 lat (usec) : 50=0.94%, 100=4.59%, 250=0.55%, 500=0.23%, 750=0.23% lat (usec) : 1000=0.26% lat (msec) : 2=6.09%, 4=3.68%, 10=6.77%, 20=10.87%, 50=34.28% lat (msec) : 100=23.54%, 250=7.68%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=5.32%, ctx=6525, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145805: Thu Sep 3 16:37:00 2026 read: IOPS=11, BW=47.8KiB/s (48.0kB/s)(6052KiB/126530msec) clat (usec): min=30, max=197617, avg=38693.46, stdev=30046.69 lat (usec): min=30, max=197618, avg=38695.25, stdev=30045.93 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 70], 20.00th=[ 15401], | 30.00th=[ 21627], 40.00th=[ 27132], 50.00th=[ 32637], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[126354], 99.50th=[149947], 99.90th=[187696], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 119, per=25.83%, avg=48.31, stdev=20.87, samples=245 iops : min= 1, max= 29, avg=11.44, stdev= 5.25, samples=245 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6236KiB/126530msec); 0 zone resets clat (usec): min=946, max=913475, avg=43404.15, stdev=52220.28 lat (usec): min=946, max=913477, avg=43406.14, stdev=52221.03 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1631], 20.00th=[ 3949], | 30.00th=[ 7570], 40.00th=[ 18220], 50.00th=[ 29754], 60.00th=[ 40633], | 70.00th=[ 55837], 80.00th=[ 76022], 90.00th=[108528], 95.00th=[130548], | 99.00th=[202376], 99.50th=[248513], 99.90th=[442500], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 143, per=25.18%, avg=49.36, stdev=22.69, samples=247 iops : min= 1, max= 35, avg=11.70, stdev= 5.70, samples=247 lat (usec) : 50=1.07%, 100=4.85%, 250=0.81%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=6.09%, 4=4.10%, 10=7.23%, 20=9.47%, 50=34.38% lat (msec) : 100=23.27%, 250=7.98%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=5.19%, ctx=6305, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=187KiB/s (192kB/s), 46.8KiB/s-47.8KiB/s (47.9kB/s-48.0kB/s), io=23.4MiB (24.6MB), run=126530-128135msec WRITE: bw=196KiB/s (201kB/s), 48.9KiB/s-50.0KiB/s (50.0kB/s-51.2kB/s), io=24.6MiB (25.7MB), run=126530-128135msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145797: Thu Sep 3 16:39:19 2026 read: IOPS=5, BW=22.6KiB/s (23.1kB/s)(5992KiB/265291msec) clat (msec): min=5, max=746, avg=33.90, stdev=43.51 lat (msec): min=5, max=746, avg=33.90, stdev=43.51 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 78], 95.00th=[ 110], | 99.00th=[ 182], 99.50th=[ 209], 99.90th=[ 726], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 96, per=29.56%, avg=26.31, stdev=18.40, samples=442 iops : min= 1, max= 24, avg= 5.98, stdev= 4.66, samples=442 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6296KiB/265291msec); 0 zone resets clat (msec): min=31, max=786, avg=136.07, stdev=70.96 lat (msec): min=31, max=786, avg=136.07, stdev=70.96 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 155], 80.00th=[ 184], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 368], 99.50th=[ 435], 99.90th=[ 592], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 56, per=25.50%, avg=23.72, stdev=11.35, samples=513 iops : min= 1, max= 14, avg= 5.33, stdev= 2.89, samples=513 lat (msec) : 10=5.53%, 20=18.91%, 50=16.41%, 100=23.73%, 250=31.28% lat (msec) : 500=3.91%, 750=0.20%, 1000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=5209, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145798: Thu Sep 3 16:39:19 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(5940KiB/267715msec) clat (msec): min=4, max=883, avg=33.39, stdev=44.53 lat (msec): min=4, max=883, avg=33.39, stdev=44.53 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 46], 90.00th=[ 71], 95.00th=[ 100], | 99.00th=[ 188], 99.50th=[ 230], 99.90th=[ 726], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 119, per=28.43%, avg=25.31, stdev=18.08, samples=454 iops : min= 1, max= 29, avg= 5.74, stdev= 4.55, samples=454 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6348KiB/267715msec); 0 zone resets clat (msec): min=34, max=789, avg=137.24, stdev=73.05 lat (msec): min=34, max=789, avg=137.25, stdev=73.05 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 155], 80.00th=[ 188], 90.00th=[ 239], 95.00th=[ 284], | 99.00th=[ 372], 99.50th=[ 397], 99.90th=[ 527], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 72, per=25.18%, avg=23.42, stdev=11.54, samples=521 iops : min= 1, max= 18, avg= 5.26, stdev= 2.95, samples=521 lat (msec) : 10=5.57%, 20=18.98%, 50=16.05%, 100=24.32%, 250=30.76% lat (msec) : 500=4.20%, 750=0.07%, 1000=0.07% cpu : usr=0.04%, sys=1.07%, ctx=5221, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145799: Thu Sep 3 16:39:19 2026 read: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6028KiB/265765msec) clat (msec): min=5, max=437, avg=33.70, stdev=37.23 lat (msec): min=5, max=437, avg=33.71, stdev=37.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 107], | 99.00th=[ 161], 99.50th=[ 241], 99.90th=[ 409], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 103, per=28.20%, avg=25.10, stdev=18.25, samples=465 iops : min= 1, max= 25, avg= 5.68, stdev= 4.60, samples=465 write: IOPS=5, BW=23.6KiB/s (24.1kB/s)(6260KiB/265765msec); 0 zone resets clat (msec): min=36, max=903, avg=137.15, stdev=70.81 lat (msec): min=36, max=903, avg=137.16, stdev=70.81 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 106], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 186], 90.00th=[ 228], 95.00th=[ 275], | 99.00th=[ 355], 99.50th=[ 384], 99.90th=[ 542], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 56, per=25.05%, avg=23.29, stdev=11.45, samples=519 iops : min= 1, max= 14, avg= 5.23, stdev= 2.92, samples=519 lat (msec) : 10=5.44%, 20=18.98%, 50=16.11%, 100=23.96%, 250=31.51% lat (msec) : 500=3.94%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5175, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145801: Thu Sep 3 16:39:19 2026 read: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6052KiB/265800msec) clat (msec): min=4, max=425, avg=32.91, stdev=36.12 lat (msec): min=4, max=425, avg=32.91, stdev=36.12 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 77], 95.00th=[ 104], | 99.00th=[ 178], 99.50th=[ 201], 99.90th=[ 401], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 111, per=29.16%, avg=25.96, stdev=18.62, samples=452 iops : min= 1, max= 27, avg= 5.89, stdev= 4.70, samples=452 write: IOPS=5, BW=23.5KiB/s (24.0kB/s)(6236KiB/265800msec); 0 zone resets clat (msec): min=43, max=902, avg=138.34, stdev=74.51 lat (msec): min=43, max=902, avg=138.35, stdev=74.51 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 188], 90.00th=[ 232], 95.00th=[ 275], | 99.00th=[ 393], 99.50th=[ 435], 99.90th=[ 793], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 48, per=25.00%, avg=23.25, stdev=11.31, samples=518 iops : min= 1, max= 12, avg= 5.22, stdev= 2.89, samples=518 lat (msec) : 10=5.01%, 20=20.31%, 50=15.95%, 100=23.37%, 250=31.38% lat (msec) : 500=3.84%, 750=0.07%, 1000=0.07% cpu : usr=0.04%, sys=1.09%, ctx=5233, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.7KiB/s (91.8kB/s), 22.2KiB/s-22.8KiB/s (22.7kB/s-23.3kB/s), io=23.4MiB (24.6MB), run=265291-267715msec WRITE: bw=93.9KiB/s (96.2kB/s), 23.5KiB/s-23.7KiB/s (24.0kB/s-24.3kB/s), io=24.6MiB (25.7MB), run=265291-267715msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145863: Thu Sep 3 16:39:52 2026 read: IOPS=16, BW=263KiB/s (269kB/s)(5920KiB/22538msec) clat (usec): min=33, max=114544, avg=29207.51, stdev=22853.63 lat (usec): min=33, max=114544, avg=29212.24, stdev=22855.04 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 106], | 30.00th=[ 16712], 40.00th=[ 23200], 50.00th=[ 28705], 60.00th=[ 33817], | 70.00th=[ 40109], 80.00th=[ 48497], 90.00th=[ 59507], 95.00th=[ 67634], | 99.00th=[ 87557], 99.50th=[104334], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 86, max= 542, per=24.20%, avg=257.02, stdev=96.53, samples=44 iops : min= 5, max= 33, avg=15.30, stdev= 6.08, samples=44 write: IOPS=17, BW=283KiB/s (289kB/s)(6368KiB/22538msec); 0 zone resets clat (usec): min=1309, max=250324, avg=28501.67, stdev=31781.78 lat (usec): min=1311, max=250326, avg=28503.61, stdev=31781.80 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1909], 10.00th=[ 3097], 20.00th=[ 4883], | 30.00th=[ 7177], 40.00th=[ 11338], 50.00th=[ 17695], 60.00th=[ 26608], | 70.00th=[ 35914], 80.00th=[ 48497], 90.00th=[ 63701], 95.00th=[ 84411], | 99.00th=[170918], 99.50th=[189793], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 28, max= 601, per=24.94%, avg=278.80, stdev=122.50, samples=44 iops : min= 1, max= 37, avg=16.66, stdev= 7.72, samples=44 lat (usec) : 50=1.30%, 100=7.94%, 250=1.95%, 500=0.78%, 1000=0.13% lat (msec) : 2=2.86%, 4=4.69%, 10=12.11%, 20=11.98%, 50=37.76% lat (msec) : 100=16.80%, 250=1.56%, 500=0.13% cpu : usr=0.09%, sys=7.94%, ctx=1582, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145864: Thu Sep 3 16:39:52 2026 read: IOPS=16, BW=259KiB/s (265kB/s)(5744KiB/22159msec) clat (usec): min=37, max=153168, avg=30196.28, stdev=25691.97 lat (usec): min=38, max=153169, avg=30200.91, stdev=25689.93 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 145], | 30.00th=[ 17171], 40.00th=[ 21627], 50.00th=[ 27657], 60.00th=[ 32637], | 70.00th=[ 40109], 80.00th=[ 50070], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[104334], 99.50th=[120062], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 56, max= 542, per=24.48%, avg=259.95, stdev=95.74, samples=43 iops : min= 3, max= 33, avg=15.49, stdev= 5.98, samples=43 write: IOPS=18, BW=295KiB/s (302kB/s)(6544KiB/22159msec); 0 zone resets clat (usec): min=1343, max=231204, avg=27210.07, stdev=28272.35 lat (usec): min=1344, max=231207, avg=27215.53, stdev=28274.33 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2024], 10.00th=[ 2868], 20.00th=[ 4948], | 30.00th=[ 6652], 40.00th=[ 10159], 50.00th=[ 18220], 60.00th=[ 26608], | 70.00th=[ 35914], 80.00th=[ 48497], 90.00th=[ 65799], 95.00th=[ 80217], | 99.00th=[127402], 99.50th=[131597], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 126, max= 637, per=26.53%, avg=296.60, stdev=112.02, samples=43 iops : min= 7, max= 39, avg=17.79, stdev= 7.02, samples=43 lat (usec) : 50=1.04%, 100=7.42%, 250=2.08%, 500=0.26%, 750=0.13% lat (msec) : 2=2.60%, 4=5.08%, 10=14.19%, 20=12.11%, 50=35.55% lat (msec) : 100=17.84%, 250=1.69% cpu : usr=0.08%, sys=8.30%, ctx=1516, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145865: Thu Sep 3 16:39:52 2026 read: IOPS=18, BW=289KiB/s (295kB/s)(6256KiB/21684msec) clat (usec): min=33, max=180492, avg=28661.81, stdev=24804.54 lat (usec): min=33, max=180493, avg=28663.67, stdev=24803.82 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 52], 10.00th=[ 61], 20.00th=[ 130], | 30.00th=[ 17957], 40.00th=[ 21890], 50.00th=[ 27132], 60.00th=[ 31589], | 70.00th=[ 38011], 80.00th=[ 45351], 90.00th=[ 56886], 95.00th=[ 72877], | 99.00th=[100140], 99.50th=[173016], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 636, per=28.25%, avg=300.00, stdev=104.84, samples=41 iops : min= 3, max= 39, avg=18.00, stdev= 6.60, samples=41 write: IOPS=17, BW=278KiB/s (285kB/s)(6032KiB/21684msec); 0 zone resets clat (usec): min=1411, max=185649, avg=26871.20, stdev=28814.52 lat (usec): min=1412, max=185651, avg=26879.25, stdev=28810.69 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2245], 10.00th=[ 3392], 20.00th=[ 4621], | 30.00th=[ 7439], 40.00th=[ 10159], 50.00th=[ 16909], 60.00th=[ 23725], | 70.00th=[ 32113], 80.00th=[ 46400], 90.00th=[ 66323], 95.00th=[ 79168], | 99.00th=[135267], 99.50th=[177210], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 56, max= 509, per=24.75%, avg=276.74, stdev=115.69, samples=42 iops : min= 3, max= 31, avg=16.55, stdev= 7.27, samples=42 lat (usec) : 50=2.21%, 100=7.68%, 250=1.17%, 500=0.91%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.21%, 4=5.60%, 10=12.24%, 20=11.98%, 50=39.45% lat (msec) : 100=14.58%, 250=1.56% cpu : usr=0.09%, sys=8.62%, ctx=1519, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145866: Thu Sep 3 16:39:52 2026 read: IOPS=17, BW=273KiB/s (280kB/s)(6032KiB/22096msec) clat (usec): min=39, max=206799, avg=27264.69, stdev=26266.03 lat (usec): min=40, max=206801, avg=27266.79, stdev=26265.83 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 60], 20.00th=[ 85], | 30.00th=[ 1188], 40.00th=[ 19268], 50.00th=[ 25822], 60.00th=[ 31065], | 70.00th=[ 36963], 80.00th=[ 45876], 90.00th=[ 56886], 95.00th=[ 66323], | 99.00th=[108528], 99.50th=[152044], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 479, per=26.85%, avg=285.20, stdev=110.45, samples=41 iops : min= 1, max= 29, avg=17.07, stdev= 6.98, samples=41 write: IOPS=17, BW=283KiB/s (290kB/s)(6256KiB/22096msec); 0 zone resets clat (usec): min=1369, max=333566, avg=28944.25, stdev=39262.72 lat (usec): min=1370, max=333570, avg=28949.47, stdev=39265.71 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1729], 10.00th=[ 2540], 20.00th=[ 4490], | 30.00th=[ 6390], 40.00th=[ 8979], 50.00th=[ 15401], 60.00th=[ 22152], | 70.00th=[ 32900], 80.00th=[ 46400], 90.00th=[ 65274], 95.00th=[ 96994], | 99.00th=[212861], 99.50th=[261096], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 28, max= 606, per=25.38%, avg=283.74, stdev=121.83, samples=43 iops : min= 1, max= 37, avg=16.98, stdev= 7.69, samples=43 lat (usec) : 50=2.08%, 100=8.85%, 250=3.26%, 500=0.52% lat (msec) : 2=3.78%, 4=5.47%, 10=12.76%, 20=12.11%, 50=33.98% lat (msec) : 100=14.06%, 250=2.86%, 500=0.26% cpu : usr=0.10%, sys=7.45%, ctx=1459, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1063KiB/s (1088kB/s), 259KiB/s-289KiB/s (265kB/s-295kB/s), io=23.4MiB (24.5MB), run=21684-22538msec WRITE: bw=1118KiB/s (1145kB/s), 278KiB/s-295KiB/s (285kB/s-302kB/s), io=24.6MiB (25.8MB), run=21684-22538msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145859: Thu Sep 3 16:40:31 2026 read: IOPS=6, BW=96.2KiB/s (98.5kB/s)(5920KiB/61517msec) clat (msec): min=6, max=179, avg=32.36, stdev=25.63 lat (msec): min=6, max=179, avg=32.37, stdev=25.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 63], 95.00th=[ 91], | 99.00th=[ 123], 99.50th=[ 178], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 31, max= 381, per=26.78%, avg=103.63, stdev=61.77, samples=113 iops : min= 1, max= 23, avg= 5.74, stdev= 3.96, samples=113 write: IOPS=6, BW=104KiB/s (106kB/s)(6368KiB/61517msec); 0 zone resets clat (msec): min=43, max=391, avg=124.31, stdev=49.67 lat (msec): min=43, max=391, avg=124.32, stdev=49.67 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 142], 80.00th=[ 157], 90.00th=[ 194], 95.00th=[ 226], | 99.00th=[ 279], 99.50th=[ 305], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 28, max= 223, per=25.33%, avg=103.11, stdev=40.88, samples=122 iops : min= 1, max= 13, avg= 5.71, stdev= 2.68, samples=122 lat (msec) : 10=3.26%, 20=15.89%, 50=20.96%, 100=25.26%, 250=33.33% lat (msec) : 500=1.30% cpu : usr=0.03%, sys=1.40%, ctx=1351, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145860: Thu Sep 3 16:40:31 2026 read: IOPS=5, BW=92.0KiB/s (95.2kB/s)(5744KiB/61771msec) clat (msec): min=6, max=161, avg=33.18, stdev=23.27 lat (msec): min=6, max=161, avg=33.18, stdev=23.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 62], 95.00th=[ 82], | 99.00th=[ 111], 99.50th=[ 155], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 28, max= 412, per=26.42%, avg=102.24, stdev=68.34, samples=110 iops : min= 1, max= 25, avg= 5.67, stdev= 4.34, samples=110 write: IOPS=6, BW=106KiB/s (108kB/s)(6544KiB/61771msec); 0 zone resets clat (msec): min=47, max=352, avg=121.20, stdev=48.16 lat (msec): min=47, max=352, avg=121.20, stdev=48.16 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 94], 40.00th=[ 102], 50.00th=[ 115], 60.00th=[ 126], | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 180], 95.00th=[ 205], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 28, max= 192, per=25.78%, avg=104.93, stdev=35.21, samples=122 iops : min= 1, max= 12, avg= 5.83, stdev= 2.32, samples=122 lat (msec) : 10=2.86%, 20=13.28%, 50=23.18%, 100=26.56%, 250=33.20% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.41%, ctx=1357, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145861: Thu Sep 3 16:40:31 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(6256KiB/58781msec) clat (msec): min=6, max=186, avg=33.80, stdev=25.64 lat (msec): min=6, max=186, avg=33.80, stdev=25.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 88], | 99.00th=[ 140], 99.50th=[ 146], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 352, per=28.59%, avg=110.62, stdev=74.11, samples=112 iops : min= 1, max= 22, avg= 6.19, stdev= 4.68, samples=112 write: IOPS=6, BW=103KiB/s (105kB/s)(6032KiB/58781msec); 0 zone resets clat (msec): min=40, max=321, avg=120.44, stdev=47.40 lat (msec): min=40, max=321, avg=120.45, stdev=47.40 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 125], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 182], 95.00th=[ 222], | 99.00th=[ 264], 99.50th=[ 309], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 192, per=25.03%, avg=101.86, stdev=37.78, samples=116 iops : min= 1, max= 12, avg= 5.63, stdev= 2.48, samples=116 lat (msec) : 10=3.78%, 20=14.19%, 50=25.00%, 100=24.74%, 250=31.25% lat (msec) : 500=1.04% cpu : usr=0.03%, sys=1.59%, ctx=1485, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145862: Thu Sep 3 16:40:31 2026 read: IOPS=6, BW=98.9KiB/s (101kB/s)(6032KiB/60972msec) clat (msec): min=5, max=189, avg=34.06, stdev=27.06 lat (msec): min=5, max=189, avg=34.06, stdev=27.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 81], | 99.00th=[ 165], 99.50th=[ 180], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 318, per=27.36%, avg=105.87, stdev=64.60, samples=112 iops : min= 1, max= 19, avg= 5.89, stdev= 4.16, samples=112 write: IOPS=6, BW=103KiB/s (105kB/s)(6256KiB/60972msec); 0 zone resets clat (msec): min=42, max=324, avg=122.23, stdev=47.94 lat (msec): min=42, max=324, avg=122.23, stdev=47.95 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 82], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 126], | 70.00th=[ 138], 80.00th=[ 159], 90.00th=[ 192], 95.00th=[ 218], | 99.00th=[ 259], 99.50th=[ 300], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 29, max= 192, per=25.37%, avg=103.27, stdev=38.81, samples=120 iops : min= 1, max= 12, avg= 5.72, stdev= 2.52, samples=120 lat (msec) : 10=2.73%, 20=12.89%, 50=26.17%, 100=24.74%, 250=32.68% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.50%, ctx=1401, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=388KiB/s (397kB/s), 92.0KiB/s-106KiB/s (95.2kB/s-109kB/s), io=23.4MiB (24.5MB), run=58781-61771msec WRITE: bw=408KiB/s (418kB/s), 103KiB/s-106KiB/s (105kB/s-108kB/s), io=24.6MiB (25.8MB), run=58781-61771msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145885: Thu Sep 3 16:40:49 2026 read: IOPS=1, BW=1314KiB/s (1346kB/s)(7168KiB/5454msec) clat (usec): min=531, max=3309.3k, avg=617784.86, stdev=1191486.56 lat (usec): min=532, max=3309.3k, avg=617786.29, stdev=1191486.40 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], | 20.00th=[ 117965], 30.00th=[ 152044], 40.00th=[ 152044], | 50.00th=[ 185598], 60.00th=[ 206570], 70.00th=[ 206570], | 80.00th=[ 350225], 90.00th=[3305112], 95.00th=[3305112], | 99.00th=[3305112], 99.50th=[3305112], 99.90th=[3305112], | 99.95th=[3305112], 99.99th=[3305112] bw ( KiB/s): min= 1828, max= 2748, per=100.00%, avg=2120.60, stdev=360.49, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=939KiB/s (961kB/s)(5120KiB/5454msec); 0 zone resets clat (msec): min=138, max=230, avg=201.29, stdev=35.97 lat (msec): min=138, max=230, avg=201.59, stdev=36.09 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 2019, max= 3657, per=96.33%, avg=2573.00, stdev=938.85, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=75.00%, 500=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=10.07%, ctx=641, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145886: Thu Sep 3 16:40:49 2026 read: IOPS=0, BW=198KiB/s (202kB/s)(2048KiB/10366msec) clat (usec): min=500, max=130906, avg=65703.63, stdev=92210.81 lat (usec): min=502, max=130909, avg=65705.66, stdev=92211.83 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[130548], | 70.00th=[130548], 80.00th=[130548], 90.00th=[130548], 95.00th=[130548], | 99.00th=[130548], 99.50th=[130548], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 1389, max= 2035, per=89.73%, avg=1712.00, stdev=456.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=988KiB/s (1012kB/s)(10.0MiB/10366msec); 0 zone resets clat (msec): min=150, max=3289, avg=1021.58, stdev=1163.34 lat (msec): min=150, max=3289, avg=1021.73, stdev=1163.50 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 155], | 30.00th=[ 215], 40.00th=[ 409], 50.00th=[ 493], 60.00th=[ 735], | 70.00th=[ 751], 80.00th=[ 986], 90.00th=[ 3037], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 1828, max= 4087, per=87.11%, avg=2326.67, stdev=866.47, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=16.67%, 750=8.33%, 1000=16.67%, >=2000=16.67% cpu : usr=0.03%, sys=5.29%, ctx=152, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145887: Thu Sep 3 16:40:49 2026 read: IOPS=0, BW=572KiB/s (586kB/s)(6144KiB/10732msec) clat (msec): min=3, max=3896, avg=819.88, stdev=1510.81 lat (msec): min=3, max=3896, avg=819.88, stdev=1510.81 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 284], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1828, max= 5796, per=100.00%, avg=3222.33, stdev=2231.45, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=572KiB/s (586kB/s)(6144KiB/10732msec); 0 zone resets clat (msec): min=117, max=3485, avg=954.62, stdev=1280.55 lat (msec): min=117, max=3485, avg=954.70, stdev=1280.55 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 584], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1932, max= 2801, per=82.43%, avg=2201.75, stdev=402.58, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=4.93%, ctx=573, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145888: Thu Sep 3 16:40:49 2026 read: IOPS=0, BW=578KiB/s (592kB/s)(5120KiB/8863msec) clat (usec): min=487, max=3528.7k, avg=826854.94, stdev=1518154.88 lat (usec): min=488, max=3528.7k, avg=826856.09, stdev=1518154.75 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], | 20.00th=[ 490], 30.00th=[ 3523], 40.00th=[ 3523], | 50.00th=[ 250610], 60.00th=[ 250610], 70.00th=[ 350225], | 80.00th=[ 350225], 90.00th=[3539993], 95.00th=[3539993], | 99.00th=[3539993], 99.50th=[3539993], 99.90th=[3539993], | 99.95th=[3539993], 99.99th=[3539993] bw ( KiB/s): min= 1828, max= 4071, per=100.00%, avg=2639.33, stdev=1243.53, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=809KiB/s (828kB/s)(7168KiB/8863msec); 0 zone resets clat (msec): min=127, max=3594, avg=669.34, stdev=1290.37 lat (msec): min=127, max=3594, avg=669.41, stdev=1290.38 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 136], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 192], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 255], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1462, max= 4087, per=100.00%, avg=2862.00, stdev=1413.21, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, >=2000=16.67% cpu : usr=0.00%, sys=5.07%, ctx=119, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1908KiB/s (1954kB/s), 198KiB/s-1314KiB/s (202kB/s-1346kB/s), io=20.0MiB (20.0MB), run=5454-10732msec WRITE: bw=2672KiB/s (2736kB/s), 572KiB/s-988KiB/s (586kB/s-1012kB/s), io=28.0MiB (29.4MB), run=5454-10732msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145890: Thu Sep 3 16:40:49 2026 read: IOPS=0, BW=706KiB/s (723kB/s)(7168KiB/10148msec) clat (msec): min=80, max=4003, avg=1127.02, stdev=1709.02 lat (msec): min=80, max=4003, avg=1127.02, stdev=1709.02 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 106], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 176], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 3205], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 2019, max= 4071, per=100.00%, avg=3037.00, stdev=1161.90, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=505KiB/s (517kB/s)(5120KiB/10148msec); 0 zone resets clat (msec): min=230, max=653, avg=436.21, stdev=185.96 lat (msec): min=230, max=653, avg=436.27, stdev=185.94 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2035, max= 4039, per=90.87%, avg=2539.00, stdev=1000.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=1.83%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145891: Thu Sep 3 16:40:49 2026 read: IOPS=0, BW=201KiB/s (206kB/s)(2048KiB/10182msec) clat (msec): min=96, max=135, avg=115.99, stdev=27.45 lat (msec): min=96, max=135, avg=115.99, stdev=27.45 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 136], 90.00th=[ 136], 95.00th=[ 136], | 99.00th=[ 136], 99.50th=[ 136], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 1368, max= 2019, per=84.84%, avg=1693.50, stdev=460.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=1006KiB/s (1030kB/s)(10.0MiB/10182msec); 0 zone resets clat (msec): min=139, max=4076, avg=987.27, stdev=1378.44 lat (msec): min=139, max=4078, avg=987.60, stdev=1378.94 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 161], | 30.00th=[ 192], 40.00th=[ 351], 50.00th=[ 359], 60.00th=[ 384], | 70.00th=[ 447], 80.00th=[ 776], 90.00th=[ 3004], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 1943, max= 4039, per=84.10%, avg=2349.67, stdev=828.36, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=2.03%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145892: Thu Sep 3 16:40:49 2026 read: IOPS=0, BW=599KiB/s (613kB/s)(6144KiB/10260msec) clat (msec): min=77, max=3215, avg=625.15, stdev=1269.30 lat (msec): min=77, max=3215, avg=625.15, stdev=1269.30 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 109], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2027, max= 4087, per=100.00%, avg=2715.00, stdev=1188.19, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=599KiB/s (613kB/s)(6144KiB/10260msec); 0 zone resets clat (msec): min=191, max=3968, avg=1069.52, stdev=1470.26 lat (msec): min=192, max=3968, avg=1069.64, stdev=1470.25 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 642], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 2027, max= 2860, per=82.68%, avg=2310.00, stdev=476.38, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 750=8.33%, 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.53%, ctx=71, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145893: Thu Sep 3 16:40:49 2026 read: IOPS=0, BW=539KiB/s (552kB/s)(5120KiB/9491msec) clat (msec): min=66, max=3032, avg=684.13, stdev=1313.00 lat (msec): min=66, max=3032, avg=684.13, stdev=1313.00 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 74], 40.00th=[ 74], 50.00th=[ 102], 60.00th=[ 102], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 2019, max= 4087, per=100.00%, avg=2713.67, stdev=1189.37, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=755KiB/s (773kB/s)(7168KiB/9491msec); 0 zone resets clat (msec): min=172, max=4047, avg=856.84, stdev=1410.67 lat (msec): min=172, max=4047, avg=856.91, stdev=1410.67 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 245], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 372], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 481], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 1456, max= 4087, per=83.38%, avg=2329.60, stdev=1013.92, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.26%, ctx=63, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1996KiB/s (2044kB/s), 201KiB/s-706KiB/s (206kB/s-723kB/s), io=20.0MiB (20.0MB), run=9491-10260msec WRITE: bw=2795KiB/s (2862kB/s), 505KiB/s-1006KiB/s (517kB/s-1030kB/s), io=28.0MiB (29.4MB), run=9491-10260msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145901: Thu Sep 3 16:41:06 2026 read: IOPS=1, BW=7912KiB/s (8102kB/s)(12.0MiB/1553msec) clat (msec): min=289, max=681, avg=492.85, stdev=196.46 lat (msec): min=289, max=681, avg=492.85, stdev=196.46 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5557, max= 8192, per=100.00%, avg=6874.50, stdev=1863.23, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.19%, sys=9.09%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145903: Thu Sep 3 16:41:06 2026 read: IOPS=0, BW=1085KiB/s (1111kB/s)(4096KiB/3776msec) clat (nsec): min=826759k, max=826759k, avg=826759289.00, stdev= 0.00 lat (nsec): min=826761k, max=826761k, avg=826761040.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2169KiB/s (2222kB/s)(8192KiB/3776msec); 0 zone resets clat (msec): min=1408, max=1484, avg=1446.44, stdev=53.26 lat (msec): min=1409, max=1484, avg=1446.67, stdev=53.16 clat percentiles (msec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7846, max= 7846, per=90.42%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.08%, sys=3.66%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145904: Thu Sep 3 16:41:06 2026 write: IOPS=0, BW=3453KiB/s (3536kB/s)(12.0MiB/3559msec); 0 zone resets clat (msec): min=646, max=1553, avg=1125.05, stdev=455.24 lat (msec): min=650, max=1553, avg=1126.39, stdev=453.44 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8078, max= 8078, per=93.10%, avg=8078.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.06%, sys=6.13%, ctx=57, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145905: Thu Sep 3 16:41:06 2026 write: IOPS=1, BW=5107KiB/s (5230kB/s)(12.0MiB/2406msec); 0 zone resets clat (msec): min=238, max=1842, avg=774.60, stdev=924.88 lat (msec): min=238, max=1844, avg=775.41, stdev=925.47 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8078, max= 8175, per=93.66%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.04%, sys=7.86%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4339KiB/s (4443kB/s), 1085KiB/s-7912KiB/s (1111kB/s-8102kB/s), io=16.0MiB (16.8MB), run=1553-3776msec WRITE: bw=8678KiB/s (8886kB/s), 2169KiB/s-5107KiB/s (2222kB/s-5230kB/s), io=32.0MiB (33.6MB), run=2406-3776msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145906: Thu Sep 3 16:41:06 2026 read: IOPS=1, BW=4703KiB/s (4816kB/s)(12.0MiB/2613msec) clat (msec): min=739, max=1040, avg=849.56, stdev=165.80 lat (msec): min=739, max=1040, avg=849.56, stdev=165.80 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7907, max= 8031, per=100.00%, avg=7969.00, stdev=87.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=17.30%, ctx=396, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145907: Thu Sep 3 16:41:06 2026 read: IOPS=0, BW=1707KiB/s (1748kB/s)(4096KiB/2400msec) clat (nsec): min=530136k, max=530136k, avg=530135673.00, stdev= 0.00 lat (nsec): min=530138k, max=530138k, avg=530138338.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3413KiB/s (3495kB/s)(8192KiB/2400msec); 0 zone resets clat (msec): min=468, max=1186, avg=827.44, stdev=508.32 lat (msec): min=468, max=1187, avg=827.74, stdev=508.32 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7922, max= 7922, per=91.53%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=9.17%, ctx=108, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145908: Thu Sep 3 16:41:06 2026 write: IOPS=0, BW=3246KiB/s (3324kB/s)(12.0MiB/3786msec); 0 zone resets clat (msec): min=416, max=1672, avg=1223.67, stdev=700.27 lat (msec): min=417, max=1673, avg=1224.02, stdev=700.27 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8062, max= 8126, per=93.52%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.06%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145909: Thu Sep 3 16:41:06 2026 write: IOPS=1, BW=4336KiB/s (4440kB/s)(12.0MiB/2834msec); 0 zone resets clat (msec): min=460, max=1231, avg=863.24, stdev=386.26 lat (msec): min=461, max=1231, avg=863.57, stdev=386.21 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 5572, max= 8031, per=78.58%, avg=6801.50, stdev=1738.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.80%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6270KiB/s (6421kB/s), 1707KiB/s-4703KiB/s (1748kB/s-4816kB/s), io=16.0MiB (16.8MB), run=2400-2613msec WRITE: bw=8655KiB/s (8863kB/s), 3246KiB/s-4336KiB/s (3324kB/s-4440kB/s), io=32.0MiB (33.6MB), run=2400-3786msec