== sanity test 398b: DIO and buffer IO race ============== 16:46:37 (1788468397) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.34061 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145604: Thu Sep 3 16:49:16 2026 read: IOPS=10, BW=43.5KiB/s (44.6kB/s)(5992KiB/137591msec) clat (usec): min=35, max=889499, avg=44889.41, stdev=41780.95 lat (usec): min=35, max=889501, avg=44899.68, stdev=41777.38 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 84], 10.00th=[ 13304], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 31327], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[168821], 99.50th=[217056], 99.90th=[492831], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 102, per=25.18%, avg=43.56, stdev=20.59, samples=267 iops : min= 1, max= 25, avg=10.24, stdev= 5.19, samples=267 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6296KiB/137591msec); 0 zone resets clat (usec): min=985, max=445367, avg=44486.37, stdev=47991.69 lat (usec): min=986, max=445370, avg=44491.94, stdev=47992.25 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1483], 10.00th=[ 2540], 20.00th=[ 5604], | 30.00th=[ 9896], 40.00th=[ 21627], 50.00th=[ 32113], 60.00th=[ 43254], | 70.00th=[ 57410], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[128451], | 99.00th=[229639], 99.50th=[274727], 99.90th=[383779], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 111, per=25.15%, avg=45.52, stdev=21.13, samples=269 iops : min= 1, max= 27, avg=10.73, stdev= 5.33, samples=269 lat (usec) : 50=0.29%, 100=2.64%, 250=0.59%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.97%, 4=3.71%, 10=8.07%, 20=8.85%, 50=38.05% lat (msec) : 100=25.46%, 250=7.58%, 500=0.49%, 1000=0.03% cpu : usr=0.11%, sys=5.42%, ctx=6983, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145605: Thu Sep 3 16:49:16 2026 read: IOPS=10, BW=43.0KiB/s (44.1kB/s)(5940KiB/138077msec) clat (usec): min=34, max=935811, avg=45287.44, stdev=41478.09 lat (usec): min=34, max=935814, avg=45298.60, stdev=41477.91 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 81], 10.00th=[ 13304], 20.00th=[ 20317], | 30.00th=[ 26346], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[108528], | 99.00th=[166724], 99.50th=[214959], 99.90th=[329253], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 110, per=25.14%, avg=43.49, stdev=20.85, samples=265 iops : min= 1, max= 27, avg=10.23, stdev= 5.25, samples=265 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6348KiB/138077msec); 0 zone resets clat (usec): min=1051, max=423709, avg=44455.58, stdev=51077.04 lat (usec): min=1053, max=423709, avg=44459.67, stdev=51077.92 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1516], 10.00th=[ 2507], 20.00th=[ 5211], | 30.00th=[ 9634], 40.00th=[ 18482], 50.00th=[ 29230], 60.00th=[ 41157], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[107480], 95.00th=[139461], | 99.00th=[233833], 99.50th=[295699], 99.90th=[421528], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 120, per=25.14%, avg=45.51, stdev=22.91, samples=270 iops : min= 1, max= 30, avg=10.74, stdev= 5.78, samples=270 lat (usec) : 50=0.26%, 100=2.70%, 250=0.52%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.26%, 4=3.97%, 10=8.11%, 20=10.38%, 50=36.75% lat (msec) : 100=23.93%, 250=8.43%, 500=0.46%, 1000=0.03% cpu : usr=0.10%, sys=5.36%, ctx=6831, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145606: Thu Sep 3 16:49:16 2026 read: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6028KiB/138538msec) clat (usec): min=34, max=274443, avg=43433.19, stdev=32045.16 lat (usec): min=34, max=274445, avg=43437.83, stdev=32046.38 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 78], 10.00th=[ 12780], 20.00th=[ 21627], | 30.00th=[ 27132], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[154141], 99.50th=[204473], 99.90th=[248513], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 104, per=25.30%, avg=43.76, stdev=20.29, samples=267 iops : min= 1, max= 26, avg=10.29, stdev= 5.14, samples=267 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6260KiB/138538msec); 0 zone resets clat (usec): min=1046, max=1051.9k, avg=46543.94, stdev=55785.24 lat (usec): min=1046, max=1051.9k, avg=46553.53, stdev=55786.30 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1500], 10.00th=[ 2704], | 20.00th=[ 5735], 30.00th=[ 10814], 40.00th=[ 21627], | 50.00th=[ 31589], 60.00th=[ 43779], 70.00th=[ 57410], | 80.00th=[ 76022], 90.00th=[ 107480], 95.00th=[ 141558], | 99.00th=[ 248513], 99.50th=[ 287310], 99.90th=[ 404751], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 126, per=24.76%, avg=44.81, stdev=20.44, samples=271 iops : min= 1, max= 31, avg=10.55, stdev= 5.13, samples=271 lat (usec) : 50=0.13%, 100=3.35%, 250=0.46%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.97%, 4=4.13%, 10=7.03%, 20=8.66%, 50=38.31% lat (msec) : 100=25.42%, 250=7.88%, 500=0.49%, 2000=0.03% cpu : usr=0.10%, sys=5.28%, ctx=6945, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145607: Thu Sep 3 16:49:16 2026 read: IOPS=10, BW=43.9KiB/s (44.0kB/s)(6052KiB/137783msec) clat (usec): min=34, max=333678, avg=43384.32, stdev=32807.41 lat (usec): min=35, max=333680, avg=43388.88, stdev=32807.83 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 74], 10.00th=[ 10290], 20.00th=[ 21103], | 30.00th=[ 26346], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[102237], | 99.00th=[139461], 99.50th=[214959], 99.90th=[312476], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 112, per=25.74%, avg=44.53, stdev=20.67, samples=265 iops : min= 1, max= 28, avg=10.48, stdev= 5.22, samples=265 write: IOPS=11, BW=45.3KiB/s (46.3kB/s)(6236KiB/137783msec); 0 zone resets clat (usec): min=1067, max=1079.8k, avg=46078.76, stdev=56916.70 lat (usec): min=1069, max=1079.8k, avg=46082.07, stdev=56916.32 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1549], 10.00th=[ 2671], | 20.00th=[ 5932], 30.00th=[ 11338], 40.00th=[ 21890], | 50.00th=[ 31327], 60.00th=[ 42206], 70.00th=[ 57410], | 80.00th=[ 74974], 90.00th=[ 105382], 95.00th=[ 132645], | 99.00th=[ 231736], 99.50th=[ 287310], 99.90th=[ 566232], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 104, per=25.05%, avg=45.33, stdev=20.72, samples=268 iops : min= 1, max= 26, avg=10.69, stdev= 5.23, samples=268 lat (usec) : 50=0.42%, 100=3.35%, 250=0.59%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=3.55%, 4=3.58%, 10=7.58%, 20=8.59%, 50=38.48% lat (msec) : 100=25.26%, 250=7.88%, 500=0.42%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.28%, ctx=6809, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=173KiB/s (177kB/s), 43.0KiB/s-43.9KiB/s (44.1kB/s-44.0kB/s), io=23.4MiB (24.6MB), run=137591-138538msec WRITE: bw=181KiB/s (186kB/s), 45.2KiB/s-45.0KiB/s (46.3kB/s-47.1kB/s), io=24.6MiB (25.7MB), run=137591-138538msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145599: Thu Sep 3 16:51:52 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(5992KiB/295073msec) clat (msec): min=5, max=993, avg=38.10, stdev=47.94 lat (msec): min=5, max=993, avg=38.11, stdev=47.94 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 79], 95.00th=[ 109], | 99.00th=[ 213], 99.50th=[ 288], 99.90th=[ 558], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 80, per=29.29%, avg=23.72, stdev=16.04, samples=487 iops : min= 1, max= 20, avg= 5.29, stdev= 4.06, samples=487 write: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6296KiB/295073msec); 0 zone resets clat (msec): min=35, max=611, avg=150.88, stdev=74.41 lat (msec): min=35, max=611, avg=150.88, stdev=74.41 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 107], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 197], 90.00th=[ 245], 95.00th=[ 300], | 99.00th=[ 401], 99.50th=[ 460], 99.90th=[ 600], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 48, per=24.85%, avg=21.13, stdev= 9.51, samples=572 iops : min= 1, max= 12, avg= 4.63, stdev= 2.44, samples=572 lat (msec) : 10=2.21%, 20=16.18%, 50=21.48%, 100=18.95%, 250=36.07% lat (msec) : 500=4.88%, 750=0.20%, 1000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5184, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145600: Thu Sep 3 16:51:52 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(5940KiB/295225msec) clat (msec): min=6, max=1030, avg=39.17, stdev=52.06 lat (msec): min=6, max=1030, avg=39.18, stdev=52.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 49], 90.00th=[ 83], 95.00th=[ 115], | 99.00th=[ 203], 99.50th=[ 275], 99.90th=[ 676], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 86, per=29.04%, avg=23.52, stdev=15.57, samples=486 iops : min= 1, max= 21, avg= 5.24, stdev= 3.93, samples=486 write: IOPS=5, BW=21.5KiB/s (22.0kB/s)(6348KiB/295225msec); 0 zone resets clat (msec): min=37, max=607, avg=149.08, stdev=73.20 lat (msec): min=37, max=607, avg=149.08, stdev=73.20 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 239], 95.00th=[ 284], | 99.00th=[ 430], 99.50th=[ 481], 99.90th=[ 584], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 48, per=25.10%, avg=21.33, stdev= 9.48, samples=571 iops : min= 1, max= 12, avg= 4.69, stdev= 2.43, samples=571 lat (msec) : 10=2.18%, 20=15.07%, 50=22.01%, 100=18.49%, 250=37.83% lat (msec) : 500=4.17%, 750=0.23%, 2000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5233, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145601: Thu Sep 3 16:51:52 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6028KiB/295295msec) clat (msec): min=5, max=459, avg=38.38, stdev=40.56 lat (msec): min=5, max=459, avg=38.39, stdev=40.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 107], | 99.00th=[ 184], 99.50th=[ 292], 99.90th=[ 418], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 103, per=27.95%, avg=22.64, stdev=15.40, samples=512 iops : min= 1, max= 25, avg= 5.02, stdev= 3.90, samples=512 write: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6260KiB/295295msec); 0 zone resets clat (msec): min=37, max=1151, avg=151.43, stdev=76.26 lat (msec): min=37, max=1151, avg=151.44, stdev=76.26 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 97], | 30.00th=[ 110], 40.00th=[ 123], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 239], 95.00th=[ 288], | 99.00th=[ 414], 99.50th=[ 464], 99.90th=[ 642], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 48, per=24.87%, avg=21.14, stdev= 9.04, samples=567 iops : min= 1, max= 12, avg= 4.64, stdev= 2.31, samples=567 lat (msec) : 10=2.21%, 20=15.43%, 50=21.52%, 100=18.26%, 250=37.96% lat (msec) : 500=4.46%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5210, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145602: Thu Sep 3 16:51:52 2026 read: IOPS=5, BW=20.5KiB/s (21.0kB/s)(6052KiB/294751msec) clat (msec): min=6, max=671, avg=37.36, stdev=42.01 lat (msec): min=6, max=671, avg=37.36, stdev=42.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 112], | 99.00th=[ 213], 99.50th=[ 275], 99.90th=[ 384], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 88, per=29.58%, avg=23.96, stdev=16.27, samples=487 iops : min= 1, max= 22, avg= 5.35, stdev= 4.09, samples=487 write: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6236KiB/294751msec); 0 zone resets clat (msec): min=42, max=1171, avg=152.51, stdev=80.09 lat (msec): min=42, max=1171, avg=152.52, stdev=80.09 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 169], 80.00th=[ 197], 90.00th=[ 245], 95.00th=[ 300], | 99.00th=[ 451], 99.50th=[ 506], 99.90th=[ 701], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 48, per=24.95%, avg=21.20, stdev= 9.00, samples=564 iops : min= 1, max= 12, avg= 4.65, stdev= 2.31, samples=564 lat (msec) : 10=1.95%, 20=16.15%, 50=22.10%, 100=18.55%, 250=36.39% lat (msec) : 500=4.52%, 750=0.29%, 2000=0.03% cpu : usr=0.05%, sys=1.18%, ctx=5190, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=81.3KiB/s (83.3kB/s), 20.1KiB/s-20.5KiB/s (20.6kB/s-21.0kB/s), io=23.4MiB (24.6MB), run=294751-295295msec WRITE: bw=85.1KiB/s (87.2kB/s), 21.2KiB/s-21.5KiB/s (21.7kB/s-22.0kB/s), io=24.6MiB (25.7MB), run=294751-295295msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145668: Thu Sep 3 16:52:32 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5920KiB/27806msec) clat (usec): min=35, max=253680, avg=34595.95, stdev=32274.57 lat (usec): min=36, max=253682, avg=34597.68, stdev=32274.56 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 86], | 30.00th=[ 15008], 40.00th=[ 26084], 50.00th=[ 32900], 60.00th=[ 40109], | 70.00th=[ 46400], 80.00th=[ 54264], 90.00th=[ 70779], 95.00th=[ 82314], | 99.00th=[164627], 99.50th=[187696], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 572, per=24.39%, avg=208.30, stdev=90.95, samples=54 iops : min= 1, max= 35, avg=12.24, stdev= 5.74, samples=54 write: IOPS=14, BW=229KiB/s (235kB/s)(6368KiB/27806msec); 0 zone resets clat (usec): min=1533, max=342723, avg=37457.50, stdev=42480.88 lat (usec): min=1533, max=342724, avg=37467.58, stdev=42483.10 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2573], 10.00th=[ 3720], 20.00th=[ 6063], | 30.00th=[ 8586], 40.00th=[ 13829], 50.00th=[ 24249], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 60556], 90.00th=[ 88605], 95.00th=[117965], | 99.00th=[179307], 99.50th=[312476], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 63, max= 504, per=25.34%, avg=227.54, stdev=88.23, samples=54 iops : min= 3, max= 31, avg=13.46, stdev= 5.57, samples=54 lat (usec) : 50=1.17%, 100=9.77%, 250=1.69%, 500=0.26% lat (msec) : 2=1.95%, 4=4.17%, 10=12.24%, 20=8.59%, 50=34.11% lat (msec) : 100=20.96%, 250=4.69%, 500=0.39% cpu : usr=0.14%, sys=6.41%, ctx=1481, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145671: Thu Sep 3 16:52:32 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5744KiB/28046msec) clat (usec): min=26, max=200378, avg=36534.56, stdev=32315.26 lat (usec): min=26, max=200379, avg=36547.52, stdev=32323.15 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 71], 10.00th=[ 76], 20.00th=[ 106], | 30.00th=[ 18744], 40.00th=[ 27657], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[141558], 99.50th=[156238], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 22, max= 446, per=24.95%, avg=213.06, stdev=88.01, samples=53 iops : min= 1, max= 27, avg=12.55, stdev= 5.57, samples=53 write: IOPS=14, BW=233KiB/s (239kB/s)(6544KiB/28046msec); 0 zone resets clat (usec): min=1582, max=251105, avg=35545.27, stdev=39559.52 lat (usec): min=1584, max=251109, avg=35573.31, stdev=39541.74 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2933], 10.00th=[ 3851], 20.00th=[ 5604], | 30.00th=[ 8356], 40.00th=[ 12387], 50.00th=[ 19006], 60.00th=[ 32375], | 70.00th=[ 45876], 80.00th=[ 61080], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[189793], 99.50th=[198181], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 44, max= 475, per=26.05%, avg=233.96, stdev=95.56, samples=55 iops : min= 2, max= 29, avg=13.85, stdev= 6.06, samples=55 lat (usec) : 50=0.52%, 100=8.20%, 250=2.34%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=1.30%, 4=5.21%, 10=12.37%, 20=10.81%, 50=30.73% lat (msec) : 100=21.61%, 250=5.73%, 500=0.13% cpu : usr=0.10%, sys=6.79%, ctx=1524, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145673: Thu Sep 3 16:52:32 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26908msec) clat (usec): min=43, max=149617, avg=35687.67, stdev=28339.00 lat (usec): min=43, max=149619, avg=35693.74, stdev=28338.37 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 200], | 30.00th=[ 21627], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[117965], 99.50th=[137364], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 64, max= 411, per=27.57%, avg=235.42, stdev=73.27, samples=52 iops : min= 4, max= 25, avg=13.96, stdev= 4.59, samples=52 write: IOPS=14, BW=224KiB/s (230kB/s)(6032KiB/26908msec); 0 zone resets clat (usec): min=1600, max=330094, avg=33541.61, stdev=35199.06 lat (usec): min=1603, max=330095, avg=33547.59, stdev=35197.32 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2147], 10.00th=[ 3294], 20.00th=[ 5997], | 30.00th=[ 8979], 40.00th=[ 13829], 50.00th=[ 23987], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 56361], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[238027], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 63, max= 446, per=25.33%, avg=227.49, stdev=88.71, samples=51 iops : min= 3, max= 27, avg=13.45, stdev= 5.58, samples=51 lat (usec) : 50=0.65%, 100=7.55%, 250=2.21%, 500=0.26%, 1000=0.26% lat (msec) : 2=1.69%, 4=4.82%, 10=9.77%, 20=9.64%, 50=37.24% lat (msec) : 100=22.79%, 250=2.99%, 500=0.13% cpu : usr=0.09%, sys=6.72%, ctx=1605, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145674: Thu Sep 3 16:52:32 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(6032KiB/26106msec) clat (usec): min=34, max=478613, avg=36365.70, stdev=38059.25 lat (usec): min=34, max=478613, avg=36367.67, stdev=38059.04 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 100], | 30.00th=[ 20317], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[154141], 99.50th=[193987], 99.90th=[480248], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 31, max= 414, per=27.55%, avg=235.24, stdev=86.13, samples=50 iops : min= 1, max= 25, avg=13.96, stdev= 5.46, samples=50 write: IOPS=14, BW=240KiB/s (245kB/s)(6256KiB/26106msec); 0 zone resets clat (usec): min=1549, max=323407, avg=30877.62, stdev=33432.42 lat (usec): min=1551, max=323410, avg=30894.56, stdev=33423.18 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2343], 10.00th=[ 3163], 20.00th=[ 5080], | 30.00th=[ 7046], 40.00th=[ 10814], 50.00th=[ 19268], 60.00th=[ 29230], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[164627], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 478, per=26.76%, avg=240.31, stdev=91.08, samples=51 iops : min= 1, max= 29, avg=14.27, stdev= 5.77, samples=51 lat (usec) : 50=1.17%, 100=8.85%, 250=1.56%, 500=0.13%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=2.08%, 4=5.34%, 10=12.76%, 20=7.68%, 50=35.81% lat (msec) : 100=20.83%, 250=2.99%, 500=0.26% cpu : usr=0.11%, sys=6.94%, ctx=1457, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=854KiB/s (875kB/s), 205KiB/s-232KiB/s (210kB/s-238kB/s), io=23.4MiB (24.5MB), run=26106-28046msec WRITE: bw=899KiB/s (920kB/s), 224KiB/s-240KiB/s (230kB/s-245kB/s), io=24.6MiB (25.8MB), run=26106-28046msec fio: pid=145670, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=145667: Thu Sep 3 16:53:10 2026 read: IOPS=5, BW=88.6KiB/s (90.7kB/s)(5920KiB/66854msec) clat (msec): min=6, max=366, avg=37.30, stdev=37.52 lat (msec): min=6, max=366, avg=37.30, stdev=37.52 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 72], 95.00th=[ 101], | 99.00th=[ 199], 99.50th=[ 239], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 317, per=27.59%, avg=96.27, stdev=60.57, samples=121 iops : min= 1, max= 19, avg= 5.26, stdev= 3.85, samples=121 write: IOPS=5, BW=95.3KiB/s (97.5kB/s)(6368KiB/66854msec); 0 zone resets clat (msec): min=42, max=556, avg=132.93, stdev=68.92 lat (msec): min=42, max=556, avg=132.94, stdev=68.93 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 102], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 174], 90.00th=[ 222], 95.00th=[ 279], | 99.00th=[ 355], 99.50th=[ 531], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 21, max= 191, per=26.11%, avg=95.82, stdev=42.46, samples=131 iops : min= 1, max= 11, avg= 5.22, stdev= 2.69, samples=131 lat (msec) : 10=1.82%, 20=14.84%, 50=22.79%, 100=25.52%, 250=31.38% lat (msec) : 500=3.39%, 750=0.26% cpu : usr=0.05%, sys=1.42%, ctx=1410, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145669: Thu Sep 3 16:53:10 2026 read: IOPS=5, BW=85.9KiB/s (87.0kB/s)(5744KiB/66844msec) clat (msec): min=7, max=206, avg=36.30, stdev=32.29 lat (msec): min=7, max=206, avg=36.31, stdev=32.29 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 79], 95.00th=[ 122], | 99.00th=[ 159], 99.50th=[ 171], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 21, max= 382, per=27.78%, avg=96.94, stdev=66.24, samples=117 iops : min= 1, max= 23, avg= 5.30, stdev= 4.16, samples=117 write: IOPS=6, BW=97.9KiB/s (100kB/s)(6544KiB/66844msec); 0 zone resets clat (msec): min=40, max=357, avg=130.64, stdev=60.30 lat (msec): min=40, max=357, avg=130.65, stdev=60.30 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 113], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 259], | 99.00th=[ 338], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 192, per=26.60%, avg=97.61, stdev=43.52, samples=132 iops : min= 1, max= 12, avg= 5.33, stdev= 2.80, samples=132 lat (msec) : 10=1.17%, 20=14.84%, 50=22.40%, 100=24.74%, 250=33.85% lat (msec) : 500=2.99% cpu : usr=0.05%, sys=1.44%, ctx=1430, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145670: Thu Sep 3 16:53:10 2026 read: IOPS=5, BW=93.5KiB/s (95.7kB/s)(5664KiB/60602msec) clat (msec): min=8, max=419, avg=38.13, stdev=36.02 lat (msec): min=8, max=419, avg=38.13, stdev=36.02 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 97], | 99.00th=[ 171], 99.50th=[ 232], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 29, max= 347, per=29.48%, avg=102.89, stdev=69.78, samples=107 iops : min= 1, max= 21, avg= 5.64, stdev= 4.41, samples=107 write: IOPS=5, BW=89.2KiB/s (91.4kB/s)(5408KiB/60602msec); 0 zone resets clat (msec): min=39, max=460, avg=138.26, stdev=66.03 lat (msec): min=39, max=460, avg=138.27, stdev=66.03 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 86], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 122], 60.00th=[ 134], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 232], 95.00th=[ 271], | 99.00th=[ 326], 99.50th=[ 409], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 22, max= 191, per=24.63%, avg=90.38, stdev=37.43, samples=117 iops : min= 1, max= 11, avg= 4.86, stdev= 2.43, samples=117 lat (msec) : 10=0.87%, 20=13.42%, 50=27.56%, 100=21.79%, 250=32.18% lat (msec) : 500=4.04% cpu : usr=0.05%, sys=1.42%, ctx=1193, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=355,338,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145672: Thu Sep 3 16:53:10 2026 read: IOPS=5, BW=92.6KiB/s (94.8kB/s)(6032KiB/65160msec) clat (msec): min=7, max=294, avg=36.65, stdev=35.29 lat (msec): min=7, max=294, avg=36.65, stdev=35.29 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 75], 95.00th=[ 115], | 99.00th=[ 190], 99.50th=[ 224], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 29, max= 288, per=29.76%, avg=103.85, stdev=63.58, samples=113 iops : min= 1, max= 18, avg= 5.73, stdev= 4.04, samples=113 write: IOPS=6, BW=96.0KiB/s (98.3kB/s)(6256KiB/65160msec); 0 zone resets clat (msec): min=44, max=556, avg=130.15, stdev=60.88 lat (msec): min=44, max=556, avg=130.16, stdev=60.88 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 116], 60.00th=[ 125], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 241], | 99.00th=[ 388], 99.50th=[ 477], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 191, per=26.22%, avg=96.24, stdev=39.79, samples=127 iops : min= 1, max= 11, avg= 5.24, stdev= 2.52, samples=127 lat (msec) : 10=2.08%, 20=15.10%, 50=22.79%, 100=23.31%, 250=34.24% lat (msec) : 500=2.34%, 750=0.13% cpu : usr=0.06%, sys=1.46%, ctx=1361, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=349KiB/s (358kB/s), 85.9KiB/s-93.5KiB/s (87.0kB/s-95.7kB/s), io=22.8MiB (23.9MB), run=60602-66854msec WRITE: bw=368KiB/s (376kB/s), 89.2KiB/s-97.9KiB/s (91.4kB/s-100kB/s), io=24.0MiB (25.2MB), run=60602-66854msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145698: Thu Sep 3 16:53:25 2026 read: IOPS=1, BW=2036KiB/s (2085kB/s)(7168KiB/3520msec) clat (usec): min=645, max=455485, avg=251468.56, stdev=141375.22 lat (usec): min=646, max=455486, avg=251470.20, stdev=141374.94 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[164627], | 30.00th=[246416], 40.00th=[246416], 50.00th=[270533], 60.00th=[299893], | 70.00th=[299893], 80.00th=[325059], 90.00th=[455082], 95.00th=[455082], | 99.00th=[455082], 99.50th=[455082], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 2043, max= 4071, per=77.43%, avg=2806.75, stdev=971.98, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1455KiB/s (1489kB/s)(5120KiB/3520msec); 0 zone resets clat (msec): min=202, max=674, avg=329.11, stdev=200.70 lat (msec): min=202, max=676, avg=329.59, stdev=201.05 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2043, max= 6083, per=80.06%, avg=4063.00, stdev=2856.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=21.06%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145699: Thu Sep 3 16:53:25 2026 read: IOPS=0, BW=363KiB/s (371kB/s)(2048KiB/5649msec) clat (usec): min=1071, max=186231, avg=93651.58, stdev=130927.78 lat (usec): min=1073, max=186235, avg=93654.20, stdev=130929.43 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1074], 10.00th=[ 1074], 20.00th=[ 1074], | 30.00th=[ 1074], 40.00th=[ 1074], 50.00th=[ 1074], 60.00th=[185598], | 70.00th=[185598], 80.00th=[185598], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 1460, max= 2043, per=48.32%, avg=1751.50, stdev=412.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1813KiB/s (1856kB/s)(10.0MiB/5649msec); 0 zone resets clat (msec): min=308, max=880, avg=541.69, stdev=211.05 lat (msec): min=308, max=880, avg=541.91, stdev=211.00 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 330], | 30.00th=[ 401], 40.00th=[ 422], 50.00th=[ 477], 60.00th=[ 489], | 70.00th=[ 493], 80.00th=[ 785], 90.00th=[ 835], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2035, max= 4055, per=51.21%, avg=2599.00, stdev=952.63, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 2=8.33%, 250=8.33%, 500=58.33%, 1000=25.00% cpu : usr=0.02%, sys=13.70%, ctx=170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145700: Thu Sep 3 16:53:25 2026 read: IOPS=1, BW=1519KiB/s (1555kB/s)(6144KiB/4046msec) clat (usec): min=865, max=248045, avg=98505.46, stdev=100118.24 lat (usec): min=866, max=248046, avg=98506.86, stdev=100118.30 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 865], 10.00th=[ 865], 20.00th=[ 1876], | 30.00th=[ 1876], 40.00th=[ 48497], 50.00th=[ 48497], 60.00th=[114820], | 70.00th=[177210], 80.00th=[177210], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 2043, max= 8110, per=100.00%, avg=5076.50, stdev=4290.02, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1519KiB/s (1555kB/s)(6144KiB/4046msec); 0 zone resets clat (msec): min=251, max=1434, avg=554.03, stdev=451.41 lat (msec): min=251, max=1435, avg=554.26, stdev=451.75 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 430], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 1535, max= 4055, per=47.67%, avg=2419.00, stdev=1116.65, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=11.69%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145701: Thu Sep 3 16:53:25 2026 read: IOPS=1, BW=1365KiB/s (1397kB/s)(5120KiB/3752msec) clat (usec): min=609, max=295544, avg=208764.01, stdev=119305.34 lat (usec): min=611, max=295545, avg=208765.48, stdev=119305.16 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[221250], 40.00th=[221250], 50.00th=[258999], 60.00th=[258999], | 70.00th=[265290], 80.00th=[265290], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 1706, max= 6083, per=100.00%, avg=3894.50, stdev=3095.01, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1910KiB/s (1956kB/s)(7168KiB/3752msec); 0 zone resets clat (msec): min=65, max=591, avg=374.96, stdev=181.29 lat (msec): min=65, max=591, avg=375.07, stdev=181.27 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 251], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 430], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 518], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1539, max= 4087, per=44.97%, avg=2282.00, stdev=1031.99, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=17.14%, ctx=187, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3625KiB/s (3712kB/s), 363KiB/s-2036KiB/s (371kB/s-2085kB/s), io=20.0MiB (20.0MB), run=3520-5649msec WRITE: bw=5076KiB/s (5197kB/s), 1455KiB/s-1910KiB/s (1489kB/s-1956kB/s), io=28.0MiB (29.4MB), run=3520-5649msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145703: Thu Sep 3 16:53:25 2026 read: IOPS=1, BW=1442KiB/s (1477kB/s)(7168KiB/4971msec) clat (msec): min=95, max=799, avg=343.60, stdev=265.65 lat (msec): min=95, max=799, avg=343.61, stdev=265.65 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 134], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 234], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 558], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1633, max= 3778, per=63.55%, avg=2293.00, stdev=846.83, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1030KiB/s (1055kB/s)(5120KiB/4971msec); 0 zone resets clat (msec): min=358, max=683, avg=489.85, stdev=119.59 lat (msec): min=358, max=683, avg=490.06, stdev=119.72 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1889, max= 2035, per=39.18%, avg=1978.75, stdev=62.96, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.04%, sys=4.31%, ctx=71, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145704: Thu Sep 3 16:53:25 2026 read: IOPS=0, BW=374KiB/s (383kB/s)(2048KiB/5472msec) clat (msec): min=85, max=368, avg=227.15, stdev=200.16 lat (msec): min=85, max=368, avg=227.15, stdev=200.16 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 86], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1617, max= 2003, per=50.17%, avg=1810.00, stdev=272.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1871KiB/s (1916kB/s)(10.0MiB/5472msec); 0 zone resets clat (msec): min=200, max=1321, avg=495.36, stdev=373.89 lat (msec): min=200, max=1321, avg=495.49, stdev=373.89 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 205], | 30.00th=[ 230], 40.00th=[ 232], 50.00th=[ 279], 60.00th=[ 355], | 70.00th=[ 600], 80.00th=[ 634], 90.00th=[ 902], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2003, max= 6059, per=59.83%, avg=3021.83, stdev=1680.37, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=4.97%, ctx=84, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145705: Thu Sep 3 16:53:25 2026 read: IOPS=1, BW=1188KiB/s (1217kB/s)(6144KiB/5170msec) clat (msec): min=81, max=444, avg=225.76, stdev=134.62 lat (msec): min=81, max=444, avg=225.76, stdev=134.62 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 253], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1996, max= 3976, per=69.36%, avg=2502.50, stdev=982.48, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1188KiB/s (1217kB/s)(6144KiB/5170msec); 0 zone resets clat (msec): min=297, max=1592, avg=617.93, stdev=485.63 lat (msec): min=297, max=1592, avg=618.05, stdev=485.61 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 523], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1889, max= 4071, per=49.29%, avg=2489.75, stdev=1055.46, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.48%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145706: Thu Sep 3 16:53:25 2026 read: IOPS=0, BW=902KiB/s (924kB/s)(5120KiB/5676msec) clat (msec): min=122, max=247, avg=160.63, stdev=51.02 lat (msec): min=122, max=247, avg=160.63, stdev=51.02 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 1996, max= 6107, per=100.00%, avg=4051.50, stdev=2906.92, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1263KiB/s (1293kB/s)(7168KiB/5676msec); 0 zone resets clat (msec): min=158, max=1418, avg=671.72, stdev=448.55 lat (msec): min=158, max=1419, avg=672.07, stdev=449.05 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 667], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 986], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1889, max= 2035, per=39.33%, avg=1986.80, stdev=57.42, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=58.33%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.41%, ctx=109, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3608KiB/s (3695kB/s), 374KiB/s-1442KiB/s (383kB/s-1477kB/s), io=20.0MiB (20.0MB), run=4971-5676msec WRITE: bw=5051KiB/s (5173kB/s), 1030KiB/s-1871KiB/s (1055kB/s-1916kB/s), io=28.0MiB (29.4MB), run=4971-5676msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145714: Thu Sep 3 16:53:42 2026 read: IOPS=0, BW=3327KiB/s (3407kB/s)(12.0MiB/3693msec) clat (msec): min=594, max=2051, avg=1213.72, stdev=752.96 lat (msec): min=594, max=2051, avg=1213.72, stdev=752.96 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.95%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145715: Thu Sep 3 16:53:42 2026 read: IOPS=0, BW=815KiB/s (835kB/s)(4096KiB/5023msec) clat (nsec): min=1378.8M, max=1378.8M, avg=1378847495.00, stdev= 0.00 lat (nsec): min=1378.8M, max=1378.8M, avg=1378850169.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1631KiB/s (1670kB/s)(8192KiB/5023msec); 0 zone resets clat (usec): min=1787.9k, max=1788.9k, avg=1788432.12, stdev=708.72 lat (usec): min=1788.4k, max=1789.3k, avg=1788879.38, stdev=611.28 clat percentiles (msec): | 1.00th=[ 1787], 5.00th=[ 1787], 10.00th=[ 1787], 20.00th=[ 1787], | 30.00th=[ 1787], 40.00th=[ 1787], 50.00th=[ 1787], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.62%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145717: Thu Sep 3 16:53:42 2026 write: IOPS=0, BW=2822KiB/s (2889kB/s)(12.0MiB/4355msec); 0 zone resets clat (msec): min=407, max=1940, avg=1388.17, stdev=851.48 lat (msec): min=408, max=1940, avg=1388.66, stdev=851.29 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 1821], 50.00th=[ 1821], 60.00th=[ 1821], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.42%, ctx=44, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145719: Thu Sep 3 16:53:42 2026 write: IOPS=0, BW=3060KiB/s (3133kB/s)(12.0MiB/4016msec); 0 zone resets clat (msec): min=483, max=1843, avg=1245.69, stdev=694.57 lat (msec): min=484, max=1844, avg=1246.87, stdev=694.91 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.10%, sys=3.64%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3262KiB/s (3340kB/s), 815KiB/s-3327KiB/s (835kB/s-3407kB/s), io=16.0MiB (16.8MB), run=3693-5023msec WRITE: bw=6524KiB/s (6680kB/s), 1631KiB/s-3060KiB/s (1670kB/s-3133kB/s), io=32.0MiB (33.6MB), run=4016-5023msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145716: Thu Sep 3 16:53:42 2026 read: IOPS=0, BW=4033KiB/s (4130kB/s)(12.0MiB/3047msec) clat (msec): min=875, max=1049, avg=971.52, stdev=88.40 lat (msec): min=875, max=1049, avg=971.52, stdev=88.40 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.97%, ctx=236, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145718: Thu Sep 3 16:53:42 2026 read: IOPS=0, BW=936KiB/s (959kB/s)(4096KiB/4374msec) clat (nsec): min=761113k, max=761113k, avg=761113089.00, stdev= 0.00 lat (nsec): min=761115k, max=761115k, avg=761115407.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1873KiB/s (1918kB/s)(8192KiB/4374msec); 0 zone resets clat (msec): min=1136, max=2316, avg=1726.61, stdev=834.21 lat (msec): min=1139, max=2316, avg=1728.09, stdev=832.66 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=3.61%, ctx=84, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145720: Thu Sep 3 16:53:42 2026 write: IOPS=0, BW=2465KiB/s (2524kB/s)(12.0MiB/4985msec); 0 zone resets clat (msec): min=383, max=2248, avg=1600.45, stdev=1054.24 lat (msec): min=384, max=2250, avg=1601.77, stdev=1055.20 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 2165], 50.00th=[ 2165], 60.00th=[ 2165], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.87%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145721: Thu Sep 3 16:53:42 2026 write: IOPS=1, BW=4139KiB/s (4238kB/s)(12.0MiB/2969msec); 0 zone resets clat (msec): min=723, max=1240, avg=955.23, stdev=262.59 lat (msec): min=737, max=1242, avg=960.87, stdev=257.44 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.13%, ctx=75, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3746KiB/s (3836kB/s), 936KiB/s-4033KiB/s (959kB/s-4130kB/s), io=16.0MiB (16.8MB), run=3047-4374msec WRITE: bw=6573KiB/s (6731kB/s), 1873KiB/s-4139KiB/s (1918kB/s-4238kB/s), io=32.0MiB (33.6MB), run=2969-4985msec