== sanity test 398b: DIO and buffer IO race ============== 23:53:30 (1781236410) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.70721 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179734: Thu Jun 11 23:55:51 2026 read: IOPS=12, BW=49.8KiB/s (50.9kB/s)(5992KiB/120437msec) clat (usec): min=34, max=222592, avg=43243.75, stdev=27322.06 lat (usec): min=34, max=222594, avg=43250.21, stdev=27325.09 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11207], 10.00th=[ 16909], 20.00th=[ 23200], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[149947], 99.50th=[166724], 99.90th=[204473], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 15, max= 96, per=24.67%, avg=49.08, stdev=18.40, samples=238 iops : min= 3, max= 24, avg=11.61, stdev= 4.62, samples=238 write: IOPS=13, BW=52.3KiB/s (53.5kB/s)(6296KiB/120437msec); 0 zone resets clat (usec): min=1082, max=781587, avg=35111.51, stdev=37661.97 lat (usec): min=1083, max=781589, avg=35115.80, stdev=37661.80 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1565], 10.00th=[ 2442], 20.00th=[ 5276], | 30.00th=[ 9896], 40.00th=[ 19268], 50.00th=[ 27395], 60.00th=[ 35914], | 70.00th=[ 45351], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[158335], 99.90th=[258999], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 119, per=24.90%, avg=51.79, stdev=21.52, samples=237 iops : min= 1, max= 29, avg=12.28, stdev= 5.40, samples=237 lat (usec) : 50=0.20%, 100=1.53%, 250=0.10%, 500=0.07% lat (msec) : 2=4.17%, 4=4.36%, 10=7.32%, 20=10.29%, 50=43.16% lat (msec) : 100=24.67%, 250=4.07%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.01%, ctx=7263, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179735: Thu Jun 11 23:55:51 2026 read: IOPS=12, BW=51.7KiB/s (52.9kB/s)(5940KiB/114948msec) clat (usec): min=43, max=939248, avg=42935.62, stdev=35446.84 lat (usec): min=45, max=939249, avg=42937.37, stdev=35446.88 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 10945], 10.00th=[ 16319], 20.00th=[ 22152], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 60556], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[177210], 99.90th=[295699], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 112, per=25.62%, avg=50.99, stdev=18.53, samples=227 iops : min= 1, max= 28, avg=12.09, stdev= 4.65, samples=227 write: IOPS=13, BW=55.2KiB/s (56.6kB/s)(6348KiB/114948msec); 0 zone resets clat (usec): min=1228, max=262187, avg=31997.32, stdev=31098.47 lat (usec): min=1229, max=262188, avg=32000.17, stdev=31098.20 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1614], 10.00th=[ 2409], 20.00th=[ 4555], | 30.00th=[ 8094], 40.00th=[ 16057], 50.00th=[ 25560], 60.00th=[ 32375], | 70.00th=[ 41681], 80.00th=[ 54789], 90.00th=[ 72877], 95.00th=[ 92799], | 99.00th=[133694], 99.50th=[149947], 99.90th=[217056], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 157, per=26.33%, avg=54.77, stdev=24.07, samples=226 iops : min= 1, max= 39, avg=13.04, stdev= 6.05, samples=226 lat (usec) : 50=0.13%, 100=1.30%, 250=0.52%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.00%, 4=5.47%, 10=8.37%, 20=10.74%, 50=41.34% lat (msec) : 100=24.93%, 250=3.03%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=6.26%, ctx=7133, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179736: Thu Jun 11 23:55:51 2026 read: IOPS=12, BW=51.2KiB/s (52.5kB/s)(6028KiB/117643msec) clat (usec): min=33, max=213567, avg=43297.20, stdev=26841.28 lat (usec): min=33, max=213568, avg=43300.29, stdev=26840.03 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 11994], 10.00th=[ 16712], 20.00th=[ 22414], | 30.00th=[ 27395], 40.00th=[ 33424], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[135267], 99.50th=[156238], 99.90th=[204473], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 119, per=25.53%, avg=50.81, stdev=19.17, samples=231 iops : min= 1, max= 29, avg=12.04, stdev= 4.82, samples=231 write: IOPS=13, BW=53.2KiB/s (54.5kB/s)(6260KiB/117643msec); 0 zone resets clat (usec): min=1031, max=774369, avg=33228.84, stdev=38193.35 lat (usec): min=1032, max=774371, avg=33232.44, stdev=38194.73 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1663], 10.00th=[ 2474], 20.00th=[ 4555], | 30.00th=[ 7767], 40.00th=[ 14877], 50.00th=[ 24249], 60.00th=[ 32375], | 70.00th=[ 41157], 80.00th=[ 56886], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[141558], 99.50th=[168821], 99.90th=[256902], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 7, max= 123, per=25.25%, avg=52.53, stdev=21.66, samples=232 iops : min= 1, max= 30, avg=12.48, stdev= 5.46, samples=232 lat (usec) : 50=0.20%, 100=1.37%, 250=0.26%, 500=0.03%, 750=0.03% lat (msec) : 2=3.42%, 4=5.53%, 10=8.72%, 20=11.00%, 50=41.47% lat (msec) : 100=23.86%, 250=4.04%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.06%, ctx=7072, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179737: Thu Jun 11 23:55:51 2026 read: IOPS=12, BW=51.2KiB/s (52.5kB/s)(6052KiB/118113msec) clat (usec): min=36, max=915148, avg=43183.18, stdev=35326.60 lat (usec): min=36, max=915149, avg=43190.90, stdev=35326.12 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 9110], 10.00th=[ 15664], 20.00th=[ 22414], | 30.00th=[ 27395], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[129500], 99.50th=[166724], 99.90th=[329253], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 108, per=25.52%, avg=50.78, stdev=17.99, samples=232 iops : min= 1, max= 27, avg=12.03, stdev= 4.53, samples=232 write: IOPS=13, BW=52.8KiB/s (54.1kB/s)(6236KiB/118113msec); 0 zone resets clat (usec): min=1227, max=290462, avg=33586.76, stdev=32835.24 lat (usec): min=1228, max=290464, avg=33589.09, stdev=32835.15 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1663], 10.00th=[ 2278], 20.00th=[ 4752], | 30.00th=[ 7832], 40.00th=[ 15664], 50.00th=[ 24773], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 60031], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[131597], 99.50th=[156238], 99.90th=[191890], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 136, per=25.06%, avg=52.12, stdev=19.79, samples=232 iops : min= 1, max= 34, avg=12.38, stdev= 4.99, samples=232 lat (usec) : 50=0.16%, 100=1.60%, 250=0.36%, 500=0.20%, 1000=0.07% lat (msec) : 2=4.26%, 4=4.46%, 10=8.72%, 20=10.68%, 50=40.66% lat (msec) : 100=25.16%, 250=3.58%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=6.17%, ctx=7046, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=199KiB/s (204kB/s), 49.8KiB/s-51.7KiB/s (50.9kB/s-52.9kB/s), io=23.4MiB (24.6MB), run=114948-120437msec WRITE: bw=209KiB/s (214kB/s), 52.3KiB/s-55.2KiB/s (53.5kB/s-56.6kB/s), io=24.6MiB (25.7MB), run=114948-120437msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179739: Thu Jun 11 23:56:30 2026 read: IOPS=9, BW=37.9KiB/s (38.8kB/s)(5992KiB/158161msec) clat (msec): min=5, max=819, avg=41.76, stdev=39.60 lat (msec): min=5, max=819, avg=41.76, stdev=39.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 115], | 99.00th=[ 165], 99.50th=[ 201], 99.90th=[ 264], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 152, per=25.21%, avg=38.07, stdev=24.41, samples=307 iops : min= 1, max= 38, avg= 8.86, stdev= 6.14, samples=307 write: IOPS=9, BW=39.8KiB/s (40.8kB/s)(6296KiB/158161msec); 0 zone resets clat (msec): min=12, max=316, avg=60.62, stdev=40.74 lat (msec): min=12, max=316, avg=60.63, stdev=40.74 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 87], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 205], 99.50th=[ 236], 99.90th=[ 292], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 111, per=24.97%, avg=39.45, stdev=22.71, samples=311 iops : min= 1, max= 27, avg= 9.21, stdev= 5.71, samples=311 lat (msec) : 10=1.14%, 20=14.26%, 50=48.44%, 100=25.10%, 250=10.81% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=2.39%, ctx=5027, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Thu Jun 11 23:56:30 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(5940KiB/157611msec) clat (msec): min=5, max=935, avg=41.02, stdev=40.94 lat (msec): min=5, max=935, avg=41.02, stdev=40.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 86], 95.00th=[ 116], | 99.00th=[ 174], 99.50th=[ 186], 99.90th=[ 226], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 126, per=25.40%, avg=38.36, stdev=23.99, samples=302 iops : min= 1, max= 31, avg= 8.93, stdev= 6.02, samples=302 write: IOPS=10, BW=40.3KiB/s (41.2kB/s)(6348KiB/157611msec); 0 zone resets clat (msec): min=10, max=425, avg=60.85, stdev=40.30 lat (msec): min=10, max=425, avg=60.85, stdev=40.30 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 70], 80.00th=[ 88], 90.00th=[ 112], 95.00th=[ 136], | 99.00th=[ 199], 99.50th=[ 247], 99.90th=[ 288], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 111, per=25.21%, avg=39.84, stdev=21.75, samples=311 iops : min= 1, max= 27, avg= 9.30, stdev= 5.46, samples=311 lat (msec) : 10=1.11%, 20=13.93%, 50=48.05%, 100=25.81%, 250=10.84% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.41%, ctx=5000, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179741: Thu Jun 11 23:56:30 2026 read: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6028KiB/157519msec) clat (msec): min=5, max=258, avg=41.17, stdev=34.00 lat (msec): min=5, max=258, avg=41.17, stdev=34.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 91], 95.00th=[ 116], | 99.00th=[ 155], 99.50th=[ 180], 99.90th=[ 230], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 7, max= 127, per=25.33%, avg=38.25, stdev=24.17, samples=306 iops : min= 1, max= 31, avg= 8.91, stdev= 6.07, samples=306 write: IOPS=9, BW=39.7KiB/s (40.7kB/s)(6260KiB/157519msec); 0 zone resets clat (msec): min=13, max=951, avg=60.89, stdev=46.11 lat (msec): min=13, max=951, avg=60.89, stdev=46.11 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 220], 99.50th=[ 239], 99.90th=[ 330], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 111, per=24.86%, avg=39.27, stdev=22.86, samples=309 iops : min= 1, max= 27, avg= 9.16, stdev= 5.75, samples=309 lat (msec) : 10=1.46%, 20=14.49%, 50=48.27%, 100=24.41%, 250=11.17% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=2.36%, ctx=4966, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Thu Jun 11 23:56:30 2026 read: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6052KiB/158058msec) clat (msec): min=4, max=231, avg=41.61, stdev=35.04 lat (msec): min=4, max=231, avg=41.61, stdev=35.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 91], 95.00th=[ 122], | 99.00th=[ 169], 99.50th=[ 184], 99.90th=[ 203], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7, max= 119, per=25.67%, avg=38.76, stdev=23.40, samples=302 iops : min= 1, max= 29, avg= 9.04, stdev= 5.89, samples=302 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6236KiB/158058msec); 0 zone resets clat (msec): min=10, max=941, avg=60.87, stdev=44.77 lat (msec): min=10, max=941, avg=60.87, stdev=44.77 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 186], 99.50th=[ 228], 99.90th=[ 430], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 111, per=24.74%, avg=39.09, stdev=22.11, samples=309 iops : min= 1, max= 27, avg= 9.12, stdev= 5.56, samples=309 lat (msec) : 10=1.63%, 20=14.13%, 50=47.82%, 100=25.16%, 250=11.07% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=2.38%, ctx=4991, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=152KiB/s (155kB/s), 37.7KiB/s-38.3KiB/s (38.6kB/s-39.2kB/s), io=23.4MiB (24.6MB), run=157519-158161msec WRITE: bw=159KiB/s (163kB/s), 39.5KiB/s-40.3KiB/s (40.4kB/s-41.2kB/s), io=24.6MiB (25.7MB), run=157519-158161msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179786: Thu Jun 11 23:57:14 2026 read: IOPS=10, BW=175KiB/s (180kB/s)(5920KiB/33745msec) clat (usec): min=47, max=192562, avg=48849.31, stdev=29314.18 lat (usec): min=48, max=192563, avg=48887.26, stdev=29379.37 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 17695], 20.00th=[ 27132], | 30.00th=[ 32900], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 51643], | 70.00th=[ 60031], 80.00th=[ 68682], 90.00th=[ 84411], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 62, max= 413, per=24.86%, avg=174.53, stdev=63.84, samples=66 iops : min= 3, max= 25, avg=10.15, stdev= 4.01, samples=66 write: IOPS=11, BW=189KiB/s (193kB/s)(6368KiB/33745msec); 0 zone resets clat (usec): min=1728, max=294890, avg=38540.26, stdev=36786.11 lat (usec): min=1729, max=294893, avg=38543.83, stdev=36785.83 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 8], | 30.00th=[ 13], 40.00th=[ 21], 50.00th=[ 30], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 87], 95.00th=[ 104], | 99.00th=[ 150], 99.50th=[ 222], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 445, per=25.56%, avg=188.88, stdev=84.31, samples=66 iops : min= 1, max= 27, avg=11.06, stdev= 5.38, samples=66 lat (usec) : 50=0.13%, 100=2.47%, 250=0.78% lat (msec) : 2=0.26%, 4=5.08%, 10=9.38%, 20=7.68%, 50=37.50% lat (msec) : 100=31.51%, 250=5.08%, 500=0.13% cpu : usr=0.08%, sys=5.84%, ctx=1915, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179787: Thu Jun 11 23:57:14 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/34088msec) clat (usec): min=49, max=187152, avg=49455.89, stdev=29222.63 lat (usec): min=50, max=187153, avg=49458.06, stdev=29222.80 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 1811], 10.00th=[ 20579], 20.00th=[ 27395], | 30.00th=[ 32900], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 85459], 95.00th=[101188], | 99.00th=[154141], 99.50th=[179307], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 345, per=23.69%, avg=166.28, stdev=71.94, samples=67 iops : min= 1, max= 21, avg= 9.64, stdev= 4.54, samples=67 write: IOPS=11, BW=192KiB/s (197kB/s)(6544KiB/34088msec); 0 zone resets clat (usec): min=1854, max=208944, avg=39775.78, stdev=35776.34 lat (usec): min=1855, max=208947, avg=39780.72, stdev=35774.83 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 13], 40.00th=[ 22], 50.00th=[ 31], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 90], 95.00th=[ 110], | 99.00th=[ 144], 99.50th=[ 176], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 62, max= 445, per=25.58%, avg=189.01, stdev=92.31, samples=67 iops : min= 3, max= 27, avg=11.07, stdev= 5.86, samples=67 lat (usec) : 50=0.13%, 100=1.56%, 250=0.39%, 500=0.13% lat (msec) : 2=0.65%, 4=4.69%, 10=8.59%, 20=8.33%, 50=39.84% lat (msec) : 100=29.69%, 250=5.99% cpu : usr=0.07%, sys=6.16%, ctx=1924, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179788: Thu Jun 11 23:57:14 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(6256KiB/33788msec) clat (usec): min=40, max=223268, avg=48129.02, stdev=31050.75 lat (usec): min=40, max=223269, avg=48130.63, stdev=31051.13 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 16581], 20.00th=[ 25822], | 30.00th=[ 32113], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 51119], | 70.00th=[ 56886], 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[156238], 99.50th=[202376], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 377, per=26.23%, avg=184.17, stdev=73.21, samples=66 iops : min= 1, max= 23, avg=10.76, stdev= 4.63, samples=66 write: IOPS=11, BW=179KiB/s (183kB/s)(6032KiB/33788msec); 0 zone resets clat (usec): min=1775, max=178340, avg=39267.26, stdev=34690.77 lat (usec): min=1777, max=178342, avg=39281.28, stdev=34694.81 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3130], 10.00th=[ 4178], 20.00th=[ 7832], | 30.00th=[ 14484], 40.00th=[ 23200], 50.00th=[ 30016], 60.00th=[ 38536], | 70.00th=[ 50070], 80.00th=[ 64750], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[156238], 99.50th=[177210], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 350, per=23.69%, avg=175.06, stdev=74.62, samples=66 iops : min= 1, max= 21, avg=10.18, stdev= 4.73, samples=66 lat (usec) : 50=0.13%, 100=3.39%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=1.17%, 4=3.65%, 10=7.03%, 20=8.07%, 50=38.80% lat (msec) : 100=30.47%, 250=6.38% cpu : usr=0.08%, sys=5.85%, ctx=1946, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179789: Thu Jun 11 23:57:14 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(6032KiB/32916msec) clat (usec): min=38, max=270203, avg=48734.54, stdev=34030.90 lat (usec): min=38, max=270204, avg=48735.89, stdev=34030.97 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 8160], 20.00th=[ 25297], | 30.00th=[ 30802], 40.00th=[ 37487], 50.00th=[ 42730], 60.00th=[ 49546], | 70.00th=[ 57410], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[152044], 99.50th=[208667], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 413, per=25.93%, avg=182.05, stdev=73.57, samples=65 iops : min= 3, max= 25, avg=10.63, stdev= 4.59, samples=65 write: IOPS=11, BW=190KiB/s (195kB/s)(6256KiB/32916msec); 0 zone resets clat (usec): min=1674, max=188701, avg=36699.37, stdev=33763.40 lat (usec): min=1675, max=188703, avg=36701.62, stdev=33763.51 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2737], 10.00th=[ 3752], 20.00th=[ 6849], | 30.00th=[ 10421], 40.00th=[ 19530], 50.00th=[ 27919], 60.00th=[ 35914], | 70.00th=[ 47973], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[145753], 99.50th=[173016], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 447, per=25.78%, avg=190.52, stdev=86.23, samples=65 iops : min= 1, max= 27, avg=11.15, stdev= 5.46, samples=65 lat (usec) : 50=0.26%, 100=3.26%, 250=0.91%, 1000=0.13% lat (msec) : 2=1.30%, 4=4.95%, 10=8.98%, 20=6.90%, 50=39.19% lat (msec) : 100=28.39%, 250=5.60%, 500=0.13% cpu : usr=0.07%, sys=6.17%, ctx=1843, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=703KiB/s (720kB/s), 169KiB/s-185KiB/s (173kB/s-190kB/s), io=23.4MiB (24.5MB), run=32916-34088msec WRITE: bw=739KiB/s (757kB/s), 179KiB/s-192KiB/s (183kB/s-197kB/s), io=24.6MiB (25.8MB), run=32916-34088msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179790: Thu Jun 11 23:57:24 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(5920KiB/44578msec) clat (msec): min=8, max=204, avg=45.05, stdev=37.08 lat (msec): min=8, max=204, avg=45.06, stdev=37.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 128], | 99.00th=[ 182], 99.50th=[ 190], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 480, per=24.50%, avg=131.59, stdev=92.10, samples=88 iops : min= 1, max= 30, avg= 7.44, stdev= 5.88, samples=88 write: IOPS=8, BW=143KiB/s (146kB/s)(6368KiB/44578msec); 0 zone resets clat (msec): min=15, max=305, avg=69.51, stdev=47.49 lat (msec): min=15, max=305, avg=69.51, stdev=47.49 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 85], 80.00th=[ 109], 90.00th=[ 138], 95.00th=[ 163], | 99.00th=[ 220], 99.50th=[ 249], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 413, per=25.17%, avg=142.20, stdev=89.29, samples=88 iops : min= 1, max= 25, avg= 8.10, stdev= 5.70, samples=88 lat (msec) : 10=1.17%, 20=12.24%, 50=45.57%, 100=23.96%, 250=16.93% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.32%, ctx=1261, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179791: Thu Jun 11 23:57:24 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(5744KiB/43982msec) clat (msec): min=6, max=218, avg=50.02, stdev=44.47 lat (msec): min=6, max=218, avg=50.02, stdev=44.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 79], 90.00th=[ 115], 95.00th=[ 163], | 99.00th=[ 205], 99.50th=[ 211], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 29, max= 442, per=24.54%, avg=131.79, stdev=86.34, samples=86 iops : min= 1, max= 27, avg= 7.44, stdev= 5.52, samples=86 write: IOPS=9, BW=149KiB/s (152kB/s)(6544KiB/43982msec); 0 zone resets clat (msec): min=15, max=356, avg=63.07, stdev=39.34 lat (msec): min=15, max=356, avg=63.08, stdev=39.34 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 74], 80.00th=[ 91], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 180], 99.50th=[ 188], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 382, per=26.20%, avg=148.03, stdev=87.29, samples=87 iops : min= 1, max= 23, avg= 8.47, stdev= 5.56, samples=87 lat (msec) : 10=0.91%, 20=11.20%, 50=45.83%, 100=27.21%, 250=14.71% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.26%, ctx=1250, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179792: Thu Jun 11 23:57:24 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6256KiB/43897msec) clat (msec): min=6, max=278, avg=46.84, stdev=38.43 lat (msec): min=6, max=278, avg=46.84, stdev=38.43 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 64], 90.00th=[ 97], 95.00th=[ 130], | 99.00th=[ 197], 99.50th=[ 222], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 407, per=26.83%, avg=144.06, stdev=93.97, samples=86 iops : min= 1, max= 25, avg= 8.21, stdev= 6.00, samples=86 write: IOPS=8, BW=137KiB/s (141kB/s)(6032KiB/43897msec); 0 zone resets clat (msec): min=14, max=325, avg=67.67, stdev=46.49 lat (msec): min=14, max=325, avg=67.67, stdev=46.49 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 80], 80.00th=[ 100], 90.00th=[ 133], 95.00th=[ 163], | 99.00th=[ 211], 99.50th=[ 305], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 413, per=24.21%, avg=136.77, stdev=80.76, samples=87 iops : min= 1, max= 25, avg= 7.76, stdev= 5.14, samples=87 lat (msec) : 10=0.52%, 20=11.07%, 50=46.48%, 100=27.21%, 250=14.19% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=2.30%, ctx=1328, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179793: Thu Jun 11 23:57:24 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(6032KiB/44035msec) clat (msec): min=8, max=282, avg=48.60, stdev=38.90 lat (msec): min=8, max=282, avg=48.60, stdev=38.90 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 73], 90.00th=[ 104], 95.00th=[ 131], | 99.00th=[ 192], 99.50th=[ 213], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 352, per=25.88%, avg=138.96, stdev=82.83, samples=85 iops : min= 1, max= 22, avg= 7.89, stdev= 5.31, samples=85 write: IOPS=8, BW=142KiB/s (145kB/s)(6256KiB/44035msec); 0 zone resets clat (msec): min=16, max=254, avg=65.32, stdev=42.26 lat (msec): min=16, max=254, avg=65.32, stdev=42.26 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 97], 90.00th=[ 127], 95.00th=[ 153], | 99.00th=[ 209], 99.50th=[ 247], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 413, per=25.34%, avg=143.17, stdev=82.86, samples=86 iops : min= 1, max= 25, avg= 8.16, stdev= 5.26, samples=86 lat (msec) : 10=0.39%, 20=9.90%, 50=47.53%, 100=27.08%, 250=14.84% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.30%, ctx=1283, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=537KiB/s (550kB/s), 131KiB/s-143KiB/s (134kB/s-146kB/s), io=23.4MiB (24.5MB), run=43897-44578msec WRITE: bw=565KiB/s (579kB/s), 137KiB/s-149KiB/s (141kB/s-152kB/s), io=24.6MiB (25.8MB), run=43897-44578msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179805: Thu Jun 11 23:57:38 2026 read: IOPS=1, BW=2018KiB/s (2066kB/s)(7168KiB/3552msec) clat (msec): min=88, max=641, avg=187.07, stdev=200.83 lat (msec): min=88, max=641, avg=187.07, stdev=200.83 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 99], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 126], 80.00th=[ 136], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1954, max= 5919, per=60.05%, avg=2968.25, stdev=1967.54, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1441KiB/s (1476kB/s)(5120KiB/3552msec); 0 zone resets clat (msec): min=231, max=664, avg=427.99, stdev=180.33 lat (msec): min=231, max=664, avg=428.08, stdev=180.36 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1961, max= 3908, per=38.07%, avg=2634.67, stdev=1103.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.03%, sys=6.93%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179806: Thu Jun 11 23:57:38 2026 read: IOPS=0, BW=494KiB/s (506kB/s)(2048KiB/4143msec) clat (usec): min=89538, max=97746, avg=93642.65, stdev=5803.81 lat (usec): min=89539, max=97748, avg=93644.39, stdev=5804.61 clat percentiles (usec): | 1.00th=[89654], 5.00th=[89654], 10.00th=[89654], 20.00th=[89654], | 30.00th=[89654], 40.00th=[89654], 50.00th=[89654], 60.00th=[98042], | 70.00th=[98042], 80.00th=[98042], 90.00th=[98042], 95.00th=[98042], | 99.00th=[98042], 99.50th=[98042], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 1910, max= 2035, per=39.90%, avg=1972.50, stdev=88.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2472KiB/s (2531kB/s)(10.0MiB/4143msec); 0 zone resets clat (msec): min=95, max=972, avg=387.08, stdev=318.82 lat (msec): min=95, max=972, avg=387.26, stdev=318.81 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 114], | 30.00th=[ 140], 40.00th=[ 142], 50.00th=[ 197], 60.00th=[ 300], | 70.00th=[ 489], 80.00th=[ 600], 90.00th=[ 827], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1872, max= 3820, per=32.36%, avg=2239.57, stdev=699.22, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=9.94%, ctx=120, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179807: Thu Jun 11 23:57:38 2026 read: IOPS=1, BW=1692KiB/s (1733kB/s)(6144KiB/3631msec) clat (msec): min=85, max=436, avg=275.40, stdev=155.48 lat (msec): min=85, max=436, avg=275.41, stdev=155.48 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 368], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1954, max= 3992, per=66.55%, avg=3289.67, stdev=1157.24, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1692KiB/s (1733kB/s)(6144KiB/3631msec); 0 zone resets clat (msec): min=152, max=582, avg=326.79, stdev=183.76 lat (msec): min=152, max=582, avg=326.88, stdev=183.77 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 300], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1961, max= 3864, per=35.76%, avg=2474.75, stdev=926.86, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=4.30%, ctx=81, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179808: Thu Jun 11 23:57:38 2026 read: IOPS=1, BW=1576KiB/s (1614kB/s)(5120KiB/3249msec) clat (msec): min=125, max=328, avg=202.92, stdev=83.84 lat (msec): min=125, max=328, avg=202.92, stdev=83.84 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 2035, max= 3992, per=54.39%, avg=2688.67, stdev=1128.72, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2206KiB/s (2259kB/s)(7168KiB/3249msec); 0 zone resets clat (msec): min=111, max=462, avg=303.76, stdev=143.89 lat (msec): min=111, max=462, avg=304.51, stdev=143.64 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 155], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 268], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 443], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1954, max= 3813, per=34.11%, avg=2360.40, stdev=813.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=50.00% cpu : usr=0.00%, sys=6.37%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4943KiB/s (5062kB/s), 494KiB/s-2018KiB/s (506kB/s-2066kB/s), io=20.0MiB (20.0MB), run=3249-4143msec WRITE: bw=6921KiB/s (7087kB/s), 1441KiB/s-2472KiB/s (1476kB/s-2531kB/s), io=28.0MiB (29.4MB), run=3249-4143msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179810: Thu Jun 11 23:57:38 2026 read: IOPS=2, BW=2260KiB/s (2315kB/s)(7168KiB/3171msec) clat (usec): min=1351, max=327954, avg=233361.65, stdev=111339.43 lat (usec): min=1352, max=327955, avg=233362.95, stdev=111339.64 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1352], 10.00th=[ 1352], 20.00th=[191890], | 30.00th=[261096], 40.00th=[261096], 50.00th=[261096], 60.00th=[274727], | 70.00th=[274727], 80.00th=[312476], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2039, max= 4087, per=57.01%, avg=3013.00, stdev=1027.66, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1615KiB/s (1653kB/s)(5120KiB/3171msec); 0 zone resets clat (msec): min=174, max=501, avg=305.81, stdev=122.89 lat (msec): min=174, max=501, avg=305.90, stdev=122.89 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1965, max= 4096, per=36.49%, avg=2700.00, stdev=1209.54, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 2=8.33%, 250=25.00%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=23.34%, ctx=259, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179811: Thu Jun 11 23:57:38 2026 read: IOPS=0, BW=529KiB/s (541kB/s)(2048KiB/3875msec) clat (usec): min=568, max=200127, avg=100348.01, stdev=141110.08 lat (usec): min=569, max=200130, avg=100349.99, stdev=141110.53 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 570], 40.00th=[ 570], 50.00th=[ 570], 60.00th=[200279], | 70.00th=[200279], 80.00th=[200279], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 1943, max= 1969, per=37.01%, avg=1956.00, stdev=18.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2643KiB/s (2706kB/s)(10.0MiB/3875msec); 0 zone resets clat (msec): min=142, max=831, avg=367.21, stdev=253.13 lat (msec): min=142, max=831, avg=367.29, stdev=253.13 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 144], | 30.00th=[ 165], 40.00th=[ 205], 50.00th=[ 239], 60.00th=[ 284], | 70.00th=[ 414], 80.00th=[ 493], 90.00th=[ 760], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1969, max= 4096, per=43.85%, avg=3244.20, stdev=1162.27, samples=5 iops : min= 1, max= 4, avg= 2.60, stdev= 1.52, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 1000=16.67% cpu : usr=0.05%, sys=19.00%, ctx=195, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179812: Thu Jun 11 23:57:38 2026 read: IOPS=1, BW=1875KiB/s (1920kB/s)(6144KiB/3277msec) clat (usec): min=319, max=238998, avg=65136.92, stdev=104011.17 lat (usec): min=319, max=238998, avg=65137.84, stdev=104011.06 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 322], 10.00th=[ 322], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[ 594], 50.00th=[ 594], 60.00th=[ 603], | 70.00th=[149947], 80.00th=[149947], 90.00th=[238027], 95.00th=[238027], | 99.00th=[238027], 99.50th=[238027], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 1969, max= 4087, per=50.64%, avg=2676.33, stdev=1221.67, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1875KiB/s (1920kB/s)(6144KiB/3277msec); 0 zone resets clat (msec): min=67, max=1275, avg=480.05, stdev=423.88 lat (msec): min=67, max=1275, avg=480.10, stdev=423.88 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 456], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1969, max= 2043, per=27.35%, avg=2023.50, stdev=36.38, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33%, 750=25.00% lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=14.77%, ctx=140, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179813: Thu Jun 11 23:57:38 2026 read: IOPS=1, BW=1414KiB/s (1448kB/s)(5120KiB/3622msec) clat (usec): min=413, max=300295, avg=117590.20, stdev=160430.00 lat (usec): min=413, max=300296, avg=117591.04, stdev=160430.07 clat percentiles (usec): | 1.00th=[ 412], 5.00th=[ 412], 10.00th=[ 412], 20.00th=[ 412], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 545], 60.00th=[ 545], | 70.00th=[287310], 80.00th=[287310], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 1969, max= 5919, per=74.63%, avg=3944.00, stdev=2793.07, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1979KiB/s (2027kB/s)(7168KiB/3622msec); 0 zone resets clat (msec): min=214, max=605, avg=432.97, stdev=127.48 lat (msec): min=214, max=605, avg=433.11, stdev=127.51 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 363], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 468], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 514], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1928, max= 4087, per=32.66%, avg=2416.80, stdev=935.08, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=8.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=18.09%, ctx=247, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5285KiB/s (5412kB/s), 529KiB/s-2260KiB/s (541kB/s-2315kB/s), io=20.0MiB (20.0MB), run=3171-3875msec WRITE: bw=7399KiB/s (7577kB/s), 1615KiB/s-2643KiB/s (1653kB/s-2706kB/s), io=28.0MiB (29.4MB), run=3171-3875msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179821: Thu Jun 11 23:57:52 2026 read: IOPS=0, BW=2779KiB/s (2846kB/s)(12.0MiB/4422msec) clat (msec): min=574, max=2748, avg=1418.75, stdev=1165.17 lat (msec): min=574, max=2748, avg=1418.76, stdev=1165.17 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8000, max= 8159, per=100.00%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.93%, ctx=713, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179822: Thu Jun 11 23:57:52 2026 read: IOPS=0, BW=848KiB/s (868kB/s)(4096KiB/4831msec) clat (nsec): min=2725.5M, max=2725.5M, avg=2725534660.00, stdev= 0.00 lat (nsec): min=2725.5M, max=2725.5M, avg=2725536628.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2735], 5.00th=[ 2735], 10.00th=[ 2735], 20.00th=[ 2735], | 30.00th=[ 2735], 40.00th=[ 2735], 50.00th=[ 2735], 60.00th=[ 2735], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1696KiB/s (1736kB/s)(8192KiB/4831msec); 0 zone resets clat (msec): min=426, max=1409, avg=918.20, stdev=695.45 lat (msec): min=428, max=1410, avg=919.20, stdev=694.27 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.04%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179823: Thu Jun 11 23:57:52 2026 write: IOPS=0, BW=3448KiB/s (3531kB/s)(12.0MiB/3564msec); 0 zone resets clat (msec): min=387, max=2383, avg=1142.32, stdev=1083.43 lat (msec): min=387, max=2384, avg=1142.72, stdev=1083.66 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.38%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179824: Thu Jun 11 23:57:52 2026 write: IOPS=0, BW=2647KiB/s (2710kB/s)(12.0MiB/4643msec); 0 zone resets clat (msec): min=178, max=2381, avg=1476.37, stdev=1152.67 lat (msec): min=179, max=2382, avg=1477.21, stdev=1152.88 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 1871], 50.00th=[ 1871], 60.00th=[ 1871], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.43%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3391KiB/s (3473kB/s), 848KiB/s-2779KiB/s (868kB/s-2846kB/s), io=16.0MiB (16.8MB), run=4422-4831msec WRITE: bw=6783KiB/s (6946kB/s), 1696KiB/s-3448KiB/s (1736kB/s-3531kB/s), io=32.0MiB (33.6MB), run=3564-4831msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179825: Thu Jun 11 23:57:52 2026 read: IOPS=0, BW=2606KiB/s (2669kB/s)(12.0MiB/4715msec) clat (msec): min=172, max=3100, avg=1520.93, stdev=1477.41 lat (msec): min=172, max=3100, avg=1520.93, stdev=1477.41 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.68%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179826: Thu Jun 11 23:57:52 2026 read: IOPS=0, BW=805KiB/s (825kB/s)(4096KiB/5087msec) clat (nsec): min=2833.1M, max=2833.1M, avg=2833117785.00, stdev= 0.00 lat (nsec): min=2833.1M, max=2833.1M, avg=2833120064.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2836], 5.00th=[ 2836], 10.00th=[ 2836], 20.00th=[ 2836], | 30.00th=[ 2836], 40.00th=[ 2836], 50.00th=[ 2836], 60.00th=[ 2836], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1610KiB/s (1649kB/s)(8192KiB/5087msec); 0 zone resets clat (msec): min=631, max=1545, avg=1088.66, stdev=645.98 lat (msec): min=632, max=1545, avg=1089.01, stdev=645.94 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.15%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179827: Thu Jun 11 23:57:52 2026 write: IOPS=0, BW=2386KiB/s (2444kB/s)(12.0MiB/5149msec); 0 zone resets clat (msec): min=247, max=3820, avg=1667.55, stdev=1896.29 lat (msec): min=247, max=3821, avg=1668.29, stdev=1896.34 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.60%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179828: Thu Jun 11 23:57:52 2026 write: IOPS=0, BW=2952KiB/s (3023kB/s)(12.0MiB/4162msec); 0 zone resets clat (msec): min=408, max=2733, avg=1348.00, stdev=1224.69 lat (msec): min=410, max=2735, avg=1349.56, stdev=1225.37 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.77%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3221KiB/s (3298kB/s), 805KiB/s-2606KiB/s (825kB/s-2669kB/s), io=16.0MiB (16.8MB), run=4715-5087msec WRITE: bw=6364KiB/s (6517kB/s), 1610KiB/s-2952KiB/s (1649kB/s-3023kB/s), io=32.0MiB (33.6MB), run=4162-5149msec