== sanity test 398b: DIO and buffer IO race ============== 18:35:07 (1781217307) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.00191 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178882: Thu Jun 11 18:37:27 2026 read: IOPS=12, BW=51.7KiB/s (52.9kB/s)(5992KiB/115930msec) clat (usec): min=38, max=289692, avg=42731.91, stdev=29269.50 lat (usec): min=38, max=289694, avg=42733.03, stdev=29269.60 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10683], 10.00th=[ 15664], 20.00th=[ 21365], | 30.00th=[ 26084], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[177210], 99.90th=[233833], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 119, per=25.47%, avg=51.46, stdev=20.45, samples=228 iops : min= 1, max= 29, avg=12.22, stdev= 5.13, samples=228 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6296KiB/115930msec); 0 zone resets clat (usec): min=871, max=391897, avg=32759.89, stdev=35697.31 lat (usec): min=871, max=391898, avg=32761.77, stdev=35696.86 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1303], 10.00th=[ 1434], 20.00th=[ 3523], | 30.00th=[ 6587], 40.00th=[ 12911], 50.00th=[ 21890], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[106431], | 99.00th=[147850], 99.50th=[175113], 99.90th=[202376], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 135, per=25.73%, avg=54.30, stdev=24.16, samples=227 iops : min= 1, max= 33, avg=12.94, stdev= 6.07, samples=227 lat (usec) : 50=0.39%, 100=1.43%, 250=0.10%, 500=0.03%, 1000=0.20% lat (msec) : 2=7.00%, 4=3.81%, 10=8.04%, 20=12.14%, 50=39.55% lat (msec) : 100=22.27%, 250=4.98%, 500=0.07% cpu : usr=0.09%, sys=5.38%, ctx=6341, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178883: Thu Jun 11 18:37:27 2026 read: IOPS=12, BW=49.0KiB/s (51.2kB/s)(5940KiB/118832msec) clat (usec): min=37, max=436961, avg=43956.60, stdev=30602.62 lat (usec): min=37, max=436963, avg=43957.76, stdev=30602.67 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10945], 10.00th=[ 16188], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[147850], 99.50th=[170918], 99.90th=[219153], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 7, max= 102, per=24.54%, avg=49.57, stdev=18.69, samples=233 iops : min= 1, max= 25, avg=11.74, stdev= 4.70, samples=233 write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6348KiB/118832msec); 0 zone resets clat (usec): min=793, max=284289, avg=33501.12, stdev=34665.69 lat (usec): min=793, max=284291, avg=33505.77, stdev=34663.27 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1401], 20.00th=[ 3458], | 30.00th=[ 7767], 40.00th=[ 15401], 50.00th=[ 24773], 60.00th=[ 32113], | 70.00th=[ 42730], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[162530], 99.90th=[240124], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 158, per=25.17%, avg=53.11, stdev=23.61, samples=232 iops : min= 1, max= 39, avg=12.64, stdev= 5.93, samples=232 lat (usec) : 50=0.13%, 100=1.60%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=7.36%, 4=3.65%, 10=6.71%, 20=11.17%, 50=41.02% lat (msec) : 100=23.40%, 250=4.65%, 500=0.07% cpu : usr=0.08%, sys=5.47%, ctx=6482, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178884: Thu Jun 11 18:37:27 2026 read: IOPS=12, BW=51.6KiB/s (52.9kB/s)(6028KiB/116737msec) clat (usec): min=33, max=319858, avg=43601.58, stdev=29807.49 lat (usec): min=34, max=319860, avg=43605.60, stdev=29807.48 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11731], 10.00th=[ 16712], 20.00th=[ 21890], | 30.00th=[ 26608], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[183501], 99.90th=[278922], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 111, per=25.38%, avg=51.26, stdev=20.74, samples=229 iops : min= 1, max= 27, avg=12.17, stdev= 5.21, samples=229 write: IOPS=13, BW=53.6KiB/s (54.9kB/s)(6260KiB/116737msec); 0 zone resets clat (usec): min=976, max=431331, avg=32339.49, stdev=35220.68 lat (usec): min=977, max=431334, avg=32341.20, stdev=35220.60 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1434], 20.00th=[ 3294], | 30.00th=[ 6390], 40.00th=[ 13566], 50.00th=[ 22676], 60.00th=[ 30540], | 70.00th=[ 41681], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[164627], 99.90th=[261096], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 110, per=25.21%, avg=53.20, stdev=22.43, samples=229 iops : min= 1, max= 27, avg=12.66, stdev= 5.65, samples=229 lat (usec) : 50=0.20%, 100=1.37%, 250=0.13%, 500=0.03%, 1000=0.10% lat (msec) : 2=7.00%, 4=4.56%, 10=7.19%, 20=11.17%, 50=41.47% lat (msec) : 100=22.17%, 250=4.46%, 500=0.16% cpu : usr=0.07%, sys=5.26%, ctx=6293, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178885: Thu Jun 11 18:37:27 2026 read: IOPS=12, BW=51.4KiB/s (52.7kB/s)(6052KiB/117648msec) clat (usec): min=35, max=286007, avg=42611.04, stdev=29219.04 lat (usec): min=35, max=286008, avg=42612.27, stdev=29219.06 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9503], 10.00th=[ 15795], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[145753], 99.50th=[166724], 99.90th=[246416], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 127, per=25.27%, avg=51.05, stdev=20.50, samples=231 iops : min= 1, max= 31, avg=12.12, stdev= 5.17, samples=231 write: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6236KiB/117648msec); 0 zone resets clat (usec): min=852, max=405737, avg=33847.59, stdev=35767.52 lat (usec): min=853, max=405740, avg=33850.02, stdev=35767.45 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1467], 20.00th=[ 3785], | 30.00th=[ 8225], 40.00th=[ 16450], 50.00th=[ 24773], 60.00th=[ 32637], | 70.00th=[ 42730], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[104334], | 99.00th=[149947], 99.50th=[187696], 99.90th=[229639], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 150, per=24.89%, avg=52.53, stdev=23.10, samples=231 iops : min= 1, max= 37, avg=12.48, stdev= 5.80, samples=231 lat (usec) : 50=0.33%, 100=1.82%, 250=0.07%, 1000=0.03% lat (msec) : 2=6.71%, 4=3.87%, 10=6.41%, 20=11.69%, 50=41.34% lat (msec) : 100=23.24%, 250=4.43%, 500=0.07% cpu : usr=0.09%, sys=5.28%, ctx=6366, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=202KiB/s (207kB/s), 49.0KiB/s-51.7KiB/s (51.2kB/s-52.9kB/s), io=23.4MiB (24.6MB), run=115930-118832msec WRITE: bw=212KiB/s (217kB/s), 53.0KiB/s-54.3KiB/s (54.3kB/s-55.6kB/s), io=24.6MiB (25.7MB), run=115930-118832msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178878: Thu Jun 11 18:38:04 2026 read: IOPS=9, BW=38.8KiB/s (39.8kB/s)(5992KiB/154242msec) clat (msec): min=5, max=396, avg=41.25, stdev=39.77 lat (msec): min=5, max=396, avg=41.25, stdev=39.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 60], 90.00th=[ 100], 95.00th=[ 127], | 99.00th=[ 190], 99.50th=[ 215], 99.90th=[ 288], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 150, per=25.23%, avg=38.86, stdev=27.53, samples=301 iops : min= 1, max= 37, avg= 9.06, stdev= 6.94, samples=301 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6296KiB/154242msec); 0 zone resets clat (msec): min=11, max=359, avg=58.50, stdev=40.59 lat (msec): min=11, max=359, avg=58.51, stdev=40.61 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 112], 95.00th=[ 142], | 99.00th=[ 201], 99.50th=[ 239], 99.90th=[ 330], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 119, per=25.05%, avg=40.57, stdev=24.94, samples=303 iops : min= 1, max= 29, avg= 9.49, stdev= 6.30, samples=303 lat (msec) : 10=2.54%, 20=17.15%, 50=45.51%, 100=23.01%, 250=11.52% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=2.15%, ctx=4920, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178879: Thu Jun 11 18:38:04 2026 read: IOPS=9, BW=38.3KiB/s (39.2kB/s)(5940KiB/155113msec) clat (msec): min=5, max=426, avg=40.42, stdev=37.96 lat (msec): min=5, max=426, avg=40.42, stdev=37.96 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 94], 95.00th=[ 120], | 99.00th=[ 169], 99.50th=[ 218], 99.90th=[ 275], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 143, per=25.01%, avg=38.51, stdev=26.64, samples=299 iops : min= 1, max= 35, avg= 8.97, stdev= 6.71, samples=299 write: IOPS=10, BW=40.9KiB/s (41.9kB/s)(6348KiB/155113msec); 0 zone resets clat (msec): min=8, max=333, avg=59.70, stdev=42.80 lat (msec): min=8, max=333, avg=59.71, stdev=42.80 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 90], 90.00th=[ 118], 95.00th=[ 140], | 99.00th=[ 222], 99.50th=[ 259], 99.90th=[ 288], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 128, per=25.22%, avg=40.86, stdev=25.42, samples=301 iops : min= 1, max= 32, avg= 9.56, stdev= 6.43, samples=301 lat (msec) : 10=2.67%, 20=17.97%, 50=44.50%, 100=22.49%, 250=12.04% lat (msec) : 500=0.33% cpu : usr=0.05%, sys=2.18%, ctx=4960, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178880: Thu Jun 11 18:38:04 2026 read: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6028KiB/153767msec) clat (msec): min=5, max=251, avg=40.33, stdev=35.79 lat (msec): min=5, max=251, avg=40.34, stdev=35.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 118], | 99.00th=[ 176], 99.50th=[ 197], 99.90th=[ 245], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7, max= 166, per=25.57%, avg=39.38, stdev=26.49, samples=299 iops : min= 1, max= 41, avg= 9.18, stdev= 6.70, samples=299 write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6260KiB/153767msec); 0 zone resets clat (msec): min=8, max=474, avg=59.21, stdev=44.67 lat (msec): min=8, max=474, avg=59.21, stdev=44.67 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 111, per=25.22%, avg=40.86, stdev=25.46, samples=299 iops : min= 1, max= 27, avg= 9.56, stdev= 6.41, samples=299 lat (msec) : 10=2.15%, 20=16.86%, 50=47.10%, 100=22.92%, 250=10.64% lat (msec) : 500=0.33% cpu : usr=0.06%, sys=2.15%, ctx=4808, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178881: Thu Jun 11 18:38:04 2026 read: IOPS=9, BW=39.2KiB/s (40.2kB/s)(6052KiB/154255msec) clat (msec): min=5, max=252, avg=40.31, stdev=36.48 lat (msec): min=5, max=252, avg=40.31, stdev=36.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 60], 90.00th=[ 92], 95.00th=[ 118], | 99.00th=[ 174], 99.50th=[ 218], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7, max= 135, per=25.75%, avg=39.65, stdev=26.63, samples=298 iops : min= 1, max= 33, avg= 9.25, stdev= 6.72, samples=298 write: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6236KiB/154255msec); 0 zone resets clat (msec): min=10, max=446, avg=59.61, stdev=44.21 lat (msec): min=10, max=446, avg=59.62, stdev=44.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 116], 95.00th=[ 144], | 99.00th=[ 226], 99.50th=[ 257], 99.90th=[ 355], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 111, per=25.04%, avg=40.57, stdev=24.76, samples=300 iops : min= 1, max= 27, avg= 9.48, stdev= 6.25, samples=300 lat (msec) : 10=2.51%, 20=16.83%, 50=46.22%, 100=23.18%, 250=10.90% lat (msec) : 500=0.36% cpu : usr=0.05%, sys=2.12%, ctx=4921, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (159kB/s), 38.3KiB/s-39.2KiB/s (39.2kB/s-40.2kB/s), io=23.4MiB (24.6MB), run=153767-155113msec WRITE: bw=162KiB/s (166kB/s), 40.4KiB/s-40.9KiB/s (41.4kB/s-41.9kB/s), io=24.6MiB (25.7MB), run=153767-155113msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178927: Thu Jun 11 18:38:51 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(5920KiB/36709msec) clat (usec): min=48, max=184272, avg=51593.22, stdev=34913.28 lat (usec): min=48, max=184274, avg=51601.37, stdev=34907.29 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 61], 10.00th=[ 9110], 20.00th=[ 26084], | 30.00th=[ 32375], 40.00th=[ 39060], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 63701], 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[168821], 99.50th=[181404], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 62, max= 316, per=25.35%, avg=160.75, stdev=64.32, samples=72 iops : min= 3, max= 19, avg= 9.29, stdev= 4.07, samples=72 write: IOPS=10, BW=173KiB/s (178kB/s)(6368KiB/36709msec); 0 zone resets clat (usec): min=1551, max=238082, avg=43713.74, stdev=42392.81 lat (usec): min=1552, max=238083, avg=43739.93, stdev=42375.94 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2147], 10.00th=[ 3523], 20.00th=[ 7373], | 30.00th=[ 14091], 40.00th=[ 22938], 50.00th=[ 32900], 60.00th=[ 40109], | 70.00th=[ 53216], 80.00th=[ 76022], 90.00th=[103285], 95.00th=[130548], | 99.00th=[177210], 99.50th=[235930], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 28, max= 444, per=26.30%, avg=175.41, stdev=79.45, samples=71 iops : min= 1, max= 27, avg=10.21, stdev= 5.04, samples=71 lat (usec) : 50=0.26%, 100=3.78%, 250=0.13%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.34%, 4=3.91%, 10=7.16%, 20=7.68%, 50=37.63% lat (msec) : 100=26.43%, 250=10.29% cpu : usr=0.05%, sys=5.10%, ctx=1688, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178929: Thu Jun 11 18:38:51 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(5744KiB/36991msec) clat (usec): min=43, max=214107, avg=54524.27, stdev=34768.45 lat (usec): min=43, max=214108, avg=54525.34, stdev=34768.44 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 19006], 20.00th=[ 27395], | 30.00th=[ 34341], 40.00th=[ 43254], 50.00th=[ 49021], 60.00th=[ 56361], | 70.00th=[ 64226], 80.00th=[ 82314], 90.00th=[100140], 95.00th=[115868], | 99.00th=[183501], 99.50th=[204473], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 29, max= 379, per=24.61%, avg=156.00, stdev=64.78, samples=71 iops : min= 1, max= 23, avg= 9.00, stdev= 4.13, samples=71 write: IOPS=11, BW=177KiB/s (181kB/s)(6544KiB/36991msec); 0 zone resets clat (usec): min=1471, max=277723, avg=42229.15, stdev=42269.63 lat (usec): min=1472, max=277726, avg=42231.44, stdev=42269.31 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1958], 10.00th=[ 3851], 20.00th=[ 7504], | 30.00th=[ 12125], 40.00th=[ 19530], 50.00th=[ 28181], 60.00th=[ 39060], | 70.00th=[ 54264], 80.00th=[ 77071], 90.00th=[102237], 95.00th=[121111], | 99.00th=[166724], 99.50th=[193987], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 443, per=26.61%, avg=177.49, stdev=87.40, samples=71 iops : min= 1, max= 27, avg=10.37, stdev= 5.55, samples=71 lat (usec) : 50=0.26%, 100=2.60%, 250=0.13% lat (msec) : 2=2.73%, 4=2.73%, 10=8.07%, 20=10.42%, 50=32.81% lat (msec) : 100=29.69%, 250=10.29%, 500=0.26% cpu : usr=0.07%, sys=5.23%, ctx=1741, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178930: Thu Jun 11 18:38:51 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37775msec) clat (usec): min=52, max=377494, avg=56287.34, stdev=40638.60 lat (usec): min=54, max=377496, avg=56288.47, stdev=40638.64 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 75], 10.00th=[ 19006], 20.00th=[ 29230], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 56361], | 70.00th=[ 65799], 80.00th=[ 79168], 90.00th=[101188], 95.00th=[117965], | 99.00th=[198181], 99.50th=[312476], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 320, per=26.18%, avg=165.99, stdev=72.18, samples=74 iops : min= 1, max= 20, avg= 9.62, stdev= 4.56, samples=74 write: IOPS=9, BW=160KiB/s (164kB/s)(6032KiB/37775msec); 0 zone resets clat (usec): min=1469, max=202457, avg=41186.95, stdev=37387.89 lat (usec): min=1470, max=202458, avg=41201.98, stdev=37375.05 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1942], 10.00th=[ 3294], 20.00th=[ 8225], | 30.00th=[ 15664], 40.00th=[ 23725], 50.00th=[ 30540], 60.00th=[ 41157], | 70.00th=[ 51643], 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[117965], | 99.00th=[166724], 99.50th=[183501], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 382, per=23.59%, avg=157.36, stdev=77.41, samples=74 iops : min= 1, max= 23, avg= 9.08, stdev= 4.92, samples=74 lat (usec) : 100=3.12% lat (msec) : 2=2.86%, 4=2.99%, 10=5.47%, 20=8.20%, 50=38.02% lat (msec) : 100=29.43%, 250=9.64%, 500=0.26% cpu : usr=0.06%, sys=5.20%, ctx=1837, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178931: Thu Jun 11 18:38:51 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36160msec) clat (usec): min=34, max=295792, avg=53807.61, stdev=40942.94 lat (usec): min=35, max=295794, avg=53809.64, stdev=40944.79 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 6325], 20.00th=[ 25035], | 30.00th=[ 33162], 40.00th=[ 39584], 50.00th=[ 47449], 60.00th=[ 53740], | 70.00th=[ 62653], 80.00th=[ 74974], 90.00th=[100140], 95.00th=[137364], | 99.00th=[202376], 99.50th=[229639], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 411, per=26.49%, avg=167.94, stdev=78.91, samples=70 iops : min= 1, max= 25, avg= 9.74, stdev= 4.97, samples=70 write: IOPS=10, BW=173KiB/s (177kB/s)(6256KiB/36160msec); 0 zone resets clat (usec): min=1392, max=248070, avg=39779.99, stdev=41094.11 lat (usec): min=1393, max=248072, avg=39782.05, stdev=41094.06 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1893], 10.00th=[ 2442], 20.00th=[ 5866], | 30.00th=[ 12256], 40.00th=[ 18220], 50.00th=[ 27132], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 64750], 90.00th=[ 99091], 95.00th=[117965], | 99.00th=[179307], 99.50th=[221250], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 416, per=25.88%, avg=172.63, stdev=75.14, samples=71 iops : min= 1, max= 26, avg=10.06, stdev= 4.80, samples=71 lat (usec) : 50=0.52%, 100=3.52%, 250=0.39%, 500=0.13% lat (msec) : 2=3.91%, 4=4.04%, 10=6.51%, 20=9.64%, 50=34.11% lat (msec) : 100=27.47%, 250=9.64%, 500=0.13% cpu : usr=0.04%, sys=4.96%, ctx=1649, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=634KiB/s (649kB/s), 155KiB/s-167KiB/s (159kB/s-171kB/s), io=23.4MiB (24.5MB), run=36160-37775msec WRITE: bw=667KiB/s (683kB/s), 160KiB/s-177KiB/s (164kB/s-181kB/s), io=24.6MiB (25.8MB), run=36160-37775msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178924: Thu Jun 11 18:39:04 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(5920KiB/49135msec) clat (msec): min=6, max=211, avg=50.47, stdev=39.01 lat (msec): min=6, max=211, avg=50.47, stdev=39.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 102], 95.00th=[ 144], | 99.00th=[ 190], 99.50th=[ 197], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 30, max= 470, per=25.51%, avg=121.70, stdev=84.78, samples=94 iops : min= 1, max= 29, avg= 6.81, stdev= 5.36, samples=94 write: IOPS=8, BW=130KiB/s (133kB/s)(6368KiB/49135msec); 0 zone resets clat (msec): min=13, max=333, avg=76.11, stdev=53.82 lat (msec): min=13, max=333, avg=76.12, stdev=53.83 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 70], | 70.00th=[ 89], 80.00th=[ 116], 90.00th=[ 155], 95.00th=[ 184], | 99.00th=[ 262], 99.50th=[ 292], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 26, max= 350, per=26.08%, avg=130.66, stdev=74.94, samples=95 iops : min= 1, max= 21, avg= 7.38, stdev= 4.77, samples=95 lat (msec) : 10=1.04%, 20=10.03%, 50=41.93%, 100=29.04%, 250=17.45% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.72%, ctx=1191, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178925: Thu Jun 11 18:39:04 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5744KiB/50213msec) clat (msec): min=5, max=282, avg=52.85, stdev=45.01 lat (msec): min=5, max=282, avg=52.85, stdev=45.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 83], 90.00th=[ 116], 95.00th=[ 150], | 99.00th=[ 209], 99.50th=[ 234], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 26, max= 444, per=25.12%, avg=119.84, stdev=78.46, samples=92 iops : min= 1, max= 27, avg= 6.70, stdev= 4.96, samples=92 write: IOPS=8, BW=130KiB/s (133kB/s)(6544KiB/50213msec); 0 zone resets clat (msec): min=11, max=333, avg=75.64, stdev=51.66 lat (msec): min=11, max=333, avg=75.64, stdev=51.66 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 72], | 70.00th=[ 92], 80.00th=[ 112], 90.00th=[ 155], 95.00th=[ 180], | 99.00th=[ 241], 99.50th=[ 247], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 413, per=25.93%, avg=129.89, stdev=75.18, samples=96 iops : min= 1, max= 25, avg= 7.32, stdev= 4.75, samples=96 lat (msec) : 10=1.43%, 20=7.94%, 50=44.01%, 100=26.82%, 250=19.40% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.79%, ctx=1281, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178926: Thu Jun 11 18:39:04 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49821msec) clat (msec): min=5, max=373, avg=53.09, stdev=48.06 lat (msec): min=5, max=373, avg=53.10, stdev=48.06 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 116], 95.00th=[ 146], | 99.00th=[ 255], 99.50th=[ 326], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 381, per=27.21%, avg=129.79, stdev=86.32, samples=95 iops : min= 1, max= 23, avg= 7.32, stdev= 5.46, samples=95 write: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49821msec); 0 zone resets clat (msec): min=14, max=257, avg=76.24, stdev=48.08 lat (msec): min=14, max=257, avg=76.25, stdev=48.08 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 36], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 77], | 70.00th=[ 90], 80.00th=[ 111], 90.00th=[ 142], 95.00th=[ 186], | 99.00th=[ 239], 99.50th=[ 255], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 30, max= 349, per=24.22%, avg=121.32, stdev=66.80, samples=97 iops : min= 1, max= 21, avg= 6.79, stdev= 4.25, samples=97 lat (msec) : 10=0.78%, 20=10.29%, 50=40.36%, 100=30.34%, 250=17.45% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.86%, ctx=1208, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178928: Thu Jun 11 18:39:04 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49763msec) clat (msec): min=7, max=368, avg=56.27, stdev=47.28 lat (msec): min=7, max=368, avg=56.29, stdev=47.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 82], 90.00th=[ 121], 95.00th=[ 159], | 99.00th=[ 228], 99.50th=[ 234], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 382, per=26.39%, avg=125.88, stdev=71.73, samples=94 iops : min= 1, max= 23, avg= 7.07, stdev= 4.54, samples=94 write: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49763msec); 0 zone resets clat (msec): min=12, max=295, avg=72.79, stdev=48.00 lat (msec): min=12, max=295, avg=72.80, stdev=48.00 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 69], | 70.00th=[ 85], 80.00th=[ 109], 90.00th=[ 142], 95.00th=[ 167], | 99.00th=[ 228], 99.50th=[ 279], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 444, per=25.58%, avg=128.16, stdev=76.76, samples=96 iops : min= 1, max= 27, avg= 7.22, stdev= 4.87, samples=96 lat (msec) : 10=1.04%, 20=8.46%, 50=42.19%, 100=30.08%, 250=17.84% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.08%, ctx=1271, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=477KiB/s (488kB/s), 114KiB/s-126KiB/s (117kB/s-129kB/s), io=23.4MiB (24.5MB), run=49135-50213msec WRITE: bw=502KiB/s (514kB/s), 121KiB/s-130KiB/s (124kB/s-133kB/s), io=24.6MiB (25.8MB), run=49135-50213msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178946: Thu Jun 11 18:39:16 2026 read: IOPS=2, BW=2433KiB/s (2492kB/s)(7168KiB/2946msec) clat (msec): min=122, max=518, avg=237.81, stdev=166.47 lat (msec): min=122, max=518, avg=237.81, stdev=166.48 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 127], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 155], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 435], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 2019, max= 3859, per=54.38%, avg=2490.00, stdev=912.73, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1738KiB/s (1780kB/s)(5120KiB/2946msec); 0 zone resets clat (msec): min=121, max=496, avg=245.66, stdev=148.20 lat (msec): min=121, max=496, avg=245.90, stdev=148.21 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1286, max= 3938, per=36.29%, avg=2326.50, stdev=1131.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=66.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=3.87%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178947: Thu Jun 11 18:39:16 2026 read: IOPS=0, BW=458KiB/s (469kB/s)(2048KiB/4472msec) clat (msec): min=106, max=193, avg=149.96, stdev=60.91 lat (msec): min=106, max=193, avg=149.97, stdev=60.91 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 194], 95.00th=[ 194], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 1835, max= 1984, per=41.70%, avg=1909.50, stdev=105.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2290KiB/s (2345kB/s)(10.0MiB/4472msec); 0 zone resets clat (msec): min=127, max=1136, avg=411.77, stdev=326.73 lat (msec): min=127, max=1136, avg=411.85, stdev=326.74 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 148], | 30.00th=[ 153], 40.00th=[ 190], 50.00th=[ 194], 60.00th=[ 405], | 70.00th=[ 460], 80.00th=[ 642], 90.00th=[ 667], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1835, max= 3968, per=35.68%, avg=2287.17, stdev=828.88, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.38%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178949: Thu Jun 11 18:39:16 2026 read: IOPS=1, BW=1378KiB/s (1411kB/s)(6144KiB/4458msec) clat (msec): min=150, max=492, avg=304.12, stdev=133.84 lat (msec): min=150, max=492, avg=304.12, stdev=133.84 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 330], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2023, max= 3968, per=58.43%, avg=2675.33, stdev=1119.50, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1378KiB/s (1411kB/s)(6144KiB/4458msec); 0 zone resets clat (msec): min=119, max=666, avg=315.35, stdev=239.89 lat (msec): min=119, max=666, avg=315.44, stdev=239.88 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 309], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1835, max= 2039, per=31.07%, avg=1991.80, stdev=87.88, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.02%, sys=4.13%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% rand-rw: (groupid=0, jobs=1): err= 0: pid=178948: Thu Jun 11 18:39:16 2026 read: IOPS=1, BW=1799KiB/s (1842kB/s)(7168KiB/3985msec) clat (usec): min=497, max=1132.1k, avg=257706.86, stdev=408258.91 lat (usec): min=498, max=1132.1k, avg=257708.17, stdev=408259.25 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], | 20.00th=[ 510], 30.00th=[ 1532], 40.00th=[ 1532], | 50.00th=[ 73925], 60.00th=[ 278922], 70.00th=[ 278922], | 80.00th=[ 316670], 90.00th=[1132463], 95.00th=[1132463], | 99.00th=[1132463], 99.50th=[1132463], 99.90th=[1132463], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 1756, max= 4047, per=64.53%, avg=2961.25, stdev=1235.99, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1285KiB/s (1316kB/s)(5120KiB/3985msec); 0 zone resets clat (msec): min=196, max=635, avg=378.90, stdev=194.46 lat (msec): min=196, max=635, avg=378.96, stdev=194.48 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2023, max= 4071, per=42.24%, avg=2714.00, stdev=1175.26, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=7.81%, ctx=157, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178951: Thu Jun 11 18:39:16 2026 read: IOPS=0, BW=459KiB/s (470kB/s)(2048KiB/4462msec) clat (usec): min=489, max=251124, avg=125807.21, stdev=177226.08 lat (usec): min=490, max=251127, avg=125809.04, stdev=177226.56 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 490], 40.00th=[ 490], 50.00th=[ 490], 60.00th=[250610], | 70.00th=[250610], 80.00th=[250610], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 1514, max= 2048, per=38.81%, avg=1781.00, stdev=377.60, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2295KiB/s (2350kB/s)(10.0MiB/4462msec); 0 zone resets clat (msec): min=85, max=713, avg=398.30, stdev=219.74 lat (msec): min=85, max=713, avg=398.38, stdev=219.75 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 130], | 30.00th=[ 236], 40.00th=[ 334], 50.00th=[ 338], 60.00th=[ 405], | 70.00th=[ 464], 80.00th=[ 575], 90.00th=[ 709], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1756, max= 4096, per=41.18%, avg=2645.67, stdev=1085.34, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=25.00% cpu : usr=0.00%, sys=10.72%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178952: Thu Jun 11 18:39:16 2026 read: IOPS=1, BW=1955KiB/s (2002kB/s)(6144KiB/3142msec) clat (usec): min=1576, max=389569, avg=232392.01, stdev=146356.62 lat (usec): min=1577, max=389570, avg=232393.42, stdev=146356.50 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1582], 10.00th=[ 1582], 20.00th=[141558], | 30.00th=[141558], 40.00th=[200279], 50.00th=[200279], 60.00th=[325059], | 70.00th=[337642], 80.00th=[337642], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 1992, max= 3512, per=51.92%, avg=2382.50, stdev=753.11, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1955KiB/s (2002kB/s)(6144KiB/3142msec); 0 zone resets clat (msec): min=217, max=323, avg=279.72, stdev=40.98 lat (msec): min=217, max=323, avg=279.80, stdev=40.98 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 296], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1756, max= 3011, per=34.17%, avg=2195.50, stdev=556.59, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 250=25.00%, 500=66.67% cpu : usr=0.00%, sys=11.65%, ctx=235, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178953: Thu Jun 11 18:39:16 2026 read: IOPS=1, BW=1400KiB/s (1434kB/s)(5120KiB/3657msec) clat (msec): min=3, max=399, avg=200.47, stdev=149.88 lat (msec): min=3, max=399, avg=200.47, stdev=149.88 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 3512, max= 4047, per=82.36%, avg=3779.50, stdev=378.30, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1960KiB/s (2007kB/s)(7168KiB/3657msec); 0 zone resets clat (msec): min=165, max=489, avg=297.35, stdev=134.15 lat (msec): min=165, max=489, avg=297.43, stdev=134.15 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 180], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 220], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 443], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1756, max= 3984, per=38.10%, avg=2447.75, stdev=1032.18, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 4=8.33%, 250=50.00%, 500=41.67% cpu : usr=0.05%, sys=11.27%, ctx=143, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4590KiB/s (4700kB/s), 459KiB/s-1955KiB/s (470kB/s-2002kB/s), io=20.0MiB (20 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178950: Thu Jun 11 18:39:16 2026 read: IOPS=1, BW=1505KiB/s (1541kB/s)(5120KiB/3402msec) clat (msec): min=123, max=783, avg=289.24, stdev=279.67 lat (msec): min=123, max=783, avg=289.24, stdev=279.67 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2027, max= 3968, per=58.48%, avg=2678.00, stdev=1117.19, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2107KiB/s (2158kB/s)(7168KiB/3402msec); 0 zone resets clat (msec): min=133, max=390, avg=259.08, stdev=103.10 lat (msec): min=133, max=390, avg=259.17, stdev=103.11 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 165], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 268], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 384], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1939, max= 4071, per=45.70%, avg=2929.75, stdev=1099.31, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=3.82%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4580KiB/s (4690kB/s), 458KiB/s-2433KiB/s (469kB/s-2492kB/s), io=20.0MiB (20.0MB), run=2946-4472msec WRITE: bw=6411KiB/s (6565kB/s), 1378KiB/s-2290KiB/s (1411kB/s-2345kB/s), io=28.0MiB (29.4MB), run=2946-4472msec .0MB), run=3142-4462msec WRITE: bw=6426KiB/s (6580kB/s), 1285KiB/s-2295KiB/s (1316kB/s-2350kB/s), io=28.0MiB (29.4MB), run=3142-4462msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178963: Thu Jun 11 18:39:32 2026 read: IOPS=0, BW=3433KiB/s (3516kB/s)(12.0MiB/3579msec) clat (msec): min=656, max=1440, avg=1161.28, stdev=437.61 lat (msec): min=656, max=1440, avg=1161.28, stdev=437.61 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8078, max= 8110, per=100.00%, avg=8094.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.33%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178964: Thu Jun 11 18:39:32 2026 read: IOPS=0, BW=955KiB/s (977kB/s)(4096KiB/4291msec) clat (nsec): min=1553.3M, max=1553.3M, avg=1553282477.00, stdev= 0.00 lat (nsec): min=1553.3M, max=1553.3M, avg=1553285959.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1552], 5.00th=[ 1552], 10.00th=[ 1552], 20.00th=[ 1552], | 30.00th=[ 1552], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1909KiB/s (1955kB/s)(8192KiB/4291msec); 0 zone resets clat (msec): min=1247, max=1433, avg=1340.44, stdev=131.98 lat (msec): min=1247, max=1434, avg=1340.81, stdev=131.94 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.61%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178966: Thu Jun 11 18:39:32 2026 write: IOPS=0, BW=3156KiB/s (3231kB/s)(12.0MiB/3894msec); 0 zone resets clat (msec): min=243, max=1800, avg=1265.29, stdev=884.91 lat (msec): min=244, max=1812, avg=1270.32, stdev=888.74 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 7892, max= 8126, per=100.00%, avg=8009.00, stdev=165.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.98%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178967: Thu Jun 11 18:39:32 2026 write: IOPS=1, BW=4754KiB/s (4868kB/s)(12.0MiB/2585msec); 0 zone resets clat (msec): min=418, max=1070, avg=846.99, stdev=371.20 lat (msec): min=418, max=1070, avg=847.35, stdev=371.10 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.08%, sys=4.33%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3818KiB/s (3910kB/s), 955KiB/s-3433KiB/s (977kB/s-3516kB/s), io=16.0MiB (16.8MB), run=3579-4291msec WRITE: bw=7636KiB/s (7820kB/s), 1909KiB/s-4754KiB/s (1955kB/s-4868kB/s), io=32.0MiB (33.6MB), run=2585-4291msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178960: Thu Jun 11 18:39:32 2026 read: IOPS=0, BW=3644KiB/s (3732kB/s)(12.0MiB/3372msec) clat (msec): min=995, max=1191, avg=1099.86, stdev=98.71 lat (msec): min=995, max=1191, avg=1099.86, stdev=98.71 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.03%, ctx=221, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178961: Thu Jun 11 18:39:32 2026 read: IOPS=0, BW=1031KiB/s (1055kB/s)(4096KiB/3974msec) clat (nsec): min=1124.0M, max=1124.0M, avg=1124008037.00, stdev= 0.00 lat (nsec): min=1124.0M, max=1124.0M, avg=1124010607.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2061KiB/s (2111kB/s)(8192KiB/3974msec); 0 zone resets clat (msec): min=873, max=1924, avg=1398.92, stdev=743.61 lat (msec): min=873, max=1925, avg=1399.25, stdev=743.66 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 1921], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.60%, ctx=108, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178962: Thu Jun 11 18:39:32 2026 write: IOPS=0, BW=2706KiB/s (2771kB/s)(12.0MiB/4541msec); 0 zone resets clat (msec): min=240, max=3245, avg=1453.24, stdev=1583.79 lat (msec): min=240, max=3245, avg=1453.56, stdev=1583.82 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.92%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178965: Thu Jun 11 18:39:32 2026 write: IOPS=0, BW=3080KiB/s (3154kB/s)(12.0MiB/3990msec); 0 zone resets clat (msec): min=253, max=1988, avg=1249.76, stdev=895.46 lat (msec): min=254, max=1988, avg=1250.16, stdev=895.52 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 7501, max= 7772, per=100.00%, avg=7636.50, stdev=191.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.11%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4123KiB/s (4222kB/s), 1031KiB/s-3644KiB/s (1055kB/s-3732kB/s), io=16.0MiB (16.8MB), run=3372-3974msec WRITE: bw=7216KiB/s (7389kB/s), 2061KiB/s-3080KiB/s (2111kB/s-3154kB/s), io=32.0MiB (33.6MB), run=3974-4541msec