== sanity test 398b: DIO and buffer IO race ============== 21:36:59 (1786066619) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.62197 s, 9.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Thu Aug 6 21:39:45 2026 read: IOPS=10, BW=41.3KiB/s (42.3kB/s)(5992KiB/144931msec) clat (usec): min=30, max=1307.4k, avg=47662.08, stdev=52873.16 lat (usec): min=31, max=1307.4k, avg=47671.94, stdev=52870.92 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 104], | 20.00th=[ 19268], 30.00th=[ 26870], 40.00th=[ 32900], | 50.00th=[ 39060], 60.00th=[ 47449], 70.00th=[ 56886], | 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[ 112722], | 99.00th=[ 168821], 99.50th=[ 204473], 99.90th=[ 817890], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 7, max= 127, per=25.75%, avg=41.45, stdev=19.23, samples=281 iops : min= 1, max= 31, avg= 9.70, stdev= 4.83, samples=281 write: IOPS=10, BW=43.4KiB/s (44.5kB/s)(6296KiB/144931msec); 0 zone resets clat (usec): min=1080, max=662332, avg=46340.10, stdev=50014.16 lat (usec): min=1081, max=662334, avg=46350.97, stdev=50007.82 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1352], 10.00th=[ 1926], 20.00th=[ 4948], | 30.00th=[ 9896], 40.00th=[ 21890], 50.00th=[ 33817], 60.00th=[ 45876], | 70.00th=[ 59507], 80.00th=[ 79168], 90.00th=[106431], 95.00th=[139461], | 99.00th=[202376], 99.50th=[240124], 99.90th=[379585], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 111, per=26.01%, avg=43.70, stdev=20.33, samples=280 iops : min= 1, max= 27, avg=10.26, stdev= 5.11, samples=280 lat (usec) : 50=0.98%, 100=3.87%, 250=0.62%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.31%, 4=3.84%, 10=6.77%, 20=8.27%, 50=32.62% lat (msec) : 100=27.47%, 250=9.60%, 500=0.29%, 750=0.03%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.07%, sys=4.75%, ctx=6616, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144958: Thu Aug 6 21:39:45 2026 read: IOPS=10, BW=40.4KiB/s (41.3kB/s)(5940KiB/147174msec) clat (usec): min=33, max=332917, avg=47048.06, stdev=36871.85 lat (usec): min=34, max=332919, avg=47049.39, stdev=36871.88 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 310], 20.00th=[ 21103], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[168821], 99.50th=[214959], 99.90th=[283116], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 6, max= 87, per=25.30%, avg=40.73, stdev=18.07, samples=284 iops : min= 1, max= 21, avg= 9.51, stdev= 4.54, samples=284 write: IOPS=10, BW=43.1KiB/s (44.2kB/s)(6348KiB/147174msec); 0 zone resets clat (usec): min=1055, max=920535, avg=48400.44, stdev=54729.60 lat (usec): min=1057, max=920536, avg=48402.92, stdev=54729.63 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 2442], 20.00th=[ 5735], | 30.00th=[ 11338], 40.00th=[ 23200], 50.00th=[ 34866], 60.00th=[ 46924], | 70.00th=[ 62129], 80.00th=[ 80217], 90.00th=[111674], 95.00th=[143655], | 99.00th=[208667], 99.50th=[337642], 99.90th=[379585], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 6, max= 134, per=25.63%, avg=43.06, stdev=19.34, samples=287 iops : min= 1, max= 33, avg=10.11, stdev= 4.87, samples=287 lat (usec) : 50=0.81%, 100=3.68%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.59%, 4=3.65%, 10=6.74%, 20=8.33%, 50=34.24% lat (msec) : 100=26.89%, 250=10.09%, 500=0.46%, 1000=0.03% cpu : usr=0.07%, sys=4.67%, ctx=6599, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144959: Thu Aug 6 21:39:45 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6028KiB/148024msec) clat (usec): min=31, max=1025.4k, avg=49357.04, stdev=48978.50 lat (usec): min=31, max=1025.4k, avg=49358.46, stdev=48978.50 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 12256], | 20.00th=[ 21890], 30.00th=[ 27657], 40.00th=[ 33817], | 50.00th=[ 41157], 60.00th=[ 48497], 70.00th=[ 57410], | 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[ 115868], | 99.00th=[ 187696], 99.50th=[ 240124], 99.90th=[ 675283], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 96, per=25.64%, avg=41.29, stdev=19.51, samples=283 iops : min= 1, max= 24, avg= 9.65, stdev= 4.91, samples=283 write: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6260KiB/148024msec); 0 zone resets clat (usec): min=1084, max=568543, avg=46762.69, stdev=49968.35 lat (usec): min=1085, max=568545, avg=46765.34, stdev=49968.99 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1926], 20.00th=[ 5211], | 30.00th=[ 10159], 40.00th=[ 21365], 50.00th=[ 32900], 60.00th=[ 46400], | 70.00th=[ 62653], 80.00th=[ 81265], 90.00th=[106431], 95.00th=[137364], | 99.00th=[212861], 99.50th=[246416], 99.90th=[367002], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 116, per=25.03%, avg=42.05, stdev=19.06, samples=288 iops : min= 1, max= 29, avg= 9.85, stdev= 4.80, samples=288 lat (usec) : 50=1.24%, 100=2.83%, 250=0.29%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.37%, 4=3.26%, 10=6.87%, 20=8.30%, 50=34.41% lat (msec) : 100=26.95%, 250=9.86%, 500=0.33%, 750=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.64%, ctx=6563, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144962: Thu Aug 6 21:39:45 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6052KiB/148759msec) clat (usec): min=29, max=597353, avg=47114.03, stdev=38878.98 lat (usec): min=30, max=597355, avg=47118.75, stdev=38878.87 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 96], 20.00th=[ 20055], | 30.00th=[ 27657], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[177210], 99.50th=[198181], 99.90th=[350225], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 103, per=25.81%, avg=41.56, stdev=18.57, samples=283 iops : min= 1, max= 25, avg= 9.73, stdev= 4.68, samples=283 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6236KiB/148759msec); 0 zone resets clat (usec): min=1127, max=1270.8k, avg=49418.60, stdev=61448.85 lat (usec): min=1128, max=1270.8k, avg=49422.30, stdev=61449.13 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 2024], | 20.00th=[ 5669], 30.00th=[ 10421], 40.00th=[ 23462], | 50.00th=[ 35390], 60.00th=[ 48497], 70.00th=[ 61604], | 80.00th=[ 83362], 90.00th=[ 113771], 95.00th=[ 141558], | 99.00th=[ 231736], 99.50th=[ 299893], 99.90th=[ 641729], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 7, max= 103, per=24.93%, avg=41.88, stdev=19.25, samples=289 iops : min= 1, max= 25, avg= 9.81, stdev= 4.85, samples=289 lat (usec) : 50=1.07%, 100=3.97%, 250=0.39%, 500=0.13%, 1000=0.03% lat (msec) : 2=5.01%, 4=3.35%, 10=6.93%, 20=8.24%, 50=32.42% lat (msec) : 100=27.96%, 250=10.06%, 500=0.29%, 750=0.10%, 2000=0.03% cpu : usr=0.06%, sys=4.67%, ctx=6503, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=161KiB/s (165kB/s), 40.4KiB/s-41.3KiB/s (41.3kB/s-42.3kB/s), io=23.4MiB (24.6MB), run=144931-148759msec WRITE: bw=169KiB/s (173kB/s), 41.9KiB/s-43.4KiB/s (42.9kB/s-44.5kB/s), io=24.6MiB (25.7MB), run=144931-148759msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144955: Thu Aug 6 21:42:36 2026 read: IOPS=4, BW=18.9KiB/s (19.3kB/s)(5992KiB/317408msec) clat (msec): min=5, max=1399, avg=43.79, stdev=55.70 lat (msec): min=5, max=1399, avg=43.80, stdev=55.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 90], 95.00th=[ 125], | 99.00th=[ 215], 99.50th=[ 279], 99.90th=[ 510], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7, max= 87, per=29.40%, avg=22.05, stdev=15.38, samples=523 iops : min= 1, max= 21, avg= 4.89, stdev= 3.88, samples=523 write: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6296KiB/317408msec); 0 zone resets clat (msec): min=41, max=1063, avg=159.69, stdev=83.74 lat (msec): min=41, max=1063, avg=159.69, stdev=83.75 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 124], 50.00th=[ 140], 60.00th=[ 157], | 70.00th=[ 180], 80.00th=[ 211], 90.00th=[ 266], 95.00th=[ 317], | 99.00th=[ 451], 99.50th=[ 477], 99.90th=[ 768], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 48, per=25.39%, avg=19.80, stdev= 9.44, samples=609 iops : min= 1, max= 12, avg= 4.32, stdev= 2.42, samples=609 lat (msec) : 10=2.28%, 20=12.92%, 50=21.45%, 100=20.15%, 250=36.26% lat (msec) : 500=6.67%, 750=0.16%, 1000=0.03%, 2000=0.07% cpu : usr=0.03%, sys=1.15%, ctx=5403, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144957: Thu Aug 6 21:42:36 2026 read: IOPS=4, BW=18.6KiB/s (19.1kB/s)(5940KiB/319213msec) clat (msec): min=5, max=1006, avg=43.02, stdev=49.85 lat (msec): min=5, max=1006, avg=43.02, stdev=49.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 85], 95.00th=[ 123], | 99.00th=[ 241], 99.50th=[ 288], 99.90th=[ 468], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 111, per=29.43%, avg=22.08, stdev=14.99, samples=517 iops : min= 1, max= 27, avg= 4.90, stdev= 3.78, samples=517 write: IOPS=4, BW=19.9KiB/s (20.4kB/s)(6348KiB/319213msec); 0 zone resets clat (msec): min=38, max=1092, avg=160.61, stdev=84.24 lat (msec): min=38, max=1092, avg=160.61, stdev=84.24 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 113], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 209], 90.00th=[ 268], 95.00th=[ 326], | 99.00th=[ 443], 99.50th=[ 489], 99.90th=[ 776], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 56, per=25.14%, avg=19.61, stdev= 9.38, samples=618 iops : min= 1, max= 14, avg= 4.27, stdev= 2.42, samples=618 lat (msec) : 10=1.95%, 20=12.50%, 50=22.20%, 100=19.27%, 250=37.37% lat (msec) : 500=6.45%, 750=0.16%, 1000=0.03%, 2000=0.07% cpu : usr=0.04%, sys=1.18%, ctx=5445, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144960: Thu Aug 6 21:42:36 2026 read: IOPS=4, BW=18.9KiB/s (19.4kB/s)(6028KiB/318704msec) clat (msec): min=5, max=524, avg=44.26, stdev=42.00 lat (msec): min=5, max=524, avg=44.26, stdev=42.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 120], | 99.00th=[ 203], 99.50th=[ 284], 99.90th=[ 405], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 87, per=29.42%, avg=22.06, stdev=14.26, samples=526 iops : min= 1, max= 21, avg= 4.89, stdev= 3.60, samples=526 write: IOPS=4, BW=19.6KiB/s (20.1kB/s)(6260KiB/318704msec); 0 zone resets clat (msec): min=34, max=1134, avg=160.73, stdev=84.43 lat (msec): min=34, max=1134, avg=160.73, stdev=84.43 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 159], | 70.00th=[ 182], 80.00th=[ 215], 90.00th=[ 268], 95.00th=[ 326], | 99.00th=[ 447], 99.50th=[ 472], 99.90th=[ 743], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 47, per=24.88%, avg=19.41, stdev= 9.21, samples=617 iops : min= 1, max= 11, avg= 4.22, stdev= 2.36, samples=617 lat (msec) : 10=1.53%, 20=11.33%, 50=22.98%, 100=20.54%, 250=37.21% lat (msec) : 500=6.28%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5463, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144961: Thu Aug 6 21:42:36 2026 read: IOPS=4, BW=19.2KiB/s (19.7kB/s)(6052KiB/314969msec) clat (msec): min=6, max=693, avg=43.46, stdev=46.86 lat (msec): min=6, max=693, avg=43.46, stdev=46.86 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 88], 95.00th=[ 123], | 99.00th=[ 230], 99.50th=[ 243], 99.90th=[ 651], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 80, per=29.60%, avg=22.20, stdev=14.41, samples=525 iops : min= 1, max= 20, avg= 4.93, stdev= 3.65, samples=525 write: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6236KiB/314969msec); 0 zone resets clat (msec): min=44, max=1263, avg=159.57, stdev=84.79 lat (msec): min=44, max=1263, avg=159.58, stdev=84.79 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 95], | 30.00th=[ 109], 40.00th=[ 124], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 213], 90.00th=[ 264], 95.00th=[ 313], | 99.00th=[ 435], 99.50th=[ 527], 99.90th=[ 709], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 48, per=25.23%, avg=19.68, stdev= 9.31, samples=607 iops : min= 1, max= 12, avg= 4.29, stdev= 2.40, samples=607 lat (msec) : 10=1.89%, 20=11.91%, 50=23.50%, 100=19.82%, 250=36.59% lat (msec) : 500=5.92%, 750=0.33%, 2000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5479, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=75.2KiB/s (77.0kB/s), 18.6KiB/s-19.2KiB/s (19.1kB/s-19.7kB/s), io=23.4MiB (24.6MB), run=314969-319213msec WRITE: bw=78.8KiB/s (80.6kB/s), 19.6KiB/s-19.9KiB/s (20.1kB/s-20.4kB/s), io=24.6MiB (25.7MB), run=314969-319213msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145026: Thu Aug 6 21:43:16 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(5920KiB/28012msec) clat (usec): min=30, max=284825, avg=41004.31, stdev=35774.79 lat (usec): min=30, max=284827, avg=41006.87, stdev=35773.26 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 62], 20.00th=[ 161], | 30.00th=[ 25560], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 53740], 80.00th=[ 59507], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[166724], 99.50th=[240124], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 62, max= 383, per=25.09%, avg=207.96, stdev=65.20, samples=54 iops : min= 3, max= 23, avg=12.30, stdev= 4.07, samples=54 write: IOPS=14, BW=227KiB/s (233kB/s)(6368KiB/28012msec); 0 zone resets clat (usec): min=1504, max=247412, avg=31858.67, stdev=35272.16 lat (usec): min=1505, max=247415, avg=31864.22, stdev=35271.69 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1860], 10.00th=[ 2868], 20.00th=[ 5669], | 30.00th=[ 7832], 40.00th=[ 12649], 50.00th=[ 18220], 60.00th=[ 29230], | 70.00th=[ 39060], 80.00th=[ 54264], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[156238], 99.50th=[212861], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 477, per=25.93%, avg=226.09, stdev=96.01, samples=54 iops : min= 1, max= 29, avg=13.43, stdev= 5.98, samples=54 lat (usec) : 50=1.69%, 100=7.29%, 250=0.91%, 500=0.26%, 750=0.13% lat (msec) : 2=3.26%, 4=4.56%, 10=10.68%, 20=9.90%, 50=33.72% lat (msec) : 100=22.79%, 250=4.69%, 500=0.13% cpu : usr=0.07%, sys=5.76%, ctx=1459, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145027: Thu Aug 6 21:43:16 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5744KiB/27825msec) clat (usec): min=38, max=209937, avg=40478.26, stdev=31494.32 lat (usec): min=38, max=209939, avg=40479.50, stdev=31494.34 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 15401], | 30.00th=[ 24773], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[128451], 99.50th=[183501], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 62, max= 380, per=24.60%, avg=203.94, stdev=73.72, samples=54 iops : min= 3, max= 23, avg=12.04, stdev= 4.61, samples=54 write: IOPS=14, BW=235KiB/s (241kB/s)(6544KiB/27825msec); 0 zone resets clat (usec): min=1581, max=222146, avg=32373.70, stdev=36086.92 lat (usec): min=1582, max=222147, avg=32375.98, stdev=36086.75 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1876], 10.00th=[ 2900], 20.00th=[ 5342], | 30.00th=[ 7963], 40.00th=[ 10945], 50.00th=[ 18482], 60.00th=[ 28443], | 70.00th=[ 40633], 80.00th=[ 55837], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[166724], 99.50th=[181404], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 446, per=26.46%, avg=230.70, stdev=97.87, samples=54 iops : min= 1, max= 27, avg=13.72, stdev= 6.17, samples=54 lat (usec) : 50=0.91%, 100=6.51%, 250=0.52%, 500=0.26% lat (msec) : 2=3.65%, 4=4.30%, 10=12.24%, 20=10.68%, 50=32.68% lat (msec) : 100=22.79%, 250=5.47% cpu : usr=0.07%, sys=6.01%, ctx=1473, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145028: Thu Aug 6 21:43:16 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28878msec) clat (usec): min=38, max=244867, avg=39564.44, stdev=34527.72 lat (usec): min=39, max=244868, avg=39566.99, stdev=34527.61 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 578], | 30.00th=[ 22152], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 43779], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[102237], | 99.00th=[177210], 99.50th=[229639], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 61, max= 380, per=26.46%, avg=219.33, stdev=82.79, samples=55 iops : min= 3, max= 23, avg=13.00, stdev= 5.24, samples=55 write: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28878msec); 0 zone resets clat (usec): min=1593, max=203160, avg=34553.99, stdev=36726.45 lat (usec): min=1594, max=203162, avg=34557.22, stdev=36727.19 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2311], 10.00th=[ 3425], 20.00th=[ 5932], | 30.00th=[ 8356], 40.00th=[ 13698], 50.00th=[ 22938], 60.00th=[ 31589], | 70.00th=[ 43254], 80.00th=[ 57934], 90.00th=[ 82314], 95.00th=[112722], | 99.00th=[183501], 99.50th=[191890], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 46, max= 382, per=23.53%, avg=205.14, stdev=77.18, samples=56 iops : min= 2, max= 23, avg=12.09, stdev= 4.83, samples=56 lat (usec) : 50=1.17%, 100=8.07%, 250=0.65%, 500=0.13%, 750=0.26% lat (msec) : 2=1.95%, 4=3.78%, 10=11.07%, 20=10.29%, 50=35.42% lat (msec) : 100=21.35%, 250=5.86% cpu : usr=0.06%, sys=5.51%, ctx=1486, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145029: Thu Aug 6 21:43:16 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(6032KiB/27273msec) clat (usec): min=35, max=214810, avg=36800.34, stdev=31467.94 lat (usec): min=35, max=214811, avg=36815.17, stdev=31482.45 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 215], | 30.00th=[ 22152], 40.00th=[ 27657], 50.00th=[ 32900], 60.00th=[ 39584], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[147850], 99.50th=[164627], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 30, max= 412, per=26.53%, avg=219.96, stdev=86.84, samples=53 iops : min= 1, max= 25, avg=13.02, stdev= 5.44, samples=53 write: IOPS=14, BW=229KiB/s (235kB/s)(6256KiB/27273msec); 0 zone resets clat (usec): min=1578, max=268707, avg=33772.81, stdev=37847.55 lat (usec): min=1579, max=268710, avg=33780.23, stdev=37843.23 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1844], 10.00th=[ 2540], 20.00th=[ 4817], | 30.00th=[ 7570], 40.00th=[ 11994], 50.00th=[ 19268], 60.00th=[ 30016], | 70.00th=[ 43779], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[185598], 99.50th=[242222], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 542, per=26.31%, avg=229.42, stdev=88.91, samples=53 iops : min= 3, max= 33, avg=13.64, stdev= 5.60, samples=53 lat (usec) : 50=1.30%, 100=7.94%, 250=0.65%, 500=0.26%, 750=0.52% lat (msec) : 2=4.04%, 4=4.82%, 10=10.68%, 20=9.11%, 50=34.77% lat (msec) : 100=21.61%, 250=4.17%, 500=0.13% cpu : usr=0.08%, sys=5.67%, ctx=1489, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=829KiB/s (849kB/s), 206KiB/s-221KiB/s (211kB/s-226kB/s), io=23.4MiB (24.5MB), run=27273-28878msec WRITE: bw=873KiB/s (894kB/s), 209KiB/s-235KiB/s (214kB/s-241kB/s), io=24.6MiB (25.8MB), run=27273-28878msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145030: Thu Aug 6 21:43:56 2026 read: IOPS=5, BW=87.7KiB/s (89.8kB/s)(5920KiB/67540msec) clat (msec): min=7, max=428, avg=37.96, stdev=43.18 lat (msec): min=7, max=428, avg=37.96, stdev=43.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 130], | 99.00th=[ 245], 99.50th=[ 300], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 348, per=27.46%, avg=96.39, stdev=57.86, samples=121 iops : min= 1, max= 21, avg= 5.26, stdev= 3.67, samples=121 write: IOPS=5, BW=94.3KiB/s (96.5kB/s)(6368KiB/67540msec); 0 zone resets clat (msec): min=45, max=578, avg=133.51, stdev=67.38 lat (msec): min=45, max=578, avg=133.52, stdev=67.38 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 215], 95.00th=[ 262], | 99.00th=[ 380], 99.50th=[ 443], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 22, max= 191, per=25.91%, avg=95.62, stdev=42.64, samples=131 iops : min= 1, max= 11, avg= 5.20, stdev= 2.74, samples=131 lat (msec) : 10=1.30%, 20=17.45%, 50=20.57%, 100=23.44%, 250=33.72% lat (msec) : 500=3.39%, 750=0.13% cpu : usr=0.03%, sys=1.38%, ctx=1328, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145031: Thu Aug 6 21:43:56 2026 read: IOPS=5, BW=84.3KiB/s (86.3kB/s)(5744KiB/68146msec) clat (msec): min=7, max=279, avg=35.20, stdev=35.58 lat (msec): min=7, max=279, avg=35.20, stdev=35.58 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 102], | 99.00th=[ 199], 99.50th=[ 253], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 22, max= 382, per=28.02%, avg=98.35, stdev=66.66, samples=114 iops : min= 1, max= 23, avg= 5.38, stdev= 4.20, samples=114 write: IOPS=6, BW=96.0KiB/s (98.3kB/s)(6544KiB/68146msec); 0 zone resets clat (msec): min=47, max=491, avg=134.60, stdev=65.17 lat (msec): min=47, max=491, avg=134.60, stdev=65.17 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 73], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 178], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 347], 99.50th=[ 368], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 22, max= 191, per=26.31%, avg=97.10, stdev=41.74, samples=132 iops : min= 1, max= 11, avg= 5.29, stdev= 2.68, samples=132 lat (msec) : 10=2.21%, 20=16.41%, 50=20.05%, 100=24.22%, 250=33.20% lat (msec) : 500=3.91% cpu : usr=0.03%, sys=1.42%, ctx=1302, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145032: Thu Aug 6 21:43:56 2026 read: IOPS=6, BW=97.1KiB/s (99.4kB/s)(6256KiB/64450msec) clat (msec): min=8, max=322, avg=34.50, stdev=34.15 lat (msec): min=8, max=322, avg=34.50, stdev=34.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 66], 95.00th=[ 102], | 99.00th=[ 171], 99.50th=[ 257], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 380, per=29.83%, avg=104.71, stdev=74.34, samples=118 iops : min= 1, max= 23, avg= 5.76, stdev= 4.71, samples=118 write: IOPS=5, BW=93.6KiB/s (95.8kB/s)(6032KiB/64450msec); 0 zone resets clat (msec): min=40, max=534, avg=134.71, stdev=69.72 lat (msec): min=40, max=534, avg=134.72, stdev=69.72 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 131], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 388], 99.50th=[ 481], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 30, max= 191, per=25.40%, avg=93.74, stdev=41.69, samples=126 iops : min= 1, max= 11, avg= 5.07, stdev= 2.68, samples=126 lat (msec) : 10=1.30%, 20=19.27%, 50=23.05%, 100=22.40%, 250=30.08% lat (msec) : 500=3.78%, 750=0.13% cpu : usr=0.03%, sys=1.56%, ctx=1443, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145033: Thu Aug 6 21:43:56 2026 read: IOPS=5, BW=89.3KiB/s (91.4kB/s)(6032KiB/67581msec) clat (msec): min=8, max=386, avg=38.53, stdev=40.52 lat (msec): min=8, max=386, avg=38.54, stdev=40.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 88], 95.00th=[ 117], | 99.00th=[ 226], 99.50th=[ 292], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 30, max= 320, per=28.94%, avg=101.59, stdev=69.46, samples=116 iops : min= 1, max= 20, avg= 5.57, stdev= 4.46, samples=116 write: IOPS=5, BW=92.6KiB/s (94.8kB/s)(6256KiB/67581msec); 0 zone resets clat (msec): min=43, max=479, avg=134.95, stdev=65.53 lat (msec): min=43, max=479, avg=134.95, stdev=65.53 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 178], 90.00th=[ 209], 95.00th=[ 266], | 99.00th=[ 376], 99.50th=[ 472], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 30, max= 192, per=25.26%, avg=93.21, stdev=42.77, samples=132 iops : min= 1, max= 12, avg= 5.04, stdev= 2.76, samples=132 lat (msec) : 10=0.91%, 20=15.36%, 50=24.48%, 100=23.31%, 250=32.94% lat (msec) : 500=2.99% cpu : usr=0.04%, sys=1.45%, ctx=1391, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=351KiB/s (360kB/s), 84.3KiB/s-97.1KiB/s (86.3kB/s-99.4kB/s), io=23.4MiB (24.5MB), run=64450-68146msec WRITE: bw=370KiB/s (379kB/s), 92.6KiB/s-96.0KiB/s (94.8kB/s-98.3kB/s), io=24.6MiB (25.8MB), run=64450-68146msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145049: Thu Aug 6 21:44:12 2026 read: IOPS=1, BW=1244KiB/s (1274kB/s)(7168KiB/5760msec) clat (usec): min=770, max=2267.8k, avg=468402.51, stdev=804547.57 lat (usec): min=772, max=2267.8k, avg=468404.04, stdev=804547.59 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], | 20.00th=[ 1188], 30.00th=[ 143655], 40.00th=[ 143655], | 50.00th=[ 235930], 60.00th=[ 278922], 70.00th=[ 278922], | 80.00th=[ 350225], 90.00th=[2264925], 95.00th=[2264925], | 99.00th=[2264925], 99.50th=[2264925], 99.90th=[2264925], | 99.95th=[2264925], 99.99th=[2264925] bw ( KiB/s): min= 1440, max= 4055, per=66.93%, avg=2379.50, stdev=1149.25, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=889KiB/s (910kB/s)(5120KiB/5760msec); 0 zone resets clat (msec): min=127, max=1302, avg=478.85, stdev=481.01 lat (msec): min=127, max=1302, avg=478.93, stdev=480.98 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 2015, max= 3923, per=53.35%, avg=2655.00, stdev=1098.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.44%, ctx=261, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145050: Thu Aug 6 21:44:12 2026 read: IOPS=0, BW=407KiB/s (416kB/s)(2048KiB/5038msec) clat (msec): min=250, max=313, avg=281.85, stdev=44.91 lat (msec): min=250, max=313, avg=281.85, stdev=44.91 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1490, max= 2027, per=49.47%, avg=1758.50, stdev=379.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2033KiB/s (2081kB/s)(10.0MiB/5038msec); 0 zone resets clat (msec): min=175, max=824, avg=440.61, stdev=233.72 lat (msec): min=175, max=824, avg=440.75, stdev=233.71 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 239], | 30.00th=[ 241], 40.00th=[ 288], 50.00th=[ 334], 60.00th=[ 363], | 70.00th=[ 527], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1984, max= 4079, per=60.45%, avg=3008.83, stdev=1097.58, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=11.85%, ctx=192, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145051: Thu Aug 6 21:44:12 2026 read: IOPS=1, BW=1334KiB/s (1366kB/s)(6144KiB/4606msec) clat (usec): min=343, max=435105, avg=281023.26, stdev=164539.94 lat (usec): min=344, max=435107, avg=281024.80, stdev=164540.14 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 343], 10.00th=[ 343], 20.00th=[200279], | 30.00th=[200279], 40.00th=[274727], 50.00th=[274727], 60.00th=[341836], | 70.00th=[429917], 80.00th=[429917], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 1946, max= 4031, per=70.11%, avg=2492.25, stdev=1026.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1334KiB/s (1366kB/s)(6144KiB/4606msec); 0 zone resets clat (msec): min=221, max=949, avg=481.40, stdev=290.78 lat (msec): min=221, max=949, avg=481.48, stdev=290.74 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 447], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1965, max= 2909, per=43.97%, avg=2188.60, stdev=403.53, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.94%, ctx=174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145052: Thu Aug 6 21:44:12 2026 read: IOPS=1, BW=1304KiB/s (1335kB/s)(5120KiB/3926msec) clat (usec): min=326, max=431813, avg=204885.41, stdev=208950.81 lat (usec): min=326, max=431814, avg=204886.65, stdev=208951.04 clat percentiles (usec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[189793], 60.00th=[189793], | 70.00th=[404751], 80.00th=[404751], 90.00th=[429917], 95.00th=[429917], | 99.00th=[429917], 99.50th=[429917], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 1946, max= 6047, per=100.00%, avg=3996.50, stdev=2899.84, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1826KiB/s (1870kB/s)(7168KiB/3926msec); 0 zone resets clat (msec): min=141, max=787, avg=407.90, stdev=259.16 lat (msec): min=141, max=787, avg=407.99, stdev=259.14 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 245], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 313], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 768], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1530, max= 6083, per=67.95%, avg=3381.75, stdev=2080.07, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 500=16.67% lat (msec) : 250=25.00%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=11.24%, ctx=138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3556KiB/s (3641kB/s), 407KiB/s-1334KiB/s (416kB/s-1366kB/s), io=20.0MiB (20.0MB), run=3926-5760msec WRITE: bw=4978KiB/s (5097kB/s), 889KiB/s-2033KiB/s (910kB/s-2081kB/s), io=28.0MiB (29.4MB), run=3926-5760msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145054: Thu Aug 6 21:44:13 2026 read: IOPS=1, BW=1215KiB/s (1244kB/s)(7168KiB/5898msec) clat (msec): min=80, max=1275, avg=465.53, stdev=478.56 lat (msec): min=80, max=1275, avg=465.54, stdev=478.56 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 90], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 228], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 969], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1768, max= 2031, per=56.62%, avg=1965.80, stdev=111.26, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=868KiB/s (889kB/s)(5120KiB/5898msec); 0 zone resets clat (msec): min=103, max=2012, avg=510.80, stdev=839.88 lat (msec): min=103, max=2012, avg=510.92, stdev=839.88 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 2039, max= 6000, per=82.69%, avg=4019.50, stdev=2800.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.70%, ctx=58, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145055: Thu Aug 6 21:44:13 2026 read: IOPS=0, BW=351KiB/s (359kB/s)(2048KiB/5837msec) clat (msec): min=102, max=795, avg=449.25, stdev=489.80 lat (msec): min=102, max=795, avg=449.26, stdev=489.80 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1514, max= 2039, per=51.17%, avg=1776.50, stdev=371.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1754KiB/s (1796kB/s)(10.0MiB/5837msec); 0 zone resets clat (msec): min=127, max=978, avg=476.98, stdev=302.44 lat (msec): min=129, max=978, avg=477.38, stdev=302.10 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 249], | 30.00th=[ 255], 40.00th=[ 279], 50.00th=[ 284], 60.00th=[ 435], | 70.00th=[ 477], 80.00th=[ 793], 90.00th=[ 894], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1954, max= 4063, per=53.14%, avg=2583.14, stdev=990.02, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 1000=33.33% cpu : usr=0.05%, sys=3.96%, ctx=80, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145056: Thu Aug 6 21:44:13 2026 read: IOPS=1, BW=1169KiB/s (1197kB/s)(6144KiB/5256msec) clat (msec): min=126, max=1184, avg=434.60, stdev=418.63 lat (msec): min=126, max=1184, avg=434.60, stdev=418.63 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 268], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1984, max= 4063, per=77.55%, avg=2692.67, stdev=1186.98, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1169KiB/s (1197kB/s)(6144KiB/5256msec); 0 zone resets clat (msec): min=145, max=1172, avg=404.52, stdev=400.44 lat (msec): min=146, max=1172, avg=404.61, stdev=400.44 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 224], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 2007, max= 2868, per=46.00%, avg=2236.25, stdev=421.39, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=58.33%, 500=8.33%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=2.84%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145057: Thu Aug 6 21:44:13 2026 read: IOPS=0, BW=991KiB/s (1015kB/s)(5120KiB/5166msec) clat (msec): min=86, max=150, avg=107.90, stdev=26.50 lat (msec): min=86, max=150, avg=107.90, stdev=26.49 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 95], 60.00th=[ 95], | 70.00th=[ 117], 80.00th=[ 117], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 2031, max= 6023, per=100.00%, avg=4027.00, stdev=2822.77, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1388KiB/s (1421kB/s)(7168KiB/5166msec); 0 zone resets clat (msec): min=203, max=1333, avg=639.51, stdev=456.68 lat (msec): min=203, max=1333, avg=639.58, stdev=456.69 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 239], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 472], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 1167], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1553, max= 4063, per=48.18%, avg=2341.80, stdev=984.21, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.06%, sys=3.78%, ctx=98, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3472KiB/s (3556kB/s), 351KiB/s-1215KiB/s (359kB/s-1244kB/s), io=20.0MiB (20.0MB), run=5166-5898msec WRITE: bw=4861KiB/s (4978kB/s), 868KiB/s-1754KiB/s (889kB/s-1796kB/s), io=28.0MiB (29.4MB), run=5166-5898msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145066: Thu Aug 6 21:44:30 2026 read: IOPS=0, BW=2579KiB/s (2641kB/s)(12.0MiB/4765msec) clat (msec): min=691, max=3131, avg=1562.93, stdev=1361.03 lat (msec): min=691, max=3131, avg=1562.94, stdev=1361.03 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=7.98%, ctx=518, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145068: Thu Aug 6 21:44:30 2026 read: IOPS=0, BW=741KiB/s (758kB/s)(4096KiB/5530msec) clat (nsec): min=3214.1M, max=3214.1M, avg=3214081399.00, stdev= 0.00 lat (nsec): min=3214.1M, max=3214.1M, avg=3214083946.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3205], 5.00th=[ 3205], 10.00th=[ 3205], 20.00th=[ 3205], | 30.00th=[ 3205], 40.00th=[ 3205], 50.00th=[ 3205], 60.00th=[ 3205], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1481KiB/s (1517kB/s)(8192KiB/5530msec); 0 zone resets clat (msec): min=480, max=1794, avg=1137.16, stdev=928.95 lat (msec): min=480, max=1794, avg=1137.60, stdev=928.80 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=5.64%, ctx=540, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145070: Thu Aug 6 21:44:30 2026 write: IOPS=0, BW=2383KiB/s (2440kB/s)(12.0MiB/5156msec); 0 zone resets clat (msec): min=605, max=2665, avg=1668.76, stdev=1031.79 lat (msec): min=605, max=2669, avg=1679.66, stdev=1034.33 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 1737], 50.00th=[ 1737], 60.00th=[ 1737], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 7953, max= 8031, per=100.00%, avg=7992.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.46%, ctx=88, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Thu Aug 6 21:44:30 2026 write: IOPS=0, BW=2844KiB/s (2913kB/s)(12.0MiB/4320msec); 0 zone resets clat (msec): min=629, max=2511, avg=1411.32, stdev=980.21 lat (msec): min=632, max=2511, avg=1412.46, stdev=979.09 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.03%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2963KiB/s (3034kB/s), 741KiB/s-2579KiB/s (758kB/s-2641kB/s), io=16.0MiB (16.8MB), run=4765-5530msec WRITE: bw=5925KiB/s (6068kB/s), 1481KiB/s-2844KiB/s (1517kB/s-2913kB/s), io=32.0MiB (33.6MB), run=4320-5530msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145065: Thu Aug 6 21:44:31 2026 read: IOPS=0, BW=2118KiB/s (2168kB/s)(12.0MiB/5803msec) clat (msec): min=201, max=3822, avg=1872.35, stdev=1826.55 lat (msec): min=201, max=3822, avg=1872.35, stdev=1826.55 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 7968, max= 8094, per=100.00%, avg=8031.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.00%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145067: Thu Aug 6 21:44:31 2026 read: IOPS=0, BW=697KiB/s (714kB/s)(4096KiB/5876msec) clat (nsec): min=3574.2M, max=3574.2M, avg=3574192049.00, stdev= 0.00 lat (nsec): min=3574.2M, max=3574.2M, avg=3574195063.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3574], 5.00th=[ 3574], 10.00th=[ 3574], 20.00th=[ 3574], | 30.00th=[ 3574], 40.00th=[ 3574], 50.00th=[ 3574], 60.00th=[ 3574], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1394KiB/s (1428kB/s)(8192KiB/5876msec); 0 zone resets clat (msec): min=347, max=1837, avg=1092.38, stdev=1053.26 lat (msec): min=348, max=1837, avg=1092.97, stdev=1052.70 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.03%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145069: Thu Aug 6 21:44:31 2026 write: IOPS=0, BW=2267KiB/s (2321kB/s)(12.0MiB/5421msec); 0 zone resets clat (msec): min=323, max=3501, avg=1789.46, stdev=1602.92 lat (msec): min=326, max=3501, avg=1791.08, stdev=1601.84 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 7831, max= 8143, per=100.00%, avg=7987.00, stdev=220.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.09%, sys=3.97%, ctx=102, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145071: Thu Aug 6 21:44:31 2026 write: IOPS=0, BW=2399KiB/s (2457kB/s)(12.0MiB/5122msec); 0 zone resets clat (msec): min=360, max=3117, avg=1645.33, stdev=1387.78 lat (msec): min=361, max=3117, avg=1649.32, stdev=1386.97 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 7831, max= 7831, per=100.00%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.46%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2788KiB/s (2855kB/s), 697KiB/s-2118KiB/s (714kB/s-2168kB/s), io=16.0MiB (16.8MB), run=5803-5876msec WRITE: bw=5577KiB/s (5710kB/s), 1394KiB/s-2399KiB/s (1428kB/s-2457kB/s), io=32.0MiB (33.6MB), run=5122-5876msec