== sanity test 398b: DIO and buffer IO race ============== 23:06:20 (1787799980) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.2728 s, 9.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179969: Wed Aug 26 23:08:35 2026 read: IOPS=13, BW=52.9KiB/s (54.2kB/s)(5992KiB/113210msec) clat (usec): min=44, max=655492, avg=41319.29, stdev=32605.91 lat (usec): min=44, max=655493, avg=41321.38, stdev=32606.79 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 11338], 10.00th=[ 15795], 20.00th=[ 20317], | 30.00th=[ 25297], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[139461], 99.50th=[219153], 99.90th=[291505], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 15, max= 103, per=25.85%, avg=52.73, stdev=19.50, samples=223 iops : min= 3, max= 25, avg=12.55, stdev= 4.91, samples=223 write: IOPS=13, BW=55.6KiB/s (56.9kB/s)(6296KiB/113210msec); 0 zone resets clat (usec): min=1063, max=363656, avg=32458.69, stdev=32362.05 lat (usec): min=1065, max=363657, avg=32461.33, stdev=32362.43 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1434], 10.00th=[ 2278], 20.00th=[ 4490], | 30.00th=[ 8029], 40.00th=[ 16057], 50.00th=[ 23725], 60.00th=[ 32637], | 70.00th=[ 43254], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[131597], 99.50th=[145753], 99.90th=[233833], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 142, per=26.02%, avg=55.42, stdev=22.08, samples=223 iops : min= 1, max= 35, avg=13.22, stdev= 5.60, samples=223 lat (usec) : 50=0.20%, 100=1.11%, 250=0.49%, 500=0.07%, 750=0.03% lat (msec) : 2=4.36%, 4=4.95%, 10=7.85%, 20=12.89%, 50=41.76% lat (msec) : 100=22.88%, 250=3.26%, 500=0.13%, 750=0.03% cpu : usr=0.10%, sys=6.08%, ctx=6848, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179970: Wed Aug 26 23:08:35 2026 read: IOPS=13, BW=52.1KiB/s (53.4kB/s)(5940KiB/113987msec) clat (usec): min=46, max=724177, avg=40908.45, stdev=31403.18 lat (usec): min=47, max=724179, avg=40912.26, stdev=31402.34 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 10683], 10.00th=[ 15795], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 48497], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[132645], 99.50th=[152044], 99.90th=[258999], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 110, per=25.41%, avg=51.84, stdev=20.75, samples=224 iops : min= 1, max= 27, avg=12.33, stdev= 5.23, samples=224 write: IOPS=13, BW=55.7KiB/s (57.0kB/s)(6348KiB/113987msec); 0 zone resets clat (usec): min=1075, max=348576, avg=33433.41, stdev=33550.72 lat (usec): min=1077, max=348579, avg=33438.04, stdev=33550.12 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1467], 10.00th=[ 2180], 20.00th=[ 4359], | 30.00th=[ 8291], 40.00th=[ 17171], 50.00th=[ 25297], 60.00th=[ 32637], | 70.00th=[ 41681], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[158335], 99.90th=[204473], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 142, per=26.10%, avg=55.58, stdev=23.84, samples=223 iops : min= 1, max= 35, avg=13.26, stdev= 6.00, samples=223 lat (usec) : 50=0.07%, 100=1.53%, 250=0.26%, 500=0.03%, 750=0.03% lat (msec) : 2=4.65%, 4=5.01%, 10=7.39%, 20=11.88%, 50=43.26% lat (msec) : 100=21.84%, 250=3.94%, 500=0.07%, 750=0.03% cpu : usr=0.11%, sys=6.17%, ctx=6903, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179971: Wed Aug 26 23:08:35 2026 read: IOPS=13, BW=52.3KiB/s (53.5kB/s)(6028KiB/115311msec) clat (usec): min=40, max=253105, avg=41545.40, stdev=27735.71 lat (usec): min=40, max=253106, avg=41547.61, stdev=27735.67 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 7701], 10.00th=[ 15401], 20.00th=[ 21627], | 30.00th=[ 26084], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[147850], 99.50th=[166724], 99.90th=[212861], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 110, per=25.56%, avg=52.15, stdev=19.97, samples=227 iops : min= 1, max= 27, avg=12.39, stdev= 5.03, samples=227 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6260KiB/115311msec); 0 zone resets clat (usec): min=1081, max=756117, avg=33563.02, stdev=39040.53 lat (usec): min=1082, max=756118, avg=33567.16, stdev=39040.93 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1483], 10.00th=[ 2212], 20.00th=[ 4228], | 30.00th=[ 7242], 40.00th=[ 15533], 50.00th=[ 23200], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[179307], 99.90th=[333448], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 118, per=25.39%, avg=54.07, stdev=21.78, samples=227 iops : min= 1, max= 29, avg=12.89, stdev= 5.48, samples=227 lat (usec) : 50=0.13%, 100=1.86%, 250=0.29%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.36%, 4=5.24%, 10=8.17%, 20=11.56%, 50=41.37% lat (msec) : 100=22.75%, 250=4.00%, 500=0.10%, 1000=0.03% cpu : usr=0.10%, sys=6.06%, ctx=6913, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179972: Wed Aug 26 23:08:35 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6052KiB/117488msec) clat (usec): min=39, max=198425, avg=41296.29, stdev=25511.72 lat (usec): min=39, max=198428, avg=41300.13, stdev=25509.81 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 10159], 10.00th=[ 15795], 20.00th=[ 21627], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 58983], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[132645], 99.50th=[149947], 99.90th=[189793], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 110, per=25.17%, avg=51.34, stdev=18.89, samples=231 iops : min= 1, max= 27, avg=12.19, stdev= 4.74, samples=231 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6236KiB/117488msec); 0 zone resets clat (usec): min=1062, max=729005, avg=35138.44, stdev=37964.09 lat (usec): min=1064, max=729007, avg=35141.02, stdev=37964.45 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1467], 10.00th=[ 2343], 20.00th=[ 5014], | 30.00th=[ 9241], 40.00th=[ 18744], 50.00th=[ 26346], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 79168], 95.00th=[102237], | 99.00th=[147850], 99.50th=[177210], 99.90th=[270533], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 126, per=24.79%, avg=52.81, stdev=22.45, samples=231 iops : min= 1, max= 31, avg=12.57, stdev= 5.66, samples=231 lat (usec) : 50=0.03%, 100=1.86%, 250=0.20%, 500=0.03%, 750=0.03% lat (msec) : 2=4.33%, 4=4.00%, 10=7.85%, 20=11.36%, 50=40.95% lat (msec) : 100=25.36%, 250=3.94%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=5.97%, ctx=7026, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=204KiB/s (209kB/s), 51.5KiB/s-52.9KiB/s (52.7kB/s-54.2kB/s), io=23.4MiB (24.6MB), run=113210-117488msec WRITE: bw=214KiB/s (219kB/s), 53.1KiB/s-55.7KiB/s (54.4kB/s-57.0kB/s), io=24.6MiB (25.7MB), run=113210-117488msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179964: Wed Aug 26 23:09:21 2026 read: IOPS=9, BW=36.8KiB/s (37.7kB/s)(5992KiB/162935msec) clat (msec): min=6, max=748, avg=41.88, stdev=38.29 lat (msec): min=6, max=748, avg=41.88, stdev=38.28 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 60], 90.00th=[ 88], 95.00th=[ 113], | 99.00th=[ 182], 99.50th=[ 192], 99.90th=[ 271], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 149, per=25.34%, avg=37.00, stdev=22.71, samples=315 iops : min= 1, max= 37, avg= 8.61, stdev= 5.73, samples=315 write: IOPS=9, BW=38.6KiB/s (39.6kB/s)(6296KiB/162935msec); 0 zone resets clat (msec): min=12, max=332, avg=63.42, stdev=39.45 lat (msec): min=12, max=332, avg=63.43, stdev=39.45 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 89], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 201], 99.50th=[ 228], 99.90th=[ 309], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 117, per=25.01%, avg=38.27, stdev=19.57, samples=320 iops : min= 1, max= 29, avg= 8.93, stdev= 4.93, samples=320 lat (msec) : 10=1.30%, 20=12.83%, 50=47.07%, 100=27.54%, 250=11.04% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=2.01%, ctx=4831, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179965: Wed Aug 26 23:09:21 2026 read: IOPS=9, BW=36.3KiB/s (37.2kB/s)(5940KiB/163541msec) clat (msec): min=6, max=817, avg=42.12, stdev=38.69 lat (msec): min=6, max=817, avg=42.12, stdev=38.69 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 88], 95.00th=[ 113], | 99.00th=[ 165], 99.50th=[ 194], 99.90th=[ 243], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 110, per=25.35%, avg=37.02, stdev=21.70, samples=312 iops : min= 1, max= 27, avg= 8.62, stdev= 5.46, samples=312 write: IOPS=9, BW=38.8KiB/s (39.7kB/s)(6348KiB/163541msec); 0 zone resets clat (msec): min=12, max=352, avg=63.40, stdev=40.52 lat (msec): min=12, max=352, avg=63.40, stdev=40.52 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 72], 80.00th=[ 88], 90.00th=[ 114], 95.00th=[ 136], | 99.00th=[ 209], 99.50th=[ 288], 99.90th=[ 334], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 111, per=25.14%, avg=38.46, stdev=19.98, samples=321 iops : min= 1, max= 27, avg= 8.98, stdev= 5.03, samples=321 lat (msec) : 10=1.40%, 20=12.89%, 50=45.70%, 100=29.30%, 250=10.38% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=2.07%, ctx=4744, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179966: Wed Aug 26 23:09:21 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6028KiB/162034msec) clat (msec): min=5, max=401, avg=42.31, stdev=35.82 lat (msec): min=5, max=401, avg=42.31, stdev=35.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 60], 90.00th=[ 87], 95.00th=[ 115], | 99.00th=[ 184], 99.50th=[ 199], 99.90th=[ 271], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 137, per=25.50%, avg=37.23, stdev=21.82, samples=315 iops : min= 1, max= 34, avg= 8.68, stdev= 5.53, samples=315 write: IOPS=9, BW=38.6KiB/s (39.6kB/s)(6260KiB/162034msec); 0 zone resets clat (msec): min=9, max=832, avg=62.56, stdev=42.94 lat (msec): min=9, max=832, avg=62.56, stdev=42.94 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 72], 80.00th=[ 87], 90.00th=[ 110], 95.00th=[ 134], | 99.00th=[ 199], 99.50th=[ 255], 99.90th=[ 368], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 110, per=25.26%, avg=38.64, stdev=19.92, samples=315 iops : min= 1, max= 27, avg= 9.02, stdev= 5.00, samples=315 lat (msec) : 10=1.66%, 20=12.63%, 50=45.90%, 100=29.36%, 250=10.12% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=2.07%, ctx=4776, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179967: Wed Aug 26 23:09:21 2026 read: IOPS=9, BW=36.0KiB/s (37.9kB/s)(6052KiB/163712msec) clat (msec): min=6, max=400, avg=43.45, stdev=36.53 lat (msec): min=6, max=400, avg=43.45, stdev=36.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 118], | 99.00th=[ 180], 99.50th=[ 188], 99.90th=[ 253], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 127, per=25.45%, avg=37.15, stdev=22.43, samples=317 iops : min= 1, max= 31, avg= 8.65, stdev= 5.65, samples=317 write: IOPS=9, BW=38.1KiB/s (39.0kB/s)(6236KiB/163712msec); 0 zone resets clat (msec): min=11, max=818, avg=62.59, stdev=42.86 lat (msec): min=11, max=818, avg=62.59, stdev=42.86 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 88], 90.00th=[ 110], 95.00th=[ 136], | 99.00th=[ 201], 99.50th=[ 262], 99.90th=[ 368], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 111, per=24.86%, avg=38.04, stdev=19.40, samples=319 iops : min= 1, max= 27, avg= 8.87, stdev= 4.89, samples=319 lat (msec) : 10=1.60%, 20=12.57%, 50=46.19%, 100=28.45%, 250=10.87% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.08%, sys=2.07%, ctx=4761, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (150kB/s), 36.3KiB/s-37.2KiB/s (37.2kB/s-38.1kB/s), io=23.4MiB (24.6MB), run=162034-163712msec WRITE: bw=154KiB/s (157kB/s), 38.1KiB/s-38.8KiB/s (39.0kB/s-39.7kB/s), io=24.6MiB (25.7MB), run=162034-163712msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180019: Wed Aug 26 23:10:05 2026 read: IOPS=11, BW=192KiB/s (197kB/s)(5920KiB/30848msec) clat (usec): min=37, max=171448, avg=45250.10, stdev=31261.31 lat (usec): min=37, max=171449, avg=45251.71, stdev=31261.37 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 76], 10.00th=[ 103], 20.00th=[ 22414], | 30.00th=[ 29230], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 82314], 95.00th=[107480], | 99.00th=[141558], 99.50th=[143655], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 448, per=26.74%, avg=191.72, stdev=73.18, samples=60 iops : min= 1, max= 28, avg=11.22, stdev= 4.68, samples=60 write: IOPS=12, BW=206KiB/s (211kB/s)(6368KiB/30848msec); 0 zone resets clat (usec): min=1647, max=179330, avg=35196.22, stdev=34270.68 lat (usec): min=1648, max=179333, avg=35198.99, stdev=34270.67 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2073], 10.00th=[ 3752], 20.00th=[ 6390], | 30.00th=[ 10814], 40.00th=[ 16319], 50.00th=[ 22676], 60.00th=[ 35390], | 70.00th=[ 44303], 80.00th=[ 57934], 90.00th=[ 84411], 95.00th=[112722], | 99.00th=[149947], 99.50th=[164627], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 384, per=27.43%, avg=206.83, stdev=75.48, samples=60 iops : min= 1, max= 24, avg=12.17, stdev= 4.77, samples=60 lat (usec) : 50=0.26%, 100=4.17%, 250=0.91%, 500=0.39%, 750=0.13% lat (msec) : 2=1.82%, 4=4.17%, 10=8.98%, 20=11.07%, 50=35.68% lat (msec) : 100=26.30%, 250=6.12% cpu : usr=0.07%, sys=5.86%, ctx=1628, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180020: Wed Aug 26 23:10:05 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(5744KiB/31891msec) clat (usec): min=40, max=266889, avg=47842.99, stdev=34056.53 lat (usec): min=41, max=266890, avg=47846.54, stdev=34057.41 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 74], 10.00th=[ 12256], 20.00th=[ 22676], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[160433], 99.50th=[179307], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 61, max= 352, per=25.01%, avg=179.35, stdev=68.80, samples=62 iops : min= 3, max= 22, avg=10.44, stdev= 4.36, samples=62 write: IOPS=12, BW=205KiB/s (210kB/s)(6544KiB/31891msec); 0 zone resets clat (usec): min=1698, max=164030, avg=35401.39, stdev=32958.70 lat (usec): min=1701, max=164033, avg=35407.31, stdev=32956.31 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2343], 10.00th=[ 3523], 20.00th=[ 6259], | 30.00th=[ 10945], 40.00th=[ 16909], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 48497], 80.00th=[ 60556], 90.00th=[ 80217], 95.00th=[105382], | 99.00th=[143655], 99.50th=[154141], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 31, max= 477, per=26.91%, avg=202.89, stdev=91.26, samples=62 iops : min= 1, max= 29, avg=11.94, stdev= 5.79, samples=62 lat (usec) : 50=0.26%, 100=3.26%, 250=0.78%, 500=0.13% lat (msec) : 2=1.82%, 4=4.30%, 10=8.72%, 20=10.55%, 50=36.72% lat (msec) : 100=26.69%, 250=6.64%, 500=0.13% cpu : usr=0.08%, sys=5.87%, ctx=1634, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180021: Wed Aug 26 23:10:05 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(6256KiB/33398msec) clat (usec): min=44, max=237761, avg=47595.25, stdev=33594.83 lat (usec): min=45, max=237762, avg=47627.25, stdev=33604.90 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 12256], 20.00th=[ 24511], | 30.00th=[ 29230], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 48497], | 70.00th=[ 56361], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[101188], | 99.00th=[179307], 99.50th=[227541], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 413, per=26.32%, avg=188.71, stdev=82.11, samples=65 iops : min= 1, max= 25, avg=11.03, stdev= 5.16, samples=65 write: IOPS=11, BW=181KiB/s (185kB/s)(6032KiB/33398msec); 0 zone resets clat (usec): min=1628, max=222546, avg=38458.24, stdev=38601.33 lat (usec): min=1632, max=222549, avg=38473.62, stdev=38598.39 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2114], 10.00th=[ 3523], 20.00th=[ 6128], | 30.00th=[ 11076], 40.00th=[ 17957], 50.00th=[ 26084], 60.00th=[ 36963], | 70.00th=[ 46400], 80.00th=[ 64750], 90.00th=[ 92799], 95.00th=[121111], | 99.00th=[164627], 99.50th=[202376], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 446, per=23.90%, avg=180.23, stdev=87.10, samples=65 iops : min= 1, max= 27, avg=10.48, stdev= 5.52, samples=65 lat (usec) : 50=0.13%, 100=4.04%, 250=0.39%, 500=0.13% lat (msec) : 2=2.21%, 4=3.78%, 10=8.46%, 20=8.98%, 50=39.58% lat (msec) : 100=25.13%, 250=7.16% cpu : usr=0.09%, sys=5.90%, ctx=1732, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180022: Wed Aug 26 23:10:05 2026 read: IOPS=11, BW=189KiB/s (193kB/s)(6032KiB/31975msec) clat (usec): min=40, max=230784, avg=47014.61, stdev=35448.43 lat (usec): min=40, max=230786, avg=47025.68, stdev=35450.06 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 21103], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 49546], | 70.00th=[ 61080], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[100140], | 99.00th=[202376], 99.50th=[214959], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 63, max= 413, per=26.12%, avg=187.31, stdev=67.54, samples=62 iops : min= 3, max= 25, avg=10.94, stdev= 4.25, samples=62 write: IOPS=12, BW=196KiB/s (200kB/s)(6256KiB/31975msec); 0 zone resets clat (usec): min=1829, max=267341, avg=35864.75, stdev=38117.81 lat (usec): min=1830, max=267344, avg=35867.56, stdev=38117.86 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2212], 10.00th=[ 3818], 20.00th=[ 6980], | 30.00th=[ 10421], 40.00th=[ 15139], 50.00th=[ 23987], 60.00th=[ 32375], | 70.00th=[ 44303], 80.00th=[ 55837], 90.00th=[ 80217], 95.00th=[114820], | 99.00th=[183501], 99.50th=[208667], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 475, per=25.69%, avg=193.68, stdev=91.11, samples=62 iops : min= 1, max= 29, avg=11.34, stdev= 5.74, samples=62 lat (usec) : 50=0.39%, 100=5.73%, 250=0.52% lat (msec) : 2=1.04%, 4=4.43%, 10=9.77%, 20=10.81%, 50=34.38% lat (msec) : 100=26.95%, 250=5.86%, 500=0.13% cpu : usr=0.10%, sys=5.83%, ctx=1608, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=717KiB/s (734kB/s), 180KiB/s-192KiB/s (184kB/s-197kB/s), io=23.4MiB (24.5MB), run=30848-33398msec WRITE: bw=755KiB/s (773kB/s), 181KiB/s-206KiB/s (185kB/s-211kB/s), io=24.6MiB (25.8MB), run=30848-33398msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180024: Wed Aug 26 23:10:20 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5920KiB/47560msec) clat (msec): min=7, max=273, avg=49.60, stdev=40.54 lat (msec): min=7, max=273, avg=49.61, stdev=40.54 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 384, per=24.63%, avg=123.90, stdev=74.25, samples=92 iops : min= 1, max= 24, avg= 6.91, stdev= 4.74, samples=92 write: IOPS=8, BW=134KiB/s (137kB/s)(6368KiB/47560msec); 0 zone resets clat (msec): min=18, max=287, avg=73.22, stdev=47.57 lat (msec): min=18, max=287, avg=73.22, stdev=47.57 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 104], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 226], 99.50th=[ 284], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 28, max= 319, per=25.38%, avg=134.25, stdev=75.21, samples=92 iops : min= 1, max= 19, avg= 7.58, stdev= 4.76, samples=92 lat (msec) : 10=1.04%, 20=6.38%, 50=46.88%, 100=29.69%, 250=15.49% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.84%, ctx=1259, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180025: Wed Aug 26 23:10:20 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5744KiB/47426msec) clat (msec): min=8, max=291, avg=52.44, stdev=46.00 lat (msec): min=8, max=291, avg=52.45, stdev=46.00 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 123], 95.00th=[ 155], | 99.00th=[ 224], 99.50th=[ 266], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 28, max= 318, per=24.90%, avg=125.24, stdev=75.20, samples=89 iops : min= 1, max= 19, avg= 7.01, stdev= 4.78, samples=89 write: IOPS=8, BW=138KiB/s (141kB/s)(6544KiB/47426msec); 0 zone resets clat (msec): min=16, max=363, avg=69.66, stdev=42.97 lat (msec): min=16, max=363, avg=69.66, stdev=42.97 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 59], 60.00th=[ 67], | 70.00th=[ 77], 80.00th=[ 97], 90.00th=[ 124], 95.00th=[ 155], | 99.00th=[ 215], 99.50th=[ 230], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 317, per=25.87%, avg=136.85, stdev=70.07, samples=93 iops : min= 1, max= 19, avg= 7.74, stdev= 4.44, samples=93 lat (msec) : 10=0.39%, 20=7.55%, 50=43.10%, 100=32.81%, 250=15.63% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.72%, ctx=1242, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180026: Wed Aug 26 23:10:20 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6256KiB/46947msec) clat (msec): min=6, max=223, avg=48.82, stdev=38.14 lat (msec): min=6, max=223, avg=48.83, stdev=38.14 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 67], 90.00th=[ 103], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 409, per=27.84%, avg=140.01, stdev=82.74, samples=88 iops : min= 1, max= 25, avg= 7.94, stdev= 5.24, samples=88 write: IOPS=8, BW=128KiB/s (132kB/s)(6032KiB/46947msec); 0 zone resets clat (msec): min=15, max=360, avg=73.63, stdev=48.44 lat (msec): min=15, max=360, avg=73.63, stdev=48.44 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 46], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 67], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 140], 95.00th=[ 184], | 99.00th=[ 234], 99.50th=[ 266], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 348, per=24.67%, avg=130.50, stdev=65.00, samples=90 iops : min= 1, max= 21, avg= 7.34, stdev= 4.13, samples=90 lat (msec) : 10=0.65%, 20=8.20%, 50=44.14%, 100=30.60%, 250=16.15% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.70%, ctx=1260, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180027: Wed Aug 26 23:10:20 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(6032KiB/47157msec) clat (msec): min=8, max=289, avg=52.50, stdev=44.84 lat (msec): min=8, max=289, avg=52.50, stdev=44.84 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 70], 90.00th=[ 110], 95.00th=[ 150], | 99.00th=[ 222], 99.50th=[ 262], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 319, per=25.76%, avg=129.56, stdev=71.72, samples=91 iops : min= 1, max= 19, avg= 7.27, stdev= 4.57, samples=91 write: IOPS=8, BW=133KiB/s (136kB/s)(6256KiB/47157msec); 0 zone resets clat (msec): min=17, max=284, avg=69.80, stdev=44.78 lat (msec): min=17, max=284, avg=69.81, stdev=44.78 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 65], | 70.00th=[ 80], 80.00th=[ 102], 90.00th=[ 130], 95.00th=[ 169], | 99.00th=[ 224], 99.50th=[ 264], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 349, per=25.35%, avg=134.08, stdev=75.74, samples=92 iops : min= 1, max= 21, avg= 7.58, stdev= 4.80, samples=92 lat (msec) : 10=0.39%, 20=7.42%, 50=46.74%, 100=28.91%, 250=15.89% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.80%, ctx=1214, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=504KiB/s (516kB/s), 121KiB/s-133KiB/s (124kB/s-136kB/s), io=23.4MiB (24.5MB), run=46947-47560msec WRITE: bw=530KiB/s (543kB/s), 128KiB/s-138KiB/s (132kB/s-141kB/s), io=24.6MiB (25.8MB), run=46947-47560msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180040: Wed Aug 26 23:10:36 2026 read: IOPS=1, BW=1254KiB/s (1284kB/s)(7168KiB/5718msec) clat (usec): min=824, max=4183.4k, avg=675002.95, stdev=1549869.96 lat (usec): min=825, max=4183.4k, avg=675004.77, stdev=1549870.22 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], | 20.00th=[ 3752], 30.00th=[ 3785], 40.00th=[ 3785], | 50.00th=[ 133694], 60.00th=[ 158335], 70.00th=[ 158335], | 80.00th=[ 242222], 90.00th=[4177527], 95.00th=[4177527], | 99.00th=[4177527], 99.50th=[4177527], 99.90th=[4177527], | 99.95th=[4177527], 99.99th=[4177527] bw ( KiB/s): min= 2007, max= 4087, per=90.62%, avg=2971.33, stdev=1048.23, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=895KiB/s (917kB/s)(5120KiB/5718msec); 0 zone resets clat (msec): min=71, max=291, avg=161.81, stdev=80.28 lat (msec): min=71, max=291, avg=162.04, stdev=80.19 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 4087, max= 4087, per=89.02%, avg=4087.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (usec) : 1000=8.33% lat (msec) : 4=16.67%, 100=8.33%, 250=50.00%, 500=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.71%, ctx=495, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180041: Wed Aug 26 23:10:36 2026 read: IOPS=0, BW=328KiB/s (336kB/s)(2048KiB/6244msec) clat (usec): min=679, max=201529, avg=101104.15, stdev=142022.44 lat (usec): min=680, max=201531, avg=101106.07, stdev=142023.10 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[202376], | 70.00th=[202376], 80.00th=[202376], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 1418, max= 2035, per=52.65%, avg=1726.50, stdev=436.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1640KiB/s (1679kB/s)(10.0MiB/6244msec); 0 zone resets clat (msec): min=168, max=2589, avg=583.54, stdev=722.04 lat (msec): min=168, max=2589, avg=583.62, stdev=722.04 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 257], 50.00th=[ 262], 60.00th=[ 342], | 70.00th=[ 527], 80.00th=[ 550], 90.00th=[ 642], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2035, max= 4071, per=69.31%, avg=3182.00, stdev=1048.49, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=9.85%, ctx=126, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180042: Wed Aug 26 23:10:36 2026 read: IOPS=1, BW=1057KiB/s (1083kB/s)(6144KiB/5811msec) clat (usec): min=851, max=364883, avg=90666.13, stdev=149952.99 lat (usec): min=852, max=364884, avg=90667.53, stdev=149953.31 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[ 1352], | 30.00th=[ 1352], 40.00th=[ 1745], 50.00th=[ 1745], 60.00th=[ 6128], | 70.00th=[168821], 80.00th=[168821], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1057KiB/s (1083kB/s)(6144KiB/5811msec); 0 zone resets clat (msec): min=173, max=3136, avg=854.96, stdev=1139.19 lat (msec): min=173, max=3136, avg=855.04, stdev=1139.17 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 489], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1892, max= 2813, per=47.83%, avg=2195.75, stdev=417.31, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=16.67%, 10=8.33%, 250=25.00%, 500=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.33%, ctx=127, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180043: Wed Aug 26 23:10:36 2026 read: IOPS=0, BW=964KiB/s (987kB/s)(5120KiB/5310msec) clat (usec): min=834, max=305284, avg=126883.36, stdev=129433.65 lat (usec): min=835, max=305286, avg=126885.01, stdev=129433.81 clat percentiles (usec): | 1.00th=[ 832], 5.00th=[ 832], 10.00th=[ 832], 20.00th=[ 832], | 30.00th=[ 50594], 40.00th=[ 50594], 50.00th=[ 57410], 60.00th=[ 57410], | 70.00th=[219153], 80.00th=[219153], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 1892, max= 6107, per=100.00%, avg=3999.50, stdev=2980.46, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1350KiB/s (1382kB/s)(7168KiB/5310msec); 0 zone resets clat (msec): min=129, max=2967, avg=663.82, stdev=1025.84 lat (msec): min=129, max=2967, avg=663.99, stdev=1025.78 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 159], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 255], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 550], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1414, max= 6131, per=73.56%, avg=3377.00, stdev=2169.85, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.31%, ctx=151, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3280KiB/s (3359kB/s), 328KiB/s-1254KiB/s (336kB/s-1284kB/s), io=20.0MiB (20.0MB), run=5310-6244msec WRITE: bw=4592KiB/s (4702kB/s), 895KiB/s-1640KiB/s (917kB/s-1679kB/s), io=28.0MiB (29.4MB), run=5310-6244msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180045: Wed Aug 26 23:10:37 2026 read: IOPS=1, BW=1062KiB/s (1088kB/s)(7168KiB/6749msec) clat (msec): min=69, max=3595, avg=761.26, stdev=1273.12 lat (msec): min=69, max=3595, avg=761.26, stdev=1273.12 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 99], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 213], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 718], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1396, max= 4096, per=78.49%, avg=2381.50, stdev=1179.92, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=759KiB/s (777kB/s)(5120KiB/6749msec); 0 zone resets clat (msec): min=128, max=429, avg=265.97, stdev=121.24 lat (msec): min=129, max=430, avg=266.13, stdev=121.20 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 2003, max= 4087, per=71.68%, avg=3045.00, stdev=1473.61, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.04%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180046: Wed Aug 26 23:10:37 2026 read: IOPS=0, BW=313KiB/s (321kB/s)(2048KiB/6533msec) clat (msec): min=86, max=533, avg=309.93, stdev=316.00 lat (msec): min=86, max=533, avg=309.93, stdev=316.00 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1404, max= 2015, per=56.34%, avg=1709.50, stdev=432.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1567KiB/s (1605kB/s)(10.0MiB/6533msec); 0 zone resets clat (msec): min=81, max=2584, avg=574.81, stdev=729.75 lat (msec): min=81, max=2585, avg=575.05, stdev=729.74 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 190], | 30.00th=[ 309], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 376], 80.00th=[ 489], 90.00th=[ 776], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1939, max= 6144, per=71.37%, avg=3031.83, stdev=1725.32, samples=6 iops : min= 1, max= 6, avg= 2.17, stdev= 2.04, samples=6 lat (msec) : 100=16.67%, 250=8.33%, 500=50.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=3.86%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180047: Wed Aug 26 23:10:37 2026 read: IOPS=0, BW=965KiB/s (988kB/s)(6144KiB/6367msec) clat (msec): min=56, max=382, avg=142.24, stdev=119.25 lat (msec): min=56, max=382, avg=142.24, stdev=119.25 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 108], | 70.00th=[ 115], 80.00th=[ 115], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 2048, max= 4031, per=100.00%, avg=3367.33, stdev=1142.58, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=0, BW=965KiB/s (988kB/s)(6144KiB/6367msec); 0 zone resets clat (msec): min=105, max=2830, avg=895.54, stdev=1004.24 lat (msec): min=105, max=2830, avg=895.71, stdev=1004.30 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 584], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1406, max= 2048, per=45.32%, avg=1925.00, stdev=254.68, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 100=25.00%, 250=25.00%, 500=25.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.20%, ctx=92, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180048: Wed Aug 26 23:10:37 2026 read: IOPS=0, BW=786KiB/s (805kB/s)(5120KiB/6512msec) clat (msec): min=69, max=842, avg=247.46, stdev=333.55 lat (msec): min=69, max=842, avg=247.46, stdev=333.55 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 101], 60.00th=[ 101], | 70.00th=[ 136], 80.00th=[ 136], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2007, max= 2048, per=66.59%, avg=2020.25, stdev=18.79, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1101KiB/s (1127kB/s)(7168KiB/6512msec); 0 zone resets clat (msec): min=85, max=2757, avg=745.29, stdev=958.70 lat (msec): min=85, max=2757, avg=745.40, stdev=958.70 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 129], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 275], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 1062], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 2027, max= 6035, per=95.33%, avg=4049.67, stdev=2004.26, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.23%, ctx=126, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3035KiB/s (3107kB/s), 313KiB/s-1062KiB/s (321kB/s-1088kB/s), io=20.0MiB (20.0MB), run=6367-6749msec WRITE: bw=4248KiB/s (4350kB/s), 759KiB/s-1567KiB/s (777kB/s-1605kB/s), io=28.0MiB (29.4MB), run=6367-6749msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180060: Wed Aug 26 23:10:51 2026 read: IOPS=1, BW=4407KiB/s (4513kB/s)(12.0MiB/2788msec) clat (msec): min=776, max=935, avg=839.20, stdev=84.46 lat (msec): min=776, max=935, avg=839.20, stdev=84.46 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8000, max= 8175, per=100.00%, avg=8087.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=13.49%, ctx=268, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180061: Wed Aug 26 23:10:51 2026 read: IOPS=0, BW=1141KiB/s (1169kB/s)(4096KiB/3589msec) clat (nsec): min=732517k, max=732517k, avg=732517175.00, stdev= 0.00 lat (nsec): min=732520k, max=732520k, avg=732520065.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2283KiB/s (2337kB/s)(8192KiB/3589msec); 0 zone resets clat (msec): min=312, max=2158, avg=1235.89, stdev=1305.42 lat (msec): min=313, max=2159, avg=1236.42, stdev=1305.60 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.16%, ctx=208, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180062: Wed Aug 26 23:10:51 2026 write: IOPS=0, BW=3480KiB/s (3564kB/s)(12.0MiB/3531msec); 0 zone resets clat (msec): min=874, max=1526, avg=1095.00, stdev=373.41 lat (msec): min=875, max=1528, avg=1096.31, stdev=374.10 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8000, max= 8159, per=88.49%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.54%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180063: Wed Aug 26 23:10:51 2026 write: IOPS=0, BW=4082KiB/s (4180kB/s)(12.0MiB/3010msec); 0 zone resets clat (msec): min=767, max=1111, avg=954.14, stdev=173.69 lat (msec): min=770, max=1111, avg=955.44, stdev=172.21 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7892, max= 8175, per=87.99%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.55%, ctx=106, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4565KiB/s (4675kB/s), 1141KiB/s-4407KiB/s (1169kB/s-4513kB/s), io=16.0MiB (16.8MB), run=2788-3589msec WRITE: bw=9130KiB/s (9349kB/s), 2283KiB/s-4082KiB/s (2337kB/s-4180kB/s), io=32.0MiB (33.6MB), run=3010-3589msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180055: Wed Aug 26 23:10:51 2026 read: IOPS=1, BW=5694KiB/s (5831kB/s)(12.0MiB/2158msec) clat (msec): min=434, max=1224, avg=698.43, stdev=455.96 lat (msec): min=434, max=1224, avg=698.43, stdev=455.96 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7529, max= 8159, per=100.00%, avg=7844.00, stdev=445.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.31%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180057: Wed Aug 26 23:10:51 2026 read: IOPS=0, BW=1015KiB/s (1039kB/s)(4096KiB/4035msec) clat (nsec): min=1160.3M, max=1160.3M, avg=1160287741.00, stdev= 0.00 lat (nsec): min=1160.3M, max=1160.3M, avg=1160290561.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2030KiB/s (2079kB/s)(8192KiB/4035msec); 0 zone resets clat (msec): min=207, max=2584, avg=1395.80, stdev=1680.43 lat (msec): min=207, max=2584, avg=1396.07, stdev=1680.36 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 2601], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.53%, ctx=46, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180058: Wed Aug 26 23:10:51 2026 write: IOPS=1, BW=6467KiB/s (6623kB/s)(12.0MiB/1900msec); 0 zone resets clat (msec): min=245, max=1360, avg=620.47, stdev=641.23 lat (msec): min=246, max=1362, avg=621.61, stdev=641.37 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min=14003, max=14003, per=100.00%, avg=14003.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.11%, sys=7.32%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180059: Wed Aug 26 23:10:51 2026 write: IOPS=1, BW=5545KiB/s (5678kB/s)(12.0MiB/2216msec); 0 zone resets clat (msec): min=343, max=1308, avg=703.29, stdev=527.28 lat (msec): min=346, max=1308, avg=704.41, stdev=526.51 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 5535, max= 5535, per=68.17%, avg=5535.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=6.91%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4060KiB/s (4158kB/s), 1015KiB/s-5694KiB/s (1039kB/s-5831kB/s), io=16.0MiB (16.8MB), run=2158-4035msec WRITE: bw=8121KiB/s (8316kB/s), 2030KiB/s-6467KiB/s (2079kB/s-6623kB/s), io=32.0MiB (33.6MB), run=1900-4035msec