== sanity test 398b: DIO and buffer IO race ============== 10:29:25 (1790778565) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.45067 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180159: Wed Sep 30 10:31:41 2026 read: IOPS=12, BW=51.5KiB/s (52.8kB/s)(5992KiB/116286msec) clat (usec): min=31, max=195747, avg=41984.73, stdev=27031.50 lat (usec): min=32, max=195749, avg=41986.24, stdev=27031.54 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11207], 10.00th=[ 15139], 20.00th=[ 21103], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[135267], 99.50th=[143655], 99.90th=[189793], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 7, max= 111, per=25.12%, avg=51.25, stdev=21.05, samples=229 iops : min= 1, max= 27, avg=12.17, stdev= 5.30, samples=229 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6296KiB/116286msec); 0 zone resets clat (usec): min=747, max=758457, avg=33652.05, stdev=38951.43 lat (usec): min=748, max=758458, avg=33660.89, stdev=38954.82 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1188], 10.00th=[ 1483], 20.00th=[ 2999], | 30.00th=[ 6915], 40.00th=[ 15139], 50.00th=[ 24249], 60.00th=[ 32113], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[154141], 99.50th=[179307], 99.90th=[225444], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 134, per=25.39%, avg=54.07, stdev=22.99, samples=228 iops : min= 1, max= 33, avg=12.87, stdev= 5.79, samples=228 lat (usec) : 50=0.20%, 100=1.37%, 250=0.07%, 750=0.03%, 1000=0.39% lat (msec) : 2=7.13%, 4=4.62%, 10=6.28%, 20=11.46%, 50=40.66% lat (msec) : 100=23.27%, 250=4.49%, 1000=0.03% cpu : usr=0.08%, sys=5.02%, ctx=6282, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180160: Wed Sep 30 10:31:41 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(5940KiB/117610msec) clat (usec): min=43, max=181668, avg=41100.53, stdev=26191.46 lat (usec): min=43, max=181670, avg=41102.71, stdev=26191.13 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 6915], 10.00th=[ 15008], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[123208], 99.50th=[137364], 99.90th=[175113], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 7, max= 112, per=24.52%, avg=50.02, stdev=18.99, samples=231 iops : min= 1, max= 28, avg=11.86, stdev= 4.80, samples=231 write: IOPS=13, BW=53.0KiB/s (55.3kB/s)(6348KiB/117610msec); 0 zone resets clat (usec): min=674, max=772254, avg=35378.18, stdev=41301.11 lat (usec): min=675, max=772256, avg=35380.50, stdev=41300.60 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1188], 10.00th=[ 1401], 20.00th=[ 3228], | 30.00th=[ 6456], 40.00th=[ 14484], 50.00th=[ 24773], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[154141], 99.50th=[185598], 99.90th=[333448], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 7, max= 158, per=25.01%, avg=53.28, stdev=24.20, samples=231 iops : min= 1, max= 39, avg=12.69, stdev= 6.08, samples=231 lat (usec) : 50=0.16%, 100=1.89%, 250=0.20%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.52% lat (msec) : 2=6.41%, 4=5.08%, 10=6.64%, 20=10.87%, 50=39.84% lat (msec) : 100=23.01%, 250=5.11%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.82%, ctx=6365, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180161: Wed Sep 30 10:31:41 2026 read: IOPS=12, BW=51.4KiB/s (52.6kB/s)(6028KiB/117293msec) clat (usec): min=27, max=315251, avg=42611.52, stdev=28829.25 lat (usec): min=27, max=315252, avg=42612.79, stdev=28829.24 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9896], 10.00th=[ 15926], 20.00th=[ 21627], | 30.00th=[ 26084], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[179307], 99.90th=[252707], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 104, per=25.07%, avg=51.14, stdev=19.97, samples=231 iops : min= 1, max= 26, avg=12.14, stdev= 5.05, samples=231 write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6260KiB/117293msec); 0 zone resets clat (usec): min=622, max=808801, avg=33632.51, stdev=38948.59 lat (usec): min=622, max=808802, avg=33635.39, stdev=38948.48 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1434], 20.00th=[ 3195], | 30.00th=[ 6652], 40.00th=[ 16188], 50.00th=[ 24773], 60.00th=[ 32900], | 70.00th=[ 43779], 80.00th=[ 56886], 90.00th=[ 77071], 95.00th=[102237], | 99.00th=[147850], 99.50th=[175113], 99.90th=[212861], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 134, per=24.89%, avg=53.02, stdev=24.08, samples=231 iops : min= 1, max= 33, avg=12.62, stdev= 6.07, samples=231 lat (usec) : 50=0.36%, 100=1.63%, 250=0.07%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=7.10%, 4=4.59%, 10=6.05%, 20=9.86%, 50=42.45% lat (msec) : 100=23.05%, 250=4.43%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=4.86%, ctx=6419, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180162: Wed Sep 30 10:31:41 2026 read: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6052KiB/115684msec) clat (usec): min=32, max=807676, avg=42297.65, stdev=34396.52 lat (usec): min=32, max=807676, avg=42305.21, stdev=34393.36 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9765], 10.00th=[ 15664], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[168821], 99.90th=[246416], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 135, per=25.45%, avg=51.92, stdev=22.07, samples=227 iops : min= 1, max= 33, avg=12.34, stdev= 5.56, samples=227 write: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6236KiB/115684msec); 0 zone resets clat (usec): min=757, max=223596, avg=32871.79, stdev=34766.57 lat (usec): min=758, max=223598, avg=32873.48, stdev=34766.38 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1450], 20.00th=[ 3130], | 30.00th=[ 6259], 40.00th=[ 15270], 50.00th=[ 23462], 60.00th=[ 31589], | 70.00th=[ 42730], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[102237], | 99.00th=[154141], 99.50th=[175113], 99.90th=[221250], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 142, per=25.24%, avg=53.77, stdev=23.00, samples=226 iops : min= 1, max= 35, avg=12.79, stdev= 5.80, samples=226 lat (usec) : 50=0.26%, 100=1.76%, 250=0.13%, 500=0.03%, 1000=0.33% lat (msec) : 2=6.93%, 4=4.62%, 10=6.67%, 20=11.39%, 50=41.18% lat (msec) : 100=21.91%, 250=4.75%, 1000=0.03% cpu : usr=0.08%, sys=4.93%, ctx=6355, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=204KiB/s (209kB/s), 50.5KiB/s-52.3KiB/s (51.7kB/s-53.6kB/s), io=23.4MiB (24.6MB), run=115684-117610msec WRITE: bw=214KiB/s (219kB/s), 53.4KiB/s-54.1KiB/s (54.7kB/s-55.4kB/s), io=24.6MiB (25.7MB), run=115684-117610msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180164: Wed Sep 30 10:32:17 2026 read: IOPS=9, BW=39.1KiB/s (39.0kB/s)(5992KiB/153432msec) clat (msec): min=5, max=859, avg=41.29, stdev=45.10 lat (msec): min=5, max=859, avg=41.29, stdev=45.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 87], 95.00th=[ 124], | 99.00th=[ 218], 99.50th=[ 251], 99.90th=[ 393], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 143, per=25.50%, avg=39.53, stdev=26.61, samples=295 iops : min= 1, max= 35, avg= 9.24, stdev= 6.71, samples=295 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6296KiB/153432msec); 0 zone resets clat (msec): min=11, max=277, avg=57.97, stdev=41.06 lat (msec): min=11, max=277, avg=57.97, stdev=41.06 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 87], 90.00th=[ 116], 95.00th=[ 138], | 99.00th=[ 203], 99.50th=[ 255], 99.90th=[ 275], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 128, per=25.13%, avg=40.96, stdev=26.01, samples=299 iops : min= 1, max= 32, avg= 9.59, stdev= 6.57, samples=299 lat (msec) : 10=3.22%, 20=17.45%, 50=45.41%, 100=22.88%, 250=10.48% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.06%, sys=1.76%, ctx=4701, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180165: Wed Sep 30 10:32:17 2026 read: IOPS=9, BW=38.8KiB/s (39.7kB/s)(5940KiB/153067msec) clat (msec): min=4, max=812, avg=40.73, stdev=43.45 lat (msec): min=4, max=812, avg=40.73, stdev=43.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 90], 95.00th=[ 122], | 99.00th=[ 199], 99.50th=[ 230], 99.90th=[ 284], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 152, per=25.46%, avg=39.46, stdev=27.15, samples=293 iops : min= 1, max= 38, avg= 9.22, stdev= 6.85, samples=293 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6348KiB/153067msec); 0 zone resets clat (msec): min=11, max=276, avg=58.12, stdev=40.35 lat (msec): min=11, max=276, avg=58.13, stdev=40.35 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 85], 90.00th=[ 113], 95.00th=[ 136], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 266], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 128, per=25.31%, avg=41.25, stdev=25.17, samples=299 iops : min= 1, max= 32, avg= 9.67, stdev= 6.36, samples=299 lat (msec) : 10=3.42%, 20=17.68%, 50=44.24%, 100=23.86%, 250=10.51% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=1.73%, ctx=4641, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180166: Wed Sep 30 10:32:17 2026 read: IOPS=9, BW=39.1KiB/s (40.1kB/s)(6028KiB/153993msec) clat (msec): min=4, max=394, avg=41.67, stdev=40.19 lat (msec): min=4, max=394, avg=41.67, stdev=40.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 60], 90.00th=[ 90], 95.00th=[ 122], | 99.00th=[ 207], 99.50th=[ 230], 99.90th=[ 376], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 176, per=25.39%, avg=39.36, stdev=25.66, samples=298 iops : min= 1, max= 44, avg= 9.19, stdev= 6.46, samples=298 write: IOPS=10, BW=40.7KiB/s (41.6kB/s)(6260KiB/153993msec); 0 zone resets clat (msec): min=10, max=786, avg=58.03, stdev=44.68 lat (msec): min=10, max=786, avg=58.03, stdev=44.68 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 86], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 226], 99.90th=[ 279], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 120, per=24.77%, avg=40.37, stdev=25.69, samples=301 iops : min= 1, max= 30, avg= 9.45, stdev= 6.49, samples=301 lat (msec) : 10=3.26%, 20=16.54%, 50=45.80%, 100=23.40%, 250=10.74% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.05%, sys=1.70%, ctx=4765, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180167: Wed Sep 30 10:32:17 2026 read: IOPS=9, BW=39.3KiB/s (40.3kB/s)(6052KiB/153956msec) clat (msec): min=5, max=392, avg=41.06, stdev=40.16 lat (msec): min=5, max=392, avg=41.06, stdev=40.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 92], 95.00th=[ 126], | 99.00th=[ 201], 99.50th=[ 224], 99.90th=[ 288], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 150, per=25.93%, avg=40.19, stdev=27.84, samples=293 iops : min= 1, max= 37, avg= 9.40, stdev= 7.02, samples=293 write: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6236KiB/153956msec); 0 zone resets clat (msec): min=9, max=781, avg=58.67, stdev=43.98 lat (msec): min=9, max=781, avg=58.67, stdev=43.99 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 116], 95.00th=[ 136], | 99.00th=[ 190], 99.50th=[ 228], 99.90th=[ 275], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 144, per=24.58%, avg=40.07, stdev=25.61, samples=302 iops : min= 1, max= 36, avg= 9.37, stdev= 6.47, samples=302 lat (msec) : 10=3.35%, 20=18.68%, 50=43.65%, 100=22.46%, 250=11.62% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=1.67%, ctx=4689, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (160kB/s), 38.8KiB/s-39.3KiB/s (39.7kB/s-40.3kB/s), io=23.4MiB (24.6MB), run=153067-153993msec WRITE: bw=163KiB/s (167kB/s), 40.5KiB/s-41.5KiB/s (41.5kB/s-42.5kB/s), io=24.6MiB (25.7MB), run=153067-153993msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180209: Wed Sep 30 10:32:57 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(5920KiB/29837msec) clat (usec): min=40, max=220304, avg=43473.11, stdev=30774.64 lat (usec): min=40, max=220305, avg=43475.33, stdev=30773.94 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 63], 10.00th=[ 11600], 20.00th=[ 21890], | 30.00th=[ 27657], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 60031], 90.00th=[ 79168], 95.00th=[109577], | 99.00th=[147850], 99.50th=[170918], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 63, max= 352, per=25.13%, avg=195.74, stdev=63.27, samples=58 iops : min= 3, max= 22, avg=11.48, stdev= 4.00, samples=58 write: IOPS=13, BW=213KiB/s (219kB/s)(6368KiB/29837msec); 0 zone resets clat (usec): min=1365, max=178250, avg=33804.67, stdev=33252.54 lat (usec): min=1367, max=178251, avg=33807.16, stdev=33252.81 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1926], 10.00th=[ 2540], 20.00th=[ 5538], | 30.00th=[ 9765], 40.00th=[ 17433], 50.00th=[ 23462], 60.00th=[ 31851], | 70.00th=[ 41681], 80.00th=[ 55837], 90.00th=[ 86508], 95.00th=[103285], | 99.00th=[137364], 99.50th=[152044], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 28, max= 447, per=25.95%, avg=212.83, stdev=81.72, samples=58 iops : min= 1, max= 27, avg=12.55, stdev= 5.11, samples=58 lat (usec) : 50=0.91%, 100=3.12%, 250=0.26% lat (msec) : 2=2.99%, 4=4.95%, 10=7.94%, 20=10.16%, 50=41.41% lat (msec) : 100=22.66%, 250=5.60% cpu : usr=0.11%, sys=5.54%, ctx=1708, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180210: Wed Sep 30 10:32:57 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(5744KiB/30586msec) clat (usec): min=38, max=215743, avg=44309.86, stdev=32510.43 lat (usec): min=38, max=215744, avg=44311.43, stdev=32510.19 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 65], 10.00th=[ 12518], 20.00th=[ 20579], | 30.00th=[ 26870], 40.00th=[ 33817], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[110625], | 99.00th=[158335], 99.50th=[202376], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 29, max= 384, per=23.98%, avg=186.78, stdev=83.40, samples=60 iops : min= 1, max= 24, avg=10.90, stdev= 5.25, samples=60 write: IOPS=13, BW=214KiB/s (219kB/s)(6544KiB/30586msec); 0 zone resets clat (usec): min=1083, max=210840, avg=35156.70, stdev=35612.99 lat (usec): min=1085, max=210843, avg=35163.33, stdev=35621.28 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2114], 10.00th=[ 2835], 20.00th=[ 4817], | 30.00th=[ 9634], 40.00th=[ 15926], 50.00th=[ 22938], 60.00th=[ 31065], | 70.00th=[ 42730], 80.00th=[ 65274], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[139461], 99.50th=[152044], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 62, max= 416, per=25.92%, avg=212.52, stdev=83.49, samples=60 iops : min= 3, max= 26, avg=12.53, stdev= 5.25, samples=60 lat (usec) : 50=0.65%, 100=2.99%, 250=0.52% lat (msec) : 2=2.47%, 4=5.99%, 10=8.07%, 20=12.63%, 50=36.98% lat (msec) : 100=23.05%, 250=6.64% cpu : usr=0.08%, sys=5.13%, ctx=1696, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180211: Wed Sep 30 10:32:57 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6256KiB/30721msec) clat (usec): min=46, max=207896, avg=44421.80, stdev=29870.12 lat (usec): min=47, max=207898, avg=44423.02, stdev=29870.12 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 72], 10.00th=[ 14746], 20.00th=[ 23462], | 30.00th=[ 29230], 40.00th=[ 33817], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[101188], | 99.00th=[132645], 99.50th=[196084], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 94, max= 384, per=26.06%, avg=203.00, stdev=69.79, samples=60 iops : min= 5, max= 24, avg=11.93, stdev= 4.37, samples=60 write: IOPS=12, BW=196KiB/s (201kB/s)(6032KiB/30721msec); 0 zone resets clat (usec): min=1336, max=205542, avg=35246.13, stdev=35624.24 lat (usec): min=1337, max=205542, avg=35250.14, stdev=35625.48 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2024], 10.00th=[ 3359], 20.00th=[ 6390], | 30.00th=[ 11207], 40.00th=[ 18482], 50.00th=[ 25560], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 84411], 95.00th=[111674], | 99.00th=[164627], 99.50th=[196084], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 466, per=23.53%, avg=192.93, stdev=96.60, samples=60 iops : min= 1, max= 29, avg=11.30, stdev= 6.08, samples=60 lat (usec) : 50=0.39%, 100=3.52%, 250=0.26%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.08%, 4=3.52%, 10=8.85%, 20=9.11%, 50=42.71% lat (msec) : 100=23.05%, 250=6.25% cpu : usr=0.07%, sys=5.20%, ctx=1718, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180212: Wed Sep 30 10:32:57 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29138msec) clat (usec): min=44, max=204378, avg=43535.93, stdev=30891.45 lat (usec): min=44, max=204379, avg=43548.12, stdev=30901.76 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 13566], 20.00th=[ 22414], | 30.00th=[ 26608], 40.00th=[ 32637], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[170918], 99.50th=[189793], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 412, per=26.29%, avg=204.77, stdev=74.11, samples=57 iops : min= 1, max= 25, avg=12.04, stdev= 4.68, samples=57 write: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29138msec); 0 zone resets clat (usec): min=1338, max=232198, avg=32016.18, stdev=32279.56 lat (usec): min=1340, max=232199, avg=32018.89, stdev=32279.74 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2147], 10.00th=[ 3064], 20.00th=[ 5735], | 30.00th=[ 8848], 40.00th=[ 14615], 50.00th=[ 23462], 60.00th=[ 29230], | 70.00th=[ 39584], 80.00th=[ 53740], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[156238], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 32, max= 372, per=25.82%, avg=211.75, stdev=81.20, samples=57 iops : min= 2, max= 23, avg=12.47, stdev= 5.12, samples=57 lat (usec) : 50=0.26%, 100=3.78%, 250=0.13%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=4.95%, 10=9.11%, 20=10.68%, 50=41.54% lat (msec) : 100=21.61%, 250=5.08% cpu : usr=0.05%, sys=5.22%, ctx=1621, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=780KiB/s (798kB/s), 188KiB/s-207KiB/s (192kB/s-212kB/s), io=23.4MiB (24.5MB), run=29138-30721msec WRITE: bw=820KiB/s (840kB/s), 196KiB/s-215KiB/s (201kB/s-220kB/s), io=24.6MiB (25.8MB), run=29138-30721msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180213: Wed Sep 30 10:33:10 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(5920KiB/42429msec) clat (msec): min=7, max=230, avg=47.57, stdev=38.20 lat (msec): min=7, max=230, avg=47.57, stdev=38.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 71], 90.00th=[ 97], 95.00th=[ 125], | 99.00th=[ 199], 99.50th=[ 226], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 445, per=24.98%, avg=138.13, stdev=87.65, samples=82 iops : min= 1, max= 27, avg= 7.85, stdev= 5.57, samples=82 write: IOPS=9, BW=150KiB/s (154kB/s)(6368KiB/42429msec); 0 zone resets clat (msec): min=12, max=312, avg=61.66, stdev=40.27 lat (msec): min=12, max=312, avg=61.69, stdev=40.26 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 70], 80.00th=[ 85], 90.00th=[ 115], 95.00th=[ 136], | 99.00th=[ 230], 99.50th=[ 271], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 352, per=25.80%, avg=150.17, stdev=72.00, samples=82 iops : min= 1, max= 22, avg= 8.62, stdev= 4.60, samples=82 lat (msec) : 10=1.17%, 20=9.51%, 50=49.22%, 100=28.13%, 250=11.59% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.73%, ctx=1173, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180214: Wed Sep 30 10:33:10 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(5744KiB/43235msec) clat (msec): min=5, max=231, avg=48.03, stdev=37.18 lat (msec): min=5, max=231, avg=48.03, stdev=37.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 103], 95.00th=[ 128], | 99.00th=[ 176], 99.50th=[ 188], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 29, max= 352, per=24.33%, avg=134.55, stdev=80.34, samples=83 iops : min= 1, max= 22, avg= 7.63, stdev= 5.14, samples=83 write: IOPS=9, BW=151KiB/s (155kB/s)(6544KiB/43235msec); 0 zone resets clat (msec): min=14, max=272, avg=63.26, stdev=41.87 lat (msec): min=14, max=272, avg=63.27, stdev=41.87 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 150], | 99.00th=[ 205], 99.50th=[ 224], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 346, per=25.69%, avg=149.49, stdev=75.54, samples=85 iops : min= 1, max= 21, avg= 8.59, stdev= 4.82, samples=85 lat (msec) : 10=1.04%, 20=9.24%, 50=49.35%, 100=26.56%, 250=13.67% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.68%, ctx=1216, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180215: Wed Sep 30 10:33:10 2026 read: IOPS=9, BW=145KiB/s (148kB/s)(6256KiB/43190msec) clat (msec): min=7, max=233, avg=48.43, stdev=39.33 lat (msec): min=7, max=233, avg=48.43, stdev=39.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 105], 95.00th=[ 140], | 99.00th=[ 211], 99.50th=[ 230], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 413, per=26.50%, avg=146.56, stdev=85.87, samples=84 iops : min= 1, max= 25, avg= 8.39, stdev= 5.44, samples=84 write: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43190msec); 0 zone resets clat (msec): min=13, max=270, avg=63.65, stdev=42.12 lat (msec): min=13, max=270, avg=63.66, stdev=42.12 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 117], 95.00th=[ 144], | 99.00th=[ 224], 99.50th=[ 266], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 352, per=24.23%, avg=141.00, stdev=73.40, samples=83 iops : min= 1, max= 22, avg= 8.05, stdev= 4.71, samples=83 lat (msec) : 10=0.65%, 20=9.90%, 50=49.48%, 100=26.30%, 250=13.41% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.72%, ctx=1155, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180216: Wed Sep 30 10:33:10 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(6032KiB/43018msec) clat (msec): min=9, max=216, avg=49.37, stdev=37.56 lat (msec): min=9, max=216, avg=49.37, stdev=37.56 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 174], 99.50th=[ 203], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 352, per=25.39%, avg=140.43, stdev=76.37, samples=84 iops : min= 1, max= 22, avg= 8.01, stdev= 4.85, samples=84 write: IOPS=9, BW=145KiB/s (149kB/s)(6256KiB/43018msec); 0 zone resets clat (msec): min=13, max=308, avg=61.84, stdev=42.23 lat (msec): min=13, max=308, avg=61.84, stdev=42.23 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 95], 90.00th=[ 120], 95.00th=[ 134], | 99.00th=[ 224], 99.50th=[ 275], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 352, per=24.93%, avg=145.12, stdev=77.31, samples=85 iops : min= 1, max= 22, avg= 8.31, stdev= 4.95, samples=85 lat (msec) : 10=0.26%, 20=10.03%, 50=49.87%, 100=25.65%, 250=13.93% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.76%, ctx=1322, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=554KiB/s (567kB/s), 133KiB/s-145KiB/s (136kB/s-148kB/s), io=23.4MiB (24.5MB), run=42429-43235msec WRITE: bw=583KiB/s (597kB/s), 140KiB/s-151KiB/s (143kB/s-155kB/s), io=24.6MiB (25.8MB), run=42429-43235msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180231: Wed Sep 30 10:33:24 2026 read: IOPS=3, BW=3311KiB/s (3390kB/s)(7168KiB/2165msec) clat (msec): min=74, max=238, avg=148.43, stdev=57.48 lat (msec): min=74, max=238, avg=148.43, stdev=57.48 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 110], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 133], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 201], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 2019, max= 8175, per=77.39%, avg=4079.00, stdev=3547.26, samples=3 iops : min= 1, max= 7, avg= 3.00, stdev= 3.46, samples=3 write: IOPS=2, BW=2365KiB/s (2422kB/s)(5120KiB/2165msec); 0 zone resets clat (msec): min=72, max=347, avg=171.70, stdev=110.07 lat (msec): min=72, max=347, avg=171.79, stdev=110.09 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 2043, max= 4087, per=46.07%, avg=3400.33, stdev=1175.51, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=66.67%, 500=8.33% cpu : usr=0.00%, sys=18.06%, ctx=219, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180232: Wed Sep 30 10:33:24 2026 read: IOPS=0, BW=527KiB/s (540kB/s)(2048KiB/3885msec) clat (msec): min=124, max=226, avg=175.55, stdev=72.59 lat (msec): min=124, max=226, avg=175.55, stdev=72.59 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 1376, max= 2048, per=32.48%, avg=1712.00, stdev=475.18, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2636KiB/s (2699kB/s)(10.0MiB/3885msec); 0 zone resets clat (msec): min=149, max=713, avg=335.30, stdev=188.94 lat (msec): min=149, max=713, avg=335.64, stdev=188.72 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 186], | 30.00th=[ 209], 40.00th=[ 222], 50.00th=[ 266], 60.00th=[ 268], | 70.00th=[ 275], 80.00th=[ 531], 90.00th=[ 542], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2011, max= 6144, per=41.40%, avg=3055.33, stdev=1721.42, samples=6 iops : min= 1, max= 6, avg= 2.33, stdev= 1.97, samples=6 lat (msec) : 250=50.00%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=13.80%, ctx=167, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180233: Wed Sep 30 10:33:24 2026 read: IOPS=1, BW=2044KiB/s (2093kB/s)(6144KiB/3006msec) clat (usec): min=1931, max=554165, avg=191278.24, stdev=202977.23 lat (usec): min=1932, max=554166, avg=191279.63, stdev=202977.26 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 1926], 10.00th=[ 1926], 20.00th=[ 1942], | 30.00th=[ 1942], 40.00th=[158335], 50.00th=[158335], 60.00th=[204473], | 70.00th=[227541], 80.00th=[227541], 90.00th=[557843], 95.00th=[557843], | 99.00th=[557843], 99.50th=[557843], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 2035, max= 6131, per=64.56%, avg=3403.00, stdev=2362.52, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=2044KiB/s (2093kB/s)(6144KiB/3006msec); 0 zone resets clat (msec): min=133, max=582, avg=302.09, stdev=182.56 lat (msec): min=133, max=583, avg=302.33, stdev=182.83 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 321], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2043, max= 4087, per=34.61%, avg=2554.00, stdev=1022.00, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 2=16.67%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=12.88%, ctx=150, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180234: Wed Sep 30 10:33:24 2026 read: IOPS=1, BW=1475KiB/s (1510kB/s)(5120KiB/3471msec) clat (usec): min=377, max=172082, avg=35078.49, stdev=76589.20 lat (usec): min=378, max=172083, avg=35079.53, stdev=76589.35 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 379], 10.00th=[ 379], 20.00th=[ 379], | 30.00th=[ 465], 40.00th=[ 465], 50.00th=[ 791], 60.00th=[ 791], | 70.00th=[ 1680], 80.00th=[ 1680], 90.00th=[173016], 95.00th=[173016], | 99.00th=[173016], 99.50th=[173016], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 2043, max= 6071, per=76.97%, avg=4057.00, stdev=2848.23, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2065KiB/s (2115kB/s)(7168KiB/3471msec); 0 zone resets clat (msec): min=153, max=903, avg=428.99, stdev=253.34 lat (msec): min=153, max=903, avg=429.09, stdev=253.31 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 268], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 351], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 625], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2043, max= 4087, per=36.92%, avg=2724.33, stdev=1180.10, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.09%, ctx=133, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5272KiB/s (5398kB/s), 527KiB/s-3311KiB/s (540kB/s-3390kB/s), io=20.0MiB (20.0MB), run=2165-3885msec WRITE: bw=7380KiB/s (7557kB/s), 2044KiB/s-2636KiB/s (2093kB/s-2699kB/s), io=28.0MiB (29.4MB), run=2165-3885msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180235: Wed Sep 30 10:33:24 2026 read: IOPS=2, BW=2234KiB/s (2288kB/s)(7168KiB/3208msec) clat (msec): min=76, max=565, avg=170.63, stdev=175.95 lat (msec): min=76, max=565, avg=170.63, stdev=175.95 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 80], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 114], 60.00th=[ 130], | 70.00th=[ 130], 80.00th=[ 146], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1434, max= 4047, per=62.46%, avg=3165.33, stdev=1499.46, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1596KiB/s (1634kB/s)(5120KiB/3208msec); 0 zone resets clat (msec): min=144, max=553, avg=348.29, stdev=170.65 lat (msec): min=144, max=553, avg=348.41, stdev=170.65 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1992, max= 2039, per=28.44%, avg=2018.00, stdev=23.90, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=16.67% cpu : usr=0.03%, sys=5.52%, ctx=94, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180236: Wed Sep 30 10:33:24 2026 read: IOPS=0, BW=507KiB/s (519kB/s)(2048KiB/4041msec) clat (msec): min=115, max=196, avg=156.22, stdev=57.67 lat (msec): min=115, max=196, avg=156.22, stdev=57.67 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1448, max= 2031, per=34.32%, avg=1739.50, stdev=412.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2534KiB/s (2595kB/s)(10.0MiB/4041msec); 0 zone resets clat (msec): min=124, max=1037, avg=356.24, stdev=288.49 lat (msec): min=124, max=1037, avg=356.60, stdev=288.60 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 153], | 30.00th=[ 167], 40.00th=[ 209], 50.00th=[ 251], 60.00th=[ 284], | 70.00th=[ 321], 80.00th=[ 326], 90.00th=[ 693], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1992, max= 4087, per=45.74%, avg=3245.60, stdev=1123.14, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=5.67%, ctx=118, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180237: Wed Sep 30 10:33:24 2026 read: IOPS=1, BW=1653KiB/s (1693kB/s)(6144KiB/3716msec) clat (msec): min=80, max=440, avg=210.00, stdev=144.54 lat (msec): min=80, max=440, avg=210.00, stdev=144.54 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 113], 60.00th=[ 199], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1992, max= 4047, per=53.08%, avg=2690.00, stdev=1175.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1653KiB/s (1693kB/s)(6144KiB/3716msec); 0 zone resets clat (msec): min=89, max=754, avg=389.16, stdev=219.93 lat (msec): min=89, max=754, avg=389.53, stdev=219.92 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 430], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2023, max= 2868, per=31.58%, avg=2240.25, stdev=418.55, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 1000=8.33% cpu : usr=0.08%, sys=4.63%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180238: Wed Sep 30 10:33:24 2026 read: IOPS=1, BW=1309KiB/s (1341kB/s)(5120KiB/3911msec) clat (msec): min=58, max=410, avg=228.00, stdev=133.87 lat (msec): min=58, max=410, avg=228.00, stdev=133.87 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 3984, max= 4063, per=79.39%, avg=4023.50, stdev=55.86, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1833KiB/s (1877kB/s)(7168KiB/3911msec); 0 zone resets clat (msec): min=257, max=625, avg=388.28, stdev=137.22 lat (msec): min=257, max=629, avg=389.02, stdev=138.50 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 268], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 388], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 493], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1396, max= 4087, per=32.56%, avg=2310.40, stdev=1029.65, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=66.67%, 750=8.33% cpu : usr=0.00%, sys=5.01%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5068KiB/s (5190kB/s), 507KiB/s-2234KiB/s (519kB/s-2288kB/s), io=20.0MiB (20.0MB), run=3208-4041msec WRITE: bw=7095KiB/s (7266kB/s), 1596KiB/s-2534KiB/s (1634kB/s-2595kB/s), io=28.0MiB (29.4MB), run=3208-4041msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180245: Wed Sep 30 10:33:39 2026 read: IOPS=1, BW=5345KiB/s (5473kB/s)(12.0MiB/2299msec) clat (msec): min=218, max=1486, avg=734.64, stdev=666.23 lat (msec): min=218, max=1486, avg=734.64, stdev=666.23 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 6815, max= 7892, per=100.00%, avg=7353.50, stdev=761.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.83%, ctx=52, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180246: Wed Sep 30 10:33:39 2026 read: IOPS=0, BW=1284KiB/s (1314kB/s)(4096KiB/3191msec) clat (nsec): min=1550.8M, max=1550.8M, avg=1550782316.00, stdev= 0.00 lat (nsec): min=1550.8M, max=1550.8M, avg=1550784463.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1552], 5.00th=[ 1552], 10.00th=[ 1552], 20.00th=[ 1552], | 30.00th=[ 1552], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2567KiB/s (2629kB/s)(8192KiB/3191msec); 0 zone resets clat (msec): min=280, max=1251, avg=766.16, stdev=686.76 lat (msec): min=281, max=1252, avg=766.61, stdev=686.62 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.42%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180247: Wed Sep 30 10:33:39 2026 write: IOPS=0, BW=3791KiB/s (3882kB/s)(12.0MiB/3241msec); 0 zone resets clat (msec): min=890, max=1233, avg=1059.57, stdev=171.23 lat (msec): min=891, max=1233, avg=1060.08, stdev=171.12 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7742, max= 7816, per=76.94%, avg=7779.00, stdev=52.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.69%, ctx=61, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180248: Wed Sep 30 10:33:39 2026 write: IOPS=1, BW=4699KiB/s (4812kB/s)(12.0MiB/2615msec); 0 zone resets clat (msec): min=485, max=1271, avg=841.85, stdev=398.09 lat (msec): min=486, max=1272, avg=842.23, stdev=398.14 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 6420, max= 8159, per=72.10%, avg=7289.50, stdev=1229.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.71%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5134KiB/s (5258kB/s), 1284KiB/s-5345KiB/s (1314kB/s-5473kB/s), io=16.0MiB (16.8MB), run=2299-3191msec WRITE: bw=9.87MiB/s (10.4MB/s), 2567KiB/s-4699KiB/s (2629kB/s-4812kB/s), io=32.0MiB (33.6MB), run=2615-3241msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180249: Wed Sep 30 10:33:39 2026 read: IOPS=1, BW=5322KiB/s (5450kB/s)(12.0MiB/2309msec) clat (msec): min=656, max=807, avg=739.76, stdev=76.65 lat (msec): min=656, max=807, avg=739.76, stdev=76.65 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7968, max= 8192, per=100.00%, avg=8080.00, stdev=158.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.30%, ctx=409, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180250: Wed Sep 30 10:33:39 2026 read: IOPS=0, BW=1141KiB/s (1168kB/s)(4096KiB/3591msec) clat (nsec): min=709647k, max=709647k, avg=709647437.00, stdev= 0.00 lat (nsec): min=709650k, max=709650k, avg=709649867.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2281KiB/s (2336kB/s)(8192KiB/3591msec); 0 zone resets clat (msec): min=271, max=2554, avg=1412.54, stdev=1614.31 lat (msec): min=271, max=2555, avg=1413.56, stdev=1615.22 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 2567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=4.23%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180251: Wed Sep 30 10:33:39 2026 write: IOPS=0, BW=3446KiB/s (3529kB/s)(12.0MiB/3566msec); 0 zone resets clat (msec): min=714, max=1869, avg=1148.53, stdev=628.58 lat (msec): min=714, max=1869, avg=1148.89, stdev=628.55 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8126, max= 8159, per=89.23%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.19%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180252: Wed Sep 30 10:33:39 2026 write: IOPS=1, BW=4218KiB/s (4320kB/s)(12.0MiB/2913msec); 0 zone resets clat (msec): min=408, max=1242, avg=938.39, stdev=460.94 lat (msec): min=408, max=1243, avg=944.71, stdev=465.12 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7787, max= 8192, per=87.56%, avg=7989.50, stdev=286.38, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.43%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4563KiB/s (4672kB/s), 1141KiB/s-5322KiB/s (1168kB/s-5450kB/s), io=16.0MiB (16.8MB), run=2309-3591msec WRITE: bw=9125KiB/s (9344kB/s), 2281KiB/s-4218KiB/s (2336kB/s-4320kB/s), io=32.0MiB (33.6MB), run=2913-3591msec