== sanity test 398b: DIO and buffer IO race ============== 10:09:33 (1766416173) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.21772 s, 15.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146996: Mon Dec 22 10:10:31 2025 read: IOPS=30, BW=124KiB/s (127kB/s)(5992KiB/48477msec) clat (usec): min=124, max=741695, avg=16191.76, stdev=21609.39 lat (usec): min=125, max=741697, avg=16192.87, stdev=21609.40 clat percentiles (usec): | 1.00th=[ 200], 5.00th=[ 363], 10.00th=[ 6325], 20.00th=[ 8586], | 30.00th=[ 10159], 40.00th=[ 11600], 50.00th=[ 13566], 60.00th=[ 16188], | 70.00th=[ 19268], 80.00th=[ 22414], 90.00th=[ 27657], 95.00th=[ 32637], | 99.00th=[ 54264], 99.50th=[ 66847], 99.90th=[119014], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 6, max= 208, per=25.02%, avg=123.33, stdev=33.28, samples=96 iops : min= 1, max= 52, avg=30.49, stdev= 8.40, samples=96 write: IOPS=32, BW=130KiB/s (133kB/s)(6296KiB/48477msec); 0 zone resets clat (usec): min=757, max=174974, avg=15279.61, stdev=13812.12 lat (usec): min=757, max=174976, avg=15282.29, stdev=13811.98 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1696], 10.00th=[ 2212], 20.00th=[ 3064], | 30.00th=[ 4686], 40.00th=[ 9110], 50.00th=[ 13042], 60.00th=[ 16057], | 70.00th=[ 19792], 80.00th=[ 24773], 90.00th=[ 31851], 95.00th=[ 39060], | 99.00th=[ 56886], 99.50th=[ 68682], 99.90th=[116917], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 72, max= 208, per=25.38%, avg=130.98, stdev=29.84, samples=95 iops : min= 18, max= 52, avg=32.40, stdev= 7.55, samples=95 lat (usec) : 250=0.94%, 500=2.86%, 750=0.42%, 1000=0.52% lat (msec) : 2=3.22%, 4=10.12%, 10=17.58%, 20=36.00%, 50=26.79% lat (msec) : 100=1.37%, 250=0.13%, 750=0.03% cpu : usr=0.19%, sys=22.32%, ctx=8057, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146997: Mon Dec 22 10:10:31 2025 read: IOPS=30, BW=123KiB/s (126kB/s)(5940KiB/48130msec) clat (usec): min=102, max=73996, avg=15296.16, stdev=9236.50 lat (usec): min=103, max=73998, avg=15299.35, stdev=9239.39 clat percentiles (usec): | 1.00th=[ 188], 5.00th=[ 363], 10.00th=[ 6652], 20.00th=[ 8717], | 30.00th=[10028], 40.00th=[11469], 50.00th=[13042], 60.00th=[15533], | 70.00th=[19006], 80.00th=[22676], 90.00th=[27395], 95.00th=[32375], | 99.00th=[41157], 99.50th=[48497], 99.90th=[64750], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 6, max= 184, per=25.01%, avg=123.29, stdev=31.20, samples=95 iops : min= 1, max= 46, avg=30.47, stdev= 7.77, samples=95 write: IOPS=32, BW=132KiB/s (135kB/s)(6348KiB/48130msec); 0 zone resets clat (usec): min=708, max=733864, avg=15904.10, stdev=22735.06 lat (usec): min=709, max=733865, avg=15905.58, stdev=22735.07 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1811], 10.00th=[ 2343], 20.00th=[ 3130], | 30.00th=[ 5145], 40.00th=[ 9634], 50.00th=[ 13042], 60.00th=[ 16581], | 70.00th=[ 20055], 80.00th=[ 25035], 90.00th=[ 31589], 95.00th=[ 39584], | 99.00th=[ 56886], 99.50th=[ 84411], 99.90th=[143655], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 71, max= 207, per=25.70%, avg=132.60, stdev=31.69, samples=94 iops : min= 17, max= 51, avg=32.81, stdev= 7.95, samples=94 lat (usec) : 250=0.98%, 500=2.47%, 750=0.26%, 1000=0.36% lat (msec) : 2=3.06%, 4=9.93%, 10=18.55%, 20=35.55%, 50=27.80% lat (msec) : 100=0.88%, 250=0.13%, 750=0.03% cpu : usr=0.15%, sys=22.49%, ctx=8167, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146998: Mon Dec 22 10:10:31 2025 read: IOPS=31, BW=124KiB/s (127kB/s)(6028KiB/48432msec) clat (usec): min=96, max=721320, avg=15883.24, stdev=20739.47 lat (usec): min=97, max=721321, avg=15884.41, stdev=20739.50 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 383], 10.00th=[ 6718], 20.00th=[ 8848], | 30.00th=[ 10159], 40.00th=[ 11731], 50.00th=[ 13173], 60.00th=[ 15926], | 70.00th=[ 19006], 80.00th=[ 22414], 90.00th=[ 26870], 95.00th=[ 31589], | 99.00th=[ 43254], 99.50th=[ 55837], 99.90th=[139461], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 32, max= 224, per=25.51%, avg=125.75, stdev=36.31, samples=95 iops : min= 8, max= 56, avg=31.09, stdev= 9.06, samples=95 write: IOPS=32, BW=129KiB/s (132kB/s)(6260KiB/48432msec); 0 zone resets clat (usec): min=593, max=150265, avg=15549.12, stdev=14301.26 lat (usec): min=594, max=150265, avg=15551.03, stdev=14301.19 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1762], 10.00th=[ 2442], 20.00th=[ 3195], | 30.00th=[ 4883], 40.00th=[ 9503], 50.00th=[ 12780], 60.00th=[ 15926], | 70.00th=[ 20055], 80.00th=[ 25035], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 57410], 99.50th=[ 69731], 99.90th=[135267], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 19, max= 223, per=24.96%, avg=128.81, stdev=33.75, samples=96 iops : min= 4, max= 55, avg=31.85, stdev= 8.55, samples=96 lat (usec) : 100=0.03%, 250=0.81%, 500=2.57%, 750=0.36%, 1000=0.33% lat (msec) : 2=2.96%, 4=10.29%, 10=17.84%, 20=36.52%, 50=26.92% lat (msec) : 100=1.14%, 250=0.20%, 750=0.03% cpu : usr=0.19%, sys=22.28%, ctx=8219, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146999: Mon Dec 22 10:10:31 2025 read: IOPS=31, BW=124KiB/s (127kB/s)(6052KiB/48692msec) clat (usec): min=95, max=134598, avg=15785.45, stdev=10621.45 lat (usec): min=96, max=134600, avg=15786.64, stdev=10621.49 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 371], 10.00th=[ 6783], 20.00th=[ 8848], | 30.00th=[ 10159], 40.00th=[ 11338], 50.00th=[ 13304], 60.00th=[ 16057], | 70.00th=[ 19268], 80.00th=[ 22938], 90.00th=[ 28181], 95.00th=[ 33424], | 99.00th=[ 49021], 99.50th=[ 58459], 99.90th=[112722], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 15, max= 200, per=25.25%, avg=124.48, stdev=33.73, samples=95 iops : min= 3, max= 50, avg=30.78, stdev= 8.47, samples=95 write: IOPS=32, BW=128KiB/s (131kB/s)(6236KiB/48692msec); 0 zone resets clat (usec): min=803, max=775851, avg=15805.82, stdev=23888.84 lat (usec): min=805, max=775852, avg=15807.13, stdev=23888.85 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1680], 10.00th=[ 2376], 20.00th=[ 3097], | 30.00th=[ 4621], 40.00th=[ 9241], 50.00th=[ 12387], 60.00th=[ 15270], | 70.00th=[ 19530], 80.00th=[ 24773], 90.00th=[ 33162], 95.00th=[ 41157], | 99.00th=[ 63177], 99.50th=[ 90702], 99.90th=[139461], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 31, max= 208, per=24.86%, avg=128.27, stdev=33.62, samples=95 iops : min= 7, max= 52, avg=31.73, stdev= 8.46, samples=95 lat (usec) : 100=0.07%, 250=1.11%, 500=2.28%, 750=0.33%, 1000=0.23% lat (msec) : 2=3.22%, 4=10.51%, 10=17.42%, 20=36.36%, 50=26.89% lat (msec) : 100=1.40%, 250=0.16%, 1000=0.03% cpu : usr=0.11%, sys=22.33%, ctx=8043, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=493KiB/s (505kB/s), 123KiB/s-124KiB/s (126kB/s-127kB/s), io=23.4MiB (24.6MB), run=48130-48692msec WRITE: bw=516KiB/s (529kB/s), 128KiB/s-132KiB/s (131kB/s-135kB/s), io=24.6MiB (25.7MB), run=48130-48692msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146991: Mon Dec 22 10:11:13 2025 read: IOPS=16, BW=66.3KiB/s (67.8kB/s)(5992KiB/90440msec) clat (msec): min=2, max=748, avg=15.16, stdev=22.72 lat (msec): min=2, max=748, avg=15.16, stdev=22.72 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 21], 90.00th=[ 29], 95.00th=[ 37], | 99.00th=[ 69], 99.50th=[ 81], 99.90th=[ 153], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 184, per=25.31%, avg=66.83, stdev=36.48, samples=178 iops : min= 1, max= 46, avg=16.37, stdev= 9.22, samples=178 write: IOPS=17, BW=69.6KiB/s (71.3kB/s)(6296KiB/90440msec); 0 zone resets clat (msec): min=16, max=236, avg=42.89, stdev=21.40 lat (msec): min=16, max=236, avg=42.89, stdev=21.40 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 71], 95.00th=[ 85], | 99.00th=[ 112], 99.50th=[ 127], 99.90th=[ 232], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 8, max= 128, per=25.26%, avg=69.72, stdev=28.89, samples=179 iops : min= 2, max= 32, avg=17.09, stdev= 7.33, samples=179 lat (msec) : 4=0.55%, 10=21.58%, 20=17.51%, 50=45.28%, 100=14.06% lat (msec) : 250=0.98%, 750=0.03% cpu : usr=0.09%, sys=5.91%, ctx=5873, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146992: Mon Dec 22 10:11:13 2025 read: IOPS=16, BW=65.4KiB/s (66.9kB/s)(5940KiB/90886msec) clat (msec): min=2, max=722, avg=15.19, stdev=22.22 lat (msec): min=2, max=722, avg=15.19, stdev=22.22 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 21], 90.00th=[ 29], 95.00th=[ 37], | 99.00th=[ 61], 99.50th=[ 82], 99.90th=[ 157], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 184, per=24.78%, avg=65.42, stdev=37.79, samples=180 iops : min= 1, max= 46, avg=16.02, stdev= 9.54, samples=180 write: IOPS=17, BW=69.8KiB/s (71.5kB/s)(6348KiB/90886msec); 0 zone resets clat (msec): min=14, max=231, avg=42.92, stdev=21.56 lat (msec): min=14, max=231, avg=42.92, stdev=21.56 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 59], 90.00th=[ 72], 95.00th=[ 85], | 99.00th=[ 112], 99.50th=[ 122], 99.90th=[ 215], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 16, max= 160, per=25.34%, avg=69.95, stdev=29.71, samples=180 iops : min= 4, max= 40, avg=17.15, stdev= 7.52, samples=180 lat (msec) : 4=0.55%, 10=20.74%, 20=18.85%, 50=44.27%, 100=14.42% lat (msec) : 250=1.14%, 750=0.03% cpu : usr=0.09%, sys=5.94%, ctx=5873, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146993: Mon Dec 22 10:11:13 2025 read: IOPS=16, BW=66.6KiB/s (68.2kB/s)(6028KiB/90536msec) clat (msec): min=3, max=155, avg=15.33, stdev=13.38 lat (msec): min=3, max=155, avg=15.33, stdev=13.38 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 21], 90.00th=[ 30], 95.00th=[ 40], | 99.00th=[ 66], 99.50th=[ 81], 99.90th=[ 124], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 7, max= 168, per=25.24%, avg=66.63, stdev=35.92, samples=179 iops : min= 1, max= 42, avg=16.32, stdev= 9.07, samples=179 write: IOPS=17, BW=69.1KiB/s (70.8kB/s)(6260KiB/90536msec); 0 zone resets clat (msec): min=15, max=738, avg=42.95, stdev=26.86 lat (msec): min=15, max=738, avg=42.95, stdev=26.86 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 59], 90.00th=[ 71], 95.00th=[ 84], | 99.00th=[ 105], 99.50th=[ 126], 99.90th=[ 182], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 23, max= 128, per=25.06%, avg=69.18, stdev=29.07, samples=179 iops : min= 5, max= 32, avg=16.96, stdev= 7.38, samples=179 lat (msec) : 4=0.72%, 10=19.50%, 20=19.17%, 50=44.95%, 100=14.65% lat (msec) : 250=0.98%, 750=0.03% cpu : usr=0.10%, sys=5.86%, ctx=5835, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146994: Mon Dec 22 10:11:13 2025 read: IOPS=16, BW=67.2KiB/s (68.8kB/s)(6052KiB/90076msec) clat (msec): min=3, max=168, avg=14.68, stdev=12.64 lat (msec): min=3, max=168, avg=14.68, stdev=12.64 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 21], 90.00th=[ 28], 95.00th=[ 35], | 99.00th=[ 59], 99.50th=[ 83], 99.90th=[ 153], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 7, max= 192, per=25.64%, avg=67.70, stdev=34.61, samples=177 iops : min= 1, max= 48, avg=16.58, stdev= 8.74, samples=177 write: IOPS=17, BW=69.2KiB/s (70.9kB/s)(6236KiB/90076msec); 0 zone resets clat (msec): min=15, max=770, avg=43.39, stdev=27.39 lat (msec): min=15, max=770, avg=43.39, stdev=27.39 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 72], 95.00th=[ 83], | 99.00th=[ 108], 99.50th=[ 126], 99.90th=[ 184], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 24, max= 136, per=25.09%, avg=69.25, stdev=28.58, samples=178 iops : min= 6, max= 34, avg=16.97, stdev= 7.25, samples=178 lat (msec) : 4=0.55%, 10=21.19%, 20=18.98%, 50=43.29%, 100=15.14% lat (msec) : 250=0.81%, 1000=0.03% cpu : usr=0.10%, sys=6.01%, ctx=5970, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=264KiB/s (271kB/s), 65.4KiB/s-67.2KiB/s (66.9kB/s-68.8kB/s), io=23.4MiB (24.6MB), run=90076-90886msec WRITE: bw=277KiB/s (283kB/s), 69.1KiB/s-69.8KiB/s (70.8kB/s-71.5kB/s), io=24.6MiB (25.7MB), run=90076-90886msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147033: Mon Dec 22 10:11:31 2025 read: IOPS=31, BW=500KiB/s (512kB/s)(5920KiB/11833msec) clat (usec): min=222, max=82576, avg=16301.94, stdev=9676.97 lat (usec): min=222, max=82576, avg=16302.93, stdev=9676.90 clat percentiles (usec): | 1.00th=[ 293], 5.00th=[ 416], 10.00th=[ 6915], 20.00th=[10159], | 30.00th=[11863], 40.00th=[13435], 50.00th=[14877], 60.00th=[17433], | 70.00th=[19268], 80.00th=[22152], 90.00th=[26346], 95.00th=[31589], | 99.00th=[50594], 99.50th=[63177], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 320, max= 798, per=24.71%, avg=496.91, stdev=112.27, samples=23 iops : min= 20, max= 49, avg=30.57, stdev= 7.00, samples=23 write: IOPS=33, BW=538KiB/s (551kB/s)(6368KiB/11833msec); 0 zone resets clat (usec): min=1266, max=83166, avg=14415.52, stdev=11856.67 lat (usec): min=1269, max=83168, avg=14417.22, stdev=11856.73 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2835], 10.00th=[ 3752], 20.00th=[ 4686], | 30.00th=[ 5800], 40.00th=[ 8356], 50.00th=[11338], 60.00th=[13829], | 70.00th=[17695], 80.00th=[23200], 90.00th=[30016], 95.00th=[36439], | 99.00th=[59507], 99.50th=[76022], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 319, max= 832, per=25.51%, avg=539.74, stdev=130.65, samples=23 iops : min= 19, max= 52, avg=33.26, stdev= 8.26, samples=23 lat (usec) : 250=0.13%, 500=3.39%, 750=0.39%, 1000=0.26% lat (msec) : 2=1.56%, 4=4.95%, 10=22.27%, 20=39.97%, 50=25.91% lat (msec) : 100=1.17% cpu : usr=0.15%, sys=29.48%, ctx=2424, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147034: Mon Dec 22 10:11:31 2025 read: IOPS=30, BW=489KiB/s (500kB/s)(5744KiB/11753msec) clat (usec): min=131, max=59493, avg=16303.30, stdev=9101.64 lat (usec): min=132, max=59495, avg=16304.22, stdev=9101.71 clat percentiles (usec): | 1.00th=[ 225], 5.00th=[ 363], 10.00th=[ 6849], 20.00th=[10159], | 30.00th=[11731], 40.00th=[13566], 50.00th=[15926], 60.00th=[17433], | 70.00th=[19792], 80.00th=[21627], 90.00th=[26084], 95.00th=[32900], | 99.00th=[46400], 99.50th=[56886], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 286, max= 667, per=24.33%, avg=489.22, stdev=122.56, samples=23 iops : min= 17, max= 41, avg=30.09, stdev= 7.75, samples=23 write: IOPS=34, BW=557KiB/s (570kB/s)(6544KiB/11753msec); 0 zone resets clat (usec): min=1330, max=67598, avg=14360.19, stdev=11788.04 lat (usec): min=1331, max=67599, avg=14361.89, stdev=11788.12 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 3458], 10.00th=[ 4047], 20.00th=[ 4752], | 30.00th=[ 5473], 40.00th=[ 7898], 50.00th=[10814], 60.00th=[13435], | 70.00th=[17433], 80.00th=[23987], 90.00th=[30016], 95.00th=[35914], | 99.00th=[54789], 99.50th=[63701], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 318, max= 768, per=26.29%, avg=556.22, stdev=108.60, samples=23 iops : min= 19, max= 48, avg=34.30, stdev= 6.81, samples=23 lat (usec) : 250=0.78%, 500=2.47%, 750=0.52%, 1000=0.26% lat (msec) : 2=1.04%, 4=3.91%, 10=25.13%, 20=39.06%, 50=25.65% lat (msec) : 100=1.17% cpu : usr=0.16%, sys=29.95%, ctx=2486, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147035: Mon Dec 22 10:11:31 2025 read: IOPS=32, BW=525KiB/s (538kB/s)(6256KiB/11906msec) clat (usec): min=137, max=61214, avg=16093.38, stdev=9763.03 lat (usec): min=138, max=61215, avg=16118.17, stdev=9785.67 clat percentiles (usec): | 1.00th=[ 190], 5.00th=[ 379], 10.00th=[ 2008], 20.00th=[ 9765], | 30.00th=[11600], 40.00th=[12518], 50.00th=[14484], 60.00th=[16450], | 70.00th=[19530], 80.00th=[22676], 90.00th=[27919], 95.00th=[33817], | 99.00th=[47973], 99.50th=[51119], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 350, max= 768, per=26.06%, avg=524.00, stdev=126.91, samples=23 iops : min= 21, max= 48, avg=32.26, stdev= 8.10, samples=23 write: IOPS=31, BW=507KiB/s (519kB/s)(6032KiB/11906msec); 0 zone resets clat (usec): min=1165, max=67866, avg=14648.43, stdev=11497.32 lat (usec): min=1167, max=67868, avg=14650.49, stdev=11497.23 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2966], 10.00th=[ 3818], 20.00th=[ 4686], | 30.00th=[ 6456], 40.00th=[ 9110], 50.00th=[11600], 60.00th=[14353], | 70.00th=[18482], 80.00th=[22938], 90.00th=[28967], 95.00th=[36439], | 99.00th=[57934], 99.50th=[61604], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 286, max= 736, per=23.42%, avg=495.48, stdev=114.85, samples=23 iops : min= 17, max= 46, avg=30.48, stdev= 7.27, samples=23 lat (usec) : 250=0.52%, 500=3.52%, 750=0.52%, 1000=0.13% lat (msec) : 2=1.17%, 4=5.73%, 10=20.96%, 20=39.97%, 50=26.30% lat (msec) : 100=1.17% cpu : usr=0.18%, sys=28.84%, ctx=2479, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147036: Mon Dec 22 10:11:31 2025 read: IOPS=32, BW=514KiB/s (526kB/s)(6032KiB/11746msec) clat (usec): min=135, max=53446, avg=16199.05, stdev=9461.58 lat (usec): min=136, max=53447, avg=16199.97, stdev=9461.54 clat percentiles (usec): | 1.00th=[ 277], 5.00th=[ 351], 10.00th=[ 594], 20.00th=[10028], | 30.00th=[11469], 40.00th=[12911], 50.00th=[14877], 60.00th=[17957], | 70.00th=[20317], 80.00th=[23200], 90.00th=[27919], 95.00th=[32375], | 99.00th=[44827], 99.50th=[52167], 99.90th=[53216], 99.95th=[53216], | 99.99th=[53216] bw ( KiB/s): min= 159, max= 704, per=25.53%, avg=513.39, stdev=126.71, samples=23 iops : min= 9, max= 44, avg=31.61, stdev= 7.96, samples=23 write: IOPS=33, BW=533KiB/s (545kB/s)(6256KiB/11746msec); 0 zone resets clat (usec): min=1399, max=89109, avg=14159.34, stdev=12060.04 lat (usec): min=1400, max=89111, avg=14162.26, stdev=12059.15 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 3163], 10.00th=[ 3818], 20.00th=[ 4555], | 30.00th=[ 5932], 40.00th=[ 8586], 50.00th=[11076], 60.00th=[13566], | 70.00th=[16319], 80.00th=[21365], 90.00th=[30540], 95.00th=[36963], | 99.00th=[60556], 99.50th=[67634], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 318, max= 795, per=25.36%, avg=536.70, stdev=137.11, samples=23 iops : min= 19, max= 49, avg=33.09, stdev= 8.52, samples=23 lat (usec) : 250=0.26%, 500=4.30%, 750=0.78%, 1000=0.26% lat (msec) : 2=0.78%, 4=5.86%, 10=21.48%, 20=39.84%, 50=25.26% lat (msec) : 100=1.17% cpu : usr=0.15%, sys=29.29%, ctx=2524, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2012KiB/s (2060kB/s), 489KiB/s-525KiB/s (500kB/s-538kB/s), io=23.4MiB (24.5MB), run=11746-11906msec WRITE: bw=2117KiB/s (2167kB/s), 507KiB/s-557KiB/s (519kB/s-570kB/s), io=24.6MiB (25.8MB), run=11746-11906msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147028: Mon Dec 22 10:11:41 2025 read: IOPS=16, BW=266KiB/s (272kB/s)(5920KiB/22288msec) clat (usec): min=3807, max=77875, avg=14857.98, stdev=12776.94 lat (usec): min=3808, max=77876, avg=14859.21, stdev=12776.87 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5211], 10.00th=[ 5735], 20.00th=[ 6521], | 30.00th=[ 7439], 40.00th=[ 8717], 50.00th=[10290], 60.00th=[12125], | 70.00th=[14615], 80.00th=[19792], 90.00th=[30278], 95.00th=[44303], | 99.00th=[65799], 99.50th=[72877], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 63, max= 608, per=24.85%, avg=263.66, stdev=115.86, samples=44 iops : min= 3, max= 38, avg=16.16, stdev= 7.39, samples=44 write: IOPS=17, BW=286KiB/s (293kB/s)(6368KiB/22288msec); 0 zone resets clat (msec): min=20, max=111, avg=42.03, stdev=14.50 lat (msec): min=20, max=111, avg=42.03, stdev=14.50 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 39], 60.00th=[ 43], | 70.00th=[ 47], 80.00th=[ 53], 90.00th=[ 63], 95.00th=[ 72], | 99.00th=[ 86], 99.50th=[ 100], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 63, max= 448, per=25.53%, avg=285.18, stdev=86.69, samples=44 iops : min= 3, max= 28, avg=17.50, stdev= 5.63, samples=44 lat (msec) : 4=0.26%, 10=22.27%, 20=16.15%, 50=48.05%, 100=13.15% lat (msec) : 250=0.13% cpu : usr=0.07%, sys=7.35%, ctx=1541, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147029: Mon Dec 22 10:11:41 2025 read: IOPS=15, BW=255KiB/s (261kB/s)(5744KiB/22560msec) clat (usec): min=4361, max=78922, avg=14500.15, stdev=12452.55 lat (usec): min=4362, max=78923, avg=14501.42, stdev=12452.56 clat percentiles (usec): | 1.00th=[ 4621], 5.00th=[ 5014], 10.00th=[ 5407], 20.00th=[ 6194], | 30.00th=[ 7111], 40.00th=[ 8160], 50.00th=[10028], 60.00th=[12256], | 70.00th=[14877], 80.00th=[20055], 90.00th=[32375], 95.00th=[40109], | 99.00th=[62129], 99.50th=[77071], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 63, max= 608, per=24.47%, avg=259.60, stdev=127.62, samples=43 iops : min= 3, max= 38, avg=15.88, stdev= 8.10, samples=43 write: IOPS=18, BW=290KiB/s (297kB/s)(6544KiB/22560msec); 0 zone resets clat (msec): min=20, max=113, avg=42.30, stdev=15.94 lat (msec): min=20, max=113, avg=42.30, stdev=15.94 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 33], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 42], | 70.00th=[ 46], 80.00th=[ 50], 90.00th=[ 64], 95.00th=[ 77], | 99.00th=[ 102], 99.50th=[ 109], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 159, max= 416, per=25.70%, avg=287.07, stdev=77.03, samples=44 iops : min= 9, max= 26, avg=17.61, stdev= 5.09, samples=44 lat (msec) : 10=23.18%, 20=14.32%, 50=50.91%, 100=10.81%, 250=0.78% cpu : usr=0.07%, sys=6.79%, ctx=1533, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147030: Mon Dec 22 10:11:41 2025 read: IOPS=17, BW=280KiB/s (287kB/s)(6256KiB/22358msec) clat (msec): min=3, max=101, avg=14.88, stdev=12.56 lat (msec): min=3, max=101, avg=14.88, stdev=12.56 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 44], | 99.00th=[ 63], 99.50th=[ 72], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 95, max= 576, per=26.55%, avg=281.73, stdev=132.08, samples=44 iops : min= 5, max= 36, avg=17.30, stdev= 8.35, samples=44 write: IOPS=16, BW=270KiB/s (276kB/s)(6032KiB/22358msec); 0 zone resets clat (msec): min=19, max=115, avg=43.72, stdev=16.46 lat (msec): min=19, max=115, avg=43.72, stdev=16.46 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 35], 40.00th=[ 38], 50.00th=[ 41], 60.00th=[ 44], | 70.00th=[ 47], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 81], | 99.00th=[ 105], 99.50th=[ 113], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 127, max= 448, per=23.93%, avg=267.25, stdev=81.21, samples=44 iops : min= 7, max= 28, avg=16.39, stdev= 5.26, samples=44 lat (msec) : 4=0.13%, 10=22.92%, 20=17.71%, 50=47.27%, 100=11.33% lat (msec) : 250=0.65% cpu : usr=0.10%, sys=7.05%, ctx=1547, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147031: Mon Dec 22 10:11:41 2025 read: IOPS=17, BW=278KiB/s (284kB/s)(6032KiB/21734msec) clat (msec): min=4, max=101, avg=14.51, stdev=12.27 lat (msec): min=4, max=101, avg=14.51, stdev=12.27 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 20], 90.00th=[ 28], 95.00th=[ 41], | 99.00th=[ 58], 99.50th=[ 102], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 64, max= 512, per=26.04%, avg=276.26, stdev=101.70, samples=43 iops : min= 4, max= 32, avg=16.93, stdev= 6.40, samples=43 write: IOPS=17, BW=288KiB/s (295kB/s)(6256KiB/21734msec); 0 zone resets clat (msec): min=20, max=120, avg=41.52, stdev=15.62 lat (msec): min=20, max=120, avg=41.52, stdev=15.62 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 33], 40.00th=[ 35], 50.00th=[ 38], 60.00th=[ 41], | 70.00th=[ 44], 80.00th=[ 50], 90.00th=[ 60], 95.00th=[ 75], | 99.00th=[ 106], 99.50th=[ 113], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 128, max= 448, per=25.80%, avg=288.14, stdev=81.13, samples=43 iops : min= 8, max= 28, avg=17.67, stdev= 5.31, samples=43 lat (msec) : 10=22.66%, 20=17.45%, 50=48.70%, 100=10.29%, 250=0.91% cpu : usr=0.07%, sys=7.33%, ctx=1536, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1062KiB/s (1087kB/s), 255KiB/s-280KiB/s (261kB/s-287kB/s), io=23.4MiB (24.5MB), run=21734-22560msec WRITE: bw=1117KiB/s (1144kB/s), 270KiB/s-290KiB/s (276kB/s-297kB/s), io=24.6MiB (25.8MB), run=21734-22560msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147045: Mon Dec 22 10:11:50 2025 read: IOPS=2, BW=2719KiB/s (2785kB/s)(7168KiB/2636msec) clat (msec): min=54, max=330, avg=154.64, stdev=91.59 lat (msec): min=54, max=330, avg=155.51, stdev=91.01 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 101], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 127], 60.00th=[ 132], | 70.00th=[ 132], 80.00th=[ 218], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 2023, max= 3878, per=39.82%, avg=2882.25, stdev=985.34, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1942KiB/s (1989kB/s)(5120KiB/2636msec); 0 zone resets clat (msec): min=155, max=358, avg=294.31, stdev=82.22 lat (msec): min=155, max=358, avg=294.37, stdev=82.22 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1939, max= 4047, per=24.78%, avg=2511.25, stdev=1024.83, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=41.67% cpu : usr=0.00%, sys=18.14%, ctx=150, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147046: Mon Dec 22 10:11:50 2025 read: IOPS=0, BW=724KiB/s (741kB/s)(2048KiB/2829msec) clat (msec): min=73, max=267, avg=170.58, stdev=136.76 lat (msec): min=73, max=267, avg=170.58, stdev=136.76 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 74], 50.00th=[ 74], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 268], 95.00th=[ 268], | 99.00th=[ 268], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 1759, max= 2011, per=26.04%, avg=1885.00, stdev=178.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3620KiB/s (3707kB/s)(10.0MiB/2829msec); 0 zone resets clat (msec): min=88, max=523, avg=242.37, stdev=138.56 lat (msec): min=89, max=523, avg=242.46, stdev=138.56 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 96], | 30.00th=[ 133], 40.00th=[ 169], 50.00th=[ 218], 60.00th=[ 222], | 70.00th=[ 264], 80.00th=[ 313], 90.00th=[ 401], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1939, max= 6144, per=44.84%, avg=4544.25, stdev=1995.76, samples=4 iops : min= 1, max= 6, avg= 3.75, stdev= 2.22, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.07%, sys=18.21%, ctx=167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147048: Mon Dec 22 10:11:50 2025 read: IOPS=2, BW=2381KiB/s (2439kB/s)(6144KiB/2580msec) clat (msec): min=77, max=551, avg=198.07, stdev=178.32 lat (msec): min=77, max=551, avg=198.07, stdev=178.32 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 167], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1939, max= 4096, per=37.05%, avg=2682.00, stdev=1225.09, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2381KiB/s (2439kB/s)(6144KiB/2580msec); 0 zone resets clat (msec): min=67, max=398, avg=229.18, stdev=116.53 lat (msec): min=68, max=398, avg=229.26, stdev=116.52 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 284], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1939, max= 3465, per=24.51%, avg=2484.00, stdev=851.32, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=12.95%, ctx=109, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147050: Mon Dec 22 10:11:50 2025 read: IOPS=1, BW=2021KiB/s (2070kB/s)(5120KiB/2533msec) clat (msec): min=57, max=181, avg=115.70, stdev=48.64 lat (msec): min=57, max=181, avg=115.70, stdev=48.64 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 106], 60.00th=[ 106], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1939, max= 6144, per=55.83%, avg=4041.50, stdev=2973.38, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2830KiB/s (2898kB/s)(7168KiB/2533msec); 0 zone resets clat (msec): min=68, max=483, avg=271.36, stdev=155.38 lat (msec): min=68, max=483, avg=271.44, stdev=155.38 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 138], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 279], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 456], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 3471, max= 4096, per=38.12%, avg=3863.33, stdev=341.73, samples=3 iops : min= 3, max= 4, avg= 3.33, stdev= 0.58, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=13.74%, ctx=82, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7239KiB/s (7413kB/s), 724KiB/s-2719KiB/s (741kB/s-2785kB/s), io=20.0MiB (20.0MB), run=2533-2829msec WRITE: bw=9.90MiB/s (10.4MB/s), 1942KiB/s-3620KiB/s (1989kB/s-3707kB/s), io=28.0MiB (29.4MB), run=2533-2829msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147047: Mon Dec 22 10:11:50 2025 read: IOPS=3, BW=3470KiB/s (3553kB/s)(7168KiB/2066msec) clat (usec): min=808, max=217403, avg=120159.57, stdev=77804.32 lat (usec): min=809, max=217404, avg=120160.63, stdev=77804.49 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 30278], | 30.00th=[128451], 40.00th=[128451], 50.00th=[130548], 60.00th=[164627], | 70.00th=[164627], 80.00th=[168821], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 1835, max= 5120, per=52.50%, avg=3651.67, stdev=1669.97, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2478KiB/s (2538kB/s)(5120KiB/2066msec); 0 zone resets clat (msec): min=126, max=423, avg=222.61, stdev=117.70 lat (msec): min=127, max=423, avg=222.71, stdev=117.65 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2000, max= 5505, per=38.53%, avg=3752.50, stdev=2478.41, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 1000=8.33% lat (msec) : 50=8.33%, 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=49.88%, ctx=788, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147049: Mon Dec 22 10:11:50 2025 read: IOPS=0, BW=696KiB/s (712kB/s)(2048KiB/2944msec) clat (msec): min=180, max=299, avg=240.03, stdev=83.56 lat (msec): min=180, max=299, avg=240.04, stdev=83.56 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1750, max= 2039, per=27.24%, avg=1894.50, stdev=204.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3478KiB/s (3562kB/s)(10.0MiB/2944msec); 0 zone resets clat (msec): min=63, max=373, avg=235.52, stdev=109.33 lat (msec): min=63, max=373, avg=235.61, stdev=109.32 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 121], | 30.00th=[ 138], 40.00th=[ 176], 50.00th=[ 226], 60.00th=[ 249], | 70.00th=[ 313], 80.00th=[ 342], 90.00th=[ 359], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2039, max= 4096, per=35.44%, avg=3451.25, stdev=959.02, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=41.67% cpu : usr=0.03%, sys=44.99%, ctx=367, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147051: Mon Dec 22 10:11:50 2025 read: IOPS=2, BW=2802KiB/s (2869kB/s)(6144KiB/2193msec) clat (usec): min=812, max=137810, avg=56734.56, stdev=65505.10 lat (usec): min=813, max=137812, avg=56735.57, stdev=65505.13 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 816], 10.00th=[ 816], 20.00th=[ 963], | 30.00th=[ 963], 40.00th=[ 2114], 50.00th=[ 2114], 60.00th=[ 67634], | 70.00th=[131597], 80.00th=[131597], 90.00th=[137364], 95.00th=[137364], | 99.00th=[137364], 99.50th=[137364], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 2039, max= 7340, per=67.42%, avg=4689.50, stdev=3748.37, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=2, BW=2802KiB/s (2869kB/s)(6144KiB/2193msec); 0 zone resets clat (msec): min=197, max=720, avg=304.60, stdev=204.55 lat (msec): min=197, max=720, avg=304.66, stdev=204.57 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 236], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 3424, max= 4079, per=38.24%, avg=3724.33, stdev=330.86, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (usec) : 1000=16.67% lat (msec) : 4=8.33%, 100=8.33%, 250=58.33%, 750=8.33% cpu : usr=0.00%, sys=41.29%, ctx=202, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147052: Mon Dec 22 10:11:50 2025 read: IOPS=1, BW=1773KiB/s (1815kB/s)(5120KiB/2888msec) clat (usec): min=806, max=175290, avg=93163.16, stdev=87514.38 lat (usec): min=807, max=175291, avg=93164.08, stdev=87514.33 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 807], | 30.00th=[ 930], 40.00th=[ 930], 50.00th=[115868], 60.00th=[115868], | 70.00th=[173016], 80.00th=[173016], 90.00th=[175113], 95.00th=[175113], | 99.00th=[175113], 99.50th=[175113], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 4079, max= 4096, per=58.76%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2482KiB/s (2542kB/s)(7168KiB/2888msec); 0 zone resets clat (msec): min=111, max=917, avg=340.74, stdev=279.04 lat (msec): min=111, max=917, avg=340.82, stdev=279.04 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 150], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 239], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 468], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1738, max= 4096, per=29.63%, avg=2885.75, stdev=1171.05, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 1000=16.67% lat (msec) : 250=58.33%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=35.12%, ctx=613, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6957KiB/s (7123kB/s), 696KiB/s-3470KiB/s (712kB/s-3553kB/s), io=20.0MiB (20.0MB), run=2066-2944msec WRITE: bw=9739KiB/s (9973kB/s), 2478KiB/s-3478KiB/s (2538kB/s-3562kB/s), io=28.0MiB (29.4MB), run=2066-2944msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147058: Mon Dec 22 10:11:58 2025 read: IOPS=1, BW=7140KiB/s (7311kB/s)(12.0MiB/1721msec) clat (msec): min=457, max=625, avg=516.46, stdev=94.55 lat (msec): min=457, max=625, avg=516.46, stdev=94.55 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 5680, max= 8000, per=75.94%, avg=6840.00, stdev=1640.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=45.47%, ctx=1835, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147059: Mon Dec 22 10:11:58 2025 read: IOPS=0, BW=2252KiB/s (2306kB/s)(4096KiB/1819msec) clat (nsec): min=464752k, max=464752k, avg=464751973.00, stdev= 0.00 lat (nsec): min=464753k, max=464753k, avg=464752786.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 5728, max= 5728, per=63.59%, avg=5728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4504KiB/s (4612kB/s)(8192KiB/1819msec); 0 zone resets clat (msec): min=161, max=1026, avg=593.94, stdev=612.18 lat (msec): min=161, max=1027, avg=594.18, stdev=612.10 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8000, max= 8000, per=44.41%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.36%, ctx=715, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147060: Mon Dec 22 10:11:58 2025 write: IOPS=1, BW=6796KiB/s (6960kB/s)(12.0MiB/1808msec); 0 zone resets clat (msec): min=470, max=604, avg=559.27, stdev=76.99 lat (msec): min=470, max=605, avg=559.66, stdev=76.83 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8000, max= 8159, per=44.85%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=25.95%, ctx=108, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147061: Mon Dec 22 10:11:58 2025 write: IOPS=1, BW=6903KiB/s (7069kB/s)(12.0MiB/1780msec); 0 zone resets clat (msec): min=320, max=770, avg=536.21, stdev=225.86 lat (msec): min=320, max=771, avg=536.50, stdev=225.76 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 5696, max= 8000, per=38.01%, avg=6848.00, stdev=1629.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.69%, ctx=81, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9007KiB/s (9223kB/s), 2252KiB/s-7140KiB/s (2306kB/s-7311kB/s), io=16.0MiB (16.8MB), run=1721-1819msec WRITE: bw=17.6MiB/s (18.4MB/s), 4504KiB/s-6903KiB/s (4612kB/s-7069kB/s), io=32.0MiB (33.6MB), run=1780-1819msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147062: Mon Dec 22 10:11:58 2025 read: IOPS=1, BW=6410KiB/s (6564kB/s)(12.0MiB/1917msec) clat (msec): min=116, max=1127, avg=620.04, stdev=505.07 lat (msec): min=116, max=1127, avg=620.04, stdev=505.07 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.12%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147063: Mon Dec 22 10:11:58 2025 read: IOPS=0, BW=1947KiB/s (1993kB/s)(4096KiB/2104msec) clat (nsec): min=733532k, max=733532k, avg=733531509.00, stdev= 0.00 lat (nsec): min=733532k, max=733532k, avg=733532288.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3894KiB/s (3987kB/s)(8192KiB/2104msec); 0 zone resets clat (msec): min=584, max=715, avg=650.17, stdev=92.84 lat (msec): min=584, max=716, avg=650.56, stdev=92.91 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8192, max= 8192, per=52.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.05%, sys=10.79%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147064: Mon Dec 22 10:11:58 2025 write: IOPS=1, BW=5807KiB/s (5947kB/s)(12.0MiB/2116msec); 0 zone resets clat (msec): min=154, max=1263, avg=676.04, stdev=557.82 lat (msec): min=154, max=1264, avg=676.61, stdev=558.02 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8192, max= 8192, per=52.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=10.45%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147065: Mon Dec 22 10:11:58 2025 write: IOPS=1, BW=8132KiB/s (8328kB/s)(12.0MiB/1511msec); 0 zone resets clat (msec): min=129, max=1106, avg=485.10, stdev=540.35 lat (msec): min=129, max=1107, avg=485.41, stdev=540.43 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min=12300, max=12300, per=79.43%, avg=12300.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=17.55%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7787KiB/s (7974kB/s), 1947KiB/s-6410KiB/s (1993kB/s-6564kB/s), io=16.0MiB (16.8MB), run=1917-2104msec WRITE: bw=15.1MiB/s (15.9MB/s), 3894KiB/s-8132KiB/s (3987kB/s-8328kB/s), io=32.0MiB (33.6MB), run=1511-2116msec