== sanity test 398b: DIO and buffer IO race ============== 22:51:30 (1784343090) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.94213 s, 17.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155000: Fri Jul 17 22:52:41 2026 read: IOPS=24, BW=99.6KiB/s (102kB/s)(5992KiB/60180msec) clat (usec): min=30, max=760960, avg=20147.28, stdev=22876.67 lat (usec): min=30, max=760962, avg=20148.06, stdev=22876.69 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 212], 10.00th=[ 7635], 20.00th=[ 10028], | 30.00th=[ 12387], 40.00th=[ 14746], 50.00th=[ 17695], 60.00th=[ 20317], | 70.00th=[ 23987], 80.00th=[ 28181], 90.00th=[ 35914], 95.00th=[ 41681], | 99.00th=[ 62653], 99.50th=[ 67634], 99.90th=[115868], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 192, per=25.80%, avg=99.34, stdev=33.12, samples=119 iops : min= 1, max= 48, avg=24.46, stdev= 8.35, samples=119 write: IOPS=26, BW=105KiB/s (107kB/s)(6296KiB/60180msec); 0 zone resets clat (usec): min=686, max=191029, avg=18850.32, stdev=17225.38 lat (usec): min=686, max=191031, avg=18851.29, stdev=17225.41 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2343], 10.00th=[ 3032], 20.00th=[ 4686], | 30.00th=[ 6849], 40.00th=[ 10945], 50.00th=[ 15139], 60.00th=[ 19268], | 70.00th=[ 23725], 80.00th=[ 30278], 90.00th=[ 39584], 95.00th=[ 49546], | 99.00th=[ 68682], 99.50th=[ 87557], 99.90th=[179307], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 7, max= 200, per=26.14%, avg=105.36, stdev=34.53, samples=118 iops : min= 1, max= 50, avg=25.97, stdev= 8.70, samples=118 lat (usec) : 50=0.26%, 100=0.68%, 250=1.60%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.49% lat (msec) : 2=1.43%, 4=6.28%, 10=17.68%, 20=31.77%, 50=35.94% lat (msec) : 100=3.22%, 250=0.33%, 1000=0.03% cpu : usr=0.09%, sys=27.20%, ctx=8865, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155001: Fri Jul 17 22:52:41 2026 read: IOPS=24, BW=96.2KiB/s (98.5kB/s)(5940KiB/61726msec) clat (usec): min=30, max=133047, avg=20060.90, stdev=12900.97 lat (usec): min=31, max=133049, avg=20061.86, stdev=12900.79 clat percentiles (usec): | 1.00th=[ 78], 5.00th=[ 204], 10.00th=[ 7504], 20.00th=[ 10159], | 30.00th=[ 12518], 40.00th=[ 15139], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 24249], 80.00th=[ 28967], 90.00th=[ 35390], 95.00th=[ 41681], | 99.00th=[ 63177], 99.50th=[ 72877], 99.90th=[ 94897], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 6, max= 200, per=24.79%, avg=95.43, stdev=32.44, samples=122 iops : min= 1, max= 50, avg=23.48, stdev= 8.16, samples=122 write: IOPS=25, BW=103KiB/s (105kB/s)(6348KiB/61726msec); 0 zone resets clat (usec): min=693, max=722343, avg=19921.40, stdev=24201.43 lat (usec): min=693, max=722344, avg=19922.38, stdev=24201.47 clat percentiles (usec): | 1.00th=[ 955], 5.00th=[ 2180], 10.00th=[ 3130], 20.00th=[ 5080], | 30.00th=[ 7767], 40.00th=[ 11600], 50.00th=[ 15270], 60.00th=[ 19530], | 70.00th=[ 24511], 80.00th=[ 31851], 90.00th=[ 43254], 95.00th=[ 51643], | 99.00th=[ 70779], 99.50th=[ 90702], 99.90th=[113771], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 6, max= 248, per=25.08%, avg=101.08, stdev=34.41, samples=122 iops : min= 1, max= 62, avg=24.89, stdev= 8.67, samples=122 lat (usec) : 50=0.23%, 100=0.55%, 250=1.92%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.49% lat (msec) : 2=1.86%, 4=5.96%, 10=16.34%, 20=31.41%, 50=36.39% lat (msec) : 100=4.30%, 250=0.13%, 750=0.03% cpu : usr=0.10%, sys=26.96%, ctx=8864, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155002: Fri Jul 17 22:52:41 2026 read: IOPS=24, BW=98.6KiB/s (101kB/s)(6028KiB/61160msec) clat (usec): min=27, max=207459, avg=20222.26, stdev=14392.48 lat (usec): min=27, max=207459, avg=20223.15, stdev=14392.54 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 196], 10.00th=[ 7767], 20.00th=[ 10159], | 30.00th=[ 12256], 40.00th=[ 14877], 50.00th=[ 17695], 60.00th=[ 20579], | 70.00th=[ 24511], 80.00th=[ 28967], 90.00th=[ 36439], 95.00th=[ 43779], | 99.00th=[ 67634], 99.50th=[ 77071], 99.90th=[168821], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 40, max= 184, per=25.95%, avg=99.90, stdev=29.23, samples=119 iops : min= 10, max= 46, avg=24.60, stdev= 7.35, samples=119 write: IOPS=25, BW=102KiB/s (105kB/s)(6260KiB/61160msec); 0 zone resets clat (usec): min=705, max=756662, avg=19373.51, stdev=24412.08 lat (usec): min=706, max=756663, avg=19385.70, stdev=24429.59 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 2073], 10.00th=[ 3064], 20.00th=[ 4817], | 30.00th=[ 7504], 40.00th=[ 11338], 50.00th=[ 15139], 60.00th=[ 19530], | 70.00th=[ 24511], 80.00th=[ 30540], 90.00th=[ 40633], 95.00th=[ 49021], | 99.00th=[ 68682], 99.50th=[ 76022], 99.90th=[141558], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 223, per=25.44%, avg=102.51, stdev=38.27, samples=120 iops : min= 1, max= 55, avg=25.25, stdev= 9.68, samples=120 lat (usec) : 50=0.26%, 100=0.78%, 250=1.92%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.81% lat (msec) : 2=1.46%, 4=5.79%, 10=16.67%, 20=31.38%, 50=36.75% lat (msec) : 100=3.58%, 250=0.16%, 1000=0.03% cpu : usr=0.09%, sys=26.86%, ctx=8842, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155003: Fri Jul 17 22:52:41 2026 read: IOPS=24, BW=97.1KiB/s (99.4kB/s)(6052KiB/62344msec) clat (usec): min=30, max=148574, avg=20416.31, stdev=14470.59 lat (usec): min=30, max=148575, avg=20417.10, stdev=14470.62 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 153], 10.00th=[ 7308], 20.00th=[ 9896], | 30.00th=[ 12387], 40.00th=[ 15008], 50.00th=[ 17695], 60.00th=[ 20841], | 70.00th=[ 24511], 80.00th=[ 29230], 90.00th=[ 36963], 95.00th=[ 44827], | 99.00th=[ 69731], 99.50th=[ 80217], 99.90th=[143655], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 23, max= 192, per=25.39%, avg=97.74, stdev=32.18, samples=123 iops : min= 5, max= 48, avg=24.06, stdev= 8.13, samples=123 write: IOPS=25, BW=100KiB/s (102kB/s)(6236KiB/62344msec); 0 zone resets clat (usec): min=721, max=731290, avg=19964.48, stdev=23917.39 lat (usec): min=721, max=731291, avg=19967.37, stdev=23916.95 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 2278], 10.00th=[ 3294], 20.00th=[ 5342], | 30.00th=[ 7832], 40.00th=[ 12387], 50.00th=[ 16188], 60.00th=[ 20317], | 70.00th=[ 25297], 80.00th=[ 31327], 90.00th=[ 41681], 95.00th=[ 52167], | 99.00th=[ 66323], 99.50th=[ 73925], 99.90th=[149947], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 13, max= 208, per=24.75%, avg=99.75, stdev=34.90, samples=124 iops : min= 3, max= 52, avg=24.56, stdev= 8.79, samples=124 lat (usec) : 50=0.16%, 100=1.01%, 250=1.92%, 500=0.23%, 750=0.10% lat (usec) : 1000=0.68% lat (msec) : 2=1.27%, 4=5.11%, 10=16.50%, 20=31.35%, 50=37.47% lat (msec) : 100=3.97%, 250=0.20%, 750=0.03% cpu : usr=0.08%, sys=26.71%, ctx=9047, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=385KiB/s (394kB/s), 96.2KiB/s-99.6KiB/s (98.5kB/s-102kB/s), io=23.4MiB (24.6MB), run=60180-62344msec WRITE: bw=403KiB/s (413kB/s), 100KiB/s-105KiB/s (102kB/s-107kB/s), io=24.6MiB (25.7MB), run=60180-62344msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154996: Fri Jul 17 22:53:04 2026 read: IOPS=17, BW=70.4KiB/s (72.0kB/s)(5992KiB/85166msec) clat (msec): min=2, max=776, avg=18.01, stdev=26.48 lat (msec): min=2, max=776, avg=18.01, stdev=26.48 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 85], 99.50th=[ 102], 99.90th=[ 205], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 232, per=25.06%, avg=70.42, stdev=51.95, samples=168 iops : min= 1, max= 58, avg=17.32, stdev=13.10, samples=168 write: IOPS=18, BW=73.9KiB/s (75.7kB/s)(6296KiB/85166msec); 0 zone resets clat (msec): min=11, max=211, avg=36.74, stdev=23.91 lat (msec): min=11, max=211, avg=36.74, stdev=23.91 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 70], 95.00th=[ 83], | 99.00th=[ 117], 99.50th=[ 129], 99.90th=[ 211], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 16, max= 200, per=25.32%, avg=74.44, stdev=47.78, samples=167 iops : min= 4, max= 50, avg=18.32, stdev=12.09, samples=167 lat (msec) : 4=4.69%, 10=18.26%, 20=26.30%, 50=35.84%, 100=13.70% lat (msec) : 250=1.17%, 1000=0.03% cpu : usr=0.07%, sys=10.54%, ctx=6478, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154997: Fri Jul 17 22:53:04 2026 read: IOPS=17, BW=69.7KiB/s (71.4kB/s)(5940KiB/85219msec) clat (msec): min=2, max=747, avg=17.82, stdev=25.57 lat (msec): min=2, max=747, avg=17.82, stdev=25.57 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 84], 99.50th=[ 107], 99.90th=[ 144], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 232, per=24.86%, avg=69.85, stdev=50.76, samples=168 iops : min= 1, max= 58, avg=17.18, stdev=12.83, samples=168 write: IOPS=18, BW=74.5KiB/s (76.3kB/s)(6348KiB/85219msec); 0 zone resets clat (msec): min=11, max=199, avg=36.81, stdev=23.47 lat (msec): min=11, max=199, avg=36.81, stdev=23.47 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 56], 90.00th=[ 70], 95.00th=[ 82], | 99.00th=[ 116], 99.50th=[ 136], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 16, max= 184, per=25.45%, avg=74.83, stdev=47.67, samples=167 iops : min= 4, max= 46, avg=18.42, stdev=12.05, samples=167 lat (msec) : 4=5.08%, 10=17.06%, 20=27.34%, 50=34.54%, 100=14.75% lat (msec) : 250=1.20%, 750=0.03% cpu : usr=0.07%, sys=10.43%, ctx=6533, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154998: Fri Jul 17 22:53:04 2026 read: IOPS=17, BW=70.8KiB/s (72.5kB/s)(6028KiB/85107msec) clat (msec): min=2, max=204, avg=17.80, stdev=18.03 lat (msec): min=2, max=204, avg=17.80, stdev=18.03 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 85], 99.50th=[ 102], 99.90th=[ 201], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 7, max= 240, per=25.42%, avg=71.42, stdev=48.40, samples=167 iops : min= 1, max= 60, avg=17.57, stdev=12.22, samples=167 write: IOPS=18, BW=73.6KiB/s (75.3kB/s)(6260KiB/85107msec); 0 zone resets clat (msec): min=11, max=754, avg=37.02, stdev=29.39 lat (msec): min=11, max=754, avg=37.02, stdev=29.39 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 56], 90.00th=[ 70], 95.00th=[ 83], | 99.00th=[ 113], 99.50th=[ 136], 99.90th=[ 163], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8, max= 192, per=25.04%, avg=73.62, stdev=47.86, samples=168 iops : min= 2, max= 48, avg=18.12, stdev=12.12, samples=168 lat (msec) : 4=3.97%, 10=18.26%, 20=26.53%, 50=35.87%, 100=14.23% lat (msec) : 250=1.11%, 1000=0.03% cpu : usr=0.08%, sys=10.69%, ctx=6527, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154999: Fri Jul 17 22:53:04 2026 read: IOPS=17, BW=70.9KiB/s (72.6kB/s)(6052KiB/85321msec) clat (msec): min=2, max=204, avg=17.62, stdev=17.66 lat (msec): min=2, max=204, avg=17.62, stdev=17.66 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 42], 95.00th=[ 54], | 99.00th=[ 77], 99.50th=[ 88], 99.90th=[ 144], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 8, max= 248, per=25.23%, avg=70.90, stdev=49.75, samples=167 iops : min= 2, max= 62, avg=17.44, stdev=12.57, samples=167 write: IOPS=18, BW=73.1KiB/s (74.8kB/s)(6236KiB/85321msec); 0 zone resets clat (msec): min=10, max=767, avg=37.41, stdev=30.16 lat (msec): min=10, max=767, avg=37.41, stdev=30.16 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 56], 90.00th=[ 70], 95.00th=[ 82], | 99.00th=[ 113], 99.50th=[ 136], 99.90th=[ 234], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8, max= 184, per=24.77%, avg=72.81, stdev=46.72, samples=168 iops : min= 2, max= 46, avg=17.92, stdev=11.82, samples=168 lat (msec) : 4=4.49%, 10=18.88%, 20=25.46%, 50=35.51%, 100=14.62% lat (msec) : 250=1.01%, 1000=0.03% cpu : usr=0.07%, sys=10.50%, ctx=6456, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=281KiB/s (288kB/s), 69.7KiB/s-70.9KiB/s (71.4kB/s-72.6kB/s), io=23.4MiB (24.6MB), run=85107-85321msec WRITE: bw=295KiB/s (302kB/s), 73.1KiB/s-74.5KiB/s (74.8kB/s-76.3kB/s), io=24.6MiB (25.7MB), run=85107-85321msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155031: Fri Jul 17 22:53:21 2026 read: IOPS=27, BW=433KiB/s (444kB/s)(5920KiB/13659msec) clat (usec): min=57, max=76903, avg=18981.80, stdev=10897.83 lat (usec): min=57, max=76904, avg=18982.51, stdev=10897.88 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 112], 10.00th=[ 6783], 20.00th=[11076], | 30.00th=[13435], 40.00th=[16057], 50.00th=[17957], 60.00th=[20579], | 70.00th=[22414], 80.00th=[26084], 90.00th=[31589], 95.00th=[40109], | 99.00th=[51119], 99.50th=[55313], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 254, max= 766, per=24.48%, avg=429.11, stdev=112.37, samples=27 iops : min= 15, max= 47, avg=26.26, stdev= 7.01, samples=27 write: IOPS=29, BW=466KiB/s (477kB/s)(6368KiB/13659msec); 0 zone resets clat (usec): min=1057, max=108284, avg=16434.55, stdev=12393.11 lat (usec): min=1058, max=108286, avg=16437.48, stdev=12392.87 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 3359], 10.00th=[ 4228], 20.00th=[ 5211], | 30.00th=[ 8160], 40.00th=[ 10421], 50.00th=[ 13435], 60.00th=[ 17433], | 70.00th=[ 20317], 80.00th=[ 25822], 90.00th=[ 31851], 95.00th=[ 39060], | 99.00th=[ 53216], 99.50th=[ 62129], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 234, max= 830, per=25.22%, avg=465.07, stdev=145.61, samples=27 iops : min= 14, max= 51, avg=28.52, stdev= 9.19, samples=27 lat (usec) : 100=1.69%, 250=1.95%, 500=0.13% lat (msec) : 2=1.30%, 4=2.60%, 10=19.01%, 20=36.72%, 50=35.03% lat (msec) : 100=1.43%, 250=0.13% cpu : usr=0.12%, sys=29.70%, ctx=2616, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155033: Fri Jul 17 22:53:21 2026 read: IOPS=26, BW=428KiB/s (439kB/s)(5744KiB/13408msec) clat (usec): min=47, max=70935, avg=18932.32, stdev=11019.85 lat (usec): min=48, max=70936, avg=18932.99, stdev=11019.92 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 116], 10.00th=[ 7767], 20.00th=[11338], | 30.00th=[13304], 40.00th=[15664], 50.00th=[17695], 60.00th=[20317], | 70.00th=[22414], 80.00th=[26870], 90.00th=[32900], 95.00th=[39060], | 99.00th=[52167], 99.50th=[62129], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 87, max= 608, per=24.29%, avg=425.73, stdev=133.25, samples=26 iops : min= 5, max= 38, avg=26.08, stdev= 8.36, samples=26 write: IOPS=30, BW=488KiB/s (500kB/s)(6544KiB/13408msec); 0 zone resets clat (usec): min=1255, max=80661, avg=16064.60, stdev=12592.17 lat (usec): min=1257, max=80663, avg=16065.90, stdev=12592.32 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 3195], 10.00th=[ 4178], 20.00th=[ 5342], | 30.00th=[ 7439], 40.00th=[10421], 50.00th=[13042], 60.00th=[16319], | 70.00th=[19530], 80.00th=[23987], 90.00th=[32375], 95.00th=[40633], | 99.00th=[59507], 99.50th=[67634], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 254, max= 800, per=25.98%, avg=479.04, stdev=144.79, samples=26 iops : min= 15, max= 50, avg=29.42, stdev= 9.21, samples=26 lat (usec) : 50=0.13%, 100=1.17%, 250=2.73%, 500=0.13% lat (msec) : 2=0.78%, 4=4.17%, 10=18.49%, 20=38.02%, 50=32.55% lat (msec) : 100=1.82% cpu : usr=0.13%, sys=30.03%, ctx=2603, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155035: Fri Jul 17 22:53:21 2026 read: IOPS=29, BW=471KiB/s (482kB/s)(6256KiB/13292msec) clat (usec): min=26, max=51669, avg=18628.49, stdev=10335.80 lat (usec): min=26, max=51670, avg=18629.33, stdev=10335.83 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 123], 10.00th=[ 7504], 20.00th=[11207], | 30.00th=[13042], 40.00th=[15139], 50.00th=[16909], 60.00th=[19792], | 70.00th=[23462], 80.00th=[26870], 90.00th=[32637], 95.00th=[36439], | 99.00th=[49546], 99.50th=[51119], 99.90th=[51643], 99.95th=[51643], | 99.99th=[51643] bw ( KiB/s): min= 191, max= 704, per=26.91%, avg=471.73, stdev=143.98, samples=26 iops : min= 11, max= 44, avg=28.96, stdev= 9.15, samples=26 write: IOPS=28, BW=454KiB/s (465kB/s)(6032KiB/13292msec); 0 zone resets clat (usec): min=1331, max=74554, avg=15705.99, stdev=12066.80 lat (usec): min=1331, max=74556, avg=15707.50, stdev=12066.92 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 3458], 10.00th=[ 4293], 20.00th=[ 5211], | 30.00th=[ 7308], 40.00th=[ 9896], 50.00th=[12256], 60.00th=[14877], | 70.00th=[20055], 80.00th=[25035], 90.00th=[31851], 95.00th=[37487], | 99.00th=[50594], 99.50th=[72877], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 191, max= 798, per=24.24%, avg=447.00, stdev=147.54, samples=26 iops : min= 11, max= 49, avg=27.42, stdev= 9.23, samples=26 lat (usec) : 50=0.26%, 100=0.78%, 250=2.73% lat (msec) : 2=0.39%, 4=3.39%, 10=20.70%, 20=36.46%, 50=34.51% lat (msec) : 100=0.78% cpu : usr=0.15%, sys=29.61%, ctx=2661, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155037: Fri Jul 17 22:53:21 2026 read: IOPS=28, BW=458KiB/s (469kB/s)(6032KiB/13172msec) clat (usec): min=53, max=50234, avg=17454.75, stdev=10385.94 lat (usec): min=53, max=50234, avg=17455.41, stdev=10385.99 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 111], 10.00th=[ 182], 20.00th=[10290], | 30.00th=[12649], 40.00th=[14353], 50.00th=[16712], 60.00th=[18220], | 70.00th=[20841], 80.00th=[24511], 90.00th=[30540], 95.00th=[36439], | 99.00th=[48497], 99.50th=[50070], 99.90th=[50070], 99.95th=[50070], | 99.99th=[50070] bw ( KiB/s): min= 205, max= 672, per=25.94%, avg=454.81, stdev=146.92, samples=26 iops : min= 12, max= 42, avg=27.88, stdev= 9.31, samples=26 write: IOPS=29, BW=475KiB/s (486kB/s)(6256KiB/13172msec); 0 zone resets clat (usec): min=1101, max=81859, avg=16550.33, stdev=13678.34 lat (usec): min=1102, max=81861, avg=16552.09, stdev=13679.14 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 3163], 10.00th=[ 4015], 20.00th=[ 5211], | 30.00th=[ 7111], 40.00th=[10421], 50.00th=[12518], 60.00th=[15533], | 70.00th=[19792], 80.00th=[26084], 90.00th=[34341], 95.00th=[44303], | 99.00th=[68682], 99.50th=[78119], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 205, max= 800, per=25.86%, avg=476.92, stdev=149.99, samples=26 iops : min= 12, max= 50, avg=29.27, stdev= 9.46, samples=26 lat (usec) : 100=1.69%, 250=3.65%, 500=0.13% lat (msec) : 2=0.91%, 4=4.30%, 10=17.45%, 20=39.97%, 50=30.21% lat (msec) : 100=1.69% cpu : usr=0.08%, sys=30.03%, ctx=2497, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1754KiB/s (1796kB/s), 428KiB/s-471KiB/s (439kB/s-482kB/s), io=23.4MiB (24.5MB), run=13172-13659msec WRITE: bw=1845KiB/s (1889kB/s), 454KiB/s-488KiB/s (465kB/s-500kB/s), io=24.6MiB (25.8MB), run=13172-13659msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155030: Fri Jul 17 22:53:27 2026 read: IOPS=19, BW=308KiB/s (316kB/s)(5920KiB/19200msec) clat (msec): min=2, max=106, avg=15.82, stdev=16.15 lat (msec): min=2, max=106, avg=15.83, stdev=16.15 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 39], 95.00th=[ 52], | 99.00th=[ 79], 99.50th=[ 94], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 95, max= 832, per=24.47%, avg=305.18, stdev=186.98, samples=38 iops : min= 5, max= 52, avg=18.66, stdev=11.91, samples=38 write: IOPS=20, BW=332KiB/s (340kB/s)(6368KiB/19200msec); 0 zone resets clat (msec): min=12, max=118, avg=33.38, stdev=18.97 lat (msec): min=12, max=118, avg=33.38, stdev=18.97 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 59], 95.00th=[ 70], | 99.00th=[ 105], 99.50th=[ 117], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 96, max= 704, per=25.20%, avg=330.66, stdev=187.69, samples=38 iops : min= 6, max= 44, avg=20.24, stdev=11.97, samples=38 lat (msec) : 4=2.86%, 10=22.92%, 20=23.44%, 50=39.06%, 100=10.81% lat (msec) : 250=0.91% cpu : usr=0.05%, sys=10.92%, ctx=1654, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155032: Fri Jul 17 22:53:27 2026 read: IOPS=18, BW=300KiB/s (307kB/s)(5744KiB/19167msec) clat (msec): min=3, max=109, avg=16.18, stdev=17.15 lat (msec): min=3, max=109, avg=16.18, stdev=17.15 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 17], 80.00th=[ 25], 90.00th=[ 39], 95.00th=[ 58], | 99.00th=[ 84], 99.50th=[ 89], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 58, max= 736, per=23.91%, avg=298.21, stdev=189.13, samples=38 iops : min= 3, max= 46, avg=18.21, stdev=12.06, samples=38 write: IOPS=21, BW=341KiB/s (350kB/s)(6544KiB/19167msec); 0 zone resets clat (msec): min=11, max=124, avg=32.60, stdev=17.72 lat (msec): min=11, max=124, avg=32.60, stdev=17.72 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 62], 95.00th=[ 72], | 99.00th=[ 81], 99.50th=[ 103], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 126, max= 736, per=25.94%, avg=340.37, stdev=180.02, samples=38 iops : min= 7, max= 46, avg=20.87, stdev=11.51, samples=38 lat (msec) : 4=2.86%, 10=21.22%, 20=24.74%, 50=40.76%, 100=9.90% lat (msec) : 250=0.52% cpu : usr=0.07%, sys=10.74%, ctx=1618, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155034: Fri Jul 17 22:53:27 2026 read: IOPS=20, BW=332KiB/s (340kB/s)(6256KiB/18852msec) clat (msec): min=2, max=129, avg=16.18, stdev=17.02 lat (msec): min=2, max=129, avg=16.18, stdev=17.02 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 54], | 99.00th=[ 91], 99.50th=[ 100], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 95, max= 896, per=26.61%, avg=331.84, stdev=224.07, samples=37 iops : min= 5, max= 56, avg=20.30, stdev=14.23, samples=37 write: IOPS=19, BW=320KiB/s (328kB/s)(6032KiB/18852msec); 0 zone resets clat (usec): min=12679, max=95751, avg=32961.44, stdev=17246.37 lat (usec): min=12681, max=95753, avg=32963.09, stdev=17246.50 clat percentiles (usec): | 1.00th=[14222], 5.00th=[15664], 10.00th=[16909], 20.00th=[18482], | 30.00th=[20317], 40.00th=[23200], 50.00th=[26346], 60.00th=[31851], | 70.00th=[39060], 80.00th=[47449], 90.00th=[58459], 95.00th=[66323], | 99.00th=[93848], 99.50th=[94897], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 158, max= 704, per=23.98%, avg=314.57, stdev=168.69, samples=37 iops : min= 9, max= 44, avg=19.22, stdev=10.80, samples=37 lat (msec) : 4=2.86%, 10=22.53%, 20=26.56%, 50=37.24%, 100=10.68% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=11.12%, ctx=1663, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155036: Fri Jul 17 22:53:27 2026 read: IOPS=19, BW=314KiB/s (322kB/s)(6032KiB/19204msec) clat (msec): min=2, max=112, avg=16.60, stdev=17.27 lat (msec): min=2, max=112, avg=16.60, stdev=17.27 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 38], 95.00th=[ 58], | 99.00th=[ 89], 99.50th=[ 104], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 63, max= 864, per=24.89%, avg=310.39, stdev=183.16, samples=38 iops : min= 3, max= 54, avg=18.97, stdev=11.64, samples=38 write: IOPS=20, BW=326KiB/s (334kB/s)(6256KiB/19204msec); 0 zone resets clat (msec): min=13, max=119, avg=32.91, stdev=18.98 lat (msec): min=13, max=119, avg=32.91, stdev=18.98 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 62], 95.00th=[ 74], | 99.00th=[ 103], 99.50th=[ 111], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 95, max= 704, per=24.76%, avg=324.79, stdev=188.05, samples=38 iops : min= 5, max= 44, avg=19.87, stdev=12.01, samples=38 lat (msec) : 4=3.12%, 10=21.61%, 20=24.87%, 50=38.41%, 100=11.20% lat (msec) : 250=0.78% cpu : usr=0.05%, sys=11.19%, ctx=1677, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1247KiB/s (1277kB/s), 300KiB/s-332KiB/s (307kB/s-340kB/s), io=23.4MiB (24.5MB), run=18852-19204msec WRITE: bw=1312KiB/s (1344kB/s), 320KiB/s-341KiB/s (328kB/s-350kB/s), io=24.6MiB (25.8MB), run=18852-19204msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155049: Fri Jul 17 22:53:37 2026 read: IOPS=1, BW=1845KiB/s (1889kB/s)(7168KiB/3886msec) clat (usec): min=542, max=380095, avg=154918.22, stdev=127014.62 lat (usec): min=543, max=380097, avg=154919.48, stdev=127014.66 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[103285], | 30.00th=[105382], 40.00th=[105382], 50.00th=[111674], 60.00th=[112722], | 70.00th=[112722], 80.00th=[270533], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 2048, max= 5840, per=98.85%, avg=3991.67, stdev=1897.80, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1318KiB/s (1349kB/s)(5120KiB/3886msec); 0 zone resets clat (msec): min=237, max=1142, avg=551.93, stdev=346.71 lat (msec): min=237, max=1142, avg=552.00, stdev=346.73 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1630, max= 2043, per=34.08%, avg=1926.75, stdev=198.38, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=40.95%, ctx=1015, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155050: Fri Jul 17 22:53:37 2026 read: IOPS=0, BW=404KiB/s (414kB/s)(2048KiB/5071msec) clat (msec): min=462, max=637, avg=549.70, stdev=123.69 lat (msec): min=462, max=637, avg=549.71, stdev=123.69 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1921, max= 2027, per=48.89%, avg=1974.00, stdev=74.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2019KiB/s (2068kB/s)(10.0MiB/5071msec); 0 zone resets clat (msec): min=170, max=1007, avg=395.99, stdev=287.13 lat (msec): min=170, max=1007, avg=396.07, stdev=287.13 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 182], | 30.00th=[ 228], 40.00th=[ 247], 50.00th=[ 271], 60.00th=[ 288], | 70.00th=[ 338], 80.00th=[ 397], 90.00th=[ 835], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1726, max= 6144, per=62.61%, avg=3539.80, stdev=1774.22, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.08%, sys=41.60%, ctx=789, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155052: Fri Jul 17 22:53:37 2026 read: IOPS=1, BW=1613KiB/s (1652kB/s)(6144KiB/3809msec) clat (usec): min=472, max=351405, avg=122753.67, stdev=165198.92 lat (usec): min=472, max=351405, avg=122754.68, stdev=165198.98 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 69731], | 70.00th=[312476], 80.00th=[312476], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 2048, max= 4055, per=83.52%, avg=3372.67, stdev=1147.37, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1613KiB/s (1652kB/s)(6144KiB/3809msec); 0 zone resets clat (msec): min=156, max=1073, avg=504.81, stdev=340.10 lat (msec): min=156, max=1073, avg=504.86, stdev=340.14 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 468], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1630, max= 4096, per=41.19%, avg=2329.00, stdev=1000.36, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=43.59%, ctx=273, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155054: Fri Jul 17 22:53:37 2026 read: IOPS=1, BW=1120KiB/s (1147kB/s)(5120KiB/4572msec) clat (usec): min=586, max=449054, avg=192865.18, stdev=192244.36 lat (usec): min=587, max=449055, avg=192866.20, stdev=192244.37 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 586], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[250610], 60.00th=[250610], | 70.00th=[263193], 80.00th=[263193], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 4055, max= 4096, per=100.00%, avg=4075.50, stdev=28.99, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1568KiB/s (1605kB/s)(7168KiB/4572msec); 0 zone resets clat (msec): min=266, max=1016, avg=496.79, stdev=331.13 lat (msec): min=266, max=1016, avg=497.58, stdev=330.88 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 284], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 936], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1885, max= 3453, per=46.98%, avg=2656.50, stdev=814.72, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=16.67% lat (msec) : 500=66.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=39.38%, ctx=783, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4039KiB/s (4136kB/s), 404KiB/s-1845KiB/s (414kB/s-1889kB/s), io=20.0MiB (20.0MB), run=3809-5071msec WRITE: bw=5654KiB/s (5790kB/s), 1318KiB/s-2019KiB/s (1349kB/s-2068kB/s), io=28.0MiB (29.4MB), run=3809-5071msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155048: Fri Jul 17 22:53:37 2026 read: IOPS=1, BW=1598KiB/s (1637kB/s)(7168KiB/4485msec) clat (msec): min=70, max=329, avg=171.78, stdev=101.61 lat (msec): min=70, max=329, avg=171.79, stdev=101.61 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 89], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 122], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 292], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 2043, max= 6023, per=100.00%, avg=4054.00, stdev=1990.33, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=1142KiB/s (1169kB/s)(5120KiB/4485msec); 0 zone resets clat (msec): min=321, max=1060, avg=635.83, stdev=291.05 lat (msec): min=321, max=1060, avg=635.92, stdev=291.05 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1924, max= 2048, per=36.49%, avg=1993.00, stdev=62.13, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=14.79%, ctx=204, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155051: Fri Jul 17 22:53:37 2026 read: IOPS=0, BW=390KiB/s (400kB/s)(2048KiB/5249msec) clat (msec): min=110, max=400, avg=255.86, stdev=204.87 lat (msec): min=110, max=400, avg=255.86, stdev=204.87 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 111], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1980, max= 1980, per=50.76%, avg=1980.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1951KiB/s (1998kB/s)(10.0MiB/5249msec); 0 zone resets clat (msec): min=148, max=905, avg=462.39, stdev=298.76 lat (msec): min=148, max=905, avg=462.47, stdev=298.76 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 153], | 30.00th=[ 163], 40.00th=[ 197], 50.00th=[ 292], 60.00th=[ 617], | 70.00th=[ 659], 80.00th=[ 726], 90.00th=[ 760], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1924, max= 6144, per=55.23%, avg=3016.83, stdev=1721.95, samples=6 iops : min= 1, max= 6, avg= 2.50, stdev= 1.87, samples=6 lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, 1000=16.67% cpu : usr=0.02%, sys=16.88%, ctx=158, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155053: Fri Jul 17 22:53:37 2026 read: IOPS=1, BW=1177KiB/s (1206kB/s)(6144KiB/5218msec) clat (msec): min=48, max=1069, avg=402.68, stdev=367.00 lat (msec): min=48, max=1069, avg=402.68, stdev=367.00 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 259], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1924, max= 3961, per=63.96%, avg=2495.25, stdev=978.91, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1177KiB/s (1206kB/s)(6144KiB/5218msec); 0 zone resets clat (msec): min=83, max=743, avg=465.04, stdev=266.29 lat (msec): min=83, max=743, avg=465.13, stdev=266.29 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 600], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1957, max= 2048, per=36.90%, avg=2015.40, stdev=45.14, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=33.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=14.45%, ctx=259, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155055: Fri Jul 17 22:53:37 2026 read: IOPS=0, BW=980KiB/s (1003kB/s)(5120KiB/5226msec) clat (msec): min=69, max=866, avg=490.50, stdev=347.21 lat (msec): min=69, max=866, avg=490.50, stdev=347.21 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1924, max= 2048, per=50.81%, avg=1982.00, stdev=50.86, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1372KiB/s (1405kB/s)(7168KiB/5226msec); 0 zone resets clat (msec): min=87, max=789, avg=394.14, stdev=281.60 lat (msec): min=87, max=790, avg=394.23, stdev=281.60 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 121], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 768], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1957, max= 4096, per=55.83%, avg=3049.25, stdev=1209.25, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=25.00%, 750=16.67%, 1000=25.00% cpu : usr=0.04%, sys=9.40%, ctx=122, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3902KiB/s (3995kB/s), 390KiB/s-1598KiB/s (400kB/s-1637kB/s), io=20.0MiB (20.0MB), run=4485-5249msec WRITE: bw=5462KiB/s (5593kB/s), 1142KiB/s-1951KiB/s (1169kB/s-1998kB/s), io=28.0MiB (29.4MB), run=4485-5249msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155063: Fri Jul 17 22:53:46 2026 read: IOPS=1, BW=7402KiB/s (7580kB/s)(12.0MiB/1660msec) clat (msec): min=394, max=568, avg=483.82, stdev=87.03 lat (msec): min=394, max=568, avg=483.82, stdev=87.03 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 8143, max= 8192, per=84.65%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=54.31%, ctx=2771, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155065: Fri Jul 17 22:53:46 2026 read: IOPS=0, BW=2412KiB/s (2470kB/s)(4096KiB/1698msec) clat (nsec): min=774098k, max=774098k, avg=774097583.00, stdev= 0.00 lat (nsec): min=774099k, max=774099k, avg=774099283.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8143, max= 8143, per=84.40%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4824KiB/s (4940kB/s)(8192KiB/1698msec); 0 zone resets clat (msec): min=379, max=523, avg=451.75, stdev=102.05 lat (msec): min=379, max=524, avg=452.02, stdev=102.02 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 8192, max= 8192, per=54.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=24.63%, ctx=657, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155067: Fri Jul 17 22:53:46 2026 write: IOPS=1, BW=5660KiB/s (5796kB/s)(12.0MiB/2171msec); 0 zone resets clat (msec): min=208, max=1627, avg=696.88, stdev=806.28 lat (msec): min=208, max=1627, avg=697.17, stdev=806.33 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=16.82%, ctx=99, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155069: Fri Jul 17 22:53:46 2026 write: IOPS=1, BW=5982KiB/s (6126kB/s)(12.0MiB/2054msec); 0 zone resets clat (msec): min=313, max=1251, avg=642.98, stdev=527.71 lat (msec): min=314, max=1251, avg=643.30, stdev=527.68 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 6187, max= 8143, per=47.47%, avg=7165.00, stdev=1383.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.15%, sys=13.25%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9649KiB/s (9881kB/s), 2412KiB/s-7402KiB/s (2470kB/s-7580kB/s), io=16.0MiB (16.8MB), run=1660-1698msec WRITE: bw=14.7MiB/s (15.5MB/s), 4824KiB/s-5982KiB/s (4940kB/s-6126kB/s), io=32.0MiB (33.6MB), run=1698-2171msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155062: Fri Jul 17 22:53:46 2026 read: IOPS=1, BW=6896KiB/s (7061kB/s)(12.0MiB/1782msec) clat (msec): min=412, max=882, avg=584.44, stdev=259.36 lat (msec): min=412, max=882, avg=584.44, stdev=259.36 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.73%, ctx=84, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155064: Fri Jul 17 22:53:46 2026 read: IOPS=0, BW=1880KiB/s (1925kB/s)(4096KiB/2179msec) clat (nsec): min=1170.7M, max=1170.7M, avg=1170729651.00, stdev= 0.00 lat (nsec): min=1170.7M, max=1170.7M, avg=1170732566.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3760KiB/s (3850kB/s)(8192KiB/2179msec); 0 zone resets clat (msec): min=149, max=775, avg=462.67, stdev=442.47 lat (msec): min=150, max=775, avg=462.93, stdev=442.46 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.52%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155066: Fri Jul 17 22:53:46 2026 write: IOPS=3, BW=13.6MiB/s (14.3MB/s)(12.0MiB/881msec); 0 zone resets clat (msec): min=129, max=533, avg=290.02, stdev=214.71 lat (msec): min=129, max=534, avg=290.29, stdev=214.67 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min=10937, max=10937, per=72.73%, avg=10937.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 750=33.33% cpu : usr=0.00%, sys=28.52%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155068: Fri Jul 17 22:53:46 2026 write: IOPS=1, BW=6450KiB/s (6605kB/s)(12.0MiB/1905msec); 0 zone resets clat (msec): min=224, max=1423, avg=626.68, stdev=690.12 lat (msec): min=224, max=1423, avg=626.97, stdev=690.12 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min=12118, max=12118, per=80.58%, avg=12118.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.39%, ctx=249, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7519KiB/s (7700kB/s), 1880KiB/s-6896KiB/s (1925kB/s-7061kB/s), io=16.0MiB (16.8MB), run=1782-2179msec WRITE: bw=14.7MiB/s (15.4MB/s), 3760KiB/s-13.6MiB/s (3850kB/s-14.3MB/s), io=32.0MiB (33.6MB), run=881-2179msec