== sanity test 398b: DIO and buffer IO race ============== 23:05:58 (1784171158) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.17158 s, 15.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159875: Wed Jul 15 23:07:18 2026 read: IOPS=21, BW=86.4KiB/s (88.5kB/s)(5992KiB/69351msec) clat (usec): min=34, max=1469.5k, avg=25336.03, stdev=39438.06 lat (usec): min=35, max=1469.5k, avg=25336.64, stdev=39438.07 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 8455], 10.00th=[ 10814], | 20.00th=[ 14353], 30.00th=[ 17171], 40.00th=[ 20055], | 50.00th=[ 22938], 60.00th=[ 25822], 70.00th=[ 29230], | 80.00th=[ 33424], 90.00th=[ 40109], 95.00th=[ 45876], | 99.00th=[ 61604], 99.50th=[ 83362], 99.90th=[ 114820], | 99.95th=[1468007], 99.99th=[1468007] bw ( KiB/s): min= 6, max= 176, per=25.28%, avg=87.22, stdev=30.24, samples=135 iops : min= 1, max= 44, avg=21.24, stdev= 7.62, samples=135 write: IOPS=22, BW=90.8KiB/s (92.0kB/s)(6296KiB/69351msec); 0 zone resets clat (usec): min=760, max=131391, avg=19802.69, stdev=13566.22 lat (usec): min=761, max=131392, avg=19803.40, stdev=13566.26 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 3654], 10.00th=[ 5211], 20.00th=[ 7898], | 30.00th=[ 10552], 40.00th=[ 13960], 50.00th=[ 16909], 60.00th=[ 21103], | 70.00th=[ 25560], 80.00th=[ 30016], 90.00th=[ 36963], 95.00th=[ 43779], | 99.00th=[ 62653], 99.50th=[ 68682], 99.90th=[ 89654], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 31, max= 207, per=25.49%, avg=92.27, stdev=34.55, samples=134 iops : min= 7, max= 51, avg=22.51, stdev= 8.67, samples=134 lat (usec) : 50=0.03%, 100=0.10%, 250=1.24%, 500=0.26%, 1000=0.49% lat (msec) : 2=0.36%, 4=2.44%, 10=13.25%, 20=31.09%, 50=47.82% lat (msec) : 100=2.83%, 250=0.07%, 2000=0.03% cpu : usr=0.07%, sys=29.64%, ctx=11348, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159876: Wed Jul 15 23:07:18 2026 read: IOPS=21, BW=85.6KiB/s (87.6kB/s)(5940KiB/69406msec) clat (usec): min=30, max=175654, avg=24424.05, stdev=13238.94 lat (usec): min=30, max=175654, avg=24424.61, stdev=13238.99 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 8094], 10.00th=[ 10945], 20.00th=[ 14615], | 30.00th=[ 16909], 40.00th=[ 19792], 50.00th=[ 22414], 60.00th=[ 25297], | 70.00th=[ 28443], 80.00th=[ 32637], 90.00th=[ 40109], 95.00th=[ 47449], | 99.00th=[ 70779], 99.50th=[ 74974], 99.90th=[ 95945], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 6, max= 200, per=25.10%, avg=86.58, stdev=32.20, samples=136 iops : min= 1, max= 50, avg=21.08, stdev= 8.11, samples=136 write: IOPS=22, BW=91.5KiB/s (93.7kB/s)(6348KiB/69406msec); 0 zone resets clat (usec): min=755, max=1463.5k, avg=20736.96, stdev=38876.61 lat (usec): min=756, max=1463.5k, avg=20739.19, stdev=38876.92 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 66], 99.50th=[ 77], 99.90th=[ 104], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 31, max= 215, per=25.74%, avg=93.16, stdev=36.15, samples=135 iops : min= 7, max= 53, avg=22.74, stdev= 9.08, samples=135 lat (usec) : 50=0.07%, 100=0.20%, 250=0.88%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=0.13%, 4=3.03%, 10=14.06%, 20=31.25%, 50=46.42% lat (msec) : 100=3.45%, 250=0.07%, 2000=0.03% cpu : usr=0.06%, sys=29.52%, ctx=11279, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159877: Wed Jul 15 23:07:18 2026 read: IOPS=21, BW=87.6KiB/s (89.7kB/s)(6028KiB/68784msec) clat (usec): min=60, max=148623, avg=23990.57, stdev=13093.43 lat (usec): min=61, max=148624, avg=23991.21, stdev=13093.48 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 7701], 10.00th=[ 10028], 20.00th=[ 14091], | 30.00th=[ 16712], 40.00th=[ 19268], 50.00th=[ 22152], 60.00th=[ 25035], | 70.00th=[ 28705], 80.00th=[ 33424], 90.00th=[ 40109], 95.00th=[ 46924], | 99.00th=[ 64226], 99.50th=[ 82314], 99.90th=[ 88605], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 23, max= 191, per=25.91%, avg=89.38, stdev=31.07, samples=133 iops : min= 5, max= 47, avg=21.78, stdev= 7.82, samples=133 write: IOPS=22, BW=91.0KiB/s (93.2kB/s)(6260KiB/68784msec); 0 zone resets clat (usec): min=816, max=1468.2k, avg=20707.80, stdev=39044.99 lat (usec): min=817, max=1468.2k, avg=20710.78, stdev=39045.13 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 38], 95.00th=[ 45], | 99.00th=[ 63], 99.50th=[ 67], 99.90th=[ 142], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 12, max= 191, per=25.38%, avg=91.87, stdev=31.42, samples=134 iops : min= 3, max= 47, avg=22.42, stdev= 7.89, samples=134 lat (usec) : 100=0.16%, 250=1.33%, 500=0.29%, 1000=0.20% lat (msec) : 2=0.29%, 4=2.90%, 10=13.74%, 20=31.67%, 50=46.45% lat (msec) : 100=2.86%, 250=0.07%, 2000=0.03% cpu : usr=0.06%, sys=29.68%, ctx=11116, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159878: Wed Jul 15 23:07:18 2026 read: IOPS=21, BW=87.4KiB/s (89.5kB/s)(6052KiB/69220msec) clat (usec): min=41, max=106115, avg=23837.75, stdev=12648.89 lat (usec): min=41, max=106116, avg=23838.34, stdev=12648.95 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 7439], 10.00th=[ 10290], 20.00th=[ 13960], | 30.00th=[ 16909], 40.00th=[ 19006], 50.00th=[ 21627], 60.00th=[ 25035], | 70.00th=[ 28705], 80.00th=[ 33162], 90.00th=[ 40109], 95.00th=[ 45876], | 99.00th=[ 61080], 99.50th=[ 67634], 99.90th=[ 94897], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 31, max= 191, per=25.81%, avg=89.06, stdev=34.84, samples=134 iops : min= 7, max= 47, avg=21.70, stdev= 8.77, samples=134 write: IOPS=22, BW=90.1KiB/s (92.3kB/s)(6236KiB/69220msec); 0 zone resets clat (usec): min=741, max=1470.9k, avg=21128.13, stdev=39549.95 lat (usec): min=742, max=1470.9k, avg=21128.84, stdev=39549.96 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 40], 95.00th=[ 46], | 99.00th=[ 69], 99.50th=[ 94], 99.90th=[ 140], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 6, max= 216, per=25.14%, avg=90.99, stdev=34.93, samples=135 iops : min= 1, max= 54, avg=22.19, stdev= 8.83, samples=135 lat (usec) : 50=0.03%, 100=0.13%, 250=1.46%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=0.20%, 4=3.29%, 10=13.57%, 20=31.25%, 50=46.09% lat (msec) : 100=3.35%, 250=0.20%, 2000=0.03% cpu : usr=0.05%, sys=29.58%, ctx=11069, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=346KiB/s (354kB/s), 85.6KiB/s-87.6KiB/s (87.6kB/s-89.7kB/s), io=23.4MiB (24.6MB), run=68784-69406msec WRITE: bw=362KiB/s (371kB/s), 90.1KiB/s-91.5KiB/s (92.3kB/s-93.7kB/s), io=24.6MiB (25.7MB), run=68784-69406msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159870: Wed Jul 15 23:07:36 2026 read: IOPS=17, BW=68.7KiB/s (70.4kB/s)(5992KiB/87185msec) clat (msec): min=2, max=1482, avg=21.13, stdev=41.38 lat (msec): min=2, max=1482, avg=21.13, stdev=41.38 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 55], | 99.00th=[ 78], 99.50th=[ 100], 99.90th=[ 140], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7, max= 200, per=25.51%, avg=69.65, stdev=39.55, samples=170 iops : min= 1, max= 50, avg=17.00, stdev=10.04, samples=170 write: IOPS=18, BW=72.2KiB/s (73.9kB/s)(6296KiB/87185msec); 0 zone resets clat (msec): min=13, max=158, avg=35.09, stdev=17.63 lat (msec): min=13, max=158, avg=35.09, stdev=17.63 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 57], 95.00th=[ 69], | 99.00th=[ 100], 99.50th=[ 118], 99.90th=[ 150], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 15, max= 168, per=25.57%, avg=73.14, stdev=35.42, samples=170 iops : min= 3, max= 42, avg=17.87, stdev= 9.05, samples=170 lat (msec) : 4=2.51%, 10=13.28%, 20=21.52%, 50=51.89%, 100=10.12% lat (msec) : 250=0.65%, 2000=0.03% cpu : usr=0.06%, sys=13.93%, ctx=7509, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159871: Wed Jul 15 23:07:36 2026 read: IOPS=16, BW=67.8KiB/s (69.4kB/s)(5940KiB/87611msec) clat (msec): min=2, max=1445, avg=20.61, stdev=40.64 lat (msec): min=2, max=1445, avg=20.61, stdev=40.64 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 53], | 99.00th=[ 82], 99.50th=[ 92], 99.90th=[ 134], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8, max= 216, per=25.16%, avg=68.68, stdev=41.95, samples=171 iops : min= 2, max= 54, avg=16.76, stdev=10.67, samples=171 write: IOPS=18, BW=72.5KiB/s (74.2kB/s)(6348KiB/87611msec); 0 zone resets clat (msec): min=11, max=181, avg=35.72, stdev=19.54 lat (msec): min=11, max=181, avg=35.72, stdev=19.54 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 59], 95.00th=[ 72], | 99.00th=[ 106], 99.50th=[ 138], 99.90th=[ 176], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 23, max= 176, per=25.60%, avg=73.22, stdev=36.25, samples=171 iops : min= 5, max= 44, avg=17.89, stdev= 9.24, samples=171 lat (msec) : 4=3.06%, 10=13.22%, 20=22.69%, 50=48.80%, 100=11.30% lat (msec) : 250=0.91%, 2000=0.03% cpu : usr=0.08%, sys=13.73%, ctx=7617, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159872: Wed Jul 15 23:07:36 2026 read: IOPS=17, BW=68.9KiB/s (70.5kB/s)(6028KiB/87505msec) clat (msec): min=2, max=131, avg=20.05, stdev=16.66 lat (msec): min=2, max=131, avg=20.05, stdev=16.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 56], | 99.00th=[ 77], 99.50th=[ 89], 99.90th=[ 114], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 7, max= 216, per=25.59%, avg=69.85, stdev=38.17, samples=171 iops : min= 1, max= 54, avg=17.05, stdev= 9.71, samples=171 write: IOPS=17, BW=71.5KiB/s (73.3kB/s)(6260KiB/87505msec); 0 zone resets clat (msec): min=13, max=1461, avg=36.40, stdev=40.45 lat (msec): min=13, max=1461, avg=36.40, stdev=40.45 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 47], 90.00th=[ 57], 95.00th=[ 73], | 99.00th=[ 99], 99.50th=[ 127], 99.90th=[ 163], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 23, max= 176, per=25.34%, avg=72.47, stdev=36.75, samples=171 iops : min= 5, max= 44, avg=17.71, stdev= 9.36, samples=171 lat (msec) : 4=2.31%, 10=13.57%, 20=22.56%, 50=49.71%, 100=11.26% lat (msec) : 250=0.55%, 2000=0.03% cpu : usr=0.06%, sys=13.88%, ctx=7443, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159873: Wed Jul 15 23:07:36 2026 read: IOPS=17, BW=69.0KiB/s (70.7kB/s)(6052KiB/87675msec) clat (msec): min=2, max=135, avg=20.02, stdev=17.25 lat (msec): min=2, max=135, avg=20.02, stdev=17.25 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 55], | 99.00th=[ 77], 99.50th=[ 93], 99.90th=[ 133], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 7, max= 224, per=25.48%, avg=69.57, stdev=39.72, samples=171 iops : min= 1, max= 56, avg=16.98, stdev=10.10, samples=171 write: IOPS=17, BW=71.1KiB/s (72.8kB/s)(6236KiB/87675msec); 0 zone resets clat (msec): min=11, max=1457, avg=36.60, stdev=40.75 lat (msec): min=11, max=1457, avg=36.60, stdev=40.75 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 48], 90.00th=[ 61], 95.00th=[ 74], | 99.00th=[ 102], 99.50th=[ 116], 99.90th=[ 188], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 15, max= 168, per=25.11%, avg=71.82, stdev=37.01, samples=171 iops : min= 3, max= 42, avg=17.54, stdev= 9.43, samples=171 lat (msec) : 4=2.83%, 10=13.96%, 20=21.78%, 50=49.32%, 100=11.39% lat (msec) : 250=0.68%, 2000=0.03% cpu : usr=0.05%, sys=13.96%, ctx=7413, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=274KiB/s (280kB/s), 67.8KiB/s-69.0KiB/s (69.4kB/s-70.7kB/s), io=23.4MiB (24.6MB), run=87185-87675msec WRITE: bw=287KiB/s (294kB/s), 71.1KiB/s-72.5KiB/s (72.8kB/s-74.2kB/s), io=24.6MiB (25.7MB), run=87185-87675msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159910: Wed Jul 15 23:08:04 2026 read: IOPS=16, BW=260KiB/s (266kB/s)(5920KiB/22809msec) clat (usec): min=24, max=154602, avg=30434.89, stdev=16094.67 lat (usec): min=25, max=154603, avg=30435.80, stdev=16094.66 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 253], 10.00th=[ 14746], 20.00th=[ 20579], | 30.00th=[ 23725], 40.00th=[ 26084], 50.00th=[ 28705], 60.00th=[ 31589], | 70.00th=[ 35390], 80.00th=[ 40633], 90.00th=[ 48497], 95.00th=[ 53740], | 99.00th=[ 74974], 99.50th=[113771], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 95, max= 416, per=24.51%, avg=257.40, stdev=72.40, samples=45 iops : min= 5, max= 26, avg=15.44, stdev= 4.60, samples=45 write: IOPS=17, BW=279KiB/s (286kB/s)(6368KiB/22809msec); 0 zone resets clat (usec): min=1211, max=106785, avg=28844.32, stdev=16769.64 lat (usec): min=1213, max=106786, avg=28845.61, stdev=16769.68 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 52], 95.00th=[ 57], | 99.00th=[ 79], 99.50th=[ 100], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 63, max= 447, per=25.24%, avg=278.67, stdev=72.67, samples=45 iops : min= 3, max= 27, avg=16.76, stdev= 4.57, samples=45 lat (usec) : 50=0.13%, 100=0.39%, 250=1.82%, 500=0.65% lat (msec) : 2=0.26%, 4=0.26%, 10=6.64%, 20=16.54%, 50=63.54% lat (msec) : 100=9.38%, 250=0.39% cpu : usr=0.10%, sys=30.46%, ctx=3359, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159911: Wed Jul 15 23:08:04 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(5744KiB/22766msec) clat (usec): min=160, max=89556, avg=32088.18, stdev=15888.64 lat (usec): min=161, max=89558, avg=32090.52, stdev=15887.23 clat percentiles (usec): | 1.00th=[ 192], 5.00th=[ 7111], 10.00th=[16909], 20.00th=[20317], | 30.00th=[23200], 40.00th=[26084], 50.00th=[30016], 60.00th=[33817], | 70.00th=[39060], 80.00th=[42730], 90.00th=[51643], 95.00th=[61080], | 99.00th=[82314], 99.50th=[87557], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 95, max= 415, per=24.08%, avg=252.87, stdev=78.59, samples=45 iops : min= 5, max= 25, avg=15.16, stdev= 4.97, samples=45 write: IOPS=17, BW=287KiB/s (294kB/s)(6544KiB/22766msec); 0 zone resets clat (usec): min=1675, max=98244, avg=27330.55, stdev=16675.63 lat (usec): min=1676, max=98245, avg=27331.92, stdev=16675.62 clat percentiles (usec): | 1.00th=[ 5473], 5.00th=[ 7635], 10.00th=[ 8979], 20.00th=[11731], | 30.00th=[15401], 40.00th=[20055], 50.00th=[24249], 60.00th=[29230], | 70.00th=[35390], 80.00th=[40109], 90.00th=[48497], 95.00th=[58459], | 99.00th=[78119], 99.50th=[86508], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 95, max= 448, per=25.90%, avg=285.96, stdev=71.52, samples=45 iops : min= 5, max= 28, avg=17.22, stdev= 4.65, samples=45 lat (usec) : 250=1.17%, 500=0.39%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.26%, 4=0.39%, 10=7.81%, 20=19.66%, 50=59.90% lat (msec) : 100=10.16% cpu : usr=0.06%, sys=30.90%, ctx=3387, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159912: Wed Jul 15 23:08:04 2026 read: IOPS=17, BW=275KiB/s (282kB/s)(6256KiB/22711msec) clat (usec): min=99, max=138559, avg=30731.07, stdev=15456.51 lat (usec): min=100, max=138561, avg=30731.90, stdev=15456.53 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 251], 10.00th=[ 16319], 20.00th=[ 20841], | 30.00th=[ 23725], 40.00th=[ 26608], 50.00th=[ 29492], 60.00th=[ 32637], | 70.00th=[ 36963], 80.00th=[ 41157], 90.00th=[ 48497], 95.00th=[ 56361], | 99.00th=[ 78119], 99.50th=[ 83362], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 127, max= 416, per=26.43%, avg=277.48, stdev=62.51, samples=44 iops : min= 7, max= 26, avg=16.70, stdev= 4.01, samples=44 write: IOPS=16, BW=266KiB/s (272kB/s)(6032KiB/22711msec); 0 zone resets clat (usec): min=5011, max=92082, avg=28280.77, stdev=15832.14 lat (usec): min=5011, max=92083, avg=28282.77, stdev=15831.59 clat percentiles (usec): | 1.00th=[ 5538], 5.00th=[ 8291], 10.00th=[10028], 20.00th=[13566], | 30.00th=[17957], 40.00th=[21627], 50.00th=[25297], 60.00th=[29492], | 70.00th=[35390], 80.00th=[40633], 90.00th=[49546], 95.00th=[58459], | 99.00th=[81265], 99.50th=[83362], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 95, max= 415, per=23.81%, avg=262.89, stdev=80.27, samples=44 iops : min= 5, max= 25, avg=15.80, stdev= 5.06, samples=44 lat (usec) : 100=0.13%, 250=2.34%, 500=0.91% lat (msec) : 10=4.82%, 20=17.45%, 50=65.76%, 100=8.46%, 250=0.13% cpu : usr=0.05%, sys=30.74%, ctx=3494, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159913: Wed Jul 15 23:08:04 2026 read: IOPS=16, BW=265KiB/s (271kB/s)(6032KiB/22768msec) clat (usec): min=74, max=111969, avg=31429.35, stdev=17157.73 lat (usec): min=75, max=111969, avg=31430.10, stdev=17157.72 clat percentiles (usec): | 1.00th=[ 157], 5.00th=[ 217], 10.00th=[ 13698], 20.00th=[ 20055], | 30.00th=[ 23987], 40.00th=[ 26870], 50.00th=[ 29754], 60.00th=[ 33817], | 70.00th=[ 37487], 80.00th=[ 43254], 90.00th=[ 53740], 95.00th=[ 62129], | 99.00th=[ 79168], 99.50th=[ 87557], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 159, max= 414, per=25.16%, avg=264.13, stdev=56.13, samples=45 iops : min= 9, max= 25, avg=15.87, stdev= 3.50, samples=45 write: IOPS=17, BW=275KiB/s (281kB/s)(6256KiB/22768msec); 0 zone resets clat (usec): min=984, max=93824, avg=27684.68, stdev=16135.59 lat (usec): min=986, max=93825, avg=27686.19, stdev=16135.30 clat percentiles (usec): | 1.00th=[ 5080], 5.00th=[ 7898], 10.00th=[ 9372], 20.00th=[12256], | 30.00th=[17171], 40.00th=[21103], 50.00th=[25035], 60.00th=[29230], | 70.00th=[33817], 80.00th=[40633], 90.00th=[48497], 95.00th=[59507], | 99.00th=[74974], 99.50th=[88605], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 95, max= 480, per=24.94%, avg=275.36, stdev=77.67, samples=45 iops : min= 5, max= 30, avg=16.56, stdev= 4.94, samples=45 lat (usec) : 100=0.26%, 250=3.26%, 500=0.78%, 1000=0.26% lat (msec) : 2=0.13%, 10=6.38%, 20=17.45%, 50=60.55%, 100=10.81% lat (msec) : 250=0.13% cpu : usr=0.05%, sys=30.51%, ctx=3439, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1050KiB/s (1075kB/s), 252KiB/s-275KiB/s (258kB/s-282kB/s), io=23.4MiB (24.5MB), run=22711-22809msec WRITE: bw=1105KiB/s (1131kB/s), 266KiB/s-287KiB/s (272kB/s-294kB/s), io=24.6MiB (25.8MB), run=22711-22809msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159905: Wed Jul 15 23:08:09 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(5920KiB/27055msec) clat (msec): min=3, max=150, avg=28.98, stdev=24.00 lat (msec): min=3, max=150, avg=28.98, stdev=24.00 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 66], 95.00th=[ 78], | 99.00th=[ 108], 99.50th=[ 122], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 63, max= 606, per=24.42%, avg=213.94, stdev=122.88, samples=53 iops : min= 3, max= 37, avg=12.87, stdev= 7.81, samples=53 write: IOPS=14, BW=235KiB/s (241kB/s)(6368KiB/27055msec); 0 zone resets clat (msec): min=13, max=163, avg=40.93, stdev=21.43 lat (msec): min=13, max=163, avg=40.94, stdev=21.43 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 55], 90.00th=[ 69], 95.00th=[ 81], | 99.00th=[ 120], 99.50th=[ 129], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 31, max= 576, per=25.28%, avg=233.04, stdev=109.75, samples=53 iops : min= 1, max= 36, avg=14.06, stdev= 7.07, samples=53 lat (msec) : 4=0.26%, 10=9.51%, 20=18.10%, 50=50.26%, 100=19.79% lat (msec) : 250=2.08% cpu : usr=0.08%, sys=15.00%, ctx=2218, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159906: Wed Jul 15 23:08:09 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(5744KiB/27326msec) clat (msec): min=2, max=167, avg=28.01, stdev=25.59 lat (msec): min=2, max=167, avg=28.01, stdev=25.59 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 68], 95.00th=[ 88], | 99.00th=[ 118], 99.50th=[ 138], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 51, max= 702, per=23.82%, avg=208.63, stdev=128.09, samples=54 iops : min= 3, max= 43, avg=12.56, stdev= 8.11, samples=54 write: IOPS=14, BW=239KiB/s (245kB/s)(6544KiB/27326msec); 0 zone resets clat (msec): min=11, max=162, avg=41.96, stdev=23.91 lat (msec): min=11, max=162, avg=41.96, stdev=23.91 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 60], 90.00th=[ 74], 95.00th=[ 89], | 99.00th=[ 116], 99.50th=[ 121], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 31, max= 672, per=25.77%, avg=237.57, stdev=143.04, samples=54 iops : min= 1, max= 42, avg=14.35, stdev= 9.13, samples=54 lat (msec) : 4=1.56%, 10=10.29%, 20=19.27%, 50=46.22%, 100=20.18% lat (msec) : 250=2.47% cpu : usr=0.05%, sys=14.27%, ctx=2132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159907: Wed Jul 15 23:08:09 2026 read: IOPS=14, BW=233KiB/s (239kB/s)(6256KiB/26832msec) clat (msec): min=3, max=138, avg=25.95, stdev=19.35 lat (msec): min=3, max=138, avg=25.95, stdev=19.35 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 54], 95.00th=[ 69], | 99.00th=[ 94], 99.50th=[ 99], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 672, per=26.70%, avg=233.87, stdev=141.25, samples=53 iops : min= 1, max= 42, avg=14.11, stdev= 9.01, samples=53 write: IOPS=14, BW=225KiB/s (230kB/s)(6032KiB/26832msec); 0 zone resets clat (msec): min=15, max=157, avg=44.13, stdev=23.94 lat (msec): min=15, max=157, avg=44.13, stdev=23.94 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 52], 80.00th=[ 62], 90.00th=[ 78], 95.00th=[ 91], | 99.00th=[ 123], 99.50th=[ 150], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 63, max= 606, per=24.24%, avg=223.47, stdev=117.53, samples=53 iops : min= 3, max= 37, avg=13.47, stdev= 7.47, samples=53 lat (msec) : 4=0.91%, 10=8.33%, 20=19.27%, 50=49.35%, 100=20.57% lat (msec) : 250=1.56% cpu : usr=0.05%, sys=15.07%, ctx=2164, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159908: Wed Jul 15 23:08:09 2026 read: IOPS=13, BW=222KiB/s (228kB/s)(6032KiB/27132msec) clat (msec): min=3, max=142, avg=29.18, stdev=24.23 lat (msec): min=3, max=142, avg=29.19, stdev=24.23 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 64], 95.00th=[ 82], | 99.00th=[ 116], 99.50th=[ 128], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 63, max= 704, per=24.68%, avg=216.21, stdev=122.30, samples=53 iops : min= 3, max= 44, avg=13.02, stdev= 7.76, samples=53 write: IOPS=14, BW=231KiB/s (236kB/s)(6256KiB/27132msec); 0 zone resets clat (msec): min=14, max=156, avg=41.20, stdev=22.46 lat (msec): min=14, max=156, avg=41.20, stdev=22.46 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 47], 80.00th=[ 56], 90.00th=[ 72], 95.00th=[ 87], | 99.00th=[ 121], 99.50th=[ 148], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 638, per=24.54%, avg=226.28, stdev=120.03, samples=53 iops : min= 1, max= 39, avg=13.64, stdev= 7.68, samples=53 lat (msec) : 4=1.04%, 10=9.24%, 20=16.67%, 50=52.60%, 100=17.84% lat (msec) : 250=2.60% cpu : usr=0.05%, sys=15.02%, ctx=2224, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=877KiB/s (898kB/s), 210KiB/s-233KiB/s (215kB/s-239kB/s), io=23.4MiB (24.5MB), run=26832-27326msec WRITE: bw=922KiB/s (944kB/s), 225KiB/s-239KiB/s (230kB/s-245kB/s), io=24.6MiB (25.8MB), run=26832-27326msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159930: Wed Jul 15 23:08:21 2026 read: IOPS=1, BW=1194KiB/s (1223kB/s)(7168KiB/6003msec) clat (usec): min=725, max=1561.3k, avg=408557.98, stdev=526526.48 lat (usec): min=726, max=1561.3k, avg=408559.38, stdev=526526.44 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 725], 10.00th=[ 725], | 20.00th=[ 183501], 30.00th=[ 187696], 40.00th=[ 187696], | 50.00th=[ 225444], 60.00th=[ 231736], 70.00th=[ 231736], | 80.00th=[ 471860], 90.00th=[1568670], 95.00th=[1568670], | 99.00th=[1568670], 99.50th=[1568670], 99.90th=[1568670], | 99.95th=[1568670], 99.99th=[1568670] bw ( KiB/s): min= 1957, max= 3482, per=74.84%, avg=2313.20, stdev=654.46, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=0, BW=853KiB/s (873kB/s)(5120KiB/6003msec); 0 zone resets clat (msec): min=169, max=1775, avg=609.34, stdev=658.78 lat (msec): min=170, max=1775, avg=609.45, stdev=658.88 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 1943, max= 2035, per=46.01%, avg=1991.50, stdev=48.29, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 2000=16.67% cpu : usr=0.00%, sys=36.94%, ctx=1390, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159931: Wed Jul 15 23:08:21 2026 read: IOPS=0, BW=309KiB/s (317kB/s)(2048KiB/6624msec) clat (msec): min=168, max=277, avg=222.95, stdev=77.28 lat (msec): min=168, max=277, avg=222.95, stdev=77.28 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1756, max= 2048, per=61.53%, avg=1902.00, stdev=206.48, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1546KiB/s (1583kB/s)(10.0MiB/6624msec); 0 zone resets clat (msec): min=125, max=2439, avg=614.80, stdev=699.86 lat (msec): min=125, max=2439, avg=614.88, stdev=699.86 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 136], | 30.00th=[ 155], 40.00th=[ 178], 50.00th=[ 334], 60.00th=[ 435], | 70.00th=[ 718], 80.00th=[ 768], 90.00th=[ 860], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 2003, max= 4096, per=70.81%, avg=3064.50, stdev=1130.07, samples=6 iops : min= 1, max= 4, avg= 2.83, stdev= 1.33, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=29.64%, ctx=606, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159932: Wed Jul 15 23:08:21 2026 read: IOPS=0, BW=992KiB/s (1016kB/s)(6144KiB/6191msec) clat (usec): min=678, max=1165.0k, avg=360611.36, stdev=431530.71 lat (usec): min=679, max=1165.0k, avg=360612.60, stdev=431530.58 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], | 20.00th=[ 709], 30.00th=[ 709], 40.00th=[ 242222], | 50.00th=[ 242222], 60.00th=[ 304088], 70.00th=[ 450888], | 80.00th=[ 450888], 90.00th=[1166017], 95.00th=[1166017], | 99.00th=[1166017], 99.50th=[1166017], 99.90th=[1166017], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 1943, max= 4096, per=81.87%, avg=2530.50, stdev=1044.71, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=0, BW=992KiB/s (1016kB/s)(6144KiB/6191msec); 0 zone resets clat (msec): min=203, max=1794, avg=651.81, stdev=592.08 lat (msec): min=203, max=1794, avg=651.87, stdev=592.09 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 617], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1943, max= 2048, per=46.69%, avg=2020.83, stdev=41.93, samples=6 iops : min= 1, max= 2, avg= 1.50, stdev= 0.55, samples=6 lat (usec) : 750=16.67% lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=31.86%, ctx=579, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159933: Wed Jul 15 23:08:21 2026 read: IOPS=0, BW=781KiB/s (799kB/s)(5120KiB/6559msec) clat (usec): min=436, max=1519.1k, avg=358447.77, stdev=659297.97 lat (usec): min=437, max=1519.1k, avg=358448.93, stdev=659298.20 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 437], 10.00th=[ 437], | 20.00th=[ 437], 30.00th=[ 734], 40.00th=[ 734], | 50.00th=[ 734], 60.00th=[ 734], 70.00th=[ 270533], | 80.00th=[ 270533], 90.00th=[1518339], 95.00th=[1518339], | 99.00th=[1518339], 99.50th=[1518339], 99.90th=[1518339], | 99.95th=[1518339], 99.99th=[1518339] bw ( KiB/s): min= 1943, max= 6144, per=100.00%, avg=4043.50, stdev=2970.56, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1093KiB/s (1119kB/s)(7168KiB/6559msec); 0 zone resets clat (msec): min=105, max=1634, avg=661.57, stdev=528.17 lat (msec): min=105, max=1634, avg=661.64, stdev=528.18 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 236], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 693], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 953], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 1957, max= 2048, per=46.76%, avg=2023.80, stdev=38.11, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=16.67%, 500=16.67%, 750=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.02%, sys=30.16%, ctx=829, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3092KiB/s (3166kB/s), 309KiB/s-1194KiB/s (317kB/s-1223kB/s), io=20.0MiB (20.0MB), run=6003-6624msec WRITE: bw=4329KiB/s (4432kB/s), 853KiB/s-1546KiB/s (873kB/s-1583kB/s), io=28.0MiB (29.4MB), run=6003-6624msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159925: Wed Jul 15 23:08:22 2026 read: IOPS=1, BW=1272KiB/s (1303kB/s)(7168KiB/5634msec) clat (msec): min=42, max=1597, avg=417.13, stdev=537.35 lat (msec): min=42, max=1597, avg=417.13, stdev=537.35 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 113], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 224], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 468], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1848, max= 5137, per=100.00%, avg=3613.67, stdev=1657.84, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=0, BW=909KiB/s (931kB/s)(5120KiB/5634msec); 0 zone resets clat (msec): min=119, max=1823, avg=540.77, stdev=723.60 lat (msec): min=119, max=1823, avg=540.84, stdev=723.60 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 1712, max= 6144, per=93.26%, avg=3928.00, stdev=3133.90, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 50=8.33%, 250=41.67%, 500=33.33%, 2000=16.67% cpu : usr=0.00%, sys=10.81%, ctx=130, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159926: Wed Jul 15 23:08:22 2026 read: IOPS=0, BW=301KiB/s (308kB/s)(2048KiB/6807msec) clat (msec): min=124, max=495, avg=309.78, stdev=262.15 lat (msec): min=124, max=495, avg=309.78, stdev=262.15 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1721, max= 2048, per=62.65%, avg=1884.50, stdev=231.22, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1504KiB/s (1540kB/s)(10.0MiB/6807msec); 0 zone resets clat (msec): min=95, max=2275, avg=614.21, stdev=722.01 lat (msec): min=95, max=2275, avg=614.30, stdev=722.01 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 144], | 30.00th=[ 171], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 241], | 70.00th=[ 523], 80.00th=[ 835], 90.00th=[ 1452], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1914, max= 6144, per=72.02%, avg=3033.33, stdev=1742.06, samples=6 iops : min= 1, max= 6, avg= 2.67, stdev= 1.97, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=11.87%, ctx=171, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159927: Wed Jul 15 23:08:22 2026 read: IOPS=0, BW=908KiB/s (930kB/s)(6144KiB/6765msec) clat (msec): min=59, max=1790, avg=465.02, stdev=662.83 lat (msec): min=59, max=1790, avg=465.02, stdev=662.83 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 338], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1848, max= 2048, per=66.10%, avg=1988.40, stdev=89.22, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 write: IOPS=0, BW=908KiB/s (930kB/s)(6144KiB/6765msec); 0 zone resets clat (msec): min=137, max=1610, avg=641.48, stdev=550.57 lat (msec): min=137, max=1610, avg=641.55, stdev=550.57 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 634], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1732, max= 4096, per=55.90%, avg=2354.40, stdev=982.95, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.22, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=10.81%, ctx=190, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159928: Wed Jul 15 23:08:22 2026 read: IOPS=0, BW=825KiB/s (845kB/s)(5120KiB/6203msec) clat (msec): min=102, max=178, avg=134.59, stdev=37.63 lat (msec): min=102, max=178, avg=134.59, stdev=37.63 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 114], 60.00th=[ 114], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1848, max= 6144, per=100.00%, avg=3996.00, stdev=3037.73, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1156KiB/s (1183kB/s)(7168KiB/6203msec); 0 zone resets clat (msec): min=244, max=1960, avg=781.60, stdev=712.56 lat (msec): min=244, max=1960, avg=781.67, stdev=712.55 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 259], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 527], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 1636], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 1732, max= 3856, per=56.90%, avg=2396.50, stdev=981.92, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 2000=16.67% cpu : usr=0.02%, sys=12.88%, ctx=174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3009KiB/s (3081kB/s), 301KiB/s-1272KiB/s (308kB/s-1303kB/s), io=20.0MiB (20.0MB), run=5634-6807msec WRITE: bw=4212KiB/s (4313kB/s), 908KiB/s-1504KiB/s (930kB/s-1540kB/s), io=28.0MiB (29.4MB), run=5634-6807msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159939: Wed Jul 15 23:08:32 2026 read: IOPS=1, BW=5040KiB/s (5161kB/s)(12.0MiB/2438msec) clat (msec): min=442, max=1313, avg=764.26, stdev=478.00 lat (msec): min=442, max=1313, avg=764.26, stdev=478.00 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=42.51%, ctx=2889, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159940: Wed Jul 15 23:08:32 2026 read: IOPS=0, BW=1424KiB/s (1458kB/s)(4096KiB/2876msec) clat (nsec): min=1313.8M, max=1313.8M, avg=1313799289.00, stdev= 0.00 lat (nsec): min=1313.8M, max=1313.8M, avg=1313800381.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2848KiB/s (2917kB/s)(8192KiB/2876msec); 0 zone resets clat (msec): min=337, max=1082, avg=710.23, stdev=526.62 lat (msec): min=338, max=1082, avg=710.48, stdev=526.50 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=78.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=19.06%, ctx=943, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159941: Wed Jul 15 23:08:32 2026 write: IOPS=1, BW=5824KiB/s (5963kB/s)(12.0MiB/2110msec); 0 zone resets clat (msec): min=302, max=1044, avg=660.40, stdev=371.61 lat (msec): min=302, max=1044, avg=660.78, stdev=371.63 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=20.82%, ctx=258, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159942: Wed Jul 15 23:08:32 2026 write: IOPS=0, BW=3896KiB/s (3990kB/s)(12.0MiB/3154msec); 0 zone resets clat (msec): min=246, max=1729, avg=1008.89, stdev=742.34 lat (msec): min=246, max=1729, avg=1009.22, stdev=742.33 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8192, max= 8192, per=78.85%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=18.17%, ctx=126, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5697KiB/s (5834kB/s), 1424KiB/s-5040KiB/s (1458kB/s-5161kB/s), io=16.0MiB (16.8MB), run=2438-2876msec WRITE: bw=10.1MiB/s (10.6MB/s), 2848KiB/s-5824KiB/s (2917kB/s-5963kB/s), io=32.0MiB (33.6MB), run=2110-3154msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159944: Wed Jul 15 23:08:33 2026 read: IOPS=1, BW=4715KiB/s (4828kB/s)(12.0MiB/2606msec) clat (msec): min=460, max=1369, avg=862.37, stdev=463.82 lat (msec): min=460, max=1369, avg=862.37, stdev=463.82 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.59%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159945: Wed Jul 15 23:08:33 2026 read: IOPS=0, BW=1267KiB/s (1298kB/s)(4096KiB/3232msec) clat (nsec): min=1530.0M, max=1530.0M, avg=1530995706.00, stdev= 0.00 lat (nsec): min=1530.0M, max=1530.0M, avg=1530997158.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1536], 5.00th=[ 1536], 10.00th=[ 1536], 20.00th=[ 1536], | 30.00th=[ 1536], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2535KiB/s (2595kB/s)(8192KiB/3232msec); 0 zone resets clat (msec): min=518, max=1093, avg=805.75, stdev=406.56 lat (msec): min=518, max=1093, avg=806.07, stdev=406.62 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8175, max= 8175, per=81.21%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=15.17%, ctx=91, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159946: Wed Jul 15 23:08:33 2026 write: IOPS=0, BW=3775KiB/s (3866kB/s)(12.0MiB/3255msec); 0 zone resets clat (msec): min=232, max=1889, avg=1055.21, stdev=828.82 lat (msec): min=232, max=1890, avg=1055.55, stdev=828.85 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8110, max= 8192, per=80.98%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.06%, sys=13.03%, ctx=103, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159947: Wed Jul 15 23:08:33 2026 write: IOPS=1, BW=4495KiB/s (4602kB/s)(12.0MiB/2734msec); 0 zone resets clat (msec): min=288, max=1376, avg=888.17, stdev=552.30 lat (msec): min=289, max=1377, avg=888.57, stdev=552.34 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=81.38%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=14.75%, ctx=88, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5069KiB/s (5191kB/s), 1267KiB/s-4715KiB/s (1298kB/s-4828kB/s), io=16.0MiB (16.8MB), run=2606-3232msec WRITE: bw=9.83MiB/s (10.3MB/s), 2535KiB/s-4495KiB/s (2595kB/s-4602kB/s), io=32.0MiB (33.6MB), run=2734-3255msec