== sanity test 398b: DIO and buffer IO race ============== 23:02:04 (1784084524) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.30651 s, 15.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159302: Tue Jul 14 23:03:20 2026 read: IOPS=22, BW=91.0KiB/s (93.2kB/s)(5992KiB/65831msec) clat (usec): min=41, max=702942, avg=22017.74, stdev=23196.30 lat (usec): min=42, max=702944, avg=22018.81, stdev=23196.30 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 88], 10.00th=[ 7635], 20.00th=[ 10945], | 30.00th=[ 13173], 40.00th=[ 15795], 50.00th=[ 18744], 60.00th=[ 22152], | 70.00th=[ 25822], 80.00th=[ 31589], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 76022], 99.50th=[ 94897], 99.90th=[141558], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 5, max= 167, per=24.95%, avg=90.58, stdev=28.25, samples=130 iops : min= 1, max= 41, avg=22.09, stdev= 7.06, samples=130 write: IOPS=23, BW=95.6KiB/s (97.9kB/s)(6296KiB/65831msec); 0 zone resets clat (usec): min=777, max=263304, avg=20823.59, stdev=21239.26 lat (usec): min=778, max=263306, avg=20825.49, stdev=21239.31 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1434], 10.00th=[ 2057], 20.00th=[ 3228], | 30.00th=[ 5145], 40.00th=[ 10028], 50.00th=[ 15664], 60.00th=[ 20841], | 70.00th=[ 27395], 80.00th=[ 34341], 90.00th=[ 46924], 95.00th=[ 58459], | 99.00th=[ 89654], 99.50th=[120062], 99.90th=[154141], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 23, max= 191, per=25.24%, avg=95.91, stdev=31.77, samples=129 iops : min= 5, max= 47, avg=23.43, stdev= 7.97, samples=129 lat (usec) : 50=0.46%, 100=2.47%, 250=1.11%, 1000=0.39% lat (msec) : 2=4.62%, 4=7.42%, 10=12.04%, 20=28.06%, 50=37.21% lat (msec) : 100=5.70%, 250=0.46%, 500=0.03%, 750=0.03% cpu : usr=0.12%, sys=12.64%, ctx=7344, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159303: Tue Jul 14 23:03:20 2026 read: IOPS=22, BW=90.9KiB/s (93.1kB/s)(5940KiB/65317msec) clat (usec): min=32, max=557147, avg=21776.53, stdev=20388.94 lat (usec): min=32, max=557149, avg=21777.58, stdev=20389.01 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 103], 10.00th=[ 7767], 20.00th=[ 10945], | 30.00th=[ 13435], 40.00th=[ 15664], 50.00th=[ 18482], 60.00th=[ 21890], | 70.00th=[ 25822], 80.00th=[ 30278], 90.00th=[ 39584], 95.00th=[ 47973], | 99.00th=[ 69731], 99.50th=[ 82314], 99.90th=[204473], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 5, max= 184, per=24.99%, avg=90.71, stdev=30.43, samples=129 iops : min= 1, max= 46, avg=22.12, stdev= 7.66, samples=129 write: IOPS=24, BW=97.2KiB/s (99.5kB/s)(6348KiB/65317msec); 0 zone resets clat (usec): min=752, max=221675, avg=20724.06, stdev=20962.04 lat (usec): min=752, max=221677, avg=20726.87, stdev=20962.19 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1401], 10.00th=[ 1893], 20.00th=[ 3294], | 30.00th=[ 5669], 40.00th=[ 10683], 50.00th=[ 16057], 60.00th=[ 21103], | 70.00th=[ 27132], 80.00th=[ 33817], 90.00th=[ 46924], 95.00th=[ 55837], | 99.00th=[ 95945], 99.50th=[106431], 99.90th=[208667], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 191, per=25.66%, avg=97.52, stdev=31.56, samples=128 iops : min= 7, max= 47, avg=23.84, stdev= 7.92, samples=128 lat (usec) : 50=0.39%, 100=1.99%, 250=1.07%, 500=0.10%, 1000=0.29% lat (msec) : 2=5.53%, 4=6.64%, 10=12.17%, 20=28.48%, 50=36.95% lat (msec) : 100=5.89%, 250=0.46%, 750=0.03% cpu : usr=0.12%, sys=12.80%, ctx=7294, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159304: Tue Jul 14 23:03:20 2026 read: IOPS=22, BW=91.3KiB/s (93.5kB/s)(6028KiB/65988msec) clat (usec): min=23, max=198762, avg=21335.49, stdev=15905.05 lat (usec): min=23, max=198763, avg=21339.53, stdev=15904.78 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 76], 10.00th=[ 6980], 20.00th=[ 10945], | 30.00th=[ 13304], 40.00th=[ 15664], 50.00th=[ 18220], 60.00th=[ 22152], | 70.00th=[ 25560], 80.00th=[ 30802], 90.00th=[ 38011], 95.00th=[ 44827], | 99.00th=[ 77071], 99.50th=[ 92799], 99.90th=[191890], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 168, per=25.20%, avg=91.47, stdev=28.74, samples=129 iops : min= 1, max= 42, avg=22.32, stdev= 7.23, samples=129 write: IOPS=23, BW=94.9KiB/s (97.1kB/s)(6260KiB/65988msec); 0 zone resets clat (usec): min=820, max=618914, avg=21565.39, stdev=25321.45 lat (usec): min=822, max=618918, avg=21569.47, stdev=25320.83 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1565], 10.00th=[ 2180], 20.00th=[ 3589], | 30.00th=[ 6325], 40.00th=[ 11731], 50.00th=[ 16712], 60.00th=[ 21627], | 70.00th=[ 26870], 80.00th=[ 34341], 90.00th=[ 46924], 95.00th=[ 58459], | 99.00th=[ 96994], 99.50th=[121111], 99.90th=[166724], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 5, max= 174, per=24.74%, avg=94.03, stdev=29.45, samples=130 iops : min= 1, max= 43, avg=22.96, stdev= 7.40, samples=130 lat (usec) : 50=0.65%, 100=2.90%, 250=0.68%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=4.23%, 4=6.67%, 10=11.36%, 20=28.71%, 50=38.54% lat (msec) : 100=5.21%, 250=0.59%, 750=0.03% cpu : usr=0.11%, sys=13.00%, ctx=7637, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159305: Tue Jul 14 23:03:20 2026 read: IOPS=22, BW=91.7KiB/s (93.9kB/s)(6052KiB/65993msec) clat (usec): min=38, max=207148, avg=21771.57, stdev=16610.39 lat (usec): min=38, max=207149, avg=21773.60, stdev=16612.28 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 85], 10.00th=[ 7177], 20.00th=[ 11076], | 30.00th=[ 13304], 40.00th=[ 15533], 50.00th=[ 18744], 60.00th=[ 21890], | 70.00th=[ 26346], 80.00th=[ 32113], 90.00th=[ 39060], 95.00th=[ 46400], | 99.00th=[ 70779], 99.50th=[101188], 99.90th=[193987], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 23, max= 168, per=25.24%, avg=91.60, stdev=30.08, samples=129 iops : min= 5, max= 42, avg=22.35, stdev= 7.56, samples=129 write: IOPS=23, BW=94.5KiB/s (96.8kB/s)(6236KiB/65993msec); 0 zone resets clat (usec): min=707, max=626364, avg=21132.81, stdev=26043.77 lat (usec): min=708, max=626367, avg=21137.68, stdev=26047.22 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 1369], 10.00th=[ 1909], 20.00th=[ 3228], | 30.00th=[ 5604], 40.00th=[ 10814], 50.00th=[ 15664], 60.00th=[ 21365], | 70.00th=[ 27132], 80.00th=[ 34866], 90.00th=[ 45876], 95.00th=[ 55837], | 99.00th=[ 87557], 99.50th=[107480], 99.90th=[258999], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 5, max= 168, per=24.68%, avg=93.78, stdev=31.32, samples=130 iops : min= 1, max= 42, avg=22.91, stdev= 7.86, samples=130 lat (usec) : 50=0.52%, 100=2.41%, 250=1.04%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.68% lat (msec) : 2=4.56%, 4=6.93%, 10=11.36%, 20=28.16%, 50=38.57% lat (msec) : 100=4.95%, 250=0.52%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=12.87%, ctx=7361, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=364KiB/s (373kB/s), 90.9KiB/s-91.7KiB/s (93.1kB/s-93.9kB/s), io=23.4MiB (24.6MB), run=65317-65993msec WRITE: bw=381KiB/s (390kB/s), 94.5KiB/s-97.2KiB/s (96.8kB/s-99.5kB/s), io=24.6MiB (25.7MB), run=65317-65993msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159297: Tue Jul 14 23:04:14 2026 read: IOPS=12, BW=50.1KiB/s (51.3kB/s)(5992KiB/119677msec) clat (msec): min=3, max=732, avg=18.04, stdev=26.83 lat (msec): min=3, max=732, avg=18.04, stdev=26.84 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 25], 90.00th=[ 41], 95.00th=[ 55], | 99.00th=[ 86], 99.50th=[ 117], 99.90th=[ 271], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 160, per=24.95%, avg=49.91, stdev=31.48, samples=237 iops : min= 1, max= 40, avg=12.00, stdev= 7.97, samples=237 write: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6296KiB/119677msec); 0 zone resets clat (msec): min=16, max=262, avg=58.69, stdev=29.59 lat (msec): min=16, max=262, avg=58.70, stdev=29.59 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 57], | 70.00th=[ 66], 80.00th=[ 78], 90.00th=[ 97], 95.00th=[ 118], | 99.00th=[ 161], 99.50th=[ 186], 99.90th=[ 259], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 7, max= 117, per=24.95%, avg=52.39, stdev=23.83, samples=237 iops : min= 1, max= 29, avg=12.62, stdev= 6.08, samples=237 lat (msec) : 4=0.07%, 10=22.33%, 20=14.91%, 50=33.76%, 100=24.02% lat (msec) : 250=4.75%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=3.54%, ctx=5514, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159298: Tue Jul 14 23:04:14 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5940KiB/119578msec) clat (msec): min=3, max=604, avg=17.70, stdev=22.84 lat (msec): min=3, max=604, avg=17.70, stdev=22.84 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 54], | 99.00th=[ 92], 99.50th=[ 102], 99.90th=[ 138], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 176, per=25.08%, avg=50.16, stdev=32.14, samples=233 iops : min= 1, max= 44, avg=12.06, stdev= 8.11, samples=233 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6348KiB/119578msec); 0 zone resets clat (msec): min=16, max=265, avg=58.62, stdev=30.21 lat (msec): min=16, max=265, avg=58.63, stdev=30.21 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 50], 60.00th=[ 56], | 70.00th=[ 65], 80.00th=[ 79], 90.00th=[ 100], 95.00th=[ 121], | 99.00th=[ 163], 99.50th=[ 182], 99.90th=[ 211], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 7, max= 104, per=25.13%, avg=52.76, stdev=23.94, samples=236 iops : min= 1, max= 26, avg=12.71, stdev= 6.09, samples=236 lat (msec) : 4=0.10%, 10=22.95%, 20=13.31%, 50=35.71%, 100=22.66% lat (msec) : 250=5.21%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.46%, ctx=5465, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159299: Tue Jul 14 23:04:14 2026 read: IOPS=12, BW=50.8KiB/s (52.0kB/s)(6028KiB/118617msec) clat (msec): min=3, max=295, avg=18.32, stdev=19.79 lat (msec): min=3, max=295, avg=18.32, stdev=19.79 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 43], 95.00th=[ 55], | 99.00th=[ 95], 99.50th=[ 129], 99.90th=[ 174], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 159, per=25.32%, avg=50.64, stdev=30.85, samples=235 iops : min= 1, max= 39, avg=12.18, stdev= 7.81, samples=235 write: IOPS=13, BW=52.8KiB/s (54.0kB/s)(6260KiB/118617msec); 0 zone resets clat (msec): min=16, max=659, avg=57.98, stdev=33.33 lat (msec): min=16, max=659, avg=57.99, stdev=33.33 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 56], | 70.00th=[ 65], 80.00th=[ 78], 90.00th=[ 96], 95.00th=[ 114], | 99.00th=[ 157], 99.50th=[ 190], 99.90th=[ 279], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 112, per=25.04%, avg=52.58, stdev=25.34, samples=235 iops : min= 1, max= 28, avg=12.66, stdev= 6.45, samples=235 lat (msec) : 4=0.20%, 10=22.14%, 20=14.23%, 50=35.32%, 100=23.44% lat (msec) : 250=4.56%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=3.48%, ctx=5549, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159300: Tue Jul 14 23:04:14 2026 read: IOPS=12, BW=50.8KiB/s (52.0kB/s)(6052KiB/119137msec) clat (msec): min=3, max=294, avg=17.18, stdev=17.76 lat (msec): min=3, max=294, avg=17.18, stdev=17.76 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 40], 95.00th=[ 53], | 99.00th=[ 81], 99.50th=[ 94], 99.90th=[ 136], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 151, per=25.96%, avg=51.92, stdev=30.84, samples=230 iops : min= 1, max= 37, avg=12.51, stdev= 7.79, samples=230 write: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6236KiB/119137msec); 0 zone resets clat (msec): min=17, max=658, avg=59.58, stdev=34.67 lat (msec): min=17, max=658, avg=59.58, stdev=34.67 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 51], 60.00th=[ 57], | 70.00th=[ 67], 80.00th=[ 80], 90.00th=[ 100], 95.00th=[ 123], | 99.00th=[ 169], 99.50th=[ 199], 99.90th=[ 275], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 120, per=24.82%, avg=52.12, stdev=23.85, samples=236 iops : min= 1, max= 30, avg=12.55, stdev= 6.07, samples=236 lat (msec) : 4=0.10%, 10=22.75%, 20=15.10%, 50=33.79%, 100=23.21% lat (msec) : 250=4.92%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=3.49%, ctx=5532, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=201KiB/s (205kB/s), 49.7KiB/s-50.8KiB/s (50.9kB/s-52.0kB/s), io=23.4MiB (24.6MB), run=118617-119677msec WRITE: bw=210KiB/s (215kB/s), 52.3KiB/s-53.1KiB/s (53.6kB/s-54.4kB/s), io=24.6MiB (25.7MB), run=118617-119677msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159344: Tue Jul 14 23:04:35 2026 read: IOPS=24, BW=384KiB/s (393kB/s)(5920KiB/15407msec) clat (usec): min=34, max=148767, avg=22278.25, stdev=17328.29 lat (usec): min=35, max=148768, avg=22280.45, stdev=17329.16 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 73], 20.00th=[ 10552], | 30.00th=[ 14353], 40.00th=[ 17171], 50.00th=[ 20841], 60.00th=[ 23462], | 70.00th=[ 27395], 80.00th=[ 32900], 90.00th=[ 40109], 95.00th=[ 49546], | 99.00th=[ 70779], 99.50th=[121111], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 254, max= 576, per=24.33%, avg=373.77, stdev=89.82, samples=30 iops : min= 15, max= 36, avg=22.67, stdev= 5.69, samples=30 write: IOPS=25, BW=413KiB/s (423kB/s)(6368KiB/15407msec); 0 zone resets clat (usec): min=924, max=116595, avg=17927.96, stdev=17181.57 lat (usec): min=925, max=116596, avg=17929.79, stdev=17181.57 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1729], 10.00th=[ 2376], 20.00th=[ 3654], | 30.00th=[ 5342], 40.00th=[ 7767], 50.00th=[ 12387], 60.00th=[ 18220], | 70.00th=[ 23462], 80.00th=[ 29492], 90.00th=[ 43779], 95.00th=[ 51643], | 99.00th=[ 77071], 99.50th=[ 95945], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 157, max= 608, per=25.31%, avg=408.93, stdev=122.31, samples=30 iops : min= 9, max= 38, avg=24.87, stdev= 7.70, samples=30 lat (usec) : 50=1.43%, 100=4.69%, 250=1.43%, 750=0.13%, 1000=0.39% lat (msec) : 2=3.78%, 4=7.81%, 10=13.41%, 20=23.31%, 50=38.15% lat (msec) : 100=5.08%, 250=0.39% cpu : usr=0.08%, sys=14.23%, ctx=1771, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159345: Tue Jul 14 23:04:35 2026 read: IOPS=23, BW=368KiB/s (377kB/s)(5744KiB/15592msec) clat (usec): min=40, max=126420, avg=21760.08, stdev=15839.56 lat (usec): min=40, max=126421, avg=21761.23, stdev=15839.58 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 95], 20.00th=[ 10552], | 30.00th=[ 14484], 40.00th=[ 17433], 50.00th=[ 19530], 60.00th=[ 23462], | 70.00th=[ 28443], 80.00th=[ 33817], 90.00th=[ 40109], 95.00th=[ 45351], | 99.00th=[ 71828], 99.50th=[ 92799], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 159, max= 542, per=23.95%, avg=367.94, stdev=97.05, samples=31 iops : min= 9, max= 33, avg=22.32, stdev= 6.18, samples=31 write: IOPS=26, BW=420KiB/s (430kB/s)(6544KiB/15592msec); 0 zone resets clat (usec): min=1086, max=106518, avg=18954.23, stdev=17506.69 lat (usec): min=1087, max=106520, avg=18956.41, stdev=17506.75 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2040], 10.00th=[ 2769], 20.00th=[ 3916], | 30.00th=[ 5538], 40.00th=[ 9241], 50.00th=[ 13566], 60.00th=[ 18220], | 70.00th=[ 25560], 80.00th=[ 32900], 90.00th=[ 43254], 95.00th=[ 51643], | 99.00th=[ 72877], 99.50th=[ 93848], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 254, max= 672, per=25.88%, avg=418.16, stdev=118.89, samples=31 iops : min= 15, max= 42, avg=25.48, stdev= 7.62, samples=31 lat (usec) : 50=0.78%, 100=4.17%, 250=1.69%, 500=0.26%, 750=0.52% lat (msec) : 2=2.47%, 4=8.33%, 10=12.89%, 20=25.91%, 50=38.54% lat (msec) : 100=4.04%, 250=0.39% cpu : usr=0.10%, sys=14.19%, ctx=1839, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159346: Tue Jul 14 23:04:35 2026 read: IOPS=25, BW=410KiB/s (420kB/s)(6256KiB/15256msec) clat (usec): min=38, max=87464, avg=21319.51, stdev=15803.08 lat (usec): min=38, max=87465, avg=21320.70, stdev=15803.08 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 90], 20.00th=[ 9110], | 30.00th=[14353], 40.00th=[17171], 50.00th=[20317], 60.00th=[22676], | 70.00th=[26870], 80.00th=[32113], 90.00th=[39584], 95.00th=[49021], | 99.00th=[76022], 99.50th=[79168], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 221, max= 667, per=26.82%, avg=412.00, stdev=101.07, samples=30 iops : min= 13, max= 41, avg=25.07, stdev= 6.30, samples=30 write: IOPS=24, BW=395KiB/s (405kB/s)(6032KiB/15256msec); 0 zone resets clat (usec): min=1000, max=109120, avg=18288.36, stdev=17011.73 lat (usec): min=1002, max=109122, avg=18303.32, stdev=17001.28 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1975], 10.00th=[ 2442], 20.00th=[ 3785], | 30.00th=[ 5866], 40.00th=[ 8848], 50.00th=[ 13435], 60.00th=[ 17171], | 70.00th=[ 22676], 80.00th=[ 32375], 90.00th=[ 41681], 95.00th=[ 50594], | 99.00th=[ 71828], 99.50th=[ 85459], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 223, max= 608, per=24.18%, avg=390.70, stdev=111.50, samples=30 iops : min= 13, max= 38, avg=23.73, stdev= 7.07, samples=30 lat (usec) : 50=1.04%, 100=5.08%, 250=2.34%, 500=0.39%, 1000=0.13% lat (msec) : 2=2.73%, 4=8.20%, 10=11.98%, 20=25.13%, 50=38.02% lat (msec) : 100=4.82%, 250=0.13% cpu : usr=0.12%, sys=13.74%, ctx=1772, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159347: Tue Jul 14 23:04:35 2026 read: IOPS=24, BW=398KiB/s (408kB/s)(6032KiB/15146msec) clat (usec): min=19, max=152298, avg=20654.46, stdev=17437.88 lat (usec): min=19, max=152298, avg=20657.68, stdev=17438.30 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 71], 20.00th=[ 359], | 30.00th=[ 12911], 40.00th=[ 15533], 50.00th=[ 18744], 60.00th=[ 21890], | 70.00th=[ 27395], 80.00th=[ 32113], 90.00th=[ 39584], 95.00th=[ 46924], | 99.00th=[ 82314], 99.50th=[ 95945], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 127, max= 606, per=25.78%, avg=395.93, stdev=104.39, samples=30 iops : min= 7, max= 37, avg=24.07, stdev= 6.65, samples=30 write: IOPS=25, BW=413KiB/s (423kB/s)(6256KiB/15146msec); 0 zone resets clat (usec): min=1034, max=146156, avg=18740.19, stdev=20526.27 lat (usec): min=1035, max=146159, avg=18742.02, stdev=20526.35 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1696], 10.00th=[ 2180], 20.00th=[ 3720], | 30.00th=[ 5342], 40.00th=[ 7635], 50.00th=[ 11600], 60.00th=[ 16188], | 70.00th=[ 24249], 80.00th=[ 30540], 90.00th=[ 42730], 95.00th=[ 53740], | 99.00th=[109577], 99.50th=[125305], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 190, max= 672, per=25.62%, avg=414.00, stdev=141.46, samples=30 iops : min= 11, max= 42, avg=25.20, stdev= 8.88, samples=30 lat (usec) : 20=0.13%, 50=1.04%, 100=5.86%, 250=2.47%, 500=0.39% lat (msec) : 2=4.95%, 4=6.25%, 10=14.58%, 20=23.57%, 50=35.42% lat (msec) : 100=4.56%, 250=0.78% cpu : usr=0.09%, sys=14.14%, ctx=1694, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1536KiB/s (1573kB/s), 368KiB/s-410KiB/s (377kB/s-420kB/s), io=23.4MiB (24.5MB), run=15146-15592msec WRITE: bw=1616KiB/s (1655kB/s), 395KiB/s-420KiB/s (405kB/s-430kB/s), io=24.6MiB (25.8MB), run=15146-15592msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159339: Tue Jul 14 23:04:51 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(5920KiB/32191msec) clat (msec): min=4, max=194, avg=21.24, stdev=22.33 lat (msec): min=4, max=194, avg=21.24, stdev=22.33 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 61], | 99.00th=[ 104], 99.50th=[ 165], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 32, max= 448, per=24.46%, avg=180.49, stdev=88.55, samples=63 iops : min= 2, max= 28, avg=10.67, stdev= 5.67, samples=63 write: IOPS=12, BW=198KiB/s (203kB/s)(6368KiB/32191msec); 0 zone resets clat (msec): min=20, max=200, avg=61.02, stdev=27.01 lat (msec): min=20, max=200, avg=61.02, stdev=27.01 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 32], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 45], 40.00th=[ 49], 50.00th=[ 55], 60.00th=[ 60], | 70.00th=[ 68], 80.00th=[ 80], 90.00th=[ 99], 95.00th=[ 115], | 99.00th=[ 157], 99.50th=[ 188], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 63, max= 352, per=25.30%, avg=196.30, stdev=83.40, samples=63 iops : min= 3, max= 22, avg=11.65, stdev= 5.31, samples=63 lat (msec) : 10=16.02%, 20=18.62%, 50=32.16%, 100=27.73%, 250=5.47% cpu : usr=0.06%, sys=3.55%, ctx=1463, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159340: Tue Jul 14 23:04:51 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5744KiB/32439msec) clat (msec): min=4, max=124, avg=19.75, stdev=20.24 lat (msec): min=4, max=124, avg=19.75, stdev=20.24 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 46], 95.00th=[ 66], | 99.00th=[ 107], 99.50th=[ 115], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 31, max= 480, per=24.48%, avg=180.63, stdev=105.73, samples=62 iops : min= 1, max= 30, avg=10.68, stdev= 6.70, samples=62 write: IOPS=12, BW=202KiB/s (207kB/s)(6544KiB/32439msec); 0 zone resets clat (msec): min=19, max=209, avg=61.77, stdev=30.75 lat (msec): min=19, max=209, avg=61.77, stdev=30.75 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 49], 50.00th=[ 55], 60.00th=[ 59], | 70.00th=[ 67], 80.00th=[ 81], 90.00th=[ 109], 95.00th=[ 125], | 99.00th=[ 169], 99.50th=[ 199], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 63, max= 352, per=25.67%, avg=199.19, stdev=82.98, samples=64 iops : min= 3, max= 22, avg=11.84, stdev= 5.31, samples=64 lat (msec) : 10=15.76%, 20=18.49%, 50=31.12%, 100=27.73%, 250=6.90% cpu : usr=0.07%, sys=3.48%, ctx=1450, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159341: Tue Jul 14 23:04:51 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31173msec) clat (msec): min=5, max=128, avg=20.61, stdev=21.06 lat (msec): min=5, max=128, avg=20.62, stdev=21.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 43], 95.00th=[ 71], | 99.00th=[ 111], 99.50th=[ 117], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 31, max= 542, per=27.20%, avg=200.72, stdev=130.01, samples=61 iops : min= 1, max= 33, avg=11.95, stdev= 8.24, samples=61 write: IOPS=12, BW=194KiB/s (198kB/s)(6032KiB/31173msec); 0 zone resets clat (msec): min=20, max=194, avg=61.11, stdev=27.56 lat (msec): min=20, max=194, avg=61.11, stdev=27.56 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 59], | 70.00th=[ 69], 80.00th=[ 80], 90.00th=[ 100], 95.00th=[ 120], | 99.00th=[ 157], 99.50th=[ 176], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 32, max= 352, per=24.65%, avg=191.26, stdev=81.65, samples=61 iops : min= 2, max= 22, avg=11.34, stdev= 5.21, samples=61 lat (msec) : 10=14.97%, 20=22.53%, 50=30.34%, 100=26.69%, 250=5.47% cpu : usr=0.07%, sys=3.65%, ctx=1431, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159342: Tue Jul 14 23:04:51 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(6032KiB/31385msec) clat (msec): min=4, max=162, avg=19.52, stdev=18.46 lat (msec): min=4, max=162, avg=19.53, stdev=18.46 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 43], 95.00th=[ 56], | 99.00th=[ 94], 99.50th=[ 122], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 31, max= 448, per=25.77%, avg=190.21, stdev=101.24, samples=62 iops : min= 1, max= 28, avg=11.27, stdev= 6.43, samples=62 write: IOPS=12, BW=199KiB/s (204kB/s)(6256KiB/31385msec); 0 zone resets clat (msec): min=24, max=170, avg=61.24, stdev=27.71 lat (msec): min=24, max=170, avg=61.24, stdev=27.71 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 32], 10.00th=[ 35], 20.00th=[ 40], | 30.00th=[ 45], 40.00th=[ 48], 50.00th=[ 53], 60.00th=[ 59], | 70.00th=[ 68], 80.00th=[ 81], 90.00th=[ 105], 95.00th=[ 124], | 99.00th=[ 148], 99.50th=[ 171], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 94, max= 352, per=25.69%, avg=199.35, stdev=82.79, samples=62 iops : min= 5, max= 22, avg=11.85, stdev= 5.27, samples=62 lat (msec) : 10=16.54%, 20=19.01%, 50=33.59%, 100=25.00%, 250=5.86% cpu : usr=0.09%, sys=3.56%, ctx=1452, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=738KiB/s (756kB/s), 177KiB/s-201KiB/s (181kB/s-206kB/s), io=23.4MiB (24.5MB), run=31173-32439msec WRITE: bw=777KiB/s (795kB/s), 194KiB/s-202KiB/s (198kB/s-207kB/s), io=24.6MiB (25.8MB), run=31173-32439msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159360: Tue Jul 14 23:05:00 2026 read: IOPS=1, BW=1788KiB/s (1831kB/s)(7168KiB/4009msec) clat (msec): min=75, max=356, avg=137.04, stdev=99.62 lat (msec): min=75, max=356, avg=137.04, stdev=99.62 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 95], 60.00th=[ 109], | 70.00th=[ 109], 80.00th=[ 148], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1992, max= 4087, per=77.19%, avg=3304.67, stdev=1143.76, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1277KiB/s (1308kB/s)(5120KiB/4009msec); 0 zone resets clat (msec): min=245, max=1571, avg=585.96, stdev=554.94 lat (msec): min=245, max=1571, avg=586.06, stdev=554.94 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1917, max= 2048, per=33.30%, avg=1996.00, stdev=69.55, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=6.56%, ctx=108, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159361: Tue Jul 14 23:05:00 2026 read: IOPS=0, BW=428KiB/s (438kB/s)(2048KiB/4783msec) clat (msec): min=138, max=1720, avg=929.72, stdev=1118.81 lat (msec): min=138, max=1720, avg=929.72, stdev=1118.81 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 2023, max= 2043, per=47.49%, avg=2033.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2141KiB/s (2192kB/s)(10.0MiB/4783msec); 0 zone resets clat (msec): min=89, max=548, avg=283.56, stdev=151.68 lat (msec): min=89, max=548, avg=283.64, stdev=151.67 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 92], | 30.00th=[ 138], 40.00th=[ 218], 50.00th=[ 288], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 363], 90.00th=[ 447], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1917, max= 6144, per=67.58%, avg=4051.00, stdev=1725.94, samples=4 iops : min= 1, max= 6, avg= 3.50, stdev= 2.08, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=7.84%, ctx=161, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159363: Tue Jul 14 23:05:00 2026 read: IOPS=1, BW=1385KiB/s (1418kB/s)(6144KiB/4437msec) clat (msec): min=54, max=176, avg=122.88, stdev=41.88 lat (msec): min=54, max=176, avg=122.88, stdev=41.88 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 138], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 178], 95.00th=[ 178], | 99.00th=[ 178], 99.50th=[ 178], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 4047, max= 4087, per=95.00%, avg=4067.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1385KiB/s (1418kB/s)(6144KiB/4437msec); 0 zone resets clat (msec): min=109, max=2125, avg=596.11, stdev=767.52 lat (msec): min=109, max=2125, avg=596.22, stdev=767.52 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 422], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 2043, max= 3835, per=44.08%, avg=2642.00, stdev=1033.17, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.92%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159366: Tue Jul 14 23:05:00 2026 read: IOPS=1, BW=1237KiB/s (1267kB/s)(5120KiB/4139msec) clat (msec): min=106, max=354, avg=186.84, stdev=97.65 lat (msec): min=106, max=354, avg=186.84, stdev=97.65 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 178], 80.00th=[ 178], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1732KiB/s (1773kB/s)(7168KiB/4139msec); 0 zone resets clat (msec): min=78, max=1849, avg=451.06, stdev=629.78 lat (msec): min=78, max=1849, avg=451.20, stdev=629.86 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 101], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 194], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 435], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 2023, max= 6131, per=58.55%, avg=3509.25, stdev=1942.84, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 2000=8.33% cpu : usr=0.05%, sys=6.21%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4282KiB/s (4385kB/s), 428KiB/s-1788KiB/s (438kB/s-1831kB/s), io=20.0MiB (20.0MB), run=4009-4783msec WRITE: bw=5995KiB/s (6138kB/s), 1277KiB/s-2141KiB/s (1308kB/s-2192kB/s), io=28.0MiB (29.4MB), run=4009-4783msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159359: Tue Jul 14 23:05:00 2026 read: IOPS=1, BW=1949KiB/s (1996kB/s)(7168KiB/3678msec) clat (usec): min=594, max=411065, avg=156906.17, stdev=133460.45 lat (usec): min=595, max=411067, avg=156907.79, stdev=133460.68 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 73925], | 30.00th=[ 80217], 40.00th=[ 80217], 50.00th=[139461], 60.00th=[170918], | 70.00th=[170918], 80.00th=[223347], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 2023, max= 3835, per=66.52%, avg=2925.00, stdev=1030.13, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1392KiB/s (1425kB/s)(5120KiB/3678msec); 0 zone resets clat (msec): min=191, max=1372, avg=505.08, stdev=490.62 lat (msec): min=191, max=1372, avg=505.17, stdev=490.60 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1917, max= 2048, per=32.42%, avg=1996.00, stdev=56.79, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=17.19%, ctx=577, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159362: Tue Jul 14 23:05:00 2026 read: IOPS=0, BW=440KiB/s (450kB/s)(2048KiB/4657msec) clat (msec): min=108, max=1716, avg=912.34, stdev=1136.98 lat (msec): min=108, max=1716, avg=912.34, stdev=1136.98 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1996, max= 2023, per=45.70%, avg=2009.50, stdev=19.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2199KiB/s (2252kB/s)(10.0MiB/4657msec); 0 zone resets clat (msec): min=85, max=624, avg=280.68, stdev=175.08 lat (msec): min=85, max=624, avg=280.77, stdev=175.06 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 132], | 30.00th=[ 159], 40.00th=[ 161], 50.00th=[ 205], 60.00th=[ 296], | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 527], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1996, max= 4087, per=48.94%, avg=3012.67, stdev=1088.88, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=15.96%, ctx=497, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159364: Tue Jul 14 23:05:00 2026 read: IOPS=1, BW=1656KiB/s (1695kB/s)(6144KiB/3711msec) clat (usec): min=630, max=359176, avg=138809.28, stdev=132572.24 lat (usec): min=632, max=359177, avg=138810.40, stdev=132572.07 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 1500], | 30.00th=[ 1500], 40.00th=[143655], 50.00th=[143655], 60.00th=[158335], | 70.00th=[170918], 80.00th=[170918], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 2023, max= 4096, per=75.46%, avg=3318.00, stdev=1129.07, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1656KiB/s (1695kB/s)(6144KiB/3711msec); 0 zone resets clat (msec): min=120, max=1834, avg=470.81, stdev=672.15 lat (msec): min=120, max=1834, avg=470.89, stdev=672.16 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 236], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1996, max= 4096, per=48.53%, avg=2987.50, stdev=1134.37, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=17.17%, ctx=127, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159365: Tue Jul 14 23:05:00 2026 read: IOPS=1, BW=1203KiB/s (1232kB/s)(5120KiB/4257msec) clat (usec): min=439, max=268108, avg=96189.56, stdev=132536.34 lat (usec): min=441, max=268108, avg=96190.74, stdev=132536.28 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 441], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 611], 60.00th=[ 611], | 70.00th=[210764], 80.00th=[210764], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 4047, max= 4087, per=92.49%, avg=4067.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1684KiB/s (1724kB/s)(7168KiB/4257msec); 0 zone resets clat (msec): min=118, max=2062, avg=534.47, stdev=682.96 lat (msec): min=118, max=2062, avg=534.56, stdev=682.96 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 201], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 292], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 485], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 1917, max= 4096, per=40.93%, avg=2519.75, stdev=1052.29, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=16.02%, ctx=164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4398KiB/s (4503kB/s), 440KiB/s-1949KiB/s (450kB/s-1996kB/s), io=20.0MiB (20.0MB), run=3678-4657msec WRITE: bw=6157KiB/s (6305kB/s), 1392KiB/s-2199KiB/s (1425kB/s-2252kB/s), io=28.0MiB (29.4MB), run=3678-4657msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159373: Tue Jul 14 23:05:08 2026 read: IOPS=1, BW=7699KiB/s (7884kB/s)(12.0MiB/1596msec) clat (msec): min=494, max=528, avg=516.59, stdev=19.55 lat (msec): min=494, max=528, avg=516.59, stdev=19.55 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 5936, max= 8159, per=68.66%, avg=7047.50, stdev=1571.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=41.25%, ctx=1121, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159374: Tue Jul 14 23:05:08 2026 read: IOPS=0, BW=2990KiB/s (3062kB/s)(4096KiB/1370msec) clat (nsec): min=392769k, max=392769k, avg=392769497.00, stdev= 0.00 lat (nsec): min=392772k, max=392772k, avg=392771811.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7173, max= 7173, per=69.88%, avg=7173.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5980KiB/s (6123kB/s)(8192KiB/1370msec); 0 zone resets clat (msec): min=325, max=588, avg=456.76, stdev=185.95 lat (msec): min=325, max=588, avg=457.15, stdev=185.95 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8159, max= 8159, per=55.93%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=14.24%, ctx=453, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159375: Tue Jul 14 23:05:08 2026 write: IOPS=1, BW=5471KiB/s (5602kB/s)(12.0MiB/2246msec); 0 zone resets clat (msec): min=226, max=1578, avg=733.59, stdev=736.57 lat (msec): min=227, max=1579, avg=734.16, stdev=736.85 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.71%, ctx=85, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159376: Tue Jul 14 23:05:08 2026 write: IOPS=1, BW=7748KiB/s (7934kB/s)(12.0MiB/1586msec); 0 zone resets clat (msec): min=240, max=1012, avg=517.06, stdev=429.96 lat (msec): min=242, max=1012, avg=517.91, stdev=429.45 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min=12300, max=12300, per=84.31%, avg=12300.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.92%, ctx=239, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.0MiB/s (10.5MB/s), 2990KiB/s-7699KiB/s (3062kB/s-7884kB/s), io=16.0MiB (16.8MB), run=1370-1596msec WRITE: bw=14.2MiB/s (14.9MB/s), 5471KiB/s-7748KiB/s (5602kB/s-7934kB/s), io=32.0MiB (33.6MB), run=1370-2246msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159377: Tue Jul 14 23:05:08 2026 read: IOPS=1, BW=6228KiB/s (6378kB/s)(12.0MiB/1973msec) clat (msec): min=378, max=776, avg=631.29, stdev=220.06 lat (msec): min=378, max=776, avg=631.29, stdev=220.06 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.37%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159378: Tue Jul 14 23:05:08 2026 read: IOPS=0, BW=1901KiB/s (1946kB/s)(4096KiB/2155msec) clat (nsec): min=1136.5M, max=1136.5M, avg=1136536865.00, stdev= 0.00 lat (nsec): min=1136.5M, max=1136.5M, avg=1136541540.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3801KiB/s (3893kB/s)(8192KiB/2155msec); 0 zone resets clat (msec): min=308, max=568, avg=438.62, stdev=184.20 lat (msec): min=308, max=569, avg=439.12, stdev=184.22 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 8192, max= 8192, per=53.88%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.82%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159379: Tue Jul 14 23:05:08 2026 write: IOPS=1, BW=5962KiB/s (6105kB/s)(12.0MiB/2061msec); 0 zone resets clat (msec): min=270, max=1005, avg=671.72, stdev=372.29 lat (msec): min=270, max=1006, avg=672.23, stdev=372.38 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8192, max= 8192, per=53.88%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.64%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159380: Tue Jul 14 23:05:08 2026 write: IOPS=1, BW=6946KiB/s (7113kB/s)(12.0MiB/1769msec); 0 zone resets clat (msec): min=358, max=695, avg=579.42, stdev=191.04 lat (msec): min=359, max=696, avg=579.67, stdev=190.97 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7198, max= 8078, per=50.23%, avg=7638.00, stdev=622.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=12.50%, ctx=267, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7603KiB/s (7785kB/s), 1901KiB/s-6228KiB/s (1946kB/s-6378kB/s), io=16.0MiB (16.8MB), run=1973-2155msec WRITE: bw=14.8MiB/s (15.6MB/s), 3801KiB/s-6946KiB/s (3893kB/s-7113kB/s), io=32.0MiB (33.6MB), run=1769-2155msec