== sanity test 398b: DIO and buffer IO race ============== 21:18:18 (1784942298) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.57211 s, 14.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178765: Fri Jul 24 21:19:52 2026 read: IOPS=18, BW=74.3KiB/s (76.1kB/s)(5992KiB/80630msec) clat (usec): min=35, max=618752, avg=29242.47, stdev=23665.26 lat (usec): min=36, max=618753, avg=29250.60, stdev=23665.75 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 8717], 10.00th=[ 11863], 20.00th=[ 15664], | 30.00th=[ 18482], 40.00th=[ 21627], 50.00th=[ 25560], 60.00th=[ 29492], | 70.00th=[ 33817], 80.00th=[ 39584], 90.00th=[ 50070], 95.00th=[ 62129], | 99.00th=[ 93848], 99.50th=[100140], 99.90th=[214959], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 16, max= 151, per=25.35%, avg=73.77, stdev=23.06, samples=159 iops : min= 4, max= 37, avg=17.84, stdev= 5.78, samples=159 write: IOPS=19, BW=78.1KiB/s (79.0kB/s)(6296KiB/80630msec); 0 zone resets clat (usec): min=700, max=147603, avg=23318.56, stdev=22533.76 lat (usec): min=700, max=147605, avg=23320.20, stdev=22533.72 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1500], 10.00th=[ 2073], 20.00th=[ 3359], | 30.00th=[ 6390], 40.00th=[ 12125], 50.00th=[ 17433], 60.00th=[ 22676], | 70.00th=[ 29492], 80.00th=[ 39584], 90.00th=[ 54264], 95.00th=[ 68682], | 99.00th=[100140], 99.50th=[104334], 99.90th=[137364], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 5, max= 143, per=25.40%, avg=77.47, stdev=26.90, samples=159 iops : min= 1, max= 35, avg=18.78, stdev= 6.76, samples=159 lat (usec) : 50=0.23%, 100=1.20%, 250=0.29%, 750=0.07%, 1000=0.10% lat (msec) : 2=4.82%, 4=6.84%, 10=8.07%, 20=23.34%, 50=43.78% lat (msec) : 100=10.55%, 250=0.68%, 750=0.03% cpu : usr=0.09%, sys=9.08%, ctx=7356, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178766: Fri Jul 24 21:19:52 2026 read: IOPS=18, BW=72.2KiB/s (73.9kB/s)(5940KiB/82325msec) clat (usec): min=32, max=611355, avg=30031.11, stdev=23304.94 lat (usec): min=33, max=611358, avg=30036.31, stdev=23309.04 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 8979], 10.00th=[ 11469], 20.00th=[ 15270], | 30.00th=[ 18744], 40.00th=[ 22414], 50.00th=[ 26346], 60.00th=[ 30540], | 70.00th=[ 35390], 80.00th=[ 42730], 90.00th=[ 53216], 95.00th=[ 62653], | 99.00th=[ 85459], 99.50th=[105382], 99.90th=[141558], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 5, max= 127, per=24.68%, avg=71.81, stdev=21.10, samples=163 iops : min= 1, max= 31, avg=17.35, stdev= 5.31, samples=163 write: IOPS=19, BW=77.1KiB/s (78.0kB/s)(6348KiB/82325msec); 0 zone resets clat (usec): min=783, max=197345, avg=23673.24, stdev=22500.78 lat (usec): min=784, max=197346, avg=23675.40, stdev=22500.63 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1401], 10.00th=[ 1991], 20.00th=[ 3818], | 30.00th=[ 7111], 40.00th=[ 13042], 50.00th=[ 17695], 60.00th=[ 23200], | 70.00th=[ 29754], 80.00th=[ 39584], 90.00th=[ 56361], 95.00th=[ 67634], | 99.00th=[ 87557], 99.50th=[119014], 99.90th=[145753], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 11, max= 191, per=25.18%, avg=76.80, stdev=30.00, samples=163 iops : min= 2, max= 47, avg=18.60, stdev= 7.52, samples=163 lat (usec) : 50=0.23%, 100=1.04%, 250=0.26%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=4.92%, 4=5.40%, 10=9.47%, 20=22.56%, 50=42.71% lat (msec) : 100=12.30%, 250=0.65%, 750=0.03% cpu : usr=0.10%, sys=8.98%, ctx=7387, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178767: Fri Jul 24 21:19:52 2026 read: IOPS=18, BW=74.3KiB/s (76.1kB/s)(6028KiB/81112msec) clat (usec): min=38, max=182458, avg=29193.52, stdev=18672.62 lat (usec): min=40, max=182459, avg=29194.88, stdev=18672.66 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 6849], 10.00th=[ 11600], 20.00th=[ 15401], | 30.00th=[ 18220], 40.00th=[ 21627], 50.00th=[ 25560], 60.00th=[ 29754], | 70.00th=[ 34866], 80.00th=[ 41157], 90.00th=[ 51119], 95.00th=[ 62653], | 99.00th=[ 94897], 99.50th=[106431], 99.90th=[145753], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 7, max= 160, per=25.56%, avg=74.38, stdev=24.79, samples=159 iops : min= 1, max= 40, avg=18.00, stdev= 6.23, samples=159 write: IOPS=19, BW=77.2KiB/s (79.0kB/s)(6260KiB/81112msec); 0 zone resets clat (usec): min=927, max=627317, avg=23647.00, stdev=26822.10 lat (usec): min=928, max=627320, avg=23648.89, stdev=26822.24 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1450], 10.00th=[ 1926], 20.00th=[ 3490], | 30.00th=[ 6325], 40.00th=[ 12518], 50.00th=[ 17695], 60.00th=[ 23725], | 70.00th=[ 29492], 80.00th=[ 39060], 90.00th=[ 54264], 95.00th=[ 64750], | 99.00th=[ 95945], 99.50th=[111674], 99.90th=[175113], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 11, max= 136, per=25.13%, avg=76.65, stdev=25.81, samples=160 iops : min= 2, max= 34, avg=18.56, stdev= 6.49, samples=160 lat (usec) : 50=0.26%, 100=1.46%, 250=0.26%, 1000=0.13% lat (msec) : 2=5.31%, 4=6.25%, 10=8.04%, 20=22.82%, 50=43.82% lat (msec) : 100=10.84%, 250=0.78%, 750=0.03% cpu : usr=0.10%, sys=9.12%, ctx=7244, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178768: Fri Jul 24 21:19:52 2026 read: IOPS=18, BW=74.3KiB/s (76.0kB/s)(6052KiB/81500msec) clat (usec): min=34, max=209049, avg=29524.25, stdev=18971.88 lat (usec): min=35, max=209050, avg=29528.55, stdev=18970.75 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 7308], 10.00th=[ 12125], 20.00th=[ 15795], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 25297], 60.00th=[ 29230], | 70.00th=[ 34341], 80.00th=[ 42206], 90.00th=[ 51643], 95.00th=[ 64226], | 99.00th=[ 89654], 99.50th=[101188], 99.90th=[164627], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 7, max= 127, per=25.59%, avg=74.48, stdev=21.98, samples=160 iops : min= 1, max= 31, avg=18.02, stdev= 5.53, samples=160 write: IOPS=19, BW=76.5KiB/s (78.4kB/s)(6236KiB/81500msec); 0 zone resets clat (usec): min=822, max=637727, avg=23560.90, stdev=26849.10 lat (usec): min=823, max=637728, avg=23564.60, stdev=26850.01 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1483], 10.00th=[ 2057], 20.00th=[ 3556], | 30.00th=[ 6521], 40.00th=[ 13042], 50.00th=[ 18220], 60.00th=[ 22938], | 70.00th=[ 29754], 80.00th=[ 39060], 90.00th=[ 52167], 95.00th=[ 65799], | 99.00th=[ 95945], 99.50th=[114820], 99.90th=[170918], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 5, max= 159, per=24.93%, avg=76.04, stdev=26.06, samples=161 iops : min= 1, max= 39, avg=18.41, stdev= 6.55, samples=161 lat (usec) : 50=0.46%, 100=1.30%, 250=0.33%, 750=0.03%, 1000=0.16% lat (msec) : 2=4.79%, 4=6.48%, 10=7.45%, 20=23.34%, 50=44.04% lat (msec) : 100=10.90%, 250=0.68%, 750=0.03% cpu : usr=0.10%, sys=9.11%, ctx=7292, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=292KiB/s (299kB/s), 72.2KiB/s-74.3KiB/s (73.9kB/s-76.1kB/s), io=23.4MiB (24.6MB), run=80630-82325msec WRITE: bw=305KiB/s (313kB/s), 76.5KiB/s-78.1KiB/s (78.4kB/s-79.0kB/s), io=24.6MiB (25.7MB), run=80630-82325msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178760: Fri Jul 24 21:20:15 2026 read: IOPS=14, BW=56.0KiB/s (58.3kB/s)(5992KiB/105173msec) clat (msec): min=4, max=696, avg=28.68, stdev=31.74 lat (msec): min=4, max=696, avg=28.69, stdev=31.74 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 64], 95.00th=[ 83], | 99.00th=[ 140], 99.50th=[ 165], 99.90th=[ 194], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 199, per=25.02%, avg=57.05, stdev=38.44, samples=207 iops : min= 1, max= 49, avg=13.70, stdev= 9.66, samples=207 write: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6296KiB/105173msec); 0 zone resets clat (msec): min=7, max=207, avg=39.35, stdev=27.45 lat (msec): min=7, max=207, avg=39.35, stdev=27.45 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 79], 95.00th=[ 96], | 99.00th=[ 127], 99.50th=[ 144], 99.90th=[ 169], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 7, max= 184, per=24.97%, avg=59.67, stdev=38.29, samples=208 iops : min= 1, max= 46, avg=14.35, stdev= 9.64, samples=208 lat (msec) : 10=9.93%, 20=30.44%, 50=38.54%, 100=17.48%, 250=3.58% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=3.80%, ctx=5141, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178761: Fri Jul 24 21:20:15 2026 read: IOPS=14, BW=56.7KiB/s (58.1kB/s)(5940KiB/104700msec) clat (msec): min=4, max=691, avg=28.83, stdev=31.89 lat (msec): min=4, max=691, avg=28.83, stdev=31.89 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 64], 95.00th=[ 90], | 99.00th=[ 126], 99.50th=[ 155], 99.90th=[ 199], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 183, per=25.03%, avg=57.07, stdev=38.03, samples=205 iops : min= 1, max= 45, avg=13.70, stdev= 9.56, samples=205 write: IOPS=15, BW=60.6KiB/s (62.1kB/s)(6348KiB/104700msec); 0 zone resets clat (msec): min=6, max=204, avg=38.82, stdev=27.15 lat (msec): min=6, max=204, avg=38.82, stdev=27.15 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 77], 95.00th=[ 93], | 99.00th=[ 138], 99.50th=[ 157], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 15, max= 196, per=25.40%, avg=60.71, stdev=37.24, samples=206 iops : min= 3, max= 49, avg=14.61, stdev= 9.37, samples=206 lat (msec) : 10=9.15%, 20=31.58%, 50=37.89%, 100=18.13%, 250=3.22% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=3.77%, ctx=5165, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178762: Fri Jul 24 21:20:15 2026 read: IOPS=14, BW=57.8KiB/s (59.2kB/s)(6028KiB/104240msec) clat (msec): min=4, max=193, avg=27.85, stdev=24.77 lat (msec): min=4, max=193, avg=27.85, stdev=24.77 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 61], 95.00th=[ 82], | 99.00th=[ 116], 99.50th=[ 136], 99.90th=[ 169], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 7, max= 199, per=25.28%, avg=57.64, stdev=37.37, samples=206 iops : min= 1, max= 49, avg=13.83, stdev= 9.39, samples=206 write: IOPS=15, BW=60.1KiB/s (61.5kB/s)(6260KiB/104240msec); 0 zone resets clat (msec): min=8, max=706, avg=39.62, stdev=31.54 lat (msec): min=8, max=706, avg=39.62, stdev=31.54 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 77], 95.00th=[ 93], | 99.00th=[ 132], 99.50th=[ 153], 99.90th=[ 207], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 167, per=25.14%, avg=60.08, stdev=36.52, samples=205 iops : min= 1, max= 41, avg=14.45, stdev= 9.18, samples=205 lat (msec) : 10=9.21%, 20=30.40%, 50=39.29%, 100=18.23%, 250=2.83% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=3.80%, ctx=5123, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178763: Fri Jul 24 21:20:15 2026 read: IOPS=14, BW=58.0KiB/s (59.4kB/s)(6052KiB/104265msec) clat (msec): min=4, max=178, avg=27.58, stdev=24.67 lat (msec): min=4, max=178, avg=27.58, stdev=24.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 61], 95.00th=[ 81], | 99.00th=[ 125], 99.50th=[ 140], 99.90th=[ 174], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 7, max= 192, per=25.59%, avg=58.34, stdev=37.20, samples=204 iops : min= 1, max= 48, avg=14.01, stdev= 9.36, samples=204 write: IOPS=14, BW=59.8KiB/s (61.2kB/s)(6236KiB/104265msec); 0 zone resets clat (msec): min=7, max=702, avg=39.94, stdev=32.09 lat (msec): min=7, max=702, avg=39.94, stdev=32.10 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 60], 90.00th=[ 79], 95.00th=[ 95], | 99.00th=[ 131], 99.50th=[ 144], 99.90th=[ 207], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8, max= 173, per=25.01%, avg=59.77, stdev=36.74, samples=205 iops : min= 2, max= 43, avg=14.38, stdev= 9.23, samples=205 lat (msec) : 10=10.19%, 20=29.88%, 50=39.65%, 100=17.09%, 250=3.16% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=3.88%, ctx=5167, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=228KiB/s (234kB/s), 56.7KiB/s-58.0KiB/s (58.1kB/s-59.4kB/s), io=23.4MiB (24.6MB), run=104240-105173msec WRITE: bw=239KiB/s (245kB/s), 59.8KiB/s-60.6KiB/s (61.2kB/s-62.1kB/s), io=24.6MiB (25.7MB), run=104240-105173msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178800: Fri Jul 24 21:20:39 2026 read: IOPS=20, BW=327KiB/s (335kB/s)(5920KiB/18118msec) clat (usec): min=37, max=125001, avg=26591.24, stdev=16706.67 lat (usec): min=38, max=125003, avg=26592.24, stdev=16706.72 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 8029], 20.00th=[ 13829], | 30.00th=[ 17957], 40.00th=[ 21103], 50.00th=[ 24511], 60.00th=[ 27919], | 70.00th=[ 33162], 80.00th=[ 38536], 90.00th=[ 47973], 95.00th=[ 54264], | 99.00th=[ 81265], 99.50th=[ 99091], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 190, max= 542, per=25.82%, avg=320.23, stdev=95.72, samples=35 iops : min= 11, max= 33, avg=19.43, stdev= 6.01, samples=35 write: IOPS=21, BW=351KiB/s (360kB/s)(6368KiB/18118msec); 0 zone resets clat (usec): min=1178, max=95692, avg=20695.82, stdev=17663.95 lat (usec): min=1179, max=95696, avg=20697.69, stdev=17664.02 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2245], 10.00th=[ 3130], 20.00th=[ 4686], | 30.00th=[ 8029], 40.00th=[11731], 50.00th=[16057], 60.00th=[20055], | 70.00th=[26346], 80.00th=[34866], 90.00th=[45351], 95.00th=[55837], | 99.00th=[82314], 99.50th=[86508], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 96, max= 576, per=26.68%, avg=348.23, stdev=111.96, samples=35 iops : min= 6, max= 36, avg=21.17, stdev= 7.06, samples=35 lat (usec) : 50=0.39%, 100=3.26%, 250=0.39%, 500=0.26% lat (msec) : 2=1.56%, 4=6.38%, 10=11.98%, 20=24.61%, 50=44.01% lat (msec) : 100=7.03%, 250=0.13% cpu : usr=0.09%, sys=12.83%, ctx=2019, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178801: Fri Jul 24 21:20:39 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(5744KiB/19014msec) clat (usec): min=45, max=119851, avg=26992.76, stdev=18492.80 lat (usec): min=45, max=119853, avg=26993.88, stdev=18492.81 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 77], 10.00th=[ 318], 20.00th=[ 14615], | 30.00th=[ 17433], 40.00th=[ 20579], 50.00th=[ 24249], 60.00th=[ 28443], | 70.00th=[ 33162], 80.00th=[ 39060], 90.00th=[ 46400], 95.00th=[ 58459], | 99.00th=[ 90702], 99.50th=[109577], 99.90th=[120062], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 127, max= 479, per=24.28%, avg=301.11, stdev=86.88, samples=37 iops : min= 7, max= 29, avg=18.22, stdev= 5.43, samples=37 write: IOPS=21, BW=344KiB/s (352kB/s)(6544KiB/19014msec); 0 zone resets clat (usec): min=1490, max=120794, avg=22579.09, stdev=20792.67 lat (usec): min=1491, max=120796, avg=22581.45, stdev=20792.40 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2409], 10.00th=[ 3195], 20.00th=[ 4948], | 30.00th=[ 7373], 40.00th=[ 11863], 50.00th=[ 16909], 60.00th=[ 22676], | 70.00th=[ 27919], 80.00th=[ 35914], 90.00th=[ 50070], 95.00th=[ 62653], | 99.00th=[ 91751], 99.50th=[100140], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 127, max= 787, per=26.29%, avg=343.08, stdev=134.73, samples=37 iops : min= 7, max= 49, avg=20.84, stdev= 8.41, samples=37 lat (usec) : 50=0.26%, 100=2.86%, 250=1.43%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.56%, 4=5.60%, 10=12.89%, 20=22.27%, 50=43.88% lat (msec) : 100=8.46%, 250=0.52% cpu : usr=0.09%, sys=12.37%, ctx=2008, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178802: Fri Jul 24 21:20:39 2026 read: IOPS=20, BW=324KiB/s (332kB/s)(6256KiB/19306msec) clat (usec): min=35, max=134412, avg=27911.93, stdev=18559.18 lat (usec): min=35, max=134415, avg=27913.02, stdev=18559.28 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 79], 10.00th=[ 3294], 20.00th=[ 14615], | 30.00th=[ 17957], 40.00th=[ 21103], 50.00th=[ 25297], 60.00th=[ 29230], | 70.00th=[ 34866], 80.00th=[ 41681], 90.00th=[ 51643], 95.00th=[ 60031], | 99.00th=[ 86508], 99.50th=[110625], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 159, max= 540, per=26.19%, avg=324.76, stdev=93.47, samples=38 iops : min= 9, max= 33, avg=19.71, stdev= 5.84, samples=38 write: IOPS=19, BW=312KiB/s (320kB/s)(6032KiB/19306msec); 0 zone resets clat (usec): min=1372, max=121092, avg=22017.71, stdev=19748.85 lat (usec): min=1373, max=121094, avg=22019.81, stdev=19748.93 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2008], 10.00th=[ 3097], 20.00th=[ 5276], | 30.00th=[ 9110], 40.00th=[ 12256], 50.00th=[ 16319], 60.00th=[ 21103], | 70.00th=[ 27657], 80.00th=[ 36439], 90.00th=[ 49546], 95.00th=[ 60031], | 99.00th=[100140], 99.50th=[108528], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 127, max= 629, per=23.69%, avg=309.18, stdev=125.89, samples=38 iops : min= 7, max= 39, avg=18.74, stdev= 7.94, samples=38 lat (usec) : 50=0.39%, 100=3.39%, 250=1.04%, 500=0.26% lat (msec) : 2=2.34%, 4=4.82%, 10=10.03%, 20=25.00%, 50=42.71% lat (msec) : 100=9.38%, 250=0.65% cpu : usr=0.12%, sys=12.01%, ctx=2062, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178803: Fri Jul 24 21:20:39 2026 read: IOPS=20, BW=323KiB/s (331kB/s)(6032KiB/18655msec) clat (usec): min=45, max=158702, avg=27488.90, stdev=18606.16 lat (usec): min=45, max=158704, avg=27489.98, stdev=18606.21 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 88], 10.00th=[ 143], 20.00th=[ 14484], | 30.00th=[ 18220], 40.00th=[ 21365], 50.00th=[ 25035], 60.00th=[ 28705], | 70.00th=[ 34341], 80.00th=[ 40633], 90.00th=[ 51643], 95.00th=[ 60556], | 99.00th=[ 74974], 99.50th=[ 84411], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 159, max= 535, per=25.56%, avg=317.00, stdev=93.93, samples=36 iops : min= 9, max= 33, avg=19.22, stdev= 5.86, samples=36 write: IOPS=20, BW=335KiB/s (343kB/s)(6256KiB/18655msec); 0 zone resets clat (usec): min=1279, max=120293, avg=20982.09, stdev=19363.94 lat (usec): min=1281, max=120295, avg=20985.65, stdev=19363.89 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2147], 10.00th=[ 3425], 20.00th=[ 5014], | 30.00th=[ 7111], 40.00th=[ 10814], 50.00th=[ 15664], 60.00th=[ 21103], | 70.00th=[ 25560], 80.00th=[ 34341], 90.00th=[ 49021], 95.00th=[ 62129], | 99.00th=[ 90702], 99.50th=[107480], 99.90th=[120062], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 191, max= 638, per=25.34%, avg=330.64, stdev=100.83, samples=36 iops : min= 11, max= 39, avg=20.06, stdev= 6.28, samples=36 lat (usec) : 50=0.26%, 100=3.39%, 250=1.69%, 500=0.26% lat (msec) : 2=1.95%, 4=5.08%, 10=13.28%, 20=21.88%, 50=41.80% lat (msec) : 100=10.03%, 250=0.39% cpu : usr=0.11%, sys=12.57%, ctx=1952, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1241KiB/s (1270kB/s), 302KiB/s-327KiB/s (309kB/s-335kB/s), io=23.4MiB (24.5MB), run=18118-19306msec WRITE: bw=1305KiB/s (1337kB/s), 312KiB/s-351KiB/s (320kB/s-360kB/s), io=24.6MiB (25.8MB), run=18118-19306msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178805: Fri Jul 24 21:20:44 2026 read: IOPS=15, BW=244KiB/s (249kB/s)(5920KiB/24298msec) clat (msec): min=4, max=130, avg=26.47, stdev=23.00 lat (msec): min=4, max=130, avg=26.47, stdev=23.01 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 60], 95.00th=[ 80], | 99.00th=[ 115], 99.50th=[ 122], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 63, max= 768, per=24.47%, avg=240.75, stdev=158.78, samples=48 iops : min= 3, max= 48, avg=14.40, stdev=10.09, samples=48 write: IOPS=16, BW=262KiB/s (268kB/s)(6368KiB/24298msec); 0 zone resets clat (msec): min=7, max=196, avg=36.36, stdev=25.70 lat (msec): min=7, max=196, avg=36.36, stdev=25.70 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 73], 95.00th=[ 85], | 99.00th=[ 110], 99.50th=[ 174], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 63, max= 672, per=25.18%, avg=260.65, stdev=160.76, samples=48 iops : min= 3, max= 42, avg=15.65, stdev=10.24, samples=48 lat (msec) : 10=9.51%, 20=33.33%, 50=38.28%, 100=16.80%, 250=2.08% cpu : usr=0.07%, sys=5.26%, ctx=1454, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178806: Fri Jul 24 21:20:44 2026 read: IOPS=14, BW=237KiB/s (243kB/s)(5744KiB/24199msec) clat (msec): min=4, max=129, avg=26.49, stdev=23.71 lat (msec): min=4, max=129, avg=26.49, stdev=23.71 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 37], 90.00th=[ 64], 95.00th=[ 82], | 99.00th=[ 117], 99.50th=[ 128], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 62, max= 928, per=24.59%, avg=241.94, stdev=169.88, samples=47 iops : min= 3, max= 58, avg=14.47, stdev=10.81, samples=47 write: IOPS=16, BW=270KiB/s (277kB/s)(6544KiB/24199msec); 0 zone resets clat (msec): min=5, max=137, avg=35.79, stdev=24.84 lat (msec): min=5, max=137, avg=35.79, stdev=24.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 72], 95.00th=[ 84], | 99.00th=[ 116], 99.50th=[ 128], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 95, max= 704, per=26.08%, avg=269.92, stdev=167.21, samples=48 iops : min= 5, max= 44, avg=16.23, stdev=10.63, samples=48 lat (msec) : 10=10.81%, 20=33.72%, 50=36.46%, 100=16.80%, 250=2.21% cpu : usr=0.08%, sys=5.35%, ctx=1387, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178807: Fri Jul 24 21:20:44 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(6256KiB/24328msec) clat (msec): min=4, max=121, avg=26.62, stdev=22.67 lat (msec): min=4, max=121, avg=26.62, stdev=22.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 43], 90.00th=[ 60], 95.00th=[ 77], | 99.00th=[ 105], 99.50th=[ 110], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 63, max= 832, per=25.96%, avg=255.42, stdev=182.03, samples=48 iops : min= 3, max= 52, avg=15.31, stdev=11.55, samples=48 write: IOPS=15, BW=248KiB/s (254kB/s)(6032KiB/24328msec); 0 zone resets clat (msec): min=7, max=189, avg=36.85, stdev=25.46 lat (msec): min=7, max=189, avg=36.85, stdev=25.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 71], 95.00th=[ 88], | 99.00th=[ 110], 99.50th=[ 124], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 64, max= 768, per=23.46%, avg=242.81, stdev=153.20, samples=48 iops : min= 4, max= 48, avg=14.52, stdev= 9.76, samples=48 lat (msec) : 10=12.24%, 20=32.42%, 50=34.77%, 100=18.49%, 250=2.08% cpu : usr=0.06%, sys=5.16%, ctx=1395, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178808: Fri Jul 24 21:20:44 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(6032KiB/24194msec) clat (msec): min=3, max=145, avg=28.35, stdev=25.15 lat (msec): min=3, max=145, avg=28.35, stdev=25.15 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 43], 90.00th=[ 68], 95.00th=[ 81], | 99.00th=[ 120], 99.50th=[ 131], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 63, max= 640, per=25.15%, avg=247.48, stdev=156.38, samples=48 iops : min= 3, max= 40, avg=14.81, stdev= 9.99, samples=48 write: IOPS=16, BW=259KiB/s (265kB/s)(6256KiB/24194msec); 0 zone resets clat (msec): min=7, max=174, avg=34.44, stdev=25.17 lat (msec): min=7, max=174, avg=34.44, stdev=25.17 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 70], 95.00th=[ 89], | 99.00th=[ 122], 99.50th=[ 130], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 63, max= 832, per=25.06%, avg=259.35, stdev=171.20, samples=48 iops : min= 3, max= 52, avg=15.56, stdev=10.87, samples=48 lat (msec) : 4=0.13%, 10=11.20%, 20=32.42%, 50=37.11%, 100=16.80% lat (msec) : 250=2.34% cpu : usr=0.08%, sys=5.33%, ctx=1447, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=985KiB/s (1008kB/s), 237KiB/s-257KiB/s (243kB/s-263kB/s), io=23.4MiB (24.5MB), run=24194-24328msec WRITE: bw=1036KiB/s (1061kB/s), 248KiB/s-270KiB/s (254kB/s-277kB/s), io=24.6MiB (25.8MB), run=24194-24328msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178816: Fri Jul 24 21:20:53 2026 read: IOPS=2, BW=2668KiB/s (2732kB/s)(7168KiB/2687msec) clat (usec): min=539, max=924810, avg=245015.42, stdev=307289.30 lat (usec): min=540, max=924811, avg=245016.67, stdev=307289.37 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[109577], | 30.00th=[137364], 40.00th=[137364], 50.00th=[139461], 60.00th=[198181], | 70.00th=[198181], 80.00th=[204473], 90.00th=[926942], 95.00th=[926942], | 99.00th=[926942], 99.50th=[926942], 99.90th=[926942], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 2043, max= 4079, per=58.44%, avg=3023.25, stdev=1130.81, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1905KiB/s (1951kB/s)(5120KiB/2687msec); 0 zone resets clat (msec): min=62, max=293, avg=187.33, stdev=82.54 lat (msec): min=62, max=294, avg=187.59, stdev=82.82 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2039, max= 4096, per=37.64%, avg=2726.00, stdev=1186.46, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=31.24%, ctx=614, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178817: Fri Jul 24 21:20:53 2026 read: IOPS=0, BW=517KiB/s (530kB/s)(2048KiB/3959msec) clat (usec): min=1690, max=136159, avg=68924.80, stdev=95083.81 lat (usec): min=1691, max=136162, avg=68927.07, stdev=95084.82 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1696], 10.00th=[ 1696], 20.00th=[ 1696], | 30.00th=[ 1696], 40.00th=[ 1696], 50.00th=[ 1696], 60.00th=[135267], | 70.00th=[135267], 80.00th=[135267], 90.00th=[135267], 95.00th=[135267], | 99.00th=[135267], 99.50th=[135267], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 1868, max= 2043, per=37.80%, avg=1955.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2587KiB/s (2649kB/s)(10.0MiB/3959msec); 0 zone resets clat (msec): min=71, max=1621, avg=380.38, stdev=484.52 lat (msec): min=71, max=1621, avg=380.46, stdev=484.52 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 75], | 30.00th=[ 91], 40.00th=[ 97], 50.00th=[ 114], 60.00th=[ 236], | 70.00th=[ 264], 80.00th=[ 592], 90.00th=[ 642], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 2043, max= 8192, per=65.63%, avg=4752.67, stdev=3138.77, samples=3 iops : min= 1, max= 8, avg= 4.00, stdev= 3.61, samples=3 lat (msec) : 2=8.33%, 100=33.33%, 250=25.00%, 500=8.33%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=18.12%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178818: Fri Jul 24 21:20:53 2026 read: IOPS=1, BW=1920KiB/s (1966kB/s)(6144KiB/3200msec) clat (usec): min=530, max=170808, avg=54760.12, stdev=83682.16 lat (usec): min=531, max=170808, avg=54761.30, stdev=83682.02 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 1549], | 70.00th=[154141], 80.00th=[154141], 90.00th=[170918], 95.00th=[170918], | 99.00th=[170918], 99.50th=[170918], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 4087, max= 4096, per=79.09%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1920KiB/s (1966kB/s)(6144KiB/3200msec); 0 zone resets clat (msec): min=95, max=1453, avg=467.97, stdev=511.06 lat (msec): min=95, max=1453, avg=468.04, stdev=511.11 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 334], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1882, max= 2048, per=27.69%, avg=2005.25, stdev=82.20, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 750=25.00% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=8.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=22.35%, ctx=130, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178819: Fri Jul 24 21:20:53 2026 read: IOPS=1, BW=1763KiB/s (1805kB/s)(5120KiB/2904msec) clat (usec): min=734, max=184641, avg=131102.38, stdev=74006.70 lat (usec): min=735, max=184642, avg=131103.68, stdev=74006.70 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 734], | 30.00th=[152044], 40.00th=[152044], 50.00th=[154141], 60.00th=[154141], | 70.00th=[164627], 80.00th=[164627], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2468KiB/s (2528kB/s)(7168KiB/2904msec); 0 zone resets clat (msec): min=73, max=1187, avg=315.76, stdev=389.66 lat (msec): min=73, max=1187, avg=315.84, stdev=389.67 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 132], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 174], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 262], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1969, max= 4087, per=35.01%, avg=2535.75, stdev=1034.77, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=27.94%, ctx=221, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5173KiB/s (5297kB/s), 517KiB/s-2668KiB/s (530kB/s-2732kB/s), io=20.0MiB (20.0MB), run=2687-3959msec WRITE: bw=7242KiB/s (7416kB/s), 1905KiB/s-2587KiB/s (1951kB/s-2649kB/s), io=28.0MiB (29.4MB), run=2687-3959msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178821: Fri Jul 24 21:20:54 2026 read: IOPS=1, BW=1849KiB/s (1894kB/s)(7168KiB/3876msec) clat (msec): min=61, max=1276, avg=360.21, stdev=463.94 lat (msec): min=61, max=1276, avg=360.21, stdev=463.94 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 68], | 30.00th=[ 99], 40.00th=[ 99], 50.00th=[ 142], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 709], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1372, max= 4079, per=54.98%, avg=2839.50, stdev=1338.40, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1321KiB/s (1353kB/s)(5120KiB/3876msec); 0 zone resets clat (msec): min=73, max=544, avg=266.13, stdev=193.75 lat (msec): min=74, max=544, avg=266.21, stdev=193.73 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2019, max= 4079, per=37.53%, avg=2713.67, stdev=1182.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=9.96%, ctx=129, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178822: Fri Jul 24 21:20:54 2026 read: IOPS=0, BW=517KiB/s (530kB/s)(2048KiB/3960msec) clat (msec): min=190, max=238, avg=214.43, stdev=33.62 lat (msec): min=190, max=238, avg=214.43, stdev=33.62 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 1398, max= 2048, per=33.36%, avg=1723.00, stdev=459.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2586KiB/s (2648kB/s)(10.0MiB/3960msec); 0 zone resets clat (msec): min=79, max=833, avg=351.60, stdev=258.34 lat (msec): min=79, max=833, avg=351.74, stdev=258.32 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 107], | 30.00th=[ 174], 40.00th=[ 199], 50.00th=[ 264], 60.00th=[ 279], | 70.00th=[ 317], 80.00th=[ 592], 90.00th=[ 684], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2019, max= 4087, per=37.09%, avg=2682.00, stdev=1004.46, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=11.90%, ctx=131, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178823: Fri Jul 24 21:20:54 2026 read: IOPS=1, BW=1550KiB/s (1587kB/s)(6144KiB/3965msec) clat (msec): min=69, max=170, avg=112.15, stdev=41.23 lat (msec): min=69, max=170, avg=112.15, stdev=41.23 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 105], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 171], 95.00th=[ 171], | 99.00th=[ 171], 99.50th=[ 171], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 4079, max= 4087, per=79.05%, avg=4083.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1550KiB/s (1587kB/s)(6144KiB/3965msec); 0 zone resets clat (msec): min=74, max=1554, avg=542.61, stdev=552.56 lat (msec): min=74, max=1554, avg=542.69, stdev=552.57 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 330], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 2035, max= 2043, per=28.20%, avg=2039.00, stdev= 3.27, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=9.21%, ctx=121, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178824: Fri Jul 24 21:20:54 2026 read: IOPS=1, BW=1293KiB/s (1324kB/s)(5120KiB/3961msec) clat (msec): min=59, max=470, avg=214.10, stdev=186.61 lat (msec): min=59, max=470, avg=214.10, stdev=186.61 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 104], 60.00th=[ 104], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2043, max= 4079, per=52.73%, avg=2723.33, stdev=1174.04, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1810KiB/s (1853kB/s)(7168KiB/3961msec); 0 zone resets clat (msec): min=62, max=1283, avg=408.30, stdev=412.59 lat (msec): min=63, max=1283, avg=408.39, stdev=412.60 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 117], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 271], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 485], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1943, max= 4087, per=37.21%, avg=2691.00, stdev=1210.00, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=7.83%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5165KiB/s (5289kB/s), 517KiB/s-1849KiB/s (530kB/s-1894kB/s), io=20.0MiB (20.0MB), run=3876-3965msec WRITE: bw=7231KiB/s (7405kB/s), 1321KiB/s-2586KiB/s (1353kB/s-2648kB/s), io=28.0MiB (29.4MB), run=3876-3965msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178830: Fri Jul 24 21:21:04 2026 read: IOPS=1, BW=4119KiB/s (4218kB/s)(12.0MiB/2983msec) clat (msec): min=423, max=2034, avg=976.01, stdev=916.73 lat (msec): min=423, max=2034, avg=976.01, stdev=916.73 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 5680, max= 8192, per=100.00%, avg=6936.00, stdev=1776.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=14.76%, ctx=733, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178831: Fri Jul 24 21:21:04 2026 read: IOPS=0, BW=1095KiB/s (1122kB/s)(4096KiB/3739msec) clat (nsec): min=2513.9M, max=2513.9M, avg=2513887157.00, stdev= 0.00 lat (nsec): min=2513.9M, max=2513.9M, avg=2513890524.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2500], 5.00th=[ 2500], 10.00th=[ 2500], 20.00th=[ 2500], | 30.00th=[ 2500], 40.00th=[ 2500], 50.00th=[ 2500], 60.00th=[ 2500], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2191KiB/s (2244kB/s)(8192KiB/3739msec); 0 zone resets clat (msec): min=502, max=630, avg=566.40, stdev=91.06 lat (msec): min=502, max=631, avg=566.79, stdev=91.13 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=8.80%, ctx=651, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178833: Fri Jul 24 21:21:04 2026 write: IOPS=0, BW=3000KiB/s (3072kB/s)(12.0MiB/4096msec); 0 zone resets clat (msec): min=250, max=3224, avg=1358.20, stdev=1625.89 lat (msec): min=251, max=3225, avg=1358.65, stdev=1625.94 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.59%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178834: Fri Jul 24 21:21:04 2026 write: IOPS=0, BW=3418KiB/s (3500kB/s)(12.0MiB/3595msec); 0 zone resets clat (msec): min=192, max=2860, avg=1173.22, stdev=1467.57 lat (msec): min=192, max=2860, avg=1173.55, stdev=1467.55 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.18%, ctx=83, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4382KiB/s (4487kB/s), 1095KiB/s-4119KiB/s (1122kB/s-4218kB/s), io=16.0MiB (16.8MB), run=2983-3739msec WRITE: bw=8000KiB/s (8192kB/s), 2191KiB/s-3418KiB/s (2244kB/s-3500kB/s), io=32.0MiB (33.6MB), run=3595-4096msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178835: Fri Jul 24 21:21:04 2026 read: IOPS=0, BW=3151KiB/s (3226kB/s)(12.0MiB/3900msec) clat (msec): min=351, max=2999, avg=1271.21, stdev=1497.97 lat (msec): min=351, max=2999, avg=1271.21, stdev=1497.97 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 8078, max= 8126, per=100.00%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.13%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178836: Fri Jul 24 21:21:04 2026 read: IOPS=0, BW=1012KiB/s (1036kB/s)(4096KiB/4049msec) clat (nsec): min=2856.8M, max=2856.8M, avg=2856834781.00, stdev= 0.00 lat (nsec): min=2856.8M, max=2856.8M, avg=2856837325.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2869], 5.00th=[ 2869], 10.00th=[ 2869], 20.00th=[ 2869], | 30.00th=[ 2869], 40.00th=[ 2869], 50.00th=[ 2869], 60.00th=[ 2869], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2023KiB/s (2072kB/s)(8192KiB/4049msec); 0 zone resets clat (msec): min=492, max=613, avg=553.27, stdev=85.29 lat (msec): min=493, max=615, avg=554.41, stdev=86.41 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.33%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178837: Fri Jul 24 21:21:04 2026 write: IOPS=0, BW=3347KiB/s (3428kB/s)(12.0MiB/3671msec); 0 zone resets clat (msec): min=223, max=2708, avg=1217.05, stdev=1315.19 lat (msec): min=223, max=2710, avg=1217.80, stdev=1315.88 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min=16157, max=16157, per=100.00%, avg=16157.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=5.34%, ctx=187, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178838: Fri Jul 24 21:21:04 2026 write: IOPS=0, BW=3515KiB/s (3599kB/s)(12.0MiB/3496msec); 0 zone resets clat (msec): min=184, max=2466, avg=1156.22, stdev=1178.32 lat (msec): min=185, max=2467, avg=1156.75, stdev=1178.53 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.18%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4046KiB/s (4144kB/s), 1012KiB/s-3151KiB/s (1036kB/s-3226kB/s), io=16.0MiB (16.8MB), run=3900-4049msec WRITE: bw=8093KiB/s (8287kB/s), 2023KiB/s-3515KiB/s (2072kB/s-3599kB/s), io=32.0MiB (33.6MB), run=3496-4049msec