== sanity test 398b: DIO and buffer IO race ============== 01:50:48 (1781243448) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.29184 s, 11.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180083: Fri Jun 12 01:52:31 2026 read: IOPS=16, BW=67.3KiB/s (68.0kB/s)(5992KiB/88974msec) clat (usec): min=40, max=280778, avg=33017.26, stdev=20435.42 lat (usec): min=41, max=280779, avg=33019.86, stdev=20435.58 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10290], 10.00th=[ 13566], 20.00th=[ 17957], | 30.00th=[ 21627], 40.00th=[ 25560], 50.00th=[ 28967], 60.00th=[ 33424], | 70.00th=[ 39060], 80.00th=[ 45876], 90.00th=[ 56886], 95.00th=[ 68682], | 99.00th=[105382], 99.50th=[113771], 99.90th=[166724], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 15, max= 127, per=24.92%, avg=66.77, stdev=20.14, samples=176 iops : min= 3, max= 31, avg=16.09, stdev= 5.05, samples=176 write: IOPS=17, BW=70.8KiB/s (72.5kB/s)(6296KiB/88974msec); 0 zone resets clat (usec): min=947, max=154280, avg=25018.70, stdev=24000.19 lat (usec): min=949, max=154281, avg=25022.30, stdev=23999.91 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1614], 10.00th=[ 2114], 20.00th=[ 3916], | 30.00th=[ 6849], 40.00th=[ 13435], 50.00th=[ 19006], 60.00th=[ 24249], | 70.00th=[ 31851], 80.00th=[ 42206], 90.00th=[ 59507], 95.00th=[ 72877], | 99.00th=[103285], 99.50th=[117965], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 7, max= 174, per=24.96%, avg=70.14, stdev=26.87, samples=176 iops : min= 1, max= 43, avg=16.94, stdev= 6.74, samples=176 lat (usec) : 50=0.26%, 100=1.11%, 250=0.26%, 1000=0.03% lat (msec) : 2=4.69%, 4=5.76%, 10=8.14%, 20=18.72%, 50=46.32% lat (msec) : 100=13.51%, 250=1.17%, 500=0.03% cpu : usr=0.11%, sys=8.46%, ctx=7389, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180084: Fri Jun 12 01:52:31 2026 read: IOPS=16, BW=66.4KiB/s (68.0kB/s)(5940KiB/89410msec) clat (usec): min=40, max=289938, avg=33221.35, stdev=20505.66 lat (usec): min=41, max=289942, avg=33227.09, stdev=20506.99 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11207], 10.00th=[ 13566], 20.00th=[ 17957], | 30.00th=[ 21365], 40.00th=[ 24773], 50.00th=[ 28967], 60.00th=[ 33817], | 70.00th=[ 39060], 80.00th=[ 45876], 90.00th=[ 57934], 95.00th=[ 68682], | 99.00th=[102237], 99.50th=[110625], 99.90th=[166724], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 127, per=24.74%, avg=66.30, stdev=21.04, samples=176 iops : min= 1, max= 31, avg=15.97, stdev= 5.27, samples=176 write: IOPS=17, BW=70.0KiB/s (72.7kB/s)(6348KiB/89410msec); 0 zone resets clat (usec): min=920, max=170122, avg=25169.68, stdev=24148.71 lat (usec): min=921, max=170124, avg=25171.64, stdev=24148.77 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1598], 10.00th=[ 2147], 20.00th=[ 4015], | 30.00th=[ 7767], 40.00th=[ 14222], 50.00th=[ 19006], 60.00th=[ 24511], | 70.00th=[ 32113], 80.00th=[ 41681], 90.00th=[ 58459], 95.00th=[ 72877], | 99.00th=[109577], 99.50th=[124257], 99.90th=[145753], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 7, max= 159, per=25.00%, avg=70.24, stdev=25.92, samples=177 iops : min= 1, max= 39, avg=16.97, stdev= 6.52, samples=177 lat (usec) : 50=0.20%, 100=0.98%, 250=0.13%, 1000=0.03% lat (msec) : 2=4.33%, 4=5.96%, 10=7.88%, 20=19.79%, 50=45.87% lat (msec) : 100=13.57%, 250=1.24%, 500=0.03% cpu : usr=0.11%, sys=8.50%, ctx=7436, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180085: Fri Jun 12 01:52:31 2026 read: IOPS=16, BW=67.6KiB/s (69.3kB/s)(6028KiB/89110msec) clat (usec): min=22, max=170431, avg=31715.04, stdev=18579.74 lat (usec): min=22, max=170433, avg=31719.48, stdev=18580.02 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 9896], 10.00th=[ 13173], 20.00th=[ 17433], | 30.00th=[ 20841], 40.00th=[ 23987], 50.00th=[ 28705], 60.00th=[ 32900], | 70.00th=[ 37487], 80.00th=[ 43779], 90.00th=[ 55313], 95.00th=[ 64750], | 99.00th=[ 87557], 99.50th=[100140], 99.90th=[149947], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 14, max= 144, per=24.97%, avg=66.93, stdev=22.80, samples=176 iops : min= 3, max= 36, avg=16.14, stdev= 5.74, samples=176 write: IOPS=17, BW=70.2KiB/s (71.9kB/s)(6260KiB/89110msec); 0 zone resets clat (usec): min=922, max=308173, avg=26308.73, stdev=25275.09 lat (usec): min=924, max=308175, avg=26315.23, stdev=25273.71 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1680], 10.00th=[ 2540], 20.00th=[ 4424], | 30.00th=[ 7701], 40.00th=[ 14615], 50.00th=[ 20317], 60.00th=[ 26608], | 70.00th=[ 34341], 80.00th=[ 43779], 90.00th=[ 58459], 95.00th=[ 70779], | 99.00th=[ 99091], 99.50th=[137364], 99.90th=[185598], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 23, max= 119, per=24.75%, avg=69.53, stdev=22.20, samples=176 iops : min= 5, max= 29, avg=16.78, stdev= 5.56, samples=176 lat (usec) : 50=0.20%, 100=1.07%, 250=0.39%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=3.55%, 4=5.63%, 10=8.82%, 20=18.82%, 50=46.16% lat (msec) : 100=14.49%, 250=0.72%, 500=0.03% cpu : usr=0.11%, sys=8.42%, ctx=7390, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180086: Fri Jun 12 01:52:31 2026 read: IOPS=17, BW=68.0KiB/s (70.7kB/s)(6052KiB/87716msec) clat (usec): min=21, max=148743, avg=32749.91, stdev=19340.86 lat (usec): min=22, max=148745, avg=32753.04, stdev=19341.06 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 10814], 10.00th=[ 13829], 20.00th=[ 17433], | 30.00th=[ 21103], 40.00th=[ 24773], 50.00th=[ 28967], 60.00th=[ 33817], | 70.00th=[ 39584], 80.00th=[ 45876], 90.00th=[ 56361], 95.00th=[ 66847], | 99.00th=[104334], 99.50th=[110625], 99.90th=[132645], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 14, max= 134, per=25.56%, avg=68.49, stdev=20.20, samples=173 iops : min= 3, max= 33, avg=16.52, stdev= 5.09, samples=173 write: IOPS=17, BW=71.1KiB/s (72.8kB/s)(6236KiB/87716msec); 0 zone resets clat (usec): min=977, max=305526, avg=24405.64, stdev=24099.98 lat (usec): min=978, max=305529, avg=24413.25, stdev=24103.37 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1614], 10.00th=[ 2278], 20.00th=[ 3949], | 30.00th=[ 6915], 40.00th=[ 12911], 50.00th=[ 18482], 60.00th=[ 23987], | 70.00th=[ 30278], 80.00th=[ 41157], 90.00th=[ 56886], 95.00th=[ 70779], | 99.00th=[103285], 99.50th=[114820], 99.90th=[139461], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 15, max= 135, per=25.11%, avg=70.55, stdev=24.23, samples=173 iops : min= 3, max= 33, avg=17.05, stdev= 6.07, samples=173 lat (usec) : 50=0.13%, 100=1.04%, 250=0.29%, 500=0.03%, 1000=0.10% lat (msec) : 2=3.91%, 4=6.48%, 10=8.37%, 20=19.92%, 50=45.44% lat (msec) : 100=13.18%, 250=1.07%, 500=0.03% cpu : usr=0.11%, sys=8.58%, ctx=7385, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=269KiB/s (275kB/s), 66.4KiB/s-68.0KiB/s (68.0kB/s-70.7kB/s), io=23.4MiB (24.6MB), run=87716-89410msec WRITE: bw=281KiB/s (288kB/s), 70.2KiB/s-71.1KiB/s (71.9kB/s-72.8kB/s), io=24.6MiB (25.7MB), run=87716-89410msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180078: Fri Jun 12 01:52:58 2026 read: IOPS=12, BW=51.0KiB/s (52.3kB/s)(5992KiB/117394msec) clat (msec): min=4, max=751, avg=30.77, stdev=31.67 lat (msec): min=4, max=751, avg=30.77, stdev=31.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 63], 95.00th=[ 86], | 99.00th=[ 136], 99.50th=[ 155], 99.90th=[ 182], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 197, per=24.89%, avg=50.78, stdev=31.97, samples=230 iops : min= 1, max= 49, avg=12.09, stdev= 8.05, samples=230 write: IOPS=13, BW=53.6KiB/s (54.9kB/s)(6296KiB/117394msec); 0 zone resets clat (msec): min=9, max=234, avg=45.06, stdev=30.80 lat (msec): min=9, max=234, avg=45.07, stdev=30.80 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 66], 90.00th=[ 87], 95.00th=[ 104], | 99.00th=[ 163], 99.50th=[ 178], 99.90th=[ 220], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 7, max= 151, per=25.22%, avg=53.72, stdev=30.15, samples=229 iops : min= 1, max= 37, avg=12.82, stdev= 7.57, samples=229 lat (msec) : 10=4.82%, 20=25.59%, 50=45.64%, 100=19.56%, 250=4.36% lat (msec) : 1000=0.03% cpu : usr=0.09%, sys=3.53%, ctx=5121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180079: Fri Jun 12 01:52:58 2026 read: IOPS=12, BW=50.5KiB/s (51.8kB/s)(5940KiB/117510msec) clat (msec): min=5, max=779, avg=32.31, stdev=33.18 lat (msec): min=5, max=779, avg=32.32, stdev=33.18 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 69], 95.00th=[ 85], | 99.00th=[ 138], 99.50th=[ 163], 99.90th=[ 201], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 159, per=24.72%, avg=50.43, stdev=31.94, samples=231 iops : min= 1, max= 39, avg=12.00, stdev= 8.01, samples=231 write: IOPS=13, BW=54.0KiB/s (55.3kB/s)(6348KiB/117510msec); 0 zone resets clat (msec): min=9, max=220, avg=43.57, stdev=29.02 lat (msec): min=9, max=220, avg=43.58, stdev=29.02 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 63], 90.00th=[ 81], 95.00th=[ 101], | 99.00th=[ 159], 99.50th=[ 180], 99.90th=[ 197], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 7, max= 150, per=25.34%, avg=53.97, stdev=30.20, samples=231 iops : min= 1, max= 37, avg=12.88, stdev= 7.61, samples=231 lat (msec) : 10=4.30%, 20=26.53%, 50=44.79%, 100=20.12%, 250=4.23% lat (msec) : 1000=0.03% cpu : usr=0.09%, sys=3.56%, ctx=5234, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180080: Fri Jun 12 01:52:58 2026 read: IOPS=13, BW=52.2KiB/s (53.4kB/s)(6028KiB/115587msec) clat (msec): min=4, max=209, avg=31.19, stdev=25.94 lat (msec): min=4, max=209, avg=31.20, stdev=25.94 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 86], | 99.00th=[ 124], 99.50th=[ 150], 99.90th=[ 197], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 7, max= 167, per=25.78%, avg=52.60, stdev=31.12, samples=225 iops : min= 1, max= 41, avg=12.54, stdev= 7.83, samples=225 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6260KiB/115587msec); 0 zone resets clat (msec): min=8, max=790, avg=43.58, stdev=34.26 lat (msec): min=8, max=790, avg=43.59, stdev=34.26 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 82], 95.00th=[ 100], | 99.00th=[ 146], 99.50th=[ 176], 99.90th=[ 224], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 158, per=25.27%, avg=53.83, stdev=31.41, samples=228 iops : min= 1, max= 39, avg=12.84, stdev= 7.90, samples=228 lat (msec) : 10=4.98%, 20=25.49%, 50=46.35%, 100=19.60%, 250=3.55% lat (msec) : 1000=0.03% cpu : usr=0.08%, sys=3.71%, ctx=5137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180081: Fri Jun 12 01:52:58 2026 read: IOPS=12, BW=51.8KiB/s (53.1kB/s)(6052KiB/116791msec) clat (msec): min=5, max=192, avg=31.99, stdev=26.45 lat (msec): min=5, max=192, avg=31.99, stdev=26.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 67], 95.00th=[ 87], | 99.00th=[ 127], 99.50th=[ 153], 99.90th=[ 178], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 7, max= 168, per=25.41%, avg=51.85, stdev=31.05, samples=228 iops : min= 1, max= 42, avg=12.35, stdev= 7.81, samples=228 write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6236KiB/116791msec); 0 zone resets clat (msec): min=7, max=792, avg=43.64, stdev=33.29 lat (msec): min=7, max=792, avg=43.64, stdev=33.29 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 64], 90.00th=[ 83], 95.00th=[ 96], | 99.00th=[ 130], 99.50th=[ 161], 99.90th=[ 222], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 158, per=24.85%, avg=52.93, stdev=30.35, samples=230 iops : min= 1, max= 39, avg=12.62, stdev= 7.64, samples=230 lat (msec) : 10=4.92%, 20=24.67%, 50=46.09%, 100=20.44%, 250=3.84% lat (msec) : 1000=0.03% cpu : usr=0.08%, sys=3.58%, ctx=5184, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=204KiB/s (209kB/s), 50.5KiB/s-52.2KiB/s (51.8kB/s-53.4kB/s), io=23.4MiB (24.6MB), run=115587-117510msec WRITE: bw=214KiB/s (219kB/s), 53.4KiB/s-54.2KiB/s (54.7kB/s-55.5kB/s), io=24.6MiB (25.7MB), run=115587-117510msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180117: Fri Jun 12 01:53:32 2026 read: IOPS=14, BW=236KiB/s (242kB/s)(5920KiB/25093msec) clat (usec): min=29, max=244662, avg=35725.09, stdev=23920.00 lat (usec): min=30, max=244663, avg=35726.61, stdev=23919.92 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 97], 10.00th=[ 13566], 20.00th=[ 20317], | 30.00th=[ 23200], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 36439], | 70.00th=[ 42730], 80.00th=[ 50070], 90.00th=[ 63177], 95.00th=[ 73925], | 99.00th=[107480], 99.50th=[149947], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 94, max= 605, per=25.43%, avg=234.51, stdev=86.91, samples=49 iops : min= 5, max= 37, avg=13.94, stdev= 5.44, samples=49 write: IOPS=15, BW=254KiB/s (260kB/s)(6368KiB/25093msec); 0 zone resets clat (usec): min=1127, max=180538, avg=29356.96, stdev=28173.24 lat (usec): min=1128, max=180540, avg=29365.76, stdev=28171.33 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2606], 10.00th=[ 3752], 20.00th=[ 5669], | 30.00th=[ 8586], 40.00th=[ 14091], 50.00th=[ 21103], 60.00th=[ 27919], | 70.00th=[ 37487], 80.00th=[ 50594], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[130548], 99.50th=[152044], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 95, max= 448, per=26.12%, avg=253.33, stdev=88.99, samples=49 iops : min= 5, max= 28, avg=15.14, stdev= 5.70, samples=49 lat (usec) : 50=0.39%, 100=2.47%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=1.04%, 4=5.21%, 10=11.72%, 20=12.63%, 50=45.31% lat (msec) : 100=18.88%, 250=1.82% cpu : usr=0.10%, sys=9.27%, ctx=2030, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180118: Fri Jun 12 01:53:32 2026 read: IOPS=14, BW=229KiB/s (234kB/s)(5744KiB/25133msec) clat (usec): min=37, max=117659, avg=35453.50, stdev=21162.44 lat (usec): min=38, max=117660, avg=35455.09, stdev=21162.04 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 109], 10.00th=[ 12780], 20.00th=[ 19530], | 30.00th=[ 24249], 40.00th=[ 28705], 50.00th=[ 32900], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 51119], 90.00th=[ 60031], 95.00th=[ 72877], | 99.00th=[104334], 99.50th=[110625], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 54, max= 444, per=24.80%, avg=228.61, stdev=82.92, samples=49 iops : min= 3, max= 27, avg=13.57, stdev= 5.27, samples=49 write: IOPS=16, BW=260KiB/s (267kB/s)(6544KiB/25133msec); 0 zone resets clat (usec): min=1280, max=182598, avg=30161.43, stdev=25532.89 lat (usec): min=1281, max=182600, avg=30166.92, stdev=25537.71 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2835], 10.00th=[ 4146], 20.00th=[ 7242], | 30.00th=[ 12780], 40.00th=[ 17433], 50.00th=[ 23462], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 50594], 90.00th=[ 68682], 95.00th=[ 77071], | 99.00th=[ 98042], 99.50th=[101188], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 124, max= 509, per=26.82%, avg=260.16, stdev=85.90, samples=49 iops : min= 7, max= 31, avg=15.57, stdev= 5.44, samples=49 lat (usec) : 50=0.26%, 100=1.56%, 250=1.69%, 500=0.13% lat (msec) : 2=1.17%, 4=3.78%, 10=8.72%, 20=16.93%, 50=45.05% lat (msec) : 100=19.40%, 250=1.30% cpu : usr=0.12%, sys=9.51%, ctx=2071, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180119: Fri Jun 12 01:53:32 2026 read: IOPS=15, BW=241KiB/s (247kB/s)(6256KiB/25978msec) clat (usec): min=44, max=173482, avg=37179.64, stdev=24289.20 lat (usec): min=45, max=173484, avg=37192.34, stdev=24292.72 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 149], 10.00th=[ 13960], 20.00th=[ 19530], | 30.00th=[ 23987], 40.00th=[ 28705], 50.00th=[ 33162], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 51643], 90.00th=[ 65799], 95.00th=[ 81265], | 99.00th=[129500], 99.50th=[149947], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 126, max= 448, per=26.22%, avg=241.78, stdev=76.73, samples=51 iops : min= 7, max= 28, avg=14.39, stdev= 4.83, samples=51 write: IOPS=14, BW=232KiB/s (238kB/s)(6032KiB/25978msec); 0 zone resets clat (usec): min=1293, max=120832, avg=29750.30, stdev=25099.22 lat (usec): min=1295, max=120836, avg=29753.02, stdev=25099.26 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2769], 10.00th=[ 3884], 20.00th=[ 7242], | 30.00th=[ 12387], 40.00th=[ 18482], 50.00th=[ 24249], 60.00th=[ 29230], | 70.00th=[ 35914], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[112722], 99.50th=[114820], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 63, max= 415, per=23.69%, avg=229.75, stdev=77.34, samples=51 iops : min= 3, max= 25, avg=13.65, stdev= 4.81, samples=51 lat (usec) : 50=0.26%, 100=1.95%, 250=1.04% lat (msec) : 2=1.17%, 4=4.30%, 10=8.46%, 20=14.84%, 50=46.74% lat (msec) : 100=19.27%, 250=1.95% cpu : usr=0.10%, sys=9.11%, ctx=2117, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180120: Fri Jun 12 01:53:32 2026 read: IOPS=15, BW=243KiB/s (249kB/s)(6032KiB/24851msec) clat (usec): min=40, max=163004, avg=36955.96, stdev=24047.76 lat (usec): min=41, max=163004, avg=36957.33, stdev=24047.77 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 10552], 20.00th=[ 19268], | 30.00th=[ 24511], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 39584], | 70.00th=[ 45351], 80.00th=[ 51119], 90.00th=[ 63177], 95.00th=[ 78119], | 99.00th=[135267], 99.50th=[147850], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 63, max= 382, per=26.28%, avg=242.33, stdev=75.37, samples=49 iops : min= 3, max= 23, avg=14.45, stdev= 4.68, samples=49 write: IOPS=15, BW=252KiB/s (258kB/s)(6256KiB/24851msec); 0 zone resets clat (usec): min=1831, max=167622, avg=27539.84, stdev=24053.84 lat (usec): min=1833, max=167624, avg=27552.23, stdev=24053.93 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 3130], 10.00th=[ 4293], 20.00th=[ 7242], | 30.00th=[ 11207], 40.00th=[ 16319], 50.00th=[ 21103], 60.00th=[ 26870], | 70.00th=[ 34341], 80.00th=[ 44303], 90.00th=[ 60031], 95.00th=[ 71828], | 99.00th=[106431], 99.50th=[156238], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 63, max= 446, per=25.97%, avg=251.92, stdev=88.70, samples=49 iops : min= 3, max= 27, avg=15.04, stdev= 5.60, samples=49 lat (usec) : 50=0.39%, 100=3.39%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=0.65%, 4=4.17%, 10=9.38%, 20=16.41%, 50=46.48% lat (msec) : 100=16.80%, 250=1.56% cpu : usr=0.13%, sys=9.32%, ctx=2008, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=922KiB/s (944kB/s), 229KiB/s-243KiB/s (234kB/s-249kB/s), io=23.4MiB (24.5MB), run=24851-25978msec WRITE: bw=970KiB/s (993kB/s), 232KiB/s-260KiB/s (238kB/s-267kB/s), io=24.6MiB (25.8MB), run=24851-25978msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180122: Fri Jun 12 01:53:40 2026 read: IOPS=11, BW=178KiB/s (182kB/s)(5920KiB/33289msec) clat (msec): min=8, max=182, avg=33.91, stdev=25.50 lat (msec): min=8, max=182, avg=33.91, stdev=25.50 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 64], 95.00th=[ 88], | 99.00th=[ 128], 99.50th=[ 176], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 31, max= 448, per=25.55%, avg=180.37, stdev=100.12, samples=63 iops : min= 1, max= 28, avg=10.54, stdev= 6.40, samples=63 write: IOPS=11, BW=191KiB/s (196kB/s)(6368KiB/33289msec); 0 zone resets clat (msec): min=13, max=210, avg=51.68, stdev=32.07 lat (msec): min=13, max=210, avg=51.68, stdev=32.07 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 60], 80.00th=[ 77], 90.00th=[ 94], 95.00th=[ 114], | 99.00th=[ 176], 99.50th=[ 205], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 448, per=25.67%, avg=190.75, stdev=95.20, samples=65 iops : min= 1, max= 28, avg=11.20, stdev= 6.04, samples=65 lat (msec) : 10=1.04%, 20=18.49%, 50=51.82%, 100=22.92%, 250=5.73% cpu : usr=0.07%, sys=3.65%, ctx=1256, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180123: Fri Jun 12 01:53:40 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/33913msec) clat (msec): min=7, max=185, avg=37.46, stdev=30.93 lat (msec): min=7, max=185, avg=37.47, stdev=30.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 87], 95.00th=[ 101], | 99.00th=[ 144], 99.50th=[ 176], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 506, per=23.86%, avg=168.46, stdev=108.43, samples=67 iops : min= 1, max= 31, avg= 9.79, stdev= 6.89, samples=67 write: IOPS=12, BW=193KiB/s (198kB/s)(6544KiB/33913msec); 0 zone resets clat (msec): min=13, max=260, avg=49.76, stdev=33.74 lat (msec): min=13, max=260, avg=49.76, stdev=33.74 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 57], 80.00th=[ 67], 90.00th=[ 93], 95.00th=[ 118], | 99.00th=[ 176], 99.50th=[ 199], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 510, per=25.88%, avg=192.27, stdev=111.80, samples=67 iops : min= 1, max= 31, avg=11.28, stdev= 7.07, samples=67 lat (msec) : 10=1.82%, 20=20.57%, 50=46.09%, 100=25.00%, 250=6.38% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=3.46%, ctx=1288, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180124: Fri Jun 12 01:53:40 2026 read: IOPS=11, BW=189KiB/s (193kB/s)(6256KiB/33131msec) clat (msec): min=7, max=175, avg=35.29, stdev=26.15 lat (msec): min=7, max=175, avg=35.30, stdev=26.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 93], | 99.00th=[ 124], 99.50th=[ 169], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 480, per=26.89%, avg=189.82, stdev=116.86, samples=65 iops : min= 1, max= 30, avg=11.14, stdev= 7.38, samples=65 write: IOPS=11, BW=182KiB/s (186kB/s)(6032KiB/33131msec); 0 zone resets clat (msec): min=12, max=231, avg=50.75, stdev=30.77 lat (msec): min=12, max=231, avg=50.76, stdev=30.77 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 60], 80.00th=[ 74], 90.00th=[ 91], 95.00th=[ 109], | 99.00th=[ 148], 99.50th=[ 161], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 62, max= 544, per=24.21%, avg=179.91, stdev=95.52, samples=65 iops : min= 3, max= 34, avg=10.51, stdev= 6.13, samples=65 lat (msec) : 10=0.78%, 20=19.53%, 50=51.30%, 100=22.79%, 250=5.60% cpu : usr=0.10%, sys=3.68%, ctx=1296, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180125: Fri Jun 12 01:53:40 2026 read: IOPS=11, BW=179KiB/s (184kB/s)(6032KiB/33611msec) clat (msec): min=7, max=267, avg=36.72, stdev=30.86 lat (msec): min=7, max=267, avg=36.72, stdev=30.86 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 83], 95.00th=[ 106], | 99.00th=[ 138], 99.50th=[ 157], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 480, per=25.82%, avg=182.27, stdev=99.16, samples=64 iops : min= 1, max= 30, avg=10.66, stdev= 6.30, samples=64 write: IOPS=11, BW=186KiB/s (191kB/s)(6256KiB/33611msec); 0 zone resets clat (msec): min=8, max=254, avg=50.12, stdev=33.63 lat (msec): min=8, max=254, avg=50.13, stdev=33.63 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 92], 95.00th=[ 110], | 99.00th=[ 201], 99.50th=[ 209], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 32, max= 512, per=24.69%, avg=183.42, stdev=100.14, samples=66 iops : min= 2, max= 32, avg=10.73, stdev= 6.35, samples=66 lat (msec) : 10=1.82%, 20=18.62%, 50=51.43%, 100=21.22%, 250=6.64% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=3.44%, ctx=1239, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=706KiB/s (723kB/s), 169KiB/s-189KiB/s (173kB/s-193kB/s), io=23.4MiB (24.5MB), run=33131-33913msec WRITE: bw=743KiB/s (761kB/s), 182KiB/s-193KiB/s (186kB/s-198kB/s), io=24.6MiB (25.8MB), run=33131-33913msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180140: Fri Jun 12 01:53:55 2026 read: IOPS=1, BW=1205KiB/s (1234kB/s)(7168KiB/5947msec) clat (msec): min=80, max=2671, avg=598.19, stdev=924.52 lat (msec): min=80, max=2671, avg=598.19, stdev=924.52 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 140], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 342], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 456], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1479, max= 4087, per=72.78%, avg=2338.40, stdev=1007.45, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=861KiB/s (882kB/s)(5120KiB/5947msec); 0 zone resets clat (msec): min=148, max=882, avg=337.08, stdev=313.66 lat (msec): min=148, max=882, avg=337.82, stdev=313.23 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2043, max= 3923, per=59.39%, avg=2671.33, stdev=1083.98, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=3.72%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180143: Fri Jun 12 01:53:55 2026 read: IOPS=0, BW=331KiB/s (339kB/s)(2048KiB/6195msec) clat (msec): min=71, max=190, avg=131.15, stdev=83.76 lat (msec): min=71, max=190, avg=131.15, stdev=83.76 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 72], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 1521, max= 2048, per=55.54%, avg=1784.50, stdev=372.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1653KiB/s (1693kB/s)(10.0MiB/6195msec); 0 zone resets clat (msec): min=108, max=2835, avg=565.33, stdev=818.51 lat (msec): min=108, max=2835, avg=565.44, stdev=818.51 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 142], | 30.00th=[ 186], 40.00th=[ 188], 50.00th=[ 215], 60.00th=[ 326], | 70.00th=[ 485], 80.00th=[ 498], 90.00th=[ 667], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1961, max= 4087, per=52.70%, avg=2370.33, stdev=841.65, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=5.76%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180144: Fri Jun 12 01:53:55 2026 read: IOPS=0, BW=980KiB/s (1003kB/s)(6144KiB/6272msec) clat (msec): min=53, max=599, avg=261.92, stdev=205.66 lat (msec): min=53, max=599, avg=261.92, stdev=205.66 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 271], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2043, max= 4087, per=79.57%, avg=2556.50, stdev=1020.34, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=0, BW=980KiB/s (1003kB/s)(6144KiB/6272msec); 0 zone resets clat (msec): min=118, max=3208, avg=739.17, stdev=1223.14 lat (msec): min=118, max=3208, avg=739.26, stdev=1223.12 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 213], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2043, max= 4087, per=62.04%, avg=2790.75, stdev=971.05, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.54%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180145: Fri Jun 12 01:53:55 2026 read: IOPS=0, BW=803KiB/s (823kB/s)(5120KiB/6373msec) clat (msec): min=39, max=747, avg=299.81, stdev=281.42 lat (msec): min=39, max=747, avg=299.81, stdev=281.42 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 40], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2043, max= 3923, per=83.14%, avg=2671.33, stdev=1083.98, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1125KiB/s (1152kB/s)(7168KiB/6373msec); 0 zone resets clat (msec): min=52, max=3021, avg=673.81, stdev=1052.86 lat (msec): min=52, max=3021, avg=673.90, stdev=1052.85 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 199], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 234], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 667], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1503, max= 2048, per=43.01%, avg=1934.40, stdev=241.20, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.81%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3214KiB/s (3291kB/s), 331KiB/s-1205KiB/s (339kB/s-1234kB/s), io=20.0MiB (20.0MB), run=5947-6373msec WRITE: bw=4499KiB/s (4607kB/s), 861KiB/s-1653KiB/s (882kB/s-1693kB/s), io=28.0MiB (29.4MB), run=5947-6373msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180138: Fri Jun 12 01:53:55 2026 read: IOPS=1, BW=1355KiB/s (1388kB/s)(7168KiB/5290msec) clat (usec): min=665, max=2653.9k, avg=494010.32, stdev=956387.15 lat (usec): min=666, max=2653.9k, avg=494012.40, stdev=956387.63 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], | 20.00th=[ 43254], 30.00th=[ 147850], 40.00th=[ 147850], | 50.00th=[ 156238], 60.00th=[ 206570], 70.00th=[ 206570], | 80.00th=[ 250610], 90.00th=[2667578], 95.00th=[2667578], | 99.00th=[2667578], 99.50th=[2667578], 99.90th=[2667578], | 99.95th=[2667578], 99.99th=[2667578] bw ( KiB/s): min= 1935, max= 6131, per=93.48%, avg=3027.00, stdev=2069.78, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=0, BW=968KiB/s (991kB/s)(5120KiB/5290msec); 0 zone resets clat (msec): min=150, max=796, avg=333.83, stdev=266.69 lat (msec): min=150, max=796, avg=333.99, stdev=266.63 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2039, max= 3871, per=58.48%, avg=2651.00, stdev=1056.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=41.67%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=11.65%, ctx=663, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180139: Fri Jun 12 01:53:55 2026 read: IOPS=0, BW=324KiB/s (332kB/s)(2048KiB/6324msec) clat (msec): min=162, max=273, avg=217.84, stdev=78.49 lat (msec): min=162, max=273, avg=217.85, stdev=78.49 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1492, max= 1935, per=52.92%, avg=1713.50, stdev=313.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1619KiB/s (1658kB/s)(10.0MiB/6324msec); 0 zone resets clat (msec): min=75, max=2802, avg=548.20, stdev=807.48 lat (msec): min=75, max=2802, avg=548.33, stdev=807.47 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 106], | 30.00th=[ 218], 40.00th=[ 251], 50.00th=[ 255], 60.00th=[ 292], | 70.00th=[ 439], 80.00th=[ 489], 90.00th=[ 558], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 2039, max= 6107, per=80.65%, avg=3655.80, stdev=1698.95, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=13.19%, ctx=166, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180141: Fri Jun 12 01:53:55 2026 read: IOPS=1, BW=1113KiB/s (1139kB/s)(6144KiB/5522msec) clat (usec): min=739, max=186703, avg=59729.98, stdev=84327.90 lat (usec): min=740, max=186703, avg=59731.24, stdev=84327.38 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 1254], | 30.00th=[ 1254], 40.00th=[ 1270], 50.00th=[ 1270], 60.00th=[ 21365], | 70.00th=[147850], 80.00th=[147850], 90.00th=[187696], 95.00th=[187696], | 99.00th=[187696], 99.50th=[187696], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 4007, max= 5807, per=100.00%, avg=4907.00, stdev=1272.79, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1113KiB/s (1139kB/s)(6144KiB/5522msec); 0 zone resets clat (msec): min=92, max=3371, avg=794.97, stdev=1287.73 lat (msec): min=92, max=3371, avg=795.04, stdev=1287.74 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 218], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 2003, max= 3871, per=65.50%, avg=2969.33, stdev=935.68, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 50=8.33%, 100=8.33%, 250=41.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.73%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180142: Fri Jun 12 01:53:55 2026 read: IOPS=0, BW=999KiB/s (1023kB/s)(5120KiB/5126msec) clat (usec): min=733, max=504611, avg=182238.71, stdev=213848.74 lat (usec): min=735, max=504612, avg=182240.43, stdev=213848.44 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 734], | 30.00th=[ 1012], 40.00th=[ 1012], 50.00th=[123208], 60.00th=[123208], | 70.00th=[283116], 80.00th=[283116], 90.00th=[505414], 95.00th=[505414], | 99.00th=[505414], 99.50th=[505414], 99.90th=[505414], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 2003, max= 4087, per=83.68%, avg=2709.67, stdev=1192.94, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1398KiB/s (1432kB/s)(7168KiB/5126msec); 0 zone resets clat (msec): min=101, max=3007, avg=598.29, stdev=1063.75 lat (msec): min=101, max=3007, avg=598.38, stdev=1063.75 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 161], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 218], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 262], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1477, max= 6119, per=70.88%, avg=3213.00, stdev=2532.53, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=11.55%, ctx=124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3238KiB/s (3316kB/s), 324KiB/s-1355KiB/s (332kB/s-1388kB/s), io=20.0MiB (20.0MB), run=5126-6324msec WRITE: bw=4534KiB/s (4643kB/s), 968KiB/s-1619KiB/s (991kB/s-1658kB/s), io=28.0MiB (29.4MB), run=5126-6324msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180153: Fri Jun 12 01:54:06 2026 read: IOPS=1, BW=6314KiB/s (6466kB/s)(12.0MiB/1946msec) clat (msec): min=558, max=773, avg=637.42, stdev=118.13 lat (msec): min=558, max=773, avg=637.43, stdev=118.13 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 6511, max= 8143, per=100.00%, avg=7327.00, stdev=1154.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.04%, ctx=267, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180155: Fri Jun 12 01:54:06 2026 read: IOPS=0, BW=1578KiB/s (1616kB/s)(4096KiB/2595msec) clat (nsec): min=488809k, max=488809k, avg=488809367.00, stdev= 0.00 lat (nsec): min=488812k, max=488812k, avg=488812337.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7148, max= 7148, per=100.00%, avg=7148.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3157KiB/s (3233kB/s)(8192KiB/2595msec); 0 zone resets clat (msec): min=609, max=1444, avg=1026.92, stdev=590.95 lat (msec): min=609, max=1445, avg=1027.37, stdev=591.09 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8143, max= 8143, per=72.32%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.16%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180157: Fri Jun 12 01:54:06 2026 write: IOPS=1, BW=4223KiB/s (4324kB/s)(12.0MiB/2910msec); 0 zone resets clat (msec): min=172, max=1520, avg=915.58, stdev=684.11 lat (msec): min=173, max=1520, avg=916.73, stdev=684.23 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8143, max= 8143, per=72.32%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.95%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180159: Fri Jun 12 01:54:06 2026 write: IOPS=1, BW=5141KiB/s (5265kB/s)(12.0MiB/2390msec); 0 zone resets clat (msec): min=206, max=1269, avg=749.86, stdev=532.23 lat (msec): min=206, max=1270, avg=750.91, stdev=532.36 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7846, max= 7846, per=69.68%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.44%, ctx=34, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6314KiB/s (6465kB/s), 1578KiB/s-6314KiB/s (1616kB/s-6466kB/s), io=16.0MiB (16.8MB), run=1946-2595msec WRITE: bw=10.0MiB/s (11.5MB/s), 3157KiB/s-5141KiB/s (3233kB/s-5265kB/s), io=32.0MiB (33.6MB), run=2390-2910msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180152: Fri Jun 12 01:54:06 2026 read: IOPS=1, BW=5948KiB/s (6090kB/s)(12.0MiB/2066msec) clat (msec): min=613, max=686, avg=655.65, stdev=37.62 lat (msec): min=613, max=686, avg=655.65, stdev=37.62 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=6.05%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180154: Fri Jun 12 01:54:06 2026 read: IOPS=0, BW=1404KiB/s (1438kB/s)(4096KiB/2917msec) clat (nsec): min=804056k, max=804056k, avg=804056351.00, stdev= 0.00 lat (nsec): min=804059k, max=804059k, avg=804059265.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2808KiB/s (2876kB/s)(8192KiB/2917msec); 0 zone resets clat (msec): min=606, max=1461, avg=1034.08, stdev=604.09 lat (msec): min=607, max=1463, avg=1035.65, stdev=605.52 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8175, max= 8175, per=72.78%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.88%, ctx=34, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180156: Fri Jun 12 01:54:06 2026 write: IOPS=1, BW=4674KiB/s (4786kB/s)(12.0MiB/2629msec); 0 zone resets clat (msec): min=220, max=1375, avg=839.87, stdev=581.91 lat (msec): min=221, max=1375, avg=840.44, stdev=581.89 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8126, max= 8126, per=72.34%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.15%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180158: Fri Jun 12 01:54:06 2026 write: IOPS=1, BW=5545KiB/s (5678kB/s)(12.0MiB/2216msec); 0 zone resets clat (msec): min=187, max=1271, avg=708.63, stdev=543.34 lat (msec): min=187, max=1271, avg=709.74, stdev=543.14 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8126, max= 8159, per=72.49%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.82%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5617KiB/s (5752kB/s), 1404KiB/s-5948KiB/s (1438kB/s-6090kB/s), io=16.0MiB (16.8MB), run=2066-2917msec WRITE: bw=10.0MiB/s (11.5MB/s), 2808KiB/s-5545KiB/s (2876kB/s-5678kB/s), io=32.0MiB (33.6MB), run=2216-2917msec