== sanity test 398b: DIO and buffer IO race ============== 00:14:16 (1782533656) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.08232 s, 16.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145674: Sat Jun 27 00:15:24 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(5992KiB/58316msec) clat (usec): min=31, max=895065, avg=19786.86, stdev=25738.26 lat (usec): min=31, max=895069, avg=19787.94, stdev=25738.36 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 157], 10.00th=[ 8356], 20.00th=[ 10552], | 30.00th=[ 12387], 40.00th=[ 14353], 50.00th=[ 16909], 60.00th=[ 19530], | 70.00th=[ 23200], 80.00th=[ 26608], 90.00th=[ 33162], 95.00th=[ 41157], | 99.00th=[ 63701], 99.50th=[ 77071], 99.90th=[122160], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 13, max= 184, per=25.10%, avg=102.66, stdev=31.57, samples=116 iops : min= 3, max= 46, avg=25.22, stdev= 7.91, samples=116 write: IOPS=26, BW=108KiB/s (111kB/s)(6296KiB/58316msec); 0 zone resets clat (usec): min=762, max=144130, avg=18085.26, stdev=16049.11 lat (usec): min=763, max=144131, avg=18086.55, stdev=16049.13 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1860], 10.00th=[ 2638], 20.00th=[ 3720], | 30.00th=[ 5735], 40.00th=[ 10159], 50.00th=[ 14353], 60.00th=[ 18744], | 70.00th=[ 23987], 80.00th=[ 29754], 90.00th=[ 39060], 95.00th=[ 49546], | 99.00th=[ 67634], 99.50th=[ 77071], 99.90th=[109577], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 8, max= 192, per=25.35%, avg=108.77, stdev=30.44, samples=115 iops : min= 2, max= 48, avg=26.75, stdev= 7.60, samples=115 lat (usec) : 50=0.16%, 100=1.04%, 250=1.50%, 500=0.16%, 1000=0.13% lat (msec) : 2=2.86%, 4=8.30%, 10=14.42%, 20=33.20%, 50=34.67% lat (msec) : 100=3.39%, 250=0.13%, 1000=0.03% cpu : usr=0.14%, sys=18.83%, ctx=8325, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145675: Sat Jun 27 00:15:24 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(5940KiB/58285msec) clat (usec): min=42, max=216612, avg=19297.02, stdev=14205.44 lat (usec): min=42, max=216614, avg=19298.62, stdev=14205.60 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 125], 10.00th=[ 8160], 20.00th=[ 10552], | 30.00th=[ 12256], 40.00th=[ 14222], 50.00th=[ 16581], 60.00th=[ 19530], | 70.00th=[ 22676], 80.00th=[ 26870], 90.00th=[ 33162], 95.00th=[ 41681], | 99.00th=[ 65799], 99.50th=[ 87557], 99.90th=[193987], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 6, max= 175, per=24.82%, avg=101.53, stdev=29.29, samples=115 iops : min= 1, max= 43, avg=24.93, stdev= 7.30, samples=115 write: IOPS=27, BW=109KiB/s (112kB/s)(6348KiB/58285msec); 0 zone resets clat (usec): min=810, max=898992, avg=18553.03, stdev=27622.50 lat (usec): min=811, max=898993, avg=18554.47, stdev=27622.51 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1827], 10.00th=[ 2409], 20.00th=[ 3458], | 30.00th=[ 5538], 40.00th=[ 10290], 50.00th=[ 14353], 60.00th=[ 18220], | 70.00th=[ 23200], 80.00th=[ 29492], 90.00th=[ 38536], 95.00th=[ 49021], | 99.00th=[ 78119], 99.50th=[ 92799], 99.90th=[137364], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 6, max= 199, per=25.21%, avg=108.14, stdev=33.67, samples=115 iops : min= 1, max= 49, avg=26.58, stdev= 8.44, samples=115 lat (usec) : 50=0.23%, 100=1.56%, 250=1.11%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=2.93%, 4=9.60%, 10=12.73%, 20=34.57%, 50=33.46% lat (msec) : 100=3.09%, 250=0.33%, 1000=0.03% cpu : usr=0.13%, sys=18.77%, ctx=8333, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145676: Sat Jun 27 00:15:24 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(6028KiB/58580msec) clat (usec): min=33, max=150380, avg=18873.23, stdev=12685.25 lat (usec): min=34, max=150382, avg=18875.52, stdev=12684.85 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 111], 10.00th=[ 7701], 20.00th=[ 10290], | 30.00th=[ 12256], 40.00th=[ 13960], 50.00th=[ 16188], 60.00th=[ 19268], | 70.00th=[ 22938], 80.00th=[ 26608], 90.00th=[ 32900], 95.00th=[ 40633], | 99.00th=[ 61604], 99.50th=[ 68682], 99.90th=[107480], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 39, max= 160, per=25.48%, avg=104.20, stdev=28.13, samples=114 iops : min= 9, max= 40, avg=25.60, stdev= 7.01, samples=114 write: IOPS=26, BW=107KiB/s (109kB/s)(6260KiB/58580msec); 0 zone resets clat (usec): min=800, max=943078, avg=19109.81, stdev=28643.03 lat (usec): min=801, max=943079, avg=19111.15, stdev=28643.01 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1926], 10.00th=[ 2540], 20.00th=[ 3851], | 30.00th=[ 6521], 40.00th=[ 10945], 50.00th=[ 14484], 60.00th=[ 18744], | 70.00th=[ 23725], 80.00th=[ 30540], 90.00th=[ 39584], 95.00th=[ 49021], | 99.00th=[ 77071], 99.50th=[ 96994], 99.90th=[130548], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 8, max= 199, per=24.92%, avg=106.90, stdev=31.34, samples=115 iops : min= 2, max= 49, avg=26.28, stdev= 7.85, samples=115 lat (usec) : 50=0.29%, 100=1.69%, 250=1.69%, 500=0.03%, 1000=0.03% lat (msec) : 2=2.83%, 4=7.68%, 10=13.31%, 20=35.09%, 50=33.72% lat (msec) : 100=3.35%, 250=0.23%, 1000=0.03% cpu : usr=0.13%, sys=18.58%, ctx=8315, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145677: Sat Jun 27 00:15:24 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(6052KiB/58543msec) clat (usec): min=33, max=185291, avg=18637.05, stdev=12138.94 lat (usec): min=34, max=185293, avg=18638.89, stdev=12140.23 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 100], 10.00th=[ 7635], 20.00th=[ 10814], | 30.00th=[ 12387], 40.00th=[ 14353], 50.00th=[ 16450], 60.00th=[ 19006], | 70.00th=[ 22414], 80.00th=[ 26084], 90.00th=[ 33162], 95.00th=[ 39060], | 99.00th=[ 58459], 99.50th=[ 64226], 99.90th=[ 96994], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 39, max= 207, per=25.51%, avg=104.34, stdev=28.35, samples=114 iops : min= 9, max= 51, avg=25.63, stdev= 7.13, samples=114 write: IOPS=26, BW=107KiB/s (109kB/s)(6236KiB/58543msec); 0 zone resets clat (usec): min=987, max=936763, avg=19340.53, stdev=29277.68 lat (usec): min=987, max=936765, avg=19342.07, stdev=29277.67 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1942], 10.00th=[ 2540], 20.00th=[ 3621], | 30.00th=[ 5932], 40.00th=[ 10814], 50.00th=[ 14877], 60.00th=[ 19006], | 70.00th=[ 23725], 80.00th=[ 30540], 90.00th=[ 40633], 95.00th=[ 49546], | 99.00th=[ 77071], 99.50th=[108528], 99.90th=[166724], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 8, max= 175, per=24.90%, avg=106.83, stdev=28.74, samples=115 iops : min= 2, max= 43, avg=26.26, stdev= 7.16, samples=115 lat (usec) : 50=0.46%, 100=2.05%, 250=1.17%, 500=0.16%, 1000=0.07% lat (msec) : 2=2.67%, 4=8.59%, 10=12.27%, 20=35.03%, 50=34.28% lat (msec) : 100=2.93%, 250=0.29%, 1000=0.03% cpu : usr=0.10%, sys=18.57%, ctx=8182, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=410KiB/s (420kB/s), 102KiB/s-103KiB/s (104kB/s-106kB/s), io=23.4MiB (24.6MB), run=58285-58580msec WRITE: bw=429KiB/s (439kB/s), 107KiB/s-109KiB/s (109kB/s-112kB/s), io=24.6MiB (25.7MB), run=58285-58580msec fio: pid=145671, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=145669: Sat Jun 27 00:16:15 2026 read: IOPS=13, BW=54.7KiB/s (56.0kB/s)(5992KiB/109489msec) clat (msec): min=3, max=908, avg=18.51, stdev=27.25 lat (msec): min=3, max=908, avg=18.51, stdev=27.25 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 23], 90.00th=[ 36], 95.00th=[ 47], | 99.00th=[ 79], 99.50th=[ 101], 99.90th=[ 144], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 144, per=26.56%, avg=54.97, stdev=30.43, samples=216 iops : min= 1, max= 36, avg=13.37, stdev= 7.63, samples=216 write: IOPS=14, BW=57.5KiB/s (58.9kB/s)(6296KiB/109489msec); 0 zone resets clat (msec): min=18, max=217, avg=51.79, stdev=23.85 lat (msec): min=18, max=217, avg=51.79, stdev=23.85 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 46], 60.00th=[ 51], | 70.00th=[ 58], 80.00th=[ 68], 90.00th=[ 83], 95.00th=[ 96], | 99.00th=[ 142], 99.50th=[ 159], 99.90th=[ 209], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 8, max= 120, per=26.60%, avg=57.72, stdev=22.16, samples=216 iops : min= 2, max= 30, avg=14.05, stdev= 5.60, samples=216 lat (msec) : 4=0.07%, 10=13.96%, 20=22.75%, 50=40.01%, 100=20.93% lat (msec) : 250=2.25%, 1000=0.03% cpu : usr=0.10%, sys=5.22%, ctx=6291, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145670: Sat Jun 27 00:16:15 2026 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(5940KiB/109768msec) clat (msec): min=4, max=916, avg=18.69, stdev=28.23 lat (msec): min=4, max=916, avg=18.69, stdev=28.23 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 23], 90.00th=[ 35], 95.00th=[ 51], | 99.00th=[ 90], 99.50th=[ 104], 99.90th=[ 159], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 152, per=26.36%, avg=54.57, stdev=30.92, samples=215 iops : min= 1, max= 38, avg=13.27, stdev= 7.77, samples=215 write: IOPS=14, BW=57.8KiB/s (59.2kB/s)(6348KiB/109768msec); 0 zone resets clat (msec): min=18, max=216, avg=51.52, stdev=23.36 lat (msec): min=18, max=216, avg=51.53, stdev=23.36 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 51], | 70.00th=[ 59], 80.00th=[ 68], 90.00th=[ 81], 95.00th=[ 95], | 99.00th=[ 133], 99.50th=[ 155], 99.90th=[ 207], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 16, max= 111, per=26.70%, avg=57.94, stdev=22.30, samples=216 iops : min= 4, max= 27, avg=14.11, stdev= 5.62, samples=216 lat (msec) : 10=14.97%, 20=21.48%, 50=39.78%, 100=21.29%, 250=2.44% lat (msec) : 1000=0.03% cpu : usr=0.08%, sys=5.20%, ctx=6225, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145671: Sat Jun 27 00:16:15 2026 read: IOPS=12, BW=50.8KiB/s (51.0kB/s)(4756KiB/93700msec) clat (msec): min=4, max=131, avg=19.79, stdev=15.32 lat (msec): min=4, max=131, avg=19.79, stdev=15.32 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 82], 99.50th=[ 94], 99.90th=[ 123], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 7, max= 151, per=24.66%, avg=51.05, stdev=27.01, samples=184 iops : min= 1, max= 37, avg=12.38, stdev= 6.81, samples=184 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(4976KiB/93700msec); 0 zone resets clat (msec): min=20, max=931, avg=56.22, stdev=34.00 lat (msec): min=20, max=931, avg=56.22, stdev=34.00 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 50], 60.00th=[ 56], | 70.00th=[ 63], 80.00th=[ 73], 90.00th=[ 87], 95.00th=[ 99], | 99.00th=[ 128], 99.50th=[ 159], 99.90th=[ 201], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 15, max= 103, per=24.61%, avg=53.40, stdev=20.75, samples=184 iops : min= 3, max= 25, avg=12.97, stdev= 5.26, samples=184 lat (msec) : 10=13.31%, 20=18.69%, 50=40.22%, 100=25.27%, 250=2.42% lat (msec) : 1000=0.04% cpu : usr=0.07%, sys=5.16%, ctx=4578, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1190,1244,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145672: Sat Jun 27 00:16:15 2026 read: IOPS=13, BW=55.2KiB/s (56.6kB/s)(6052KiB/109568msec) clat (msec): min=4, max=159, avg=18.37, stdev=15.73 lat (msec): min=4, max=159, avg=18.37, stdev=15.73 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 47], | 99.00th=[ 91], 99.50th=[ 105], 99.90th=[ 136], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 7, max= 159, per=27.04%, avg=55.98, stdev=29.09, samples=214 iops : min= 1, max= 39, avg=13.61, stdev= 7.31, samples=214 write: IOPS=14, BW=56.9KiB/s (58.3kB/s)(6236KiB/109568msec); 0 zone resets clat (msec): min=19, max=932, avg=52.29, stdev=31.85 lat (msec): min=19, max=932, avg=52.30, stdev=31.85 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 38], 40.00th=[ 42], 50.00th=[ 46], 60.00th=[ 51], | 70.00th=[ 58], 80.00th=[ 68], 90.00th=[ 84], 95.00th=[ 99], | 99.00th=[ 123], 99.50th=[ 146], 99.90th=[ 207], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 15, max= 104, per=26.32%, avg=57.12, stdev=22.20, samples=216 iops : min= 3, max= 26, avg=13.90, stdev= 5.61, samples=216 lat (msec) : 10=13.74%, 20=23.44%, 50=39.94%, 100=20.15%, 250=2.70% lat (msec) : 1000=0.03% cpu : usr=0.07%, sys=5.27%, ctx=6212, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=207KiB/s (212kB/s), 50.8KiB/s-55.2KiB/s (51.0kB/s-56.6kB/s), io=22.2MiB (23.3MB), run=93700-109768msec WRITE: bw=217KiB/s (223kB/s), 53.1KiB/s-57.8KiB/s (54.4kB/s-59.2kB/s), io=23.3MiB (24.4MB), run=93700-109768msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145708: Sat Jun 27 00:16:34 2026 read: IOPS=27, BW=442KiB/s (453kB/s)(5920KiB/13388msec) clat (usec): min=29, max=75018, avg=18253.74, stdev=12320.10 lat (usec): min=30, max=75019, avg=18255.28, stdev=12320.03 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 87], 10.00th=[ 127], 20.00th=[10552], | 30.00th=[12518], 40.00th=[14222], 50.00th=[16909], 60.00th=[19792], | 70.00th=[22938], 80.00th=[26346], 90.00th=[33817], 95.00th=[38536], | 99.00th=[61080], 99.50th=[73925], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 192, max= 672, per=24.53%, avg=438.88, stdev=123.61, samples=26 iops : min= 12, max= 42, avg=26.88, stdev= 7.73, samples=26 write: IOPS=29, BW=476KiB/s (487kB/s)(6368KiB/13388msec); 0 zone resets clat (usec): min=1609, max=144431, avg=16537.63, stdev=14712.66 lat (usec): min=1611, max=144433, avg=16539.70, stdev=14712.66 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 24], 90.00th=[ 33], 95.00th=[ 40], | 99.00th=[ 74], 99.50th=[ 111], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 224, max= 736, per=25.25%, avg=475.23, stdev=114.76, samples=26 iops : min= 14, max= 46, avg=29.15, stdev= 7.21, samples=26 lat (usec) : 50=0.52%, 100=2.60%, 250=3.39%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.13%, 4=5.60%, 10=15.49%, 20=36.33%, 50=33.07% lat (msec) : 100=1.95%, 250=0.26% cpu : usr=0.10%, sys=23.72%, ctx=2234, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145709: Sat Jun 27 00:16:34 2026 read: IOPS=27, BW=435KiB/s (445kB/s)(5744KiB/13208msec) clat (usec): min=53, max=102393, avg=17813.30, stdev=11823.42 lat (usec): min=54, max=102395, avg=17814.24, stdev=11823.44 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 101], 10.00th=[ 120], 20.00th=[ 10552], | 30.00th=[ 13435], 40.00th=[ 15401], 50.00th=[ 17433], 60.00th=[ 19268], | 70.00th=[ 21890], 80.00th=[ 25297], 90.00th=[ 31327], 95.00th=[ 36439], | 99.00th=[ 50594], 99.50th=[ 56886], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 223, max= 694, per=24.37%, avg=436.00, stdev=122.28, samples=26 iops : min= 13, max= 43, avg=26.69, stdev= 7.76, samples=26 write: IOPS=30, BW=495KiB/s (507kB/s)(6544KiB/13208msec); 0 zone resets clat (usec): min=1089, max=103921, avg=16481.20, stdev=13683.51 lat (usec): min=1090, max=103923, avg=16483.19, stdev=13683.52 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2573], 10.00th=[ 3654], 20.00th=[ 4752], | 30.00th=[ 6456], 40.00th=[ 9372], 50.00th=[ 13304], 60.00th=[ 16712], | 70.00th=[ 21890], 80.00th=[ 26870], 90.00th=[ 33162], 95.00th=[ 38011], | 99.00th=[ 63177], 99.50th=[ 72877], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 318, max= 669, per=26.29%, avg=494.77, stdev=98.04, samples=26 iops : min= 19, max= 41, avg=30.38, stdev= 6.24, samples=26 lat (usec) : 100=2.21%, 250=4.69%, 500=0.13% lat (msec) : 2=1.69%, 4=5.60%, 10=16.41%, 20=33.72%, 50=33.46% lat (msec) : 100=1.82%, 250=0.26% cpu : usr=0.10%, sys=24.12%, ctx=2340, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145710: Sat Jun 27 00:16:34 2026 read: IOPS=29, BW=471KiB/s (482kB/s)(6256KiB/13282msec) clat (usec): min=41, max=71001, avg=18778.43, stdev=12189.24 lat (usec): min=41, max=71002, avg=18779.97, stdev=12188.58 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 100], 10.00th=[ 159], 20.00th=[11076], | 30.00th=[12780], 40.00th=[14746], 50.00th=[17171], 60.00th=[20055], | 70.00th=[22676], 80.00th=[26608], 90.00th=[34341], 95.00th=[41157], | 99.00th=[59507], 99.50th=[69731], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 254, max= 638, per=26.47%, avg=473.54, stdev=111.71, samples=26 iops : min= 15, max= 39, avg=29.04, stdev= 6.92, samples=26 write: IOPS=28, BW=454KiB/s (465kB/s)(6032KiB/13282msec); 0 zone resets clat (usec): min=1226, max=115145, avg=15565.69, stdev=13021.31 lat (usec): min=1228, max=115147, avg=15567.72, stdev=13021.29 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2704], 10.00th=[ 3818], 20.00th=[ 4948], | 30.00th=[ 6456], 40.00th=[ 9503], 50.00th=[ 12649], 60.00th=[ 15926], | 70.00th=[ 18744], 80.00th=[ 23200], 90.00th=[ 31589], 95.00th=[ 41157], | 99.00th=[ 60031], 99.50th=[ 66847], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 190, max= 662, per=23.82%, avg=448.38, stdev=124.19, samples=26 iops : min= 11, max= 41, avg=27.46, stdev= 7.91, samples=26 lat (usec) : 50=0.13%, 100=2.47%, 250=3.39%, 500=0.26% lat (msec) : 2=1.17%, 4=4.69%, 10=16.28%, 20=38.28%, 50=31.64% lat (msec) : 100=1.56%, 250=0.13% cpu : usr=0.14%, sys=24.16%, ctx=2383, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145711: Sat Jun 27 00:16:34 2026 read: IOPS=28, BW=459KiB/s (470kB/s)(6032KiB/13144msec) clat (usec): min=36, max=78235, avg=17578.55, stdev=12552.96 lat (usec): min=36, max=78235, avg=17579.72, stdev=12552.69 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 83], 10.00th=[ 112], 20.00th=[ 9241], | 30.00th=[12387], 40.00th=[14615], 50.00th=[17433], 60.00th=[19792], | 70.00th=[22152], 80.00th=[25297], 90.00th=[31065], 95.00th=[38011], | 99.00th=[62653], 99.50th=[71828], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 224, max= 702, per=25.28%, avg=452.20, stdev=129.67, samples=25 iops : min= 14, max= 43, avg=27.68, stdev= 8.14, samples=25 write: IOPS=29, BW=476KiB/s (487kB/s)(6256KiB/13144msec); 0 zone resets clat (usec): min=1262, max=106007, avg=16581.88, stdev=14698.30 lat (usec): min=1263, max=106009, avg=16585.39, stdev=14697.02 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2737], 10.00th=[ 3654], 20.00th=[ 4817], | 30.00th=[ 6587], 40.00th=[ 9896], 50.00th=[ 12780], 60.00th=[ 16057], | 70.00th=[ 20055], 80.00th=[ 24773], 90.00th=[ 34866], 95.00th=[ 44303], | 99.00th=[ 76022], 99.50th=[ 89654], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 256, max= 892, per=25.16%, avg=473.52, stdev=143.64, samples=25 iops : min= 16, max= 55, avg=29.04, stdev= 9.07, samples=25 lat (usec) : 50=0.39%, 100=3.78%, 250=4.17%, 500=0.26% lat (msec) : 2=1.30%, 4=5.47%, 10=15.89%, 20=34.64%, 50=30.99% lat (msec) : 100=2.99%, 250=0.13% cpu : usr=0.10%, sys=23.73%, ctx=2341, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1789KiB/s (1832kB/s), 435KiB/s-471KiB/s (445kB/s-482kB/s), io=23.4MiB (24.5MB), run=13144-13388msec WRITE: bw=1882KiB/s (1927kB/s), 454KiB/s-495KiB/s (465kB/s-507kB/s), io=24.6MiB (25.8MB), run=13144-13388msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145713: Sat Jun 27 00:16:45 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(5920KiB/23804msec) clat (msec): min=3, max=108, avg=16.44, stdev=17.12 lat (msec): min=3, max=108, avg=16.44, stdev=17.12 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 37], 95.00th=[ 51], | 99.00th=[ 96], 99.50th=[ 107], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 63, max= 640, per=24.91%, avg=248.81, stdev=133.26, samples=47 iops : min= 3, max= 40, avg=15.09, stdev= 8.49, samples=47 write: IOPS=16, BW=268KiB/s (274kB/s)(6368KiB/23804msec); 0 zone resets clat (msec): min=15, max=196, avg=44.36, stdev=22.91 lat (msec): min=15, max=196, avg=44.37, stdev=22.91 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 50], 80.00th=[ 57], 90.00th=[ 71], 95.00th=[ 91], | 99.00th=[ 125], 99.50th=[ 161], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 95, max= 574, per=25.44%, avg=267.38, stdev=131.67, samples=47 iops : min= 5, max= 35, avg=16.23, stdev= 8.45, samples=47 lat (msec) : 4=0.13%, 10=25.00%, 20=13.80%, 50=43.75%, 100=15.23% lat (msec) : 250=2.08% cpu : usr=0.04%, sys=6.90%, ctx=1557, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145714: Sat Jun 27 00:16:45 2026 read: IOPS=14, BW=240KiB/s (245kB/s)(5744KiB/23963msec) clat (msec): min=4, max=113, avg=15.88, stdev=16.94 lat (msec): min=4, max=113, avg=15.88, stdev=16.94 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 15], 80.00th=[ 22], 90.00th=[ 36], 95.00th=[ 56], | 99.00th=[ 90], 99.50th=[ 113], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 32, max= 704, per=23.88%, avg=238.55, stdev=153.38, samples=47 iops : min= 2, max= 44, avg=14.45, stdev= 9.77, samples=47 write: IOPS=17, BW=273KiB/s (280kB/s)(6544KiB/23963msec); 0 zone resets clat (msec): min=17, max=191, avg=44.37, stdev=22.80 lat (msec): min=17, max=191, avg=44.38, stdev=22.80 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 51], 80.00th=[ 62], 90.00th=[ 78], 95.00th=[ 90], | 99.00th=[ 111], 99.50th=[ 140], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 95, max= 542, per=25.80%, avg=271.19, stdev=126.26, samples=47 iops : min= 5, max= 33, avg=16.49, stdev= 8.07, samples=47 lat (msec) : 10=27.47%, 20=10.16%, 50=43.23%, 100=17.84%, 250=1.30% cpu : usr=0.08%, sys=6.84%, ctx=1637, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145715: Sat Jun 27 00:16:45 2026 read: IOPS=16, BW=267KiB/s (273kB/s)(6256KiB/23445msec) clat (msec): min=3, max=153, avg=16.92, stdev=20.33 lat (msec): min=3, max=153, avg=16.92, stdev=20.33 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 20], 90.00th=[ 42], 95.00th=[ 60], | 99.00th=[ 104], 99.50th=[ 112], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 63, max= 926, per=27.01%, avg=269.83, stdev=184.52, samples=46 iops : min= 3, max= 57, avg=16.39, stdev=11.67, samples=46 write: IOPS=16, BW=257KiB/s (263kB/s)(6032KiB/23445msec); 0 zone resets clat (msec): min=16, max=192, avg=44.32, stdev=22.62 lat (msec): min=16, max=192, avg=44.32, stdev=22.62 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 74], 95.00th=[ 91], | 99.00th=[ 114], 99.50th=[ 159], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 95, max= 509, per=24.36%, avg=255.98, stdev=129.11, samples=46 iops : min= 5, max= 31, avg=15.52, stdev= 8.28, samples=46 lat (msec) : 4=0.39%, 10=29.69%, 20=12.37%, 50=39.45%, 100=16.54% lat (msec) : 250=1.56% cpu : usr=0.09%, sys=7.09%, ctx=1625, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145716: Sat Jun 27 00:16:45 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(6032KiB/23490msec) clat (usec): min=3920, max=94920, avg=15821.32, stdev=14733.08 lat (usec): min=3921, max=94921, avg=15822.36, stdev=14733.04 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5276], 10.00th=[ 5604], 20.00th=[ 6456], | 30.00th=[ 7373], 40.00th=[ 8225], 50.00th=[ 9765], 60.00th=[11600], | 70.00th=[15533], 80.00th=[22152], 90.00th=[37487], 95.00th=[51119], | 99.00th=[68682], 99.50th=[87557], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 63, max= 576, per=25.55%, avg=255.26, stdev=136.57, samples=46 iops : min= 3, max= 36, avg=15.48, stdev= 8.68, samples=46 write: IOPS=16, BW=266KiB/s (273kB/s)(6256KiB/23490msec); 0 zone resets clat (msec): min=16, max=189, avg=44.51, stdev=24.06 lat (msec): min=16, max=189, avg=44.51, stdev=24.06 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 60], 90.00th=[ 80], 95.00th=[ 92], | 99.00th=[ 130], 99.50th=[ 153], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 63, max= 606, per=25.28%, avg=265.70, stdev=135.32, samples=46 iops : min= 3, max= 37, avg=16.13, stdev= 8.68, samples=46 lat (msec) : 4=0.39%, 10=24.87%, 20=14.97%, 50=42.71%, 100=15.76% lat (msec) : 250=1.30% cpu : usr=0.10%, sys=7.11%, ctx=1568, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1000KiB/s (1024kB/s), 240KiB/s-267KiB/s (245kB/s-273kB/s), io=23.4MiB (24.5MB), run=23445-23963msec WRITE: bw=1052KiB/s (1077kB/s), 257KiB/s-273KiB/s (263kB/s-280kB/s), io=24.6MiB (25.8MB), run=23445-23963msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145725: Sat Jun 27 00:16:53 2026 read: IOPS=3, BW=3285KiB/s (3364kB/s)(7168KiB/2182msec) clat (usec): min=578, max=191528, avg=144089.04, stdev=69031.37 lat (usec): min=579, max=191529, avg=144090.28, stdev=69031.24 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[115868], | 30.00th=[149947], 40.00th=[149947], 50.00th=[175113], 60.00th=[187696], | 70.00th=[187696], 80.00th=[189793], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 2048, max= 4837, per=56.59%, avg=3660.33, stdev=1444.64, samples=3 iops : min= 2, max= 4, avg= 3.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2346KiB/s (2403kB/s)(5120KiB/2182msec); 0 zone resets clat (msec): min=166, max=291, avg=224.06, stdev=58.59 lat (msec): min=166, max=292, avg=224.13, stdev=58.58 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2048, max= 4055, per=30.00%, avg=2717.00, stdev=1158.74, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=75.00%, 500=16.67% cpu : usr=0.09%, sys=50.11%, ctx=875, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145726: Sat Jun 27 00:16:53 2026 read: IOPS=0, BW=647KiB/s (662kB/s)(2048KiB/3166msec) clat (usec): min=629, max=88989, avg=44809.47, stdev=62480.54 lat (usec): min=630, max=88992, avg=44811.48, stdev=62481.04 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 627], | 30.00th=[ 627], 40.00th=[ 627], 50.00th=[ 627], 60.00th=[88605], | 70.00th=[88605], 80.00th=[88605], 90.00th=[88605], 95.00th=[88605], | 99.00th=[88605], 99.50th=[88605], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 1615, max= 2048, per=28.32%, avg=1831.50, stdev=306.18, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3234KiB/s (3312kB/s)(10.0MiB/3166msec); 0 zone resets clat (msec): min=103, max=540, avg=306.56, stdev=135.99 lat (msec): min=103, max=540, avg=306.64, stdev=135.99 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 180], | 30.00th=[ 220], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 326], | 70.00th=[ 338], 80.00th=[ 342], 90.00th=[ 506], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2048, max= 4096, per=40.44%, avg=3662.00, stdev=902.88, samples=5 iops : min= 2, max= 4, avg= 3.20, stdev= 0.84, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=39.18%, ctx=336, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145727: Sat Jun 27 00:16:53 2026 read: IOPS=2, BW=2313KiB/s (2369kB/s)(6144KiB/2656msec) clat (usec): min=948, max=203824, avg=106754.57, stdev=92449.05 lat (usec): min=949, max=203825, avg=106755.71, stdev=92449.11 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 947], 10.00th=[ 947], 20.00th=[ 21627], | 30.00th=[ 21627], 40.00th=[ 49021], 50.00th=[ 49021], 60.00th=[181404], | 70.00th=[183501], 80.00th=[183501], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 2048, max= 8110, per=78.53%, avg=5079.00, stdev=4286.48, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2313KiB/s (2369kB/s)(6144KiB/2656msec); 0 zone resets clat (msec): min=135, max=663, avg=328.92, stdev=185.57 lat (msec): min=135, max=665, avg=329.31, stdev=186.27 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 321], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2048, max= 4055, per=31.40%, avg=2844.00, stdev=979.61, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 lat (usec) : 1000=8.33% lat (msec) : 50=16.67%, 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=36.01%, ctx=501, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145728: Sat Jun 27 00:16:53 2026 read: IOPS=1, BW=2046KiB/s (2095kB/s)(5120KiB/2503msec) clat (usec): min=798, max=250189, avg=140802.41, stdev=128248.63 lat (usec): min=800, max=250190, avg=140803.58, stdev=128248.38 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 799], 10.00th=[ 799], 20.00th=[ 799], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[219153], 60.00th=[219153], | 70.00th=[233833], 80.00th=[233833], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 4055, max= 4096, per=63.01%, avg=4075.50, stdev=28.99, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2864KiB/s (2932kB/s)(7168KiB/2503msec); 0 zone resets clat (msec): min=138, max=326, avg=250.34, stdev=74.68 lat (msec): min=138, max=327, avg=250.40, stdev=74.68 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 167], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 275], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 326], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1615, max= 4096, per=28.48%, avg=2579.33, stdev=1329.53, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 1000=16.67% lat (msec) : 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=42.09%, ctx=592, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6469KiB/s (6624kB/s), 647KiB/s-3285KiB/s (662kB/s-3364kB/s), io=20.0MiB (20.0MB), run=2182-3166msec WRITE: bw=9056KiB/s (9274kB/s), 2313KiB/s-3234KiB/s (2369kB/s-3312kB/s), io=28.0MiB (29.4MB), run=2182-3166msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145730: Sat Jun 27 00:16:53 2026 read: IOPS=2, BW=2342KiB/s (2399kB/s)(7168KiB/3060msec) clat (msec): min=58, max=530, avg=217.84, stdev=181.78 lat (msec): min=58, max=530, avg=217.84, stdev=181.78 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 93], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 138], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 418], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1729, max= 4096, per=53.97%, avg=3304.00, stdev=1364.00, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1673KiB/s (1713kB/s)(5120KiB/3060msec); 0 zone resets clat (msec): min=205, max=354, avg=280.39, stdev=57.78 lat (msec): min=205, max=354, avg=280.47, stdev=57.77 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2043, max= 4096, per=31.82%, avg=2727.33, stdev=1185.30, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=13.31%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145731: Sat Jun 27 00:16:53 2026 read: IOPS=0, BW=620KiB/s (635kB/s)(2048KiB/3301msec) clat (msec): min=90, max=387, avg=238.67, stdev=210.08 lat (msec): min=90, max=387, avg=238.67, stdev=210.08 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 1750, max= 2048, per=31.02%, avg=1899.00, stdev=210.72, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3102KiB/s (3177kB/s)(10.0MiB/3301msec); 0 zone resets clat (msec): min=81, max=455, avg=269.42, stdev=127.65 lat (msec): min=81, max=455, avg=269.50, stdev=127.63 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 146], | 30.00th=[ 174], 40.00th=[ 199], 50.00th=[ 234], 60.00th=[ 257], | 70.00th=[ 326], 80.00th=[ 388], 90.00th=[ 439], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2043, max= 6144, per=38.20%, avg=3274.00, stdev=1831.62, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 1.92, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=50.00% cpu : usr=0.00%, sys=15.94%, ctx=153, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145732: Sat Jun 27 00:16:53 2026 read: IOPS=1, BW=1837KiB/s (1881kB/s)(6144KiB/3345msec) clat (msec): min=37, max=278, avg=124.89, stdev=88.50 lat (msec): min=37, max=278, avg=124.89, stdev=88.50 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 130], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 4087, max= 4096, per=66.83%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1837KiB/s (1881kB/s)(6144KiB/3345msec); 0 zone resets clat (msec): min=101, max=897, avg=423.08, stdev=314.49 lat (msec): min=101, max=897, avg=423.15, stdev=314.50 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 567], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2043, max= 4096, per=31.84%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=9.78%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145733: Sat Jun 27 00:16:53 2026 read: IOPS=1, BW=1555KiB/s (1593kB/s)(5120KiB/3292msec) clat (msec): min=37, max=389, avg=189.26, stdev=160.74 lat (msec): min=37, max=389, avg=189.26, stdev=160.74 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 39], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 97], 60.00th=[ 97], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2043, max= 4096, per=44.58%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2177KiB/s (2230kB/s)(7168KiB/3292msec); 0 zone resets clat (msec): min=86, max=766, avg=313.32, stdev=246.22 lat (msec): min=86, max=766, avg=313.39, stdev=246.23 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 95], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 253], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 523], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2043, max= 4087, per=29.83%, avg=2556.50, stdev=1020.34, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=8.33%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=15.16%, ctx=557, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6123KiB/s (6270kB/s), 620KiB/s-2342KiB/s (635kB/s-2399kB/s), io=20.0MiB (20.0MB), run=3060-3345msec WRITE: bw=8572KiB/s (8777kB/s), 1673KiB/s-3102KiB/s (1713kB/s-3177kB/s), io=28.0MiB (29.4MB), run=3060-3345msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145743: Sat Jun 27 00:17:02 2026 read: IOPS=1, BW=5702KiB/s (5839kB/s)(12.0MiB/2155msec) clat (msec): min=138, max=1251, avg=683.56, stdev=556.84 lat (msec): min=138, max=1251, avg=683.56, stdev=556.84 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.59%, ctx=184, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145744: Sat Jun 27 00:17:02 2026 read: IOPS=0, BW=2437KiB/s (2495kB/s)(4096KiB/1681msec) clat (nsec): min=542053k, max=542053k, avg=542053252.00, stdev= 0.00 lat (nsec): min=542055k, max=542055k, avg=542055302.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 5595, max= 5595, per=73.60%, avg=5595.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4873KiB/s (4990kB/s)(8192KiB/1681msec); 0 zone resets clat (msec): min=533, max=579, avg=556.71, stdev=32.37 lat (msec): min=534, max=579, avg=557.03, stdev=32.29 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8126, max= 8126, per=51.58%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.06%, sys=13.45%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145745: Sat Jun 27 00:17:02 2026 write: IOPS=1, BW=5908KiB/s (6049kB/s)(12.0MiB/2080msec); 0 zone resets clat (msec): min=191, max=1128, avg=677.82, stdev=469.40 lat (msec): min=191, max=1128, avg=678.22, stdev=469.68 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8126, max= 8126, per=51.58%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.71%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145746: Sat Jun 27 00:17:02 2026 write: IOPS=1, BW=6994KiB/s (7162kB/s)(12.0MiB/1757msec); 0 zone resets clat (msec): min=398, max=929, avg=577.97, stdev=304.17 lat (msec): min=399, max=929, avg=578.36, stdev=304.21 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 5919, max= 8126, per=44.58%, avg=7022.50, stdev=1560.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.19%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7603KiB/s (7785kB/s), 2437KiB/s-5702KiB/s (2495kB/s-5839kB/s), io=16.0MiB (16.8MB), run=1681-2155msec WRITE: bw=15.4MiB/s (16.1MB/s), 4873KiB/s-6994KiB/s (4990kB/s-7162kB/s), io=32.0MiB (33.6MB), run=1681-2080msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145739: Sat Jun 27 00:17:02 2026 read: IOPS=1, BW=8100KiB/s (8295kB/s)(12.0MiB/1517msec) clat (msec): min=435, max=607, avg=494.17, stdev=98.32 lat (msec): min=435, max=607, avg=494.17, stdev=98.32 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 5809, max= 8192, per=79.78%, avg=7000.50, stdev=1685.04, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=37.14%, ctx=1105, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145740: Sat Jun 27 00:17:02 2026 read: IOPS=0, BW=2194KiB/s (2247kB/s)(4096KiB/1867msec) clat (nsec): min=500880k, max=500880k, avg=500880455.00, stdev= 0.00 lat (nsec): min=500883k, max=500883k, avg=500883217.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 8126, max= 8126, per=92.60%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4388KiB/s (4493kB/s)(8192KiB/1867msec); 0 zone resets clat (msec): min=234, max=1086, avg=660.34, stdev=602.38 lat (msec): min=234, max=1086, avg=660.70, stdev=602.37 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8126, max= 8126, per=57.44%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=17.15%, ctx=441, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145741: Sat Jun 27 00:17:02 2026 write: IOPS=1, BW=5306KiB/s (5433kB/s)(12.0MiB/2316msec); 0 zone resets clat (msec): min=194, max=1108, avg=762.49, stdev=495.35 lat (msec): min=195, max=1108, avg=762.83, stdev=495.40 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8159, max= 8192, per=57.79%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.10%, ctx=82, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145742: Sat Jun 27 00:17:02 2026 write: IOPS=1, BW=6998KiB/s (7166kB/s)(12.0MiB/1756msec); 0 zone resets clat (msec): min=227, max=1251, avg=575.13, stdev=586.25 lat (msec): min=227, max=1252, avg=575.59, stdev=586.17 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min=15875, max=15875, per=100.00%, avg=15875.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.06%, sys=12.31%, ctx=110, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8776KiB/s (8986kB/s), 2194KiB/s-8100KiB/s (2247kB/s-8295kB/s), io=16.0MiB (16.8MB), run=1517-1867msec WRITE: bw=13.8MiB/s (14.5MB/s), 4388KiB/s-6998KiB/s (4493kB/s-7166kB/s), io=32.0MiB (33.6MB), run=1756-2316msec