== sanity test 398b: DIO and buffer IO race ============== 06:23:50 (1778840630) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.89504 s, 17.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160740: Fri May 15 06:24:48 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(5992KiB/48498msec) clat (usec): min=32, max=593044, avg=16484.69, stdev=18045.61 lat (usec): min=33, max=593044, avg=16485.21, stdev=18045.62 clat percentiles (usec): | 1.00th=[ 78], 5.00th=[ 198], 10.00th=[ 6980], 20.00th=[ 8717], | 30.00th=[ 10290], 40.00th=[ 11863], 50.00th=[ 13960], 60.00th=[ 16450], | 70.00th=[ 19006], 80.00th=[ 22414], 90.00th=[ 28967], 95.00th=[ 34866], | 99.00th=[ 53740], 99.50th=[ 65274], 99.90th=[ 80217], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 6, max= 216, per=25.16%, avg=123.02, stdev=40.50, samples=96 iops : min= 1, max= 54, avg=30.39, stdev=10.18, samples=96 write: IOPS=32, BW=130KiB/s (133kB/s)(6296KiB/48498msec); 0 zone resets clat (usec): min=770, max=139565, avg=15014.75, stdev=13596.36 lat (usec): min=771, max=139566, avg=15015.38, stdev=13596.35 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 1975], 10.00th=[ 2704], 20.00th=[ 3621], | 30.00th=[ 5800], 40.00th=[ 9503], 50.00th=[ 12125], 60.00th=[ 15008], | 70.00th=[ 18744], 80.00th=[ 23725], 90.00th=[ 31065], 95.00th=[ 39060], | 99.00th=[ 63177], 99.50th=[ 74974], 99.90th=[135267], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 47, max= 231, per=25.50%, avg=130.55, stdev=40.89, samples=95 iops : min= 11, max= 57, avg=32.27, stdev=10.32, samples=95 lat (usec) : 50=0.16%, 100=0.81%, 250=1.66%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.98% lat (msec) : 2=1.69%, 4=9.05%, 10=21.35%, 20=37.37%, 50=25.23% lat (msec) : 100=1.43%, 250=0.16%, 750=0.03% cpu : usr=0.09%, sys=28.10%, ctx=8698, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160741: Fri May 15 06:24:48 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(5940KiB/49072msec) clat (usec): min=31, max=579802, avg=16821.62, stdev=18364.81 lat (usec): min=32, max=579803, avg=16822.30, stdev=18364.86 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 219], 10.00th=[ 6849], 20.00th=[ 8717], | 30.00th=[ 10552], 40.00th=[ 12256], 50.00th=[ 14222], 60.00th=[ 16450], | 70.00th=[ 19530], 80.00th=[ 22938], 90.00th=[ 28967], 95.00th=[ 34341], | 99.00th=[ 55837], 99.50th=[ 83362], 99.90th=[117965], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 16, max= 247, per=24.84%, avg=121.46, stdev=39.60, samples=96 iops : min= 4, max= 61, avg=30.00, stdev= 9.98, samples=96 write: IOPS=32, BW=129KiB/s (132kB/s)(6348KiB/49072msec); 0 zone resets clat (usec): min=727, max=125635, avg=15063.21, stdev=13589.85 lat (usec): min=728, max=125635, avg=15063.89, stdev=13589.84 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 1860], 10.00th=[ 2638], 20.00th=[ 3556], | 30.00th=[ 5407], 40.00th=[ 8586], 50.00th=[ 11863], 60.00th=[ 15008], | 70.00th=[ 19530], 80.00th=[ 23725], 90.00th=[ 32113], 95.00th=[ 39584], | 99.00th=[ 63177], 99.50th=[ 79168], 99.90th=[ 99091], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 48, max= 271, per=25.17%, avg=128.86, stdev=45.86, samples=96 iops : min= 12, max= 67, avg=31.85, stdev=11.54, samples=96 lat (usec) : 50=0.07%, 100=0.55%, 250=1.89%, 500=0.03%, 750=0.10% lat (usec) : 1000=1.30% lat (msec) : 2=1.53%, 4=9.28%, 10=20.87%, 20=36.04%, 50=26.60% lat (msec) : 100=1.63%, 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=27.56%, ctx=8550, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160742: Fri May 15 06:24:48 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(6028KiB/48007msec) clat (usec): min=27, max=128827, avg=15936.49, stdev=10889.84 lat (usec): min=28, max=128828, avg=15937.16, stdev=10889.85 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 147], 10.00th=[ 6390], 20.00th=[ 8455], | 30.00th=[ 10028], 40.00th=[ 11731], 50.00th=[ 13698], 60.00th=[ 15926], | 70.00th=[ 18744], 80.00th=[ 22938], 90.00th=[ 29754], 95.00th=[ 34866], | 99.00th=[ 49021], 99.50th=[ 53740], 99.90th=[127402], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 47, max= 216, per=25.91%, avg=126.68, stdev=39.24, samples=94 iops : min= 11, max= 54, avg=31.30, stdev= 9.89, samples=94 write: IOPS=32, BW=130KiB/s (134kB/s)(6260KiB/48007msec); 0 zone resets clat (usec): min=760, max=588824, avg=15208.90, stdev=19510.04 lat (usec): min=761, max=588825, avg=15211.77, stdev=19509.79 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 2147], 10.00th=[ 2802], 20.00th=[ 3621], | 30.00th=[ 5407], 40.00th=[ 8586], 50.00th=[ 11731], 60.00th=[ 15008], | 70.00th=[ 19006], 80.00th=[ 23987], 90.00th=[ 31065], 95.00th=[ 39060], | 99.00th=[ 64226], 99.50th=[ 76022], 99.90th=[113771], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 13, max= 223, per=25.41%, avg=130.08, stdev=41.87, samples=95 iops : min= 3, max= 55, avg=32.16, stdev=10.52, samples=95 lat (usec) : 50=0.29%, 100=0.81%, 250=2.21%, 500=0.10%, 1000=0.81% lat (msec) : 2=1.33%, 4=9.41%, 10=22.49%, 20=35.32%, 50=26.01% lat (msec) : 100=1.01%, 250=0.16%, 750=0.03% cpu : usr=0.09%, sys=28.35%, ctx=8575, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160743: Fri May 15 06:24:48 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(6052KiB/48917msec) clat (usec): min=35, max=121085, avg=16179.06, stdev=10548.93 lat (usec): min=35, max=121086, avg=16179.61, stdev=10548.95 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 155], 10.00th=[ 6521], 20.00th=[ 8586], | 30.00th=[ 9896], 40.00th=[ 11994], 50.00th=[ 14091], 60.00th=[ 16450], | 70.00th=[ 19530], 80.00th=[ 23200], 90.00th=[ 29492], 95.00th=[ 35914], | 99.00th=[ 48497], 99.50th=[ 55837], 99.90th=[ 80217], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 32, max= 208, per=25.49%, avg=124.62, stdev=39.63, samples=96 iops : min= 8, max= 52, avg=30.79, stdev= 9.96, samples=96 write: IOPS=31, BW=127KiB/s (131kB/s)(6236KiB/48917msec); 0 zone resets clat (usec): min=775, max=633405, avg=15557.84, stdev=20377.35 lat (usec): min=776, max=633406, avg=15558.52, stdev=20377.38 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 2245], 10.00th=[ 2835], 20.00th=[ 3785], | 30.00th=[ 6063], 40.00th=[ 9503], 50.00th=[ 12256], 60.00th=[ 15139], | 70.00th=[ 19006], 80.00th=[ 23987], 90.00th=[ 31327], 95.00th=[ 38536], | 99.00th=[ 65274], 99.50th=[ 71828], 99.90th=[114820], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 48, max= 224, per=25.09%, avg=128.45, stdev=39.18, samples=96 iops : min= 12, max= 56, avg=31.75, stdev= 9.90, samples=96 lat (usec) : 50=0.13%, 100=1.11%, 250=1.73%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.62% lat (msec) : 2=1.30%, 4=8.92%, 10=22.14%, 20=36.17%, 50=26.20% lat (msec) : 100=1.43%, 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=27.82%, ctx=8754, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=489KiB/s (501kB/s), 121KiB/s-126KiB/s (124kB/s-129kB/s), io=23.4MiB (24.6MB), run=48007-49072msec WRITE: bw=512KiB/s (525kB/s), 127KiB/s-130KiB/s (131kB/s-134kB/s), io=24.6MiB (25.7MB), run=48007-49072msec fio: pid=160747, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=160745: Fri May 15 06:25:16 2026 read: IOPS=19, BW=77.0KiB/s (79.9kB/s)(5992KiB/76827msec) clat (msec): min=2, max=600, avg=14.33, stdev=20.39 lat (msec): min=2, max=600, avg=14.33, stdev=20.39 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 30], 95.00th=[ 41], | 99.00th=[ 73], 99.50th=[ 85], 99.90th=[ 130], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 208, per=26.52%, avg=78.51, stdev=40.32, samples=152 iops : min= 1, max= 52, avg=19.38, stdev=10.23, samples=152 write: IOPS=20, BW=81.0KiB/s (83.9kB/s)(6296KiB/76827msec); 0 zone resets clat (msec): min=14, max=175, avg=35.10, stdev=16.63 lat (msec): min=14, max=175, avg=35.10, stdev=16.63 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 66], | 99.00th=[ 96], 99.50th=[ 123], 99.90th=[ 159], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 152, per=26.58%, avg=82.40, stdev=34.48, samples=152 iops : min= 7, max= 38, avg=20.35, stdev= 8.80, samples=152 lat (msec) : 4=5.11%, 10=21.16%, 20=16.70%, 50=48.11%, 100=8.37% lat (msec) : 250=0.52%, 750=0.03% cpu : usr=0.08%, sys=8.95%, ctx=6028, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160746: Fri May 15 06:25:16 2026 read: IOPS=19, BW=77.2KiB/s (79.1kB/s)(5940KiB/76915msec) clat (msec): min=2, max=583, avg=14.31, stdev=20.19 lat (msec): min=2, max=583, avg=14.31, stdev=20.19 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 41], | 99.00th=[ 70], 99.50th=[ 85], 99.90th=[ 138], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8, max= 192, per=26.24%, avg=77.66, stdev=41.59, samples=152 iops : min= 2, max= 48, avg=19.16, stdev=10.52, samples=152 write: IOPS=20, BW=82.5KiB/s (84.5kB/s)(6348KiB/76915msec); 0 zone resets clat (msec): min=11, max=159, avg=35.00, stdev=16.23 lat (msec): min=11, max=159, avg=35.00, stdev=16.23 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 67], | 99.00th=[ 94], 99.50th=[ 112], 99.90th=[ 146], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 23, max= 152, per=26.70%, avg=82.77, stdev=34.23, samples=152 iops : min= 5, max= 38, avg=20.44, stdev= 8.75, samples=152 lat (msec) : 4=5.08%, 10=21.00%, 20=16.37%, 50=48.86%, 100=8.14% lat (msec) : 250=0.52%, 750=0.03% cpu : usr=0.06%, sys=9.03%, ctx=5914, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=160747: Fri May 15 06:25:16 2026 read: IOPS=18, BW=72.3KiB/s (74.0kB/s)(4816KiB/66641msec) clat (msec): min=2, max=124, avg=16.15, stdev=14.95 lat (msec): min=2, max=124, avg=16.15, stdev=14.95 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 68], 99.50th=[ 88], 99.90th=[ 115], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 8, max= 192, per=24.50%, avg=72.53, stdev=37.65, samples=131 iops : min= 2, max= 48, avg=17.84, stdev= 9.54, samples=131 write: IOPS=18, BW=75.3KiB/s (77.1kB/s)(5020KiB/66641msec); 0 zone resets clat (msec): min=13, max=599, avg=37.51, stdev=23.10 lat (msec): min=13, max=599, avg=37.51, stdev=23.10 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 42], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 97], 99.50th=[ 121], 99.90th=[ 178], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 16, max= 144, per=24.42%, avg=75.70, stdev=31.56, samples=131 iops : min= 4, max= 36, avg=18.63, stdev= 8.04, samples=131 lat (msec) : 4=4.39%, 10=17.60%, 20=16.22%, 50=51.75%, 100=9.35% lat (msec) : 250=0.61%, 750=0.04% cpu : usr=0.04%, sys=9.12%, ctx=4590, majf=0, minf=22 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1205,1255,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160748: Fri May 15 06:25:16 2026 read: IOPS=19, BW=78.0KiB/s (80.9kB/s)(6052KiB/76633msec) clat (msec): min=2, max=151, avg=14.25, stdev=14.31 lat (msec): min=2, max=151, avg=14.25, stdev=14.31 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 42], | 99.00th=[ 66], 99.50th=[ 85], 99.90th=[ 138], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 7, max= 200, per=26.77%, avg=79.24, stdev=41.20, samples=151 iops : min= 1, max= 50, avg=19.56, stdev=10.45, samples=151 write: IOPS=20, BW=81.4KiB/s (83.3kB/s)(6236KiB/76633msec); 0 zone resets clat (msec): min=14, max=628, avg=35.25, stdev=21.89 lat (msec): min=14, max=628, avg=35.26, stdev=21.89 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 66], | 99.00th=[ 95], 99.50th=[ 113], 99.90th=[ 161], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 32, max= 152, per=26.33%, avg=81.62, stdev=33.81, samples=151 iops : min= 8, max= 38, avg=20.15, stdev= 8.63, samples=151 lat (msec) : 4=5.31%, 10=21.26%, 20=15.27%, 50=49.71%, 100=7.91% lat (msec) : 250=0.52%, 750=0.03% cpu : usr=0.06%, sys=9.02%, ctx=5940, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=296KiB/s (304kB/s), 72.3KiB/s-78.0KiB/s (74.0kB/s-80.9kB/s), io=22.3MiB (23.3MB), run=66641-76915msec WRITE: bw=311KiB/s (318kB/s), 75.3KiB/s-82.5KiB/s (77.1kB/s-84.5kB/s), io=23.3MiB (24.5MB), run=66641-76915msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160773: Fri May 15 06:25:35 2026 read: IOPS=32, BW=523KiB/s (535kB/s)(5920KiB/11327msec) clat (usec): min=32, max=56059, avg=14390.64, stdev=9694.08 lat (usec): min=32, max=56059, avg=14391.21, stdev=9694.09 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 98], 10.00th=[ 119], 20.00th=[ 7570], | 30.00th=[10421], 40.00th=[12125], 50.00th=[13829], 60.00th=[15795], | 70.00th=[17695], 80.00th=[20055], 90.00th=[26084], 95.00th=[31589], | 99.00th=[45351], 99.50th=[49546], 99.90th=[55837], 99.95th=[55837], | 99.99th=[55837] bw ( KiB/s): min= 320, max= 702, per=25.32%, avg=522.41, stdev=114.18, samples=22 iops : min= 20, max= 43, avg=32.23, stdev= 6.93, samples=22 write: IOPS=35, BW=562KiB/s (576kB/s)(6368KiB/11327msec); 0 zone resets clat (usec): min=986, max=101750, avg=14927.22, stdev=13627.98 lat (usec): min=987, max=101751, avg=14928.00, stdev=13627.98 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2769], 10.00th=[ 3589], 20.00th=[ 4359], | 30.00th=[ 5604], 40.00th=[ 8586], 50.00th=[ 11469], 60.00th=[ 13698], | 70.00th=[ 17695], 80.00th=[ 23725], 90.00th=[ 31589], 95.00th=[ 40633], | 99.00th=[ 63177], 99.50th=[ 96994], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 383, max= 704, per=25.97%, avg=563.91, stdev=88.33, samples=22 iops : min= 23, max= 44, avg=34.82, stdev= 5.68, samples=22 lat (usec) : 50=0.52%, 100=1.95%, 250=4.82%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.69%, 4=6.12%, 10=21.35%, 20=39.97%, 50=21.48% lat (msec) : 100=1.43%, 250=0.13% cpu : usr=0.12%, sys=29.46%, ctx=2250, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160774: Fri May 15 06:25:35 2026 read: IOPS=30, BW=496KiB/s (508kB/s)(5744KiB/11589msec) clat (usec): min=37, max=79972, avg=15734.36, stdev=9827.43 lat (usec): min=38, max=79973, avg=15734.89, stdev=9827.39 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 103], 10.00th=[ 149], 20.00th=[ 9503], | 30.00th=[11469], 40.00th=[12780], 50.00th=[14877], 60.00th=[17171], | 70.00th=[19006], 80.00th=[22414], 90.00th=[25822], 95.00th=[31327], | 99.00th=[41681], 99.50th=[71828], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 266, max= 702, per=24.42%, avg=503.82, stdev=110.75, samples=22 iops : min= 16, max= 43, avg=31.05, stdev= 6.76, samples=22 write: IOPS=35, BW=565KiB/s (578kB/s)(6544KiB/11589msec); 0 zone resets clat (usec): min=977, max=75212, avg=14216.50, stdev=11957.03 lat (usec): min=977, max=75212, avg=14217.31, stdev=11957.03 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 3064], 10.00th=[ 3785], 20.00th=[ 4490], | 30.00th=[ 5538], 40.00th=[ 7111], 50.00th=[10683], 60.00th=[13304], | 70.00th=[17433], 80.00th=[22414], 90.00th=[31065], 95.00th=[38011], | 99.00th=[50070], 99.50th=[51643], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 320, max= 766, per=25.95%, avg=563.32, stdev=133.24, samples=22 iops : min= 20, max= 47, avg=34.77, stdev= 8.34, samples=22 lat (usec) : 50=0.13%, 100=2.08%, 250=2.99%, 500=0.13%, 1000=0.26% lat (msec) : 2=1.30%, 4=5.08%, 10=23.57%, 20=38.93%, 50=24.87% lat (msec) : 100=0.65% cpu : usr=0.08%, sys=30.37%, ctx=2336, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160775: Fri May 15 06:25:35 2026 read: IOPS=33, BW=539KiB/s (552kB/s)(6256KiB/11606msec) clat (usec): min=33, max=59253, avg=15484.74, stdev=9795.26 lat (usec): min=34, max=59254, avg=15485.36, stdev=9795.31 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 101], 10.00th=[ 125], 20.00th=[ 9372], | 30.00th=[11076], 40.00th=[12518], 50.00th=[14222], 60.00th=[16909], | 70.00th=[19792], 80.00th=[22152], 90.00th=[27395], 95.00th=[32113], | 99.00th=[50594], 99.50th=[56886], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 160, max= 758, per=26.42%, avg=545.09, stdev=139.30, samples=22 iops : min= 10, max= 47, avg=33.64, stdev= 8.62, samples=22 write: IOPS=32, BW=520KiB/s (532kB/s)(6032KiB/11606msec); 0 zone resets clat (usec): min=979, max=152907, avg=14662.71, stdev=14054.89 lat (usec): min=980, max=152909, avg=14664.77, stdev=14058.02 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 3359], 10.00th=[ 3916], 20.00th=[ 4621], | 30.00th=[ 5473], 40.00th=[ 7373], 50.00th=[ 10683], 60.00th=[ 13829], | 70.00th=[ 17433], 80.00th=[ 23200], 90.00th=[ 30540], 95.00th=[ 36963], | 99.00th=[ 63177], 99.50th=[ 73925], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 288, max= 640, per=23.54%, avg=511.09, stdev=100.85, samples=22 iops : min= 18, max= 40, avg=31.50, stdev= 6.21, samples=22 lat (usec) : 50=0.91%, 100=1.56%, 250=4.04%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=4.56%, 10=23.70%, 20=37.11%, 50=25.39% lat (msec) : 100=1.56%, 250=0.13% cpu : usr=0.10%, sys=30.00%, ctx=2318, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160776: Fri May 15 06:25:35 2026 read: IOPS=34, BW=555KiB/s (568kB/s)(6032KiB/10868msec) clat (usec): min=31, max=89590, avg=14136.59, stdev=9790.59 lat (usec): min=31, max=89591, avg=14137.16, stdev=9790.62 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 98], 10.00th=[ 115], 20.00th=[ 8586], | 30.00th=[10552], 40.00th=[11994], 50.00th=[13698], 60.00th=[15401], | 70.00th=[17433], 80.00th=[19530], 90.00th=[24511], 95.00th=[29492], | 99.00th=[45351], 99.50th=[62653], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 351, max= 766, per=26.94%, avg=555.86, stdev=119.17, samples=21 iops : min= 21, max= 47, avg=34.29, stdev= 7.44, samples=21 write: IOPS=35, BW=576KiB/s (589kB/s)(6256KiB/10868msec); 0 zone resets clat (usec): min=1041, max=142193, avg=13930.68, stdev=13302.09 lat (usec): min=1042, max=142194, avg=13931.51, stdev=13302.12 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 2835], 10.00th=[ 3818], 20.00th=[ 4555], | 30.00th=[ 5407], 40.00th=[ 7046], 50.00th=[ 9896], 60.00th=[ 12518], | 70.00th=[ 16188], 80.00th=[ 22152], 90.00th=[ 28705], 95.00th=[ 38011], | 99.00th=[ 56361], 99.50th=[ 68682], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 383, max= 768, per=26.67%, avg=579.00, stdev=114.25, samples=21 iops : min= 23, max= 48, avg=35.71, stdev= 7.09, samples=21 lat (usec) : 50=0.39%, 100=2.21%, 250=4.69%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.95%, 4=4.43%, 10=24.48%, 20=40.49%, 50=20.05% lat (msec) : 100=0.91%, 250=0.13% cpu : usr=0.12%, sys=30.03%, ctx=2171, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2064KiB/s (2113kB/s), 496KiB/s-555KiB/s (508kB/s-568kB/s), io=23.4MiB (24.5MB), run=10868-11606msec WRITE: bw=2171KiB/s (2223kB/s), 520KiB/s-576KiB/s (532kB/s-589kB/s), io=24.6MiB (25.8MB), run=10868-11606msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160777: Fri May 15 06:25:43 2026 read: IOPS=18, BW=298KiB/s (306kB/s)(5920KiB/19834msec) clat (usec): min=3241, max=83398, avg=15328.35, stdev=11861.53 lat (usec): min=3241, max=83398, avg=15329.13, stdev=11861.80 clat percentiles (usec): | 1.00th=[ 3949], 5.00th=[ 4621], 10.00th=[ 5669], 20.00th=[ 7701], | 30.00th=[ 8717], 40.00th=[10028], 50.00th=[11076], 60.00th=[13042], | 70.00th=[15926], 80.00th=[21103], 90.00th=[30802], 95.00th=[40633], | 99.00th=[63177], 99.50th=[67634], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 31, max= 640, per=24.93%, avg=296.92, stdev=132.30, samples=39 iops : min= 1, max= 40, avg=18.31, stdev= 8.44, samples=39 write: IOPS=20, BW=321KiB/s (329kB/s)(6368KiB/19834msec); 0 zone resets clat (msec): min=14, max=139, avg=35.34, stdev=17.93 lat (msec): min=14, max=139, avg=35.34, stdev=17.93 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 38], 80.00th=[ 45], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 94], 99.50th=[ 140], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 128, max= 576, per=25.63%, avg=321.13, stdev=136.77, samples=39 iops : min= 8, max= 36, avg=19.82, stdev= 8.75, samples=39 lat (msec) : 4=0.65%, 10=18.62%, 20=23.31%, 50=48.18%, 100=8.85% lat (msec) : 250=0.39% cpu : usr=0.04%, sys=10.81%, ctx=1645, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160778: Fri May 15 06:25:43 2026 read: IOPS=17, BW=286KiB/s (293kB/s)(5744KiB/20099msec) clat (msec): min=3, max=105, avg=15.68, stdev=13.24 lat (msec): min=3, max=105, avg=15.68, stdev=13.24 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 21], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 68], 99.50th=[ 70], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 53, max= 608, per=24.06%, avg=286.54, stdev=154.46, samples=39 iops : min= 3, max= 38, avg=17.67, stdev= 9.83, samples=39 write: IOPS=20, BW=326KiB/s (333kB/s)(6544KiB/20099msec); 0 zone resets clat (msec): min=14, max=151, avg=35.32, stdev=16.82 lat (msec): min=14, max=151, avg=35.32, stdev=16.82 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 70], | 99.00th=[ 90], 99.50th=[ 95], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 63, max= 608, per=25.53%, avg=319.87, stdev=132.71, samples=39 iops : min= 3, max= 38, avg=19.74, stdev= 8.48, samples=39 lat (msec) : 4=1.69%, 10=17.32%, 20=23.83%, 50=47.40%, 100=9.38% lat (msec) : 250=0.39% cpu : usr=0.03%, sys=10.81%, ctx=1655, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160779: Fri May 15 06:25:43 2026 read: IOPS=19, BW=311KiB/s (319kB/s)(6256KiB/20086msec) clat (msec): min=3, max=111, avg=16.48, stdev=15.68 lat (msec): min=3, max=111, avg=16.48, stdev=15.68 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 35], 95.00th=[ 52], | 99.00th=[ 93], 99.50th=[ 106], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 127, max= 832, per=26.21%, avg=312.10, stdev=165.24, samples=39 iops : min= 7, max= 52, avg=19.26, stdev=10.51, samples=39 write: IOPS=18, BW=300KiB/s (308kB/s)(6032KiB/20086msec); 0 zone resets clat (msec): min=12, max=151, avg=35.99, stdev=18.24 lat (msec): min=12, max=151, avg=35.99, stdev=18.24 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 74], | 99.00th=[ 102], 99.50th=[ 110], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 95, max= 608, per=23.56%, avg=295.26, stdev=137.43, samples=39 iops : min= 5, max= 38, avg=18.21, stdev= 8.78, samples=39 lat (msec) : 4=1.17%, 10=20.70%, 20=23.70%, 50=43.23%, 100=10.42% lat (msec) : 250=0.78% cpu : usr=0.07%, sys=10.82%, ctx=1702, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160780: Fri May 15 06:25:43 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(6032KiB/19976msec) clat (msec): min=3, max=113, avg=15.30, stdev=13.42 lat (msec): min=3, max=113, avg=15.30, stdev=13.42 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 45], | 99.00th=[ 67], 99.50th=[ 89], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 96, max= 640, per=25.10%, avg=298.95, stdev=141.80, samples=39 iops : min= 6, max= 40, avg=18.44, stdev= 9.03, samples=39 write: IOPS=19, BW=313KiB/s (321kB/s)(6256KiB/19976msec); 0 zone resets clat (msec): min=14, max=115, avg=35.96, stdev=17.96 lat (msec): min=14, max=115, avg=35.96, stdev=17.96 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 63], 95.00th=[ 75], | 99.00th=[ 101], 99.50th=[ 111], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 158, max= 608, per=24.84%, avg=311.28, stdev=139.65, samples=39 iops : min= 9, max= 38, avg=19.21, stdev= 8.95, samples=39 lat (msec) : 4=1.04%, 10=20.57%, 20=22.79%, 50=45.57%, 100=9.38% lat (msec) : 250=0.65% cpu : usr=0.06%, sys=10.83%, ctx=1627, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1192KiB/s (1220kB/s), 286KiB/s-311KiB/s (293kB/s-319kB/s), io=23.4MiB (24.5MB), run=19834-20099msec WRITE: bw=1254KiB/s (1284kB/s), 300KiB/s-326KiB/s (308kB/s-333kB/s), io=24.6MiB (25.8MB), run=19834-20099msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160789: Fri May 15 06:25:53 2026 read: IOPS=2, BW=2126KiB/s (2177kB/s)(7168KiB/3372msec) clat (usec): min=633, max=329404, avg=179033.16, stdev=97727.88 lat (usec): min=634, max=329406, avg=179034.32, stdev=97727.84 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[162530], | 30.00th=[162530], 40.00th=[162530], 50.00th=[175113], 60.00th=[208667], | 70.00th=[208667], 80.00th=[217056], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2027, max= 5171, per=82.71%, avg=3751.00, stdev=1593.89, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1518KiB/s (1555kB/s)(5120KiB/3372msec); 0 zone resets clat (msec): min=324, max=521, avg=422.15, stdev=85.36 lat (msec): min=324, max=521, avg=422.20, stdev=85.36 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1892, max= 2048, per=31.47%, avg=1998.50, stdev=71.69, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=49.30%, ctx=670, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160790: Fri May 15 06:25:53 2026 read: IOPS=0, BW=454KiB/s (464kB/s)(2048KiB/4515msec) clat (msec): min=372, max=629, avg=500.76, stdev=181.40 lat (msec): min=372, max=629, avg=500.76, stdev=181.40 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2027, max= 2048, per=44.93%, avg=2037.50, stdev=14.85, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2268KiB/s (2322kB/s)(10.0MiB/4515msec); 0 zone resets clat (msec): min=162, max=949, avg=346.00, stdev=238.51 lat (msec): min=162, max=949, avg=346.06, stdev=238.51 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 211], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 288], 80.00th=[ 384], 90.00th=[ 542], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2027, max= 6083, per=51.34%, avg=3260.40, stdev=1811.52, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.64, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=46.06%, ctx=630, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160791: Fri May 15 06:25:53 2026 read: IOPS=1, BW=1674KiB/s (1714kB/s)(6144KiB/3671msec) clat (usec): min=548, max=381719, avg=140986.34, stdev=164238.36 lat (usec): min=592, max=381720, avg=141060.22, stdev=164163.53 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 594], | 30.00th=[ 594], 40.00th=[ 627], 50.00th=[ 627], 60.00th=[204473], | 70.00th=[258999], 80.00th=[258999], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 2048, max= 4055, per=72.68%, avg=3296.00, stdev=1089.20, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1674KiB/s (1714kB/s)(6144KiB/3671msec); 0 zone resets clat (msec): min=242, max=1189, avg=464.23, stdev=364.22 lat (msec): min=242, max=1189, avg=464.28, stdev=364.24 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 380], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1892, max= 4096, per=45.17%, avg=2868.50, stdev=1082.76, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=25.00% lat (msec) : 250=25.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=41.96%, ctx=741, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160792: Fri May 15 06:25:53 2026 read: IOPS=1, BW=1382KiB/s (1415kB/s)(5120KiB/3705msec) clat (usec): min=858, max=305151, avg=197475.30, stdev=128902.65 lat (usec): min=859, max=305153, avg=197476.61, stdev=128903.03 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[ 857], | 30.00th=[139461], 40.00th=[139461], 50.00th=[235930], 60.00th=[235930], | 70.00th=[304088], 80.00th=[304088], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 1892, max= 6083, per=87.93%, avg=3987.50, stdev=2963.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1935KiB/s (1981kB/s)(7168KiB/3705msec); 0 zone resets clat (msec): min=208, max=611, avg=384.43, stdev=160.87 lat (msec): min=208, max=611, avg=384.49, stdev=160.88 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 222], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 355], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 567], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1726, max= 4055, per=37.00%, avg=2349.60, stdev=961.99, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=43.68%, ctx=509, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4536KiB/s (4645kB/s), 454KiB/s-2126KiB/s (464kB/s-2177kB/s), io=20.0MiB (20.0MB), run=3372-4515msec WRITE: bw=6350KiB/s (6503kB/s), 1518KiB/s-2268KiB/s (1555kB/s-2322kB/s), io=28.0MiB (29.4MB), run=3372-4515msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160794: Fri May 15 06:25:53 2026 read: IOPS=1, BW=1640KiB/s (1680kB/s)(7168KiB/4370msec) clat (msec): min=82, max=675, avg=280.76, stdev=192.92 lat (msec): min=82, max=675, avg=280.76, stdev=192.92 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 157], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 226], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 330], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1592, max= 4096, per=52.75%, avg=2323.60, stdev=1005.80, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 write: IOPS=1, BW=1172KiB/s (1200kB/s)(5120KiB/4370msec); 0 zone resets clat (msec): min=322, max=644, avg=445.33, stdev=128.53 lat (msec): min=322, max=644, avg=445.39, stdev=128.53 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2015, max= 2048, per=32.99%, avg=2034.25, stdev=14.68, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=16.62%, ctx=205, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160795: Fri May 15 06:25:53 2026 read: IOPS=0, BW=446KiB/s (456kB/s)(2048KiB/4594msec) clat (msec): min=208, max=322, avg=265.81, stdev=80.45 lat (msec): min=208, max=322, avg=265.81, stdev=80.45 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1965, max= 2043, per=45.49%, avg=2004.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2229KiB/s (2282kB/s)(10.0MiB/4594msec); 0 zone resets clat (msec): min=84, max=1586, avg=374.92, stdev=447.20 lat (msec): min=84, max=1586, avg=374.99, stdev=447.20 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 121], | 30.00th=[ 122], 40.00th=[ 167], 50.00th=[ 171], 60.00th=[ 251], | 70.00th=[ 326], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1965, max= 3835, per=38.72%, avg=2387.80, stdev=809.78, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=17.33%, ctx=145, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160796: Fri May 15 06:25:53 2026 read: IOPS=1, BW=1485KiB/s (1521kB/s)(6144KiB/4136msec) clat (msec): min=73, max=413, avg=209.85, stdev=127.11 lat (msec): min=73, max=413, avg=209.85, stdev=127.11 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 192], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 4063, max= 4087, per=92.51%, avg=4075.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1485KiB/s (1521kB/s)(6144KiB/4136msec); 0 zone resets clat (msec): min=107, max=1345, avg=474.42, stdev=462.37 lat (msec): min=107, max=1345, avg=474.48, stdev=462.38 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 485], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 1528, max= 2048, per=30.63%, avg=1889.00, stdev=243.07, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.20%, ctx=149, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160797: Fri May 15 06:25:53 2026 read: IOPS=1, BW=1101KiB/s (1128kB/s)(5120KiB/4649msec) clat (msec): min=25, max=649, avg=280.94, stdev=250.61 lat (msec): min=25, max=649, avg=280.94, stdev=250.61 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 26], 10.00th=[ 26], 20.00th=[ 26], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2015, max= 4096, per=61.70%, avg=2718.00, stdev=1193.47, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1542KiB/s (1579kB/s)(7168KiB/4649msec); 0 zone resets clat (msec): min=97, max=1304, avg=414.32, stdev=411.54 lat (msec): min=97, max=1304, avg=414.41, stdev=411.54 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 117], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 321], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 414], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1965, max= 4063, per=43.65%, avg=2692.00, stdev=1188.05, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=13.34%, ctx=297, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4405KiB/s (4511kB/s), 446KiB/s-1640KiB/s (456kB/s-1680kB/s), io=20.0MiB (20.0MB), run=4136-4649msec WRITE: bw=6167KiB/s (6315kB/s), 1172KiB/s-2229KiB/s (1200kB/s-2282kB/s), io=28.0MiB (29.4MB), run=4136-4649msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160805: Fri May 15 06:26:05 2026 read: IOPS=1, BW=7488KiB/s (7668kB/s)(12.0MiB/1641msec) clat (msec): min=379, max=751, avg=543.81, stdev=189.66 lat (msec): min=379, max=751, avg=543.81, stdev=189.66 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7953, max= 8192, per=100.00%, avg=8072.50, stdev=169.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=42.13%, ctx=2283, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160806: Fri May 15 06:26:05 2026 read: IOPS=0, BW=1876KiB/s (1921kB/s)(4096KiB/2183msec) clat (nsec): min=277578k, max=277578k, avg=277578162.00, stdev= 0.00 lat (nsec): min=277579k, max=277579k, avg=277579167.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7288, max= 7288, per=97.11%, avg=7288.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3753KiB/s (3843kB/s)(8192KiB/2183msec); 0 zone resets clat (msec): min=740, max=1146, avg=943.49, stdev=286.45 lat (msec): min=741, max=1146, avg=943.72, stdev=286.41 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8192, max= 8192, per=54.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.55%, ctx=857, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160807: Fri May 15 06:26:05 2026 write: IOPS=1, BW=6241KiB/s (6391kB/s)(12.0MiB/1969msec); 0 zone resets clat (msec): min=422, max=1069, avg=649.30, stdev=364.51 lat (msec): min=423, max=1070, avg=649.66, stdev=364.42 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=15.75%, ctx=149, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160808: Fri May 15 06:26:05 2026 write: IOPS=1, BW=5616KiB/s (5751kB/s)(12.0MiB/2188msec); 0 zone resets clat (msec): min=364, max=913, avg=724.69, stdev=311.77 lat (msec): min=364, max=913, avg=724.87, stdev=311.80 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7953, max= 8047, per=53.42%, avg=8000.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.22%, ctx=130, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7505KiB/s (7685kB/s), 1876KiB/s-7488KiB/s (1921kB/s-7668kB/s), io=16.0MiB (16.8MB), run=1641-2183msec WRITE: bw=14.6MiB/s (15.3MB/s), 3753KiB/s-6241KiB/s (3843kB/s-6391kB/s), io=32.0MiB (33.6MB), run=1969-2188msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160810: Fri May 15 06:26:05 2026 read: IOPS=1, BW=6092KiB/s (6238kB/s)(12.0MiB/2017msec) clat (msec): min=164, max=1085, avg=665.56, stdev=466.31 lat (msec): min=164, max=1085, avg=665.56, stdev=466.31 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.66%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160811: Fri May 15 06:26:05 2026 read: IOPS=0, BW=1858KiB/s (1902kB/s)(4096KiB/2205msec) clat (nsec): min=1176.5M, max=1176.5M, avg=1176519528.00, stdev= 0.00 lat (nsec): min=1176.5M, max=1176.5M, avg=1176521905.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3715KiB/s (3804kB/s)(8192KiB/2205msec); 0 zone resets clat (msec): min=477, max=505, avg=491.16, stdev=19.97 lat (msec): min=477, max=505, avg=491.35, stdev=20.04 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 8031, max= 8031, per=54.04%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.56%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160812: Fri May 15 06:26:05 2026 write: IOPS=1, BW=5591KiB/s (5725kB/s)(12.0MiB/2198msec); 0 zone resets clat (msec): min=131, max=1302, avg=712.79, stdev=585.78 lat (msec): min=131, max=1302, avg=713.08, stdev=585.79 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8062, max= 8062, per=54.25%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.56%, ctx=102, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160813: Fri May 15 06:26:05 2026 write: IOPS=1, BW=6631KiB/s (6791kB/s)(12.0MiB/1853msec); 0 zone resets clat (msec): min=251, max=865, avg=593.38, stdev=312.82 lat (msec): min=251, max=866, avg=593.60, stdev=312.91 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8047, max= 8047, per=54.15%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.01%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7430KiB/s (7609kB/s), 1858KiB/s-6092KiB/s (1902kB/s-6238kB/s), io=16.0MiB (16.8MB), run=2017-2205msec WRITE: bw=14.5MiB/s (15.2MB/s), 3715KiB/s-6631KiB/s (3804kB/s-6791kB/s), io=32.0MiB (33.6MB), run=1853-2205msec