== sanity test 398b: DIO and buffer IO race ============== 21:28:59 (1778290139) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.77041 s, 18.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150205: Fri May 8 21:30:06 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(5992KiB/57033msec) clat (usec): min=33, max=563527, avg=18767.32, stdev=18619.24 lat (usec): min=33, max=563529, avg=18768.29, stdev=18619.29 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 103], 10.00th=[ 7767], 20.00th=[ 10159], | 30.00th=[ 11600], 40.00th=[ 13435], 50.00th=[ 15664], 60.00th=[ 18482], | 70.00th=[ 22152], 80.00th=[ 26608], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 60556], 99.50th=[ 73925], 99.90th=[117965], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 47, max= 184, per=25.26%, avg=105.61, stdev=28.76, samples=112 iops : min= 11, max= 46, avg=25.90, stdev= 7.19, samples=112 write: IOPS=27, BW=110KiB/s (113kB/s)(6296KiB/57033msec); 0 zone resets clat (usec): min=925, max=181759, avg=18261.56, stdev=17546.93 lat (usec): min=926, max=181760, avg=18264.49, stdev=17545.90 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1549], 10.00th=[ 2114], 20.00th=[ 3130], | 30.00th=[ 5211], 40.00th=[ 10028], 50.00th=[ 14484], 60.00th=[ 18482], | 70.00th=[ 23725], 80.00th=[ 29754], 90.00th=[ 39584], 95.00th=[ 50070], | 99.00th=[ 72877], 99.50th=[100140], 99.90th=[139461], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 47, max= 207, per=25.36%, avg=111.09, stdev=32.44, samples=112 iops : min= 11, max= 51, avg=27.28, stdev= 8.14, samples=112 lat (usec) : 50=0.36%, 100=1.99%, 250=1.20%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=4.49%, 4=8.33%, 10=13.31%, 20=33.59%, 50=32.85% lat (msec) : 100=3.22%, 250=0.33%, 750=0.03% cpu : usr=0.12%, sys=15.08%, ctx=7620, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150206: Fri May 8 21:30:06 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(5940KiB/57171msec) clat (usec): min=29, max=114991, avg=18673.09, stdev=12287.86 lat (usec): min=30, max=114992, avg=18674.11, stdev=12288.00 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 91], 10.00th=[ 7767], 20.00th=[ 10290], | 30.00th=[ 12125], 40.00th=[ 13829], 50.00th=[ 15926], 60.00th=[ 19006], | 70.00th=[ 22676], 80.00th=[ 26608], 90.00th=[ 33162], 95.00th=[ 40109], | 99.00th=[ 60031], 99.50th=[ 71828], 99.90th=[104334], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 6, max= 176, per=24.79%, avg=103.60, stdev=27.56, samples=113 iops : min= 1, max= 44, avg=25.40, stdev= 6.88, samples=113 write: IOPS=27, BW=111KiB/s (114kB/s)(6348KiB/57171msec); 0 zone resets clat (usec): min=864, max=604767, avg=18472.84, stdev=22709.66 lat (usec): min=865, max=604769, avg=18474.97, stdev=22709.21 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1598], 10.00th=[ 2089], 20.00th=[ 3097], | 30.00th=[ 5211], 40.00th=[ 10028], 50.00th=[ 14746], 60.00th=[ 18744], | 70.00th=[ 23725], 80.00th=[ 29754], 90.00th=[ 39060], 95.00th=[ 47973], | 99.00th=[ 79168], 99.50th=[101188], 99.90th=[175113], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 23, max= 191, per=25.43%, avg=111.38, stdev=30.54, samples=112 iops : min= 5, max= 47, avg=27.35, stdev= 7.65, samples=112 lat (usec) : 50=0.42%, 100=2.34%, 250=0.62%, 500=0.16%, 1000=0.16% lat (msec) : 2=4.43%, 4=8.79%, 10=12.63%, 20=33.11%, 50=34.02% lat (msec) : 100=2.96%, 250=0.33%, 750=0.03% cpu : usr=0.12%, sys=15.17%, ctx=7574, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150207: Fri May 8 21:30:06 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(6028KiB/57330msec) clat (usec): min=34, max=186220, avg=18288.42, stdev=12624.94 lat (usec): min=35, max=186221, avg=18289.37, stdev=12624.91 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 94], 10.00th=[ 7439], 20.00th=[ 10028], | 30.00th=[ 11863], 40.00th=[ 13566], 50.00th=[ 15664], 60.00th=[ 18482], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32637], 95.00th=[ 38536], | 99.00th=[ 62129], 99.50th=[ 72877], 99.90th=[117965], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 23, max= 176, per=25.26%, avg=105.61, stdev=30.44, samples=112 iops : min= 5, max= 44, avg=25.90, stdev= 7.67, samples=112 write: IOPS=27, BW=109KiB/s (112kB/s)(6260KiB/57330msec); 0 zone resets clat (usec): min=1026, max=677177, avg=18911.30, stdev=23562.97 lat (usec): min=1027, max=677181, avg=18914.28, stdev=23562.09 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1696], 10.00th=[ 2180], 20.00th=[ 3359], | 30.00th=[ 5800], 40.00th=[ 11076], 50.00th=[ 15270], 60.00th=[ 19268], | 70.00th=[ 24249], 80.00th=[ 30016], 90.00th=[ 39584], 95.00th=[ 47973], | 99.00th=[ 76022], 99.50th=[ 91751], 99.90th=[131597], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 31, max= 184, per=24.99%, avg=109.44, stdev=29.61, samples=112 iops : min= 7, max= 46, avg=26.87, stdev= 7.40, samples=112 lat (usec) : 50=0.33%, 100=2.41%, 250=0.88%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.13%, 4=8.07%, 10=12.70%, 20=34.18%, 50=34.05% lat (msec) : 100=2.83%, 250=0.20%, 750=0.03% cpu : usr=0.16%, sys=14.97%, ctx=7664, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150208: Fri May 8 21:30:06 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(6052KiB/57286msec) clat (usec): min=32, max=164770, avg=18607.64, stdev=13154.78 lat (usec): min=32, max=164771, avg=18608.51, stdev=13154.80 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 83], 10.00th=[ 6849], 20.00th=[ 10159], | 30.00th=[ 11994], 40.00th=[ 13829], 50.00th=[ 15926], 60.00th=[ 19006], | 70.00th=[ 22414], 80.00th=[ 26608], 90.00th=[ 33162], 95.00th=[ 40633], | 99.00th=[ 63701], 99.50th=[ 80217], 99.90th=[122160], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 55, max= 168, per=25.31%, avg=105.81, stdev=27.71, samples=112 iops : min= 13, max= 42, avg=25.96, stdev= 6.95, samples=112 write: IOPS=27, BW=109KiB/s (111kB/s)(6236KiB/57286msec); 0 zone resets clat (usec): min=694, max=664653, avg=18592.33, stdev=23041.82 lat (usec): min=694, max=664679, avg=18594.06, stdev=23041.96 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1582], 10.00th=[ 2089], 20.00th=[ 3195], | 30.00th=[ 5342], 40.00th=[ 10552], 50.00th=[ 15139], 60.00th=[ 19006], | 70.00th=[ 23725], 80.00th=[ 30540], 90.00th=[ 39060], 95.00th=[ 47973], | 99.00th=[ 74974], 99.50th=[ 89654], 99.90th=[139461], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 39, max= 182, per=24.97%, avg=109.37, stdev=28.83, samples=112 iops : min= 9, max= 45, avg=26.85, stdev= 7.20, samples=112 lat (usec) : 50=0.46%, 100=2.77%, 250=0.91%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.10% lat (msec) : 2=4.26%, 4=8.20%, 10=12.43%, 20=33.59%, 50=33.76% lat (msec) : 100=3.09%, 250=0.16%, 750=0.03% cpu : usr=0.11%, sys=14.87%, ctx=7600, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=419KiB/s (429kB/s), 104KiB/s-106KiB/s (106kB/s-108kB/s), io=23.4MiB (24.6MB), run=57033-57330msec WRITE: bw=439KiB/s (449kB/s), 109KiB/s-111KiB/s (111kB/s-114kB/s), io=24.6MiB (25.7MB), run=57033-57330msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150200: Fri May 8 21:31:05 2026 read: IOPS=12, BW=51.4KiB/s (52.6kB/s)(5992KiB/116639msec) clat (msec): min=3, max=618, avg=17.79, stdev=21.49 lat (msec): min=3, max=618, avg=17.79, stdev=21.49 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 80], 99.50th=[ 109], 99.90th=[ 171], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 143, per=24.94%, avg=51.12, stdev=28.99, samples=231 iops : min= 1, max= 35, avg=12.29, stdev= 7.30, samples=231 write: IOPS=13, BW=53.0KiB/s (55.3kB/s)(6296KiB/116639msec); 0 zone resets clat (msec): min=21, max=212, avg=57.03, stdev=23.89 lat (msec): min=21, max=212, avg=57.04, stdev=23.89 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 57], | 70.00th=[ 64], 80.00th=[ 73], 90.00th=[ 88], 95.00th=[ 105], | 99.00th=[ 140], 99.50th=[ 165], 99.90th=[ 197], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 7, max= 96, per=25.09%, avg=53.69, stdev=19.11, samples=231 iops : min= 1, max= 24, avg=12.94, stdev= 4.86, samples=231 lat (msec) : 4=0.03%, 10=16.73%, 20=19.50%, 50=35.32%, 100=25.03% lat (msec) : 250=3.35%, 750=0.03% cpu : usr=0.06%, sys=3.78%, ctx=5769, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150201: Fri May 8 21:31:05 2026 read: IOPS=12, BW=50.7KiB/s (51.0kB/s)(5940KiB/117065msec) clat (msec): min=3, max=647, avg=18.10, stdev=23.00 lat (msec): min=3, max=647, avg=18.10, stdev=23.00 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 97], 99.50th=[ 118], 99.90th=[ 174], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 143, per=24.83%, avg=50.90, stdev=29.23, samples=230 iops : min= 1, max= 35, avg=12.24, stdev= 7.39, samples=230 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6348KiB/117065msec); 0 zone resets clat (msec): min=17, max=196, avg=56.69, stdev=23.64 lat (msec): min=17, max=196, avg=56.69, stdev=23.64 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 31], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 57], | 70.00th=[ 64], 80.00th=[ 73], 90.00th=[ 90], 95.00th=[ 105], | 99.00th=[ 133], 99.50th=[ 148], 99.90th=[ 188], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 15, max= 112, per=25.21%, avg=53.94, stdev=19.94, samples=232 iops : min= 3, max= 28, avg=13.00, stdev= 5.05, samples=232 lat (msec) : 4=0.07%, 10=17.25%, 20=18.59%, 50=35.87%, 100=24.74% lat (msec) : 250=3.45%, 750=0.03% cpu : usr=0.08%, sys=3.70%, ctx=5756, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150202: Fri May 8 21:31:05 2026 read: IOPS=12, BW=51.7KiB/s (52.0kB/s)(6028KiB/116528msec) clat (msec): min=3, max=132, avg=17.58, stdev=14.47 lat (msec): min=3, max=132, avg=17.58, stdev=14.47 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 77], 99.50th=[ 106], 99.90th=[ 132], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 7, max= 160, per=25.24%, avg=51.73, stdev=28.14, samples=230 iops : min= 1, max= 40, avg=12.45, stdev= 7.08, samples=230 write: IOPS=13, BW=53.7KiB/s (55.0kB/s)(6260KiB/116528msec); 0 zone resets clat (msec): min=21, max=694, avg=57.39, stdev=28.91 lat (msec): min=21, max=694, avg=57.39, stdev=28.91 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 58], | 70.00th=[ 65], 80.00th=[ 74], 90.00th=[ 88], 95.00th=[ 104], | 99.00th=[ 140], 99.50th=[ 157], 99.90th=[ 197], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 15, max= 104, per=24.99%, avg=53.48, stdev=20.32, samples=231 iops : min= 3, max= 26, avg=12.88, stdev= 5.14, samples=231 lat (msec) : 4=0.03%, 10=15.72%, 20=20.44%, 50=34.93%, 100=25.62% lat (msec) : 250=3.22%, 750=0.03% cpu : usr=0.07%, sys=3.79%, ctx=5756, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150203: Fri May 8 21:31:05 2026 read: IOPS=13, BW=52.2KiB/s (53.5kB/s)(6052KiB/115875msec) clat (msec): min=3, max=168, avg=17.49, stdev=14.39 lat (msec): min=3, max=168, avg=17.49, stdev=14.39 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 71], 99.50th=[ 105], 99.90th=[ 127], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 7, max= 144, per=25.72%, avg=52.72, stdev=27.85, samples=226 iops : min= 1, max= 36, avg=12.69, stdev= 7.00, samples=226 write: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6236KiB/115875msec); 0 zone resets clat (msec): min=20, max=691, avg=57.22, stdev=28.00 lat (msec): min=20, max=691, avg=57.22, stdev=28.00 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 57], | 70.00th=[ 64], 80.00th=[ 73], 90.00th=[ 88], 95.00th=[ 103], | 99.00th=[ 136], 99.50th=[ 148], 99.90th=[ 213], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 15, max= 112, per=25.00%, avg=53.49, stdev=19.17, samples=229 iops : min= 3, max= 28, avg=12.88, stdev= 4.86, samples=229 lat (msec) : 4=0.03%, 10=17.06%, 20=18.88%, 50=35.58%, 100=25.42% lat (msec) : 250=2.99%, 750=0.03% cpu : usr=0.08%, sys=3.73%, ctx=5820, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=205KiB/s (210kB/s), 50.7KiB/s-52.2KiB/s (51.0kB/s-53.5kB/s), io=23.4MiB (24.6MB), run=115875-117065msec WRITE: bw=215KiB/s (220kB/s), 53.7KiB/s-54.2KiB/s (55.0kB/s-55.5kB/s), io=24.6MiB (25.7MB), run=115875-117065msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150243: Fri May 8 21:31:24 2026 read: IOPS=28, BW=457KiB/s (468kB/s)(5920KiB/12940msec) clat (usec): min=29, max=67802, avg=16423.85, stdev=12857.20 lat (usec): min=29, max=67803, avg=16424.70, stdev=12857.21 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 85], 20.00th=[ 139], | 30.00th=[10159], 40.00th=[12780], 50.00th=[15533], 60.00th=[18482], | 70.00th=[21890], 80.00th=[25560], 90.00th=[31589], 95.00th=[40633], | 99.00th=[56886], 99.50th=[62653], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 316, max= 667, per=24.63%, avg=450.20, stdev=96.85, samples=25 iops : min= 19, max= 41, avg=27.64, stdev= 6.12, samples=25 write: IOPS=30, BW=492KiB/s (504kB/s)(6368KiB/12940msec); 0 zone resets clat (usec): min=1332, max=132384, avg=17157.47, stdev=16219.41 lat (usec): min=1332, max=132384, avg=17163.20, stdev=16219.19 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2212], 10.00th=[ 2868], 20.00th=[ 4080], | 30.00th=[ 5276], 40.00th=[ 7570], 50.00th=[ 12387], 60.00th=[ 16581], | 70.00th=[ 21890], 80.00th=[ 29492], 90.00th=[ 36963], 95.00th=[ 46400], | 99.00th=[ 79168], 99.50th=[ 83362], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 210, max= 864, per=25.58%, avg=491.84, stdev=168.26, samples=25 iops : min= 13, max= 54, avg=30.28, stdev=10.47, samples=25 lat (usec) : 50=0.65%, 100=6.12%, 250=3.52%, 500=0.39%, 750=0.13% lat (msec) : 2=1.30%, 4=8.85%, 10=15.89%, 20=28.65%, 50=31.51% lat (msec) : 100=2.86%, 250=0.13% cpu : usr=0.15%, sys=19.41%, ctx=1822, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150244: Fri May 8 21:31:24 2026 read: IOPS=27, BW=438KiB/s (449kB/s)(5744KiB/13100msec) clat (usec): min=43, max=73884, avg=18565.67, stdev=13239.80 lat (usec): min=44, max=73885, avg=18566.87, stdev=13239.67 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 75], 10.00th=[ 110], 20.00th=[ 9765], | 30.00th=[12387], 40.00th=[14222], 50.00th=[17171], 60.00th=[19792], | 70.00th=[22938], 80.00th=[27395], 90.00th=[34341], 95.00th=[39584], | 99.00th=[69731], 99.50th=[72877], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 210, max= 640, per=23.98%, avg=438.32, stdev=111.31, samples=25 iops : min= 13, max= 40, avg=26.92, stdev= 6.98, samples=25 write: IOPS=31, BW=500KiB/s (512kB/s)(6544KiB/13100msec); 0 zone resets clat (usec): min=1425, max=100788, avg=15572.10, stdev=14074.64 lat (usec): min=1426, max=100789, avg=15573.76, stdev=14074.58 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2040], 10.00th=[ 2802], 20.00th=[ 3949], | 30.00th=[ 5473], 40.00th=[ 8029], 50.00th=[ 11863], 60.00th=[ 15008], | 70.00th=[ 19268], 80.00th=[ 25560], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 60031], 99.50th=[ 69731], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 191, max= 832, per=25.38%, avg=488.04, stdev=133.46, samples=25 iops : min= 11, max= 52, avg=30.04, stdev= 8.43, samples=25 lat (usec) : 50=0.39%, 100=3.65%, 250=2.99%, 500=0.13% lat (msec) : 2=2.34%, 4=8.59%, 10=16.54%, 20=31.38%, 50=31.25% lat (msec) : 100=2.60%, 250=0.13% cpu : usr=0.14%, sys=19.93%, ctx=1915, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150245: Fri May 8 21:31:24 2026 read: IOPS=31, BW=508KiB/s (521kB/s)(6256KiB/12305msec) clat (usec): min=26, max=69130, avg=16898.88, stdev=12336.50 lat (usec): min=26, max=69131, avg=16900.37, stdev=12336.57 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 76], 10.00th=[ 101], 20.00th=[ 8160], | 30.00th=[11469], 40.00th=[14222], 50.00th=[16319], 60.00th=[18220], | 70.00th=[20841], 80.00th=[24773], 90.00th=[31065], 95.00th=[39584], | 99.00th=[65274], 99.50th=[67634], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 319, max= 768, per=28.10%, avg=513.62, stdev=110.18, samples=24 iops : min= 19, max= 48, avg=31.62, stdev= 6.92, samples=24 write: IOPS=30, BW=490KiB/s (502kB/s)(6032KiB/12305msec); 0 zone resets clat (usec): min=1352, max=119347, avg=14920.41, stdev=14192.48 lat (usec): min=1442, max=119348, avg=14922.49, stdev=14192.11 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2212], 10.00th=[ 3032], 20.00th=[ 4113], | 30.00th=[ 4948], 40.00th=[ 7635], 50.00th=[ 10421], 60.00th=[ 13960], | 70.00th=[ 17171], 80.00th=[ 25297], 90.00th=[ 33424], 95.00th=[ 42730], | 99.00th=[ 57410], 99.50th=[ 91751], 99.90th=[119014], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 288, max= 704, per=25.26%, avg=485.71, stdev=122.02, samples=24 iops : min= 18, max= 44, avg=29.92, stdev= 7.63, samples=24 lat (usec) : 50=0.65%, 100=4.30%, 250=4.17%, 500=0.26% lat (msec) : 2=1.69%, 4=7.94%, 10=17.06%, 20=34.38%, 50=27.73% lat (msec) : 100=1.69%, 250=0.13% cpu : usr=0.10%, sys=19.89%, ctx=1933, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150246: Fri May 8 21:31:24 2026 read: IOPS=30, BW=491KiB/s (503kB/s)(6032KiB/12280msec) clat (usec): min=38, max=98824, avg=17283.28, stdev=14431.18 lat (usec): min=40, max=98826, avg=17285.26, stdev=14432.59 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 85], 20.00th=[ 188], | 30.00th=[10552], 40.00th=[12911], 50.00th=[15533], 60.00th=[18220], | 70.00th=[22152], 80.00th=[26084], 90.00th=[34341], 95.00th=[43779], | 99.00th=[66847], 99.50th=[96994], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 238, max= 798, per=26.86%, avg=490.96, stdev=139.45, samples=24 iops : min= 14, max= 49, avg=30.21, stdev= 8.78, samples=24 write: IOPS=31, BW=509KiB/s (522kB/s)(6256KiB/12280msec); 0 zone resets clat (usec): min=1488, max=100183, avg=14429.08, stdev=14529.72 lat (usec): min=1488, max=100184, avg=14430.67, stdev=14529.78 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2057], 10.00th=[ 2802], 20.00th=[ 3687], | 30.00th=[ 4621], 40.00th=[ 6325], 50.00th=[ 8979], 60.00th=[ 12256], | 70.00th=[ 16188], 80.00th=[ 23725], 90.00th=[ 35390], 95.00th=[ 43779], | 99.00th=[ 63701], 99.50th=[ 79168], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 255, max= 704, per=26.68%, avg=513.00, stdev=125.83, samples=24 iops : min= 15, max= 44, avg=31.63, stdev= 7.86, samples=24 lat (usec) : 50=0.52%, 100=6.51%, 250=3.12%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.21%, 4=9.64%, 10=18.88%, 20=28.52%, 50=27.60% lat (msec) : 100=2.60%, 250=0.13% cpu : usr=0.09%, sys=20.46%, ctx=1750, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1828KiB/s (1872kB/s), 438KiB/s-508KiB/s (449kB/s-521kB/s), io=23.4MiB (24.5MB), run=12280-13100msec WRITE: bw=1924KiB/s (1970kB/s), 490KiB/s-509KiB/s (502kB/s-522kB/s), io=24.6MiB (25.8MB), run=12280-13100msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150238: Fri May 8 21:31:38 2026 read: IOPS=13, BW=218KiB/s (224kB/s)(5920KiB/27105msec) clat (msec): min=4, max=209, avg=17.88, stdev=17.84 lat (msec): min=4, max=209, avg=17.88, stdev=17.84 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 37], 95.00th=[ 50], | 99.00th=[ 89], 99.50th=[ 105], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 480, per=24.36%, avg=214.62, stdev=110.88, samples=53 iops : min= 1, max= 30, avg=12.89, stdev= 7.06, samples=53 write: IOPS=14, BW=235KiB/s (241kB/s)(6368KiB/27105msec); 0 zone resets clat (msec): min=22, max=209, avg=51.35, stdev=23.37 lat (msec): min=22, max=209, avg=51.35, stdev=23.37 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 44], 60.00th=[ 50], | 70.00th=[ 56], 80.00th=[ 66], 90.00th=[ 86], 95.00th=[ 101], | 99.00th=[ 130], 99.50th=[ 142], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 63, max= 384, per=25.26%, avg=234.13, stdev=96.99, samples=53 iops : min= 3, max= 24, avg=14.11, stdev= 6.15, samples=53 lat (msec) : 10=15.76%, 20=21.61%, 50=40.76%, 100=19.14%, 250=2.73% cpu : usr=0.10%, sys=4.86%, ctx=1554, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150239: Fri May 8 21:31:38 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(5744KiB/27180msec) clat (msec): min=4, max=120, avg=16.64, stdev=14.44 lat (msec): min=4, max=120, avg=16.64, stdev=14.44 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 14], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 70], 99.50th=[ 112], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 31, max= 512, per=24.02%, avg=211.58, stdev=127.51, samples=53 iops : min= 1, max= 32, avg=12.70, stdev= 8.07, samples=53 write: IOPS=15, BW=241KiB/s (247kB/s)(6544KiB/27180msec); 0 zone resets clat (msec): min=23, max=190, avg=51.78, stdev=25.46 lat (msec): min=23, max=190, avg=51.78, stdev=25.46 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 50], | 70.00th=[ 55], 80.00th=[ 66], 90.00th=[ 84], 95.00th=[ 107], | 99.00th=[ 148], 99.50th=[ 161], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 63, max= 415, per=25.69%, avg=238.17, stdev=91.77, samples=53 iops : min= 3, max= 25, avg=14.36, stdev= 5.83, samples=53 lat (msec) : 10=16.54%, 20=20.57%, 50=40.62%, 100=18.36%, 250=3.91% cpu : usr=0.07%, sys=4.93%, ctx=1521, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150240: Fri May 8 21:31:38 2026 read: IOPS=14, BW=238KiB/s (244kB/s)(6256KiB/26258msec) clat (msec): min=3, max=105, avg=17.10, stdev=14.68 lat (msec): min=3, max=105, avg=17.10, stdev=14.68 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 46], | 99.00th=[ 93], 99.50th=[ 99], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 63, max= 672, per=27.17%, avg=239.37, stdev=143.39, samples=52 iops : min= 3, max= 42, avg=14.42, stdev= 9.01, samples=52 write: IOPS=14, BW=230KiB/s (235kB/s)(6032KiB/26258msec); 0 zone resets clat (msec): min=22, max=142, avg=51.74, stdev=23.16 lat (msec): min=22, max=142, avg=51.75, stdev=23.16 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 34], | 30.00th=[ 37], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 51], | 70.00th=[ 58], 80.00th=[ 68], 90.00th=[ 84], 95.00th=[ 101], | 99.00th=[ 132], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 64, max= 384, per=24.68%, avg=228.79, stdev=91.57, samples=52 iops : min= 4, max= 24, avg=13.77, stdev= 5.79, samples=52 lat (msec) : 4=0.13%, 10=16.28%, 20=23.18%, 50=38.67%, 100=19.27% lat (msec) : 250=2.47% cpu : usr=0.10%, sys=5.11%, ctx=1574, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150241: Fri May 8 21:31:38 2026 read: IOPS=14, BW=225KiB/s (231kB/s)(6032KiB/26770msec) clat (msec): min=4, max=109, avg=17.75, stdev=15.06 lat (msec): min=4, max=109, avg=17.75, stdev=15.06 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 54], | 99.00th=[ 75], 99.50th=[ 107], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 31, max= 479, per=25.41%, avg=223.85, stdev=113.31, samples=53 iops : min= 1, max= 29, avg=13.45, stdev= 7.18, samples=53 write: IOPS=14, BW=234KiB/s (239kB/s)(6256KiB/26770msec); 0 zone resets clat (msec): min=19, max=193, avg=51.16, stdev=24.17 lat (msec): min=19, max=193, avg=51.16, stdev=24.17 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 49], | 70.00th=[ 56], 80.00th=[ 66], 90.00th=[ 85], 95.00th=[ 99], | 99.00th=[ 144], 99.50th=[ 171], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 94, max= 416, per=25.18%, avg=233.43, stdev=92.90, samples=53 iops : min= 5, max= 26, avg=14.06, stdev= 5.93, samples=53 lat (msec) : 10=16.02%, 20=21.35%, 50=41.02%, 100=18.88%, 250=2.73% cpu : usr=0.09%, sys=4.92%, ctx=1539, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=881KiB/s (902kB/s), 211KiB/s-238KiB/s (216kB/s-244kB/s), io=23.4MiB (24.5MB), run=26258-27180msec WRITE: bw=927KiB/s (949kB/s), 230KiB/s-241KiB/s (235kB/s-247kB/s), io=24.6MiB (25.8MB), run=26258-27180msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150255: Fri May 8 21:31:46 2026 read: IOPS=3, BW=3408KiB/s (3490kB/s)(7168KiB/2103msec) clat (msec): min=42, max=393, avg=125.66, stdev=128.28 lat (msec): min=42, max=393, avg=125.66, stdev=128.28 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 46], | 30.00th=[ 51], 40.00th=[ 51], 50.00th=[ 75], 60.00th=[ 85], | 70.00th=[ 85], 80.00th=[ 188], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1961, max= 6918, per=58.88%, avg=4439.50, stdev=3505.13, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2435KiB/s (2493kB/s)(5120KiB/2103msec); 0 zone resets clat (msec): min=78, max=395, avg=235.33, stdev=134.39 lat (msec): min=79, max=395, avg=235.41, stdev=134.39 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1729, max= 5976, per=36.50%, avg=3852.50, stdev=3003.08, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 50=16.67%, 100=33.33%, 250=25.00%, 500=25.00% cpu : usr=0.05%, sys=13.56%, ctx=147, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150256: Fri May 8 21:31:46 2026 read: IOPS=0, BW=754KiB/s (772kB/s)(2048KiB/2716msec) clat (msec): min=38, max=285, avg=161.88, stdev=174.69 lat (msec): min=38, max=285, avg=161.88, stdev=174.69 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 39], | 30.00th=[ 39], 40.00th=[ 39], 50.00th=[ 39], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1753, max= 2035, per=25.12%, avg=1894.00, stdev=199.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3770KiB/s (3861kB/s)(10.0MiB/2716msec); 0 zone resets clat (msec): min=87, max=560, avg=233.46, stdev=158.90 lat (msec): min=87, max=561, avg=233.53, stdev=158.91 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 103], | 30.00th=[ 104], 40.00th=[ 112], 50.00th=[ 142], 60.00th=[ 220], | 70.00th=[ 284], 80.00th=[ 313], 90.00th=[ 414], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1992, max= 5976, per=33.03%, avg=3486.40, stdev=1637.75, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=13.59%, ctx=114, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150257: Fri May 8 21:31:46 2026 read: IOPS=2, BW=2833KiB/s (2901kB/s)(6144KiB/2169msec) clat (msec): min=61, max=384, avg=177.73, stdev=130.99 lat (msec): min=61, max=384, avg=177.73, stdev=130.99 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 190], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 2035, max= 3984, per=43.95%, avg=3314.00, stdev=1108.07, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2833KiB/s (2901kB/s)(6144KiB/2169msec); 0 zone resets clat (msec): min=88, max=378, avg=182.26, stdev=113.66 lat (msec): min=88, max=378, avg=182.34, stdev=113.65 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 134], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 3500, max= 4071, per=36.30%, avg=3831.33, stdev=296.33, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=12.78%, ctx=84, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150258: Fri May 8 21:31:46 2026 read: IOPS=2, BW=2126KiB/s (2177kB/s)(5120KiB/2408msec) clat (msec): min=71, max=318, avg=172.69, stdev=115.52 lat (msec): min=71, max=318, avg=172.69, stdev=115.52 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 120], 60.00th=[ 120], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2035, max= 5976, per=53.12%, avg=4005.50, stdev=2786.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2977KiB/s (3048kB/s)(7168KiB/2408msec); 0 zone resets clat (msec): min=86, max=349, avg=210.41, stdev=108.98 lat (msec): min=86, max=349, avg=210.49, stdev=108.98 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 92], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 176], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 321], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1961, max= 5260, per=29.23%, avg=3085.33, stdev=1883.68, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=41.67% cpu : usr=0.00%, sys=12.21%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7541KiB/s (7721kB/s), 754KiB/s-3408KiB/s (772kB/s-3490kB/s), io=20.0MiB (20.0MB), run=2103-2716msec WRITE: bw=10.3MiB/s (10.8MB/s), 2435KiB/s-3770KiB/s (2493kB/s-3861kB/s), io=28.0MiB (29.4MB), run=2103-2716msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150260: Fri May 8 21:31:46 2026 read: IOPS=3, BW=3739KiB/s (3829kB/s)(7168KiB/1917msec) clat (usec): min=476, max=245152, avg=146443.56, stdev=82200.72 lat (usec): min=477, max=245153, avg=146444.77, stdev=82200.59 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[112722], | 30.00th=[132645], 40.00th=[132645], 50.00th=[141558], 60.00th=[156238], | 70.00th=[156238], 80.00th=[235930], 90.00th=[244319], 95.00th=[244319], | 99.00th=[244319], 99.50th=[244319], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 4063, max= 4465, per=52.28%, avg=4264.00, stdev=284.26, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2671KiB/s (2735kB/s)(5120KiB/1917msec); 0 zone resets clat (msec): min=139, max=206, avg=174.65, stdev=28.36 lat (msec): min=139, max=206, avg=174.71, stdev=28.35 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 2031, max= 6023, per=35.27%, avg=4027.00, stdev=2822.77, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33% lat (msec) : 250=91.67% cpu : usr=0.00%, sys=47.18%, ctx=373, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150261: Fri May 8 21:31:46 2026 read: IOPS=0, BW=816KiB/s (835kB/s)(2048KiB/2511msec) clat (usec): min=534, max=180465, avg=90500.09, stdev=127230.48 lat (usec): min=536, max=180466, avg=90501.44, stdev=127229.97 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 537], 60.00th=[181404], | 70.00th=[181404], 80.00th=[181404], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 1473, max= 2007, per=21.33%, avg=1740.00, stdev=377.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=4078KiB/s (4176kB/s)(10.0MiB/2511msec); 0 zone resets clat (msec): min=59, max=520, avg=232.75, stdev=160.16 lat (msec): min=59, max=520, avg=232.82, stdev=160.16 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 84], | 30.00th=[ 153], 40.00th=[ 159], 50.00th=[ 176], 60.00th=[ 194], | 70.00th=[ 232], 80.00th=[ 241], 90.00th=[ 514], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2031, max= 4015, per=28.41%, avg=3244.00, stdev=949.07, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=58.33%, 750=16.67% cpu : usr=0.00%, sys=39.84%, ctx=186, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150262: Fri May 8 21:31:46 2026 read: IOPS=2, BW=2734KiB/s (2800kB/s)(6144KiB/2247msec) clat (usec): min=443, max=199102, avg=88896.47, stdev=91867.25 lat (usec): min=444, max=199102, avg=88897.36, stdev=91867.12 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 18220], 50.00th=[ 18220], 60.00th=[156238], | 70.00th=[160433], 80.00th=[160433], 90.00th=[198181], 95.00th=[198181], | 99.00th=[198181], 99.50th=[198181], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 1992, max= 4063, per=41.16%, avg=3356.67, stdev=1182.08, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2734KiB/s (2800kB/s)(6144KiB/2247msec); 0 zone resets clat (msec): min=95, max=619, avg=285.25, stdev=185.42 lat (msec): min=95, max=619, avg=285.31, stdev=185.41 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 313], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2007, max= 3984, per=24.14%, avg=2756.00, stdev=940.77, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 20=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=33.04%, ctx=456, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150263: Fri May 8 21:31:46 2026 read: IOPS=2, BW=2120KiB/s (2171kB/s)(5120KiB/2415msec) clat (usec): min=369, max=295636, avg=161215.17, stdev=114245.50 lat (usec): min=371, max=295637, avg=161216.39, stdev=114245.47 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 371], 10.00th=[ 371], 20.00th=[ 371], | 30.00th=[117965], 40.00th=[117965], 50.00th=[152044], 60.00th=[152044], | 70.00th=[240124], 80.00th=[240124], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 3984, max= 4015, per=49.04%, avg=3999.50, stdev=21.92, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2968KiB/s (3039kB/s)(7168KiB/2415msec); 0 zone resets clat (msec): min=132, max=569, avg=229.53, stdev=154.30 lat (msec): min=132, max=569, avg=229.58, stdev=154.29 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 140], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 163], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 228], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1481, max= 6095, per=33.75%, avg=3853.33, stdev=2309.77, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=75.00%, 500=8.33%, 750=8.33% cpu : usr=0.04%, sys=40.97%, ctx=373, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8156KiB/s (8352kB/s), 816KiB/s-3739KiB/s (835kB/s-3829kB/s), io=20.0MiB (20.0MB), run=1917-2511msec WRITE: bw=11.2MiB/s (11.7MB/s), 2671KiB/s-4078KiB/s (2735kB/s-4176kB/s), io=28.0MiB (29.4MB), run=1917-2511msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150269: Fri May 8 21:31:55 2026 read: IOPS=1, BW=7953KiB/s (8144kB/s)(12.0MiB/1545msec) clat (msec): min=362, max=576, avg=472.04, stdev=106.85 lat (msec): min=362, max=576, avg=472.04, stdev=106.85 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 5673, max= 7861, per=80.30%, avg=6767.00, stdev=1547.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=16.90%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150270: Fri May 8 21:31:55 2026 read: IOPS=0, BW=2107KiB/s (2158kB/s)(4096KiB/1944msec) clat (nsec): min=916812k, max=916812k, avg=916812049.00, stdev= 0.00 lat (nsec): min=916813k, max=916813k, avg=916813061.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7861, max= 7861, per=93.28%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4214KiB/s (4315kB/s)(8192KiB/1944msec); 0 zone resets clat (msec): min=114, max=793, avg=453.85, stdev=480.11 lat (msec): min=114, max=793, avg=454.16, stdev=480.17 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=10.76%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150271: Fri May 8 21:31:55 2026 write: IOPS=1, BW=6257KiB/s (6407kB/s)(12.0MiB/1964msec); 0 zone resets clat (msec): min=311, max=808, avg=610.63, stdev=263.56 lat (msec): min=312, max=808, avg=610.96, stdev=263.39 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7861, max= 8192, per=48.11%, avg=8026.50, stdev=234.05, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=12.94%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150272: Fri May 8 21:31:55 2026 write: IOPS=1, BW=7902KiB/s (8092kB/s)(12.0MiB/1555msec); 0 zone resets clat (msec): min=156, max=1037, avg=475.41, stdev=488.66 lat (msec): min=156, max=1038, avg=475.72, stdev=488.70 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min=11330, max=11330, per=67.91%, avg=11330.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.61%, ctx=293, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8428KiB/s (8630kB/s), 2107KiB/s-7953KiB/s (2158kB/s-8144kB/s), io=16.0MiB (16.8MB), run=1545-1944msec WRITE: bw=16.3MiB/s (17.1MB/s), 4214KiB/s-7902KiB/s (4315kB/s-8092kB/s), io=32.0MiB (33.6MB), run=1555-1964msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150273: Fri May 8 21:31:55 2026 read: IOPS=2, BW=8904KiB/s (9118kB/s)(12.0MiB/1380msec) clat (msec): min=430, max=468, avg=444.20, stdev=20.80 lat (msec): min=430, max=468, avg=444.20, stdev=20.80 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 6068, max= 8192, per=60.06%, avg=7130.00, stdev=1501.89, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=40.90%, ctx=1498, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150274: Fri May 8 21:31:55 2026 read: IOPS=0, BW=3018KiB/s (3091kB/s)(4096KiB/1357msec) clat (nsec): min=466998k, max=466998k, avg=466998040.00, stdev= 0.00 lat (nsec): min=467001k, max=467001k, avg=467000545.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 5893, max= 5893, per=49.64%, avg=5893.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6037KiB/s (6182kB/s)(8192KiB/1357msec); 0 zone resets clat (msec): min=164, max=693, avg=429.12, stdev=374.41 lat (msec): min=164, max=694, avg=429.47, stdev=374.29 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 5893, max= 5893, per=34.51%, avg=5893.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.07%, sys=30.01%, ctx=417, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150275: Fri May 8 21:31:55 2026 write: IOPS=1, BW=6403KiB/s (6557kB/s)(12.0MiB/1919msec); 0 zone resets clat (msec): min=232, max=1207, avg=616.06, stdev=519.53 lat (msec): min=233, max=1207, avg=616.34, stdev=519.54 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min=15937, max=15937, per=93.34%, avg=15937.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.19%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150276: Fri May 8 21:31:55 2026 write: IOPS=1, BW=7782KiB/s (7969kB/s)(12.0MiB/1579msec); 0 zone resets clat (msec): min=139, max=1036, avg=499.08, stdev=474.28 lat (msec): min=139, max=1036, avg=499.36, stdev=474.27 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min=11855, max=11855, per=69.43%, avg=11855.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.13%, sys=12.10%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.6MiB/s (12.2MB/s), 3018KiB/s-8904KiB/s (3091kB/s-9118kB/s), io=16.0MiB (16.8MB), run=1357-1380msec WRITE: bw=16.7MiB/s (17.5MB/s), 6037KiB/s-7782KiB/s (6182kB/s-7969kB/s), io=32.0MiB (33.6MB), run=1357-1919msec