== sanity test 398b: DIO and buffer IO race ============== 08:04:42 (1775045082) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.46591 s, 20.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148790: Wed Apr 1 08:05:36 2026 read: IOPS=33, BW=134KiB/s (137kB/s)(5992KiB/44653msec) clat (usec): min=32, max=258119, avg=15358.71, stdev=11364.98 lat (usec): min=33, max=258121, avg=15359.71, stdev=11364.99 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 130], 10.00th=[ 6980], 20.00th=[ 8717], | 30.00th=[ 9896], 40.00th=[ 11338], 50.00th=[ 13304], 60.00th=[ 15664], | 70.00th=[ 18220], 80.00th=[ 20841], 90.00th=[ 25560], 95.00th=[ 31589], | 99.00th=[ 47973], 99.50th=[ 57934], 99.90th=[ 99091], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 55, max= 216, per=25.45%, avg=134.13, stdev=35.02, samples=89 iops : min= 13, max= 54, avg=33.21, stdev= 8.85, samples=89 write: IOPS=35, BW=141KiB/s (144kB/s)(6296KiB/44653msec); 0 zone resets clat (usec): min=671, max=88529, avg=13714.72, stdev=11713.31 lat (usec): min=672, max=88530, avg=13715.89, stdev=11713.34 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1975], 10.00th=[ 2474], 20.00th=[ 3163], | 30.00th=[ 4817], 40.00th=[ 8586], 50.00th=[11338], 60.00th=[13698], | 70.00th=[17433], 80.00th=[22152], 90.00th=[30016], 95.00th=[35390], | 99.00th=[51643], 99.50th=[64750], 99.90th=[79168], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 56, max= 248, per=25.52%, avg=140.88, stdev=34.47, samples=89 iops : min= 14, max= 62, avg=34.90, stdev= 8.60, samples=89 lat (usec) : 50=0.20%, 100=1.33%, 250=1.07%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=2.28%, 4=10.90%, 10=21.94%, 20=38.02%, 50=22.88% lat (msec) : 100=0.94%, 500=0.03% cpu : usr=0.17%, sys=24.38%, ctx=7960, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148791: Wed Apr 1 08:05:36 2026 read: IOPS=33, BW=132KiB/s (135kB/s)(5940KiB/44924msec) clat (usec): min=39, max=274918, avg=15828.88, stdev=11726.08 lat (usec): min=40, max=274919, avg=15830.72, stdev=11725.70 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 5014], 10.00th=[ 7111], 20.00th=[ 8979], | 30.00th=[ 10421], 40.00th=[ 11863], 50.00th=[ 13698], 60.00th=[ 16057], | 70.00th=[ 18482], 80.00th=[ 21365], 90.00th=[ 26346], 95.00th=[ 32113], | 99.00th=[ 50070], 99.50th=[ 57934], 99.90th=[108528], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 15, max= 200, per=25.02%, avg=131.85, stdev=34.00, samples=89 iops : min= 3, max= 50, avg=32.64, stdev= 8.57, samples=89 write: IOPS=35, BW=141KiB/s (145kB/s)(6348KiB/44924msec); 0 zone resets clat (usec): min=795, max=86645, avg=13463.93, stdev=11593.35 lat (usec): min=796, max=86647, avg=13465.40, stdev=11593.25 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1893], 10.00th=[ 2409], 20.00th=[ 3064], | 30.00th=[ 4555], 40.00th=[ 7832], 50.00th=[10945], 60.00th=[13698], | 70.00th=[17433], 80.00th=[21890], 90.00th=[28705], 95.00th=[34341], | 99.00th=[52167], 99.50th=[60031], 99.90th=[85459], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 63, max= 256, per=25.44%, avg=140.45, stdev=36.71, samples=89 iops : min= 15, max= 64, avg=34.80, stdev= 9.26, samples=89 lat (usec) : 50=0.07%, 100=0.91%, 250=1.17%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.52% lat (msec) : 2=2.64%, 4=11.13%, 10=21.09%, 20=37.92%, 50=23.14% lat (msec) : 100=1.20%, 250=0.03%, 500=0.03% cpu : usr=0.14%, sys=24.52%, ctx=8077, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148792: Wed Apr 1 08:05:36 2026 read: IOPS=33, BW=134KiB/s (137kB/s)(6028KiB/45086msec) clat (usec): min=34, max=103091, avg=15044.72, stdev=9650.94 lat (usec): min=34, max=103092, avg=15045.79, stdev=9650.95 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 119], 10.00th=[ 6783], 20.00th=[ 8455], | 30.00th=[ 10028], 40.00th=[ 11469], 50.00th=[ 13042], 60.00th=[ 15270], | 70.00th=[ 17695], 80.00th=[ 21103], 90.00th=[ 26346], 95.00th=[ 30278], | 99.00th=[ 49021], 99.50th=[ 60556], 99.90th=[ 93848], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 63, max= 272, per=25.18%, avg=132.70, stdev=34.40, samples=89 iops : min= 15, max= 68, avg=32.85, stdev= 8.62, samples=89 write: IOPS=34, BW=139KiB/s (142kB/s)(6260KiB/45086msec); 0 zone resets clat (usec): min=744, max=285002, avg=14272.76, stdev=13911.30 lat (usec): min=744, max=285003, avg=14277.61, stdev=13913.51 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 1909], 10.00th=[ 2442], 20.00th=[ 3195], | 30.00th=[ 4752], 40.00th=[ 8455], 50.00th=[ 11338], 60.00th=[ 14746], | 70.00th=[ 18220], 80.00th=[ 22676], 90.00th=[ 29754], 95.00th=[ 38011], | 99.00th=[ 54789], 99.50th=[ 60556], 99.90th=[113771], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 63, max= 208, per=24.93%, avg=137.63, stdev=32.84, samples=89 iops : min= 15, max= 52, avg=34.09, stdev= 8.27, samples=89 lat (usec) : 50=0.26%, 100=1.24%, 250=1.63%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.65% lat (msec) : 2=2.05%, 4=10.51%, 10=21.13%, 20=38.15%, 50=23.11% lat (msec) : 100=1.04%, 250=0.07%, 500=0.03% cpu : usr=0.15%, sys=24.31%, ctx=8075, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148793: Wed Apr 1 08:05:36 2026 read: IOPS=33, BW=133KiB/s (136kB/s)(6052KiB/45489msec) clat (usec): min=29, max=90448, avg=15525.03, stdev=9640.36 lat (usec): min=30, max=90450, avg=15526.17, stdev=9640.19 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 122], 10.00th=[ 6652], 20.00th=[ 8717], | 30.00th=[10159], 40.00th=[11863], 50.00th=[13698], 60.00th=[16057], | 70.00th=[18482], 80.00th=[21890], 90.00th=[27132], 95.00th=[32637], | 99.00th=[47449], 99.50th=[55313], 99.90th=[83362], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 38, max= 224, per=25.01%, avg=131.80, stdev=33.64, samples=90 iops : min= 9, max= 56, avg=32.63, stdev= 8.51, samples=90 write: IOPS=34, BW=137KiB/s (140kB/s)(6236KiB/45489msec); 0 zone resets clat (usec): min=794, max=279524, avg=14074.33, stdev=13362.54 lat (usec): min=794, max=279525, avg=14075.54, stdev=13362.53 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1926], 10.00th=[ 2540], 20.00th=[ 3392], | 30.00th=[ 5538], 40.00th=[ 8717], 50.00th=[ 11469], 60.00th=[ 14222], | 70.00th=[ 18220], 80.00th=[ 22152], 90.00th=[ 28967], 95.00th=[ 35390], | 99.00th=[ 51643], 99.50th=[ 64226], 99.90th=[110625], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 53, max= 216, per=24.69%, avg=136.31, stdev=33.96, samples=90 iops : min= 13, max= 54, avg=33.77, stdev= 8.54, samples=90 lat (usec) : 50=0.29%, 100=1.50%, 250=1.33%, 1000=0.42% lat (msec) : 2=2.41%, 4=9.31%, 10=22.46%, 20=36.91%, 50=24.35% lat (msec) : 100=0.94%, 250=0.03%, 500=0.03% cpu : usr=0.14%, sys=24.27%, ctx=8240, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=528KiB/s (541kB/s), 132KiB/s-134KiB/s (135kB/s-137kB/s), io=23.4MiB (24.6MB), run=44653-45489msec WRITE: bw=553KiB/s (566kB/s), 137KiB/s-141KiB/s (140kB/s-145kB/s), io=24.6MiB (25.7MB), run=44653-45489msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148785: Wed Apr 1 08:06:07 2026 read: IOPS=19, BW=78.1KiB/s (79.0kB/s)(5992KiB/76710msec) clat (msec): min=3, max=335, avg=13.23, stdev=14.57 lat (msec): min=3, max=335, avg=13.23, stdev=14.57 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 19], 90.00th=[ 28], 95.00th=[ 39], | 99.00th=[ 60], 99.50th=[ 70], 99.90th=[ 131], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 8, max= 199, per=24.85%, avg=77.55, stdev=40.69, samples=152 iops : min= 2, max= 49, avg=19.08, stdev=10.21, samples=152 write: IOPS=20, BW=82.1KiB/s (84.0kB/s)(6296KiB/76710msec); 0 zone resets clat (msec): min=14, max=129, avg=36.03, stdev=16.11 lat (msec): min=14, max=129, avg=36.03, stdev=16.11 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 40], 80.00th=[ 46], 90.00th=[ 56], 95.00th=[ 66], | 99.00th=[ 100], 99.50th=[ 107], 99.90th=[ 125], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 20, max= 160, per=25.00%, avg=81.51, stdev=32.81, samples=152 iops : min= 5, max= 40, avg=20.07, stdev= 8.29, samples=152 lat (msec) : 4=1.40%, 10=27.21%, 20=15.14%, 50=47.27%, 100=8.40% lat (msec) : 250=0.55%, 500=0.03% cpu : usr=0.10%, sys=7.46%, ctx=5638, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148786: Wed Apr 1 08:06:07 2026 read: IOPS=19, BW=77.2KiB/s (79.1kB/s)(5940KiB/76932msec) clat (msec): min=2, max=354, avg=13.24, stdev=15.20 lat (msec): min=2, max=354, avg=13.24, stdev=15.20 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 18], 90.00th=[ 28], 95.00th=[ 37], | 99.00th=[ 65], 99.50th=[ 78], 99.90th=[ 132], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 6, max= 191, per=24.70%, avg=77.06, stdev=40.56, samples=153 iops : min= 1, max= 47, avg=18.96, stdev=10.21, samples=153 write: IOPS=20, BW=82.5KiB/s (84.5kB/s)(6348KiB/76932msec); 0 zone resets clat (msec): min=13, max=141, avg=35.97, stdev=16.64 lat (msec): min=13, max=141, avg=35.98, stdev=16.64 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 97], 99.50th=[ 107], 99.90th=[ 128], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 20, max= 160, per=25.18%, avg=82.08, stdev=33.52, samples=153 iops : min= 5, max= 40, avg=20.22, stdev= 8.45, samples=153 lat (msec) : 4=1.95%, 10=26.60%, 20=16.41%, 50=45.74%, 100=8.79% lat (msec) : 250=0.49%, 500=0.03% cpu : usr=0.10%, sys=7.40%, ctx=5690, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148787: Wed Apr 1 08:06:07 2026 read: IOPS=19, BW=78.9KiB/s (80.8kB/s)(6028KiB/76360msec) clat (msec): min=3, max=128, avg=13.32, stdev=12.95 lat (msec): min=3, max=128, avg=13.33, stdev=12.95 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 19], 90.00th=[ 30], 95.00th=[ 41], | 99.00th=[ 67], 99.50th=[ 80], 99.90th=[ 106], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 7, max= 192, per=25.25%, avg=78.78, stdev=40.22, samples=152 iops : min= 1, max= 48, avg=19.39, stdev=10.13, samples=152 write: IOPS=20, BW=81.0KiB/s (83.9kB/s)(6260KiB/76360msec); 0 zone resets clat (msec): min=15, max=355, avg=35.84, stdev=17.75 lat (msec): min=15, max=355, avg=35.84, stdev=17.75 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 90], 99.50th=[ 103], 99.90th=[ 140], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 20, max= 159, per=25.08%, avg=81.77, stdev=34.68, samples=152 iops : min= 5, max= 39, avg=20.14, stdev= 8.73, samples=152 lat (msec) : 4=1.86%, 10=26.14%, 20=17.58%, 50=45.05%, 100=8.98% lat (msec) : 250=0.36%, 500=0.03% cpu : usr=0.10%, sys=7.50%, ctx=5728, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148788: Wed Apr 1 08:06:07 2026 read: IOPS=19, BW=79.2KiB/s (81.1kB/s)(6052KiB/76441msec) clat (msec): min=3, max=106, avg=13.13, stdev=11.73 lat (msec): min=3, max=106, avg=13.13, stdev=11.73 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 19], 90.00th=[ 28], 95.00th=[ 39], | 99.00th=[ 57], 99.50th=[ 67], 99.90th=[ 99], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 7, max= 224, per=25.30%, avg=78.93, stdev=40.11, samples=152 iops : min= 1, max= 56, avg=19.43, stdev=10.12, samples=152 write: IOPS=20, BW=81.6KiB/s (83.5kB/s)(6236KiB/76441msec); 0 zone resets clat (msec): min=14, max=355, avg=36.17, stdev=17.89 lat (msec): min=14, max=355, avg=36.17, stdev=17.89 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 92], 99.50th=[ 102], 99.90th=[ 129], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 24, max= 160, per=24.92%, avg=81.24, stdev=32.26, samples=152 iops : min= 6, max= 40, avg=20.00, stdev= 8.14, samples=152 lat (msec) : 4=1.69%, 10=26.43%, 20=16.18%, 50=46.52%, 100=8.89% lat (msec) : 250=0.26%, 500=0.03% cpu : usr=0.11%, sys=7.41%, ctx=5616, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=312KiB/s (320kB/s), 77.2KiB/s-79.2KiB/s (79.1kB/s-81.1kB/s), io=23.4MiB (24.6MB), run=76360-76932msec WRITE: bw=327KiB/s (335kB/s), 81.6KiB/s-82.5KiB/s (83.5kB/s-84.5kB/s), io=24.6MiB (25.7MB), run=76360-76932msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148821: Wed Apr 1 08:06:26 2026 read: IOPS=29, BW=465KiB/s (476kB/s)(5920KiB/12728msec) clat (usec): min=70, max=76449, avg=18017.93, stdev=11291.91 lat (usec): min=70, max=76450, avg=18020.34, stdev=11291.44 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 128], 10.00th=[ 7963], 20.00th=[10421], | 30.00th=[12518], 40.00th=[13960], 50.00th=[15795], 60.00th=[17695], | 70.00th=[20841], 80.00th=[25297], 90.00th=[32637], 95.00th=[38011], | 99.00th=[56886], 99.50th=[74974], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 255, max= 798, per=25.60%, avg=464.56, stdev=132.64, samples=25 iops : min= 15, max= 49, avg=28.52, stdev= 8.33, samples=25 write: IOPS=31, BW=500KiB/s (512kB/s)(6368KiB/12728msec); 0 zone resets clat (usec): min=1239, max=83554, avg=15141.51, stdev=11897.43 lat (usec): min=1239, max=83557, avg=15143.17, stdev=11897.55 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2835], 10.00th=[ 3687], 20.00th=[ 4948], | 30.00th=[ 7635], 40.00th=[ 9634], 50.00th=[11994], 60.00th=[14353], | 70.00th=[17957], 80.00th=[23462], 90.00th=[32637], 95.00th=[38536], | 99.00th=[53216], 99.50th=[76022], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 286, max= 736, per=26.12%, avg=498.88, stdev=140.19, samples=25 iops : min= 17, max= 46, avg=30.64, stdev= 8.93, samples=25 lat (usec) : 100=1.17%, 250=2.60% lat (msec) : 2=1.04%, 4=5.60%, 10=19.66%, 20=41.02%, 50=27.34% lat (msec) : 100=1.56% cpu : usr=0.15%, sys=28.99%, ctx=2415, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148822: Wed Apr 1 08:06:26 2026 read: IOPS=27, BW=435KiB/s (446kB/s)(5744KiB/13190msec) clat (usec): min=54, max=87083, avg=18368.74, stdev=11333.26 lat (usec): min=54, max=87085, avg=18369.67, stdev=11333.35 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 139], 10.00th=[ 7635], 20.00th=[10552], | 30.00th=[12387], 40.00th=[14222], 50.00th=[16909], 60.00th=[19006], | 70.00th=[21627], 80.00th=[24773], 90.00th=[32900], 95.00th=[38536], | 99.00th=[58459], 99.50th=[63177], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 157, max= 734, per=24.13%, avg=437.92, stdev=164.53, samples=26 iops : min= 9, max= 45, avg=26.85, stdev=10.43, samples=26 write: IOPS=31, BW=496KiB/s (508kB/s)(6544KiB/13190msec); 0 zone resets clat (usec): min=1723, max=92577, avg=15838.63, stdev=13315.28 lat (usec): min=1725, max=92578, avg=15840.20, stdev=13315.36 clat percentiles (usec): | 1.00th=[ 2245], 5.00th=[ 3294], 10.00th=[ 3720], 20.00th=[ 4883], | 30.00th=[ 6915], 40.00th=[ 9503], 50.00th=[11469], 60.00th=[14746], | 70.00th=[18744], 80.00th=[24249], 90.00th=[34341], 95.00th=[43779], | 99.00th=[58983], 99.50th=[65274], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 256, max= 800, per=26.00%, avg=496.69, stdev=160.15, samples=26 iops : min= 16, max= 50, avg=30.54, stdev=10.08, samples=26 lat (usec) : 100=0.91%, 250=2.21%, 500=0.13% lat (msec) : 2=0.26%, 4=5.99%, 10=21.74%, 20=36.72%, 50=29.56% lat (msec) : 100=2.47% cpu : usr=0.14%, sys=28.34%, ctx=2423, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148823: Wed Apr 1 08:06:26 2026 read: IOPS=29, BW=474KiB/s (486kB/s)(6256KiB/13192msec) clat (usec): min=48, max=77580, avg=18573.44, stdev=12045.03 lat (usec): min=50, max=77581, avg=18574.46, stdev=12045.10 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 125], 10.00th=[ 7635], 20.00th=[ 9765], | 30.00th=[11731], 40.00th=[14091], 50.00th=[16319], 60.00th=[19006], | 70.00th=[22414], 80.00th=[26608], 90.00th=[33817], 95.00th=[41157], | 99.00th=[63701], 99.50th=[71828], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 128, max= 736, per=26.11%, avg=473.92, stdev=154.86, samples=26 iops : min= 8, max= 46, avg=29.12, stdev= 9.66, samples=26 write: IOPS=28, BW=457KiB/s (468kB/s)(6032KiB/13192msec); 0 zone resets clat (usec): min=1117, max=87882, avg=15555.31, stdev=13590.64 lat (usec): min=1119, max=87885, avg=15557.07, stdev=13590.78 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3195], 10.00th=[ 3884], 20.00th=[ 4752], | 30.00th=[ 6587], 40.00th=[ 8979], 50.00th=[11338], 60.00th=[14746], | 70.00th=[18220], 80.00th=[23725], 90.00th=[32900], 95.00th=[42730], | 99.00th=[72877], 99.50th=[83362], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 191, max= 768, per=23.65%, avg=451.81, stdev=142.06, samples=26 iops : min= 11, max= 48, avg=27.73, stdev= 9.04, samples=26 lat (usec) : 50=0.13%, 100=0.91%, 250=3.26%, 1000=0.13% lat (msec) : 2=0.78%, 4=4.82%, 10=23.05%, 20=34.24%, 50=29.95% lat (msec) : 100=2.73% cpu : usr=0.19%, sys=27.95%, ctx=2499, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148824: Wed Apr 1 08:06:26 2026 read: IOPS=29, BW=467KiB/s (478kB/s)(6032KiB/12927msec) clat (usec): min=66, max=75241, avg=17495.94, stdev=11026.66 lat (usec): min=67, max=75242, avg=17496.88, stdev=11026.76 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 119], 10.00th=[ 2966], 20.00th=[ 9765], | 30.00th=[11994], 40.00th=[13698], 50.00th=[15664], 60.00th=[18482], | 70.00th=[20579], 80.00th=[25035], 90.00th=[31851], 95.00th=[38011], | 99.00th=[51643], 99.50th=[53216], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 159, max= 766, per=25.14%, avg=456.28, stdev=131.77, samples=25 iops : min= 9, max= 47, avg=28.00, stdev= 8.23, samples=25 write: IOPS=30, BW=484KiB/s (496kB/s)(6256KiB/12927msec); 0 zone resets clat (usec): min=1409, max=85768, avg=16004.44, stdev=13075.61 lat (usec): min=1411, max=85770, avg=16006.26, stdev=13075.79 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 3261], 10.00th=[ 3818], 20.00th=[ 4752], | 30.00th=[ 6521], 40.00th=[ 9896], 50.00th=[12387], 60.00th=[15926], | 70.00th=[19792], 80.00th=[24773], 90.00th=[33817], 95.00th=[40633], | 99.00th=[61604], 99.50th=[80217], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 284, max= 734, per=25.21%, avg=481.48, stdev=124.88, samples=25 iops : min= 17, max= 45, avg=29.56, stdev= 7.94, samples=25 lat (usec) : 100=1.69%, 250=2.99%, 750=0.13% lat (msec) : 2=0.52%, 4=5.99%, 10=19.92%, 20=36.72%, 50=30.34% lat (msec) : 100=1.69% cpu : usr=0.11%, sys=28.20%, ctx=2470, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1816KiB/s (1859kB/s), 435KiB/s-474KiB/s (446kB/s-486kB/s), io=23.4MiB (24.5MB), run=12728-13192msec WRITE: bw=1910KiB/s (1956kB/s), 457KiB/s-500KiB/s (468kB/s-512kB/s), io=24.6MiB (25.8MB), run=12728-13192msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148825: Wed Apr 1 08:06:32 2026 read: IOPS=19, BW=304KiB/s (312kB/s)(5920KiB/19442msec) clat (msec): min=3, max=104, avg=16.11, stdev=16.08 lat (msec): min=3, max=104, avg=16.12, stdev=16.08 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 72], 99.50th=[ 92], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 95, max= 704, per=24.22%, avg=298.13, stdev=159.97, samples=38 iops : min= 5, max= 44, avg=18.18, stdev=10.26, samples=38 write: IOPS=20, BW=328KiB/s (335kB/s)(6368KiB/19442msec); 0 zone resets clat (msec): min=12, max=171, avg=33.72, stdev=19.03 lat (msec): min=12, max=171, avg=33.72, stdev=19.03 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 77], | 99.00th=[ 97], 99.50th=[ 111], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 64, max= 640, per=25.00%, avg=324.00, stdev=176.05, samples=38 iops : min= 4, max= 40, avg=19.82, stdev=11.29, samples=38 lat (msec) : 4=2.47%, 10=22.53%, 20=23.57%, 50=40.89%, 100=10.16% lat (msec) : 250=0.39% cpu : usr=0.10%, sys=9.89%, ctx=1626, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148826: Wed Apr 1 08:06:32 2026 read: IOPS=18, BW=297KiB/s (304kB/s)(5744KiB/19363msec) clat (msec): min=3, max=133, avg=15.06, stdev=16.07 lat (msec): min=3, max=133, avg=15.07, stdev=16.07 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 31], 95.00th=[ 47], | 99.00th=[ 97], 99.50th=[ 115], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 63, max= 736, per=24.03%, avg=295.87, stdev=185.21, samples=38 iops : min= 3, max= 46, avg=18.05, stdev=11.83, samples=38 write: IOPS=21, BW=338KiB/s (346kB/s)(6544KiB/19363msec); 0 zone resets clat (usec): min=14031, max=93774, avg=34034.32, stdev=17540.84 lat (usec): min=14032, max=93776, avg=34036.49, stdev=17540.91 clat percentiles (usec): | 1.00th=[14746], 5.00th=[16581], 10.00th=[17695], 20.00th=[19792], | 30.00th=[21890], 40.00th=[24511], 50.00th=[27657], 60.00th=[31589], | 70.00th=[38011], 80.00th=[47973], 90.00th=[60556], 95.00th=[74974], | 99.00th=[88605], 99.50th=[89654], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 125, max= 672, per=25.94%, avg=336.16, stdev=163.60, samples=38 iops : min= 7, max= 42, avg=20.58, stdev=10.49, samples=38 lat (msec) : 4=1.43%, 10=24.22%, 20=21.48%, 50=41.15%, 100=11.46% lat (msec) : 250=0.26% cpu : usr=0.11%, sys=9.94%, ctx=1618, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148827: Wed Apr 1 08:06:32 2026 read: IOPS=20, BW=325KiB/s (333kB/s)(6256KiB/19233msec) clat (usec): min=2975, max=88761, avg=15453.28, stdev=15519.96 lat (usec): min=2976, max=88763, avg=15454.43, stdev=15520.01 clat percentiles (usec): | 1.00th=[ 3195], 5.00th=[ 3785], 10.00th=[ 4228], 20.00th=[ 5080], | 30.00th=[ 5932], 40.00th=[ 7308], 50.00th=[ 9372], 60.00th=[12125], | 70.00th=[15926], 80.00th=[23200], 90.00th=[34341], 95.00th=[52691], | 99.00th=[79168], 99.50th=[85459], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 63, max= 800, per=26.60%, avg=327.39, stdev=206.01, samples=38 iops : min= 3, max= 50, avg=20.03, stdev=13.15, samples=38 write: IOPS=19, BW=314KiB/s (321kB/s)(6032KiB/19233msec); 0 zone resets clat (msec): min=13, max=155, avg=34.77, stdev=19.94 lat (msec): min=13, max=155, avg=34.77, stdev=19.94 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 49], 90.00th=[ 63], 95.00th=[ 75], | 99.00th=[ 100], 99.50th=[ 142], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 95, max= 736, per=24.13%, avg=312.76, stdev=171.36, samples=38 iops : min= 5, max= 46, avg=19.11, stdev=10.99, samples=38 lat (msec) : 4=3.91%, 10=23.18%, 20=21.09%, 50=39.97%, 100=11.46% lat (msec) : 250=0.39% cpu : usr=0.09%, sys=9.97%, ctx=1641, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148828: Wed Apr 1 08:06:32 2026 read: IOPS=19, BW=310KiB/s (318kB/s)(6032KiB/19437msec) clat (msec): min=3, max=135, avg=16.22, stdev=17.11 lat (msec): min=3, max=135, avg=16.23, stdev=17.11 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 37], 95.00th=[ 56], | 99.00th=[ 78], 99.50th=[ 115], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 63, max= 800, per=24.76%, avg=304.82, stdev=185.31, samples=38 iops : min= 3, max= 50, avg=18.61, stdev=11.81, samples=38 write: IOPS=20, BW=322KiB/s (330kB/s)(6256KiB/19437msec); 0 zone resets clat (msec): min=12, max=140, avg=33.76, stdev=19.38 lat (msec): min=12, max=140, avg=33.76, stdev=19.38 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 46], 90.00th=[ 61], 95.00th=[ 79], | 99.00th=[ 104], 99.50th=[ 116], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 94, max= 640, per=24.60%, avg=318.84, stdev=174.67, samples=38 iops : min= 5, max= 40, avg=19.47, stdev=11.22, samples=38 lat (msec) : 4=3.26%, 10=22.66%, 20=20.18%, 50=42.71%, 100=10.42% lat (msec) : 250=0.78% cpu : usr=0.09%, sys=9.64%, ctx=1614, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1232KiB/s (1262kB/s), 297KiB/s-325KiB/s (304kB/s-333kB/s), io=23.4MiB (24.5MB), run=19233-19442msec WRITE: bw=1296KiB/s (1327kB/s), 314KiB/s-338KiB/s (321kB/s-346kB/s), io=24.6MiB (25.8MB), run=19233-19442msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148837: Wed Apr 1 08:06:41 2026 read: IOPS=2, BW=2485KiB/s (2545kB/s)(7168KiB/2884msec) clat (msec): min=110, max=218, avg=135.09, stdev=40.95 lat (msec): min=110, max=218, avg=135.09, stdev=40.95 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 114], 60.00th=[ 120], | 70.00th=[ 120], 80.00th=[ 161], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 3946, max= 5171, per=66.66%, avg=4558.50, stdev=866.21, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1775KiB/s (1818kB/s)(5120KiB/2884msec); 0 zone resets clat (msec): min=143, max=938, avg=379.38, stdev=334.93 lat (msec): min=143, max=938, avg=379.44, stdev=334.94 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1723, max= 4096, per=27.36%, avg=2619.33, stdev=1288.55, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=83.33%, 500=8.33%, 1000=8.33% cpu : usr=0.07%, sys=36.75%, ctx=1092, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148838: Wed Apr 1 08:06:41 2026 read: IOPS=0, BW=684KiB/s (700kB/s)(2048KiB/2995msec) clat (msec): min=96, max=168, avg=132.40, stdev=50.94 lat (msec): min=96, max=168, avg=132.40, stdev=50.94 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 169], 95.00th=[ 169], | 99.00th=[ 169], 99.50th=[ 169], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 1718, max= 2039, per=27.47%, avg=1878.50, stdev=226.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3419KiB/s (3501kB/s)(10.0MiB/2995msec); 0 zone resets clat (msec): min=100, max=790, avg=271.32, stdev=211.48 lat (msec): min=101, max=790, avg=271.39, stdev=211.47 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 106], | 30.00th=[ 157], 40.00th=[ 167], 50.00th=[ 197], 60.00th=[ 205], | 70.00th=[ 215], 80.00th=[ 317], 90.00th=[ 464], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1718, max= 4096, per=28.93%, avg=2769.40, stdev=1151.48, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=35.60%, ctx=506, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148839: Wed Apr 1 08:06:41 2026 read: IOPS=2, BW=2606KiB/s (2668kB/s)(6144KiB/2358msec) clat (usec): min=486, max=657860, avg=165410.29, stdev=253293.77 lat (usec): min=488, max=657861, avg=165411.70, stdev=253293.80 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 34341], 50.00th=[ 34341], 60.00th=[ 93848], | 70.00th=[204473], 80.00th=[204473], 90.00th=[658506], 95.00th=[658506], | 99.00th=[658506], 99.50th=[658506], 99.90th=[658506], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 1973, max= 8159, per=74.09%, avg=5066.00, stdev=4374.16, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=2, BW=2606KiB/s (2668kB/s)(6144KiB/2358msec); 0 zone resets clat (msec): min=82, max=384, avg=218.30, stdev=108.09 lat (msec): min=82, max=384, avg=218.35, stdev=108.10 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1973, max= 4079, per=33.00%, avg=3158.67, stdev=1077.78, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=34.75%, ctx=581, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148840: Wed Apr 1 08:06:41 2026 read: IOPS=2, BW=2550KiB/s (2611kB/s)(5120KiB/2008msec) clat (usec): min=434, max=176291, avg=78046.92, stdev=66558.09 lat (usec): min=436, max=176292, avg=78048.00, stdev=66558.06 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 437], 10.00th=[ 437], 20.00th=[ 437], | 30.00th=[ 49546], 40.00th=[ 49546], 50.00th=[ 57410], 60.00th=[ 57410], | 70.00th=[106431], 80.00th=[106431], 90.00th=[177210], 95.00th=[177210], | 99.00th=[177210], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3570KiB/s (3655kB/s)(7168KiB/2008msec); 0 zone resets clat (msec): min=51, max=453, avg=225.14, stdev=140.95 lat (msec): min=51, max=453, avg=225.20, stdev=140.97 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 68], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 230], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 321], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 3430, max= 4096, per=39.95%, avg=3824.00, stdev=349.36, samples=3 iops : min= 3, max= 4, avg= 3.33, stdev= 0.58, samples=3 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=25.00% cpu : usr=0.00%, sys=43.10%, ctx=689, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6838KiB/s (7002kB/s), 684KiB/s-2606KiB/s (700kB/s-2668kB/s), io=20.0MiB (20.0MB), run=2008-2995msec WRITE: bw=9573KiB/s (9803kB/s), 1775KiB/s-3570KiB/s (1818kB/s-3655kB/s), io=28.0MiB (29.4MB), run=2008-2995msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148841: Wed Apr 1 08:06:41 2026 read: IOPS=2, BW=2667KiB/s (2731kB/s)(7168KiB/2688msec) clat (msec): min=57, max=268, avg=137.52, stdev=65.53 lat (msec): min=57, max=268, avg=137.52, stdev=65.53 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 118], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 150], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 2043, max= 5086, per=55.34%, avg=3741.67, stdev=1552.14, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1905KiB/s (1950kB/s)(5120KiB/2688msec); 0 zone resets clat (msec): min=80, max=876, avg=341.38, stdev=319.38 lat (msec): min=80, max=876, avg=341.45, stdev=319.37 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1695, max= 4096, per=34.79%, avg=3292.67, stdev=1383.63, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=12.69%, ctx=105, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148842: Wed Apr 1 08:06:41 2026 read: IOPS=0, BW=676KiB/s (692kB/s)(2048KiB/3029msec) clat (msec): min=60, max=277, avg=168.90, stdev=153.16 lat (msec): min=60, max=277, avg=168.90, stdev=153.16 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1718, max= 2043, per=27.81%, avg=1880.50, stdev=229.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3381KiB/s (3462kB/s)(10.0MiB/3029msec); 0 zone resets clat (msec): min=94, max=761, avg=258.38, stdev=199.37 lat (msec): min=94, max=761, avg=258.44, stdev=199.37 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 100], | 30.00th=[ 144], 40.00th=[ 146], 50.00th=[ 167], 60.00th=[ 232], | 70.00th=[ 255], 80.00th=[ 309], 90.00th=[ 380], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2043, max= 6144, per=43.26%, avg=4094.33, stdev=2050.50, samples=3 iops : min= 1, max= 6, avg= 3.67, stdev= 2.52, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 1000=8.33% cpu : usr=0.03%, sys=17.31%, ctx=557, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148843: Wed Apr 1 08:06:41 2026 read: IOPS=2, BW=2172KiB/s (2224kB/s)(6144KiB/2829msec) clat (msec): min=58, max=236, avg=132.73, stdev=65.64 lat (msec): min=58, max=236, avg=132.73, stdev=65.64 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 4087, max= 4096, per=60.52%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2172KiB/s (2224kB/s)(6144KiB/2829msec); 0 zone resets clat (msec): min=97, max=928, avg=320.57, stdev=315.28 lat (msec): min=97, max=928, avg=320.65, stdev=315.28 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1709, max= 4087, per=26.13%, avg=2473.00, stdev=1087.80, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=25.00%, 250=50.00%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=15.42%, ctx=331, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148844: Wed Apr 1 08:06:41 2026 read: IOPS=1, BW=1760KiB/s (1802kB/s)(5120KiB/2909msec) clat (msec): min=43, max=186, avg=100.67, stdev=54.73 lat (msec): min=43, max=186, avg=100.67, stdev=54.73 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 44], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 79], 60.00th=[ 79], | 70.00th=[ 117], 80.00th=[ 117], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2464KiB/s (2523kB/s)(7168KiB/2909msec); 0 zone resets clat (msec): min=84, max=1117, avg=329.35, stdev=363.88 lat (msec): min=84, max=1117, avg=329.43, stdev=363.88 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 93], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 201], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1735, max= 4096, per=27.73%, avg=2624.67, stdev=1283.48, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=33.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=14.24%, ctx=155, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6761KiB/s (6924kB/s), 676KiB/s-2667KiB/s (692kB/s-2731kB/s), io=20.0MiB (20.0MB), run=2688-3029msec WRITE: bw=9466KiB/s (9693kB/s), 1905KiB/s-3381KiB/s (1950kB/s-3462kB/s), io=28.0MiB (29.4MB), run=2688-3029msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148854: Wed Apr 1 08:06:49 2026 read: IOPS=2, BW=10.6MiB/s (11.2MB/s)(12.0MiB/1127msec) clat (msec): min=244, max=512, avg=375.29, stdev=134.27 lat (msec): min=244, max=512, avg=375.30, stdev=134.27 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 5793, max= 5793, per=56.29%, avg=5793.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=20.60%, ctx=67, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148855: Wed Apr 1 08:06:49 2026 read: IOPS=0, BW=2573KiB/s (2635kB/s)(4096KiB/1592msec) clat (nsec): min=906220k, max=906220k, avg=906220375.00, stdev= 0.00 lat (nsec): min=906221k, max=906221k, avg=906221178.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8192, max= 8192, per=79.60%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5146KiB/s (5269kB/s)(8192KiB/1592msec); 0 zone resets clat (msec): min=266, max=417, avg=342.18, stdev=106.43 lat (msec): min=267, max=417, avg=342.49, stdev=106.45 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.13%, sys=15.02%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148856: Wed Apr 1 08:06:49 2026 write: IOPS=2, BW=8393KiB/s (8595kB/s)(12.0MiB/1464msec); 0 zone resets clat (msec): min=135, max=702, avg=487.32, stdev=307.07 lat (msec): min=135, max=702, avg=487.60, stdev=307.07 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 5826, max= 5826, per=28.31%, avg=5826.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=13.74%, ctx=46, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148857: Wed Apr 1 08:06:49 2026 write: IOPS=2, BW=9431KiB/s (9657kB/s)(12.0MiB/1303msec); 0 zone resets clat (msec): min=359, max=473, avg=433.60, stdev=63.84 lat (msec): min=360, max=473, avg=433.89, stdev=63.84 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 5910, max= 8192, per=34.26%, avg=7051.00, stdev=1613.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=20.12%, ctx=181, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.0MiB/s (10.5MB/s), 2573KiB/s-10.6MiB/s (2635kB/s-11.2MB/s), io=16.0MiB (16.8MB), run=1127-1592msec WRITE: bw=20.1MiB/s (21.1MB/s), 5146KiB/s-9431KiB/s (5269kB/s-9657kB/s), io=32.0MiB (33.6MB), run=1303-1592msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148849: Wed Apr 1 08:06:49 2026 read: IOPS=2, BW=9752KiB/s (9986kB/s)(12.0MiB/1260msec) clat (msec): min=331, max=473, avg=409.27, stdev=71.84 lat (msec): min=331, max=473, avg=409.27, stdev=71.84 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7529, max= 8062, per=66.28%, avg=7795.50, stdev=376.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=46.47%, ctx=2496, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148850: Wed Apr 1 08:06:49 2026 read: IOPS=0, BW=2940KiB/s (3011kB/s)(4096KiB/1393msec) clat (nsec): min=332041k, max=332041k, avg=332040718.00, stdev= 0.00 lat (nsec): min=332043k, max=332043k, avg=332043005.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7699, max= 7699, per=65.46%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5881KiB/s (6022kB/s)(8192KiB/1393msec); 0 zone resets clat (msec): min=463, max=576, avg=520.05, stdev=79.55 lat (msec): min=464, max=576, avg=520.35, stdev=79.56 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 8062, max= 8062, per=45.02%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=24.28%, ctx=753, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148851: Wed Apr 1 08:06:49 2026 write: IOPS=1, BW=6715KiB/s (6876kB/s)(12.0MiB/1830msec); 0 zone resets clat (msec): min=145, max=1195, avg=602.86, stdev=537.89 lat (msec): min=146, max=1195, avg=603.14, stdev=537.89 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8094, max= 8094, per=45.20%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.84%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148852: Wed Apr 1 08:06:49 2026 write: IOPS=2, BW=8765KiB/s (8975kB/s)(12.0MiB/1402msec); 0 zone resets clat (msec): min=191, max=717, avg=462.46, stdev=263.28 lat (msec): min=192, max=718, avg=462.77, stdev=263.30 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7816, max= 8062, per=44.34%, avg=7939.00, stdev=173.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=19.91%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.5MiB/s (12.0MB/s), 2940KiB/s-9752KiB/s (3011kB/s-9986kB/s), io=16.0MiB (16.8MB), run=1260-1393msec WRITE: bw=17.5MiB/s (18.3MB/s), 5881KiB/s-8765KiB/s (6022kB/s-8975kB/s), io=32.0MiB (33.6MB), run=1393-1830msec