== sanity test 398b: DIO and buffer IO race ============== 02:41:10 (1779691270) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.97197 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146014: Mon May 25 02:43:27 2026 read: IOPS=12, BW=51.1KiB/s (52.3kB/s)(5992KiB/117242msec) clat (usec): min=35, max=231727, avg=38421.76, stdev=27933.21 lat (usec): min=35, max=231728, avg=38428.18, stdev=27939.54 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 10159], 20.00th=[ 18482], | 30.00th=[ 22676], 40.00th=[ 27657], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[170918], 99.90th=[225444], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 103, per=24.99%, avg=50.73, stdev=20.44, samples=230 iops : min= 1, max= 25, avg=12.07, stdev= 5.18, samples=230 write: IOPS=13, BW=53.7KiB/s (54.0kB/s)(6296KiB/117242msec); 0 zone resets clat (usec): min=822, max=613702, avg=37619.72, stdev=44018.28 lat (usec): min=823, max=613704, avg=37627.06, stdev=44020.38 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1516], 20.00th=[ 4178], | 30.00th=[ 7832], 40.00th=[ 16909], 50.00th=[ 27395], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[164627], 99.50th=[191890], 99.90th=[583009], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 128, per=25.16%, avg=53.59, stdev=22.83, samples=229 iops : min= 1, max= 32, avg=12.78, stdev= 5.77, samples=229 lat (usec) : 50=0.49%, 100=3.45%, 250=0.23%, 500=0.10%, 1000=0.13% lat (msec) : 2=6.48%, 4=3.65%, 10=7.39%, 20=11.33%, 50=38.38% lat (msec) : 100=23.67%, 250=4.56%, 500=0.07%, 750=0.10% cpu : usr=0.09%, sys=5.43%, ctx=6606, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146016: Mon May 25 02:43:27 2026 read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(5940KiB/117446msec) clat (usec): min=28, max=282116, avg=37887.42, stdev=28484.18 lat (usec): min=29, max=282118, avg=37889.09, stdev=28484.42 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 6783], 20.00th=[ 17957], | 30.00th=[ 23200], 40.00th=[ 27657], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 45876], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[132645], 99.50th=[177210], 99.90th=[212861], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 111, per=25.00%, avg=50.76, stdev=22.07, samples=229 iops : min= 1, max= 27, avg=12.07, stdev= 5.55, samples=229 write: IOPS=13, BW=54.0KiB/s (55.3kB/s)(6348KiB/117446msec); 0 zone resets clat (usec): min=902, max=608058, avg=38242.46, stdev=42482.84 lat (usec): min=905, max=608060, avg=38244.26, stdev=42482.82 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1369], 10.00th=[ 1778], 20.00th=[ 4490], | 30.00th=[ 8455], 40.00th=[ 16909], 50.00th=[ 27657], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 65799], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[189793], 99.50th=[246416], 99.90th=[325059], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 144, per=25.12%, avg=53.50, stdev=21.72, samples=232 iops : min= 1, max= 36, avg=12.76, stdev= 5.51, samples=232 lat (usec) : 50=0.59%, 100=3.68%, 250=0.36%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=5.63%, 4=4.04%, 10=7.19%, 20=11.82%, 50=38.61% lat (msec) : 100=22.79%, 250=4.85%, 500=0.16%, 750=0.03% cpu : usr=0.10%, sys=5.40%, ctx=6540, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146017: Mon May 25 02:43:27 2026 read: IOPS=12, BW=51.8KiB/s (53.0kB/s)(6028KiB/116410msec) clat (usec): min=23, max=662241, avg=37666.66, stdev=33509.74 lat (usec): min=23, max=662241, avg=37669.43, stdev=33509.65 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 75], 20.00th=[ 16909], | 30.00th=[ 22414], 40.00th=[ 26870], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 45351], 80.00th=[ 54789], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[152044], 99.50th=[177210], 99.90th=[263193], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 96, per=25.38%, avg=51.53, stdev=20.06, samples=229 iops : min= 1, max= 24, avg=12.27, stdev= 5.07, samples=229 write: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6260KiB/116410msec); 0 zone resets clat (usec): min=939, max=290569, avg=37821.57, stdev=38003.48 lat (usec): min=941, max=290571, avg=37825.56, stdev=38001.34 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1696], 20.00th=[ 4359], | 30.00th=[ 8979], 40.00th=[ 18744], 50.00th=[ 28443], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 87557], 95.00th=[106431], | 99.00th=[179307], 99.50th=[206570], 99.90th=[238027], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 127, per=25.10%, avg=53.45, stdev=22.09, samples=229 iops : min= 1, max= 31, avg=12.75, stdev= 5.58, samples=229 lat (usec) : 50=1.01%, 100=4.10%, 250=0.29%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.22%, 4=3.35%, 10=6.71%, 20=11.23%, 50=39.55% lat (msec) : 100=22.66%, 250=4.43%, 500=0.10%, 750=0.03% cpu : usr=0.07%, sys=5.45%, ctx=6495, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146018: Mon May 25 02:43:27 2026 read: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6052KiB/117958msec) clat (usec): min=22, max=294009, avg=37841.31, stdev=27607.94 lat (usec): min=22, max=294010, avg=37848.86, stdev=27606.12 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 594], 20.00th=[ 18744], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 33162], 60.00th=[ 39060], | 70.00th=[ 45876], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[132645], 99.50th=[164627], 99.90th=[196084], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 111, per=25.37%, avg=51.49, stdev=21.57, samples=230 iops : min= 1, max= 27, avg=12.25, stdev= 5.46, samples=230 write: IOPS=13, BW=52.9KiB/s (54.1kB/s)(6236KiB/117958msec); 0 zone resets clat (usec): min=738, max=603151, avg=38627.73, stdev=40869.47 lat (usec): min=739, max=603153, avg=38630.88, stdev=40871.28 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1827], 20.00th=[ 4490], | 30.00th=[ 8979], 40.00th=[ 18482], 50.00th=[ 28181], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[158335], 99.50th=[193987], 99.90th=[316670], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 134, per=24.55%, avg=52.28, stdev=21.85, samples=233 iops : min= 1, max= 33, avg=12.45, stdev= 5.51, samples=233 lat (usec) : 50=0.85%, 100=3.68%, 250=0.39%, 750=0.07%, 1000=0.13% lat (msec) : 2=5.37%, 4=4.04%, 10=6.84%, 20=10.68%, 50=40.20% lat (msec) : 100=22.62%, 250=5.01%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=5.57%, ctx=6557, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=204KiB/s (208kB/s), 50.6KiB/s-51.8KiB/s (51.8kB/s-53.0kB/s), io=23.4MiB (24.6MB), run=116410-117958msec WRITE: bw=213KiB/s (218kB/s), 52.9KiB/s-54.0KiB/s (54.1kB/s-55.3kB/s), io=24.6MiB (25.7MB), run=116410-117958msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146011: Mon May 25 02:45:11 2026 read: IOPS=6, BW=27.1KiB/s (27.7kB/s)(5992KiB/221180msec) clat (msec): min=4, max=762, avg=31.87, stdev=36.61 lat (msec): min=4, max=762, avg=31.87, stdev=36.61 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 70], 95.00th=[ 90], | 99.00th=[ 163], 99.50th=[ 199], 99.90th=[ 414], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 127, per=27.20%, avg=29.38, stdev=20.47, samples=397 iops : min= 1, max= 31, avg= 6.74, stdev= 5.19, samples=397 write: IOPS=7, BW=28.5KiB/s (29.1kB/s)(6296KiB/221180msec); 0 zone resets clat (msec): min=29, max=539, avg=109.89, stdev=63.11 lat (msec): min=29, max=539, avg=109.90, stdev=63.11 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 70], 40.00th=[ 78], 50.00th=[ 89], 60.00th=[ 104], | 70.00th=[ 124], 80.00th=[ 157], 90.00th=[ 203], 95.00th=[ 234], | 99.00th=[ 317], 99.50th=[ 355], 99.90th=[ 443], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 79, per=24.92%, avg=28.16, stdev=14.91, samples=434 iops : min= 1, max= 19, avg= 6.43, stdev= 3.82, samples=434 lat (msec) : 10=5.70%, 20=16.89%, 50=21.91%, 100=32.23%, 250=21.22% lat (msec) : 500=1.99%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.52%, ctx=5577, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146012: Mon May 25 02:45:11 2026 read: IOPS=6, BW=26.8KiB/s (27.4kB/s)(5940KiB/221594msec) clat (msec): min=4, max=655, avg=32.08, stdev=35.88 lat (msec): min=4, max=655, avg=32.08, stdev=35.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 68], 95.00th=[ 89], | 99.00th=[ 153], 99.50th=[ 171], 99.90th=[ 351], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 111, per=27.59%, avg=29.80, stdev=20.44, samples=388 iops : min= 1, max= 27, avg= 6.85, stdev= 5.20, samples=388 write: IOPS=7, BW=28.6KiB/s (29.3kB/s)(6348KiB/221594msec); 0 zone resets clat (msec): min=30, max=617, avg=109.31, stdev=62.08 lat (msec): min=30, max=617, avg=109.31, stdev=62.08 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 48], 10.00th=[ 54], 20.00th=[ 62], | 30.00th=[ 69], 40.00th=[ 79], 50.00th=[ 89], 60.00th=[ 102], | 70.00th=[ 124], 80.00th=[ 155], 90.00th=[ 197], 95.00th=[ 239], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 443], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 71, per=25.03%, avg=28.29, stdev=14.85, samples=436 iops : min= 1, max= 17, avg= 6.47, stdev= 3.80, samples=436 lat (msec) : 10=5.92%, 20=15.49%, 50=22.82%, 100=32.75%, 250=20.90% lat (msec) : 500=2.05%, 750=0.07% cpu : usr=0.05%, sys=1.63%, ctx=5597, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146013: Mon May 25 02:45:11 2026 read: IOPS=6, BW=27.2KiB/s (27.8kB/s)(6028KiB/221867msec) clat (msec): min=4, max=416, avg=33.81, stdev=35.31 lat (msec): min=4, max=416, avg=33.81, stdev=35.31 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 72], 95.00th=[ 99], | 99.00th=[ 153], 99.50th=[ 207], 99.90th=[ 393], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 95, per=26.64%, avg=28.77, stdev=19.73, samples=406 iops : min= 1, max= 23, avg= 6.60, stdev= 5.00, samples=406 write: IOPS=7, BW=28.2KiB/s (28.9kB/s)(6260KiB/221867msec); 0 zone resets clat (msec): min=24, max=796, avg=108.92, stdev=64.18 lat (msec): min=24, max=796, avg=108.92, stdev=64.18 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 47], 10.00th=[ 54], 20.00th=[ 62], | 30.00th=[ 69], 40.00th=[ 78], 50.00th=[ 88], 60.00th=[ 102], | 70.00th=[ 121], 80.00th=[ 155], 90.00th=[ 201], 95.00th=[ 234], | 99.00th=[ 305], 99.50th=[ 372], 99.90th=[ 447], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 72, per=24.65%, avg=27.86, stdev=14.98, samples=435 iops : min= 1, max= 18, avg= 6.36, stdev= 3.84, samples=435 lat (msec) : 10=6.15%, 20=14.62%, 50=23.57%, 100=32.42%, 250=21.22% lat (msec) : 500=1.99%, 1000=0.03% cpu : usr=0.04%, sys=1.55%, ctx=5637, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146015: Mon May 25 02:45:11 2026 read: IOPS=6, BW=27.3KiB/s (27.9kB/s)(6052KiB/222080msec) clat (msec): min=4, max=412, avg=32.27, stdev=34.92 lat (msec): min=4, max=412, avg=32.27, stdev=34.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 70], 95.00th=[ 95], | 99.00th=[ 155], 99.50th=[ 218], 99.90th=[ 334], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 111, per=27.88%, avg=30.11, stdev=20.88, samples=389 iops : min= 1, max= 27, avg= 6.93, stdev= 5.29, samples=389 write: IOPS=7, BW=28.1KiB/s (28.8kB/s)(6236KiB/222080msec); 0 zone resets clat (msec): min=24, max=893, avg=110.81, stdev=68.04 lat (msec): min=24, max=893, avg=110.81, stdev=68.04 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 47], 10.00th=[ 53], 20.00th=[ 62], | 30.00th=[ 70], 40.00th=[ 79], 50.00th=[ 89], 60.00th=[ 101], | 70.00th=[ 124], 80.00th=[ 159], 90.00th=[ 205], 95.00th=[ 236], | 99.00th=[ 330], 99.50th=[ 388], 99.90th=[ 609], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 64, per=24.42%, avg=27.59, stdev=14.94, samples=436 iops : min= 1, max= 16, avg= 6.29, stdev= 3.83, samples=436 lat (msec) : 10=6.97%, 20=16.05%, 50=22.20%, 100=32.36%, 250=20.21% lat (msec) : 500=2.12%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.54%, ctx=5671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=108KiB/s (111kB/s), 26.8KiB/s-27.3KiB/s (27.4kB/s-27.9kB/s), io=23.4MiB (24.6MB), run=221180-222080msec WRITE: bw=113KiB/s (116kB/s), 28.1KiB/s-28.6KiB/s (28.8kB/s-29.3kB/s), io=24.6MiB (25.7MB), run=221180-222080msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146073: Mon May 25 02:45:37 2026 read: IOPS=19, BW=315KiB/s (322kB/s)(5920KiB/18819msec) clat (usec): min=38, max=106027, avg=25945.03, stdev=20366.82 lat (usec): min=39, max=106027, avg=25949.03, stdev=20363.15 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 165], | 30.00th=[ 15926], 40.00th=[ 20579], 50.00th=[ 24773], 60.00th=[ 28443], | 70.00th=[ 32900], 80.00th=[ 42206], 90.00th=[ 51119], 95.00th=[ 61604], | 99.00th=[ 87557], 99.50th=[ 90702], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 190, max= 539, per=24.53%, avg=312.03, stdev=92.34, samples=37 iops : min= 11, max= 33, avg=18.73, stdev= 5.89, samples=37 write: IOPS=21, BW=338KiB/s (347kB/s)(6368KiB/18819msec); 0 zone resets clat (usec): min=1482, max=178757, avg=22717.16, stdev=25437.17 lat (usec): min=1484, max=178759, avg=22722.18, stdev=25436.36 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1844], 10.00th=[ 2245], 20.00th=[ 3326], | 30.00th=[ 4752], 40.00th=[ 8029], 50.00th=[ 13960], 60.00th=[ 21103], | 70.00th=[ 29230], 80.00th=[ 39060], 90.00th=[ 53216], 95.00th=[ 67634], | 99.00th=[114820], 99.50th=[177210], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 604, per=25.25%, avg=338.05, stdev=99.56, samples=37 iops : min= 1, max= 37, avg=20.35, stdev= 6.19, samples=37 lat (usec) : 50=0.91%, 100=7.68%, 250=1.43%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.52%, 4=8.85%, 10=11.72%, 20=13.80%, 50=39.45% lat (msec) : 100=11.20%, 250=1.04% cpu : usr=0.08%, sys=9.68%, ctx=1579, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146074: Mon May 25 02:45:37 2026 read: IOPS=19, BW=314KiB/s (322kB/s)(5744KiB/18284msec) clat (usec): min=39, max=79656, avg=25059.29, stdev=17608.09 lat (usec): min=39, max=79657, avg=25060.80, stdev=17608.28 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 65], 20.00th=[ 1270], | 30.00th=[17695], 40.00th=[21103], 50.00th=[24511], 60.00th=[28181], | 70.00th=[33162], 80.00th=[40109], 90.00th=[47973], 95.00th=[55313], | 99.00th=[73925], 99.50th=[78119], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 95, max= 508, per=24.85%, avg=316.06, stdev=104.50, samples=36 iops : min= 5, max= 31, avg=18.97, stdev= 6.63, samples=36 write: IOPS=22, BW=358KiB/s (366kB/s)(6544KiB/18284msec); 0 zone resets clat (usec): min=987, max=287440, avg=22516.95, stdev=26851.89 lat (usec): min=989, max=287444, avg=22518.91, stdev=26851.92 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1975], 10.00th=[ 2474], 20.00th=[ 4047], | 30.00th=[ 5800], 40.00th=[ 9110], 50.00th=[ 14746], 60.00th=[ 20579], | 70.00th=[ 28705], 80.00th=[ 36439], 90.00th=[ 51119], 95.00th=[ 65799], | 99.00th=[102237], 99.50th=[120062], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 190, max= 540, per=26.73%, avg=357.89, stdev=95.08, samples=36 iops : min= 11, max= 33, avg=21.61, stdev= 5.98, samples=36 lat (usec) : 50=0.65%, 100=7.42%, 250=0.65%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.86%, 4=7.42%, 10=12.63%, 20=16.41%, 50=41.41% lat (msec) : 100=8.98%, 250=0.65%, 500=0.13% cpu : usr=0.09%, sys=9.74%, ctx=1522, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146075: Mon May 25 02:45:37 2026 read: IOPS=21, BW=344KiB/s (352kB/s)(6256KiB/18201msec) clat (usec): min=35, max=206171, avg=25090.26, stdev=21151.12 lat (usec): min=36, max=206172, avg=25092.11, stdev=21151.14 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 110], | 30.00th=[ 16581], 40.00th=[ 20579], 50.00th=[ 23987], 60.00th=[ 28443], | 70.00th=[ 32375], 80.00th=[ 37487], 90.00th=[ 47449], 95.00th=[ 56361], | 99.00th=[ 90702], 99.50th=[139461], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 156, max= 542, per=27.06%, avg=344.22, stdev=85.43, samples=36 iops : min= 9, max= 33, avg=20.75, stdev= 5.35, samples=36 write: IOPS=20, BW=331KiB/s (339kB/s)(6032KiB/18201msec); 0 zone resets clat (usec): min=1285, max=165571, avg=21896.30, stdev=22392.78 lat (usec): min=1288, max=165573, avg=21898.63, stdev=22392.98 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1778], 10.00th=[ 2147], 20.00th=[ 3359], | 30.00th=[ 5932], 40.00th=[ 9372], 50.00th=[ 15401], 60.00th=[ 20841], | 70.00th=[ 26608], 80.00th=[ 36963], 90.00th=[ 52691], 95.00th=[ 65799], | 99.00th=[100140], 99.50th=[109577], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 126, max= 572, per=24.71%, avg=330.83, stdev=109.92, samples=36 iops : min= 7, max= 35, avg=19.89, stdev= 6.95, samples=36 lat (usec) : 50=1.30%, 100=8.20%, 250=1.17%, 500=0.26% lat (msec) : 2=4.43%, 4=6.90%, 10=10.03%, 20=15.63%, 50=42.45% lat (msec) : 100=8.98%, 250=0.65% cpu : usr=0.12%, sys=9.38%, ctx=1539, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146076: Mon May 25 02:45:37 2026 read: IOPS=21, BW=339KiB/s (347kB/s)(6032KiB/17797msec) clat (usec): min=35, max=146241, avg=24287.14, stdev=21289.26 lat (usec): min=35, max=146241, avg=24288.18, stdev=21289.24 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 52], 10.00th=[ 61], 20.00th=[ 77], | 30.00th=[ 12125], 40.00th=[ 17957], 50.00th=[ 23725], 60.00th=[ 27657], | 70.00th=[ 32900], 80.00th=[ 40109], 90.00th=[ 50070], 95.00th=[ 61080], | 99.00th=[ 90702], 99.50th=[105382], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 127, max= 574, per=26.40%, avg=335.83, stdev=103.53, samples=35 iops : min= 7, max= 35, avg=20.23, stdev= 6.44, samples=35 write: IOPS=21, BW=352KiB/s (360kB/s)(6256KiB/17797msec); 0 zone resets clat (usec): min=1233, max=151686, avg=21687.13, stdev=21419.70 lat (usec): min=1235, max=151688, avg=21692.16, stdev=21418.86 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1876], 10.00th=[ 2737], 20.00th=[ 3982], | 30.00th=[ 6063], 40.00th=[ 9503], 50.00th=[ 14746], 60.00th=[ 20841], | 70.00th=[ 28443], 80.00th=[ 38011], 90.00th=[ 52691], 95.00th=[ 64750], | 99.00th=[ 83362], 99.50th=[133694], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 63, max= 601, per=26.30%, avg=352.17, stdev=114.39, samples=35 iops : min= 3, max= 37, avg=21.26, stdev= 7.19, samples=35 lat (usec) : 50=1.82%, 100=9.90%, 250=1.04%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=7.55%, 10=11.20%, 20=15.49%, 50=38.67% lat (msec) : 100=10.16%, 250=0.65% cpu : usr=0.14%, sys=9.89%, ctx=1476, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1273KiB/s (1303kB/s), 314KiB/s-344KiB/s (322kB/s-352kB/s), io=23.4MiB (24.5MB), run=17797-18819msec WRITE: bw=1339KiB/s (1371kB/s), 331KiB/s-358KiB/s (339kB/s-366kB/s), io=24.6MiB (25.8MB), run=17797-18819msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146078: Mon May 25 02:46:06 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5920KiB/47031msec) clat (msec): min=6, max=157, avg=28.52, stdev=21.15 lat (msec): min=6, max=157, avg=28.53, stdev=21.15 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 37], 90.00th=[ 53], 95.00th=[ 74], | 99.00th=[ 109], 99.50th=[ 130], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 379, per=24.64%, avg=125.41, stdev=73.42, samples=93 iops : min= 1, max= 23, avg= 7.14, stdev= 4.65, samples=93 write: IOPS=8, BW=135KiB/s (139kB/s)(6368KiB/47031msec); 0 zone resets clat (msec): min=24, max=292, avg=91.49, stdev=38.48 lat (msec): min=24, max=292, avg=91.50, stdev=38.48 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 46], 10.00th=[ 54], 20.00th=[ 62], | 30.00th=[ 69], 40.00th=[ 77], 50.00th=[ 84], 60.00th=[ 94], | 70.00th=[ 105], 80.00th=[ 117], 90.00th=[ 134], 95.00th=[ 161], | 99.00th=[ 247], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 224, per=25.28%, avg=135.25, stdev=50.99, samples=93 iops : min= 1, max= 14, avg= 7.76, stdev= 3.23, samples=93 lat (msec) : 10=4.04%, 20=16.02%, 50=26.56%, 100=34.64%, 250=18.36% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=2.20%, ctx=1493, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146079: Mon May 25 02:46:06 2026 read: IOPS=7, BW=123KiB/s (125kB/s)(5744KiB/46869msec) clat (msec): min=5, max=317, avg=29.55, stdev=27.88 lat (msec): min=5, max=317, avg=29.56, stdev=27.90 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 51], 95.00th=[ 80], | 99.00th=[ 144], 99.50th=[ 159], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 25, max= 288, per=24.77%, avg=126.07, stdev=73.53, samples=89 iops : min= 1, max= 18, avg= 7.19, stdev= 4.69, samples=89 write: IOPS=8, BW=140KiB/s (143kB/s)(6544KiB/46869msec); 0 zone resets clat (msec): min=34, max=296, avg=88.51, stdev=37.53 lat (msec): min=34, max=296, avg=88.51, stdev=37.53 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 48], 10.00th=[ 53], 20.00th=[ 61], | 30.00th=[ 67], 40.00th=[ 73], 50.00th=[ 80], 60.00th=[ 86], | 70.00th=[ 97], 80.00th=[ 110], 90.00th=[ 138], 95.00th=[ 171], | 99.00th=[ 220], 99.50th=[ 230], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 255, per=26.21%, avg=140.22, stdev=48.03, samples=91 iops : min= 1, max= 15, avg= 8.08, stdev= 3.03, samples=91 lat (msec) : 10=3.39%, 20=16.54%, 50=25.39%, 100=38.41%, 250=15.89% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=2.03%, ctx=1400, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146080: Mon May 25 02:46:06 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(6256KiB/45052msec) clat (msec): min=6, max=319, avg=26.77, stdev=24.70 lat (msec): min=6, max=319, avg=26.77, stdev=24.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 53], 95.00th=[ 66], | 99.00th=[ 125], 99.50th=[ 140], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 476, per=27.99%, avg=142.49, stdev=92.60, samples=87 iops : min= 1, max= 29, avg= 8.22, stdev= 5.77, samples=87 write: IOPS=8, BW=134KiB/s (137kB/s)(6032KiB/45052msec); 0 zone resets clat (msec): min=28, max=224, avg=91.58, stdev=39.06 lat (msec): min=28, max=224, avg=91.59, stdev=39.06 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 45], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 68], 40.00th=[ 72], 50.00th=[ 81], 60.00th=[ 90], | 70.00th=[ 102], 80.00th=[ 120], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 222], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 256, per=24.94%, avg=133.44, stdev=49.40, samples=89 iops : min= 1, max= 16, avg= 7.64, stdev= 3.20, samples=89 lat (msec) : 10=5.08%, 20=20.05%, 50=24.35%, 100=33.98%, 250=16.41% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.21%, ctx=1549, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146081: Mon May 25 02:46:06 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(6032KiB/46906msec) clat (msec): min=4, max=188, avg=29.95, stdev=25.17 lat (msec): min=4, max=188, avg=29.95, stdev=25.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 37], 90.00th=[ 58], 95.00th=[ 86], | 99.00th=[ 138], 99.50th=[ 144], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 25, max= 288, per=25.89%, avg=131.79, stdev=73.54, samples=89 iops : min= 1, max= 18, avg= 7.55, stdev= 4.63, samples=89 write: IOPS=8, BW=133KiB/s (137kB/s)(6256KiB/46906msec); 0 zone resets clat (msec): min=35, max=285, avg=90.90, stdev=37.70 lat (msec): min=35, max=285, avg=90.91, stdev=37.69 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 45], 10.00th=[ 52], 20.00th=[ 63], | 30.00th=[ 69], 40.00th=[ 77], 50.00th=[ 83], 60.00th=[ 92], | 70.00th=[ 101], 80.00th=[ 118], 90.00th=[ 142], 95.00th=[ 163], | 99.00th=[ 224], 99.50th=[ 257], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 256, per=24.83%, avg=132.82, stdev=48.22, samples=92 iops : min= 1, max= 16, avg= 7.61, stdev= 3.10, samples=92 lat (msec) : 10=3.65%, 20=17.06%, 50=27.47%, 100=34.90%, 250=16.67% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=2.29%, ctx=1508, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=509KiB/s (522kB/s), 123KiB/s-139KiB/s (125kB/s-142kB/s), io=23.4MiB (24.5MB), run=45052-47031msec WRITE: bw=536KiB/s (549kB/s), 133KiB/s-140KiB/s (137kB/s-143kB/s), io=24.6MiB (25.8MB), run=45052-47031msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146094: Mon May 25 02:46:16 2026 read: IOPS=2, BW=2901KiB/s (2970kB/s)(7168KiB/2471msec) clat (msec): min=92, max=260, avg=151.74, stdev=55.71 lat (msec): min=92, max=260, avg=151.74, stdev=55.71 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 128], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 130], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 188], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1917, max= 6083, per=55.43%, avg=3014.50, stdev=2046.36, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=2, BW=2072KiB/s (2122kB/s)(5120KiB/2471msec); 0 zone resets clat (msec): min=176, max=362, avg=265.11, stdev=79.42 lat (msec): min=176, max=362, avg=265.48, stdev=79.45 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2019, max= 3835, per=34.56%, avg=2631.00, stdev=1042.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.04%, sys=7.25%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146095: Mon May 25 02:46:16 2026 read: IOPS=0, BW=544KiB/s (557kB/s)(2048KiB/3766msec) clat (msec): min=123, max=274, avg=199.09, stdev=107.12 lat (msec): min=123, max=274, avg=199.10, stdev=107.12 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1954, max= 2043, per=36.75%, avg=1998.50, stdev=62.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2719KiB/s (2784kB/s)(10.0MiB/3766msec); 0 zone resets clat (msec): min=93, max=844, avg=332.56, stdev=244.91 lat (msec): min=94, max=845, avg=332.76, stdev=244.95 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 120], | 30.00th=[ 125], 40.00th=[ 146], 50.00th=[ 215], 60.00th=[ 296], | 70.00th=[ 481], 80.00th=[ 498], 90.00th=[ 514], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1917, max= 6119, per=39.61%, avg=3015.17, stdev=1738.64, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=5.95%, ctx=84, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146096: Mon May 25 02:46:16 2026 read: IOPS=2, BW=2234KiB/s (2288kB/s)(6144KiB/2750msec) clat (msec): min=47, max=253, avg=165.07, stdev=86.88 lat (msec): min=47, max=253, avg=165.07, stdev=86.88 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 218], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 1383, max= 4071, per=43.18%, avg=2348.25, stdev=1181.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=2, BW=2234KiB/s (2288kB/s)(6144KiB/2750msec); 0 zone resets clat (msec): min=99, max=489, avg=281.39, stdev=146.87 lat (msec): min=100, max=489, avg=281.51, stdev=146.86 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 279], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1924, max= 4151, per=35.42%, avg=2696.67, stdev=1260.31, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=50.00% cpu : usr=0.00%, sys=5.89%, ctx=126, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146097: Mon May 25 02:46:16 2026 read: IOPS=1, BW=1578KiB/s (1616kB/s)(5120KiB/3245msec) clat (msec): min=112, max=622, avg=289.95, stdev=196.06 lat (msec): min=112, max=622, avg=289.95, stdev=196.06 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1924, max= 4071, per=49.03%, avg=2666.00, stdev=1217.41, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2209KiB/s (2262kB/s)(7168KiB/3245msec); 0 zone resets clat (msec): min=166, max=426, avg=238.68, stdev=88.65 lat (msec): min=166, max=426, avg=238.79, stdev=88.61 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 174], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 220], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 247], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2003, max= 4031, per=38.39%, avg=2922.67, stdev=1027.08, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=66.67%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=6.54%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5438KiB/s (5569kB/s), 544KiB/s-2901KiB/s (557kB/s-2970kB/s), io=20.0MiB (20.0MB), run=2471-3766msec WRITE: bw=7613KiB/s (7796kB/s), 2072KiB/s-2719KiB/s (2122kB/s-2784kB/s), io=28.0MiB (29.4MB), run=2471-3766msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146099: Mon May 25 02:46:16 2026 read: IOPS=3, BW=3167KiB/s (3243kB/s)(7168KiB/2263msec) clat (usec): min=665, max=267155, avg=142746.63, stdev=100791.98 lat (usec): min=667, max=267156, avg=142748.31, stdev=100791.83 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 11469], | 30.00th=[145753], 40.00th=[145753], 50.00th=[173016], 60.00th=[189793], | 70.00th=[189793], 80.00th=[212861], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 2043, max= 4733, per=60.44%, avg=3589.33, stdev=1389.47, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2262KiB/s (2317kB/s)(5120KiB/2263msec); 0 zone resets clat (msec): min=172, max=315, avg=252.34, stdev=59.20 lat (msec): min=173, max=315, avg=252.44, stdev=59.19 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1996, max= 4023, per=32.32%, avg=2687.33, stdev=1156.96, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=24.27%, ctx=218, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146100: Mon May 25 02:46:16 2026 read: IOPS=0, BW=594KiB/s (608kB/s)(2048KiB/3448msec) clat (msec): min=52, max=135, avg=93.86, stdev=58.35 lat (msec): min=52, max=135, avg=93.86, stdev=58.35 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 53], | 30.00th=[ 53], 40.00th=[ 53], 50.00th=[ 53], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 136], 90.00th=[ 136], 95.00th=[ 136], | 99.00th=[ 136], 99.50th=[ 136], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 1551, max= 2043, per=30.26%, avg=1797.00, stdev=347.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2970KiB/s (3041kB/s)(10.0MiB/3448msec); 0 zone resets clat (msec): min=145, max=698, avg=325.49, stdev=182.42 lat (msec): min=146, max=698, avg=325.85, stdev=182.33 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 176], | 30.00th=[ 180], 40.00th=[ 234], 50.00th=[ 247], 60.00th=[ 275], | 70.00th=[ 351], 80.00th=[ 376], 90.00th=[ 575], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1551, max= 4079, per=31.43%, avg=2613.17, stdev=1116.96, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=16.28%, ctx=168, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146101: Mon May 25 02:46:16 2026 read: IOPS=2, BW=2374KiB/s (2431kB/s)(6144KiB/2588msec) clat (usec): min=697, max=316484, avg=114469.96, stdev=133060.67 lat (usec): min=699, max=316485, avg=114471.60, stdev=133060.32 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 1106], | 30.00th=[ 1106], 40.00th=[ 4293], 50.00th=[ 4293], 60.00th=[164627], | 70.00th=[200279], 80.00th=[200279], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 2011, max= 4087, per=56.63%, avg=3363.33, stdev=1172.12, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2374KiB/s (2431kB/s)(6144KiB/2588msec); 0 zone resets clat (msec): min=230, max=394, avg=315.21, stdev=57.75 lat (msec): min=230, max=394, avg=315.31, stdev=57.72 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 338], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1996, max= 3160, per=27.69%, avg=2302.50, stdev=572.00, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=25.00%, 500=50.00% cpu : usr=0.12%, sys=19.33%, ctx=142, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146102: Mon May 25 02:46:16 2026 read: IOPS=1, BW=1675KiB/s (1715kB/s)(5120KiB/3057msec) clat (usec): min=556, max=284718, avg=154251.81, stdev=103061.50 lat (usec): min=557, max=284720, avg=154253.12, stdev=103061.35 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[130548], 40.00th=[130548], 50.00th=[168821], 60.00th=[168821], | 70.00th=[187696], 80.00th=[187696], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 4007, max= 4087, per=68.14%, avg=4047.00, stdev=56.57, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2345KiB/s (2401kB/s)(7168KiB/3057msec); 0 zone resets clat (msec): min=138, max=584, avg=326.26, stdev=201.02 lat (msec): min=138, max=584, avg=326.35, stdev=201.01 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 142], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 251], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 558], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1638, max= 2043, per=23.31%, avg=1938.20, stdev=168.78, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=17.90%, ctx=300, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5940KiB/s (6082kB/s), 594KiB/s-3167KiB/s (608kB/s-3243kB/s), io=20.0MiB (20.0MB), run=2263-3448msec WRITE: bw=8316KiB/s (8515kB/s), 2262KiB/s-2970KiB/s (2317kB/s-3041kB/s), io=28.0MiB (29.4MB), run=2263-3448msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146109: Mon May 25 02:46:27 2026 read: IOPS=3, BW=12.0MiB/s (13.6MB/s)(12.0MiB/926msec) clat (msec): min=200, max=320, avg=252.28, stdev=61.42 lat (msec): min=200, max=320, avg=252.28, stdev=61.42 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min=11206, max=11206, per=100.00%, avg=11206.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=23.57%, ctx=164, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146111: Mon May 25 02:46:27 2026 read: IOPS=0, BW=1562KiB/s (1599kB/s)(4096KiB/2623msec) clat (nsec): min=649246k, max=649246k, avg=649245750.00, stdev= 0.00 lat (nsec): min=649248k, max=649248k, avg=649247810.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3123KiB/s (3198kB/s)(8192KiB/2623msec); 0 zone resets clat (msec): min=472, max=1377, avg=925.16, stdev=640.24 lat (msec): min=473, max=1378, avg=925.77, stdev=640.12 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8159, max= 8159, per=65.31%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.79%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146113: Mon May 25 02:46:27 2026 write: IOPS=1, BW=5022KiB/s (5142kB/s)(12.0MiB/2447msec); 0 zone resets clat (msec): min=249, max=1398, avg=767.77, stdev=582.69 lat (msec): min=249, max=1398, avg=768.29, stdev=582.70 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8175, max= 8175, per=65.44%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.50%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146115: Mon May 25 02:46:27 2026 write: IOPS=1, BW=6021KiB/s (6165kB/s)(12.0MiB/2041msec); 0 zone resets clat (msec): min=288, max=1112, avg=639.22, stdev=425.11 lat (msec): min=288, max=1112, avg=639.64, stdev=425.19 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 6113, max= 6113, per=48.94%, avg=6113.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.93%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6246KiB/s (6396kB/s), 1562KiB/s-12.0MiB/s (1599kB/s-13.6MB/s), io=16.0MiB (16.8MB), run=926-2623msec WRITE: bw=12.2MiB/s (12.8MB/s), 3123KiB/s-6021KiB/s (3198kB/s-6165kB/s), io=32.0MiB (33.6MB), run=2041-2623msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146110: Mon May 25 02:46:27 2026 read: IOPS=1, BW=7425KiB/s (7603kB/s)(12.0MiB/1655msec) clat (msec): min=413, max=572, avg=510.88, stdev=85.56 lat (msec): min=413, max=572, avg=510.88, stdev=85.56 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 6023, max= 6023, per=73.01%, avg=6023.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=24.12%, ctx=474, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146112: Mon May 25 02:46:27 2026 read: IOPS=0, BW=2062KiB/s (2112kB/s)(4096KiB/1986msec) clat (nsec): min=538065k, max=538065k, avg=538064507.00, stdev= 0.00 lat (nsec): min=538066k, max=538066k, avg=538065565.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 6095, max= 6095, per=73.89%, avg=6095.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4125KiB/s (4224kB/s)(8192KiB/1986msec); 0 zone resets clat (msec): min=595, max=730, avg=662.95, stdev=95.78 lat (msec): min=595, max=731, avg=663.53, stdev=95.77 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7968, max= 7968, per=63.57%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=9.12%, ctx=211, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146114: Mon May 25 02:46:27 2026 write: IOPS=1, BW=4701KiB/s (4814kB/s)(12.0MiB/2614msec); 0 zone resets clat (msec): min=182, max=1704, avg=829.75, stdev=786.10 lat (msec): min=183, max=1705, avg=830.17, stdev=786.14 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8192, max= 8192, per=65.35%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.51%, ctx=82, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146116: Mon May 25 02:46:27 2026 write: IOPS=1, BW=7194KiB/s (7367kB/s)(12.0MiB/1708msec); 0 zone resets clat (msec): min=289, max=902, avg=530.48, stdev=326.99 lat (msec): min=289, max=903, avg=530.99, stdev=326.94 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 6041, max= 8192, per=56.77%, avg=7116.50, stdev=1520.99, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=9.78%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8250KiB/s (8448kB/s), 2062KiB/s-7425KiB/s (2112kB/s-7603kB/s), io=16.0MiB (16.8MB), run=1655-1986msec WRITE: bw=12.2MiB/s (12.8MB/s), 4125KiB/s-7194KiB/s (4224kB/s-7367kB/s), io=32.0MiB (33.6MB), run=1708-2614msec