== sanity test 398b: DIO and buffer IO race ============== 14:26:09 (1780338369) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.43176 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179182: Mon Jun 1 14:28:36 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(5992KiB/124914msec) clat (usec): min=49, max=797843, avg=46452.12, stdev=34659.10 lat (usec): min=50, max=797847, avg=46458.44, stdev=34656.96 clat percentiles (usec): | 1.00th=[ 66], 5.00th=[ 13960], 10.00th=[ 17695], 20.00th=[ 23987], | 30.00th=[ 29230], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[137364], 99.50th=[154141], 99.90th=[244319], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 104, per=25.09%, avg=47.93, stdev=18.01, samples=244 iops : min= 1, max= 26, avg=11.29, stdev= 4.53, samples=244 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6296KiB/124914msec); 0 zone resets clat (usec): min=1144, max=271901, avg=34716.60, stdev=33758.29 lat (usec): min=1144, max=271903, avg=34722.69, stdev=33756.39 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1614], 10.00th=[ 2311], 20.00th=[ 5145], | 30.00th=[ 10814], 40.00th=[ 18744], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[166724], 99.90th=[261096], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 111, per=25.14%, avg=50.28, stdev=22.74, samples=244 iops : min= 1, max= 27, avg=11.89, stdev= 5.71, samples=244 lat (usec) : 50=0.07%, 100=1.17%, 250=0.23%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.56%, 4=4.04%, 10=6.51%, 20=10.94%, 50=42.29% lat (msec) : 100=25.03%, 250=4.95%, 500=0.07%, 1000=0.03% cpu : usr=0.10%, sys=5.47%, ctx=7016, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179184: Mon Jun 1 14:28:36 2026 read: IOPS=12, BW=48.1KiB/s (49.2kB/s)(5940KiB/123610msec) clat (usec): min=41, max=220956, avg=45850.87, stdev=29159.77 lat (usec): min=41, max=220959, avg=45853.93, stdev=29159.82 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 14222], 10.00th=[ 18482], 20.00th=[ 23987], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[147850], 99.50th=[175113], 99.90th=[214959], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 5, max= 96, per=25.03%, avg=47.80, stdev=18.01, samples=243 iops : min= 1, max= 24, avg=11.26, stdev= 4.53, samples=243 write: IOPS=12, BW=51.4KiB/s (52.6kB/s)(6348KiB/123610msec); 0 zone resets clat (usec): min=1039, max=807229, avg=34584.80, stdev=37462.13 lat (usec): min=1041, max=807230, avg=34587.81, stdev=37463.89 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1663], 10.00th=[ 2507], 20.00th=[ 5407], | 30.00th=[ 9896], 40.00th=[ 18744], 50.00th=[ 26084], 60.00th=[ 33424], | 70.00th=[ 43254], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[129500], 99.50th=[152044], 99.90th=[198181], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 119, per=25.57%, avg=51.13, stdev=21.80, samples=243 iops : min= 1, max= 29, avg=12.09, stdev= 5.48, samples=243 lat (usec) : 50=0.03%, 100=1.37%, 250=0.10%, 750=0.03%, 1000=0.07% lat (msec) : 2=4.26%, 4=3.71%, 10=7.78%, 20=9.86%, 50=43.23% lat (msec) : 100=24.09%, 250=5.44%, 1000=0.03% cpu : usr=0.09%, sys=5.53%, ctx=7072, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179185: Mon Jun 1 14:28:36 2026 read: IOPS=12, BW=48.8KiB/s (49.9kB/s)(6028KiB/123650msec) clat (usec): min=42, max=769869, avg=45331.93, stdev=33068.44 lat (usec): min=42, max=769871, avg=45353.10, stdev=33071.64 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 13960], 10.00th=[ 18744], 20.00th=[ 23987], | 30.00th=[ 29492], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 62129], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[147850], 99.50th=[185598], 99.90th=[210764], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 5, max= 103, per=25.28%, avg=48.28, stdev=19.11, samples=244 iops : min= 1, max= 25, avg=11.39, stdev= 4.79, samples=244 write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6260KiB/123650msec); 0 zone resets clat (usec): min=1173, max=290846, avg=34938.10, stdev=34601.91 lat (usec): min=1174, max=290848, avg=34954.70, stdev=34595.65 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1614], 10.00th=[ 2278], 20.00th=[ 5014], | 30.00th=[ 8979], 40.00th=[ 17433], 50.00th=[ 25297], 60.00th=[ 33817], | 70.00th=[ 45876], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[139461], 99.50th=[177210], 99.90th=[225444], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 127, per=25.27%, avg=50.55, stdev=21.69, samples=242 iops : min= 1, max= 31, avg=11.95, stdev= 5.44, samples=242 lat (usec) : 50=0.13%, 100=1.01%, 250=0.23% lat (msec) : 2=4.52%, 4=4.10%, 10=7.65%, 20=10.12%, 50=41.63% lat (msec) : 100=25.88%, 250=4.65%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.36%, ctx=6965, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179186: Mon Jun 1 14:28:36 2026 read: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6052KiB/125569msec) clat (usec): min=42, max=263343, avg=45581.63, stdev=29607.79 lat (usec): min=42, max=263344, avg=45590.64, stdev=29602.42 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 12387], 10.00th=[ 17695], 20.00th=[ 23987], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 53216], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[158335], 99.50th=[181404], 99.90th=[261096], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 102, per=25.14%, avg=48.02, stdev=18.08, samples=245 iops : min= 1, max= 25, avg=11.32, stdev= 4.55, samples=245 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6236KiB/125569msec); 0 zone resets clat (usec): min=1001, max=828271, avg=35847.97, stdev=40094.16 lat (usec): min=1003, max=828275, avg=35851.58, stdev=40093.29 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1614], 10.00th=[ 2311], 20.00th=[ 5538], | 30.00th=[ 10028], 40.00th=[ 18220], 50.00th=[ 26608], 60.00th=[ 35390], | 70.00th=[ 45876], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[154141], 99.50th=[179307], 99.90th=[287310], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 143, per=24.95%, avg=49.91, stdev=21.69, samples=243 iops : min= 1, max= 35, avg=11.79, stdev= 5.45, samples=243 lat (usec) : 50=0.10%, 100=1.53%, 250=0.20%, 500=0.03%, 750=0.03% lat (msec) : 2=4.33%, 4=3.58%, 10=7.45%, 20=11.04%, 50=41.57% lat (msec) : 100=24.97%, 250=5.05%, 500=0.10%, 1000=0.03% cpu : usr=0.10%, sys=5.44%, ctx=6947, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=191KiB/s (196kB/s), 47.0KiB/s-48.8KiB/s (49.1kB/s-49.9kB/s), io=23.4MiB (24.6MB), run=123610-125569msec WRITE: bw=200KiB/s (205kB/s), 49.7KiB/s-51.4KiB/s (50.9kB/s-52.6kB/s), io=24.6MiB (25.7MB), run=123610-125569msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179183: Mon Jun 1 14:29:14 2026 read: IOPS=9, BW=36.6KiB/s (37.5kB/s)(5992KiB/163737msec) clat (msec): min=6, max=840, avg=43.16, stdev=42.05 lat (msec): min=6, max=840, avg=43.16, stdev=42.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 114], | 99.00th=[ 192], 99.50th=[ 220], 99.90th=[ 292], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 142, per=24.97%, avg=36.45, stdev=25.84, samples=319 iops : min= 1, max= 35, avg= 8.43, stdev= 6.47, samples=319 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6296KiB/163737msec); 0 zone resets clat (msec): min=10, max=349, avg=62.60, stdev=44.83 lat (msec): min=10, max=349, avg=62.61, stdev=44.83 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 90], 90.00th=[ 120], 95.00th=[ 155], | 99.00th=[ 228], 99.50th=[ 253], 99.90th=[ 334], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 128, per=25.04%, avg=38.32, stdev=22.85, samples=319 iops : min= 1, max= 32, avg= 8.89, stdev= 5.75, samples=319 lat (msec) : 10=1.89%, 20=14.58%, 50=46.29%, 100=25.07%, 250=11.75% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.08%, sys=2.24%, ctx=4941, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179187: Mon Jun 1 14:29:14 2026 read: IOPS=9, BW=36.6KiB/s (37.5kB/s)(5940KiB/162380msec) clat (msec): min=6, max=783, avg=43.05, stdev=40.62 lat (msec): min=6, max=783, avg=43.05, stdev=40.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 91], 95.00th=[ 118], | 99.00th=[ 180], 99.50th=[ 201], 99.90th=[ 251], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 125, per=25.15%, avg=36.73, stdev=24.68, samples=314 iops : min= 1, max= 31, avg= 8.50, stdev= 6.21, samples=314 write: IOPS=9, BW=39.1KiB/s (40.0kB/s)(6348KiB/162380msec); 0 zone resets clat (msec): min=11, max=346, avg=61.68, stdev=42.78 lat (msec): min=11, max=346, avg=61.68, stdev=42.78 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 120], 95.00th=[ 146], | 99.00th=[ 215], 99.50th=[ 259], 99.90th=[ 334], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 135, per=25.49%, avg=39.00, stdev=21.93, samples=316 iops : min= 1, max= 33, avg= 9.06, stdev= 5.52, samples=316 lat (msec) : 10=1.95%, 20=14.29%, 50=46.48%, 100=25.55%, 250=11.39% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.08%, sys=2.31%, ctx=4996, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179188: Mon Jun 1 14:29:14 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6028KiB/161567msec) clat (msec): min=5, max=291, avg=43.45, stdev=36.58 lat (msec): min=5, max=291, avg=43.45, stdev=36.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 93], 95.00th=[ 121], | 99.00th=[ 171], 99.50th=[ 201], 99.90th=[ 266], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 142, per=25.83%, avg=37.71, stdev=23.94, samples=311 iops : min= 1, max= 35, avg= 8.74, stdev= 6.03, samples=311 write: IOPS=9, BW=38.7KiB/s (39.7kB/s)(6260KiB/161567msec); 0 zone resets clat (msec): min=10, max=775, avg=61.00, stdev=46.12 lat (msec): min=10, max=775, avg=61.00, stdev=46.12 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 87], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 222], 99.50th=[ 249], 99.90th=[ 368], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 119, per=25.21%, avg=38.57, stdev=22.92, samples=316 iops : min= 1, max= 29, avg= 8.96, stdev= 5.75, samples=316 lat (msec) : 10=1.73%, 20=13.67%, 50=47.10%, 100=26.14%, 250=11.07% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=2.30%, ctx=4975, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179189: Mon Jun 1 14:29:14 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6052KiB/162145msec) clat (msec): min=5, max=272, avg=43.15, stdev=35.73 lat (msec): min=5, max=272, avg=43.15, stdev=35.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 120], | 99.00th=[ 167], 99.50th=[ 192], 99.90th=[ 255], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 167, per=25.95%, avg=37.88, stdev=24.10, samples=311 iops : min= 1, max= 41, avg= 8.78, stdev= 6.05, samples=311 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6236KiB/162145msec); 0 zone resets clat (msec): min=10, max=846, avg=61.77, stdev=47.06 lat (msec): min=10, max=846, avg=61.78, stdev=47.06 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 115], 95.00th=[ 144], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 347], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 103, per=25.00%, avg=38.26, stdev=22.09, samples=317 iops : min= 1, max= 25, avg= 8.88, stdev= 5.55, samples=317 lat (msec) : 10=1.86%, 20=14.36%, 50=45.41%, 100=26.82%, 250=11.20% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.09%, sys=2.29%, ctx=4976, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (150kB/s), 36.6KiB/s-37.3KiB/s (37.5kB/s-38.2kB/s), io=23.4MiB (24.6MB), run=161567-163737msec WRITE: bw=154KiB/s (157kB/s), 38.5KiB/s-39.1KiB/s (39.4kB/s-40.0kB/s), io=24.6MiB (25.7MB), run=161567-163737msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179226: Mon Jun 1 14:30:02 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(5920KiB/37721msec) clat (usec): min=37, max=196501, avg=54107.09, stdev=34407.89 lat (usec): min=37, max=196503, avg=54108.84, stdev=34407.87 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 139], 10.00th=[ 19268], 20.00th=[ 26870], | 30.00th=[ 33424], 40.00th=[ 40633], 50.00th=[ 48497], 60.00th=[ 55313], | 70.00th=[ 66847], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[158335], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 62, max= 348, per=24.69%, avg=156.55, stdev=64.07, samples=74 iops : min= 3, max= 21, avg= 8.96, stdev= 4.02, samples=74 write: IOPS=10, BW=169KiB/s (173kB/s)(6368KiB/37721msec); 0 zone resets clat (usec): min=1345, max=258478, avg=43741.39, stdev=40375.91 lat (usec): min=1347, max=258481, avg=43786.90, stdev=40486.03 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2212], 10.00th=[ 3916], 20.00th=[ 7439], | 30.00th=[ 13435], 40.00th=[ 24249], 50.00th=[ 33424], 60.00th=[ 41681], | 70.00th=[ 55837], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[116917], | 99.00th=[158335], 99.50th=[227541], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 29, max= 383, per=25.17%, avg=168.16, stdev=71.73, samples=74 iops : min= 1, max= 23, avg= 9.68, stdev= 4.48, samples=74 lat (usec) : 50=0.13%, 100=2.08%, 250=0.26%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=4.56%, 10=8.33%, 20=7.42%, 50=34.64% lat (msec) : 100=30.21%, 250=10.94%, 500=0.13% cpu : usr=0.08%, sys=4.90%, ctx=1811, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179229: Mon Jun 1 14:30:02 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(5744KiB/36733msec) clat (usec): min=40, max=296183, avg=52266.79, stdev=36798.60 lat (usec): min=41, max=296184, avg=52268.73, stdev=36799.27 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 85], 10.00th=[ 5014], 20.00th=[ 25560], | 30.00th=[ 32375], 40.00th=[ 40633], 50.00th=[ 47973], 60.00th=[ 54264], | 70.00th=[ 62653], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[183501], 99.50th=[227541], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 30, max= 285, per=24.44%, avg=154.97, stdev=62.35, samples=72 iops : min= 1, max= 17, avg= 8.86, stdev= 3.92, samples=72 write: IOPS=11, BW=178KiB/s (182kB/s)(6544KiB/36733msec); 0 zone resets clat (usec): min=1607, max=239561, avg=43021.94, stdev=41889.21 lat (usec): min=1610, max=239565, avg=43025.13, stdev=41888.86 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2245], 10.00th=[ 3949], 20.00th=[ 6915], | 30.00th=[ 13304], 40.00th=[ 20317], 50.00th=[ 31065], 60.00th=[ 40633], | 70.00th=[ 52167], 80.00th=[ 76022], 90.00th=[109577], 95.00th=[128451], | 99.00th=[170918], 99.50th=[208667], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 30, max= 479, per=26.97%, avg=180.15, stdev=86.31, samples=71 iops : min= 1, max= 29, avg=10.44, stdev= 5.41, samples=71 lat (usec) : 50=0.13%, 100=2.86%, 250=1.04%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.65%, 4=4.95%, 10=7.94%, 20=10.03%, 50=33.72% lat (msec) : 100=28.26%, 250=10.03%, 500=0.13% cpu : usr=0.09%, sys=5.06%, ctx=1784, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179231: Mon Jun 1 14:30:02 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(6256KiB/36098msec) clat (usec): min=43, max=262149, avg=54389.74, stdev=34284.97 lat (usec): min=44, max=262151, avg=54391.59, stdev=34285.31 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 94], 10.00th=[ 20055], 20.00th=[ 27919], | 30.00th=[ 34341], 40.00th=[ 41681], 50.00th=[ 50070], 60.00th=[ 57934], | 70.00th=[ 66323], 80.00th=[ 80217], 90.00th=[ 95945], 95.00th=[110625], | 99.00th=[177210], 99.50th=[191890], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 342, per=27.30%, avg=173.11, stdev=61.89, samples=71 iops : min= 1, max= 21, avg=10.00, stdev= 3.90, samples=71 write: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36098msec); 0 zone resets clat (usec): min=1706, max=225399, avg=39062.83, stdev=37238.48 lat (usec): min=1709, max=225402, avg=39069.23, stdev=37235.48 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 13], 40.00th=[ 21], 50.00th=[ 28], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 93], 95.00th=[ 110], | 99.00th=[ 161], 99.50th=[ 171], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 477, per=24.82%, avg=165.79, stdev=85.47, samples=71 iops : min= 1, max= 29, avg= 9.54, stdev= 5.40, samples=71 lat (usec) : 50=0.13%, 100=2.73%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=0.26%, 4=3.91%, 10=7.94%, 20=8.85%, 50=36.20% lat (msec) : 100=31.51%, 250=7.68%, 500=0.13% cpu : usr=0.05%, sys=5.01%, ctx=1741, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179232: Mon Jun 1 14:30:02 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(6032KiB/37243msec) clat (usec): min=38, max=220247, avg=52229.49, stdev=36806.25 lat (usec): min=39, max=220248, avg=52232.08, stdev=36804.84 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 76], 10.00th=[ 133], 20.00th=[ 25560], | 30.00th=[ 31589], 40.00th=[ 38536], 50.00th=[ 46400], 60.00th=[ 54789], | 70.00th=[ 63701], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[123208], | 99.00th=[185598], 99.50th=[202376], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 342, per=25.53%, avg=161.86, stdev=66.49, samples=72 iops : min= 1, max= 21, avg= 9.29, stdev= 4.20, samples=72 write: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37243msec); 0 zone resets clat (usec): min=1480, max=427198, avg=43893.75, stdev=48379.10 lat (usec): min=1482, max=427200, avg=43904.00, stdev=48380.19 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2245], 10.00th=[ 4293], 20.00th=[ 7701], | 30.00th=[ 12125], 40.00th=[ 19792], 50.00th=[ 28443], 60.00th=[ 40109], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[105382], 95.00th=[129500], | 99.00th=[227541], 99.50th=[283116], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 30, max= 351, per=25.32%, avg=169.15, stdev=79.16, samples=72 iops : min= 1, max= 21, avg= 9.75, stdev= 4.99, samples=72 lat (usec) : 50=0.26%, 100=4.43%, 250=0.52%, 500=0.26% lat (msec) : 2=1.17%, 4=3.12%, 10=9.11%, 20=8.59%, 50=33.20% lat (msec) : 100=29.17%, 250=9.77%, 500=0.39% cpu : usr=0.08%, sys=5.26%, ctx=1817, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=635KiB/s (650kB/s), 156KiB/s-173KiB/s (160kB/s-177kB/s), io=23.4MiB (24.5MB), run=36098-37721msec WRITE: bw=668KiB/s (684kB/s), 167KiB/s-178KiB/s (171kB/s-182kB/s), io=24.6MiB (25.8MB), run=36098-37721msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179225: Mon Jun 1 14:30:14 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5920KiB/49037msec) clat (msec): min=8, max=266, avg=51.90, stdev=45.02 lat (msec): min=8, max=266, avg=51.90, stdev=45.01 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 111], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 228], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 384, per=24.52%, avg=118.91, stdev=80.77, samples=95 iops : min= 1, max= 24, avg= 6.65, stdev= 5.13, samples=95 write: IOPS=8, BW=130KiB/s (133kB/s)(6368KiB/49037msec); 0 zone resets clat (msec): min=15, max=461, avg=74.35, stdev=53.54 lat (msec): min=15, max=461, avg=74.35, stdev=53.54 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 67], | 70.00th=[ 81], 80.00th=[ 108], 90.00th=[ 136], 95.00th=[ 176], | 99.00th=[ 279], 99.50th=[ 384], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 29, max= 320, per=25.14%, avg=128.22, stdev=71.62, samples=96 iops : min= 1, max= 20, avg= 7.24, stdev= 4.52, samples=96 lat (msec) : 10=0.65%, 20=7.94%, 50=44.53%, 100=29.30%, 250=16.54% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.94%, ctx=1279, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179227: Mon Jun 1 14:30:14 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5744KiB/49080msec) clat (msec): min=10, max=247, avg=50.87, stdev=40.64 lat (msec): min=10, max=247, avg=50.88, stdev=40.64 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 71], 90.00th=[ 109], 95.00th=[ 140], | 99.00th=[ 222], 99.50th=[ 234], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 30, max= 416, per=25.02%, avg=121.33, stdev=76.33, samples=91 iops : min= 1, max= 26, avg= 6.80, stdev= 4.84, samples=91 write: IOPS=8, BW=133KiB/s (137kB/s)(6544KiB/49080msec); 0 zone resets clat (msec): min=17, max=413, avg=75.14, stdev=55.50 lat (msec): min=17, max=413, avg=75.17, stdev=55.50 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 68], | 70.00th=[ 83], 80.00th=[ 107], 90.00th=[ 146], 95.00th=[ 192], | 99.00th=[ 262], 99.50th=[ 313], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 31, max= 383, per=25.80%, avg=131.59, stdev=71.33, samples=95 iops : min= 1, max= 23, avg= 7.45, stdev= 4.50, samples=95 lat (msec) : 20=7.29%, 50=48.31%, 100=26.69%, 250=16.80%, 500=0.91% cpu : usr=0.06%, sys=1.97%, ctx=1206, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179228: Mon Jun 1 14:30:14 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(6256KiB/49363msec) clat (msec): min=8, max=255, avg=52.53, stdev=44.02 lat (msec): min=8, max=255, avg=52.53, stdev=44.02 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 80], 90.00th=[ 109], 95.00th=[ 142], | 99.00th=[ 226], 99.50th=[ 247], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 415, per=26.32%, avg=127.64, stdev=87.66, samples=96 iops : min= 1, max= 25, avg= 7.20, stdev= 5.52, samples=96 write: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49363msec); 0 zone resets clat (msec): min=13, max=392, avg=75.66, stdev=54.06 lat (msec): min=13, max=392, avg=75.67, stdev=54.06 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 107], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 296], 99.50th=[ 359], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 350, per=23.64%, avg=120.58, stdev=68.77, samples=96 iops : min= 1, max= 21, avg= 6.76, stdev= 4.34, samples=96 lat (msec) : 10=0.26%, 20=11.20%, 50=42.06%, 100=28.13%, 250=17.58% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=1.69%, ctx=1137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179230: Mon Jun 1 14:30:14 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48756msec) clat (msec): min=8, max=210, avg=50.59, stdev=38.46 lat (msec): min=8, max=210, avg=50.59, stdev=38.46 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 74], 90.00th=[ 110], 95.00th=[ 134], | 99.00th=[ 188], 99.50th=[ 209], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 348, per=25.39%, avg=123.16, stdev=73.57, samples=95 iops : min= 1, max= 21, avg= 6.93, stdev= 4.65, samples=95 write: IOPS=8, BW=128KiB/s (131kB/s)(6256KiB/48756msec); 0 zone resets clat (msec): min=17, max=479, avg=75.05, stdev=53.18 lat (msec): min=17, max=479, avg=75.07, stdev=53.20 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 106], 90.00th=[ 142], 95.00th=[ 178], | 99.00th=[ 271], 99.50th=[ 292], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 31, max= 319, per=25.29%, avg=128.98, stdev=70.43, samples=95 iops : min= 1, max= 19, avg= 7.28, stdev= 4.45, samples=95 lat (msec) : 10=0.52%, 20=7.29%, 50=46.88%, 100=27.99%, 250=16.54% lat (msec) : 500=0.78% cpu : usr=0.03%, sys=1.93%, ctx=1195, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=485KiB/s (497kB/s), 117KiB/s-127KiB/s (120kB/s-130kB/s), io=23.4MiB (24.5MB), run=48756-49363msec WRITE: bw=511KiB/s (523kB/s), 122KiB/s-133KiB/s (125kB/s-137kB/s), io=24.6MiB (25.8MB), run=48756-49363msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179248: Mon Jun 1 14:30:32 2026 read: IOPS=1, BW=1332KiB/s (1364kB/s)(7168KiB/5380msec) clat (msec): min=41, max=3232, avg=614.25, stdev=1156.88 lat (msec): min=41, max=3232, avg=614.25, stdev=1156.88 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 132], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 211], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 266], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1996, max= 6095, per=100.00%, avg=4059.33, stdev=2049.64, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=0, BW=952KiB/s (975kB/s)(5120KiB/5380msec); 0 zone resets clat (msec): min=120, max=349, avg=194.27, stdev=93.94 lat (msec): min=120, max=349, avg=194.39, stdev=93.98 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1996, max= 6131, per=87.80%, avg=3390.00, stdev=2373.89, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 50=8.33%, 250=66.67%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=9.20%, ctx=558, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179250: Mon Jun 1 14:30:32 2026 read: IOPS=0, BW=276KiB/s (282kB/s)(2048KiB/7426msec) clat (msec): min=41, max=288, avg=164.65, stdev=174.50 lat (msec): min=41, max=288, avg=164.66, stdev=174.50 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 42], | 30.00th=[ 42], 40.00th=[ 42], 50.00th=[ 42], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1723, max= 1996, per=67.45%, avg=1859.50, stdev=193.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1379KiB/s (1412kB/s)(10.0MiB/7426msec); 0 zone resets clat (msec): min=130, max=3262, avg=693.74, stdev=1014.46 lat (msec): min=130, max=3262, avg=693.97, stdev=1014.59 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 186], 50.00th=[ 288], 60.00th=[ 296], | 70.00th=[ 342], 80.00th=[ 409], 90.00th=[ 1687], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1996, max= 6119, per=94.79%, avg=3660.00, stdev=1724.78, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.81%, ctx=195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179251: Mon Jun 1 14:30:32 2026 read: IOPS=1, BW=1047KiB/s (1072kB/s)(6144KiB/5869msec) clat (usec): min=670, max=313476, avg=152216.37, stdev=129896.70 lat (usec): min=671, max=313478, avg=152217.65, stdev=129896.60 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 2343], | 30.00th=[ 2343], 40.00th=[154141], 50.00th=[154141], 60.00th=[181404], | 70.00th=[263193], 80.00th=[263193], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2035, max= 3992, per=91.70%, avg=2528.25, stdev=975.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1047KiB/s (1072kB/s)(6144KiB/5869msec); 0 zone resets clat (msec): min=198, max=3365, avg=816.63, stdev=1256.12 lat (msec): min=198, max=3365, avg=816.72, stdev=1256.12 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 351], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1996, max= 4071, per=71.32%, avg=2753.50, stdev=972.47, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.67%, ctx=141, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179252: Mon Jun 1 14:30:32 2026 read: IOPS=0, BW=731KiB/s (749kB/s)(5120KiB/7002msec) clat (usec): min=633, max=286267, avg=91150.18, stdev=128127.53 lat (usec): min=634, max=286268, avg=91151.28, stdev=128127.54 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 652], 40.00th=[ 652], 50.00th=[ 9503], 60.00th=[ 9503], | 70.00th=[158335], 80.00th=[158335], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 1996, max= 6035, per=100.00%, avg=4015.50, stdev=2856.00, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=1024KiB/s (1048kB/s)(7168KiB/7002msec); 0 zone resets clat (msec): min=168, max=4021, avg=907.66, stdev=1385.52 lat (msec): min=168, max=4021, avg=907.79, stdev=1385.51 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 209], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 477], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 659], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 1996, max= 2043, per=52.22%, avg=2016.20, stdev=21.88, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.08%, ctx=121, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2758KiB/s (2824kB/s), 276KiB/s-1332KiB/s (282kB/s-1364kB/s), io=20.0MiB (20.0MB), run=5380-7426msec WRITE: bw=3861KiB/s (3954kB/s), 952KiB/s-1379KiB/s (975kB/s-1412kB/s), io=28.0MiB (29.4MB), run=5380-7426msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179249: Mon Jun 1 14:30:33 2026 read: IOPS=0, BW=901KiB/s (923kB/s)(7168KiB/7955msec) clat (msec): min=52, max=3042, avg=923.75, stdev=1243.49 lat (msec): min=52, max=3042, avg=923.75, stdev=1243.49 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 161], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 213], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 2400], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1969, max= 4079, per=100.00%, avg=3040.50, stdev=1194.92, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=644KiB/s (659kB/s)(5120KiB/7955msec); 0 zone resets clat (msec): min=116, max=503, avg=234.88, stdev=158.50 lat (msec): min=117, max=503, avg=235.00, stdev=158.49 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1961, max= 5907, per=100.00%, avg=3934.00, stdev=2790.24, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, >=2000=16.67% cpu : usr=0.01%, sys=1.58%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179253: Mon Jun 1 14:30:33 2026 read: IOPS=0, BW=256KiB/s (262kB/s)(2048KiB/8009msec) clat (msec): min=104, max=268, avg=186.53, stdev=116.06 lat (msec): min=104, max=268, avg=186.53, stdev=116.06 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1961, max= 2043, per=78.29%, avg=2002.00, stdev=57.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1279KiB/s (1309kB/s)(10.0MiB/8009msec); 0 zone resets clat (msec): min=169, max=3940, avg=728.05, stdev=1136.26 lat (msec): min=169, max=3940, avg=728.19, stdev=1136.25 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 271], | 30.00th=[ 284], 40.00th=[ 313], 50.00th=[ 317], 60.00th=[ 422], | 70.00th=[ 456], 80.00th=[ 477], 90.00th=[ 634], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 1961, max= 4079, per=64.44%, avg=2306.14, stdev=782.57, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.79, samples=7 lat (msec) : 250=16.67%, 500=66.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.00%, ctx=129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179254: Mon Jun 1 14:30:33 2026 read: IOPS=0, BW=915KiB/s (937kB/s)(6144KiB/6712msec) clat (msec): min=81, max=418, avg=157.37, stdev=129.83 lat (msec): min=81, max=418, avg=157.37, stdev=129.83 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 111], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1961, max= 4096, per=100.00%, avg=3376.00, stdev=1225.49, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=915KiB/s (937kB/s)(6144KiB/6712msec); 0 zone resets clat (msec): min=76, max=4275, avg=929.92, stdev=1644.21 lat (msec): min=76, max=4277, avg=930.26, stdev=1644.74 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 363], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 3923, max= 4096, per=100.00%, avg=4035.33, stdev=97.39, samples=3 iops : min= 3, max= 4, avg= 3.33, stdev= 0.58, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=1.89%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179255: Mon Jun 1 14:30:33 2026 read: IOPS=0, BW=656KiB/s (671kB/s)(5120KiB/7809msec) clat (msec): min=140, max=365, avg=266.19, stdev=95.39 lat (msec): min=140, max=365, avg=266.19, stdev=95.39 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1961, max= 4071, per=100.00%, avg=2693.33, stdev=1193.89, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=918KiB/s (940kB/s)(7168KiB/7809msec); 0 zone resets clat (msec): min=251, max=3903, avg=919.32, stdev=1321.22 lat (msec): min=252, max=3903, avg=919.59, stdev=1321.47 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 317], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 464], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 609], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 2003, max= 3938, per=65.75%, avg=2353.17, stdev=776.59, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 0.82, samples=6 lat (msec) : 250=16.67%, 500=58.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.59%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2557KiB/s (2618kB/s), 256KiB/s-915KiB/s (262kB/s-937kB/s), io=20.0MiB (20.0MB), run=6712-8009msec WRITE: bw=3580KiB/s (3666kB/s), 644KiB/s-1279KiB/s (659kB/s-1309kB/s), io=28.0MiB (29.4MB), run=6712-8009msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179264: Mon Jun 1 14:30:50 2026 read: IOPS=0, BW=2957KiB/s (3028kB/s)(12.0MiB/4155msec) clat (msec): min=948, max=1639, avg=1206.00, stdev=378.04 lat (msec): min=948, max=1639, avg=1206.00, stdev=378.04 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7876, max= 8078, per=100.00%, avg=7977.00, stdev=142.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.08%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179265: Mon Jun 1 14:30:50 2026 read: IOPS=0, BW=1041KiB/s (1066kB/s)(4096KiB/3935msec) clat (nsec): min=867915k, max=867915k, avg=867914771.00, stdev= 0.00 lat (nsec): min=867917k, max=867917k, avg=867916983.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2082KiB/s (2132kB/s)(8192KiB/3935msec); 0 zone resets clat (msec): min=1250, max=1653, avg=1451.90, stdev=285.42 lat (msec): min=1250, max=1656, avg=1453.57, stdev=287.08 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7571, max= 7571, per=90.92%, avg=7571.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.19%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179266: Mon Jun 1 14:30:50 2026 write: IOPS=1, BW=4748KiB/s (4862kB/s)(12.0MiB/2588msec); 0 zone resets clat (msec): min=381, max=1675, avg=815.06, stdev=745.08 lat (msec): min=381, max=1676, avg=815.75, stdev=745.34 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 6692, max= 8078, per=88.69%, avg=7385.00, stdev=980.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.29%, ctx=44, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179267: Mon Jun 1 14:30:50 2026 write: IOPS=0, BW=3243KiB/s (3321kB/s)(12.0MiB/3789msec); 0 zone resets clat (msec): min=893, max=1699, avg=1166.64, stdev=461.79 lat (msec): min=894, max=1700, avg=1167.19, stdev=461.81 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7571, max= 7876, per=92.75%, avg=7723.50, stdev=215.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.28%, ctx=62, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3943KiB/s (4038kB/s), 1041KiB/s-2957KiB/s (1066kB/s-3028kB/s), io=16.0MiB (16.8MB), run=3935-4155msec WRITE: bw=8327KiB/s (8527kB/s), 2082KiB/s-4748KiB/s (2132kB/s-4862kB/s), io=32.0MiB (33.6MB), run=2588-3935msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179268: Mon Jun 1 14:30:50 2026 read: IOPS=0, BW=3288KiB/s (3367kB/s)(12.0MiB/3737msec) clat (msec): min=914, max=1159, avg=1030.08, stdev=123.13 lat (msec): min=914, max=1159, avg=1030.08, stdev=123.13 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7173, max= 8094, per=100.00%, avg=7633.50, stdev=651.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=8.27%, ctx=207, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179269: Mon Jun 1 14:30:50 2026 read: IOPS=0, BW=920KiB/s (942kB/s)(4096KiB/4452msec) clat (nsec): min=1094.3M, max=1094.3M, avg=1094348177.00, stdev= 0.00 lat (nsec): min=1094.4M, max=1094.4M, avg=1094352292.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1840KiB/s (1884kB/s)(8192KiB/4452msec); 0 zone resets clat (msec): min=541, max=2398, avg=1469.90, stdev=1312.65 lat (msec): min=541, max=2400, avg=1471.13, stdev=1314.09 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=5.30%, ctx=181, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179270: Mon Jun 1 14:30:50 2026 write: IOPS=0, BW=2728KiB/s (2794kB/s)(12.0MiB/4504msec); 0 zone resets clat (msec): min=294, max=2292, avg=1325.29, stdev=1000.10 lat (msec): min=295, max=2293, avg=1326.13, stdev=1000.65 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7173, max= 7173, per=98.60%, avg=7173.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.75%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179271: Mon Jun 1 14:30:50 2026 write: IOPS=0, BW=3636KiB/s (3723kB/s)(12.0MiB/3380msec); 0 zone resets clat (msec): min=373, max=1642, avg=1087.23, stdev=648.92 lat (msec): min=374, max=1643, avg=1087.99, stdev=649.20 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7515, max= 8094, per=100.00%, avg=7804.50, stdev=409.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.06%, sys=3.26%, ctx=38, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3680KiB/s (3768kB/s), 920KiB/s-3288KiB/s (942kB/s-3367kB/s), io=16.0MiB (16.8MB), run=3737-4452msec WRITE: bw=7275KiB/s (7450kB/s), 1840KiB/s-3636KiB/s (1884kB/s-3723kB/s), io=32.0MiB (33.6MB), run=3380-4504msec