== sanity test 398b: DIO and buffer IO race ============== 05:29:09 (1779701349) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.58792 s, 5.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178657: Mon May 25 05:32:06 2026 read: IOPS=9, BW=39.4KiB/s (40.3kB/s)(5992KiB/152173msec) clat (usec): min=46, max=965940, avg=55107.39, stdev=40572.22 lat (usec): min=47, max=965942, avg=55109.28, stdev=40572.19 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 15270], 10.00th=[ 22414], 20.00th=[ 28443], | 30.00th=[ 35390], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 56361], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 95945], 95.00th=[114820], | 99.00th=[160433], 99.50th=[183501], 99.90th=[329253], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 102, per=24.83%, avg=38.99, stdev=15.97, samples=299 iops : min= 1, max= 25, avg= 9.08, stdev= 4.02, samples=299 write: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6296KiB/152173msec); 0 zone resets clat (usec): min=892, max=385369, avg=43895.05, stdev=42763.50 lat (usec): min=893, max=385371, avg=43902.70, stdev=42767.53 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1614], 10.00th=[ 2769], 20.00th=[ 6587], | 30.00th=[ 12256], 40.00th=[ 22152], 50.00th=[ 31851], 60.00th=[ 42206], | 70.00th=[ 56361], 80.00th=[ 78119], 90.00th=[104334], 95.00th=[129500], | 99.00th=[173016], 99.50th=[196084], 99.90th=[250610], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 135, per=24.90%, avg=41.08, stdev=19.35, samples=298 iops : min= 1, max= 33, avg= 9.61, stdev= 4.87, samples=298 lat (usec) : 50=0.20%, 100=1.07%, 250=0.07%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=3.84%, 4=2.93%, 10=7.39%, 20=7.78%, 50=35.64% lat (msec) : 100=30.83%, 250=9.96%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.10%, ctx=6913, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178658: Mon May 25 05:32:06 2026 read: IOPS=10, BW=40.3KiB/s (41.2kB/s)(5940KiB/147558msec) clat (usec): min=43, max=969523, avg=55722.29, stdev=43109.98 lat (usec): min=43, max=969525, avg=55727.75, stdev=43110.76 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 15664], 10.00th=[ 21365], 20.00th=[ 28443], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 47449], 60.00th=[ 55837], | 70.00th=[ 65799], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[116917], | 99.00th=[191890], 99.50th=[225444], 99.90th=[383779], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 87, per=25.42%, avg=39.90, stdev=16.38, samples=289 iops : min= 1, max= 21, avg= 9.31, stdev= 4.11, samples=289 write: IOPS=10, BW=43.0KiB/s (44.1kB/s)(6348KiB/147558msec); 0 zone resets clat (usec): min=946, max=301073, avg=40546.41, stdev=39484.96 lat (usec): min=947, max=301075, avg=40550.27, stdev=39484.88 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1582], 10.00th=[ 2278], 20.00th=[ 5735], | 30.00th=[ 10683], 40.00th=[ 19792], 50.00th=[ 29754], 60.00th=[ 40633], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 99091], 95.00th=[116917], | 99.00th=[164627], 99.50th=[181404], 99.90th=[227541], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 110, per=25.93%, avg=42.79, stdev=19.57, samples=287 iops : min= 1, max= 27, avg=10.05, stdev= 4.94, samples=287 lat (usec) : 50=0.29%, 100=1.24%, 250=0.07%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.43%, 4=3.26%, 10=7.39%, 20=7.98%, 50=36.26% lat (msec) : 100=29.65%, 250=9.15%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.21%, ctx=6792, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178659: Mon May 25 05:32:06 2026 read: IOPS=10, BW=40.0KiB/s (40.0kB/s)(6028KiB/150603msec) clat (usec): min=35, max=955243, avg=55793.46, stdev=44098.72 lat (usec): min=36, max=955245, avg=55799.43, stdev=44098.78 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 14484], 10.00th=[ 20841], 20.00th=[ 28443], | 30.00th=[ 34341], 40.00th=[ 40633], 50.00th=[ 49021], 60.00th=[ 56361], | 70.00th=[ 65274], 80.00th=[ 77071], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[183501], 99.50th=[240124], 99.90th=[404751], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 103, per=25.28%, avg=39.69, stdev=16.65, samples=294 iops : min= 1, max= 25, avg= 9.26, stdev= 4.19, samples=294 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6260KiB/150603msec); 0 zone resets clat (usec): min=999, max=469851, avg=42153.87, stdev=44592.15 lat (usec): min=1000, max=469853, avg=42161.64, stdev=44593.39 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1582], 10.00th=[ 2089], 20.00th=[ 5473], | 30.00th=[ 9634], 40.00th=[ 19268], 50.00th=[ 29754], 60.00th=[ 40633], | 70.00th=[ 53216], 80.00th=[ 71828], 90.00th=[102237], 95.00th=[126354], | 99.00th=[183501], 99.50th=[214959], 99.90th=[362808], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 101, per=25.21%, avg=41.59, stdev=19.35, samples=291 iops : min= 1, max= 25, avg= 9.74, stdev= 4.88, samples=291 lat (usec) : 50=0.20%, 100=1.30%, 250=0.23%, 1000=0.07% lat (msec) : 2=4.88%, 4=3.55%, 10=7.19%, 20=7.71%, 50=34.54% lat (msec) : 100=30.73%, 250=9.24%, 500=0.33%, 1000=0.03% cpu : usr=0.08%, sys=5.31%, ctx=6799, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178660: Mon May 25 05:32:06 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6052KiB/151492msec) clat (usec): min=33, max=996152, avg=55154.15, stdev=44106.22 lat (usec): min=33, max=996153, avg=55156.45, stdev=44106.70 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 12387], 10.00th=[ 21365], 20.00th=[ 28181], | 30.00th=[ 33817], 40.00th=[ 39584], 50.00th=[ 48497], 60.00th=[ 55313], | 70.00th=[ 64750], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[112722], | 99.00th=[212861], 99.50th=[261096], 99.90th=[287310], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 102, per=25.27%, avg=39.68, stdev=17.32, samples=296 iops : min= 1, max= 25, avg= 9.25, stdev= 4.35, samples=296 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6236KiB/151492msec); 0 zone resets clat (usec): min=919, max=259425, avg=43337.24, stdev=41859.48 lat (usec): min=919, max=259427, avg=43339.30, stdev=41859.03 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1631], 10.00th=[ 2278], 20.00th=[ 5997], | 30.00th=[ 11863], 40.00th=[ 20841], 50.00th=[ 32375], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[101188], 95.00th=[124257], | 99.00th=[181404], 99.50th=[202376], 99.90th=[233833], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 111, per=24.76%, avg=40.86, stdev=18.00, samples=295 iops : min= 1, max= 27, avg= 9.56, stdev= 4.54, samples=295 lat (usec) : 50=0.33%, 100=1.46%, 250=0.07%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.49%, 4=3.26%, 10=6.51%, 20=7.58%, 50=34.41% lat (msec) : 100=32.36%, 250=9.02%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=5.13%, ctx=6822, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (162kB/s), 39.4KiB/s-40.3KiB/s (40.3kB/s-41.2kB/s), io=23.4MiB (24.6MB), run=147558-152173msec WRITE: bw=165KiB/s (169kB/s), 41.2KiB/s-43.0KiB/s (42.2kB/s-44.1kB/s), io=24.6MiB (25.7MB), run=147558-152173msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178662: Mon May 25 05:33:00 2026 read: IOPS=7, BW=29.3KiB/s (30.1kB/s)(5992KiB/204154msec) clat (msec): min=6, max=1007, avg=54.43, stdev=54.05 lat (msec): min=6, max=1007, avg=54.43, stdev=54.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 59], 80.00th=[ 78], 90.00th=[ 116], 95.00th=[ 150], | 99.00th=[ 257], 99.50th=[ 279], 99.90th=[ 477], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 135, per=26.00%, avg=30.16, stdev=20.92, samples=385 iops : min= 1, max= 33, avg= 6.87, stdev= 5.27, samples=385 write: IOPS=7, BW=30.8KiB/s (31.6kB/s)(6296KiB/204154msec); 0 zone resets clat (msec): min=14, max=421, avg=77.78, stdev=52.42 lat (msec): min=14, max=421, avg=77.79, stdev=52.42 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 111], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 271], 99.50th=[ 305], 99.90th=[ 393], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 103, per=25.25%, avg=30.81, stdev=18.89, samples=396 iops : min= 1, max= 25, avg= 7.03, stdev= 4.77, samples=396 lat (msec) : 10=0.88%, 20=8.82%, 50=40.56%, 100=30.27%, 250=18.29% lat (msec) : 500=1.14%, 2000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=5033, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178663: Mon May 25 05:33:00 2026 read: IOPS=7, BW=28.9KiB/s (29.6kB/s)(5940KiB/205356msec) clat (msec): min=7, max=1048, avg=53.45, stdev=52.62 lat (msec): min=7, max=1048, avg=53.46, stdev=52.62 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 113], 95.00th=[ 150], | 99.00th=[ 239], 99.50th=[ 271], 99.90th=[ 300], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 112, per=26.40%, avg=30.63, stdev=20.66, samples=375 iops : min= 1, max= 28, avg= 6.98, stdev= 5.21, samples=375 write: IOPS=7, BW=30.9KiB/s (31.7kB/s)(6348KiB/205356msec); 0 zone resets clat (msec): min=12, max=422, avg=79.26, stdev=56.13 lat (msec): min=12, max=422, avg=79.27, stdev=56.13 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 94], 80.00th=[ 114], 90.00th=[ 153], 95.00th=[ 188], | 99.00th=[ 296], 99.50th=[ 363], 99.90th=[ 401], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 111, per=25.16%, avg=30.70, stdev=19.60, samples=400 iops : min= 1, max= 27, avg= 7.01, stdev= 4.95, samples=400 lat (msec) : 10=0.62%, 20=9.05%, 50=40.95%, 100=29.49%, 250=18.62% lat (msec) : 500=1.24%, 2000=0.03% cpu : usr=0.06%, sys=1.93%, ctx=5091, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178664: Mon May 25 05:33:00 2026 read: IOPS=7, BW=29.6KiB/s (30.3kB/s)(6028KiB/203728msec) clat (msec): min=6, max=481, avg=53.35, stdev=46.30 lat (msec): min=6, max=481, avg=53.35, stdev=46.30 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 80], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 218], 99.50th=[ 243], 99.90th=[ 409], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 136, per=25.64%, avg=29.74, stdev=20.83, samples=392 iops : min= 1, max= 34, avg= 6.77, stdev= 5.25, samples=392 write: IOPS=7, BW=30.7KiB/s (31.5kB/s)(6260KiB/203728msec); 0 zone resets clat (msec): min=15, max=1096, avg=78.65, stdev=59.11 lat (msec): min=15, max=1096, avg=78.66, stdev=59.11 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 92], 80.00th=[ 114], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 264], 99.50th=[ 334], 99.90th=[ 456], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 110, per=25.29%, avg=30.85, stdev=19.25, samples=393 iops : min= 1, max= 27, avg= 7.04, stdev= 4.85, samples=393 lat (msec) : 10=0.42%, 20=9.34%, 50=40.92%, 100=29.56%, 250=18.95% lat (msec) : 500=0.78%, 2000=0.03% cpu : usr=0.05%, sys=1.97%, ctx=5134, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178665: Mon May 25 05:33:00 2026 read: IOPS=7, BW=30.1KiB/s (30.8kB/s)(6052KiB/201040msec) clat (msec): min=6, max=413, avg=52.63, stdev=46.19 lat (msec): min=6, max=413, avg=52.63, stdev=46.19 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 78], 90.00th=[ 117], 95.00th=[ 148], | 99.00th=[ 218], 99.50th=[ 266], 99.90th=[ 317], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 135, per=26.75%, avg=31.03, stdev=21.04, samples=377 iops : min= 1, max= 33, avg= 7.08, stdev= 5.30, samples=377 write: IOPS=7, BW=31.0KiB/s (31.8kB/s)(6236KiB/201040msec); 0 zone resets clat (msec): min=13, max=1073, avg=77.76, stdev=57.61 lat (msec): min=13, max=1073, avg=77.77, stdev=57.61 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 110], 90.00th=[ 144], 95.00th=[ 180], | 99.00th=[ 266], 99.50th=[ 338], 99.90th=[ 451], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 96, per=25.46%, avg=31.07, stdev=19.01, samples=388 iops : min= 1, max= 24, avg= 7.09, stdev= 4.79, samples=388 lat (msec) : 10=0.68%, 20=9.70%, 50=40.43%, 100=30.24%, 250=18.07% lat (msec) : 500=0.85%, 2000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=5022, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=117KiB/s (120kB/s), 28.9KiB/s-30.1KiB/s (29.6kB/s-30.8kB/s), io=23.4MiB (24.6MB), run=201040-205356msec WRITE: bw=122KiB/s (125kB/s), 30.7KiB/s-31.0KiB/s (31.5kB/s-31.8kB/s), io=24.6MiB (25.7MB), run=201040-205356msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178719: Mon May 25 05:33:57 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(5920KiB/38199msec) clat (usec): min=40, max=183540, avg=52317.58, stdev=34817.02 lat (usec): min=40, max=183541, avg=52318.76, stdev=34817.10 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 82], 20.00th=[ 26870], | 30.00th=[ 34866], 40.00th=[ 40633], 50.00th=[ 47973], 60.00th=[ 55313], | 70.00th=[ 65274], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[111674], | 99.00th=[164627], 99.50th=[181404], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 62, max= 411, per=25.47%, avg=157.15, stdev=64.69, samples=74 iops : min= 3, max= 25, avg= 9.00, stdev= 4.04, samples=74 write: IOPS=10, BW=167KiB/s (171kB/s)(6368KiB/38199msec); 0 zone resets clat (usec): min=1676, max=201506, avg=47122.97, stdev=41626.35 lat (usec): min=1678, max=201508, avg=47129.04, stdev=41623.47 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 3458], 10.00th=[ 5014], 20.00th=[ 9503], | 30.00th=[ 15926], 40.00th=[ 27657], 50.00th=[ 34866], 60.00th=[ 47449], | 70.00th=[ 60556], 80.00th=[ 81265], 90.00th=[107480], 95.00th=[135267], | 99.00th=[173016], 99.50th=[200279], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 30, max= 286, per=25.66%, avg=166.55, stdev=63.45, samples=75 iops : min= 1, max= 17, avg= 9.60, stdev= 3.99, samples=75 lat (usec) : 50=0.78%, 100=4.69%, 250=0.26%, 500=0.13% lat (msec) : 2=0.65%, 4=2.60%, 10=8.20%, 20=7.94%, 50=31.90% lat (msec) : 100=32.03%, 250=10.81% cpu : usr=0.09%, sys=6.04%, ctx=1810, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178720: Mon May 25 05:33:57 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(5744KiB/38206msec) clat (usec): min=46, max=291914, avg=56253.37, stdev=34997.74 lat (usec): min=47, max=291916, avg=56255.24, stdev=34997.49 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 15926], 20.00th=[ 31065], | 30.00th=[ 36963], 40.00th=[ 44827], 50.00th=[ 51119], 60.00th=[ 59507], | 70.00th=[ 70779], 80.00th=[ 83362], 90.00th=[100140], 95.00th=[110625], | 99.00th=[145753], 99.50th=[229639], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 318, per=24.75%, avg=152.70, stdev=67.64, samples=74 iops : min= 1, max= 19, avg= 8.73, stdev= 4.23, samples=74 write: IOPS=10, BW=171KiB/s (175kB/s)(6544KiB/38206msec); 0 zone resets clat (usec): min=1781, max=270149, avg=43916.26, stdev=42899.97 lat (usec): min=1783, max=270152, avg=43939.41, stdev=42889.70 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 6], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 22], 50.00th=[ 31], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 74], 90.00th=[ 101], 95.00th=[ 136], | 99.00th=[ 188], 99.50th=[ 207], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 413, per=26.61%, avg=172.72, stdev=87.33, samples=74 iops : min= 1, max= 25, avg= 9.99, stdev= 5.47, samples=74 lat (usec) : 50=0.13%, 100=3.26%, 250=0.13%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.39%, 4=3.52%, 10=8.33%, 20=9.38%, 50=33.07% lat (msec) : 100=31.51%, 250=9.77%, 500=0.26% cpu : usr=0.07%, sys=6.11%, ctx=1768, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178721: Mon May 25 05:33:57 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38794msec) clat (usec): min=25, max=325038, avg=55088.36, stdev=39301.64 lat (usec): min=25, max=325039, avg=55095.75, stdev=39303.08 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 66], 10.00th=[ 260], 20.00th=[ 27132], | 30.00th=[ 33817], 40.00th=[ 41681], 50.00th=[ 50070], 60.00th=[ 57410], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[101188], 95.00th=[121111], | 99.00th=[191890], 99.50th=[221250], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 349, per=26.12%, avg=161.18, stdev=67.49, samples=76 iops : min= 1, max= 21, avg= 9.26, stdev= 4.24, samples=76 write: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38794msec); 0 zone resets clat (usec): min=1436, max=218060, avg=45602.85, stdev=39494.18 lat (usec): min=1437, max=218063, avg=45611.54, stdev=39489.23 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 3097], 10.00th=[ 5145], 20.00th=[ 9110], | 30.00th=[ 18482], 40.00th=[ 26084], 50.00th=[ 35390], 60.00th=[ 44827], | 70.00th=[ 59507], 80.00th=[ 78119], 90.00th=[102237], 95.00th=[128451], | 99.00th=[164627], 99.50th=[181404], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 349, per=23.61%, avg=153.24, stdev=65.48, samples=76 iops : min= 1, max= 21, avg= 8.76, stdev= 4.13, samples=76 lat (usec) : 50=0.52%, 100=4.56%, 500=0.26%, 750=0.13% lat (msec) : 2=0.78%, 4=3.39%, 10=6.77%, 20=6.51%, 50=33.98% lat (msec) : 100=32.29%, 250=10.68%, 500=0.13% cpu : usr=0.06%, sys=5.82%, ctx=1691, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178722: Mon May 25 05:33:57 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(6032KiB/37147msec) clat (usec): min=35, max=312941, avg=51432.12, stdev=35911.41 lat (usec): min=35, max=312943, avg=51434.19, stdev=35911.51 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 63], 10.00th=[ 83], 20.00th=[ 26870], | 30.00th=[ 34341], 40.00th=[ 40109], 50.00th=[ 47973], 60.00th=[ 55313], | 70.00th=[ 62653], 80.00th=[ 76022], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[160433], 99.50th=[164627], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 319, per=26.26%, avg=162.00, stdev=69.78, samples=73 iops : min= 1, max= 19, avg= 9.32, stdev= 4.38, samples=73 write: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37147msec); 0 zone resets clat (usec): min=1578, max=286045, avg=45272.99, stdev=42868.98 lat (usec): min=1580, max=286046, avg=45276.44, stdev=42870.36 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 14], 40.00th=[ 23], 50.00th=[ 33], 60.00th=[ 45], | 70.00th=[ 59], 80.00th=[ 81], 90.00th=[ 102], 95.00th=[ 130], | 99.00th=[ 180], 99.50th=[ 271], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 383, per=25.92%, avg=168.22, stdev=73.61, samples=73 iops : min= 1, max= 23, avg= 9.70, stdev= 4.62, samples=73 lat (usec) : 50=0.26%, 100=5.34%, 250=0.26%, 750=0.39% lat (msec) : 2=0.39%, 4=3.26%, 10=8.72%, 20=7.42%, 50=32.81% lat (msec) : 100=32.03%, 250=8.72%, 500=0.39% cpu : usr=0.09%, sys=6.26%, ctx=1815, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=617KiB/s (632kB/s), 150KiB/s-162KiB/s (154kB/s-166kB/s), io=23.4MiB (24.5MB), run=37147-38794msec WRITE: bw=650KiB/s (665kB/s), 155KiB/s-171KiB/s (159kB/s-175kB/s), io=24.6MiB (25.8MB), run=37147-38794msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178714: Mon May 25 05:34:11 2026 read: IOPS=6, BW=112KiB/s (114kB/s)(5920KiB/53007msec) clat (msec): min=7, max=258, avg=55.21, stdev=44.24 lat (msec): min=7, max=258, avg=55.21, stdev=44.24 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 61], 80.00th=[ 83], 90.00th=[ 120], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 249], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 319, per=25.42%, avg=114.12, stdev=65.75, samples=101 iops : min= 1, max= 19, avg= 6.33, stdev= 4.18, samples=101 write: IOPS=7, BW=120KiB/s (123kB/s)(6368KiB/53007msec); 0 zone resets clat (msec): min=15, max=318, avg=81.55, stdev=50.79 lat (msec): min=15, max=318, avg=81.56, stdev=50.79 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 75], | 70.00th=[ 93], 80.00th=[ 112], 90.00th=[ 140], 95.00th=[ 199], | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 256, per=25.50%, avg=120.37, stdev=61.62, samples=103 iops : min= 1, max= 16, avg= 6.72, stdev= 3.87, samples=103 lat (msec) : 10=0.26%, 20=6.77%, 50=38.41%, 100=32.42%, 250=21.22% lat (msec) : 500=0.91% cpu : usr=0.06%, sys=2.02%, ctx=1209, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178715: Mon May 25 05:34:11 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(5744KiB/53171msec) clat (msec): min=8, max=244, avg=54.24, stdev=44.47 lat (msec): min=8, max=244, avg=54.24, stdev=44.47 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 74], 90.00th=[ 132], 95.00th=[ 159], | 99.00th=[ 203], 99.50th=[ 232], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 347, per=25.46%, avg=114.30, stdev=68.87, samples=97 iops : min= 1, max= 21, avg= 6.34, stdev= 4.35, samples=97 write: IOPS=7, BW=123KiB/s (126kB/s)(6544KiB/53171msec); 0 zone resets clat (msec): min=18, max=323, avg=81.80, stdev=48.90 lat (msec): min=18, max=323, avg=81.81, stdev=48.90 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 34], 10.00th=[ 37], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 55], 50.00th=[ 67], 60.00th=[ 79], | 70.00th=[ 94], 80.00th=[ 117], 90.00th=[ 150], 95.00th=[ 180], | 99.00th=[ 234], 99.50th=[ 288], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 351, per=25.75%, avg=121.56, stdev=66.46, samples=104 iops : min= 1, max= 21, avg= 6.80, stdev= 4.21, samples=104 lat (msec) : 10=0.26%, 20=5.08%, 50=41.02%, 100=32.81%, 250=20.44% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=2.08%, ctx=1231, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178716: Mon May 25 05:34:11 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(6256KiB/52439msec) clat (msec): min=9, max=338, avg=56.15, stdev=47.44 lat (msec): min=9, max=338, avg=56.15, stdev=47.44 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 81], 90.00th=[ 118], 95.00th=[ 157], | 99.00th=[ 239], 99.50th=[ 317], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 415, per=27.57%, avg=123.79, stdev=78.92, samples=99 iops : min= 1, max= 25, avg= 6.94, stdev= 4.99, samples=99 write: IOPS=7, BW=115KiB/s (118kB/s)(6032KiB/52439msec); 0 zone resets clat (msec): min=23, max=279, avg=80.34, stdev=45.74 lat (msec): min=23, max=279, avg=80.35, stdev=45.74 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 59], 50.00th=[ 68], 60.00th=[ 79], | 70.00th=[ 91], 80.00th=[ 108], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 241], 99.50th=[ 275], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 284, per=24.93%, avg=117.66, stdev=55.73, samples=100 iops : min= 1, max= 17, avg= 6.55, stdev= 3.51, samples=100 lat (msec) : 10=0.13%, 20=4.69%, 50=42.32%, 100=33.59%, 250=18.62% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=2.03%, ctx=1203, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178717: Mon May 25 05:34:11 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(6032KiB/53314msec) clat (msec): min=7, max=358, avg=58.59, stdev=49.48 lat (msec): min=7, max=358, avg=58.59, stdev=49.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 79], 90.00th=[ 131], 95.00th=[ 161], | 99.00th=[ 259], 99.50th=[ 296], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 351, per=25.27%, avg=113.48, stdev=65.24, samples=101 iops : min= 1, max= 21, avg= 6.28, stdev= 4.10, samples=101 write: IOPS=7, BW=117KiB/s (120kB/s)(6256KiB/53314msec); 0 zone resets clat (msec): min=15, max=260, avg=79.23, stdev=47.64 lat (msec): min=15, max=260, avg=79.24, stdev=47.64 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 51], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 91], 80.00th=[ 115], 90.00th=[ 150], 95.00th=[ 186], | 99.00th=[ 241], 99.50th=[ 247], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 317, per=24.37%, avg=115.01, stdev=63.29, samples=104 iops : min= 1, max= 19, avg= 6.38, stdev= 4.00, samples=104 lat (msec) : 10=0.78%, 20=5.08%, 50=38.54%, 100=35.81%, 250=19.01% lat (msec) : 500=0.78% cpu : usr=0.03%, sys=2.10%, ctx=1254, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=449KiB/s (460kB/s), 108KiB/s-119KiB/s (111kB/s-122kB/s), io=23.4MiB (24.5MB), run=52439-53314msec WRITE: bw=473KiB/s (484kB/s), 115KiB/s-123KiB/s (118kB/s-126kB/s), io=24.6MiB (25.8MB), run=52439-53314msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178735: Mon May 25 05:34:34 2026 read: IOPS=0, BW=825KiB/s (845kB/s)(7168KiB/8690msec) clat (usec): min=1487, max=4503.4k, avg=892738.44, stdev=1598919.05 lat (usec): min=1488, max=4503.4k, avg=892740.04, stdev=1598919.09 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1483], 10.00th=[ 1483], | 20.00th=[ 283116], 30.00th=[ 291505], 40.00th=[ 291505], | 50.00th=[ 329253], 60.00th=[ 346031], 70.00th=[ 346031], | 80.00th=[ 492831], 90.00th=[4529849], 95.00th=[4529849], | 99.00th=[4529849], 99.50th=[4529849], 99.90th=[4529849], | 99.95th=[4529849], 99.99th=[4529849] bw ( KiB/s): min= 1673, max= 4031, per=100.00%, avg=2347.80, stdev=952.59, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=589KiB/s (603kB/s)(5120KiB/8690msec); 0 zone resets clat (msec): min=188, max=751, avg=476.11, stdev=231.13 lat (msec): min=188, max=751, avg=476.51, stdev=230.79 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2000, max= 3778, per=86.72%, avg=2601.67, stdev=1018.82, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=8.33%, 500=50.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.74%, ctx=594, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178736: Mon May 25 05:34:34 2026 read: IOPS=0, BW=214KiB/s (219kB/s)(2048KiB/9557msec) clat (msec): min=300, max=423, avg=361.94, stdev=87.21 lat (msec): min=300, max=423, avg=361.95, stdev=87.21 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1812, max= 2035, per=89.80%, avg=1923.50, stdev=157.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1071KiB/s (1097kB/s)(10.0MiB/9557msec); 0 zone resets clat (msec): min=156, max=3984, avg=862.94, stdev=1143.00 lat (msec): min=156, max=3985, avg=863.37, stdev=1142.89 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 305], | 30.00th=[ 347], 40.00th=[ 384], 50.00th=[ 430], 60.00th=[ 493], | 70.00th=[ 502], 80.00th=[ 701], 90.00th=[ 1334], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 1961, max= 4015, per=75.30%, avg=2259.12, stdev=710.09, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=8.33%, 500=66.67%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=6.29%, ctx=144, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178737: Mon May 25 05:34:34 2026 read: IOPS=0, BW=710KiB/s (727kB/s)(6144KiB/8654msec) clat (usec): min=484, max=323937, avg=160227.07, stdev=142574.79 lat (usec): min=486, max=323938, avg=160228.50, stdev=142574.66 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 3752], | 30.00th=[ 3752], 40.00th=[152044], 50.00th=[152044], 60.00th=[164627], | 70.00th=[316670], 80.00th=[316670], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 1812, max= 4000, per=100.00%, avg=2450.00, stdev=1037.03, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=710KiB/s (727kB/s)(6144KiB/8654msec); 0 zone resets clat (msec): min=226, max=4640, avg=1249.69, stdev=1688.78 lat (msec): min=226, max=4640, avg=1249.75, stdev=1688.80 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 584], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 1812, max= 2035, per=65.61%, avg=1968.40, stdev=90.25, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.45%, ctx=187, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178738: Mon May 25 05:34:34 2026 read: IOPS=0, BW=633KiB/s (649kB/s)(5120KiB/8083msec) clat (msec): min=2, max=360, avg=151.90, stdev=151.46 lat (msec): min=2, max=360, avg=151.90, stdev=151.46 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1812, max= 6000, per=100.00%, avg=3906.00, stdev=2961.36, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=887KiB/s (908kB/s)(7168KiB/8083msec); 0 zone resets clat (msec): min=227, max=4985, avg=1036.26, stdev=1748.50 lat (msec): min=227, max=4986, avg=1036.59, stdev=1749.05 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 251], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 397], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 676], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 1812, max= 2035, per=65.43%, avg=1963.00, stdev=91.25, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 4=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=5.02%, ctx=120, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2143KiB/s (2194kB/s), 214KiB/s-825KiB/s (219kB/s-845kB/s), io=20.0MiB (20.0MB), run=8083-9557msec WRITE: bw=3000KiB/s (3072kB/s), 589KiB/s-1071KiB/s (603kB/s-1097kB/s), io=28.0MiB (29.4MB), run=8083-9557msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178742: Mon May 25 05:34:35 2026 read: IOPS=0, BW=803KiB/s (822kB/s)(7168KiB/8927msec) clat (msec): min=115, max=3033, avg=1105.50, stdev=1286.00 lat (msec): min=115, max=3033, avg=1105.50, stdev=1286.00 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 125], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 693], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 2869], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1954, max= 3806, per=100.00%, avg=2458.50, stdev=899.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=574KiB/s (587kB/s)(5120KiB/8927msec); 0 zone resets clat (msec): min=133, max=319, avg=215.97, stdev=74.76 lat (msec): min=134, max=320, avg=216.22, stdev=74.55 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1903, max= 4007, per=82.48%, avg=2648.33, stdev=1178.49, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.01%, sys=2.06%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178743: Mon May 25 05:34:35 2026 read: IOPS=0, BW=252KiB/s (258kB/s)(2048KiB/8121msec) clat (msec): min=116, max=162, avg=139.53, stdev=32.26 lat (msec): min=116, max=162, avg=139.53, stdev=32.26 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 1965, max= 2039, per=87.27%, avg=2002.00, stdev=52.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1261KiB/s (1291kB/s)(10.0MiB/8121msec); 0 zone resets clat (msec): min=153, max=2951, avg=772.59, stdev=945.47 lat (msec): min=153, max=2951, avg=772.68, stdev=945.47 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 220], | 30.00th=[ 251], 40.00th=[ 262], 50.00th=[ 317], 60.00th=[ 334], | 70.00th=[ 558], 80.00th=[ 634], 90.00th=[ 2039], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2007, max= 5862, per=98.14%, avg=3151.40, stdev=1699.37, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=2.39%, ctx=126, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178744: Mon May 25 05:34:35 2026 read: IOPS=0, BW=714KiB/s (731kB/s)(6144KiB/8608msec) clat (msec): min=139, max=649, avg=336.88, stdev=186.57 lat (msec): min=139, max=649, avg=336.88, stdev=186.57 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 279], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2007, max= 3806, per=100.00%, avg=2617.33, stdev=1029.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=714KiB/s (731kB/s)(6144KiB/8608msec); 0 zone resets clat (msec): min=109, max=5307, avg=1081.41, stdev=2073.30 lat (msec): min=109, max=5307, avg=1081.54, stdev=2073.28 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 296], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 5336], 95.00th=[ 5336], | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], | 99.99th=[ 5336] bw ( KiB/s): min= 1903, max= 3900, per=76.90%, avg=2469.25, stdev=955.92, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.94%, ctx=74, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178745: Mon May 25 05:34:35 2026 read: IOPS=0, BW=588KiB/s (602kB/s)(5120KiB/8702msec) clat (msec): min=132, max=452, avg=260.51, stdev=151.86 lat (msec): min=132, max=452, avg=260.51, stdev=151.86 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2003, max= 3813, per=100.00%, avg=2617.00, stdev=1035.89, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=824KiB/s (843kB/s)(7168KiB/8702msec); 0 zone resets clat (msec): min=174, max=5108, avg=1053.02, stdev=1800.16 lat (msec): min=175, max=5108, avg=1053.12, stdev=1800.15 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 194], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 330], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 768], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 1424, max= 4071, per=72.10%, avg=2315.20, stdev=1015.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.46%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2294KiB/s (2349kB/s), 252KiB/s-803KiB/s (258kB/s-822kB/s), io=20.0MiB (20.0MB), run=8121-8927msec WRITE: bw=3212KiB/s (3289kB/s), 574KiB/s-1261KiB/s (587kB/s-1291kB/s), io=28.0MiB (29.4MB), run=8121-8927msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178758: Mon May 25 05:34:57 2026 read: IOPS=0, BW=3251KiB/s (3329kB/s)(12.0MiB/3780msec) clat (msec): min=408, max=1641, avg=1217.37, stdev=700.64 lat (msec): min=408, max=1641, avg=1217.37, stdev=700.64 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.80%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178759: Mon May 25 05:34:57 2026 read: IOPS=0, BW=948KiB/s (971kB/s)(4096KiB/4320msec) clat (nsec): min=874186k, max=874186k, avg=874185638.00, stdev= 0.00 lat (nsec): min=874188k, max=874188k, avg=874187993.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7393, max= 7393, per=100.00%, avg=7393.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1896KiB/s (1942kB/s)(8192KiB/4320msec); 0 zone resets clat (msec): min=1589, max=1703, avg=1646.40, stdev=80.78 lat (msec): min=1589, max=1703, avg=1646.74, stdev=80.84 clat percentiles (msec): | 1.00th=[ 1586], 5.00th=[ 1586], 10.00th=[ 1586], 20.00th=[ 1586], | 30.00th=[ 1586], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.10%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178760: Mon May 25 05:34:57 2026 write: IOPS=0, BW=3814KiB/s (3905kB/s)(12.0MiB/3222msec); 0 zone resets clat (msec): min=813, max=1234, avg=1023.47, stdev=210.65 lat (msec): min=813, max=1234, avg=1023.89, stdev=210.61 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.60%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178761: Mon May 25 05:34:57 2026 write: IOPS=0, BW=3775KiB/s (3866kB/s)(12.0MiB/3255msec); 0 zone resets clat (msec): min=486, max=1394, avg=1063.65, stdev=501.68 lat (msec): min=487, max=1394, avg=1064.10, stdev=501.49 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8031, max= 8094, per=100.00%, avg=8062.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.20%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3793KiB/s (3884kB/s), 948KiB/s-3251KiB/s (971kB/s-3329kB/s), io=16.0MiB (16.8MB), run=3780-4320msec WRITE: bw=7585KiB/s (7767kB/s), 1896KiB/s-3814KiB/s (1942kB/s-3905kB/s), io=32.0MiB (33.6MB), run=3222-4320msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178753: Mon May 25 05:34:57 2026 read: IOPS=1, BW=4160KiB/s (4260kB/s)(12.0MiB/2954msec) clat (msec): min=730, max=1249, avg=969.88, stdev=261.49 lat (msec): min=730, max=1249, avg=969.88, stdev=261.49 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.27%, ctx=299, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178754: Mon May 25 05:34:57 2026 read: IOPS=0, BW=1001KiB/s (1025kB/s)(4096KiB/4091msec) clat (nsec): min=1144.0M, max=1144.0M, avg=1144021298.00, stdev= 0.00 lat (nsec): min=1144.0M, max=1144.0M, avg=1144023963.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2002KiB/s (2051kB/s)(8192KiB/4091msec); 0 zone resets clat (msec): min=1065, max=1723, avg=1394.47, stdev=464.82 lat (msec): min=1068, max=1724, avg=1396.42, stdev=464.08 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.25%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178755: Mon May 25 05:34:57 2026 write: IOPS=0, BW=2600KiB/s (2662kB/s)(12.0MiB/4726msec); 0 zone resets clat (msec): min=367, max=2612, avg=1541.89, stdev=1125.84 lat (msec): min=368, max=2612, avg=1542.51, stdev=1125.55 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.69%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178756: Mon May 25 05:34:57 2026 write: IOPS=0, BW=3280KiB/s (3359kB/s)(12.0MiB/3746msec); 0 zone resets clat (msec): min=494, max=1948, avg=1230.69, stdev=727.35 lat (msec): min=495, max=1949, avg=1231.22, stdev=727.20 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8078, max= 8143, per=100.00%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.66%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4005KiB/s (4101kB/s), 1001KiB/s-4160KiB/s (1025kB/s-4260kB/s), io=16.0MiB (16.8MB), run=2954-4091msec WRITE: bw=6934KiB/s (7100kB/s), 2002KiB/s-3280KiB/s (2051kB/s-3359kB/s), io=32.0MiB (33.6MB), run=3746-4726msec