== sanity test 398b: DIO and buffer IO race ============== 04:58:27 (1785401907) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 11.1152 s, 4.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178484: Thu Jul 30 05:01:49 2026 read: IOPS=8, BW=34.7KiB/s (35.5kB/s)(5992KiB/172882msec) clat (usec): min=36, max=371317, avg=63168.43, stdev=43869.18 lat (usec): min=36, max=371319, avg=63183.00, stdev=43862.68 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 13698], 10.00th=[ 21365], 20.00th=[ 30278], | 30.00th=[ 38536], 40.00th=[ 44827], 50.00th=[ 52691], 60.00th=[ 62653], | 70.00th=[ 74974], 80.00th=[ 89654], 90.00th=[116917], 95.00th=[143655], | 99.00th=[219153], 99.50th=[254804], 99.90th=[329253], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 94, per=25.63%, avg=34.86, stdev=16.29, samples=332 iops : min= 1, max= 23, avg= 8.04, stdev= 4.12, samples=332 write: IOPS=9, BW=36.4KiB/s (37.3kB/s)(6296KiB/172882msec); 0 zone resets clat (usec): min=999, max=892269, avg=49396.12, stdev=57619.54 lat (usec): min=999, max=892271, avg=49400.44, stdev=57618.40 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 1663], 20.00th=[ 5932], | 30.00th=[ 10552], 40.00th=[ 20055], 50.00th=[ 31327], 60.00th=[ 44827], | 70.00th=[ 60031], 80.00th=[ 86508], 90.00th=[123208], 95.00th=[154141], | 99.00th=[238027], 99.50th=[291505], 99.90th=[417334], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 126, per=25.40%, avg=36.07, stdev=19.15, samples=337 iops : min= 1, max= 31, avg= 8.35, stdev= 4.83, samples=337 lat (usec) : 50=0.20%, 100=1.66%, 250=0.03%, 1000=0.07% lat (msec) : 2=5.50%, 4=2.38%, 10=7.36%, 20=7.52%, 50=30.50% lat (msec) : 100=29.26%, 250=14.81%, 500=0.68%, 1000=0.03% cpu : usr=0.07%, sys=3.92%, ctx=6245, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178485: Thu Jul 30 05:01:49 2026 read: IOPS=8, BW=33.9KiB/s (34.7kB/s)(5940KiB/175320msec) clat (usec): min=48, max=976055, avg=65049.16, stdev=51239.85 lat (usec): min=49, max=976056, avg=65053.20, stdev=51239.72 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 13304], 10.00th=[ 23200], 20.00th=[ 30802], | 30.00th=[ 38536], 40.00th=[ 45351], 50.00th=[ 54789], 60.00th=[ 65274], | 70.00th=[ 74974], 80.00th=[ 90702], 90.00th=[120062], 95.00th=[145753], | 99.00th=[235930], 99.50th=[274727], 99.90th=[392168], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 103, per=24.90%, avg=33.87, stdev=16.22, samples=339 iops : min= 1, max= 25, avg= 7.80, stdev= 4.08, samples=339 write: IOPS=9, BW=36.2KiB/s (37.1kB/s)(6348KiB/175320msec); 0 zone resets clat (usec): min=1030, max=361211, avg=49257.45, stdev=53085.92 lat (usec): min=1031, max=361213, avg=49265.01, stdev=53082.43 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1532], 20.00th=[ 5604], | 30.00th=[ 10945], 40.00th=[ 21890], 50.00th=[ 34341], 60.00th=[ 46400], | 70.00th=[ 61604], 80.00th=[ 84411], 90.00th=[119014], 95.00th=[156238], | 99.00th=[238027], 99.50th=[278922], 99.90th=[337642], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 111, per=25.46%, avg=36.15, stdev=20.10, samples=339 iops : min= 1, max= 27, avg= 8.38, stdev= 5.08, samples=339 lat (usec) : 50=0.07%, 100=1.76%, 250=0.07%, 750=0.03%, 1000=0.03% lat (msec) : 2=6.41%, 4=2.02%, 10=6.74%, 20=6.28%, 50=30.34% lat (msec) : 100=31.12%, 250=14.42%, 500=0.68%, 1000=0.03% cpu : usr=0.06%, sys=3.82%, ctx=6338, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178486: Thu Jul 30 05:01:49 2026 read: IOPS=8, BW=34.6KiB/s (35.4kB/s)(6028KiB/174440msec) clat (usec): min=43, max=559537, avg=63736.49, stdev=46310.55 lat (usec): min=44, max=559538, avg=63752.91, stdev=46310.42 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 80], 10.00th=[ 21103], 20.00th=[ 30540], | 30.00th=[ 39060], 40.00th=[ 46400], 50.00th=[ 54789], 60.00th=[ 64226], | 70.00th=[ 73925], 80.00th=[ 89654], 90.00th=[115868], 95.00th=[147850], | 99.00th=[229639], 99.50th=[265290], 99.90th=[375391], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 95, per=25.42%, avg=34.57, stdev=16.93, samples=337 iops : min= 1, max= 23, avg= 7.97, stdev= 4.26, samples=337 write: IOPS=8, BW=35.9KiB/s (36.7kB/s)(6260KiB/174440msec); 0 zone resets clat (usec): min=1051, max=912261, avg=49726.52, stdev=57850.22 lat (usec): min=1052, max=912263, avg=49734.62, stdev=57853.77 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1483], 20.00th=[ 5211], | 30.00th=[ 10159], 40.00th=[ 21365], 50.00th=[ 33817], 60.00th=[ 46400], | 70.00th=[ 61080], 80.00th=[ 84411], 90.00th=[119014], 95.00th=[158335], | 99.00th=[244319], 99.50th=[283116], 99.90th=[358613], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 94, per=25.27%, avg=35.88, stdev=18.95, samples=337 iops : min= 1, max= 23, avg= 8.31, stdev= 4.76, samples=337 lat (usec) : 50=0.33%, 100=2.31% lat (msec) : 2=6.90%, 4=1.86%, 10=6.48%, 20=6.15%, 50=29.75% lat (msec) : 100=31.18%, 250=14.26%, 500=0.72%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.06%, ctx=6405, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178487: Thu Jul 30 05:01:49 2026 read: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6052KiB/175983msec) clat (usec): min=36, max=525480, avg=64296.34, stdev=46634.51 lat (usec): min=37, max=525481, avg=64300.02, stdev=46633.70 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11863], 10.00th=[ 21365], 20.00th=[ 30540], | 30.00th=[ 38011], 40.00th=[ 44827], 50.00th=[ 54264], 60.00th=[ 64226], | 70.00th=[ 74974], 80.00th=[ 90702], 90.00th=[121111], 95.00th=[154141], | 99.00th=[219153], 99.50th=[258999], 99.90th=[367002], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 7, max= 111, per=25.26%, avg=34.35, stdev=17.57, samples=340 iops : min= 1, max= 27, avg= 7.92, stdev= 4.44, samples=340 write: IOPS=8, BW=35.4KiB/s (36.3kB/s)(6236KiB/175983msec); 0 zone resets clat (usec): min=1006, max=847909, avg=50189.83, stdev=59583.33 lat (usec): min=1007, max=847911, avg=50192.48, stdev=59582.90 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 1762], 20.00th=[ 5800], | 30.00th=[ 10814], 40.00th=[ 20317], 50.00th=[ 33162], 60.00th=[ 44827], | 70.00th=[ 60031], 80.00th=[ 85459], 90.00th=[122160], 95.00th=[158335], | 99.00th=[244319], 99.50th=[278922], 99.90th=[574620], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 103, per=25.18%, avg=35.76, stdev=19.51, samples=336 iops : min= 1, max= 25, avg= 8.27, stdev= 4.91, samples=336 lat (usec) : 50=0.26%, 100=1.73%, 250=0.16%, 500=0.07%, 750=0.03% lat (msec) : 2=5.40%, 4=1.95%, 10=7.36%, 20=7.81%, 50=29.79% lat (msec) : 100=29.88%, 250=14.84%, 500=0.59%, 750=0.10%, 1000=0.03% cpu : usr=0.06%, sys=3.94%, ctx=6262, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=136KiB/s (140kB/s), 33.9KiB/s-34.7KiB/s (34.7kB/s-35.5kB/s), io=23.4MiB (24.6MB), run=172882-175983msec WRITE: bw=143KiB/s (146kB/s), 35.4KiB/s-36.4KiB/s (36.3kB/s-37.3kB/s), io=24.6MiB (25.7MB), run=172882-175983msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178489: Thu Jul 30 05:02:39 2026 read: IOPS=6, BW=26.6KiB/s (27.2kB/s)(5992KiB/225382msec) clat (msec): min=5, max=1037, avg=59.96, stdev=62.12 lat (msec): min=5, max=1037, avg=59.96, stdev=62.12 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 63], 80.00th=[ 88], 90.00th=[ 131], 95.00th=[ 178], | 99.00th=[ 275], 99.50th=[ 359], 99.90th=[ 518], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 111, per=26.32%, avg=27.90, stdev=20.61, samples=413 iops : min= 1, max= 27, avg= 6.30, stdev= 5.20, samples=413 write: IOPS=6, BW=27.9KiB/s (28.6kB/s)(6296KiB/225382msec); 0 zone resets clat (msec): min=13, max=573, avg=86.01, stdev=69.86 lat (msec): min=13, max=573, avg=86.01, stdev=69.86 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 75], | 70.00th=[ 96], 80.00th=[ 128], 90.00th=[ 182], 95.00th=[ 228], | 99.00th=[ 334], 99.50th=[ 401], 99.90th=[ 523], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 88, per=25.63%, avg=28.45, stdev=19.07, samples=425 iops : min= 1, max= 22, avg= 6.44, stdev= 4.82, samples=425 lat (msec) : 10=0.62%, 20=8.63%, 50=41.15%, 100=26.86%, 250=20.05% lat (msec) : 500=2.57%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4883, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178490: Thu Jul 30 05:02:39 2026 read: IOPS=6, BW=26.4KiB/s (27.0kB/s)(5940KiB/225006msec) clat (msec): min=6, max=978, avg=59.36, stdev=62.52 lat (msec): min=6, max=978, avg=59.36, stdev=62.52 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 85], 90.00th=[ 136], 95.00th=[ 180], | 99.00th=[ 279], 99.50th=[ 317], 99.90th=[ 743], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 111, per=26.46%, avg=28.05, stdev=20.30, samples=408 iops : min= 1, max= 27, avg= 6.33, stdev= 5.14, samples=408 write: IOPS=7, BW=28.2KiB/s (28.9kB/s)(6348KiB/225006msec); 0 zone resets clat (msec): min=14, max=609, avg=86.13, stdev=69.51 lat (msec): min=14, max=609, avg=86.13, stdev=69.51 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 63], 60.00th=[ 78], | 70.00th=[ 97], 80.00th=[ 127], 90.00th=[ 174], 95.00th=[ 220], | 99.00th=[ 351], 99.50th=[ 401], 99.90th=[ 575], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 103, per=25.58%, avg=28.39, stdev=19.47, samples=430 iops : min= 1, max= 25, avg= 6.42, stdev= 4.91, samples=430 lat (msec) : 10=0.81%, 20=8.59%, 50=41.15%, 100=26.69%, 250=20.21% lat (msec) : 500=2.38%, 750=0.13%, 1000=0.03% cpu : usr=0.04%, sys=1.59%, ctx=4820, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178491: Thu Jul 30 05:02:39 2026 read: IOPS=6, BW=26.8KiB/s (27.4kB/s)(6028KiB/225044msec) clat (msec): min=4, max=440, avg=60.12, stdev=57.61 lat (msec): min=4, max=440, avg=60.12, stdev=57.61 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 86], 90.00th=[ 136], 95.00th=[ 182], | 99.00th=[ 284], 99.50th=[ 321], 99.90th=[ 430], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 127, per=26.38%, avg=27.96, stdev=20.32, samples=416 iops : min= 1, max= 31, avg= 6.31, stdev= 5.12, samples=416 write: IOPS=6, BW=27.8KiB/s (28.5kB/s)(6260KiB/225044msec); 0 zone resets clat (msec): min=7, max=974, avg=85.79, stdev=74.22 lat (msec): min=7, max=974, avg=85.80, stdev=74.22 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 72], | 70.00th=[ 94], 80.00th=[ 123], 90.00th=[ 171], 95.00th=[ 230], | 99.00th=[ 351], 99.50th=[ 393], 99.90th=[ 600], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 88, per=25.72%, avg=28.55, stdev=18.82, samples=423 iops : min= 1, max= 22, avg= 6.46, stdev= 4.74, samples=423 lat (msec) : 10=0.68%, 20=7.45%, 50=42.48%, 100=27.38%, 250=18.88% lat (msec) : 500=3.03%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.56%, ctx=4897, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178492: Thu Jul 30 05:02:39 2026 read: IOPS=6, BW=26.8KiB/s (27.4kB/s)(6052KiB/225980msec) clat (msec): min=6, max=738, avg=59.37, stdev=59.85 lat (msec): min=6, max=738, avg=59.37, stdev=59.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 49], | 70.00th=[ 60], 80.00th=[ 85], 90.00th=[ 131], 95.00th=[ 186], | 99.00th=[ 296], 99.50th=[ 334], 99.90th=[ 393], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 96, per=26.85%, avg=28.46, stdev=20.37, samples=408 iops : min= 1, max= 24, avg= 6.44, stdev= 5.14, samples=408 write: IOPS=6, BW=27.6KiB/s (28.3kB/s)(6236KiB/225980msec); 0 zone resets clat (msec): min=11, max=975, avg=87.22, stdev=72.11 lat (msec): min=11, max=975, avg=87.22, stdev=72.10 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 75], | 70.00th=[ 101], 80.00th=[ 131], 90.00th=[ 176], 95.00th=[ 220], | 99.00th=[ 338], 99.50th=[ 422], 99.90th=[ 625], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 87, per=26.04%, avg=28.91, stdev=18.59, samples=414 iops : min= 1, max= 21, avg= 6.55, stdev= 4.69, samples=414 lat (msec) : 10=1.04%, 20=8.14%, 50=40.40%, 100=27.47%, 250=20.41% lat (msec) : 500=2.38%, 750=0.13%, 1000=0.03% cpu : usr=0.05%, sys=1.56%, ctx=4822, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=106KiB/s (109kB/s), 26.4KiB/s-26.8KiB/s (27.0kB/s-27.4kB/s), io=23.4MiB (24.6MB), run=225006-225980msec WRITE: bw=111KiB/s (114kB/s), 27.6KiB/s-28.2KiB/s (28.3kB/s-28.9kB/s), io=24.6MiB (25.7MB), run=225006-225980msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178552: Thu Jul 30 05:03:47 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(5920KiB/55797msec) clat (usec): min=36, max=318349, avg=78061.36, stdev=52559.95 lat (usec): min=36, max=318351, avg=78062.79, stdev=52560.00 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 80], 10.00th=[ 23987], 20.00th=[ 40633], | 30.00th=[ 48497], 40.00th=[ 56361], 50.00th=[ 67634], 60.00th=[ 82314], | 70.00th=[ 92799], 80.00th=[110625], 90.00th=[141558], 95.00th=[187696], | 99.00th=[261096], 99.50th=[287310], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 30, max= 280, per=24.57%, avg=105.39, stdev=54.74, samples=107 iops : min= 1, max= 17, avg= 5.84, stdev= 3.49, samples=107 write: IOPS=7, BW=114KiB/s (117kB/s)(6368KiB/55797msec); 0 zone resets clat (usec): min=1666, max=366535, avg=67019.59, stdev=66044.16 lat (usec): min=1667, max=366537, avg=67022.47, stdev=66043.82 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2057], 10.00th=[ 6390], 20.00th=[ 14091], | 30.00th=[ 20841], 40.00th=[ 32900], 50.00th=[ 45876], 60.00th=[ 62129], | 70.00th=[ 86508], 80.00th=[108528], 90.00th=[158335], 95.00th=[200279], | 99.00th=[316670], 99.50th=[320865], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 29, max= 346, per=25.57%, avg=115.31, stdev=57.17, samples=106 iops : min= 1, max= 21, avg= 6.47, stdev= 3.69, samples=106 lat (usec) : 50=0.26%, 100=2.47%, 250=0.52%, 500=0.13% lat (msec) : 2=1.82%, 4=2.47%, 10=3.39%, 20=7.68%, 50=24.09% lat (msec) : 100=32.94%, 250=22.01%, 500=2.21% cpu : usr=0.04%, sys=4.20%, ctx=1807, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178553: Thu Jul 30 05:03:47 2026 read: IOPS=6, BW=110KiB/s (112kB/s)(5744KiB/52339msec) clat (usec): min=43, max=389098, avg=78099.86, stdev=52077.57 lat (usec): min=43, max=389100, avg=78102.00, stdev=52077.29 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 91], 10.00th=[ 29230], 20.00th=[ 41157], | 30.00th=[ 51643], 40.00th=[ 59507], 50.00th=[ 67634], 60.00th=[ 78119], | 70.00th=[ 91751], 80.00th=[103285], 90.00th=[139461], 95.00th=[183501], | 99.00th=[265290], 99.50th=[329253], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 29, max= 287, per=25.80%, avg=110.67, stdev=54.38, samples=101 iops : min= 1, max= 17, avg= 6.16, stdev= 3.46, samples=101 write: IOPS=7, BW=125KiB/s (128kB/s)(6544KiB/52339msec); 0 zone resets clat (usec): min=1654, max=397344, avg=59031.62, stdev=57319.40 lat (usec): min=1656, max=397346, avg=59037.23, stdev=57319.16 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3490], 10.00th=[ 6849], 20.00th=[ 12387], | 30.00th=[ 20055], 40.00th=[ 31065], 50.00th=[ 44827], 60.00th=[ 56361], | 70.00th=[ 70779], 80.00th=[ 96994], 90.00th=[133694], 95.00th=[166724], | 99.00th=[263193], 99.50th=[304088], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 26, max= 318, per=27.78%, avg=125.27, stdev=67.51, samples=101 iops : min= 1, max= 19, avg= 7.08, stdev= 4.30, samples=101 lat (usec) : 50=0.13%, 100=2.47%, 250=0.13%, 1000=0.13% lat (msec) : 2=1.43%, 4=1.56%, 10=5.86%, 20=7.55%, 50=23.70% lat (msec) : 100=36.20%, 250=19.40%, 500=1.43% cpu : usr=0.05%, sys=4.36%, ctx=1798, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178554: Thu Jul 30 05:03:47 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(6256KiB/52679msec) clat (usec): min=40, max=323510, avg=77756.89, stdev=51683.83 lat (usec): min=41, max=323512, avg=77758.28, stdev=51683.77 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 77], 10.00th=[ 24511], 20.00th=[ 38536], | 30.00th=[ 48497], 40.00th=[ 57934], 50.00th=[ 66847], 60.00th=[ 82314], | 70.00th=[ 95945], 80.00th=[112722], 90.00th=[141558], 95.00th=[177210], | 99.00th=[258999], 99.50th=[278922], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 253, per=28.00%, avg=120.10, stdev=49.03, samples=100 iops : min= 1, max= 15, avg= 6.77, stdev= 3.14, samples=100 write: IOPS=7, BW=115KiB/s (117kB/s)(6032KiB/52679msec); 0 zone resets clat (usec): min=1677, max=263058, avg=58357.82, stdev=56328.23 lat (usec): min=1680, max=263060, avg=58398.75, stdev=56379.14 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2343], 10.00th=[ 5014], 20.00th=[ 10159], | 30.00th=[ 15926], 40.00th=[ 26346], 50.00th=[ 38011], 60.00th=[ 55837], | 70.00th=[ 72877], 80.00th=[106431], 90.00th=[145753], 95.00th=[170918], | 99.00th=[244319], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 256, per=25.50%, avg=115.01, stdev=55.48, samples=99 iops : min= 1, max= 16, avg= 6.43, stdev= 3.53, samples=99 lat (usec) : 50=0.26%, 100=3.52%, 250=0.13%, 750=0.13% lat (msec) : 2=1.04%, 4=2.60%, 10=5.86%, 20=8.07%, 50=22.66% lat (msec) : 100=31.25%, 250=23.70%, 500=0.78% cpu : usr=0.05%, sys=4.08%, ctx=1826, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178555: Thu Jul 30 05:03:47 2026 read: IOPS=7, BW=117KiB/s (119kB/s)(6032KiB/51690msec) clat (usec): min=44, max=310366, avg=75100.02, stdev=52804.02 lat (usec): min=45, max=310368, avg=75101.36, stdev=52803.99 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 693], 20.00th=[ 37487], | 30.00th=[ 47449], 40.00th=[ 56886], 50.00th=[ 68682], 60.00th=[ 79168], | 70.00th=[ 90702], 80.00th=[108528], 90.00th=[145753], 95.00th=[175113], | 99.00th=[267387], 99.50th=[304088], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 30, max= 288, per=27.08%, avg=116.18, stdev=59.76, samples=100 iops : min= 1, max= 18, avg= 6.50, stdev= 3.81, samples=100 write: IOPS=7, BW=121KiB/s (124kB/s)(6256KiB/51690msec); 0 zone resets clat (usec): min=1559, max=346437, avg=59171.59, stdev=57063.62 lat (usec): min=1561, max=346439, avg=59174.05, stdev=57063.97 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2278], 10.00th=[ 5932], 20.00th=[ 11207], | 30.00th=[ 17433], 40.00th=[ 27395], 50.00th=[ 44827], 60.00th=[ 58459], | 70.00th=[ 73925], 80.00th=[ 99091], 90.00th=[135267], 95.00th=[168821], | 99.00th=[270533], 99.50th=[274727], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 30, max= 301, per=27.29%, avg=123.08, stdev=55.21, samples=98 iops : min= 1, max= 18, avg= 6.97, stdev= 3.51, samples=98 lat (usec) : 50=0.26%, 100=4.17%, 250=0.39%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.69%, 4=2.60%, 10=5.73%, 20=8.07%, 50=19.66% lat (msec) : 100=34.90%, 250=20.96%, 500=1.30% cpu : usr=0.04%, sys=4.23%, ctx=1706, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=429KiB/s (440kB/s), 106KiB/s-119KiB/s (109kB/s-122kB/s), io=23.4MiB (24.5MB), run=51690-55797msec WRITE: bw=452KiB/s (462kB/s), 114KiB/s-125KiB/s (117kB/s-128kB/s), io=24.6MiB (25.8MB), run=51690-55797msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178557: Thu Jul 30 05:04:02 2026 read: IOPS=5, BW=85.6KiB/s (87.6kB/s)(5920KiB/69195msec) clat (msec): min=10, max=388, avg=75.25, stdev=65.99 lat (msec): min=10, max=388, avg=75.25, stdev=65.99 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 39], 50.00th=[ 51], 60.00th=[ 63], | 70.00th=[ 81], 80.00th=[ 123], 90.00th=[ 159], 95.00th=[ 220], | 99.00th=[ 334], 99.50th=[ 368], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 30, max= 346, per=26.56%, avg=91.11, stdev=66.66, samples=125 iops : min= 1, max= 21, avg= 4.89, stdev= 4.25, samples=125 write: IOPS=5, BW=92.0KiB/s (94.2kB/s)(6368KiB/69195msec); 0 zone resets clat (msec): min=19, max=498, avg=103.47, stdev=76.18 lat (msec): min=19, max=498, avg=103.48, stdev=76.18 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 45], | 30.00th=[ 54], 40.00th=[ 64], 50.00th=[ 77], 60.00th=[ 100], | 70.00th=[ 121], 80.00th=[ 159], 90.00th=[ 207], 95.00th=[ 253], | 99.00th=[ 376], 99.50th=[ 393], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 27, max= 318, per=25.88%, avg=93.43, stdev=62.60, samples=132 iops : min= 1, max= 19, avg= 5.02, stdev= 3.95, samples=132 lat (msec) : 20=2.73%, 50=34.51%, 100=30.47%, 250=28.26%, 500=4.04% cpu : usr=0.03%, sys=1.58%, ctx=1284, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178558: Thu Jul 30 05:04:02 2026 read: IOPS=5, BW=82.5KiB/s (84.4kB/s)(5744KiB/69658msec) clat (msec): min=7, max=607, avg=75.97, stdev=75.22 lat (msec): min=7, max=607, avg=75.97, stdev=75.23 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 77], 80.00th=[ 105], 90.00th=[ 171], 95.00th=[ 232], | 99.00th=[ 388], 99.50th=[ 485], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 27, max= 352, per=25.53%, avg=87.58, stdev=65.33, samples=126 iops : min= 1, max= 22, avg= 4.64, stdev= 4.14, samples=126 write: IOPS=5, BW=93.9KiB/s (96.2kB/s)(6544KiB/69658msec); 0 zone resets clat (msec): min=12, max=391, avg=103.33, stdev=67.12 lat (msec): min=12, max=391, avg=103.34, stdev=67.12 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 29], 10.00th=[ 37], 20.00th=[ 49], | 30.00th=[ 59], 40.00th=[ 71], 50.00th=[ 84], 60.00th=[ 97], | 70.00th=[ 125], 80.00th=[ 155], 90.00th=[ 205], 95.00th=[ 236], | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 29, max= 318, per=26.59%, avg=95.98, stdev=56.92, samples=130 iops : min= 1, max= 19, avg= 5.18, stdev= 3.60, samples=130 lat (msec) : 10=0.13%, 20=5.47%, 50=29.17%, 100=35.16%, 250=26.17% lat (msec) : 500=3.78%, 750=0.13% cpu : usr=0.03%, sys=1.39%, ctx=1203, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178559: Thu Jul 30 05:04:02 2026 read: IOPS=5, BW=89.8KiB/s (91.0kB/s)(6256KiB/69639msec) clat (msec): min=4, max=467, avg=78.11, stdev=74.13 lat (msec): min=4, max=467, avg=78.12, stdev=74.14 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 34], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 67], | 70.00th=[ 81], 80.00th=[ 112], 90.00th=[ 180], 95.00th=[ 234], | 99.00th=[ 380], 99.50th=[ 430], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 29, max= 311, per=27.27%, avg=93.55, stdev=65.83, samples=129 iops : min= 1, max= 19, avg= 5.03, stdev= 4.17, samples=129 write: IOPS=5, BW=86.6KiB/s (88.7kB/s)(6032KiB/69639msec); 0 zone resets clat (msec): min=12, max=459, avg=103.36, stdev=78.78 lat (msec): min=12, max=459, avg=103.37, stdev=78.78 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 44], | 30.00th=[ 55], 40.00th=[ 65], 50.00th=[ 78], 60.00th=[ 96], | 70.00th=[ 117], 80.00th=[ 155], 90.00th=[ 213], 95.00th=[ 292], | 99.00th=[ 393], 99.50th=[ 422], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 30, max= 318, per=24.78%, avg=89.45, stdev=60.31, samples=128 iops : min= 1, max= 19, avg= 4.77, stdev= 3.82, samples=128 lat (msec) : 10=0.65%, 20=5.08%, 50=31.77%, 100=32.29%, 250=25.52% lat (msec) : 500=4.69% cpu : usr=0.04%, sys=1.37%, ctx=1213, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178560: Thu Jul 30 05:04:02 2026 read: IOPS=5, BW=86.6KiB/s (88.7kB/s)(6032KiB/69640msec) clat (msec): min=6, max=465, avg=78.51, stdev=70.42 lat (msec): min=6, max=465, avg=78.51, stdev=70.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 68], | 70.00th=[ 90], 80.00th=[ 123], 90.00th=[ 169], 95.00th=[ 239], | 99.00th=[ 321], 99.50th=[ 376], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 319, per=26.69%, avg=91.56, stdev=64.44, samples=126 iops : min= 1, max= 19, avg= 4.90, stdev= 4.07, samples=126 write: IOPS=5, BW=89.8KiB/s (91.0kB/s)(6256KiB/69640msec); 0 zone resets clat (msec): min=16, max=486, avg=101.82, stdev=75.18 lat (msec): min=16, max=486, avg=101.84, stdev=75.18 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 35], 20.00th=[ 44], | 30.00th=[ 54], 40.00th=[ 66], 50.00th=[ 78], 60.00th=[ 94], | 70.00th=[ 122], 80.00th=[ 150], 90.00th=[ 201], 95.00th=[ 249], | 99.00th=[ 384], 99.50th=[ 468], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 26, max= 382, per=25.72%, avg=92.84, stdev=62.97, samples=129 iops : min= 1, max= 23, avg= 4.98, stdev= 3.99, samples=129 lat (msec) : 10=0.91%, 20=5.47%, 50=31.25%, 100=31.12%, 250=26.95% lat (msec) : 500=4.30% cpu : usr=0.03%, sys=1.43%, ctx=1212, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=344KiB/s (352kB/s), 82.5KiB/s-89.8KiB/s (84.4kB/s-91.0kB/s), io=23.4MiB (24.5MB), run=69195-69658msec WRITE: bw=362KiB/s (370kB/s), 86.6KiB/s-93.9KiB/s (88.7kB/s-96.2kB/s), io=24.6MiB (25.8MB), run=69195-69658msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178582: Thu Jul 30 05:04:16 2026 read: IOPS=1, BW=1918KiB/s (1964kB/s)(7168KiB/3737msec) clat (usec): min=602, max=381701, avg=239540.71, stdev=120616.68 lat (usec): min=603, max=381702, avg=239542.11, stdev=120616.57 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[185598], | 30.00th=[248513], 40.00th=[248513], 50.00th=[278922], 60.00th=[291505], | 70.00th=[291505], 80.00th=[291505], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 1935, max= 4055, per=66.32%, avg=2991.50, stdev=1200.55, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1370KiB/s (1403kB/s)(5120KiB/3737msec); 0 zone resets clat (msec): min=273, max=652, avg=411.50, stdev=147.44 lat (msec): min=273, max=653, avg=411.82, stdev=147.88 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1695, max= 2015, per=30.35%, avg=1916.75, stdev=149.03, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=66.67%, 750=8.33% cpu : usr=0.00%, sys=11.78%, ctx=194, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178583: Thu Jul 30 05:04:16 2026 read: IOPS=0, BW=451KiB/s (462kB/s)(2048KiB/4540msec) clat (msec): min=360, max=818, avg=589.08, stdev=323.80 lat (msec): min=360, max=818, avg=589.08, stdev=323.80 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2015, max= 2027, per=44.80%, avg=2021.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2256KiB/s (2310kB/s)(10.0MiB/4540msec); 0 zone resets clat (msec): min=160, max=715, avg=334.42, stdev=173.33 lat (msec): min=160, max=715, avg=335.75, stdev=173.61 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 178], | 30.00th=[ 180], 40.00th=[ 211], 50.00th=[ 321], 60.00th=[ 347], | 70.00th=[ 355], 80.00th=[ 376], 90.00th=[ 502], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1988, max= 5873, per=48.36%, avg=3053.80, stdev=1686.72, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=11.30%, ctx=223, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178584: Thu Jul 30 05:04:16 2026 read: IOPS=2, BW=2060KiB/s (2110kB/s)(6144KiB/2982msec) clat (usec): min=399, max=231360, avg=84727.04, stdev=112798.13 lat (usec): min=399, max=231361, avg=84728.26, stdev=112798.16 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 2868], 50.00th=[ 2868], 60.00th=[ 47449], | 70.00th=[225444], 80.00th=[225444], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 2003, max= 5086, per=78.57%, avg=3544.50, stdev=2180.01, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2060KiB/s (2110kB/s)(6144KiB/2982msec); 0 zone resets clat (msec): min=171, max=1319, avg=411.26, stdev=446.17 lat (msec): min=172, max=1319, avg=411.55, stdev=446.03 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 249], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2003, max= 3750, per=48.26%, avg=3047.67, stdev=922.44, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 50=8.33%, 250=50.00%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.39%, ctx=90, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178585: Thu Jul 30 05:04:16 2026 read: IOPS=1, BW=1141KiB/s (1169kB/s)(5120KiB/4486msec) clat (usec): min=483, max=303976, avg=141031.08, stdev=131624.17 lat (usec): min=485, max=303977, avg=141032.69, stdev=131624.03 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 10683], 40.00th=[ 10683], 50.00th=[185598], 60.00th=[185598], | 70.00th=[204473], 80.00th=[204473], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 3938, max= 4031, per=88.33%, avg=3984.50, stdev=65.76, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1598KiB/s (1636kB/s)(7168KiB/4486msec); 0 zone resets clat (msec): min=183, max=1138, avg=539.42, stdev=325.89 lat (msec): min=184, max=1138, avg=539.97, stdev=325.60 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 321], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 456], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 760], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1695, max= 3915, per=35.88%, avg=2265.60, stdev=933.96, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 20=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=7.60%, ctx=113, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4511KiB/s (4619kB/s), 451KiB/s-2060KiB/s (462kB/s-2110kB/s), io=20.0MiB (20.0MB), run=2982-4540msec WRITE: bw=6315KiB/s (6467kB/s), 1370KiB/s-2256KiB/s (1403kB/s-2310kB/s), io=28.0MiB (29.4MB), run=2982-4540msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178577: Thu Jul 30 05:04:17 2026 read: IOPS=1, BW=1834KiB/s (1878kB/s)(7168KiB/3908msec) clat (msec): min=138, max=511, avg=233.19, stdev=133.43 lat (msec): min=138, max=511, avg=233.19, stdev=133.43 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 142], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 197], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 288], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2035, max= 5287, per=100.00%, avg=3803.00, stdev=1644.50, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1310KiB/s (1342kB/s)(5120KiB/3908msec); 0 zone resets clat (msec): min=174, max=650, avg=439.19, stdev=214.15 lat (msec): min=174, max=650, avg=439.29, stdev=214.15 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1841, max= 4079, per=52.17%, avg=2645.00, stdev=1244.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=3.46%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178578: Thu Jul 30 05:04:17 2026 read: IOPS=0, BW=430KiB/s (440kB/s)(2048KiB/4763msec) clat (msec): min=132, max=217, avg=175.03, stdev=60.48 lat (msec): min=132, max=217, avg=175.03, stdev=60.48 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 1703, max= 2039, per=51.67%, avg=1871.00, stdev=237.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2150KiB/s (2202kB/s)(10.0MiB/4763msec); 0 zone resets clat (msec): min=153, max=1009, avg=438.74, stdev=275.25 lat (msec): min=153, max=1010, avg=438.99, stdev=275.34 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 194], | 30.00th=[ 197], 40.00th=[ 255], 50.00th=[ 393], 60.00th=[ 405], | 70.00th=[ 451], 80.00th=[ 584], 90.00th=[ 751], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1841, max= 4023, per=48.93%, avg=2480.57, stdev=864.50, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.30%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178579: Thu Jul 30 05:04:17 2026 read: IOPS=1, BW=1425KiB/s (1459kB/s)(6144KiB/4312msec) clat (msec): min=103, max=850, avg=299.47, stdev=290.09 lat (msec): min=103, max=850, avg=299.47, stdev=290.09 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 203], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1812, max= 4071, per=67.14%, avg=2431.00, stdev=1096.45, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1425KiB/s (1459kB/s)(6144KiB/4312msec); 0 zone resets clat (msec): min=146, max=1136, avg=403.58, stdev=372.14 lat (msec): min=146, max=1136, avg=403.67, stdev=372.14 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 296], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1812, max= 4000, per=54.65%, avg=2770.75, stdev=1114.94, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.99%, ctx=116, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178580: Thu Jul 30 05:04:17 2026 read: IOPS=0, BW=905KiB/s (927kB/s)(5120KiB/5655msec) clat (msec): min=122, max=1118, avg=450.33, stdev=431.16 lat (msec): min=122, max=1118, avg=450.33, stdev=431.16 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1841, max= 4000, per=72.54%, avg=2626.67, stdev=1193.45, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1268KiB/s (1298kB/s)(7168KiB/5655msec); 0 zone resets clat (msec): min=246, max=677, avg=480.07, stdev=165.04 lat (msec): min=247, max=677, avg=480.16, stdev=165.02 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 288], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 518], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 617], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1759, max= 2043, per=38.38%, avg=1945.83, stdev=125.89, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=16.67%, 750=41.67%, 2000=8.33% cpu : usr=0.00%, sys=3.94%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3622KiB/s (3708kB/s), 430KiB/s-1834KiB/s (440kB/s-1878kB/s), io=20.0MiB (20.0MB), run=3908-5655msec WRITE: bw=5070KiB/s (5192kB/s), 1268KiB/s-2150KiB/s (1298kB/s-2202kB/s), io=28.0MiB (29.4MB), run=3908-5655msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178596: Thu Jul 30 05:04:35 2026 read: IOPS=0, BW=3437KiB/s (3520kB/s)(12.0MiB/3575msec) clat (msec): min=467, max=1623, avg=1111.17, stdev=589.03 lat (msec): min=467, max=1623, avg=1111.17, stdev=589.03 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8094, max= 8110, per=100.00%, avg=8102.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.66%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178598: Thu Jul 30 05:04:35 2026 read: IOPS=0, BW=1066KiB/s (1092kB/s)(4096KiB/3841msec) clat (nsec): min=1424.4M, max=1424.4M, avg=1424436311.00, stdev= 0.00 lat (nsec): min=1424.4M, max=1424.4M, avg=1424440143.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1418], 5.00th=[ 1418], 10.00th=[ 1418], 20.00th=[ 1418], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2133KiB/s (2184kB/s)(8192KiB/3841msec); 0 zone resets clat (msec): min=697, max=1430, avg=1063.88, stdev=518.17 lat (msec): min=697, max=1430, avg=1064.28, stdev=518.48 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8094, max= 8094, per=94.88%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.62%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178599: Thu Jul 30 05:04:35 2026 write: IOPS=0, BW=3738KiB/s (3828kB/s)(12.0MiB/3287msec); 0 zone resets clat (msec): min=504, max=1447, avg=1063.43, stdev=495.28 lat (msec): min=504, max=1448, avg=1063.76, stdev=495.28 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8094, max= 8126, per=95.07%, avg=8110.00, stdev=16.00, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.56%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178600: Thu Jul 30 05:04:35 2026 write: IOPS=1, BW=4128KiB/s (4227kB/s)(12.0MiB/2977msec); 0 zone resets clat (msec): min=742, max=1302, avg=958.43, stdev=301.51 lat (msec): min=743, max=1303, avg=960.42, stdev=300.40 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8110, max= 8159, per=95.35%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.14%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4266KiB/s (4368kB/s), 1066KiB/s-3437KiB/s (1092kB/s-3520kB/s), io=16.0MiB (16.8MB), run=3575-3841msec WRITE: bw=8531KiB/s (8736kB/s), 2133KiB/s-4128KiB/s (2184kB/s-4227kB/s), io=32.0MiB (33.6MB), run=2977-3841msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178593: Thu Jul 30 05:04:36 2026 read: IOPS=1, BW=4651KiB/s (4763kB/s)(12.0MiB/2642msec) clat (msec): min=778, max=895, avg=833.53, stdev=58.80 lat (msec): min=778, max=895, avg=833.54, stdev=58.80 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.01%, ctx=225, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178594: Thu Jul 30 05:04:36 2026 read: IOPS=0, BW=1421KiB/s (1455kB/s)(4096KiB/2882msec) clat (nsec): min=763915k, max=763915k, avg=763915378.00, stdev= 0.00 lat (nsec): min=763917k, max=763917k, avg=763917095.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2842KiB/s (2911kB/s)(8192KiB/2882msec); 0 zone resets clat (msec): min=852, max=1178, avg=1015.16, stdev=230.29 lat (msec): min=852, max=1179, avg=1015.89, stdev=230.91 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.71%, ctx=136, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178595: Thu Jul 30 05:04:36 2026 write: IOPS=0, BW=2892KiB/s (2961kB/s)(12.0MiB/4249msec); 0 zone resets clat (msec): min=471, max=2134, avg=1324.26, stdev=832.11 lat (msec): min=471, max=2135, avg=1324.68, stdev=832.34 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.39%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178597: Thu Jul 30 05:04:36 2026 write: IOPS=1, BW=4246KiB/s (4348kB/s)(12.0MiB/2894msec); 0 zone resets clat (msec): min=317, max=1616, avg=877.81, stdev=667.24 lat (msec): min=318, max=1616, avg=878.55, stdev=667.09 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 5809, max= 8175, per=90.68%, avg=6992.00, stdev=1673.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.39%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5685KiB/s (5821kB/s), 1421KiB/s-4651KiB/s (1455kB/s-4763kB/s), io=16.0MiB (16.8MB), run=2642-2882msec WRITE: bw=7712KiB/s (7897kB/s), 2842KiB/s-4246KiB/s (2911kB/s-4348kB/s), io=32.0MiB (33.6MB), run=2882-4249msec