== sanity test 398b: DIO and buffer IO race ============== 12:14:01 (1777565641) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.48731 s, 20.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158278: Thu Apr 30 12:15:11 2026 read: IOPS=24, BW=96.0KiB/s (99.3kB/s)(5992KiB/61775msec) clat (usec): min=31, max=572501, avg=20721.07, stdev=19395.94 lat (usec): min=32, max=572501, avg=20724.88, stdev=19398.19 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 239], 10.00th=[ 7635], 20.00th=[ 10421], | 30.00th=[ 13042], 40.00th=[ 15401], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 25822], 80.00th=[ 30016], 90.00th=[ 35914], 95.00th=[ 41157], | 99.00th=[ 60031], 99.50th=[ 76022], 99.90th=[212861], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 13, max= 199, per=24.59%, avg=95.43, stdev=30.24, samples=122 iops : min= 3, max= 49, avg=23.40, stdev= 7.61, samples=122 write: IOPS=25, BW=102KiB/s (104kB/s)(6296KiB/61775msec); 0 zone resets clat (usec): min=744, max=137337, avg=19410.39, stdev=15675.60 lat (usec): min=744, max=137338, avg=19411.13, stdev=15675.61 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 2311], 10.00th=[ 3261], 20.00th=[ 5211], | 30.00th=[ 7570], 40.00th=[ 12256], 50.00th=[ 16319], 60.00th=[ 20055], | 70.00th=[ 25035], 80.00th=[ 31327], 90.00th=[ 40633], 95.00th=[ 47449], | 99.00th=[ 69731], 99.50th=[ 74974], 99.90th=[102237], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 32, max= 207, per=24.89%, avg=101.07, stdev=30.59, samples=121 iops : min= 8, max= 51, avg=24.81, stdev= 7.69, samples=121 lat (usec) : 50=0.16%, 100=0.78%, 250=1.53%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.85% lat (msec) : 2=1.14%, 4=4.95%, 10=17.25%, 20=31.45%, 50=38.61% lat (msec) : 100=2.96%, 250=0.10%, 750=0.03% cpu : usr=0.07%, sys=27.56%, ctx=9251, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158279: Thu Apr 30 12:15:11 2026 read: IOPS=24, BW=96.6KiB/s (98.9kB/s)(5940KiB/61517msec) clat (usec): min=28, max=128280, avg=20865.41, stdev=12989.27 lat (usec): min=29, max=128281, avg=20866.03, stdev=12989.27 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 260], 10.00th=[ 7832], 20.00th=[ 10814], | 30.00th=[ 13304], 40.00th=[ 15926], 50.00th=[ 18744], 60.00th=[ 21890], | 70.00th=[ 25822], 80.00th=[ 30802], 90.00th=[ 36963], 95.00th=[ 41157], | 99.00th=[ 60556], 99.50th=[ 71828], 99.90th=[111674], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 6, max= 184, per=24.78%, avg=96.14, stdev=29.81, samples=122 iops : min= 1, max= 46, avg=23.58, stdev= 7.50, samples=122 write: IOPS=25, BW=103KiB/s (106kB/s)(6348KiB/61517msec); 0 zone resets clat (usec): min=750, max=573482, avg=19127.43, stdev=21071.45 lat (usec): min=750, max=573483, avg=19128.15, stdev=21071.47 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 2311], 10.00th=[ 3163], 20.00th=[ 4948], | 30.00th=[ 7308], 40.00th=[ 11600], 50.00th=[ 15270], 60.00th=[ 19530], | 70.00th=[ 23462], 80.00th=[ 29754], 90.00th=[ 40109], 95.00th=[ 49546], | 99.00th=[ 72877], 99.50th=[ 80217], 99.90th=[115868], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 6, max= 223, per=25.28%, avg=102.64, stdev=35.61, samples=122 iops : min= 1, max= 55, avg=25.20, stdev= 8.97, samples=122 lat (usec) : 50=0.33%, 100=0.49%, 250=1.53%, 500=0.26%, 750=0.03% lat (usec) : 1000=0.81% lat (msec) : 2=0.98%, 4=6.18%, 10=16.76%, 20=30.40%, 50=38.54% lat (msec) : 100=3.48%, 250=0.16%, 750=0.03% cpu : usr=0.06%, sys=27.66%, ctx=9270, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158280: Thu Apr 30 12:15:11 2026 read: IOPS=24, BW=97.6KiB/s (99.0kB/s)(6028KiB/61752msec) clat (usec): min=50, max=104449, avg=20284.64, stdev=12039.09 lat (usec): min=50, max=104449, avg=20285.47, stdev=12039.10 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 196], 10.00th=[ 7832], 20.00th=[ 10945], | 30.00th=[ 13566], 40.00th=[ 15664], 50.00th=[ 18482], 60.00th=[ 21365], | 70.00th=[ 25297], 80.00th=[ 29492], 90.00th=[ 35390], 95.00th=[ 39584], | 99.00th=[ 54789], 99.50th=[ 65799], 99.90th=[ 96994], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 39, max= 191, per=25.04%, avg=97.16, stdev=31.42, samples=121 iops : min= 9, max= 47, avg=23.83, stdev= 7.88, samples=121 write: IOPS=25, BW=101KiB/s (104kB/s)(6260KiB/61752msec); 0 zone resets clat (usec): min=764, max=603993, avg=19804.07, stdev=21845.05 lat (usec): min=764, max=603994, avg=19804.95, stdev=21845.04 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 2573], 10.00th=[ 3425], 20.00th=[ 5407], | 30.00th=[ 8029], 40.00th=[ 12125], 50.00th=[ 16319], 60.00th=[ 20317], | 70.00th=[ 24511], 80.00th=[ 31327], 90.00th=[ 40109], 95.00th=[ 47973], | 99.00th=[ 68682], 99.50th=[ 86508], 99.90th=[202376], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 39, max= 199, per=24.83%, avg=100.79, stdev=31.09, samples=121 iops : min= 9, max= 49, avg=24.74, stdev= 7.76, samples=121 lat (usec) : 100=0.52%, 250=2.15%, 500=0.20%, 1000=0.78% lat (msec) : 2=0.85%, 4=4.79%, 10=16.89%, 20=31.51%, 50=39.36% lat (msec) : 100=2.80%, 250=0.13%, 750=0.03% cpu : usr=0.07%, sys=27.77%, ctx=9158, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158281: Thu Apr 30 12:15:11 2026 read: IOPS=24, BW=98.9KiB/s (101kB/s)(6052KiB/61214msec) clat (usec): min=33, max=125343, avg=20309.42, stdev=12680.47 lat (usec): min=33, max=125344, avg=20310.10, stdev=12680.48 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 269], 10.00th=[ 7963], 20.00th=[ 10552], | 30.00th=[ 13042], 40.00th=[ 15401], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 24773], 80.00th=[ 29754], 90.00th=[ 35914], 95.00th=[ 41157], | 99.00th=[ 58983], 99.50th=[ 69731], 99.90th=[117965], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 31, max= 191, per=25.48%, avg=98.86, stdev=29.74, samples=120 iops : min= 7, max= 47, avg=24.26, stdev= 7.50, samples=120 write: IOPS=25, BW=102KiB/s (104kB/s)(6236KiB/61214msec); 0 zone resets clat (usec): min=770, max=579671, avg=19422.23, stdev=21302.12 lat (usec): min=771, max=579672, avg=19422.99, stdev=21302.12 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 2245], 10.00th=[ 3228], 20.00th=[ 5211], | 30.00th=[ 7701], 40.00th=[ 12125], 50.00th=[ 15795], 60.00th=[ 19530], | 70.00th=[ 24511], 80.00th=[ 30540], 90.00th=[ 39584], 95.00th=[ 47449], | 99.00th=[ 70779], 99.50th=[ 90702], 99.90th=[143655], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 13, max= 184, per=24.93%, avg=101.23, stdev=32.20, samples=121 iops : min= 3, max= 46, avg=24.86, stdev= 8.08, samples=121 lat (usec) : 50=0.13%, 100=0.59%, 250=1.63%, 500=0.29%, 1000=0.78% lat (msec) : 2=1.33%, 4=5.47%, 10=16.18%, 20=32.91%, 50=37.73% lat (msec) : 100=2.73%, 250=0.20%, 750=0.03% cpu : usr=0.05%, sys=27.93%, ctx=9072, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=389KiB/s (398kB/s), 96.6KiB/s-98.9KiB/s (98.9kB/s-101kB/s), io=23.4MiB (24.6MB), run=61214-61775msec WRITE: bw=407KiB/s (417kB/s), 101KiB/s-103KiB/s (104kB/s-106kB/s), io=24.6MiB (25.7MB), run=61214-61775msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158282: Thu Apr 30 12:15:33 2026 read: IOPS=17, BW=70.0KiB/s (72.7kB/s)(5992KiB/84442msec) clat (msec): min=2, max=583, avg=17.15, stdev=22.57 lat (msec): min=2, max=583, avg=17.16, stdev=22.57 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 83], 99.50th=[ 102], 99.90th=[ 148], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 16, max= 216, per=25.33%, avg=71.69, stdev=47.21, samples=166 iops : min= 4, max= 54, avg=17.63, stdev=11.93, samples=166 write: IOPS=18, BW=74.6KiB/s (76.3kB/s)(6296KiB/84442msec); 0 zone resets clat (msec): min=12, max=214, avg=37.22, stdev=22.06 lat (msec): min=12, max=214, avg=37.22, stdev=22.06 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 68], 95.00th=[ 80], | 99.00th=[ 113], 99.50th=[ 136], 99.90th=[ 186], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 15, max= 176, per=25.27%, avg=74.81, stdev=44.17, samples=167 iops : min= 3, max= 44, avg=18.40, stdev=11.22, samples=167 lat (msec) : 4=6.05%, 10=17.74%, 20=20.83%, 50=40.98%, 100=13.28% lat (msec) : 250=1.07%, 750=0.03% cpu : usr=0.07%, sys=9.69%, ctx=6294, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158283: Thu Apr 30 12:15:33 2026 read: IOPS=17, BW=70.3KiB/s (71.0kB/s)(5940KiB/84532msec) clat (msec): min=2, max=579, avg=17.69, stdev=22.86 lat (msec): min=2, max=579, avg=17.69, stdev=22.86 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 41], 95.00th=[ 53], | 99.00th=[ 84], 99.50th=[ 102], 99.90th=[ 142], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 232, per=24.94%, avg=70.59, stdev=47.57, samples=167 iops : min= 1, max= 58, avg=17.35, stdev=12.04, samples=167 write: IOPS=18, BW=75.1KiB/s (76.9kB/s)(6348KiB/84532msec); 0 zone resets clat (msec): min=12, max=214, avg=36.60, stdev=21.05 lat (msec): min=12, max=214, avg=36.60, stdev=21.05 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 66], 95.00th=[ 77], | 99.00th=[ 108], 99.50th=[ 130], 99.90th=[ 186], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 16, max= 168, per=25.42%, avg=75.24, stdev=43.22, samples=167 iops : min= 4, max= 42, avg=18.51, stdev=10.98, samples=167 lat (msec) : 4=5.89%, 10=17.71%, 20=18.68%, 50=44.17%, 100=12.57% lat (msec) : 250=0.94%, 750=0.03% cpu : usr=0.09%, sys=9.81%, ctx=6382, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158284: Thu Apr 30 12:15:33 2026 read: IOPS=17, BW=71.1KiB/s (72.8kB/s)(6028KiB/84731msec) clat (msec): min=2, max=141, avg=17.48, stdev=17.56 lat (msec): min=2, max=141, avg=17.48, stdev=17.56 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 41], 95.00th=[ 54], | 99.00th=[ 80], 99.50th=[ 95], 99.90th=[ 138], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 7, max= 240, per=25.10%, avg=71.02, stdev=46.23, samples=167 iops : min= 1, max= 60, avg=17.46, stdev=11.70, samples=167 write: IOPS=18, BW=73.9KiB/s (75.7kB/s)(6260KiB/84731msec); 0 zone resets clat (msec): min=10, max=602, avg=37.21, stdev=26.05 lat (msec): min=10, max=602, avg=37.21, stdev=26.05 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 67], 95.00th=[ 82], | 99.00th=[ 113], 99.50th=[ 134], 99.90th=[ 186], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 23, max= 176, per=24.87%, avg=73.61, stdev=43.78, samples=167 iops : min= 5, max= 44, avg=18.10, stdev=11.12, samples=167 lat (msec) : 4=5.70%, 10=18.03%, 20=19.82%, 50=42.45%, 100=12.89% lat (msec) : 250=1.07%, 750=0.03% cpu : usr=0.06%, sys=9.63%, ctx=6327, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158285: Thu Apr 30 12:15:33 2026 read: IOPS=17, BW=71.6KiB/s (73.3kB/s)(6052KiB/84520msec) clat (msec): min=2, max=175, avg=16.99, stdev=17.73 lat (msec): min=2, max=175, avg=16.99, stdev=17.73 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 86], 99.50th=[ 109], 99.90th=[ 140], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 7, max= 232, per=25.38%, avg=71.84, stdev=47.40, samples=167 iops : min= 1, max= 58, avg=17.66, stdev=12.00, samples=167 write: IOPS=18, BW=73.8KiB/s (75.6kB/s)(6236KiB/84520msec); 0 zone resets clat (msec): min=12, max=594, avg=37.62, stdev=25.66 lat (msec): min=12, max=594, avg=37.63, stdev=25.66 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 68], 95.00th=[ 79], | 99.00th=[ 103], 99.50th=[ 138], 99.90th=[ 184], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 23, max= 168, per=24.98%, avg=73.95, stdev=43.23, samples=167 iops : min= 5, max= 42, avg=18.19, stdev=10.98, samples=167 lat (msec) : 4=5.66%, 10=18.49%, 20=19.86%, 50=41.73%, 100=13.28% lat (msec) : 250=0.94%, 750=0.03% cpu : usr=0.07%, sys=9.63%, ctx=6161, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=283KiB/s (290kB/s), 70.3KiB/s-71.6KiB/s (71.0kB/s-73.3kB/s), io=23.4MiB (24.6MB), run=84442-84731msec WRITE: bw=297KiB/s (304kB/s), 73.8KiB/s-75.1KiB/s (75.6kB/s-76.9kB/s), io=24.6MiB (25.7MB), run=84442-84731msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158320: Thu Apr 30 12:15:50 2026 read: IOPS=33, BW=540KiB/s (553kB/s)(5920KiB/10967msec) clat (usec): min=34, max=84931, avg=14465.36, stdev=10063.56 lat (usec): min=35, max=84931, avg=14469.74, stdev=10063.63 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 108], 10.00th=[ 122], 20.00th=[ 8586], | 30.00th=[10290], 40.00th=[11600], 50.00th=[13698], 60.00th=[15795], | 70.00th=[17957], 80.00th=[20579], 90.00th=[24249], 95.00th=[28967], | 99.00th=[52691], 99.50th=[72877], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 360, max= 800, per=24.99%, avg=535.24, stdev=118.79, samples=21 iops : min= 22, max= 50, avg=32.90, stdev= 7.54, samples=21 write: IOPS=36, BW=581KiB/s (595kB/s)(6368KiB/10967msec); 0 zone resets clat (usec): min=1043, max=81443, avg=14035.95, stdev=10956.77 lat (usec): min=1044, max=81444, avg=14037.17, stdev=10956.82 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 3195], 10.00th=[ 3982], 20.00th=[ 4686], | 30.00th=[ 6063], 40.00th=[ 8029], 50.00th=[10945], 60.00th=[13435], | 70.00th=[17695], 80.00th=[23462], 90.00th=[30278], 95.00th=[34866], | 99.00th=[43779], 99.50th=[54789], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 256, max= 827, per=25.86%, avg=582.90, stdev=127.39, samples=21 iops : min= 16, max= 51, avg=35.90, stdev= 7.84, samples=21 lat (usec) : 50=0.26%, 100=1.30%, 250=4.56%, 500=0.26% lat (msec) : 2=1.43%, 4=4.04%, 10=25.78%, 20=38.67%, 50=22.92% lat (msec) : 100=0.78% cpu : usr=0.13%, sys=31.00%, ctx=2434, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158321: Thu Apr 30 12:15:50 2026 read: IOPS=32, BW=514KiB/s (526kB/s)(5744KiB/11180msec) clat (usec): min=30, max=114216, avg=15214.10, stdev=10785.08 lat (usec): min=30, max=114216, avg=15214.68, stdev=10785.08 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 104], 10.00th=[ 131], 20.00th=[ 8586], | 30.00th=[ 10552], 40.00th=[ 12125], 50.00th=[ 14222], 60.00th=[ 16057], | 70.00th=[ 18482], 80.00th=[ 21365], 90.00th=[ 28181], 95.00th=[ 30540], | 99.00th=[ 49546], 99.50th=[ 54789], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 231, max= 734, per=24.05%, avg=515.14, stdev=130.01, samples=22 iops : min= 14, max= 45, avg=31.64, stdev= 8.06, samples=22 write: IOPS=36, BW=585KiB/s (599kB/s)(6544KiB/11180msec); 0 zone resets clat (usec): min=967, max=117504, avg=13847.82, stdev=11298.98 lat (usec): min=968, max=117505, avg=13848.86, stdev=11298.98 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1991], 10.00th=[ 3949], 20.00th=[ 4948], | 30.00th=[ 6128], 40.00th=[ 8586], 50.00th=[ 11338], 60.00th=[ 14615], | 70.00th=[ 17171], 80.00th=[ 21365], 90.00th=[ 27395], 95.00th=[ 31327], | 99.00th=[ 52691], 99.50th=[ 56361], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 383, max= 958, per=25.98%, avg=585.50, stdev=142.20, samples=22 iops : min= 23, max= 59, avg=36.05, stdev= 8.86, samples=22 lat (usec) : 50=0.39%, 100=1.69%, 250=3.65%, 1000=0.13% lat (msec) : 2=2.60%, 4=2.73%, 10=25.91%, 20=38.02%, 50=23.70% lat (msec) : 100=0.91%, 250=0.26% cpu : usr=0.11%, sys=30.74%, ctx=2414, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158322: Thu Apr 30 12:15:50 2026 read: IOPS=35, BW=562KiB/s (575kB/s)(6256KiB/11133msec) clat (usec): min=27, max=69137, avg=15394.80, stdev=10050.36 lat (usec): min=27, max=69137, avg=15395.41, stdev=10050.35 clat percentiles (usec): | 1.00th=[ 36], 5.00th=[ 93], 10.00th=[ 128], 20.00th=[ 9110], | 30.00th=[10814], 40.00th=[12518], 50.00th=[14484], 60.00th=[16319], | 70.00th=[19530], 80.00th=[21890], 90.00th=[26346], 95.00th=[34341], | 99.00th=[46924], 99.50th=[54264], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 351, max= 795, per=26.18%, avg=560.86, stdev=119.03, samples=21 iops : min= 21, max= 49, avg=34.52, stdev= 7.40, samples=21 write: IOPS=33, BW=542KiB/s (555kB/s)(6032KiB/11133msec); 0 zone resets clat (usec): min=1063, max=89589, avg=13356.04, stdev=10390.78 lat (usec): min=1064, max=89591, avg=13357.58, stdev=10390.87 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 2966], 10.00th=[ 3982], 20.00th=[ 4883], | 30.00th=[ 5932], 40.00th=[ 8586], 50.00th=[11076], 60.00th=[13304], | 70.00th=[16581], 80.00th=[20317], 90.00th=[26346], 95.00th=[31327], | 99.00th=[49021], 99.50th=[57410], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 349, max= 766, per=23.29%, avg=524.95, stdev=99.37, samples=21 iops : min= 21, max= 47, avg=32.29, stdev= 6.23, samples=21 lat (usec) : 50=0.78%, 100=2.60%, 250=3.26%, 500=0.39% lat (msec) : 2=1.43%, 4=3.52%, 10=23.57%, 20=39.71%, 50=24.09% lat (msec) : 100=0.65% cpu : usr=0.13%, sys=31.01%, ctx=2470, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158323: Thu Apr 30 12:15:50 2026 read: IOPS=34, BW=560KiB/s (573kB/s)(6032KiB/10776msec) clat (usec): min=36, max=108726, avg=14579.08, stdev=10906.08 lat (usec): min=36, max=108727, avg=14579.67, stdev=10906.08 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 93], 10.00th=[ 115], 20.00th=[ 7963], | 30.00th=[ 10552], 40.00th=[ 11994], 50.00th=[ 14091], 60.00th=[ 16057], | 70.00th=[ 18482], 80.00th=[ 20579], 90.00th=[ 24511], 95.00th=[ 28443], | 99.00th=[ 49546], 99.50th=[ 73925], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 287, max= 704, per=26.06%, avg=558.29, stdev=100.72, samples=21 iops : min= 17, max= 44, avg=34.33, stdev= 6.37, samples=21 write: IOPS=36, BW=581KiB/s (594kB/s)(6256KiB/10776msec); 0 zone resets clat (usec): min=1033, max=102736, avg=13286.02, stdev=11667.07 lat (usec): min=1034, max=102738, avg=13287.01, stdev=11667.07 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2311], 10.00th=[ 3589], 20.00th=[ 4621], | 30.00th=[ 5276], 40.00th=[ 7504], 50.00th=[ 10028], 60.00th=[ 13566], | 70.00th=[ 15664], 80.00th=[ 20579], 90.00th=[ 27657], 95.00th=[ 30278], | 99.00th=[ 60031], 99.50th=[ 71828], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 383, max= 924, per=25.89%, avg=583.67, stdev=141.53, samples=21 iops : min= 23, max= 57, avg=35.95, stdev= 8.75, samples=21 lat (usec) : 50=0.39%, 100=3.26%, 250=4.04%, 500=0.26% lat (msec) : 2=2.34%, 4=5.08%, 10=23.31%, 20=39.97%, 50=20.05% lat (msec) : 100=1.04%, 250=0.26% cpu : usr=0.07%, sys=30.72%, ctx=2389, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2142KiB/s (2194kB/s), 514KiB/s-562KiB/s (526kB/s-575kB/s), io=23.4MiB (24.5MB), run=10776-11180msec WRITE: bw=2254KiB/s (2308kB/s), 542KiB/s-585KiB/s (555kB/s-599kB/s), io=24.6MiB (25.8MB), run=10776-11180msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158315: Thu Apr 30 12:15:58 2026 read: IOPS=19, BW=310KiB/s (317kB/s)(5920KiB/19123msec) clat (msec): min=3, max=119, avg=13.78, stdev=14.33 lat (msec): min=3, max=119, avg=13.78, stdev=14.33 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 10], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 44], | 99.00th=[ 59], 99.50th=[ 81], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 126, max= 640, per=23.92%, avg=299.49, stdev=140.22, samples=37 iops : min= 7, max= 40, avg=18.51, stdev= 8.85, samples=37 write: IOPS=20, BW=333KiB/s (341kB/s)(6368KiB/19123msec); 0 zone resets clat (msec): min=13, max=145, avg=35.14, stdev=16.90 lat (msec): min=13, max=145, avg=35.14, stdev=16.90 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 38], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 69], | 99.00th=[ 103], 99.50th=[ 110], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 63, max= 608, per=24.76%, avg=326.11, stdev=150.18, samples=37 iops : min= 3, max= 38, avg=20.16, stdev= 9.58, samples=37 lat (msec) : 4=4.56%, 10=24.61%, 20=14.19%, 50=47.66%, 100=8.33% lat (msec) : 250=0.65% cpu : usr=0.04%, sys=8.77%, ctx=1502, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158316: Thu Apr 30 12:15:58 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(5744KiB/19037msec) clat (usec): min=3252, max=86514, avg=13179.61, stdev=14687.16 lat (usec): min=3253, max=86515, avg=13180.22, stdev=14687.13 clat percentiles (usec): | 1.00th=[ 3359], 5.00th=[ 3752], 10.00th=[ 4146], 20.00th=[ 4752], | 30.00th=[ 5276], 40.00th=[ 5800], 50.00th=[ 6587], 60.00th=[ 8586], | 70.00th=[11338], 80.00th=[16909], 90.00th=[33162], 95.00th=[49546], | 99.00th=[72877], 99.50th=[81265], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 63, max= 768, per=24.74%, avg=309.78, stdev=169.16, samples=36 iops : min= 3, max= 48, avg=19.14, stdev=10.77, samples=36 write: IOPS=21, BW=344KiB/s (352kB/s)(6544KiB/19037msec); 0 zone resets clat (msec): min=14, max=144, avg=34.93, stdev=16.91 lat (msec): min=14, max=144, avg=34.93, stdev=16.91 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 33], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 59], 95.00th=[ 69], | 99.00th=[ 89], 99.50th=[ 107], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 127, max= 576, per=25.62%, avg=337.41, stdev=144.82, samples=37 iops : min= 7, max= 36, avg=20.86, stdev= 9.23, samples=37 lat (msec) : 4=3.39%, 10=27.08%, 20=11.98%, 50=47.79%, 100=9.38% lat (msec) : 250=0.39% cpu : usr=0.05%, sys=8.73%, ctx=1583, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158317: Thu Apr 30 12:15:58 2026 read: IOPS=21, BW=340KiB/s (348kB/s)(6256KiB/18413msec) clat (msec): min=3, max=119, avg=13.92, stdev=15.67 lat (msec): min=3, max=119, avg=13.92, stdev=15.67 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 10], | 70.00th=[ 14], 80.00th=[ 20], 90.00th=[ 32], 95.00th=[ 49], | 99.00th=[ 81], 99.50th=[ 99], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 63, max= 864, per=27.46%, avg=343.81, stdev=194.01, samples=36 iops : min= 3, max= 54, avg=21.28, stdev=12.29, samples=36 write: IOPS=20, BW=328KiB/s (335kB/s)(6032KiB/18413msec); 0 zone resets clat (msec): min=14, max=120, avg=34.32, stdev=15.65 lat (msec): min=14, max=120, avg=34.32, stdev=15.65 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 37], 80.00th=[ 42], 90.00th=[ 55], 95.00th=[ 68], | 99.00th=[ 110], 99.50th=[ 120], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 127, max= 608, per=24.67%, avg=324.86, stdev=137.84, samples=36 iops : min= 7, max= 38, avg=20.08, stdev= 8.78, samples=36 lat (msec) : 4=3.12%, 10=28.26%, 20=13.02%, 50=47.01%, 100=7.94% lat (msec) : 250=0.65% cpu : usr=0.05%, sys=9.25%, ctx=1521, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158318: Thu Apr 30 12:15:58 2026 read: IOPS=20, BW=321KiB/s (329kB/s)(6032KiB/18789msec) clat (msec): min=3, max=181, avg=13.32, stdev=14.96 lat (msec): min=3, max=181, avg=13.32, stdev=14.96 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 11], | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 29], 95.00th=[ 40], | 99.00th=[ 62], 99.50th=[ 115], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 127, max= 704, per=25.41%, avg=318.16, stdev=157.51, samples=37 iops : min= 7, max= 44, avg=19.68, stdev=10.00, samples=37 write: IOPS=20, BW=333KiB/s (341kB/s)(6256KiB/18789msec); 0 zone resets clat (msec): min=15, max=144, avg=35.09, stdev=16.90 lat (msec): min=15, max=144, avg=35.09, stdev=16.90 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 30], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 61], 95.00th=[ 71], | 99.00th=[ 90], 99.50th=[ 107], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 128, max= 672, per=25.18%, avg=331.68, stdev=147.38, samples=37 iops : min= 8, max= 42, avg=20.51, stdev= 9.39, samples=37 lat (msec) : 4=3.52%, 10=24.48%, 20=17.06%, 50=45.44%, 100=8.98% lat (msec) : 250=0.52% cpu : usr=0.09%, sys=8.92%, ctx=1536, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1253KiB/s (1283kB/s), 302KiB/s-340KiB/s (309kB/s-348kB/s), io=23.4MiB (24.5MB), run=18413-19123msec WRITE: bw=1318KiB/s (1349kB/s), 328KiB/s-344KiB/s (335kB/s-352kB/s), io=24.6MiB (25.8MB), run=18413-19123msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158339: Thu Apr 30 12:16:07 2026 read: IOPS=2, BW=2554KiB/s (2615kB/s)(7168KiB/2807msec) clat (msec): min=88, max=1038, avg=261.66, stdev=345.53 lat (msec): min=88, max=1038, avg=261.66, stdev=345.53 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 94], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 201], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 2035, max= 6144, per=64.34%, avg=3899.00, stdev=2080.83, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 write: IOPS=1, BW=1824KiB/s (1868kB/s)(5120KiB/2807msec); 0 zone resets clat (msec): min=90, max=326, avg=190.87, stdev=100.24 lat (msec): min=90, max=326, avg=190.93, stdev=100.22 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 2048, max= 6095, per=47.98%, avg=4071.50, stdev=2861.66, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 100=33.33%, 250=50.00%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=39.49%, ctx=1374, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158340: Thu Apr 30 12:16:07 2026 read: IOPS=0, BW=606KiB/s (621kB/s)(2048KiB/3379msec) clat (usec): min=475, max=81394, avg=40935.32, stdev=57218.62 lat (usec): min=476, max=81396, avg=40936.71, stdev=57219.11 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 478], 50.00th=[ 478], 60.00th=[81265], | 70.00th=[81265], 80.00th=[81265], 90.00th=[81265], 95.00th=[81265], | 99.00th=[81265], 99.50th=[81265], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 1726, max= 2035, per=31.03%, avg=1880.50, stdev=218.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3030KiB/s (3103kB/s)(10.0MiB/3379msec); 0 zone resets clat (msec): min=90, max=1474, avg=328.60, stdev=421.17 lat (msec): min=90, max=1475, avg=328.66, stdev=421.17 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 92], | 30.00th=[ 120], 40.00th=[ 125], 50.00th=[ 138], 60.00th=[ 178], | 70.00th=[ 236], 80.00th=[ 405], 90.00th=[ 430], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1726, max= 6144, per=47.04%, avg=3991.00, stdev=2440.51, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.63, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=29.78%, ctx=403, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158341: Thu Apr 30 12:16:07 2026 read: IOPS=2, BW=2279KiB/s (2334kB/s)(6144KiB/2696msec) clat (usec): min=383, max=178591, avg=80057.25, stdev=88729.62 lat (usec): min=384, max=178592, avg=80058.25, stdev=88729.44 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[130548], | 70.00th=[170918], 80.00th=[170918], 90.00th=[179307], 95.00th=[179307], | 99.00th=[179307], 99.50th=[179307], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 4063, max= 6107, per=83.91%, avg=5085.00, stdev=1445.33, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2279KiB/s (2334kB/s)(6144KiB/2696msec); 0 zone resets clat (msec): min=124, max=1219, avg=364.80, stdev=423.26 lat (msec): min=124, max=1219, avg=364.85, stdev=423.27 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 209], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 3453, max= 4071, per=45.52%, avg=3862.33, stdev=354.52, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=58.33%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=32.95%, ctx=232, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158342: Thu Apr 30 12:16:07 2026 read: IOPS=1, BW=1962KiB/s (2009kB/s)(5120KiB/2610msec) clat (usec): min=510, max=154419, avg=81882.68, stdev=75120.38 lat (usec): min=512, max=154421, avg=81883.65, stdev=75120.59 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[124257], 60.00th=[124257], | 70.00th=[129500], 80.00th=[129500], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2746KiB/s (2812kB/s)(7168KiB/2610msec); 0 zone resets clat (msec): min=74, max=1166, avg=312.85, stdev=379.66 lat (msec): min=74, max=1166, avg=312.90, stdev=379.65 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 153], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 199], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 222], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1756, max= 4096, per=35.22%, avg=2988.50, stdev=1269.41, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=66.67%, 2000=8.33% cpu : usr=0.04%, sys=32.73%, ctx=530, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6061KiB/s (6206kB/s), 606KiB/s-2554KiB/s (621kB/s-2615kB/s), io=20.0MiB (20.0MB), run=2610-3379msec WRITE: bw=8485KiB/s (8689kB/s), 1824KiB/s-3030KiB/s (1868kB/s-3103kB/s), io=28.0MiB (29.4MB), run=2610-3379msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158344: Thu Apr 30 12:16:07 2026 read: IOPS=2, BW=2324KiB/s (2379kB/s)(7168KiB/3085msec) clat (msec): min=38, max=1156, avg=275.81, stdev=408.87 lat (msec): min=38, max=1156, avg=275.81, stdev=408.87 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 47], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 57], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 388], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1892, max= 4079, per=39.21%, avg=2423.00, stdev=928.19, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 0.71, samples=5 write: IOPS=1, BW=1660KiB/s (1699kB/s)(5120KiB/3085msec); 0 zone resets clat (msec): min=91, max=381, avg=215.22, stdev=114.79 lat (msec): min=91, max=381, avg=215.29, stdev=114.78 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2039, max= 6144, per=39.42%, avg=3410.33, stdev=2367.43, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 lat (msec) : 50=16.67%, 100=25.00%, 250=25.00%, 500=25.00%, 2000=8.33% cpu : usr=0.06%, sys=13.98%, ctx=99, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158345: Thu Apr 30 12:16:07 2026 read: IOPS=0, BW=626KiB/s (641kB/s)(2048KiB/3270msec) clat (msec): min=100, max=160, avg=130.76, stdev=42.11 lat (msec): min=100, max=160, avg=130.76, stdev=42.11 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 102], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 1872, max= 2039, per=31.65%, avg=1955.50, stdev=118.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3131KiB/s (3207kB/s)(10.0MiB/3270msec); 0 zone resets clat (msec): min=55, max=1657, avg=286.24, stdev=488.57 lat (msec): min=55, max=1658, avg=286.30, stdev=488.56 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 67], | 30.00th=[ 88], 40.00th=[ 101], 50.00th=[ 127], 60.00th=[ 129], | 70.00th=[ 131], 80.00th=[ 171], 90.00th=[ 338], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 2039, max= 4096, per=40.39%, avg=3493.75, stdev=983.93, samples=4 iops : min= 1, max= 4, avg= 3.00, stdev= 1.41, samples=4 lat (msec) : 100=25.00%, 250=58.33%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=14.50%, ctx=439, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158347: Thu Apr 30 12:16:07 2026 read: IOPS=1, BW=2034KiB/s (2083kB/s)(6144KiB/3020msec) clat (msec): min=55, max=271, avg=105.44, stdev=82.80 lat (msec): min=55, max=271, avg=105.44, stdev=82.80 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 79], | 70.00th=[ 97], 80.00th=[ 97], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 2039, max= 4096, per=49.64%, avg=3067.50, stdev=1454.52, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 write: IOPS=1, BW=2034KiB/s (2083kB/s)(6144KiB/3020msec); 0 zone resets clat (msec): min=70, max=1421, avg=384.48, stdev=516.56 lat (msec): min=70, max=1421, avg=384.54, stdev=516.57 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 211], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 2039, max= 3778, per=30.30%, avg=2621.67, stdev=1001.42, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=50.00%, 250=25.00%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=10.24%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158348: Thu Apr 30 12:16:07 2026 read: IOPS=1, BW=1545KiB/s (1582kB/s)(5120KiB/3314msec) clat (msec): min=19, max=179, avg=69.45, stdev=63.09 lat (msec): min=19, max=179, avg=69.45, stdev=63.09 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 20], 10.00th=[ 20], 20.00th=[ 20], | 30.00th=[ 47], 40.00th=[ 47], 50.00th=[ 50], 60.00th=[ 50], | 70.00th=[ 52], 80.00th=[ 52], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2163KiB/s (2215kB/s)(7168KiB/3314msec); 0 zone resets clat (msec): min=70, max=1382, avg=392.25, stdev=470.34 lat (msec): min=70, max=1382, avg=392.31, stdev=470.34 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 86], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 182], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 558], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1790, max= 2048, per=22.90%, avg=1981.25, stdev=127.57, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 20=8.33%, 50=16.67%, 100=25.00%, 250=25.00%, 500=8.33% lat (msec) : 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=12.71%, ctx=114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6180KiB/s (6328kB/s), 626KiB/s-2324KiB/s (641kB/s-2379kB/s), io=20.0MiB (20.0MB), run=3020-3314msec WRITE: bw=8652KiB/s (8859kB/s), 1660KiB/s-3131KiB/s (1699kB/s-3207kB/s), io=28.0MiB (29.4MB), run=3020-3314msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158353: Thu Apr 30 12:16:16 2026 read: IOPS=1, BW=6540KiB/s (6697kB/s)(12.0MiB/1879msec) clat (msec): min=419, max=977, avg=612.54, stdev=316.64 lat (msec): min=419, max=977, avg=612.55, stdev=316.64 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=41.80%, ctx=3073, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158354: Thu Apr 30 12:16:16 2026 read: IOPS=0, BW=1760KiB/s (1802kB/s)(4096KiB/2327msec) clat (nsec): min=1001.4M, max=1001.4M, avg=1001368787.00, stdev= 0.00 lat (nsec): min=1001.4M, max=1001.4M, avg=1001370419.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3520KiB/s (3605kB/s)(8192KiB/2327msec); 0 zone resets clat (msec): min=518, max=761, avg=640.12, stdev=172.30 lat (msec): min=518, max=762, avg=640.36, stdev=172.34 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8192, max= 8192, per=62.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=15.69%, ctx=386, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158355: Thu Apr 30 12:16:16 2026 write: IOPS=1, BW=6178KiB/s (6326kB/s)(12.0MiB/1989msec); 0 zone resets clat (msec): min=439, max=852, avg=649.63, stdev=206.38 lat (msec): min=440, max=852, avg=649.92, stdev=206.35 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8175, max= 8192, per=62.84%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.10%, sys=14.03%, ctx=106, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158356: Thu Apr 30 12:16:16 2026 write: IOPS=1, BW=4884KiB/s (5001kB/s)(12.0MiB/2516msec); 0 zone resets clat (msec): min=155, max=1472, avg=826.40, stdev=658.73 lat (msec): min=155, max=1472, avg=826.70, stdev=658.74 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8192, max= 8192, per=62.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=9.98%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7041KiB/s (7210kB/s), 1760KiB/s-6540KiB/s (1802kB/s-6697kB/s), io=16.0MiB (16.8MB), run=1879-2327msec WRITE: bw=12.7MiB/s (13.3MB/s), 3520KiB/s-6178KiB/s (3605kB/s-6326kB/s), io=32.0MiB (33.6MB), run=1989-2516msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158358: Thu Apr 30 12:16:16 2026 read: IOPS=1, BW=5418KiB/s (5548kB/s)(12.0MiB/2268msec) clat (msec): min=425, max=1135, avg=750.27, stdev=358.87 lat (msec): min=425, max=1135, avg=750.27, stdev=358.87 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.97%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158359: Thu Apr 30 12:16:16 2026 read: IOPS=0, BW=1609KiB/s (1648kB/s)(4096KiB/2545msec) clat (nsec): min=1368.3M, max=1368.3M, avg=1368260896.00, stdev= 0.00 lat (nsec): min=1368.3M, max=1368.3M, avg=1368263043.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1368], 5.00th=[ 1368], 10.00th=[ 1368], 20.00th=[ 1368], | 30.00th=[ 1368], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3219KiB/s (3296kB/s)(8192KiB/2545msec); 0 zone resets clat (msec): min=420, max=713, avg=567.12, stdev=207.51 lat (msec): min=420, max=713, avg=567.26, stdev=207.52 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.63%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158360: Thu Apr 30 12:16:16 2026 write: IOPS=1, BW=4888KiB/s (5005kB/s)(12.0MiB/2514msec); 0 zone resets clat (msec): min=120, max=1815, avg=827.68, stdev=881.39 lat (msec): min=120, max=1815, avg=827.93, stdev=881.37 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8192, max= 8192, per=63.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=10.43%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158361: Thu Apr 30 12:16:16 2026 write: IOPS=1, BW=5813KiB/s (5952kB/s)(12.0MiB/2114msec); 0 zone resets clat (msec): min=110, max=1116, avg=696.77, stdev=523.56 lat (msec): min=110, max=1116, avg=697.01, stdev=523.57 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8192, max= 8192, per=63.63%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.22%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6438KiB/s (6592kB/s), 1609KiB/s-5418KiB/s (1648kB/s-5548kB/s), io=16.0MiB (16.8MB), run=2268-2545msec WRITE: bw=12.6MiB/s (13.2MB/s), 3219KiB/s-5813KiB/s (3296kB/s-5952kB/s), io=32.0MiB (33.6MB), run=2114-2545msec