== sanity test 398b: DIO and buffer IO race ============== 14:36:28 (1780857388) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.7929 s, 18.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180443: Sun Jun 7 14:37:39 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(5992KiB/59837msec) clat (usec): min=47, max=137571, avg=21470.54, stdev=11004.15 lat (usec): min=48, max=137573, avg=21471.78, stdev=11004.14 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 8586], 10.00th=[ 10159], 20.00th=[ 12518], | 30.00th=[ 15008], 40.00th=[ 17433], 50.00th=[ 19792], 60.00th=[ 22152], | 70.00th=[ 25035], 80.00th=[ 28967], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 56361], 99.50th=[ 63701], 99.90th=[ 76022], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 20, max= 208, per=25.34%, avg=100.08, stdev=29.80, samples=119 iops : min= 5, max= 52, avg=24.62, stdev= 7.49, samples=119 write: IOPS=26, BW=105KiB/s (108kB/s)(6296KiB/59837msec); 0 zone resets clat (usec): min=749, max=629028, avg=17400.44, stdev=19941.88 lat (usec): min=750, max=629030, avg=17401.78, stdev=19941.96 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2802], 10.00th=[ 3425], 20.00th=[ 5211], | 30.00th=[ 8160], 40.00th=[ 11207], 50.00th=[ 14091], 60.00th=[ 17695], | 70.00th=[ 21890], 80.00th=[ 27395], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 55313], 99.50th=[ 63701], 99.90th=[ 71828], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 32, max= 207, per=25.64%, avg=105.90, stdev=33.99, samples=118 iops : min= 8, max= 51, avg=26.08, stdev= 8.52, samples=118 lat (usec) : 50=0.03%, 100=0.23%, 250=0.62%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=0.75%, 4=6.48%, 10=14.39%, 20=35.58%, 50=40.04% lat (msec) : 100=1.60%, 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=25.04%, ctx=9891, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180445: Sun Jun 7 14:37:39 2026 read: IOPS=24, BW=97.8KiB/s (100kB/s)(5940KiB/60748msec) clat (usec): min=49, max=136504, avg=21902.70, stdev=11903.06 lat (usec): min=50, max=136506, avg=21903.80, stdev=11903.09 clat percentiles (usec): | 1.00th=[ 123], 5.00th=[ 8455], 10.00th=[ 10028], 20.00th=[ 12518], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 19792], 60.00th=[ 22414], | 70.00th=[ 25297], 80.00th=[ 29492], 90.00th=[ 35914], 95.00th=[ 44303], | 99.00th=[ 62653], 99.50th=[ 66323], 99.90th=[ 99091], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 6, max= 168, per=24.57%, avg=97.05, stdev=28.87, samples=120 iops : min= 1, max= 42, avg=23.86, stdev= 7.27, samples=120 write: IOPS=26, BW=104KiB/s (107kB/s)(6348KiB/60748msec); 0 zone resets clat (usec): min=684, max=641486, avg=17596.57, stdev=20118.61 lat (usec): min=685, max=641488, avg=17598.59, stdev=20118.45 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2933], 10.00th=[ 3490], 20.00th=[ 5473], | 30.00th=[ 8455], 40.00th=[ 11600], 50.00th=[ 14877], 60.00th=[ 17957], | 70.00th=[ 21890], 80.00th=[ 27395], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 55837], 99.50th=[ 59507], 99.90th=[108528], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 6, max= 207, per=25.03%, avg=103.39, stdev=35.84, samples=120 iops : min= 1, max= 51, avg=25.44, stdev= 8.97, samples=120 lat (usec) : 50=0.03%, 100=0.10%, 250=0.65%, 750=0.07%, 1000=0.13% lat (msec) : 2=0.59%, 4=6.12%, 10=14.91%, 20=35.94%, 50=38.96% lat (msec) : 100=2.41%, 250=0.07%, 750=0.03% cpu : usr=0.11%, sys=24.63%, ctx=10080, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180446: Sun Jun 7 14:37:39 2026 read: IOPS=24, BW=99.5KiB/s (102kB/s)(6028KiB/60571msec) clat (usec): min=58, max=70463, avg=20944.35, stdev=10677.04 lat (usec): min=59, max=70464, avg=20945.54, stdev=10677.07 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 7963], 10.00th=[ 9765], 20.00th=[12256], | 30.00th=[14615], 40.00th=[16909], 50.00th=[19268], 60.00th=[21627], | 70.00th=[24773], 80.00th=[28705], 90.00th=[34866], 95.00th=[41157], | 99.00th=[54264], 99.50th=[61080], 99.90th=[67634], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 24, max= 167, per=25.27%, avg=99.82, stdev=29.87, samples=119 iops : min= 6, max= 41, avg=24.55, stdev= 7.50, samples=119 write: IOPS=25, BW=103KiB/s (106kB/s)(6260KiB/60571msec); 0 zone resets clat (usec): min=821, max=678543, avg=18344.23, stdev=21403.35 lat (usec): min=823, max=678545, avg=18345.84, stdev=21403.32 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 3130], 10.00th=[ 3785], 20.00th=[ 5997], | 30.00th=[ 8848], 40.00th=[ 12125], 50.00th=[ 15008], 60.00th=[ 18482], | 70.00th=[ 21890], 80.00th=[ 27919], 90.00th=[ 36439], 95.00th=[ 44303], | 99.00th=[ 62129], 99.50th=[ 70779], 99.90th=[ 85459], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 32, max= 184, per=25.01%, avg=103.31, stdev=30.83, samples=119 iops : min= 8, max= 46, avg=25.43, stdev= 7.76, samples=119 lat (usec) : 100=0.42%, 250=0.81%, 500=0.03%, 750=0.03%, 1000=0.10% lat (msec) : 2=0.72%, 4=4.75%, 10=15.40%, 20=36.98%, 50=38.51% lat (msec) : 100=2.21%, 750=0.03% cpu : usr=0.11%, sys=24.69%, ctx=10150, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180447: Sun Jun 7 14:37:39 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(6052KiB/60389msec) clat (usec): min=43, max=75248, avg=21335.52, stdev=10993.37 lat (usec): min=45, max=75248, avg=21336.68, stdev=10993.43 clat percentiles (usec): | 1.00th=[ 113], 5.00th=[ 8225], 10.00th=[ 9634], 20.00th=[12387], | 30.00th=[14746], 40.00th=[17171], 50.00th=[19530], 60.00th=[22152], | 70.00th=[25035], 80.00th=[29230], 90.00th=[35914], 95.00th=[42206], | 99.00th=[55313], 99.50th=[63701], 99.90th=[73925], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 8, max= 183, per=25.52%, avg=100.79, stdev=30.44, samples=119 iops : min= 2, max= 45, avg=24.79, stdev= 7.65, samples=119 write: IOPS=25, BW=103KiB/s (106kB/s)(6236KiB/60389msec); 0 zone resets clat (usec): min=880, max=679576, avg=17843.59, stdev=21067.00 lat (usec): min=881, max=679578, avg=17844.92, stdev=21067.02 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2933], 10.00th=[ 3556], 20.00th=[ 5800], | 30.00th=[ 8848], 40.00th=[ 11731], 50.00th=[ 14484], 60.00th=[ 17695], | 70.00th=[ 22152], 80.00th=[ 27395], 90.00th=[ 35390], 95.00th=[ 42730], | 99.00th=[ 55837], 99.50th=[ 64226], 99.90th=[ 90702], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 32, max= 207, per=25.13%, avg=103.80, stdev=30.14, samples=119 iops : min= 8, max= 51, avg=25.55, stdev= 7.56, samples=119 lat (usec) : 50=0.07%, 100=0.16%, 250=1.07%, 1000=0.07% lat (msec) : 2=0.62%, 4=5.86%, 10=14.81%, 20=35.29%, 50=40.14% lat (msec) : 100=1.89%, 750=0.03% cpu : usr=0.12%, sys=25.05%, ctx=10011, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=395KiB/s (405kB/s), 97.8KiB/s-100KiB/s (100kB/s-103kB/s), io=23.4MiB (24.6MB), run=59837-60748msec WRITE: bw=414KiB/s (424kB/s), 103KiB/s-105KiB/s (106kB/s-108kB/s), io=24.6MiB (25.7MB), run=59837-60748msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180440: Sun Jun 7 14:37:46 2026 read: IOPS=22, BW=88.1KiB/s (90.2kB/s)(5992KiB/67993msec) clat (msec): min=2, max=694, avg=19.92, stdev=22.99 lat (msec): min=2, max=694, avg=19.92, stdev=22.99 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 42], 95.00th=[ 50], | 99.00th=[ 69], 99.50th=[ 77], 99.90th=[ 114], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 23, max= 336, per=24.94%, avg=88.02, stdev=58.88, samples=134 iops : min= 5, max= 84, avg=21.59, stdev=14.82, samples=134 write: IOPS=23, BW=92.6KiB/s (94.8kB/s)(6296KiB/67993msec); 0 zone resets clat (msec): min=5, max=125, avg=24.06, stdev=16.27 lat (msec): min=5, max=125, avg=24.06, stdev=16.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 37], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 74], 99.50th=[ 84], 99.90th=[ 125], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 8, max= 336, per=25.04%, avg=92.38, stdev=59.88, samples=134 iops : min= 2, max= 84, avg=22.68, stdev=15.06, samples=134 lat (msec) : 4=0.68%, 10=25.91%, 20=30.89%, 50=36.46%, 100=5.83% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.11%, sys=13.55%, ctx=6635, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180441: Sun Jun 7 14:37:46 2026 read: IOPS=21, BW=87.5KiB/s (89.6kB/s)(5940KiB/67888msec) clat (msec): min=3, max=657, avg=19.78, stdev=22.11 lat (msec): min=3, max=657, avg=19.78, stdev=22.11 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 72], 99.50th=[ 77], 99.90th=[ 100], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8, max= 336, per=24.90%, avg=87.91, stdev=58.88, samples=134 iops : min= 2, max= 84, avg=21.56, stdev=14.82, samples=134 write: IOPS=23, BW=93.5KiB/s (95.8kB/s)(6348KiB/67888msec); 0 zone resets clat (msec): min=5, max=133, avg=24.09, stdev=16.40 lat (msec): min=5, max=133, avg=24.09, stdev=16.40 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 80], 99.50th=[ 86], 99.90th=[ 127], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 24, max= 320, per=25.38%, avg=93.63, stdev=58.26, samples=134 iops : min= 6, max= 80, avg=22.99, stdev=14.66, samples=134 lat (msec) : 4=0.49%, 10=24.32%, 20=32.16%, 50=36.65%, 100=6.22% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.10%, sys=13.69%, ctx=6637, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180442: Sun Jun 7 14:37:46 2026 read: IOPS=22, BW=89.3KiB/s (91.5kB/s)(6028KiB/67493msec) clat (msec): min=3, max=115, avg=18.97, stdev=14.29 lat (msec): min=3, max=115, avg=18.97, stdev=14.29 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 66], 99.50th=[ 73], 99.90th=[ 105], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 16, max= 312, per=25.31%, avg=89.36, stdev=61.17, samples=133 iops : min= 4, max= 78, avg=21.92, stdev=15.40, samples=133 write: IOPS=23, BW=92.8KiB/s (94.0kB/s)(6260KiB/67493msec); 0 zone resets clat (msec): min=5, max=664, avg=24.68, stdev=22.85 lat (msec): min=5, max=664, avg=24.69, stdev=22.85 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 55], | 99.00th=[ 82], 99.50th=[ 92], 99.90th=[ 118], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 23, max= 312, per=25.11%, avg=92.65, stdev=56.96, samples=133 iops : min= 5, max= 78, avg=22.75, stdev=14.36, samples=133 lat (msec) : 4=0.46%, 10=25.62%, 20=30.99%, 50=36.95%, 100=5.79% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.10%, sys=14.02%, ctx=6778, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180444: Sun Jun 7 14:37:46 2026 read: IOPS=22, BW=89.1KiB/s (91.3kB/s)(6052KiB/67888msec) clat (usec): min=2975, max=94066, avg=19471.24, stdev=14562.12 lat (usec): min=2976, max=94068, avg=19472.17, stdev=14562.23 clat percentiles (usec): | 1.00th=[ 4146], 5.00th=[ 4883], 10.00th=[ 5538], 20.00th=[ 7046], | 30.00th=[ 9634], 40.00th=[12387], 50.00th=[15401], 60.00th=[18744], | 70.00th=[22676], 80.00th=[30016], 90.00th=[40109], 95.00th=[47449], | 99.00th=[68682], 99.50th=[77071], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 7, max= 312, per=25.34%, avg=89.45, stdev=59.63, samples=134 iops : min= 1, max= 78, avg=21.95, stdev=15.01, samples=134 write: IOPS=22, BW=91.9KiB/s (94.1kB/s)(6236KiB/67888msec); 0 zone resets clat (msec): min=4, max=667, avg=24.47, stdev=23.10 lat (msec): min=4, max=667, avg=24.47, stdev=23.10 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 36], 90.00th=[ 45], 95.00th=[ 55], | 99.00th=[ 81], 99.50th=[ 101], 99.90th=[ 134], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 32, max= 328, per=24.97%, avg=92.14, stdev=58.74, samples=134 iops : min= 8, max= 82, avg=22.62, stdev=14.80, samples=134 lat (msec) : 4=0.39%, 10=25.20%, 20=31.58%, 50=37.34%, 100=5.24% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.10%, sys=13.77%, ctx=6699, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=353KiB/s (362kB/s), 87.5KiB/s-89.3KiB/s (89.6kB/s-91.5kB/s), io=23.4MiB (24.6MB), run=67493-67993msec WRITE: bw=370KiB/s (379kB/s), 91.9KiB/s-93.5KiB/s (94.1kB/s-95.8kB/s), io=24.6MiB (25.7MB), run=67493-67993msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180472: Sun Jun 7 14:38:10 2026 read: IOPS=21, BW=337KiB/s (345kB/s)(5920KiB/17584msec) clat (usec): min=101, max=81979, avg=24668.25, stdev=13760.03 lat (usec): min=102, max=81981, avg=24669.39, stdev=13760.11 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7898], 10.00th=[11600], 20.00th=[14484], | 30.00th=[17433], 40.00th=[20055], 50.00th=[22414], 60.00th=[25297], | 70.00th=[28181], 80.00th=[32113], 90.00th=[41157], 95.00th=[51643], | 99.00th=[76022], 99.50th=[79168], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 160, max= 540, per=24.10%, avg=328.18, stdev=86.67, samples=34 iops : min= 10, max= 33, avg=19.97, stdev= 5.35, samples=34 write: IOPS=22, BW=362KiB/s (371kB/s)(6368KiB/17584msec); 0 zone resets clat (usec): min=1565, max=79482, avg=21156.91, stdev=13957.71 lat (usec): min=1569, max=79484, avg=21158.92, stdev=13957.75 clat percentiles (usec): | 1.00th=[ 2999], 5.00th=[ 4490], 10.00th=[ 5604], 20.00th=[ 8979], | 30.00th=[11207], 40.00th=[14484], 50.00th=[17957], 60.00th=[22414], | 70.00th=[26870], 80.00th=[32637], 90.00th=[41681], 95.00th=[47973], | 99.00th=[59507], 99.50th=[66847], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 63, max= 636, per=25.07%, avg=359.29, stdev=117.44, samples=34 iops : min= 3, max= 39, avg=21.91, stdev= 7.46, samples=34 lat (usec) : 250=2.08%, 1000=0.13% lat (msec) : 2=0.13%, 4=1.30%, 10=12.24%, 20=31.90%, 50=47.14% lat (msec) : 100=5.08% cpu : usr=0.14%, sys=26.04%, ctx=3122, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180474: Sun Jun 7 14:38:10 2026 read: IOPS=20, BW=331KiB/s (339kB/s)(5744KiB/17332msec) clat (usec): min=90, max=69892, avg=24405.65, stdev=12411.30 lat (usec): min=91, max=69893, avg=24406.82, stdev=12411.41 clat percentiles (usec): | 1.00th=[ 102], 5.00th=[ 9503], 10.00th=[11207], 20.00th=[14353], | 30.00th=[17433], 40.00th=[20317], 50.00th=[22152], 60.00th=[25035], | 70.00th=[28705], 80.00th=[33817], 90.00th=[41157], 95.00th=[48497], | 99.00th=[63701], 99.50th=[66323], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 127, max= 542, per=24.21%, avg=329.68, stdev=103.57, samples=34 iops : min= 7, max= 33, avg=20.09, stdev= 6.48, samples=34 write: IOPS=23, BW=378KiB/s (387kB/s)(6544KiB/17332msec); 0 zone resets clat (usec): min=1442, max=72996, avg=20805.43, stdev=14221.42 lat (usec): min=1443, max=72999, avg=20807.69, stdev=14221.78 clat percentiles (usec): | 1.00th=[ 2089], 5.00th=[ 4228], 10.00th=[ 5080], 20.00th=[ 8291], | 30.00th=[11600], 40.00th=[15008], 50.00th=[17433], 60.00th=[20841], | 70.00th=[24511], 80.00th=[31851], 90.00th=[40109], 95.00th=[51643], | 99.00th=[63701], 99.50th=[68682], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 158, max= 542, per=25.93%, avg=371.53, stdev=100.31, samples=34 iops : min= 9, max= 33, avg=22.71, stdev= 6.27, samples=34 lat (usec) : 100=0.39%, 250=1.43% lat (msec) : 2=0.52%, 4=1.69%, 10=12.50%, 20=31.90%, 50=46.48% lat (msec) : 100=5.08% cpu : usr=0.10%, sys=26.82%, ctx=3031, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180476: Sun Jun 7 14:38:10 2026 read: IOPS=22, BW=361KiB/s (370kB/s)(6256KiB/17321msec) clat (usec): min=90, max=94183, avg=22750.72, stdev=12985.07 lat (usec): min=91, max=94185, avg=22751.98, stdev=12985.13 clat percentiles (usec): | 1.00th=[ 106], 5.00th=[ 202], 10.00th=[10028], 20.00th=[13566], | 30.00th=[16188], 40.00th=[18220], 50.00th=[20841], 60.00th=[23200], | 70.00th=[26608], 80.00th=[30802], 90.00th=[39060], 95.00th=[45876], | 99.00th=[66847], 99.50th=[68682], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 160, max= 606, per=26.32%, avg=358.47, stdev=111.85, samples=34 iops : min= 10, max= 37, avg=21.88, stdev= 6.98, samples=34 write: IOPS=21, BW=348KiB/s (357kB/s)(6032KiB/17321msec); 0 zone resets clat (usec): min=2087, max=90098, avg=22097.15, stdev=15391.04 lat (usec): min=2089, max=90100, avg=22099.83, stdev=15391.32 clat percentiles (usec): | 1.00th=[ 2704], 5.00th=[ 4490], 10.00th=[ 5473], 20.00th=[ 8291], | 30.00th=[12256], 40.00th=[15139], 50.00th=[18482], 60.00th=[22938], | 70.00th=[27395], 80.00th=[33162], 90.00th=[41681], 95.00th=[50070], | 99.00th=[73925], 99.50th=[87557], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 159, max= 544, per=23.84%, avg=341.65, stdev=105.03, samples=34 iops : min= 9, max= 34, avg=20.82, stdev= 6.71, samples=34 lat (usec) : 100=0.26%, 250=2.60%, 500=0.39% lat (msec) : 4=1.30%, 10=11.98%, 20=33.20%, 50=45.96%, 100=4.30% cpu : usr=0.08%, sys=26.10%, ctx=3017, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180478: Sun Jun 7 14:38:10 2026 read: IOPS=22, BW=353KiB/s (362kB/s)(6032KiB/17075msec) clat (usec): min=46, max=74279, avg=22965.04, stdev=13080.00 lat (usec): min=47, max=74280, avg=22966.31, stdev=13080.10 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 135], 10.00th=[ 9634], 20.00th=[12911], | 30.00th=[15926], 40.00th=[19006], 50.00th=[22152], 60.00th=[24511], | 70.00th=[28705], 80.00th=[31851], 90.00th=[40109], 95.00th=[46924], | 99.00th=[65274], 99.50th=[72877], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 191, max= 542, per=25.51%, avg=347.39, stdev=96.80, samples=33 iops : min= 11, max= 33, avg=21.18, stdev= 6.05, samples=33 write: IOPS=22, BW=366KiB/s (375kB/s)(6256KiB/17075msec); 0 zone resets clat (usec): min=2020, max=87546, avg=21259.82, stdev=13663.94 lat (usec): min=2021, max=87548, avg=21281.71, stdev=13667.41 clat percentiles (usec): | 1.00th=[ 2704], 5.00th=[ 4424], 10.00th=[ 5342], 20.00th=[ 9503], | 30.00th=[12780], 40.00th=[15270], 50.00th=[19006], 60.00th=[22414], | 70.00th=[26608], 80.00th=[31589], 90.00th=[40109], 95.00th=[45876], | 99.00th=[65274], 99.50th=[67634], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 191, max= 667, per=25.38%, avg=363.67, stdev=111.88, samples=33 iops : min= 11, max= 41, avg=22.18, stdev= 7.05, samples=33 lat (usec) : 50=0.13%, 100=0.52%, 250=3.12%, 500=0.13% lat (msec) : 2=0.13%, 4=1.30%, 10=11.59%, 20=31.12%, 50=48.70% lat (msec) : 100=3.26% cpu : usr=0.11%, sys=26.41%, ctx=2879, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1362KiB/s (1395kB/s), 331KiB/s-361KiB/s (339kB/s-370kB/s), io=23.4MiB (24.5MB), run=17075-17584msec WRITE: bw=1433KiB/s (1468kB/s), 348KiB/s-378KiB/s (357kB/s-387kB/s), io=24.6MiB (25.8MB), run=17075-17584msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180471: Sun Jun 7 14:38:12 2026 read: IOPS=19, BW=309KiB/s (316kB/s)(5920KiB/19185msec) clat (usec): min=3764, max=98538, avg=21660.29, stdev=17281.18 lat (usec): min=3765, max=98538, avg=21661.22, stdev=17281.25 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 5080], 10.00th=[ 6063], 20.00th=[ 8455], | 30.00th=[11076], 40.00th=[13435], 50.00th=[16057], 60.00th=[19530], | 70.00th=[23987], 80.00th=[31327], 90.00th=[45876], 95.00th=[61080], | 99.00th=[82314], 99.50th=[88605], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 127, max= 1152, per=24.36%, avg=304.00, stdev=200.76, samples=38 iops : min= 7, max= 72, avg=18.45, stdev=12.64, samples=38 write: IOPS=20, BW=332KiB/s (340kB/s)(6368KiB/19185msec); 0 zone resets clat (msec): min=4, max=108, avg=27.81, stdev=18.61 lat (msec): min=4, max=108, avg=27.81, stdev=18.61 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 67], | 99.00th=[ 95], 99.50th=[ 100], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 127, max= 1088, per=25.03%, avg=328.63, stdev=204.95, samples=38 iops : min= 7, max= 68, avg=19.97, stdev=12.90, samples=38 lat (msec) : 4=0.39%, 10=19.79%, 20=30.60%, 50=40.23%, 100=8.85% lat (msec) : 250=0.13% cpu : usr=0.07%, sys=13.39%, ctx=1700, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180473: Sun Jun 7 14:38:12 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(5744KiB/19042msec) clat (usec): min=3892, max=85542, avg=22090.11, stdev=15468.10 lat (usec): min=3892, max=85542, avg=22091.12, stdev=15468.22 clat percentiles (usec): | 1.00th=[ 4621], 5.00th=[ 5604], 10.00th=[ 6718], 20.00th=[ 9241], | 30.00th=[12387], 40.00th=[14746], 50.00th=[18220], 60.00th=[20841], | 70.00th=[24511], 80.00th=[32113], 90.00th=[45876], 95.00th=[55313], | 99.00th=[71828], 99.50th=[72877], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 128, max= 832, per=23.09%, avg=288.19, stdev=133.19, samples=37 iops : min= 8, max= 52, avg=17.43, stdev= 8.36, samples=37 write: IOPS=21, BW=344KiB/s (352kB/s)(6544KiB/19042msec); 0 zone resets clat (msec): min=6, max=115, avg=27.05, stdev=17.65 lat (msec): min=6, max=115, avg=27.05, stdev=17.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 54], 95.00th=[ 61], | 99.00th=[ 80], 99.50th=[ 88], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 159, max= 1053, per=24.68%, avg=324.08, stdev=181.89, samples=37 iops : min= 9, max= 65, avg=19.68, stdev=11.43, samples=37 lat (msec) : 4=0.13%, 10=17.58%, 20=33.20%, 50=39.19%, 100=9.77% lat (msec) : 250=0.13% cpu : usr=0.11%, sys=13.96%, ctx=1763, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180475: Sun Jun 7 14:38:12 2026 read: IOPS=20, BW=328KiB/s (335kB/s)(6256KiB/19095msec) clat (msec): min=4, max=116, avg=21.78, stdev=16.48 lat (msec): min=4, max=116, avg=21.78, stdev=16.48 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 44], 95.00th=[ 59], | 99.00th=[ 80], 99.50th=[ 101], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 127, max= 1216, per=24.97%, avg=311.57, stdev=193.54, samples=37 iops : min= 7, max= 76, avg=18.92, stdev=12.16, samples=37 write: IOPS=19, BW=316KiB/s (323kB/s)(6032KiB/19095msec); 0 zone resets clat (msec): min=5, max=117, avg=27.84, stdev=17.34 lat (msec): min=5, max=117, avg=27.84, stdev=17.34 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 89], 99.50th=[ 112], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 158, max= 734, per=22.41%, avg=294.22, stdev=118.10, samples=37 iops : min= 9, max= 45, avg=17.81, stdev= 7.37, samples=37 lat (msec) : 10=19.40%, 20=30.86%, 50=40.89%, 100=8.20%, 250=0.65% cpu : usr=0.12%, sys=13.71%, ctx=1769, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180477: Sun Jun 7 14:38:12 2026 read: IOPS=19, BW=317KiB/s (325kB/s)(6032KiB/19004msec) clat (msec): min=3, max=106, avg=21.37, stdev=16.35 lat (msec): min=3, max=106, avg=21.37, stdev=16.35 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 45], 95.00th=[ 61], | 99.00th=[ 73], 99.50th=[ 75], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 95, max= 1053, per=23.91%, avg=298.41, stdev=164.40, samples=37 iops : min= 5, max= 65, avg=18.08, stdev=10.28, samples=37 write: IOPS=20, BW=329KiB/s (337kB/s)(6256KiB/19004msec); 0 zone resets clat (msec): min=5, max=100, avg=27.77, stdev=16.38 lat (msec): min=5, max=100, avg=27.77, stdev=16.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 13], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 41], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 78], 99.50th=[ 99], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 63, max= 992, per=24.04%, avg=315.68, stdev=161.58, samples=37 iops : min= 3, max= 62, avg=19.16, stdev=10.17, samples=37 lat (msec) : 4=0.26%, 10=18.10%, 20=32.29%, 50=41.02%, 100=8.07% lat (msec) : 250=0.26% cpu : usr=0.12%, sys=13.62%, ctx=1854, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1248KiB/s (1278kB/s), 302KiB/s-328KiB/s (309kB/s-335kB/s), io=23.4MiB (24.5MB), run=19004-19185msec WRITE: bw=1314KiB/s (1345kB/s), 316KiB/s-344KiB/s (323kB/s-352kB/s), io=24.6MiB (25.8MB), run=19004-19185msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180489: Sun Jun 7 14:38:21 2026 read: IOPS=3, BW=3203KiB/s (3280kB/s)(7168KiB/2238msec) clat (msec): min=76, max=166, avg=126.32, stdev=30.20 lat (msec): min=76, max=166, avg=126.32, stdev=30.20 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 104], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 127], 60.00th=[ 132], | 70.00th=[ 132], 80.00th=[ 155], 90.00th=[ 167], 95.00th=[ 167], | 99.00th=[ 167], 99.50th=[ 167], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 2031, max= 5774, per=60.84%, avg=3967.00, stdev=1874.83, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=2, BW=2288KiB/s (2343kB/s)(5120KiB/2238msec); 0 zone resets clat (msec): min=139, max=442, avg=268.78, stdev=138.65 lat (msec): min=139, max=442, avg=268.83, stdev=138.63 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2031, max= 4096, per=29.85%, avg=2725.00, stdev=1187.35, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.04%, sys=50.92%, ctx=898, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180491: Sun Jun 7 14:38:21 2026 read: IOPS=0, BW=652KiB/s (668kB/s)(2048KiB/3141msec) clat (msec): min=114, max=300, avg=207.45, stdev=131.94 lat (msec): min=114, max=300, avg=207.45, stdev=131.94 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1950, max= 1980, per=30.14%, avg=1965.00, stdev=21.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3260KiB/s (3338kB/s)(10.0MiB/3141msec); 0 zone resets clat (msec): min=95, max=627, avg=269.95, stdev=194.30 lat (msec): min=95, max=627, avg=270.04, stdev=194.29 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 128], 40.00th=[ 130], 50.00th=[ 161], 60.00th=[ 167], | 70.00th=[ 355], 80.00th=[ 456], 90.00th=[ 489], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2048, max= 8192, per=50.35%, avg=4595.75, stdev=3063.92, samples=4 iops : min= 2, max= 8, avg= 4.25, stdev= 2.87, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.06%, sys=45.67%, ctx=629, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180493: Sun Jun 7 14:38:21 2026 read: IOPS=2, BW=2850KiB/s (2918kB/s)(6144KiB/2156msec) clat (msec): min=86, max=183, avg=143.96, stdev=37.09 lat (msec): min=86, max=183, avg=143.96, stdev=37.09 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 155], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 2031, max= 4096, per=52.26%, avg=3407.67, stdev=1192.23, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2850KiB/s (2918kB/s)(6144KiB/2156msec); 0 zone resets clat (msec): min=111, max=289, avg=211.65, stdev=70.11 lat (msec): min=111, max=289, avg=211.71, stdev=70.10 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 239], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2048, max= 4063, per=33.24%, avg=3033.75, stdev=1138.80, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.05%, sys=47.66%, ctx=650, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180495: Sun Jun 7 14:38:21 2026 read: IOPS=2, BW=2095KiB/s (2145kB/s)(5120KiB/2444msec) clat (usec): min=419, max=269509, avg=120203.88, stdev=119056.53 lat (usec): min=420, max=269511, avg=120205.07, stdev=119056.87 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 420], | 30.00th=[ 453], 40.00th=[ 453], 50.00th=[137364], 60.00th=[137364], | 70.00th=[193987], 80.00th=[193987], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2933KiB/s (3003kB/s)(7168KiB/2444msec); 0 zone resets clat (msec): min=191, max=322, avg=259.22, stdev=49.77 lat (msec): min=191, max=322, avg=259.29, stdev=49.74 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 209], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 275], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 300], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1988, max= 4096, per=33.40%, avg=3048.75, stdev=1190.54, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (usec) : 500=16.67% lat (msec) : 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=46.62%, ctx=433, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6520KiB/s (6677kB/s), 652KiB/s-3203KiB/s (668kB/s-3280kB/s), io=20.0MiB (20.0MB), run=2156-3141msec WRITE: bw=9128KiB/s (9347kB/s), 2288KiB/s-3260KiB/s (2343kB/s-3338kB/s), io=28.0MiB (29.4MB), run=2156-3141msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180488: Sun Jun 7 14:38:21 2026 read: IOPS=2, BW=2650KiB/s (2714kB/s)(7168KiB/2705msec) clat (msec): min=59, max=348, avg=160.48, stdev=110.92 lat (msec): min=59, max=348, avg=160.48, stdev=110.92 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 60], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 148], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 271], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 4079, max= 4129, per=65.22%, avg=4104.00, stdev=35.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1893KiB/s (1938kB/s)(5120KiB/2705msec); 0 zone resets clat (msec): min=107, max=790, avg=303.25, stdev=284.86 lat (msec): min=108, max=790, avg=303.32, stdev=284.87 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2048, max= 4087, per=34.81%, avg=3067.50, stdev=1441.79, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=19.97%, ctx=301, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180490: Sun Jun 7 14:38:21 2026 read: IOPS=0, BW=707KiB/s (724kB/s)(2048KiB/2895msec) clat (msec): min=60, max=399, avg=229.80, stdev=240.07 lat (msec): min=60, max=399, avg=229.81, stdev=240.07 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2015, max= 2039, per=32.21%, avg=2027.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3537KiB/s (3622kB/s)(10.0MiB/2895msec); 0 zone resets clat (msec): min=93, max=579, avg=241.58, stdev=156.68 lat (msec): min=93, max=579, avg=241.66, stdev=156.67 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 109], | 30.00th=[ 130], 40.00th=[ 140], 50.00th=[ 157], 60.00th=[ 197], | 70.00th=[ 284], 80.00th=[ 326], 90.00th=[ 405], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2015, max= 6144, per=40.53%, avg=3571.25, stdev=1971.02, samples=4 iops : min= 1, max= 6, avg= 2.75, stdev= 2.36, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=17.83%, ctx=340, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180492: Sun Jun 7 14:38:21 2026 read: IOPS=1, BW=2012KiB/s (2061kB/s)(6144KiB/3053msec) clat (msec): min=59, max=312, avg=155.10, stdev=91.42 lat (msec): min=59, max=312, avg=155.10, stdev=91.42 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 146], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2039, max= 6144, per=54.19%, avg=3410.33, stdev=2367.43, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 write: IOPS=1, BW=2012KiB/s (2061kB/s)(6144KiB/3053msec); 0 zone resets clat (msec): min=131, max=707, avg=343.94, stdev=242.78 lat (msec): min=131, max=707, avg=344.02, stdev=242.78 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 284], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2043, max= 6144, per=38.72%, avg=3411.67, stdev=2366.27, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=16.64%, ctx=138, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180494: Sun Jun 7 14:38:21 2026 read: IOPS=1, BW=1573KiB/s (1611kB/s)(5120KiB/3254msec) clat (msec): min=21, max=718, avg=283.31, stdev=279.46 lat (msec): min=21, max=718, avg=283.31, stdev=279.46 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 22], 10.00th=[ 22], 20.00th=[ 22], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 4087, max= 4096, per=65.02%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2203KiB/s (2256kB/s)(7168KiB/3254msec); 0 zone resets clat (msec): min=33, max=689, avg=258.98, stdev=234.68 lat (msec): min=33, max=689, avg=259.06, stdev=234.69 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 57], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 203], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 456], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1391, max= 6131, per=38.73%, avg=3412.25, stdev=2143.42, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 50=16.67%, 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=15.06%, ctx=96, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6294KiB/s (6445kB/s), 707KiB/s-2650KiB/s (724kB/s-2714kB/s), io=20.0MiB (20.0MB), run=2705-3254msec WRITE: bw=8811KiB/s (9023kB/s), 1893KiB/s-3537KiB/s (1938kB/s-3622kB/s), io=28.0MiB (29.4MB), run=2705-3254msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180501: Sun Jun 7 14:38:29 2026 read: IOPS=1, BW=7103KiB/s (7273kB/s)(12.0MiB/1730msec) clat (msec): min=497, max=656, avg=567.73, stdev=80.71 lat (msec): min=497, max=656, avg=567.73, stdev=80.71 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 5818, max= 7670, per=83.12%, avg=6744.00, stdev=1309.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=16.08%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180502: Sun Jun 7 14:38:29 2026 read: IOPS=0, BW=2029KiB/s (2077kB/s)(4096KiB/2019msec) clat (nsec): min=135826k, max=135826k, avg=135826107.00, stdev= 0.00 lat (nsec): min=135829k, max=135829k, avg=135828575.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 136], 90.00th=[ 136], 95.00th=[ 136], | 99.00th=[ 136], 99.50th=[ 136], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4057KiB/s (4155kB/s)(8192KiB/2019msec); 0 zone resets clat (msec): min=853, max=979, avg=916.30, stdev=89.26 lat (msec): min=853, max=979, avg=916.64, stdev=89.33 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8192, max= 8192, per=50.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=15.11%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180503: Sun Jun 7 14:38:29 2026 write: IOPS=1, BW=6241KiB/s (6391kB/s)(12.0MiB/1969msec); 0 zone resets clat (msec): min=131, max=1047, avg=642.44, stdev=467.00 lat (msec): min=132, max=1048, avg=642.74, stdev=467.07 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7670, max= 7670, per=47.26%, avg=7670.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=12.80%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180504: Sun Jun 7 14:38:29 2026 write: IOPS=1, BW=7062KiB/s (7232kB/s)(12.0MiB/1740msec); 0 zone resets clat (msec): min=327, max=1049, avg=570.78, stdev=414.83 lat (msec): min=327, max=1050, avg=571.17, stdev=414.78 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min=11521, max=11521, per=70.99%, avg=11521.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.06%, sys=15.64%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8115KiB/s (8310kB/s), 2029KiB/s-7103KiB/s (2077kB/s-7273kB/s), io=16.0MiB (16.8MB), run=1730-2019msec WRITE: bw=15.8MiB/s (16.6MB/s), 4057KiB/s-7062KiB/s (4155kB/s-7232kB/s), io=32.0MiB (33.6MB), run=1740-2019msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180505: Sun Jun 7 14:38:29 2026 read: IOPS=1, BW=7680KiB/s (7864kB/s)(12.0MiB/1600msec) clat (msec): min=329, max=640, avg=497.50, stdev=157.15 lat (msec): min=329, max=640, avg=497.51, stdev=157.15 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 5712, max= 8110, per=90.10%, avg=6911.00, stdev=1695.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=50.09%, ctx=2593, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180506: Sun Jun 7 14:38:29 2026 read: IOPS=0, BW=1918KiB/s (1964kB/s)(4096KiB/2136msec) clat (nsec): min=397375k, max=397375k, avg=397374527.00, stdev= 0.00 lat (nsec): min=397377k, max=397377k, avg=397377202.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 5712, max= 5712, per=74.47%, avg=5712.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3835KiB/s (3927kB/s)(8192KiB/2136msec); 0 zone resets clat (msec): min=645, max=1052, avg=849.23, stdev=287.89 lat (msec): min=645, max=1053, avg=849.54, stdev=287.94 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7968, max= 7968, per=51.94%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=20.66%, ctx=1046, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180507: Sun Jun 7 14:38:29 2026 write: IOPS=1, BW=5761KiB/s (5899kB/s)(12.0MiB/2133msec); 0 zone resets clat (msec): min=126, max=1168, avg=686.24, stdev=525.57 lat (msec): min=126, max=1169, avg=686.59, stdev=525.59 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7968, max= 7968, per=51.94%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.05%, sys=13.65%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180508: Sun Jun 7 14:38:29 2026 write: IOPS=1, BW=6759KiB/s (6921kB/s)(12.0MiB/1818msec); 0 zone resets clat (msec): min=129, max=1015, avg=577.27, stdev=443.04 lat (msec): min=129, max=1015, avg=577.60, stdev=443.02 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 5752, max= 7968, per=44.72%, avg=6860.00, stdev=1566.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.55%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7670KiB/s (7855kB/s), 1918KiB/s-7680KiB/s (1964kB/s-7864kB/s), io=16.0MiB (16.8MB), run=1600-2136msec WRITE: bw=14.0MiB/s (15.7MB/s), 3835KiB/s-6759KiB/s (3927kB/s-6921kB/s), io=32.0MiB (33.6MB), run=1818-2136msec