== sanity test 398b: DIO and buffer IO race ============== 07:05:33 (1773659133) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.82348 s, 17.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182204: Mon Mar 16 07:06:40 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(5992KiB/57993msec) clat (usec): min=37, max=1071.7k, avg=21104.36, stdev=29199.18 lat (usec): min=38, max=1071.7k, avg=21105.27, stdev=29199.22 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7832], 10.00th=[ 9110], | 20.00th=[ 11994], 30.00th=[ 14222], 40.00th=[ 16450], | 50.00th=[ 18744], 60.00th=[ 21365], 70.00th=[ 23987], | 80.00th=[ 27657], 90.00th=[ 32900], 95.00th=[ 40633], | 99.00th=[ 60556], 99.50th=[ 64750], 99.90th=[ 89654], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 14, max= 184, per=25.34%, avg=104.16, stdev=27.10, samples=114 iops : min= 3, max= 46, avg=25.68, stdev= 6.78, samples=114 write: IOPS=27, BW=109KiB/s (111kB/s)(6296KiB/57993msec); 0 zone resets clat (usec): min=864, max=121812, avg=16576.59, stdev=13070.78 lat (usec): min=866, max=121813, avg=16578.97, stdev=13070.50 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2245], 10.00th=[ 3097], 20.00th=[ 4686], | 30.00th=[ 7635], 40.00th=[ 11207], 50.00th=[ 13960], 60.00th=[ 16909], | 70.00th=[ 20841], 80.00th=[ 26346], 90.00th=[ 34341], 95.00th=[ 40633], | 99.00th=[ 57934], 99.50th=[ 63701], 99.90th=[ 90702], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 47, max= 198, per=25.66%, avg=110.32, stdev=31.19, samples=113 iops : min= 11, max= 49, avg=27.22, stdev= 7.86, samples=113 lat (usec) : 50=0.07%, 100=0.16%, 250=0.91%, 500=0.03%, 1000=0.13% lat (msec) : 2=1.76%, 4=6.71%, 10=15.07%, 20=36.69%, 50=36.39% lat (msec) : 100=2.02%, 250=0.03%, 2000=0.03% cpu : usr=0.13%, sys=21.26%, ctx=9440, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182205: Mon Mar 16 07:06:40 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(5940KiB/57730msec) clat (usec): min=50, max=89201, avg=20853.15, stdev=11153.88 lat (usec): min=51, max=89202, avg=20854.71, stdev=11153.54 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 8029], 10.00th=[ 9765], 20.00th=[12125], | 30.00th=[14091], 40.00th=[16450], 50.00th=[19006], 60.00th=[21365], | 70.00th=[24511], 80.00th=[28181], 90.00th=[33817], 95.00th=[40633], | 99.00th=[61604], 99.50th=[66323], 99.90th=[73925], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 7, max= 168, per=25.24%, avg=103.73, stdev=25.28, samples=113 iops : min= 1, max= 42, avg=25.57, stdev= 6.35, samples=113 write: IOPS=27, BW=110KiB/s (113kB/s)(6348KiB/57730msec); 0 zone resets clat (usec): min=738, max=963026, avg=16663.00, stdev=26716.93 lat (usec): min=739, max=963037, avg=16664.47, stdev=26717.27 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2376], 10.00th=[ 3130], 20.00th=[ 4555], | 30.00th=[ 8029], 40.00th=[ 10683], 50.00th=[ 13698], 60.00th=[ 16581], | 70.00th=[ 20317], 80.00th=[ 25297], 90.00th=[ 32375], 95.00th=[ 39060], | 99.00th=[ 54789], 99.50th=[ 57934], 99.90th=[108528], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 182, per=25.72%, avg=110.58, stdev=34.58, samples=113 iops : min= 1, max= 45, avg=27.28, stdev= 8.67, samples=113 lat (usec) : 100=0.29%, 250=0.81%, 500=0.03%, 750=0.03%, 1000=0.03% lat (msec) : 2=1.30%, 4=7.32%, 10=14.42%, 20=37.37%, 50=36.13% lat (msec) : 100=2.18%, 250=0.03%, 1000=0.03% cpu : usr=0.13%, sys=21.67%, ctx=9497, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182206: Mon Mar 16 07:06:40 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6028KiB/58239msec) clat (usec): min=36, max=1063.3k, avg=20818.46, stdev=28955.00 lat (usec): min=36, max=1063.3k, avg=20819.44, stdev=28955.06 clat percentiles (usec): | 1.00th=[ 91], 5.00th=[ 7242], 10.00th=[ 9241], | 20.00th=[ 11469], 30.00th=[ 13829], 40.00th=[ 15795], | 50.00th=[ 18220], 60.00th=[ 20579], 70.00th=[ 23725], | 80.00th=[ 27657], 90.00th=[ 34341], 95.00th=[ 40633], | 99.00th=[ 54789], 99.50th=[ 61604], 99.90th=[ 76022], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 7, max= 160, per=25.36%, avg=104.23, stdev=26.52, samples=114 iops : min= 1, max= 40, avg=25.69, stdev= 6.68, samples=114 write: IOPS=26, BW=107KiB/s (110kB/s)(6260KiB/58239msec); 0 zone resets clat (usec): min=834, max=109489, avg=16965.61, stdev=13339.42 lat (usec): min=835, max=109490, avg=16966.94, stdev=13339.41 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2474], 10.00th=[ 3032], 20.00th=[ 4490], | 30.00th=[ 7832], 40.00th=[ 11076], 50.00th=[ 14091], 60.00th=[ 17433], | 70.00th=[ 21890], 80.00th=[ 27132], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 57410], 99.50th=[ 62653], 99.90th=[ 86508], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 21, max= 216, per=25.11%, avg=107.96, stdev=32.88, samples=114 iops : min= 5, max= 54, avg=26.62, stdev= 8.23, samples=114 lat (usec) : 50=0.07%, 100=0.65%, 250=0.75%, 1000=0.26% lat (msec) : 2=1.30%, 4=7.49%, 10=14.91%, 20=36.36%, 50=36.04% lat (msec) : 100=2.12%, 250=0.03%, 2000=0.03% cpu : usr=0.13%, sys=21.29%, ctx=9365, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182207: Mon Mar 16 07:06:40 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6052KiB/58421msec) clat (usec): min=32, max=93255, avg=20731.23, stdev=11249.62 lat (usec): min=33, max=93256, avg=20733.62, stdev=11248.69 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 7635], 10.00th=[ 9503], 20.00th=[12256], | 30.00th=[14222], 40.00th=[16450], 50.00th=[18744], 60.00th=[21365], | 70.00th=[24511], 80.00th=[28443], 90.00th=[34866], 95.00th=[41157], | 99.00th=[58459], 99.50th=[64750], 99.90th=[84411], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 32, max= 182, per=25.53%, avg=104.92, stdev=24.32, samples=114 iops : min= 8, max= 45, avg=25.87, stdev= 6.04, samples=114 write: IOPS=26, BW=107KiB/s (109kB/s)(6236KiB/58421msec); 0 zone resets clat (usec): min=856, max=1009.1k, avg=17162.91, stdev=28158.88 lat (usec): min=857, max=1009.1k, avg=17164.05, stdev=28158.90 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2442], 10.00th=[ 3097], | 20.00th=[ 4686], 30.00th=[ 7832], 40.00th=[ 11207], | 50.00th=[ 13960], 60.00th=[ 16712], 70.00th=[ 20579], | 80.00th=[ 26084], 90.00th=[ 34341], 95.00th=[ 40109], | 99.00th=[ 57410], 99.50th=[ 66847], 99.90th=[ 90702], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 40, max= 207, per=25.14%, avg=108.09, stdev=32.27, samples=114 iops : min= 10, max= 51, avg=26.66, stdev= 8.06, samples=114 lat (usec) : 50=0.07%, 100=0.65%, 250=0.72%, 500=0.10%, 1000=0.13% lat (msec) : 2=1.43%, 4=7.00%, 10=14.32%, 20=38.09%, 50=35.58% lat (msec) : 100=1.89%, 2000=0.03% cpu : usr=0.12%, sys=21.28%, ctx=9551, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=411KiB/s (421kB/s), 103KiB/s-104KiB/s (105kB/s-106kB/s), io=23.4MiB (24.6MB), run=57730-58421msec WRITE: bw=430KiB/s (441kB/s), 107KiB/s-110KiB/s (109kB/s-113kB/s), io=24.6MiB (25.7MB), run=57730-58421msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182209: Mon Mar 16 07:06:50 2026 read: IOPS=21, BW=87.9KiB/s (89.0kB/s)(5992KiB/68187msec) clat (msec): min=3, max=1067, avg=18.84, stdev=30.54 lat (msec): min=3, max=1067, avg=18.84, stdev=30.54 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 70], 99.50th=[ 78], 99.90th=[ 93], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 15, max= 264, per=25.22%, avg=88.51, stdev=55.77, samples=133 iops : min= 3, max= 66, avg=21.71, stdev=14.08, samples=133 write: IOPS=23, BW=92.3KiB/s (94.6kB/s)(6296KiB/68187msec); 0 zone resets clat (msec): min=5, max=144, avg=25.27, stdev=17.11 lat (msec): min=5, max=144, avg=25.27, stdev=17.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 47], 95.00th=[ 58], | 99.00th=[ 85], 99.50th=[ 92], 99.90th=[ 129], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 24, max= 270, per=25.18%, avg=92.66, stdev=54.57, samples=133 iops : min= 6, max= 67, avg=22.75, stdev=13.77, samples=133 lat (msec) : 4=0.16%, 10=23.73%, 20=35.55%, 50=34.54%, 100=5.79% lat (msec) : 250=0.20%, 2000=0.03% cpu : usr=0.11%, sys=11.21%, ctx=6170, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182210: Mon Mar 16 07:06:50 2026 read: IOPS=21, BW=87.2KiB/s (89.3kB/s)(5940KiB/68151msec) clat (msec): min=3, max=988, avg=18.33, stdev=28.91 lat (msec): min=3, max=988, avg=18.33, stdev=28.91 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 38], 95.00th=[ 48], | 99.00th=[ 70], 99.50th=[ 81], 99.90th=[ 107], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 15, max= 288, per=25.04%, avg=87.90, stdev=57.50, samples=133 iops : min= 3, max= 72, avg=21.56, stdev=14.50, samples=133 write: IOPS=23, BW=93.1KiB/s (95.4kB/s)(6348KiB/68151msec); 0 zone resets clat (msec): min=4, max=153, avg=25.67, stdev=17.89 lat (msec): min=4, max=153, avg=25.67, stdev=17.89 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 62], | 99.00th=[ 85], 99.50th=[ 103], 99.90th=[ 130], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 39, max= 278, per=25.40%, avg=93.49, stdev=55.35, samples=133 iops : min= 9, max= 69, avg=22.96, stdev=13.99, samples=133 lat (msec) : 4=0.13%, 10=24.32%, 20=35.38%, 50=33.14%, 100=6.67% lat (msec) : 250=0.33%, 1000=0.03% cpu : usr=0.11%, sys=11.12%, ctx=6084, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182211: Mon Mar 16 07:06:50 2026 read: IOPS=22, BW=88.3KiB/s (90.4kB/s)(6028KiB/68247msec) clat (usec): min=3207, max=97640, avg=18512.72, stdev=14927.78 lat (usec): min=3208, max=97640, avg=18513.81, stdev=14927.72 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5211], 10.00th=[ 5800], 20.00th=[ 6980], | 30.00th=[ 8586], 40.00th=[10552], 50.00th=[13173], 60.00th=[16319], | 70.00th=[21103], 80.00th=[28443], 90.00th=[39060], 95.00th=[48497], | 99.00th=[71828], 99.50th=[79168], 99.90th=[87557], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 7, max= 296, per=25.27%, avg=88.69, stdev=57.13, samples=133 iops : min= 1, max= 74, avg=21.76, stdev=14.42, samples=133 write: IOPS=22, BW=91.7KiB/s (93.9kB/s)(6260KiB/68247msec); 0 zone resets clat (msec): min=4, max=1003, avg=25.66, stdev=29.97 lat (msec): min=4, max=1003, avg=25.66, stdev=29.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 84], 99.50th=[ 101], 99.90th=[ 115], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 15, max= 272, per=24.97%, avg=91.88, stdev=57.09, samples=133 iops : min= 3, max= 68, avg=22.56, stdev=14.41, samples=133 lat (msec) : 4=0.33%, 10=25.10%, 20=33.66%, 50=33.95%, 100=6.74% lat (msec) : 250=0.20%, 2000=0.03% cpu : usr=0.09%, sys=11.09%, ctx=6060, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182212: Mon Mar 16 07:06:50 2026 read: IOPS=22, BW=89.0KiB/s (91.1kB/s)(6052KiB/67997msec) clat (usec): min=3633, max=97945, avg=18449.10, stdev=14743.18 lat (usec): min=3634, max=97946, avg=18450.14, stdev=14743.16 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5342], 10.00th=[ 5997], 20.00th=[ 7177], | 30.00th=[ 8848], 40.00th=[10945], 50.00th=[13173], 60.00th=[16319], | 70.00th=[20579], 80.00th=[27657], 90.00th=[38536], 95.00th=[51643], | 99.00th=[68682], 99.50th=[77071], 99.90th=[92799], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 7, max= 288, per=25.61%, avg=89.90, stdev=55.86, samples=133 iops : min= 1, max= 72, avg=22.06, stdev=14.11, samples=133 write: IOPS=22, BW=91.7KiB/s (93.9kB/s)(6236KiB/67997msec); 0 zone resets clat (msec): min=5, max=994, avg=25.59, stdev=29.57 lat (msec): min=5, max=994, avg=25.59, stdev=29.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 37], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 78], 99.50th=[ 103], 99.90th=[ 118], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 23, max= 280, per=25.16%, avg=92.59, stdev=56.06, samples=133 iops : min= 5, max= 70, avg=22.74, stdev=14.14, samples=133 lat (msec) : 4=0.16%, 10=24.67%, 20=34.24%, 50=33.85%, 100=6.80% lat (msec) : 250=0.23%, 1000=0.03% cpu : usr=0.14%, sys=11.24%, ctx=6032, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=352KiB/s (360kB/s), 87.2KiB/s-89.0KiB/s (89.3kB/s-91.1kB/s), io=23.4MiB (24.6MB), run=67997-68247msec WRITE: bw=368KiB/s (377kB/s), 91.7KiB/s-93.1KiB/s (93.9kB/s-95.4kB/s), io=24.6MiB (25.7MB), run=67997-68247msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182239: Mon Mar 16 07:07:14 2026 read: IOPS=21, BW=350KiB/s (359kB/s)(5920KiB/16900msec) clat (usec): min=66, max=82079, avg=23076.63, stdev=12356.99 lat (usec): min=67, max=82080, avg=23078.51, stdev=12357.37 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 126], 10.00th=[10159], 20.00th=[13566], | 30.00th=[17433], 40.00th=[19530], 50.00th=[22414], 60.00th=[24511], | 70.00th=[27132], 80.00th=[31065], 90.00th=[38011], 95.00th=[42206], | 99.00th=[70779], 99.50th=[80217], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 160, max= 572, per=24.39%, avg=345.64, stdev=94.83, samples=33 iops : min= 10, max= 35, avg=21.06, stdev= 5.99, samples=33 write: IOPS=23, BW=377KiB/s (386kB/s)(6368KiB/16900msec); 0 zone resets clat (usec): min=1555, max=84508, avg=20824.59, stdev=14784.82 lat (usec): min=1556, max=84511, avg=20826.64, stdev=14784.85 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 3916], 10.00th=[ 5145], 20.00th=[ 7111], | 30.00th=[10683], 40.00th=[13566], 50.00th=[17171], 60.00th=[22152], | 70.00th=[27395], 80.00th=[32113], 90.00th=[43254], 95.00th=[49021], | 99.00th=[66847], 99.50th=[74974], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 160, max= 576, per=25.20%, avg=375.67, stdev=109.60, samples=33 iops : min= 10, max= 36, avg=22.97, stdev= 6.74, samples=33 lat (usec) : 100=1.04%, 250=2.08% lat (msec) : 2=0.91%, 4=2.08%, 10=13.28%, 20=30.21%, 50=47.14% lat (msec) : 100=3.26% cpu : usr=0.11%, sys=24.48%, ctx=2721, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182240: Mon Mar 16 07:07:14 2026 read: IOPS=21, BW=342KiB/s (350kB/s)(5744KiB/16807msec) clat (usec): min=62, max=89541, avg=23506.79, stdev=12978.51 lat (usec): min=63, max=89542, avg=23507.96, stdev=12978.60 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 176], 10.00th=[10290], 20.00th=[14615], | 30.00th=[17171], 40.00th=[19530], 50.00th=[21890], 60.00th=[23987], | 70.00th=[26870], 80.00th=[32113], 90.00th=[39060], 95.00th=[47973], | 99.00th=[65274], 99.50th=[71828], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 181, max= 542, per=23.98%, avg=339.85, stdev=83.98, samples=33 iops : min= 11, max= 33, avg=20.73, stdev= 5.20, samples=33 write: IOPS=24, BW=389KiB/s (399kB/s)(6544KiB/16807msec); 0 zone resets clat (usec): min=1507, max=74704, avg=20368.98, stdev=14345.19 lat (usec): min=1508, max=74707, avg=20371.12, stdev=14345.41 clat percentiles (usec): | 1.00th=[ 2147], 5.00th=[ 3949], 10.00th=[ 4621], 20.00th=[ 7242], | 30.00th=[11207], 40.00th=[14222], 50.00th=[16909], 60.00th=[20317], | 70.00th=[26346], 80.00th=[31589], 90.00th=[39584], 95.00th=[46400], | 99.00th=[69731], 99.50th=[71828], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 254, max= 640, per=26.02%, avg=388.00, stdev=91.97, samples=33 iops : min= 15, max= 40, avg=23.73, stdev= 5.84, samples=33 lat (usec) : 100=0.78%, 250=1.82%, 500=0.13%, 750=0.13% lat (msec) : 2=0.52%, 4=2.34%, 10=12.89%, 20=32.68%, 50=45.05% lat (msec) : 100=3.65% cpu : usr=0.09%, sys=24.75%, ctx=2796, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182241: Mon Mar 16 07:07:14 2026 read: IOPS=23, BW=382KiB/s (391kB/s)(6256KiB/16373msec) clat (usec): min=36, max=82855, avg=22565.10, stdev=13092.53 lat (usec): min=37, max=82857, avg=22566.77, stdev=13092.62 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 129], 10.00th=[ 9241], 20.00th=[13435], | 30.00th=[15926], 40.00th=[18220], 50.00th=[21627], 60.00th=[24249], | 70.00th=[26870], 80.00th=[31065], 90.00th=[37487], 95.00th=[43779], | 99.00th=[71828], 99.50th=[79168], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 191, max= 606, per=26.84%, avg=380.38, stdev=98.36, samples=32 iops : min= 11, max= 37, avg=23.25, stdev= 6.26, samples=32 write: IOPS=23, BW=368KiB/s (377kB/s)(6032KiB/16373msec); 0 zone resets clat (usec): min=1768, max=83506, avg=19815.90, stdev=15256.70 lat (usec): min=1771, max=83508, avg=19820.22, stdev=15254.88 clat percentiles (usec): | 1.00th=[ 2442], 5.00th=[ 4047], 10.00th=[ 4686], 20.00th=[ 6063], | 30.00th=[ 9372], 40.00th=[12125], 50.00th=[15664], 60.00th=[19530], | 70.00th=[24511], 80.00th=[31327], 90.00th=[42730], 95.00th=[51119], | 99.00th=[69731], 99.50th=[81265], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 160, max= 670, per=24.22%, avg=361.19, stdev=114.42, samples=32 iops : min= 10, max= 41, avg=22.06, stdev= 7.05, samples=32 lat (usec) : 50=0.26%, 100=0.91%, 250=2.60%, 500=0.13% lat (msec) : 2=0.26%, 4=2.21%, 10=15.49%, 20=31.51%, 50=42.19% lat (msec) : 100=4.43% cpu : usr=0.12%, sys=24.77%, ctx=2702, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182242: Mon Mar 16 07:07:14 2026 read: IOPS=22, BW=365KiB/s (374kB/s)(6032KiB/16519msec) clat (usec): min=43, max=72643, avg=22556.42, stdev=13093.74 lat (usec): min=45, max=72644, avg=22558.16, stdev=13092.91 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 124], 10.00th=[ 7111], 20.00th=[12780], | 30.00th=[15795], 40.00th=[18220], 50.00th=[21365], 60.00th=[24249], | 70.00th=[28181], 80.00th=[32900], 90.00th=[39584], 95.00th=[46400], | 99.00th=[57410], 99.50th=[62129], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 126, max= 637, per=25.23%, avg=357.50, stdev=122.14, samples=32 iops : min= 7, max= 39, avg=21.81, stdev= 7.63, samples=32 write: IOPS=23, BW=379KiB/s (388kB/s)(6256KiB/16519msec); 0 zone resets clat (usec): min=1375, max=75027, avg=20186.10, stdev=14585.50 lat (usec): min=1377, max=75029, avg=20188.42, stdev=14585.51 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 4146], 10.00th=[ 4948], 20.00th=[ 7177], | 30.00th=[ 9896], 40.00th=[13698], 50.00th=[16909], 60.00th=[20055], | 70.00th=[24773], 80.00th=[31327], 90.00th=[40109], 95.00th=[49021], | 99.00th=[70779], 99.50th=[73925], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 191, max= 574, per=25.10%, avg=374.19, stdev=97.25, samples=32 iops : min= 11, max= 35, avg=22.84, stdev= 6.05, samples=32 lat (usec) : 50=0.26%, 100=1.17%, 250=2.86%, 500=0.26% lat (msec) : 2=0.65%, 4=1.69%, 10=15.23%, 20=30.47%, 50=43.36% lat (msec) : 100=4.04% cpu : usr=0.13%, sys=24.89%, ctx=2669, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1417KiB/s (1451kB/s), 342KiB/s-382KiB/s (350kB/s-391kB/s), io=23.4MiB (24.5MB), run=16373-16900msec WRITE: bw=1491KiB/s (1527kB/s), 368KiB/s-389KiB/s (377kB/s-399kB/s), io=24.6MiB (25.8MB), run=16373-16900msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182235: Mon Mar 16 07:07:17 2026 read: IOPS=18, BW=297KiB/s (305kB/s)(5920KiB/19903msec) clat (usec): min=3718, max=96551, avg=22218.57, stdev=16927.62 lat (usec): min=3719, max=96551, avg=22219.64, stdev=16927.66 clat percentiles (usec): | 1.00th=[ 4359], 5.00th=[ 6325], 10.00th=[ 7177], 20.00th=[ 9110], | 30.00th=[11863], 40.00th=[13566], 50.00th=[15926], 60.00th=[19268], | 70.00th=[24249], 80.00th=[34341], 90.00th=[47449], 95.00th=[59507], | 99.00th=[78119], 99.50th=[89654], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 96, max= 832, per=23.81%, avg=286.49, stdev=163.65, samples=39 iops : min= 6, max= 52, avg=17.38, stdev=10.42, samples=39 write: IOPS=19, BW=320KiB/s (328kB/s)(6368KiB/19903msec); 0 zone resets clat (msec): min=6, max=105, avg=29.22, stdev=19.85 lat (msec): min=6, max=105, avg=29.22, stdev=19.85 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 60], 95.00th=[ 73], | 99.00th=[ 91], 99.50th=[ 101], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 94, max= 832, per=24.71%, avg=312.77, stdev=161.88, samples=39 iops : min= 5, max= 52, avg=19.05, stdev=10.33, samples=39 lat (msec) : 4=0.26%, 10=15.63%, 20=35.94%, 50=36.07%, 100=11.85% lat (msec) : 250=0.26% cpu : usr=0.14%, sys=11.58%, ctx=1782, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182236: Mon Mar 16 07:07:17 2026 read: IOPS=18, BW=292KiB/s (299kB/s)(5744KiB/19690msec) clat (msec): min=4, max=106, avg=22.16, stdev=17.17 lat (msec): min=4, max=106, avg=22.16, stdev=17.17 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 46], 95.00th=[ 62], | 99.00th=[ 83], 99.50th=[ 104], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 95, max= 704, per=24.10%, avg=289.95, stdev=153.72, samples=39 iops : min= 5, max= 44, avg=17.62, stdev= 9.78, samples=39 write: IOPS=20, BW=332KiB/s (340kB/s)(6544KiB/19690msec); 0 zone resets clat (msec): min=6, max=130, avg=28.63, stdev=18.67 lat (msec): min=6, max=130, avg=28.63, stdev=18.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 54], 95.00th=[ 66], | 99.00th=[ 88], 99.50th=[ 106], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 127, max= 864, per=26.05%, avg=329.77, stdev=184.87, samples=39 iops : min= 7, max= 54, avg=20.10, stdev=11.78, samples=39 lat (msec) : 10=15.10%, 20=36.20%, 50=38.41%, 100=9.64%, 250=0.65% cpu : usr=0.07%, sys=11.90%, ctx=1665, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182237: Mon Mar 16 07:07:17 2026 read: IOPS=19, BW=316KiB/s (324kB/s)(6256KiB/19799msec) clat (msec): min=4, max=108, avg=21.91, stdev=16.87 lat (msec): min=4, max=108, avg=21.91, stdev=16.87 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 48], 95.00th=[ 60], | 99.00th=[ 77], 99.50th=[ 106], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 96, max= 1056, per=26.15%, avg=314.62, stdev=200.56, samples=39 iops : min= 6, max= 66, avg=19.15, stdev=12.74, samples=39 write: IOPS=19, BW=305KiB/s (312kB/s)(6032KiB/19799msec); 0 zone resets clat (msec): min=6, max=130, avg=29.44, stdev=20.08 lat (msec): min=6, max=130, avg=29.45, stdev=20.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 43], 90.00th=[ 57], 95.00th=[ 71], | 99.00th=[ 93], 99.50th=[ 116], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 95, max= 704, per=23.61%, avg=298.85, stdev=167.46, samples=39 iops : min= 5, max= 44, avg=18.18, stdev=10.68, samples=39 lat (msec) : 10=16.67%, 20=35.03%, 50=36.20%, 100=11.59%, 250=0.52% cpu : usr=0.09%, sys=11.77%, ctx=1672, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182238: Mon Mar 16 07:07:17 2026 read: IOPS=19, BW=305KiB/s (312kB/s)(6032KiB/19804msec) clat (msec): min=4, max=108, avg=22.11, stdev=16.21 lat (msec): min=4, max=108, avg=22.11, stdev=16.21 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 59], | 99.00th=[ 79], 99.50th=[ 93], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 158, max= 800, per=25.05%, avg=301.36, stdev=168.12, samples=39 iops : min= 9, max= 50, avg=18.33, stdev=10.70, samples=39 write: IOPS=19, BW=316KiB/s (323kB/s)(6256KiB/19804msec); 0 zone resets clat (msec): min=6, max=122, avg=29.07, stdev=19.17 lat (msec): min=6, max=122, avg=29.07, stdev=19.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 55], 95.00th=[ 66], | 99.00th=[ 99], 99.50th=[ 108], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 127, max= 832, per=24.64%, avg=312.00, stdev=171.40, samples=39 iops : min= 7, max= 52, avg=19.00, stdev=10.91, samples=39 lat (msec) : 10=15.49%, 20=35.16%, 50=38.54%, 100=10.29%, 250=0.52% cpu : usr=0.11%, sys=11.97%, ctx=1743, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1203KiB/s (1232kB/s), 292KiB/s-316KiB/s (299kB/s-324kB/s), io=23.4MiB (24.5MB), run=19690-19903msec WRITE: bw=1266KiB/s (1297kB/s), 305KiB/s-332KiB/s (312kB/s-340kB/s), io=24.6MiB (25.8MB), run=19690-19903msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182250: Mon Mar 16 07:07:26 2026 read: IOPS=3, BW=3372KiB/s (3453kB/s)(7168KiB/2126msec) clat (usec): min=499, max=277405, avg=121399.39, stdev=82742.14 lat (usec): min=500, max=277407, avg=121404.04, stdev=82741.69 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 89654], | 30.00th=[ 99091], 40.00th=[ 99091], 50.00th=[109577], 60.00th=[133694], | 70.00th=[133694], 80.00th=[139461], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2039, max= 5111, per=54.68%, avg=2810.25, stdev=1533.84, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=2, BW=2408KiB/s (2466kB/s)(5120KiB/2126msec); 0 zone resets clat (msec): min=59, max=435, avg=252.53, stdev=160.13 lat (msec): min=59, max=435, avg=252.60, stdev=160.13 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2043, max= 4079, per=37.86%, avg=2723.33, stdev=1174.04, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=25.00%, 250=33.33%, 500=33.33% cpu : usr=0.09%, sys=50.99%, ctx=972, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182251: Mon Mar 16 07:07:26 2026 read: IOPS=0, BW=560KiB/s (574kB/s)(2048KiB/3655msec) clat (usec): min=565, max=146930, avg=73748.27, stdev=103495.95 lat (usec): min=566, max=146933, avg=73750.20, stdev=103497.14 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 570], 40.00th=[ 570], 50.00th=[ 570], 60.00th=[147850], | 70.00th=[147850], 80.00th=[147850], 90.00th=[147850], 95.00th=[147850], | 99.00th=[147850], 99.50th=[147850], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 1700, max= 2039, per=36.38%, avg=1869.50, stdev=239.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2802KiB/s (2869kB/s)(10.0MiB/3655msec); 0 zone resets clat (msec): min=92, max=832, avg=335.46, stdev=245.74 lat (msec): min=93, max=832, avg=338.12, stdev=246.05 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 127], | 30.00th=[ 174], 40.00th=[ 218], 50.00th=[ 239], 60.00th=[ 264], | 70.00th=[ 351], 80.00th=[ 355], 90.00th=[ 709], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2039, max= 6144, per=51.20%, avg=3683.60, stdev=1716.83, samples=5 iops : min= 1, max= 6, avg= 3.20, stdev= 2.17, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.08%, sys=46.25%, ctx=177, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182252: Mon Mar 16 07:07:26 2026 read: IOPS=1, BW=1542KiB/s (1579kB/s)(6144KiB/3985msec) clat (usec): min=575, max=1002.4k, avg=287489.93, stdev=365084.16 lat (usec): min=577, max=1002.4k, avg=287491.33, stdev=365084.05 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], | 20.00th=[ 95945], 30.00th=[ 95945], 40.00th=[ 149947], | 50.00th=[ 149947], 60.00th=[ 160433], 70.00th=[ 316670], | 80.00th=[ 316670], 90.00th=[1002439], 95.00th=[1002439], | 99.00th=[1002439], 99.50th=[1002439], 99.90th=[1002439], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 1961, max= 4096, per=52.54%, avg=2700.00, stdev=1209.67, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1542KiB/s (1579kB/s)(6144KiB/3985msec); 0 zone resets clat (msec): min=121, max=942, avg=370.64, stdev=308.16 lat (msec): min=121, max=942, avg=370.69, stdev=308.17 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 401], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2043, max= 3401, per=34.71%, avg=2497.33, stdev=782.60, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=31.98%, ctx=886, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182253: Mon Mar 16 07:07:26 2026 read: IOPS=1, BW=1765KiB/s (1807kB/s)(5120KiB/2901msec) clat (usec): min=539, max=195838, avg=106815.06, stdev=97845.09 lat (usec): min=540, max=195839, avg=106816.34, stdev=97845.04 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[160433], 60.00th=[160433], | 70.00th=[177210], 80.00th=[177210], 90.00th=[196084], 95.00th=[196084], | 99.00th=[196084], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 2043, max= 6119, per=79.41%, avg=4081.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2471KiB/s (2530kB/s)(7168KiB/2901msec); 0 zone resets clat (msec): min=111, max=849, avg=329.41, stdev=260.87 lat (msec): min=111, max=849, avg=329.49, stdev=260.87 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 133], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 292], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 460], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1700, max= 4096, per=41.42%, avg=2979.50, stdev=1287.07, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=43.62%, ctx=456, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5139KiB/s (5263kB/s), 560KiB/s-3372KiB/s (574kB/s-3453kB/s), io=20.0MiB (20.0MB), run=2126-3985msec WRITE: bw=7195KiB/s (7368kB/s), 1542KiB/s-2802KiB/s (1579kB/s-2869kB/s), io=28.0MiB (29.4MB), run=2126-3985msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182255: Mon Mar 16 07:07:26 2026 read: IOPS=1, BW=1988KiB/s (2036kB/s)(7168KiB/3605msec) clat (msec): min=41, max=651, avg=178.72, stdev=215.81 lat (msec): min=41, max=651, avg=178.72, stdev=215.81 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 54], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 81], 60.00th=[ 155], | 70.00th=[ 155], 80.00th=[ 199], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1709, max= 4096, per=65.06%, avg=3297.33, stdev=1375.54, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1420KiB/s (1454kB/s)(5120KiB/3605msec); 0 zone resets clat (msec): min=174, max=965, avg=441.15, stdev=338.93 lat (msec): min=174, max=965, avg=441.22, stdev=338.91 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2019, max= 2048, per=28.73%, avg=2038.33, stdev=16.74, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=8.33%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=18.76%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182256: Mon Mar 16 07:07:26 2026 read: IOPS=0, BW=510KiB/s (523kB/s)(2048KiB/4013msec) clat (msec): min=58, max=464, avg=261.51, stdev=287.72 lat (msec): min=58, max=464, avg=261.51, stdev=287.72 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 58], 40.00th=[ 58], 50.00th=[ 58], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1703, max= 2043, per=36.96%, avg=1873.00, stdev=240.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2552KiB/s (2613kB/s)(10.0MiB/4013msec); 0 zone resets clat (msec): min=42, max=1227, avg=342.75, stdev=340.92 lat (msec): min=42, max=1227, avg=342.84, stdev=340.93 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 63], | 30.00th=[ 126], 40.00th=[ 232], 50.00th=[ 268], 60.00th=[ 271], | 70.00th=[ 326], 80.00th=[ 380], 90.00th=[ 493], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 2019, max= 6131, per=40.28%, avg=2857.80, stdev=1829.81, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.64, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=50.00%, 2000=8.33% cpu : usr=0.02%, sys=20.16%, ctx=197, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182257: Mon Mar 16 07:07:26 2026 read: IOPS=1, BW=1520KiB/s (1557kB/s)(6144KiB/4041msec) clat (msec): min=24, max=899, avg=222.43, stdev=341.71 lat (msec): min=24, max=899, avg=222.44, stdev=341.71 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 25], 10.00th=[ 25], 20.00th=[ 51], | 30.00th=[ 51], 40.00th=[ 54], 50.00th=[ 54], 60.00th=[ 59], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2048, max= 4087, per=53.82%, avg=2727.67, stdev=1177.22, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 write: IOPS=1, BW=1520KiB/s (1557kB/s)(6144KiB/4041msec); 0 zone resets clat (msec): min=94, max=987, avg=425.58, stdev=327.02 lat (msec): min=94, max=987, avg=425.67, stdev=327.03 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 405], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1684, max= 2048, per=27.55%, avg=1954.50, stdev=180.35, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=16.67%, 750=8.33% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=14.21%, ctx=151, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182258: Mon Mar 16 07:07:26 2026 read: IOPS=1, BW=1336KiB/s (1368kB/s)(5120KiB/3832msec) clat (msec): min=48, max=386, avg=147.48, stdev=137.38 lat (msec): min=48, max=386, avg=147.49, stdev=137.38 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 49], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 112], 60.00th=[ 112], | 70.00th=[ 127], 80.00th=[ 127], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 4039, max= 4087, per=80.17%, avg=4063.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1871KiB/s (1915kB/s)(7168KiB/3832msec); 0 zone resets clat (msec): min=80, max=943, avg=420.97, stdev=365.66 lat (msec): min=81, max=943, avg=421.05, stdev=365.67 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 83], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 372], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 894], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1706, max= 2048, per=27.66%, avg=1962.50, stdev=171.00, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=25.00%, 1000=16.67% cpu : usr=0.00%, sys=12.53%, ctx=140, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5068KiB/s (5190kB/s), 510KiB/s-1988KiB/s (523kB/s-2036kB/s), io=20.0MiB (20.0MB), run=3605-4041msec WRITE: bw=7095KiB/s (7266kB/s), 1420KiB/s-2552KiB/s (1454kB/s-2613kB/s), io=28.0MiB (29.4MB), run=3605-4041msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182265: Mon Mar 16 07:07:35 2026 read: IOPS=2, BW=8828KiB/s (9039kB/s)(12.0MiB/1392msec) clat (msec): min=413, max=476, avg=442.35, stdev=31.45 lat (msec): min=413, max=476, avg=442.35, stdev=31.45 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 6150, max= 7876, per=91.22%, avg=7013.00, stdev=1220.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=49.03%, ctx=2668, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182267: Mon Mar 16 07:07:35 2026 read: IOPS=0, BW=1922KiB/s (1968kB/s)(4096KiB/2131msec) clat (nsec): min=474146k, max=474146k, avg=474145930.00, stdev= 0.00 lat (nsec): min=474148k, max=474148k, avg=474147582.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 5587, max= 5587, per=72.67%, avg=5587.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3844KiB/s (3936kB/s)(8192KiB/2131msec); 0 zone resets clat (msec): min=227, max=1359, avg=793.61, stdev=800.97 lat (msec): min=227, max=1360, avg=793.81, stdev=801.05 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.35%, ctx=914, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182269: Mon Mar 16 07:07:35 2026 write: IOPS=1, BW=6231KiB/s (6381kB/s)(12.0MiB/1972msec); 0 zone resets clat (msec): min=264, max=1193, avg=642.13, stdev=488.31 lat (msec): min=265, max=1193, avg=642.44, stdev=488.33 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min=16157, max=16157, per=100.00%, avg=16157.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.50%, ctx=64, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182271: Mon Mar 16 07:07:35 2026 write: IOPS=1, BW=6892KiB/s (7057kB/s)(12.0MiB/1783msec); 0 zone resets clat (msec): min=467, max=743, avg=577.97, stdev=146.16 lat (msec): min=467, max=743, avg=578.22, stdev=146.07 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7876, max= 8078, per=51.88%, avg=7977.00, stdev=142.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=15.77%, ctx=74, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7688KiB/s (7873kB/s), 1922KiB/s-8828KiB/s (1968kB/s-9039kB/s), io=16.0MiB (16.8MB), run=1392-2131msec WRITE: bw=15.0MiB/s (15.7MB/s), 3844KiB/s-6892KiB/s (3936kB/s-7057kB/s), io=32.0MiB (33.6MB), run=1783-2131msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182266: Mon Mar 16 07:07:35 2026 read: IOPS=2, BW=9.79MiB/s (10.3MB/s)(12.0MiB/1226msec) clat (msec): min=188, max=748, avg=400.35, stdev=303.86 lat (msec): min=188, max=748, avg=400.36, stdev=303.86 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min=11736, max=11736, per=100.00%, avg=11736.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=19.67%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182268: Mon Mar 16 07:07:35 2026 read: IOPS=0, BW=2127KiB/s (2178kB/s)(4096KiB/1926msec) clat (nsec): min=541969k, max=541969k, avg=541968872.00, stdev= 0.00 lat (nsec): min=541971k, max=541971k, avg=541970844.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 6077, max= 6077, per=71.44%, avg=6077.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4253KiB/s (4355kB/s)(8192KiB/1926msec); 0 zone resets clat (msec): min=208, max=1152, avg=680.86, stdev=667.33 lat (msec): min=209, max=1152, avg=681.12, stdev=667.31 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.90%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182270: Mon Mar 16 07:07:35 2026 write: IOPS=1, BW=5908KiB/s (6049kB/s)(12.0MiB/2080msec); 0 zone resets clat (msec): min=157, max=1590, avg=683.87, stdev=788.22 lat (msec): min=157, max=1590, avg=684.13, stdev=788.26 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8062, max= 8062, per=51.18%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.70%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182272: Mon Mar 16 07:07:35 2026 write: IOPS=1, BW=7979KiB/s (8171kB/s)(12.0MiB/1540msec); 0 zone resets clat (msec): min=325, max=819, avg=493.28, stdev=282.15 lat (msec): min=325, max=819, avg=493.54, stdev=282.12 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 5910, max= 7922, per=43.90%, avg=6916.00, stdev=1422.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=16.31%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8507KiB/s (8711kB/s), 2127KiB/s-9.79MiB/s (2178kB/s-10.3MB/s), io=16.0MiB (16.8MB), run=1226-1926msec WRITE: bw=15.4MiB/s (16.1MB/s), 4253KiB/s-7979KiB/s (4355kB/s-8171kB/s), io=32.0MiB (33.6MB), run=1540-2080msec