== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:53:44 (1781232824) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats=0 llite.lustre-ffff941404194800.statahead_max=32 llite.lustre-ffff941404194800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats=0 total: 100 open/close in 1.17 seconds: 85.50 ops/second llite.lustre-ffff941404194800.statahead_max=0 101 real 0m1.303s user 0m0.005s sys 0m0.313s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff941404194800.statahead_max=32 llite.lustre-ffff941404194800.statahead_max=32 101 real 0m0.545s user 0m0.003s sys 0m0.222s 'ls -l' 100 files with statahead: 1 sec statahead total: 73 statahead wrong: 2 agl total: 69 list_total: 27 fname_total: 44 hit_total: 3663 miss_total: 513 swrong=2 ewrong=2 total: 900 open/close in 5.75 seconds: 156.39 ops/second llite.lustre-ffff941404194800.statahead_max=0 1001 real 0m11.013s user 0m0.032s sys 0m2.893s 'ls -l' 1000 files without statahead: 11 sec llite.lustre-ffff941404194800.statahead_max=32 llite.lustre-ffff941404194800.statahead_max=32 1001 real 0m4.585s user 0m0.018s sys 0m1.988s 'ls -l' 1000 files with statahead: 5 sec statahead total: 74 statahead wrong: 2 agl total: 70 list_total: 28 fname_total: 44 hit_total: 4662 miss_total: 514 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff941404194800.statahead_stats= statahead total: 74 statahead wrong: 2 agl total: 70 list_total: 28 fname_total: 44 hit_total: 4662 miss_total: 514 mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats= snapshot_time: 1781232867.519782964 secs.nsecs start_time: 1781232826.303026788 secs.nsecs elapsed_time: 41.216756176 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 1706 (time 1781232878.61 total 10.01 last 170.50) - open/close 3392 (time 1781232888.61 total 20.01 last 168.60) - open/close 5121 (time 1781232898.61 total 30.01 last 172.89) - open/close 6666 (time 1781232908.62 total 40.01 last 154.39) - open/close 8037 (time 1781232918.63 total 50.02 last 137.01) - open/close 9402 (time 1781232928.63 total 60.02 last 136.45) total: 10000 open/close in 64.07 seconds: 156.08 ops/second llite.lustre-ffff941404194800.statahead_batch_max=0 llite.lustre-ffff941404194800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff941404194800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.395s user 0m0.295s sys 0m30.864s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff941404194800.statahead_batch_max=32 llite.lustre-ffff941404194800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff941404194800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.529s user 0m0.222s sys 0m21.215s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats= snapshot_time: 1781233028.449019022 secs.nsecs start_time: 1781232975.343479410 secs.nsecs elapsed_time: 53.105539612 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats=0 llite.lustre-ffff941404194800.statahead_max=2048 llite.lustre-ffff941404194800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats=0 total: 100 open/close in 1.50 seconds: 66.54 ops/second llite.lustre-ffff941404194800.statahead_max=0 101 real 0m1.288s user 0m0.007s sys 0m0.304s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff941404194800.statahead_max=2048 llite.lustre-ffff941404194800.statahead_max=2048 101 real 0m0.364s user 0m0.002s sys 0m0.190s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 total: 900 open/close in 6.28 seconds: 143.38 ops/second llite.lustre-ffff941404194800.statahead_max=0 1001 real 0m14.092s user 0m0.033s sys 0m2.914s 'ls -l' 1000 files without statahead: 14 sec llite.lustre-ffff941404194800.statahead_max=2048 llite.lustre-ffff941404194800.statahead_max=2048 1001 real 0m3.700s user 0m0.025s sys 0m1.853s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 10 seconds llite.lustre-ffff941404194800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats= snapshot_time: 1781233236.669738919 secs.nsecs start_time: 1781233029.481129670 secs.nsecs elapsed_time: 207.188609249 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 1 8 58 128: 1 8 66 256: 4 33 100 - open/close 1098 (time 1781233248.28 total 10.00 last 109.76) - open/close 2135 (time 1781233258.29 total 20.01 last 103.65) - open/close 3218 (time 1781233268.29 total 30.02 last 108.23) - open/close 4343 (time 1781233278.30 total 40.02 last 112.41) - open/close 5531 (time 1781233288.31 total 50.03 last 118.71) - open/close 6873 (time 1781233298.31 total 60.04 last 134.11) - open/close 8174 (time 1781233308.32 total 70.04 last 130.05) - open/close 9427 (time 1781233318.33 total 80.05 last 125.18) total: 10000 open/close in 84.97 seconds: 117.69 ops/second llite.lustre-ffff941404194800.statahead_batch_max=0 llite.lustre-ffff941404194800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff941404194800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.803s user 0m0.289s sys 0m25.054s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff941404194800.statahead_batch_max=256 llite.lustre-ffff941404194800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff941404194800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.274s user 0m0.245s sys 0m21.026s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff941404194800.batch_stats= snapshot_time: 1781233411.232551961 secs.nsecs start_time: 1781233366.461873163 secs.nsecs elapsed_time: 44.770678798 secs.nsecs subreqs per batch batches % cum % 1: 351 55 55 2: 125 19 75 4: 70 11 86 8: 25 3 90 16: 8 1 91 32: 13 2 93 64: 7 1 94 128: 0 0 94 256: 33 5 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff941404194800.statahead_batch_max=64 llite.lustre-ffff941404194800.statahead_max=128