== sanity test 123ad: Verify batching statahead works correctly ========================================================== 19:00:37 (1780527637) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats=0 llite.lustre-ffff8a875017f800.statahead_max=32 llite.lustre-ffff8a875017f800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats=0 total: 100 open/close in 0.58 seconds: 172.45 ops/second llite.lustre-ffff8a875017f800.statahead_max=0 101 real 0m0.533s user 0m0.004s sys 0m0.219s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8a875017f800.statahead_max=32 llite.lustre-ffff8a875017f800.statahead_max=32 101 real 0m0.487s user 0m0.001s sys 0m0.320s 'ls -l' 100 files with statahead: 0 sec statahead total: 56 statahead wrong: 1 agl total: 52 list_total: 26 fname_total: 30 hit_total: 13524 miss_total: 209 swrong=1 ewrong=1 total: 900 open/close in 1.79 seconds: 501.65 ops/second llite.lustre-ffff8a875017f800.statahead_max=0 1001 real 0m5.325s user 0m0.016s sys 0m2.164s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff8a875017f800.statahead_max=32 llite.lustre-ffff8a875017f800.statahead_max=32 1001 real 0m4.162s user 0m0.016s sys 0m2.549s 'ls -l' 1000 files with statahead: 4 sec statahead total: 57 statahead wrong: 1 agl total: 53 list_total: 27 fname_total: 30 hit_total: 14523 miss_total: 210 swrong=1 ewrong=1 - open/close 4946 (time 1780527667.05 total 10.00 last 494.50) total: 9000 open/close in 18.32 seconds: 491.18 ops/second llite.lustre-ffff8a875017f800.statahead_max=0 10001 real 1m2.862s user 0m0.242s sys 0m23.923s 'ls -l' 10000 files without statahead: 63 sec llite.lustre-ffff8a875017f800.statahead_max=32 llite.lustre-ffff8a875017f800.statahead_max=32 10001 real 0m42.432s user 0m0.209s sys 0m24.832s 'ls -l' 10000 files with statahead: 43 sec statahead total: 58 statahead wrong: 1 agl total: 54 list_total: 28 fname_total: 30 hit_total: 24522 miss_total: 211 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 73 seconds llite.lustre-ffff8a875017f800.statahead_stats= statahead total: 58 statahead wrong: 1 agl total: 54 list_total: 28 fname_total: 30 hit_total: 24522 miss_total: 211 mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats= snapshot_time: 1780527867.420372690 secs.nsecs start_time: 1780527639.220583605 secs.nsecs elapsed_time: 228.199789085 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 0 0 0 4: 1 0 0 8: 3 0 1 16: 4 1 2 32: 346 97 100 - open/close 4512 (time 1780527878.66 total 10.00 last 451.16) - open/close 9009 (time 1780527888.67 total 20.00 last 449.58) total: 10000 open/close in 22.14 seconds: 451.60 ops/second llite.lustre-ffff8a875017f800.statahead_batch_max=0 llite.lustre-ffff8a875017f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a875017f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.596s user 0m0.168s sys 0m45.461s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a875017f800.statahead_batch_max=32 llite.lustre-ffff8a875017f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a875017f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.926s user 0m0.153s sys 0m29.768s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats= snapshot_time: 1780527996.809292344 secs.nsecs start_time: 1780527941.727234245 secs.nsecs elapsed_time: 55.082058099 secs.nsecs subreqs per batch batches % cum % 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 1 32: 312 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats=0 llite.lustre-ffff8a875017f800.statahead_max=2048 llite.lustre-ffff8a875017f800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats=0 total: 100 open/close in 1.43 seconds: 70.06 ops/second llite.lustre-ffff8a875017f800.statahead_max=0 101 real 0m0.671s user 0m0.003s sys 0m0.236s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8a875017f800.statahead_max=2048 llite.lustre-ffff8a875017f800.statahead_max=2048 101 real 0m0.364s user 0m0.003s sys 0m0.203s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.95 seconds: 461.26 ops/second llite.lustre-ffff8a875017f800.statahead_max=0 1001 real 0m6.116s user 0m0.017s sys 0m2.390s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8a875017f800.statahead_max=2048 llite.lustre-ffff8a875017f800.statahead_max=2048 1001 real 0m4.989s user 0m0.013s sys 0m1.543s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8a875017f800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats= snapshot_time: 1780528114.364771536 secs.nsecs start_time: 1780527997.705759491 secs.nsecs elapsed_time: 116.659012045 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 4520 (time 1780528125.13 total 10.00 last 451.91) - open/close 9076 (time 1780528135.13 total 20.00 last 455.58) total: 10000 open/close in 21.99 seconds: 454.73 ops/second llite.lustre-ffff8a875017f800.statahead_batch_max=0 llite.lustre-ffff8a875017f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a875017f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.088s user 0m0.151s sys 0m29.412s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a875017f800.statahead_batch_max=256 llite.lustre-ffff8a875017f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a875017f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.597s user 0m0.152s sys 0m20.600s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a875017f800.batch_stats= snapshot_time: 1780528210.253246028 secs.nsecs start_time: 1780528174.311598060 secs.nsecs elapsed_time: 35.941647968 secs.nsecs subreqs per batch batches % cum % 1: 339 63 63 2: 73 13 77 4: 44 8 85 8: 13 2 88 16: 7 1 89 32: 20 3 93 64: 2 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a875017f800.statahead_batch_max=64 llite.lustre-ffff8a875017f800.statahead_max=128