== sanity test 123ad: Verify batching statahead works correctly ========================================================== 14:35:59 (1782930959) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats=0 llite.lustre-ffff9338c8796800.statahead_max=32 llite.lustre-ffff9338c8796800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.73 seconds: 136.23 ops/second llite.lustre-ffff9338c8796800.statahead_max=0 101 real 0m0.706s user 0m0.005s sys 0m0.267s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9338c8796800.statahead_max=32 llite.lustre-ffff9338c8796800.statahead_max=32 101 real 0m0.445s user 0m0.003s sys 0m0.248s 'ls -l' 100 files with statahead: 0 sec statahead total: 52 statahead wrong: 1 agl total: 49 list_total: 22 fname_total: 30 hit_total: 4071 miss_total: 181 swrong=1 ewrong=1 total: 900 open/close in 1.85 seconds: 485.46 ops/second llite.lustre-ffff9338c8796800.statahead_max=0 1001 real 0m6.145s user 0m0.017s sys 0m2.358s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9338c8796800.statahead_max=32 llite.lustre-ffff9338c8796800.statahead_max=32 1001 real 0m4.587s user 0m0.023s sys 0m2.348s 'ls -l' 1000 files with statahead: 4 sec statahead total: 53 statahead wrong: 1 agl total: 50 list_total: 23 fname_total: 30 hit_total: 5070 miss_total: 182 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff9338c8796800.statahead_stats= statahead total: 53 statahead wrong: 1 agl total: 50 list_total: 23 fname_total: 30 hit_total: 5070 miss_total: 182 mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats= snapshot_time: 1782930987.321588011 secs.nsecs start_time: 1782930960.813679305 secs.nsecs elapsed_time: 26.507908706 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 3 7 10 8: 1 2 12 16: 20 51 64 32: 14 35 100 mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats= snapshot_time: 1782930987.321678531 secs.nsecs start_time: 1782930960.813740878 secs.nsecs elapsed_time: 26.507937653 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 2 5 7 4: 1 2 10 8: 4 10 20 16: 16 40 60 32: 16 40 100 - open/close 4521 (time 1782930998.80 total 10.00 last 452.06) - open/close 8946 (time 1782931008.80 total 20.00 last 442.46) total: 10000 open/close in 22.21 seconds: 450.30 ops/second llite.lustre-ffff9338c8796800.statahead_batch_max=0 llite.lustre-ffff9338c8796800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9338c8796800.stats=clear mdc.lustre-MDT0001-mdc-ffff9338c8796800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.408s user 0m0.151s sys 0m36.290s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9338c8796800.statahead_batch_max=32 llite.lustre-ffff9338c8796800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9338c8796800.stats=clear mdc.lustre-MDT0001-mdc-ffff9338c8796800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.304s user 0m0.146s sys 0m22.788s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats= snapshot_time: 1782931099.132634718 secs.nsecs start_time: 1782931053.685401361 secs.nsecs elapsed_time: 45.447233357 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats= snapshot_time: 1782931099.132679509 secs.nsecs start_time: 1782931053.685459142 secs.nsecs elapsed_time: 45.447220367 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats=0 llite.lustre-ffff9338c8796800.statahead_max=2048 llite.lustre-ffff9338c8796800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.77 seconds: 130.19 ops/second llite.lustre-ffff9338c8796800.statahead_max=0 101 real 0m0.656s user 0m0.002s sys 0m0.251s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9338c8796800.statahead_max=2048 llite.lustre-ffff9338c8796800.statahead_max=2048 101 real 0m0.433s user 0m0.002s sys 0m0.204s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.91 seconds: 470.30 ops/second llite.lustre-ffff9338c8796800.statahead_max=0 1001 real 0m6.235s user 0m0.022s sys 0m2.422s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9338c8796800.statahead_max=2048 llite.lustre-ffff9338c8796800.statahead_max=2048 1001 real 0m3.703s user 0m0.015s sys 0m1.462s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff9338c8796800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats= snapshot_time: 1782931215.378779942 secs.nsecs start_time: 1782931099.922247671 secs.nsecs elapsed_time: 115.456532271 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 42 42 8: 1 14 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats= snapshot_time: 1782931215.378863211 secs.nsecs start_time: 1782931099.922383393 secs.nsecs elapsed_time: 115.456479818 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 14 14 4: 1 14 28 8: 2 28 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 - open/close 4781 (time 1782931226.19 total 10.00 last 478.08) - open/close 9623 (time 1782931236.19 total 20.00 last 484.13) total: 10000 open/close in 20.78 seconds: 481.34 ops/second llite.lustre-ffff9338c8796800.statahead_batch_max=0 llite.lustre-ffff9338c8796800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9338c8796800.stats=clear mdc.lustre-MDT0001-mdc-ffff9338c8796800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.943s user 0m0.161s sys 0m29.527s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9338c8796800.statahead_batch_max=256 llite.lustre-ffff9338c8796800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9338c8796800.stats=clear mdc.lustre-MDT0001-mdc-ffff9338c8796800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.231s user 0m0.161s sys 0m21.925s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9338c8796800.batch_stats= snapshot_time: 1782931311.528046279 secs.nsecs start_time: 1782931274.834256603 secs.nsecs elapsed_time: 36.693789676 secs.nsecs subreqs per batch batches %% cum %% 1: 271 67 67 2: 38 9 77 4: 24 6 83 8: 6 1 84 16: 1 0 85 32: 24 6 91 64: 1 0 91 128: 0 0 91 256: 35 8 100 mdc.lustre-MDT0001-mdc-ffff9338c8796800.batch_stats= snapshot_time: 1782931311.528109819 secs.nsecs start_time: 1782931274.834318704 secs.nsecs elapsed_time: 36.693791115 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9338c8796800.statahead_batch_max=64 llite.lustre-ffff9338c8796800.statahead_max=128