== sanity test 123ad: Verify batching statahead works correctly ========================================================== 09:47:16 (1788875236) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats=0 llite.lustre-ffff9bbe9a73a800.statahead_max=32 llite.lustre-ffff9bbe9a73a800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats=0 total: 100 open/close in 2.20 seconds: 45.36 ops/second llite.lustre-ffff9bbe9a73a800.statahead_max=0 101 real 0m2.135s user 0m0.003s sys 0m0.307s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9bbe9a73a800.statahead_max=32 llite.lustre-ffff9bbe9a73a800.statahead_max=32 101 real 0m1.379s user 0m0.008s sys 0m0.174s 'ls -l' 100 files with statahead: 2 sec statahead total: 127 statahead wrong: 2 agl total: 121 list_total: 29 fname_total: 85 hit_total: 4152 miss_total: 1273 swrong=2 ewrong=2 - open/close 670 (time 1788875264.35 total 10.04 last 66.73) total: 900 open/close in 13.31 seconds: 67.61 ops/second llite.lustre-ffff9bbe9a73a800.statahead_max=0 1001 real 0m19.346s user 0m0.043s sys 0m2.883s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9bbe9a73a800.statahead_max=32 llite.lustre-ffff9bbe9a73a800.statahead_max=32 1001 real 0m9.038s user 0m0.030s sys 0m1.357s 'ls -l' 1000 files with statahead: 9 sec statahead total: 128 statahead wrong: 2 agl total: 122 list_total: 30 fname_total: 85 hit_total: 5150 miss_total: 1275 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff9bbe9a73a800.statahead_stats= statahead total: 128 statahead wrong: 2 agl total: 122 list_total: 30 fname_total: 85 hit_total: 5150 miss_total: 1275 mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats= snapshot_time: 1788875327.496810233 secs.nsecs start_time: 1788875240.595697046 secs.nsecs elapsed_time: 86.901113187 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 826 (time 1788875339.58 total 10.01 last 82.48) - open/close 1523 (time 1788875349.58 total 20.02 last 69.65) - open/close 2280 (time 1788875359.60 total 30.04 last 75.56) - open/close 2961 (time 1788875369.61 total 40.05 last 68.04) - open/close 3739 (time 1788875379.61 total 50.05 last 77.77) - open/close 4564 (time 1788875389.61 total 60.05 last 82.49) - open/close 5326 (time 1788875399.63 total 70.07 last 76.08) - open/close 6083 (time 1788875409.64 total 80.08 last 75.64) - open/close 6862 (time 1788875419.64 total 90.08 last 77.88) - open/close 7646 (time 1788875429.65 total 100.09 last 78.32) - open/close 8334 (time 1788875439.65 total 110.09 last 68.79) - open/close 9052 (time 1788875449.67 total 120.11 last 71.66) - open/close 9872 (time 1788875459.68 total 130.12 last 81.96) total: 10000 open/close in 131.65 seconds: 75.96 ops/second llite.lustre-ffff9bbe9a73a800.statahead_batch_max=0 llite.lustre-ffff9bbe9a73a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.304s user 0m0.333s sys 0m14.170s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bbe9a73a800.statahead_batch_max=32 llite.lustre-ffff9bbe9a73a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m33.675s user 0m0.269s sys 0m12.888s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats= snapshot_time: 1788875636.936700711 secs.nsecs start_time: 1788875533.012557278 secs.nsecs elapsed_time: 103.924143433 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats=0 llite.lustre-ffff9bbe9a73a800.statahead_max=2048 llite.lustre-ffff9bbe9a73a800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats=0 total: 100 open/close in 2.43 seconds: 41.21 ops/second llite.lustre-ffff9bbe9a73a800.statahead_max=0 101 real 0m1.866s user 0m0.005s sys 0m0.292s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9bbe9a73a800.statahead_max=2048 llite.lustre-ffff9bbe9a73a800.statahead_max=2048 101 real 0m0.694s user 0m0.004s sys 0m0.133s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 866 (time 1788875911.43 total 10.00 last 86.59) total: 900 open/close in 10.34 seconds: 87.04 ops/second llite.lustre-ffff9bbe9a73a800.statahead_max=0 1001 real 0m16.251s user 0m0.028s sys 0m2.727s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff9bbe9a73a800.statahead_max=2048 llite.lustre-ffff9bbe9a73a800.statahead_max=2048 1001 real 0m5.414s user 0m0.024s sys 0m1.293s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 16 seconds llite.lustre-ffff9bbe9a73a800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats= snapshot_time: 1788875959.316195074 secs.nsecs start_time: 1788875639.258711019 secs.nsecs elapsed_time: 320.057484055 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 1 8 58 128: 1 8 66 256: 4 33 100 - open/close 907 (time 1788875971.49 total 10.00 last 90.67) - open/close 1886 (time 1788875981.50 total 20.01 last 97.83) - open/close 2766 (time 1788875991.51 total 30.02 last 87.93) - open/close 3653 (time 1788876001.51 total 40.02 last 88.68) - open/close 4553 (time 1788876011.51 total 50.03 last 89.96) - open/close 5458 (time 1788876021.52 total 60.03 last 90.42) - open/close 6402 (time 1788876031.52 total 70.03 last 94.40) - open/close 7113 (time 1788876041.52 total 80.03 last 71.10) - open/close 7945 (time 1788876051.53 total 90.04 last 83.17) - open/close 8771 (time 1788876061.54 total 100.05 last 82.51) - open/close 9636 (time 1788876071.54 total 110.05 last 86.46) total: 10000 open/close in 113.86 seconds: 87.82 ops/second llite.lustre-ffff9bbe9a73a800.statahead_batch_max=0 llite.lustre-ffff9bbe9a73a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.387s user 0m0.286s sys 0m15.359s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bbe9a73a800.statahead_batch_max=256 llite.lustre-ffff9bbe9a73a800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.475s user 0m0.282s sys 0m14.023s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9bbe9a73a800.batch_stats= snapshot_time: 1788876171.421158549 secs.nsecs start_time: 1788876126.297086038 secs.nsecs elapsed_time: 45.124072511 secs.nsecs subreqs per batch batches %% cum %% 1: 138 46 46 2: 38 12 59 4: 32 10 70 8: 18 6 76 16: 17 5 82 32: 14 4 87 64: 2 0 88 128: 0 0 88 256: 35 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9bbe9a73a800.statahead_batch_max=64 llite.lustre-ffff9bbe9a73a800.statahead_max=128