== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:54:54 (1789181694) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats=0 llite.lustre-ffffa0ce7577f800.statahead_max=32 llite.lustre-ffffa0ce7577f800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats=0 total: 100 open/close in 2.44 seconds: 41.07 ops/second llite.lustre-ffffa0ce7577f800.statahead_max=0 101 real 0m2.295s user 0m0.002s sys 0m0.289s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffffa0ce7577f800.statahead_max=32 llite.lustre-ffffa0ce7577f800.statahead_max=32 101 real 0m0.876s user 0m0.007s sys 0m0.156s 'ls -l' 100 files with statahead: 1 sec statahead total: 151 statahead wrong: 2 agl total: 145 list_total: 30 fname_total: 94 hit_total: 4435 miss_total: 1284 swrong=2 ewrong=2 - open/close 705 (time 1789181721.32 total 10.01 last 70.42) total: 900 open/close in 13.49 seconds: 66.71 ops/second llite.lustre-ffffa0ce7577f800.statahead_max=0 1001 real 0m24.184s user 0m0.027s sys 0m2.978s 'ls -l' 1000 files without statahead: 24 sec llite.lustre-ffffa0ce7577f800.statahead_max=32 llite.lustre-ffffa0ce7577f800.statahead_max=32 1001 real 0m11.219s user 0m0.030s sys 0m1.305s 'ls -l' 1000 files with statahead: 11 sec statahead total: 152 statahead wrong: 2 agl total: 146 list_total: 31 fname_total: 94 hit_total: 5430 miss_total: 1289 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffffa0ce7577f800.statahead_stats= statahead total: 152 statahead wrong: 2 agl total: 146 list_total: 31 fname_total: 94 hit_total: 5430 miss_total: 1289 mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats= snapshot_time: 1789181795.861041427 secs.nsecs start_time: 1789181699.261397042 secs.nsecs elapsed_time: 96.599644385 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 5 5 16: 2 5 10 32: 34 89 100 - open/close 738 (time 1789181808.30 total 10.02 last 73.68) - open/close 1421 (time 1789181818.30 total 20.02 last 68.29) - open/close 2093 (time 1789181828.30 total 30.02 last 67.18) - open/close 2782 (time 1789181838.31 total 40.03 last 68.85) - open/close 3442 (time 1789181848.33 total 50.05 last 65.86) - open/close 4168 (time 1789181858.34 total 60.06 last 72.52) - open/close 4868 (time 1789181868.35 total 70.06 last 69.98) - open/close 5668 (time 1789181878.35 total 80.07 last 79.95) - open/close 6412 (time 1789181888.36 total 90.07 last 74.37) - open/close 7156 (time 1789181898.37 total 100.08 last 74.33) - open/close 7846 (time 1789181908.38 total 110.09 last 68.93) - open/close 8405 (time 1789181918.39 total 120.10 last 55.84) - open/close 8970 (time 1789181928.39 total 130.11 last 56.48) - open/close 9717 (time 1789181938.40 total 140.11 last 74.63) total: 10000 open/close in 143.57 seconds: 69.65 ops/second llite.lustre-ffffa0ce7577f800.statahead_batch_max=0 llite.lustre-ffffa0ce7577f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.550s user 0m0.281s sys 0m14.873s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa0ce7577f800.statahead_batch_max=32 llite.lustre-ffffa0ce7577f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m34.428s user 0m0.268s sys 0m13.094s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats= snapshot_time: 1789182111.474705578 secs.nsecs start_time: 1789182007.345273906 secs.nsecs elapsed_time: 104.129431672 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats=0 llite.lustre-ffffa0ce7577f800.statahead_max=2048 llite.lustre-ffffa0ce7577f800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats=0 total: 100 open/close in 2.02 seconds: 49.41 ops/second llite.lustre-ffffa0ce7577f800.statahead_max=0 101 real 0m2.096s user 0m0.002s sys 0m0.309s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffffa0ce7577f800.statahead_max=2048 llite.lustre-ffffa0ce7577f800.statahead_max=2048 101 real 0m0.811s user 0m0.003s sys 0m0.184s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 734 (time 1789182415.60 total 10.01 last 73.36) total: 900 open/close in 12.37 seconds: 72.76 ops/second llite.lustre-ffffa0ce7577f800.statahead_max=0 1001 real 0m19.771s user 0m0.032s sys 0m2.837s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffffa0ce7577f800.statahead_max=2048 llite.lustre-ffffa0ce7577f800.statahead_max=2048 1001 real 0m4.650s user 0m0.021s sys 0m1.396s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffffa0ce7577f800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats= snapshot_time: 1789182473.509952716 secs.nsecs start_time: 1789182114.043145287 secs.nsecs elapsed_time: 359.466807429 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 0 0 40 64: 1 10 50 128: 1 10 60 256: 4 40 100 - open/close 763 (time 1789182485.67 total 10.00 last 76.30) - open/close 1636 (time 1789182495.69 total 20.02 last 87.16) - open/close 2436 (time 1789182505.69 total 30.02 last 79.98) - open/close 3170 (time 1789182515.71 total 40.04 last 73.24) - open/close 3960 (time 1789182525.72 total 50.05 last 78.93) - open/close 4648 (time 1789182535.74 total 60.06 last 68.70) - open/close 5177 (time 1789182545.76 total 70.08 last 52.81) - open/close 5842 (time 1789182555.76 total 80.09 last 66.48) - open/close 6538 (time 1789182565.76 total 90.09 last 69.60) - open/close 7278 (time 1789182575.76 total 100.09 last 74.00) - open/close 8012 (time 1789182585.78 total 110.10 last 73.28) - open/close 8738 (time 1789182595.78 total 120.10 last 72.59) - open/close 9472 (time 1789182605.79 total 130.11 last 73.34) total: 10000 open/close in 136.89 seconds: 73.05 ops/second llite.lustre-ffffa0ce7577f800.statahead_batch_max=0 llite.lustre-ffffa0ce7577f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.571s user 0m0.288s sys 0m14.980s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffffa0ce7577f800.statahead_batch_max=256 llite.lustre-ffffa0ce7577f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.963s user 0m0.293s sys 0m15.040s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffffa0ce7577f800.batch_stats= snapshot_time: 1789182734.871995680 secs.nsecs start_time: 1789182679.429885334 secs.nsecs elapsed_time: 55.442110346 secs.nsecs subreqs per batch batches %% cum %% 1: 78 36 36 2: 26 12 48 4: 24 11 60 8: 19 8 69 16: 10 4 73 32: 14 6 80 64: 7 3 83 128: 0 0 83 256: 35 16 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffffa0ce7577f800.statahead_batch_max=64 llite.lustre-ffffa0ce7577f800.statahead_max=128