== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:26:47 (1782869207) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats=0 llite.lustre-ffff96c750c76000.statahead_max=32 llite.lustre-ffff96c750c76000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 0.66 seconds: 152.21 ops/second llite.lustre-ffff96c750c76000.statahead_max=0 101 real 0m0.853s user 0m0.002s sys 0m0.325s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff96c750c76000.statahead_max=32 llite.lustre-ffff96c750c76000.statahead_max=32 101 real 0m0.536s user 0m0.004s sys 0m0.281s 'ls -l' 100 files with statahead: 0 sec statahead total: 72 statahead wrong: 1 agl total: 66 list_total: 27 fname_total: 45 hit_total: 13654 miss_total: 204 swrong=1 ewrong=1 total: 900 open/close in 3.58 seconds: 251.53 ops/second llite.lustre-ffff96c750c76000.statahead_max=0 1001 real 0m8.553s user 0m0.021s sys 0m3.145s 'ls -l' 1000 files without statahead: 8 sec llite.lustre-ffff96c750c76000.statahead_max=32 llite.lustre-ffff96c750c76000.statahead_max=32 1001 real 0m4.470s user 0m0.013s sys 0m1.991s 'ls -l' 1000 files with statahead: 5 sec statahead total: 73 statahead wrong: 1 agl total: 67 list_total: 28 fname_total: 45 hit_total: 14653 miss_total: 205 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff96c750c76000.statahead_stats= statahead total: 73 statahead wrong: 1 agl total: 67 list_total: 28 fname_total: 45 hit_total: 14653 miss_total: 205 mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats= snapshot_time: 1782869243.043704094 secs.nsecs start_time: 1782869209.536436949 secs.nsecs elapsed_time: 33.507267145 secs.nsecs subreqs per batch batches %% cum %% 1: 4 10 10 2: 1 2 13 4: 1 2 15 8: 3 7 23 16: 21 55 78 32: 8 21 100 mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats= snapshot_time: 1782869243.043763435 secs.nsecs start_time: 1782869209.536539084 secs.nsecs elapsed_time: 33.507224351 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 2 5 7 8: 2 5 12 16: 12 30 43 32: 22 56 100 - open/close 3099 (time 1782869254.39 total 10.00 last 309.82) - open/close 5775 (time 1782869264.39 total 20.01 last 267.52) - open/close 9142 (time 1782869274.39 total 30.01 last 336.68) total: 10000 open/close in 33.55 seconds: 298.04 ops/second llite.lustre-ffff96c750c76000.statahead_batch_max=0 llite.lustre-ffff96c750c76000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff96c750c76000.stats=clear mdc.lustre-MDT0001-mdc-ffff96c750c76000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m46.493s user 0m0.160s sys 0m44.184s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff96c750c76000.statahead_batch_max=32 llite.lustre-ffff96c750c76000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff96c750c76000.stats=clear mdc.lustre-MDT0001-mdc-ffff96c750c76000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m43.247s user 0m0.159s sys 0m24.546s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats= snapshot_time: 1782869378.223028648 secs.nsecs start_time: 1782869328.235519966 secs.nsecs elapsed_time: 49.987508682 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats= snapshot_time: 1782869378.223073439 secs.nsecs start_time: 1782869328.235671682 secs.nsecs elapsed_time: 49.987401757 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats=0 llite.lustre-ffff96c750c76000.statahead_max=2048 llite.lustre-ffff96c750c76000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 1.36 seconds: 73.76 ops/second llite.lustre-ffff96c750c76000.statahead_max=0 101 real 0m0.883s user 0m0.003s sys 0m0.311s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff96c750c76000.statahead_max=2048 llite.lustre-ffff96c750c76000.statahead_max=2048 101 real 0m0.413s user 0m0.004s sys 0m0.245s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 2.54 seconds: 354.32 ops/second llite.lustre-ffff96c750c76000.statahead_max=0 1001 real 0m9.925s user 0m0.021s sys 0m3.533s 'ls -l' 1000 files without statahead: 10 sec llite.lustre-ffff96c750c76000.statahead_max=2048 llite.lustre-ffff96c750c76000.statahead_max=2048 1001 real 0m3.926s user 0m0.011s sys 0m1.587s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff96c750c76000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats= snapshot_time: 1782869521.432522056 secs.nsecs start_time: 1782869379.151363733 secs.nsecs elapsed_time: 142.281158323 secs.nsecs subreqs per batch batches %% cum %% 1: 1 16 16 2: 0 0 16 4: 1 16 33 8: 2 33 66 16: 0 0 66 32: 0 0 66 64: 0 0 66 128: 0 0 66 256: 2 33 100 mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats= snapshot_time: 1782869521.432648681 secs.nsecs start_time: 1782869379.151510990 secs.nsecs elapsed_time: 142.281137691 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 12 12 4: 1 12 25 8: 2 25 50 16: 0 0 50 32: 0 0 50 64: 1 12 62 128: 1 12 75 256: 2 25 100 - open/close 3369 (time 1782869532.49 total 10.00 last 336.78) - open/close 6139 (time 1782869542.50 total 20.01 last 276.92) - open/close 8826 (time 1782869552.50 total 30.01 last 268.65) total: 10000 open/close in 33.37 seconds: 299.69 ops/second llite.lustre-ffff96c750c76000.statahead_batch_max=0 llite.lustre-ffff96c750c76000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff96c750c76000.stats=clear mdc.lustre-MDT0001-mdc-ffff96c750c76000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m48.241s user 0m0.143s sys 0m39.792s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff96c750c76000.statahead_batch_max=256 llite.lustre-ffff96c750c76000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff96c750c76000.stats=clear mdc.lustre-MDT0001-mdc-ffff96c750c76000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.122s user 0m0.143s sys 0m22.149s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff96c750c76000.batch_stats= snapshot_time: 1782869645.626559853 secs.nsecs start_time: 1782869607.739618751 secs.nsecs elapsed_time: 37.886941102 secs.nsecs subreqs per batch batches %% cum %% 1: 510 66 66 2: 105 13 80 4: 73 9 89 8: 18 2 92 16: 4 0 92 32: 19 2 95 64: 3 0 95 128: 0 0 95 256: 33 4 100 mdc.lustre-MDT0001-mdc-ffff96c750c76000.batch_stats= snapshot_time: 1782869645.626694432 secs.nsecs start_time: 1782869607.739686729 secs.nsecs elapsed_time: 37.887007703 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff96c750c76000.statahead_batch_max=64 llite.lustre-ffff96c750c76000.statahead_max=128