== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:20:01 (1787588401) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats=0 llite.lustre-ffff8ee61e7b9800.statahead_max=32 llite.lustre-ffff8ee61e7b9800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats=0 total: 100 open/close in 2.59 seconds: 38.63 ops/second llite.lustre-ffff8ee61e7b9800.statahead_max=0 101 real 0m2.021s user 0m0.005s sys 0m0.300s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8ee61e7b9800.statahead_max=32 llite.lustre-ffff8ee61e7b9800.statahead_max=32 101 real 0m1.180s user 0m0.004s sys 0m0.139s 'ls -l' 100 files with statahead: 1 sec statahead total: 138 statahead wrong: 2 agl total: 132 list_total: 30 fname_total: 96 hit_total: 4237 miss_total: 768 swrong=2 ewrong=2 - open/close 752 (time 1787588427.40 total 10.01 last 75.16) total: 900 open/close in 12.26 seconds: 73.42 ops/second llite.lustre-ffff8ee61e7b9800.statahead_max=0 1001 real 0m18.490s user 0m0.027s sys 0m2.709s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff8ee61e7b9800.statahead_max=32 llite.lustre-ffff8ee61e7b9800.statahead_max=32 1001 real 0m10.253s user 0m0.026s sys 0m1.291s 'ls -l' 1000 files with statahead: 10 sec statahead total: 139 statahead wrong: 2 agl total: 133 list_total: 31 fname_total: 96 hit_total: 5232 miss_total: 773 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff8ee61e7b9800.statahead_stats= statahead total: 139 statahead wrong: 2 agl total: 133 list_total: 31 fname_total: 96 hit_total: 5232 miss_total: 773 mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats= snapshot_time: 1787588490.592350881 secs.nsecs start_time: 1787588405.452665094 secs.nsecs elapsed_time: 85.139685787 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 842 (time 1787588503.21 total 10.01 last 84.14) - open/close 1674 (time 1787588513.22 total 20.01 last 83.14) - open/close 2524 (time 1787588523.22 total 30.02 last 84.95) - open/close 3347 (time 1787588533.23 total 40.03 last 82.25) - open/close 4201 (time 1787588543.23 total 50.03 last 85.39) - open/close 5014 (time 1787588553.23 total 60.03 last 81.28) - open/close 5801 (time 1787588563.24 total 70.04 last 78.63) - open/close 6655 (time 1787588573.26 total 80.06 last 85.22) - open/close 7483 (time 1787588583.27 total 90.07 last 82.71) - open/close 8248 (time 1787588593.28 total 100.08 last 76.46) - open/close 9057 (time 1787588603.32 total 110.12 last 80.55) - open/close 9894 (time 1787588613.33 total 120.13 last 83.65) total: 10000 open/close in 121.40 seconds: 82.37 ops/second llite.lustre-ffff8ee61e7b9800.statahead_batch_max=0 llite.lustre-ffff8ee61e7b9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.189s user 0m0.276s sys 0m14.091s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ee61e7b9800.statahead_batch_max=32 llite.lustre-ffff8ee61e7b9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m28.125s user 0m0.250s sys 0m13.563s batched statahead RPC= hit count=9981 mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats= snapshot_time: 1787588775.769990246 secs.nsecs start_time: 1787588677.007872441 secs.nsecs elapsed_time: 98.762117805 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats=0 llite.lustre-ffff8ee61e7b9800.statahead_max=2048 llite.lustre-ffff8ee61e7b9800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats=0 total: 100 open/close in 2.47 seconds: 40.48 ops/second llite.lustre-ffff8ee61e7b9800.statahead_max=0 101 real 0m1.928s user 0m0.004s sys 0m0.286s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8ee61e7b9800.statahead_max=2048 llite.lustre-ffff8ee61e7b9800.statahead_max=2048 101 real 0m0.893s user 0m0.004s sys 0m0.153s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10080 miss_total: 20 swrong=0 ewrong=0 - open/close 806 (time 1787589072.34 total 10.01 last 80.55) total: 900 open/close in 11.11 seconds: 81.00 ops/second llite.lustre-ffff8ee61e7b9800.statahead_max=0 1001 real 0m20.376s user 0m0.032s sys 0m2.743s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff8ee61e7b9800.statahead_max=2048 llite.lustre-ffff8ee61e7b9800.statahead_max=2048 1001 real 0m6.561s user 0m0.032s sys 0m1.385s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff8ee61e7b9800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11079 miss_total: 21 mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats= snapshot_time: 1787589127.783432470 secs.nsecs start_time: 1787588778.719193905 secs.nsecs elapsed_time: 349.064238565 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 807 (time 1787589140.10 total 10.02 last 80.57) - open/close 1604 (time 1787589150.11 total 20.02 last 79.64) - open/close 2431 (time 1787589160.12 total 30.03 last 82.63) - open/close 3222 (time 1787589170.13 total 40.04 last 79.01) - open/close 3909 (time 1787589180.13 total 50.05 last 68.65) - open/close 4695 (time 1787589190.14 total 60.06 last 78.55) - open/close 5391 (time 1787589200.15 total 70.06 last 69.57) - open/close 6180 (time 1787589210.15 total 80.07 last 78.84) - open/close 7023 (time 1787589220.17 total 90.09 last 84.14) - open/close 7807 (time 1787589230.17 total 100.09 last 78.38) - open/close 8655 (time 1787589240.19 total 110.10 last 84.69) - open/close 9428 (time 1787589250.19 total 120.11 last 77.27) total: 10000 open/close in 127.29 seconds: 78.56 ops/second llite.lustre-ffff8ee61e7b9800.statahead_batch_max=0 llite.lustre-ffff8ee61e7b9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.822s user 0m0.308s sys 0m16.092s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ee61e7b9800.statahead_batch_max=256 llite.lustre-ffff8ee61e7b9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m46.156s user 0m0.293s sys 0m15.232s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8ee61e7b9800.batch_stats= snapshot_time: 1787589374.401056922 secs.nsecs start_time: 1787589316.357153657 secs.nsecs elapsed_time: 58.043903265 secs.nsecs subreqs per batch batches %% cum %% 1: 94 45 45 2: 18 8 54 4: 17 8 62 8: 9 4 67 16: 12 5 73 32: 13 6 79 64: 6 2 82 128: 1 0 82 256: 35 17 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8ee61e7b9800.statahead_batch_max=64 llite.lustre-ffff8ee61e7b9800.statahead_max=128