== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:48:41 (1787712521) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats=0 llite.lustre-ffff893d02cab800.statahead_max=32 llite.lustre-ffff893d02cab800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats=0 total: 100 open/close in 2.86 seconds: 34.98 ops/second llite.lustre-ffff893d02cab800.statahead_max=0 101 real 0m2.907s user 0m0.001s sys 0m0.315s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff893d02cab800.statahead_max=32 llite.lustre-ffff893d02cab800.statahead_max=32 101 real 0m0.719s user 0m0.003s sys 0m0.134s 'ls -l' 100 files with statahead: 0 sec statahead total: 132 statahead wrong: 2 agl total: 127 list_total: 30 fname_total: 84 hit_total: 4270 miss_total: 1287 swrong=2 ewrong=2 - open/close 717 (time 1787712549.40 total 10.00 last 71.69) total: 900 open/close in 12.03 seconds: 74.79 ops/second llite.lustre-ffff893d02cab800.statahead_max=0 1001 real 0m19.464s user 0m0.036s sys 0m2.814s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff893d02cab800.statahead_max=32 llite.lustre-ffff893d02cab800.statahead_max=32 1001 real 0m13.118s user 0m0.038s sys 0m1.445s 'ls -l' 1000 files with statahead: 13 sec statahead total: 133 statahead wrong: 2 agl total: 128 list_total: 31 fname_total: 84 hit_total: 5268 miss_total: 1289 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff893d02cab800.statahead_stats= statahead total: 133 statahead wrong: 2 agl total: 128 list_total: 31 fname_total: 84 hit_total: 5268 miss_total: 1289 mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats= snapshot_time: 1787712617.122687673 secs.nsecs start_time: 1787712526.442494410 secs.nsecs elapsed_time: 90.680193263 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 878 (time 1787712629.62 total 10.00 last 87.80) - open/close 1734 (time 1787712639.63 total 20.01 last 85.54) - open/close 2573 (time 1787712649.63 total 30.01 last 83.89) - open/close 3469 (time 1787712659.63 total 40.01 last 89.58) - open/close 4369 (time 1787712669.63 total 50.02 last 89.97) - open/close 5312 (time 1787712679.63 total 60.02 last 94.28) - open/close 6159 (time 1787712689.64 total 70.02 last 84.68) - open/close 7053 (time 1787712699.64 total 80.03 last 89.34) - open/close 7810 (time 1787712709.65 total 90.03 last 75.67) - open/close 8611 (time 1787712719.65 total 100.04 last 80.05) - open/close 9514 (time 1787712729.66 total 110.04 last 90.25) total: 10000 open/close in 114.97 seconds: 86.98 ops/second llite.lustre-ffff893d02cab800.statahead_batch_max=0 llite.lustre-ffff893d02cab800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff893d02cab800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.767s user 0m0.295s sys 0m13.558s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff893d02cab800.statahead_batch_max=32 llite.lustre-ffff893d02cab800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff893d02cab800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m32.117s user 0m0.292s sys 0m12.532s batched statahead RPC= hit count=9973 mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats= snapshot_time: 1787712897.687357802 secs.nsecs start_time: 1787712794.369293817 secs.nsecs elapsed_time: 103.318063985 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats=0 llite.lustre-ffff893d02cab800.statahead_max=2048 llite.lustre-ffff893d02cab800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats=0 total: 100 open/close in 1.87 seconds: 53.33 ops/second llite.lustre-ffff893d02cab800.statahead_max=0 101 real 0m1.633s user 0m0.004s sys 0m0.275s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff893d02cab800.statahead_max=2048 llite.lustre-ffff893d02cab800.statahead_max=2048 101 real 0m0.919s user 0m0.003s sys 0m0.149s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10072 miss_total: 28 swrong=0 ewrong=0 - open/close 833 (time 1787713167.88 total 10.01 last 83.24) total: 900 open/close in 10.86 seconds: 82.85 ops/second llite.lustre-ffff893d02cab800.statahead_max=0 1001 real 0m23.266s user 0m0.028s sys 0m2.763s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff893d02cab800.statahead_max=2048 llite.lustre-ffff893d02cab800.statahead_max=2048 1001 real 0m9.184s user 0m0.028s sys 0m1.277s 'ls -l' 1000 files with statahead: 9 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11071 miss_total: 29 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff893d02cab800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11071 miss_total: 29 mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats= snapshot_time: 1787713236.743053444 secs.nsecs start_time: 1787712900.122256007 secs.nsecs elapsed_time: 336.620797437 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 1 8 58 128: 1 8 66 256: 4 33 100 - open/close 825 (time 1787713249.87 total 10.01 last 82.44) - open/close 1706 (time 1787713259.89 total 20.03 last 87.90) - open/close 2549 (time 1787713269.89 total 30.04 last 84.26) - open/close 3489 (time 1787713279.91 total 40.05 last 93.89) - open/close 4442 (time 1787713289.92 total 50.06 last 95.18) - open/close 5478 (time 1787713299.92 total 60.06 last 103.57) - open/close 6450 (time 1787713309.94 total 70.08 last 97.07) - open/close 7379 (time 1787713319.95 total 80.09 last 92.80) - open/close 8261 (time 1787713329.95 total 90.09 last 88.19) - open/close 9155 (time 1787713339.95 total 100.09 last 89.34) - open/close 9891 (time 1787713349.96 total 110.10 last 73.58) total: 10000 open/close in 111.97 seconds: 89.31 ops/second llite.lustre-ffff893d02cab800.statahead_batch_max=0 llite.lustre-ffff893d02cab800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff893d02cab800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.399s user 0m0.302s sys 0m13.849s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff893d02cab800.statahead_batch_max=256 llite.lustre-ffff893d02cab800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff893d02cab800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.636s user 0m0.303s sys 0m13.678s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff893d02cab800.batch_stats= snapshot_time: 1787713471.828327220 secs.nsecs start_time: 1787713418.332527192 secs.nsecs elapsed_time: 53.495800028 secs.nsecs subreqs per batch batches %% cum %% 1: 48 29 29 2: 19 11 40 4: 16 9 50 8: 13 7 58 16: 10 6 64 32: 16 9 74 64: 6 3 78 128: 1 0 78 256: 35 21 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff893d02cab800.statahead_batch_max=64 llite.lustre-ffff893d02cab800.statahead_max=128