== sanity test 123ad: Verify batching statahead works correctly ========================================================== 17:16:25 (1784409385) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats=0 llite.lustre-ffff9894c66fd800.statahead_max=32 llite.lustre-ffff9894c66fd800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.70 seconds: 142.07 ops/second llite.lustre-ffff9894c66fd800.statahead_max=0 101 real 0m0.694s user 0m0.002s sys 0m0.268s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9894c66fd800.statahead_max=32 llite.lustre-ffff9894c66fd800.statahead_max=32 101 real 0m0.401s user 0m0.002s sys 0m0.212s 'ls -l' 100 files with statahead: 1 sec statahead total: 133 statahead wrong: 2 agl total: 126 list_total: 31 fname_total: 102 hit_total: 13956 miss_total: 934 swrong=2 ewrong=2 total: 900 open/close in 2.00 seconds: 449.95 ops/second llite.lustre-ffff9894c66fd800.statahead_max=0 1001 real 0m5.813s user 0m0.020s sys 0m2.260s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9894c66fd800.statahead_max=32 llite.lustre-ffff9894c66fd800.statahead_max=32 1001 real 0m4.466s user 0m0.018s sys 0m2.247s 'ls -l' 1000 files with statahead: 4 sec statahead total: 134 statahead wrong: 2 agl total: 127 list_total: 32 fname_total: 102 hit_total: 14955 miss_total: 935 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 26 seconds llite.lustre-ffff9894c66fd800.statahead_stats= statahead total: 134 statahead wrong: 2 agl total: 127 list_total: 32 fname_total: 102 hit_total: 14955 miss_total: 935 mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats= snapshot_time: 1784409432.971200973 secs.nsecs start_time: 1784409386.759591561 secs.nsecs elapsed_time: 46.211609412 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 3 7 10 8: 3 7 17 16: 20 51 69 32: 12 30 100 mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats= snapshot_time: 1784409432.971262688 secs.nsecs start_time: 1784409386.759640339 secs.nsecs elapsed_time: 46.211622349 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 1 2 5 4: 2 5 10 8: 3 7 17 16: 17 42 60 32: 16 40 100 - open/close 4637 (time 1784409443.83 total 10.00 last 463.67) - open/close 9611 (time 1784409453.83 total 20.00 last 497.30) total: 10000 open/close in 20.78 seconds: 481.18 ops/second llite.lustre-ffff9894c66fd800.statahead_batch_max=0 llite.lustre-ffff9894c66fd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9894c66fd800.stats=clear mdc.lustre-MDT0001-mdc-ffff9894c66fd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.048s user 0m0.198s sys 0m33.258s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9894c66fd800.statahead_batch_max=32 llite.lustre-ffff9894c66fd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9894c66fd800.stats=clear mdc.lustre-MDT0001-mdc-ffff9894c66fd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.340s user 0m0.188s sys 0m21.466s batched statahead RPC= hit count=9998 mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats= snapshot_time: 1784409540.585863874 secs.nsecs start_time: 1784409494.714877793 secs.nsecs elapsed_time: 45.870986081 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats= snapshot_time: 1784409540.585937623 secs.nsecs start_time: 1784409494.714949773 secs.nsecs elapsed_time: 45.870987850 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats=0 llite.lustre-ffff9894c66fd800.statahead_max=2048 llite.lustre-ffff9894c66fd800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.74 seconds: 134.77 ops/second llite.lustre-ffff9894c66fd800.statahead_max=0 101 real 0m0.783s user 0m0.004s sys 0m0.276s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9894c66fd800.statahead_max=2048 llite.lustre-ffff9894c66fd800.statahead_max=2048 101 real 0m0.363s user 0m0.005s sys 0m0.264s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10097 miss_total: 3 swrong=0 ewrong=0 total: 900 open/close in 2.62 seconds: 344.16 ops/second llite.lustre-ffff9894c66fd800.statahead_max=0 1001 real 0m6.264s user 0m0.017s sys 0m2.392s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9894c66fd800.statahead_max=2048 llite.lustre-ffff9894c66fd800.statahead_max=2048 1001 real 0m3.418s user 0m0.016s sys 0m1.470s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff9894c66fd800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats= snapshot_time: 1784409664.506341012 secs.nsecs start_time: 1784409541.392852861 secs.nsecs elapsed_time: 123.113488151 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 37 37 8: 2 25 62 16: 0 0 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats= snapshot_time: 1784409664.506391337 secs.nsecs start_time: 1784409541.393004852 secs.nsecs elapsed_time: 123.113386485 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 25 25 8: 2 25 50 16: 1 12 62 32: 1 12 75 64: 0 0 75 128: 0 0 75 256: 2 25 100 - open/close 3083 (time 1784409675.53 total 10.01 last 308.13) - open/close 5444 (time 1784409685.53 total 20.01 last 236.06) - open/close 7593 (time 1784409695.53 total 30.01 last 214.87) total: 10000 open/close in 39.52 seconds: 253.04 ops/second llite.lustre-ffff9894c66fd800.statahead_batch_max=0 llite.lustre-ffff9894c66fd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9894c66fd800.stats=clear mdc.lustre-MDT0001-mdc-ffff9894c66fd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.276s user 0m0.190s sys 0m27.620s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9894c66fd800.statahead_batch_max=256 llite.lustre-ffff9894c66fd800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9894c66fd800.stats=clear mdc.lustre-MDT0001-mdc-ffff9894c66fd800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.484s user 0m0.175s sys 0m22.056s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9894c66fd800.batch_stats= snapshot_time: 1784409778.877868893 secs.nsecs start_time: 1784409742.014102563 secs.nsecs elapsed_time: 36.863766330 secs.nsecs subreqs per batch batches %% cum %% 1: 229 65 65 2: 36 10 75 4: 15 4 80 8: 6 1 81 16: 4 1 82 32: 24 6 89 64: 1 0 90 128: 0 0 90 256: 35 10 100 mdc.lustre-MDT0001-mdc-ffff9894c66fd800.batch_stats= snapshot_time: 1784409778.877909541 secs.nsecs start_time: 1784409742.014159973 secs.nsecs elapsed_time: 36.863749568 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9894c66fd800.statahead_batch_max=64 llite.lustre-ffff9894c66fd800.statahead_max=128