== sanity test 123ad: Verify batching statahead works correctly ========================================================== 06:56:36 (1783076196) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats=0 llite.lustre-ffff8a64909c3800.statahead_max=32 llite.lustre-ffff8a64909c3800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats=0 total: 100 open/close in 0.64 seconds: 156.89 ops/second llite.lustre-ffff8a64909c3800.statahead_max=0 101 real 0m0.646s user 0m0.003s sys 0m0.246s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8a64909c3800.statahead_max=32 llite.lustre-ffff8a64909c3800.statahead_max=32 101 real 0m0.365s user 0m0.002s sys 0m0.225s 'ls -l' 100 files with statahead: 1 sec statahead total: 99 statahead wrong: 2 agl total: 94 list_total: 30 fname_total: 69 hit_total: 13965 miss_total: 1210 swrong=2 ewrong=2 total: 900 open/close in 2.26 seconds: 398.16 ops/second llite.lustre-ffff8a64909c3800.statahead_max=0 1001 real 0m6.109s user 0m0.025s sys 0m2.364s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8a64909c3800.statahead_max=32 llite.lustre-ffff8a64909c3800.statahead_max=32 1001 real 0m3.615s user 0m0.016s sys 0m1.984s 'ls -l' 1000 files with statahead: 4 sec statahead total: 100 statahead wrong: 2 agl total: 95 list_total: 31 fname_total: 69 hit_total: 14964 miss_total: 1211 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8a64909c3800.statahead_stats= statahead total: 100 statahead wrong: 2 agl total: 95 list_total: 31 fname_total: 69 hit_total: 14964 miss_total: 1211 mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats= snapshot_time: 1783076223.283894881 secs.nsecs start_time: 1783076197.691444905 secs.nsecs elapsed_time: 25.592449976 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 4338 (time 1783076234.11 total 10.00 last 433.72) - open/close 9224 (time 1783076244.11 total 20.00 last 488.56) total: 10000 open/close in 21.58 seconds: 463.48 ops/second llite.lustre-ffff8a64909c3800.statahead_batch_max=0 llite.lustre-ffff8a64909c3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a64909c3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.010s user 0m0.158s sys 0m29.495s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a64909c3800.statahead_batch_max=32 llite.lustre-ffff8a64909c3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a64909c3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.967s user 0m0.159s sys 0m21.820s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats= snapshot_time: 1783076323.220495227 secs.nsecs start_time: 1783076279.567333555 secs.nsecs elapsed_time: 43.653161672 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats=0 llite.lustre-ffff8a64909c3800.statahead_max=2048 llite.lustre-ffff8a64909c3800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats=0 total: 100 open/close in 0.59 seconds: 168.51 ops/second llite.lustre-ffff8a64909c3800.statahead_max=0 101 real 0m0.872s user 0m0.002s sys 0m0.271s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8a64909c3800.statahead_max=2048 llite.lustre-ffff8a64909c3800.statahead_max=2048 101 real 0m0.367s user 0m0.003s sys 0m0.265s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.77 seconds: 508.48 ops/second llite.lustre-ffff8a64909c3800.statahead_max=0 1001 real 0m5.578s user 0m0.018s sys 0m2.205s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff8a64909c3800.statahead_max=2048 llite.lustre-ffff8a64909c3800.statahead_max=2048 1001 real 0m4.144s user 0m0.013s sys 0m2.362s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 - open/close 5032 (time 1783076436.13 total 10.00 last 503.15) total: 9000 open/close in 17.60 seconds: 511.39 ops/second llite.lustre-ffff8a64909c3800.statahead_max=0 10001 real 0m58.162s user 0m0.175s sys 0m22.534s 'ls -l' 10000 files without statahead: 58 sec llite.lustre-ffff8a64909c3800.statahead_max=2048 llite.lustre-ffff8a64909c3800.statahead_max=2048 10001 real 0m29.893s user 0m0.144s sys 0m20.845s 'ls -l' 10000 files with statahead: 30 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 64 seconds llite.lustre-ffff8a64909c3800.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats= snapshot_time: 1783076607.263275346 secs.nsecs start_time: 1783076324.096598158 secs.nsecs elapsed_time: 283.166677188 secs.nsecs subreqs per batch batches %% cum %% 1: 381 65 65 2: 79 13 79 4: 41 7 86 8: 11 1 87 16: 6 1 89 32: 25 4 93 64: 0 0 93 128: 1 0 93 256: 38 6 100 - open/close 5261 (time 1783076617.98 total 10.00 last 526.07) total: 10000 open/close in 19.26 seconds: 519.11 ops/second llite.lustre-ffff8a64909c3800.statahead_batch_max=0 llite.lustre-ffff8a64909c3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a64909c3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.673s user 0m0.143s sys 0m30.289s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a64909c3800.statahead_batch_max=256 llite.lustre-ffff8a64909c3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a64909c3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m28.426s user 0m0.152s sys 0m20.104s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a64909c3800.batch_stats= snapshot_time: 1783076701.834743366 secs.nsecs start_time: 1783076667.104859702 secs.nsecs elapsed_time: 34.729883664 secs.nsecs subreqs per batch batches %% cum %% 1: 250 53 53 2: 82 17 71 4: 60 12 84 8: 9 1 86 16: 1 0 86 32: 26 5 92 64: 0 0 92 128: 1 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a64909c3800.statahead_batch_max=64 llite.lustre-ffff8a64909c3800.statahead_max=128