== sanity test 123ad: Verify batching statahead works correctly ========================================================== 00:12:17 (1790395937) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats=0 llite.lustre-ffff9bd802e9e800.statahead_max=32 llite.lustre-ffff9bd802e9e800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats=0 total: 100 open/close in 0.58 seconds: 172.51 ops/second llite.lustre-ffff9bd802e9e800.statahead_max=0 101 real 0m0.576s user 0m0.002s sys 0m0.199s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9bd802e9e800.statahead_max=32 llite.lustre-ffff9bd802e9e800.statahead_max=32 101 real 0m0.347s user 0m0.002s sys 0m0.194s 'ls -l' 100 files with statahead: 0 sec statahead total: 93 statahead wrong: 2 agl total: 88 list_total: 30 fname_total: 63 hit_total: 14165 miss_total: 763 swrong=2 ewrong=2 total: 900 open/close in 1.63 seconds: 552.08 ops/second llite.lustre-ffff9bd802e9e800.statahead_max=0 1001 real 0m5.081s user 0m0.021s sys 0m1.905s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff9bd802e9e800.statahead_max=32 llite.lustre-ffff9bd802e9e800.statahead_max=32 1001 real 0m3.072s user 0m0.009s sys 0m1.737s 'ls -l' 1000 files with statahead: 3 sec statahead total: 94 statahead wrong: 2 agl total: 89 list_total: 31 fname_total: 63 hit_total: 15164 miss_total: 764 swrong=2 ewrong=2 - open/close 5259 (time 1790395964.41 total 10.00 last 525.82) total: 9000 open/close in 16.79 seconds: 536.11 ops/second llite.lustre-ffff9bd802e9e800.statahead_max=0 10001 real 0m53.916s user 0m0.213s sys 0m19.600s 'ls -l' 10000 files without statahead: 54 sec llite.lustre-ffff9bd802e9e800.statahead_max=32 llite.lustre-ffff9bd802e9e800.statahead_max=32 10001 real 0m35.469s user 0m0.172s sys 0m18.432s 'ls -l' 10000 files with statahead: 36 sec statahead total: 95 statahead wrong: 2 agl total: 90 list_total: 32 fname_total: 63 hit_total: 25163 miss_total: 765 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 59 seconds llite.lustre-ffff9bd802e9e800.statahead_stats= statahead total: 95 statahead wrong: 2 agl total: 90 list_total: 32 fname_total: 63 hit_total: 25163 miss_total: 765 mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats= snapshot_time: 1790396130.866818181 secs.nsecs start_time: 1790395938.547336568 secs.nsecs elapsed_time: 192.319481613 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 3 0 1 16: 4 1 2 32: 346 97 100 - open/close 5180 (time 1790396141.55 total 10.00 last 517.97) total: 10000 open/close in 19.94 seconds: 501.43 ops/second llite.lustre-ffff9bd802e9e800.statahead_batch_max=0 llite.lustre-ffff9bd802e9e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.477s user 0m0.154s sys 0m26.477s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bd802e9e800.statahead_batch_max=32 llite.lustre-ffff9bd802e9e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.936s user 0m0.151s sys 0m18.833s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats= snapshot_time: 1790396219.245238711 secs.nsecs start_time: 1790396181.484611736 secs.nsecs elapsed_time: 37.760626975 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats=0 llite.lustre-ffff9bd802e9e800.statahead_max=2048 llite.lustre-ffff9bd802e9e800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats=0 total: 100 open/close in 0.63 seconds: 157.93 ops/second llite.lustre-ffff9bd802e9e800.statahead_max=0 101 real 0m0.799s user 0m0.005s sys 0m0.237s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9bd802e9e800.statahead_max=2048 llite.lustre-ffff9bd802e9e800.statahead_max=2048 101 real 0m0.280s user 0m0.002s sys 0m0.149s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.93 seconds: 467.40 ops/second llite.lustre-ffff9bd802e9e800.statahead_max=0 1001 real 0m5.872s user 0m0.021s sys 0m2.163s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9bd802e9e800.statahead_max=2048 llite.lustre-ffff9bd802e9e800.statahead_max=2048 1001 real 0m4.274s user 0m0.020s sys 0m1.900s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff9bd802e9e800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats= snapshot_time: 1790396321.877321215 secs.nsecs start_time: 1790396220.076996659 secs.nsecs elapsed_time: 101.800324556 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 4502 (time 1790396332.67 total 10.00 last 450.19) - open/close 9043 (time 1790396342.67 total 20.00 last 454.07) total: 10000 open/close in 22.12 seconds: 452.08 ops/second llite.lustre-ffff9bd802e9e800.statahead_batch_max=0 llite.lustre-ffff9bd802e9e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.466s user 0m0.172s sys 0m26.884s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bd802e9e800.statahead_batch_max=256 llite.lustre-ffff9bd802e9e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m24.626s user 0m0.144s sys 0m18.129s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9bd802e9e800.batch_stats= snapshot_time: 1790396406.865963127 secs.nsecs start_time: 1790396377.802292783 secs.nsecs elapsed_time: 29.063670344 secs.nsecs subreqs per batch batches %% cum %% 1: 166 52 52 2: 50 15 68 4: 35 11 79 8: 3 0 80 16: 4 1 81 32: 23 7 88 64: 1 0 88 128: 0 0 88 256: 35 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9bd802e9e800.statahead_batch_max=64 llite.lustre-ffff9bd802e9e800.statahead_max=128