== sanity test 123ad: Verify batching statahead works correctly ========================================================== 13:30:20 (1789320620) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats=0 llite.lustre-ffff89b4c1e4c800.statahead_max=32 llite.lustre-ffff89b4c1e4c800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats=0 total: 100 open/close in 0.80 seconds: 124.39 ops/second llite.lustre-ffff89b4c1e4c800.statahead_max=0 101 real 0m0.907s user 0m0.002s sys 0m0.315s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff89b4c1e4c800.statahead_max=32 llite.lustre-ffff89b4c1e4c800.statahead_max=32 101 real 0m0.488s user 0m0.002s sys 0m0.271s 'ls -l' 100 files with statahead: 1 sec statahead total: 81 statahead wrong: 1 agl total: 76 list_total: 29 fname_total: 52 hit_total: 23947 miss_total: 227 swrong=1 ewrong=1 total: 900 open/close in 2.19 seconds: 411.12 ops/second llite.lustre-ffff89b4c1e4c800.statahead_max=0 1001 real 0m7.322s user 0m0.025s sys 0m2.563s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff89b4c1e4c800.statahead_max=32 llite.lustre-ffff89b4c1e4c800.statahead_max=32 1001 real 0m3.563s user 0m0.014s sys 0m1.957s 'ls -l' 1000 files with statahead: 4 sec statahead total: 82 statahead wrong: 1 agl total: 77 list_total: 30 fname_total: 52 hit_total: 24946 miss_total: 228 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff89b4c1e4c800.statahead_stats= statahead total: 82 statahead wrong: 1 agl total: 77 list_total: 30 fname_total: 52 hit_total: 24946 miss_total: 228 mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats= snapshot_time: 1789320649.520029924 secs.nsecs start_time: 1789320622.027188486 secs.nsecs elapsed_time: 27.492841438 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 3835 (time 1789320660.43 total 10.00 last 383.43) - open/close 8058 (time 1789320670.43 total 20.00 last 422.30) total: 10000 open/close in 25.91 seconds: 385.95 ops/second llite.lustre-ffff89b4c1e4c800.statahead_batch_max=0 llite.lustre-ffff89b4c1e4c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.445s user 0m0.157s sys 0m38.915s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff89b4c1e4c800.statahead_batch_max=32 llite.lustre-ffff89b4c1e4c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.648s user 0m0.166s sys 0m19.710s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats= snapshot_time: 1789320762.108792118 secs.nsecs start_time: 1789320721.852826287 secs.nsecs elapsed_time: 40.255965831 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats=0 llite.lustre-ffff89b4c1e4c800.statahead_max=2048 llite.lustre-ffff89b4c1e4c800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats=0 total: 100 open/close in 0.89 seconds: 112.11 ops/second llite.lustre-ffff89b4c1e4c800.statahead_max=0 101 real 0m0.848s user 0m0.006s sys 0m0.278s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff89b4c1e4c800.statahead_max=2048 llite.lustre-ffff89b4c1e4c800.statahead_max=2048 101 real 0m0.391s user 0m0.003s sys 0m0.286s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 3.41 seconds: 263.87 ops/second llite.lustre-ffff89b4c1e4c800.statahead_max=0 1001 real 0m9.752s user 0m0.027s sys 0m3.248s 'ls -l' 1000 files without statahead: 10 sec llite.lustre-ffff89b4c1e4c800.statahead_max=2048 llite.lustre-ffff89b4c1e4c800.statahead_max=2048 1001 real 0m2.994s user 0m0.010s sys 0m1.721s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff89b4c1e4c800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats= snapshot_time: 1789320907.115503948 secs.nsecs start_time: 1789320762.944154439 secs.nsecs elapsed_time: 144.171349509 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 3114 (time 1789320917.89 total 10.00 last 311.31) - open/close 5573 (time 1789320927.89 total 20.01 last 245.81) - open/close 8306 (time 1789320937.90 total 30.01 last 273.26) total: 10000 open/close in 35.84 seconds: 278.99 ops/second llite.lustre-ffff89b4c1e4c800.statahead_batch_max=0 llite.lustre-ffff89b4c1e4c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.282s user 0m0.183s sys 0m35.975s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff89b4c1e4c800.statahead_batch_max=256 llite.lustre-ffff89b4c1e4c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.995s user 0m0.145s sys 0m23.865s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff89b4c1e4c800.batch_stats= snapshot_time: 1789321031.937304596 secs.nsecs start_time: 1789320991.315816452 secs.nsecs elapsed_time: 40.621488144 secs.nsecs subreqs per batch batches %% cum %% 1: 318 67 67 2: 71 15 82 4: 18 3 86 8: 1 0 86 16: 4 0 87 32: 22 4 92 64: 1 0 92 128: 0 0 92 256: 35 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff89b4c1e4c800.statahead_batch_max=64 llite.lustre-ffff89b4c1e4c800.statahead_max=128