== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:11:57 (1783566717) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats=0 llite.lustre-ffff9bbbc5f79000.statahead_max=32 llite.lustre-ffff9bbbc5f79000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats=0 total: 100 open/close in 0.67 seconds: 150.21 ops/second llite.lustre-ffff9bbbc5f79000.statahead_max=0 101 real 0m0.584s user 0m0.002s sys 0m0.234s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9bbbc5f79000.statahead_max=32 llite.lustre-ffff9bbbc5f79000.statahead_max=32 101 real 0m0.381s user 0m0.001s sys 0m0.224s 'ls -l' 100 files with statahead: 0 sec statahead total: 85 statahead wrong: 1 agl total: 80 list_total: 27 fname_total: 58 hit_total: 4042 miss_total: 231 swrong=1 ewrong=1 total: 900 open/close in 1.99 seconds: 453.08 ops/second llite.lustre-ffff9bbbc5f79000.statahead_max=0 1001 real 0m5.928s user 0m0.021s sys 0m2.300s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9bbbc5f79000.statahead_max=32 llite.lustre-ffff9bbbc5f79000.statahead_max=32 1001 real 0m3.478s user 0m0.015s sys 0m2.049s 'ls -l' 1000 files with statahead: 4 sec statahead total: 86 statahead wrong: 1 agl total: 81 list_total: 28 fname_total: 58 hit_total: 5041 miss_total: 232 swrong=1 ewrong=1 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 4 seconds llite.lustre-ffff9bbbc5f79000.statahead_stats= statahead total: 86 statahead wrong: 1 agl total: 81 list_total: 28 fname_total: 58 hit_total: 5041 miss_total: 232 mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats= snapshot_time: 1783566741.415603620 secs.nsecs start_time: 1783566718.511356870 secs.nsecs elapsed_time: 22.904246750 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 2 2 8: 2 5 7 16: 2 5 12 32: 34 87 100 - open/close 4219 (time 1783566752.16 total 10.00 last 421.78) - open/close 8499 (time 1783566762.16 total 20.00 last 427.97) total: 10000 open/close in 23.44 seconds: 426.70 ops/second llite.lustre-ffff9bbbc5f79000.statahead_batch_max=0 llite.lustre-ffff9bbbc5f79000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.727s user 0m0.192s sys 0m31.592s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bbbc5f79000.statahead_batch_max=32 llite.lustre-ffff9bbbc5f79000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m40.281s user 0m0.224s sys 0m21.615s batched statahead RPC= hit count=9997 mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats= snapshot_time: 1783566850.375998820 secs.nsecs start_time: 1783566803.206193439 secs.nsecs elapsed_time: 47.169805381 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats=0 llite.lustre-ffff9bbbc5f79000.statahead_max=2048 llite.lustre-ffff9bbbc5f79000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats=0 total: 100 open/close in 0.88 seconds: 113.89 ops/second llite.lustre-ffff9bbbc5f79000.statahead_max=0 101 real 0m0.797s user 0m0.008s sys 0m0.282s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9bbbc5f79000.statahead_max=2048 llite.lustre-ffff9bbbc5f79000.statahead_max=2048 101 real 0m0.517s user 0m0.003s sys 0m0.354s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10096 miss_total: 4 swrong=0 ewrong=0 total: 900 open/close in 3.54 seconds: 254.19 ops/second llite.lustre-ffff9bbbc5f79000.statahead_max=0 1001 real 0m7.436s user 0m0.040s sys 0m2.602s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff9bbbc5f79000.statahead_max=2048 llite.lustre-ffff9bbbc5f79000.statahead_max=2048 1001 real 0m3.256s user 0m0.012s sys 0m1.991s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11095 miss_total: 5 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff9bbbc5f79000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11095 miss_total: 5 mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats= snapshot_time: 1783566974.339317669 secs.nsecs start_time: 1783566851.307230468 secs.nsecs elapsed_time: 123.032087201 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 3506 (time 1783566985.64 total 10.00 last 350.54) - open/close 6815 (time 1783566995.65 total 20.01 last 330.76) total: 10000 open/close in 29.90 seconds: 334.40 ops/second llite.lustre-ffff9bbbc5f79000.statahead_batch_max=0 llite.lustre-ffff9bbbc5f79000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.487s user 0m0.208s sys 0m27.779s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9bbbc5f79000.statahead_batch_max=256 llite.lustre-ffff9bbbc5f79000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m26.622s user 0m0.147s sys 0m19.348s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9bbbc5f79000.batch_stats= snapshot_time: 1783567075.004003695 secs.nsecs start_time: 1783567042.357811439 secs.nsecs elapsed_time: 32.646192256 secs.nsecs subreqs per batch batches %% cum %% 1: 273 63 63 2: 54 12 75 4: 33 7 83 8: 9 2 85 16: 6 1 86 32: 23 5 91 64: 0 0 91 128: 0 0 91 256: 35 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9bbbc5f79000.statahead_batch_max=64 llite.lustre-ffff9bbbc5f79000.statahead_max=128