== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:10:36 (1783354236) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats=0 llite.lustre-ffff9a30c672c800.statahead_max=32 llite.lustre-ffff9a30c672c800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats=0 total: 100 open/close in 0.67 seconds: 149.41 ops/second llite.lustre-ffff9a30c672c800.statahead_max=0 101 real 0m0.611s user 0m0.004s sys 0m0.241s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9a30c672c800.statahead_max=32 llite.lustre-ffff9a30c672c800.statahead_max=32 101 real 0m0.417s user 0m0.003s sys 0m0.256s 'ls -l' 100 files with statahead: 0 sec statahead total: 94 statahead wrong: 2 agl total: 89 list_total: 30 fname_total: 49 hit_total: 13854 miss_total: 1742 swrong=2 ewrong=2 total: 900 open/close in 2.35 seconds: 383.11 ops/second llite.lustre-ffff9a30c672c800.statahead_max=0 1001 real 0m5.524s user 0m0.020s sys 0m2.149s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff9a30c672c800.statahead_max=32 llite.lustre-ffff9a30c672c800.statahead_max=32 1001 real 0m3.425s user 0m0.016s sys 0m2.034s 'ls -l' 1000 files with statahead: 4 sec statahead total: 95 statahead wrong: 2 agl total: 90 list_total: 31 fname_total: 49 hit_total: 14853 miss_total: 1743 swrong=2 ewrong=2 - open/close 4917 (time 1783354266.18 total 10.00 last 491.60) total: 9000 open/close in 18.42 seconds: 488.48 ops/second llite.lustre-ffff9a30c672c800.statahead_max=0 10001 real 1m0.618s user 0m0.234s sys 0m23.099s 'ls -l' 10000 files without statahead: 61 sec llite.lustre-ffff9a30c672c800.statahead_max=32 llite.lustre-ffff9a30c672c800.statahead_max=32 10001 real 0m38.955s user 0m0.155s sys 0m22.615s 'ls -l' 10000 files with statahead: 39 sec statahead total: 96 statahead wrong: 2 agl total: 91 list_total: 32 fname_total: 49 hit_total: 24852 miss_total: 1744 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 66 seconds llite.lustre-ffff9a30c672c800.statahead_stats= statahead total: 96 statahead wrong: 2 agl total: 91 list_total: 32 fname_total: 49 hit_total: 24852 miss_total: 1744 mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats= snapshot_time: 1783354452.973170252 secs.nsecs start_time: 1783354238.248780650 secs.nsecs elapsed_time: 214.724389602 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 4 1 1 16: 4 1 2 32: 346 97 100 - open/close 4266 (time 1783354463.74 total 10.00 last 426.54) - open/close 8503 (time 1783354473.74 total 20.00 last 423.63) total: 10000 open/close in 23.50 seconds: 425.52 ops/second llite.lustre-ffff9a30c672c800.statahead_batch_max=0 llite.lustre-ffff9a30c672c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a30c672c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m35.899s user 0m0.163s sys 0m32.704s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a30c672c800.statahead_batch_max=32 llite.lustre-ffff9a30c672c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a30c672c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m39.760s user 0m0.155s sys 0m23.003s batched statahead RPC= hit count=9998 mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats= snapshot_time: 1783354562.441491327 secs.nsecs start_time: 1783354516.207327953 secs.nsecs elapsed_time: 46.234163374 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 1 32: 312 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats=0 llite.lustre-ffff9a30c672c800.statahead_max=2048 llite.lustre-ffff9a30c672c800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats=0 total: 100 open/close in 1.08 seconds: 92.36 ops/second llite.lustre-ffff9a30c672c800.statahead_max=0 101 real 0m0.600s user 0m0.000s sys 0m0.236s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9a30c672c800.statahead_max=2048 llite.lustre-ffff9a30c672c800.statahead_max=2048 101 real 0m0.370s user 0m0.001s sys 0m0.220s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10097 miss_total: 3 swrong=0 ewrong=0 total: 900 open/close in 1.95 seconds: 462.30 ops/second llite.lustre-ffff9a30c672c800.statahead_max=0 1001 real 0m5.673s user 0m0.017s sys 0m2.189s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff9a30c672c800.statahead_max=2048 llite.lustre-ffff9a30c672c800.statahead_max=2048 1001 real 0m3.508s user 0m0.014s sys 0m1.206s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff9a30c672c800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats= snapshot_time: 1783354673.082621027 secs.nsecs start_time: 1783354563.282841259 secs.nsecs elapsed_time: 109.799779768 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 4572 (time 1783354683.84 total 10.00 last 457.16) - open/close 9122 (time 1783354693.85 total 20.01 last 454.52) total: 10000 open/close in 22.13 seconds: 451.79 ops/second llite.lustre-ffff9a30c672c800.statahead_batch_max=0 llite.lustre-ffff9a30c672c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a30c672c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.399s user 0m0.143s sys 0m28.675s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a30c672c800.statahead_batch_max=256 llite.lustre-ffff9a30c672c800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a30c672c800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m28.802s user 0m0.154s sys 0m20.733s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a30c672c800.batch_stats= snapshot_time: 1783354768.592222136 secs.nsecs start_time: 1783354733.372137453 secs.nsecs elapsed_time: 35.220084683 secs.nsecs subreqs per batch batches %% cum %% 1: 455 68 68 2: 76 11 80 4: 51 7 88 8: 18 2 90 16: 5 0 91 32: 22 3 94 64: 0 0 94 128: 0 0 94 256: 34 5 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a30c672c800.statahead_batch_max=64 llite.lustre-ffff9a30c672c800.statahead_max=128