== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:00:54 (1783648854) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats=0 llite.lustre-ffff8e9e8af3c000.statahead_max=32 llite.lustre-ffff8e9e8af3c000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats=0 total: 100 open/close in 0.81 seconds: 123.04 ops/second llite.lustre-ffff8e9e8af3c000.statahead_max=0 101 real 0m0.779s user 0m0.003s sys 0m0.284s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8e9e8af3c000.statahead_max=32 llite.lustre-ffff8e9e8af3c000.statahead_max=32 101 real 0m0.413s user 0m0.003s sys 0m0.209s 'ls -l' 100 files with statahead: 0 sec statahead total: 68 statahead wrong: 2 agl total: 65 list_total: 26 fname_total: 42 hit_total: 4177 miss_total: 731 swrong=2 ewrong=2 total: 900 open/close in 2.30 seconds: 390.75 ops/second llite.lustre-ffff8e9e8af3c000.statahead_max=0 1001 real 0m6.669s user 0m0.021s sys 0m2.490s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8e9e8af3c000.statahead_max=32 llite.lustre-ffff8e9e8af3c000.statahead_max=32 1001 real 0m3.937s user 0m0.013s sys 0m2.327s 'ls -l' 1000 files with statahead: 4 sec statahead total: 69 statahead wrong: 2 agl total: 66 list_total: 27 fname_total: 42 hit_total: 5176 miss_total: 732 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff8e9e8af3c000.statahead_stats= statahead total: 69 statahead wrong: 2 agl total: 66 list_total: 27 fname_total: 42 hit_total: 5176 miss_total: 732 mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats= snapshot_time: 1783648882.681449904 secs.nsecs start_time: 1783648855.838471761 secs.nsecs elapsed_time: 26.842978143 secs.nsecs subreqs per batch batches %% cum %% 1: 4 9 9 2: 1 2 11 4: 0 0 11 8: 2 4 16 16: 2 4 20 32: 34 79 100 - open/close 4243 (time 1783648893.99 total 10.00 last 424.24) - open/close 7879 (time 1783648903.99 total 20.00 last 363.59) total: 10000 open/close in 25.86 seconds: 386.69 ops/second llite.lustre-ffff8e9e8af3c000.statahead_batch_max=0 llite.lustre-ffff8e9e8af3c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.845s user 0m0.214s sys 0m31.749s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e9e8af3c000.statahead_batch_max=32 llite.lustre-ffff8e9e8af3c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.541s user 0m0.170s sys 0m21.939s batched statahead RPC= hit count=9998 mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats= snapshot_time: 1783648991.371560593 secs.nsecs start_time: 1783648947.880552378 secs.nsecs elapsed_time: 43.491008215 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats=0 llite.lustre-ffff8e9e8af3c000.statahead_max=2048 llite.lustre-ffff8e9e8af3c000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats=0 total: 100 open/close in 1.08 seconds: 92.27 ops/second llite.lustre-ffff8e9e8af3c000.statahead_max=0 101 real 0m0.718s user 0m0.000s sys 0m0.276s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8e9e8af3c000.statahead_max=2048 llite.lustre-ffff8e9e8af3c000.statahead_max=2048 101 real 0m0.367s user 0m0.002s sys 0m0.229s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10097 miss_total: 3 swrong=0 ewrong=0 total: 900 open/close in 2.63 seconds: 341.99 ops/second llite.lustre-ffff8e9e8af3c000.statahead_max=0 1001 real 0m5.799s user 0m0.013s sys 0m2.255s 'ls -l' 1000 files without statahead: 5 sec llite.lustre-ffff8e9e8af3c000.statahead_max=2048 llite.lustre-ffff8e9e8af3c000.statahead_max=2048 1001 real 0m3.332s user 0m0.016s sys 0m1.517s 'ls -l' 1000 files with statahead: 3 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11096 miss_total: 4 swrong=0 ewrong=0 - open/close 4545 (time 1783649106.84 total 10.00 last 454.44) total: 9000 open/close in 19.89 seconds: 452.56 ops/second llite.lustre-ffff8e9e8af3c000.statahead_max=0 10001 real 0m55.000s user 0m0.183s sys 0m21.431s 'ls -l' 10000 files without statahead: 55 sec llite.lustre-ffff8e9e8af3c000.statahead_max=2048 llite.lustre-ffff8e9e8af3c000.statahead_max=2048 10001 real 0m27.511s user 0m0.164s sys 0m19.775s 'ls -l' 10000 files with statahead: 28 sec statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21095 miss_total: 5 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 65 seconds llite.lustre-ffff8e9e8af3c000.statahead_stats= statahead total: 4 statahead wrong: 0 agl total: 4 list_total: 4 fname_total: 0 hit_total: 21095 miss_total: 5 mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats= snapshot_time: 1783649275.777768627 secs.nsecs start_time: 1783648992.269711025 secs.nsecs elapsed_time: 283.508057602 secs.nsecs subreqs per batch batches %% cum %% 1: 433 69 69 2: 80 12 81 4: 34 5 87 8: 9 1 88 16: 9 1 90 32: 23 3 93 64: 0 0 93 128: 1 0 93 256: 38 6 100 - open/close 4496 (time 1783649286.53 total 10.00 last 449.42) - open/close 9201 (time 1783649296.53 total 20.00 last 470.45) total: 10000 open/close in 21.88 seconds: 457.08 ops/second llite.lustre-ffff8e9e8af3c000.statahead_batch_max=0 llite.lustre-ffff8e9e8af3c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.564s user 0m0.155s sys 0m26.370s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e9e8af3c000.statahead_batch_max=256 llite.lustre-ffff8e9e8af3c000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m26.421s user 0m0.163s sys 0m18.599s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8e9e8af3c000.batch_stats= snapshot_time: 1783649366.088845768 secs.nsecs start_time: 1783649333.097798806 secs.nsecs elapsed_time: 32.991046962 secs.nsecs subreqs per batch batches %% cum %% 1: 281 60 60 2: 63 13 74 4: 44 9 83 8: 11 2 86 16: 6 1 87 32: 21 4 92 64: 1 0 92 128: 1 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8e9e8af3c000.statahead_batch_max=64 llite.lustre-ffff8e9e8af3c000.statahead_max=128