== sanity test 123ad: Verify batching statahead works correctly ========================================================== 10:12:19 (1787148739) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats=0 llite.lustre-ffff90d805219800.statahead_max=32 llite.lustre-ffff90d805219800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats=0 total: 100 open/close in 3.69 seconds: 27.13 ops/second llite.lustre-ffff90d805219800.statahead_max=0 101 real 0m3.108s user 0m0.002s sys 0m0.359s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff90d805219800.statahead_max=32 llite.lustre-ffff90d805219800.statahead_max=32 101 real 0m1.382s user 0m0.003s sys 0m0.169s 'ls -l' 100 files with statahead: 1 sec statahead total: 122 statahead wrong: 2 agl total: 117 list_total: 31 fname_total: 89 hit_total: 4584 miss_total: 1292 swrong=2 ewrong=2 - open/close 572 (time 1787148771.35 total 10.02 last 57.09) total: 900 open/close in 15.81 seconds: 56.93 ops/second llite.lustre-ffff90d805219800.statahead_max=0 1001 real 0m25.657s user 0m0.042s sys 0m3.138s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff90d805219800.statahead_max=32 llite.lustre-ffff90d805219800.statahead_max=32 1001 real 0m13.143s user 0m0.036s sys 0m1.466s 'ls -l' 1000 files with statahead: 13 sec statahead total: 123 statahead wrong: 2 agl total: 118 list_total: 32 fname_total: 89 hit_total: 5578 miss_total: 1298 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff90d805219800.statahead_stats= statahead total: 123 statahead wrong: 2 agl total: 118 list_total: 32 fname_total: 89 hit_total: 5578 miss_total: 1298 mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats= snapshot_time: 1787148857.743177100 secs.nsecs start_time: 1787148745.590425834 secs.nsecs elapsed_time: 112.152751266 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 665 (time 1787148871.28 total 10.01 last 66.42) - open/close 1298 (time 1787148881.30 total 20.03 last 63.18) - open/close 1925 (time 1787148891.30 total 30.03 last 62.69) - open/close 2548 (time 1787148901.31 total 40.04 last 62.26) - open/close 3217 (time 1787148911.33 total 50.06 last 66.74) - open/close 3920 (time 1787148921.33 total 60.06 last 70.29) - open/close 4664 (time 1787148931.34 total 70.07 last 74.36) - open/close 5353 (time 1787148941.34 total 80.07 last 68.85) - open/close 6047 (time 1787148951.34 total 90.08 last 69.38) - open/close 6675 (time 1787148961.35 total 100.08 last 62.76) - open/close 7127 (time 1787148971.37 total 110.10 last 45.13) - open/close 7711 (time 1787148981.38 total 120.11 last 58.33) - open/close 8413 (time 1787148991.38 total 130.11 last 70.20) - open/close 9111 (time 1787149001.38 total 140.11 last 69.80) - open/close 9742 (time 1787149011.39 total 150.12 last 63.04) total: 10000 open/close in 154.31 seconds: 64.80 ops/second llite.lustre-ffff90d805219800.statahead_batch_max=0 llite.lustre-ffff90d805219800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90d805219800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.389s user 0m0.305s sys 0m14.481s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff90d805219800.statahead_batch_max=32 llite.lustre-ffff90d805219800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff90d805219800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m45.929s user 0m0.325s sys 0m13.836s batched statahead RPC= hit count=9987 mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats= snapshot_time: 1787149204.727656859 secs.nsecs start_time: 1787149087.507891345 secs.nsecs elapsed_time: 117.219765514 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats=0 llite.lustre-ffff90d805219800.statahead_max=2048 llite.lustre-ffff90d805219800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats=0 total: 100 open/close in 2.95 seconds: 33.87 ops/second llite.lustre-ffff90d805219800.statahead_max=0 101 real 0m2.492s user 0m0.003s sys 0m0.289s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff90d805219800.statahead_max=2048 llite.lustre-ffff90d805219800.statahead_max=2048 101 real 0m0.991s user 0m0.005s sys 0m0.164s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10086 miss_total: 14 swrong=0 ewrong=0 - open/close 857 (time 1787149529.55 total 10.01 last 85.63) total: 900 open/close in 10.74 seconds: 83.77 ops/second llite.lustre-ffff90d805219800.statahead_max=0 1001 real 0m18.006s user 0m0.042s sys 0m2.797s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff90d805219800.statahead_max=2048 llite.lustre-ffff90d805219800.statahead_max=2048 1001 real 0m6.192s user 0m0.028s sys 0m1.405s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11085 miss_total: 15 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff90d805219800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11085 miss_total: 15 mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats= snapshot_time: 1787149584.935871806 secs.nsecs start_time: 1787149207.476650334 secs.nsecs elapsed_time: 377.459221472 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 1 11 33 32: 1 11 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 703 (time 1787149597.11 total 10.01 last 70.25) - open/close 1479 (time 1787149607.12 total 20.01 last 77.56) - open/close 2234 (time 1787149617.12 total 30.02 last 75.44) - open/close 3087 (time 1787149627.14 total 40.03 last 85.18) - open/close 3879 (time 1787149637.16 total 50.05 last 79.03) - open/close 4682 (time 1787149647.17 total 60.06 last 80.23) - open/close 5454 (time 1787149657.18 total 70.07 last 77.13) - open/close 6278 (time 1787149667.20 total 80.10 last 82.20) - open/close 7058 (time 1787149677.20 total 90.10 last 78.00) - open/close 7839 (time 1787149687.20 total 100.10 last 78.10) - open/close 8609 (time 1787149697.22 total 110.11 last 76.89) - open/close 9412 (time 1787149707.22 total 120.12 last 80.24) total: 10000 open/close in 127.65 seconds: 78.34 ops/second llite.lustre-ffff90d805219800.statahead_batch_max=0 llite.lustre-ffff90d805219800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90d805219800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.974s user 0m0.321s sys 0m14.432s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff90d805219800.statahead_batch_max=256 llite.lustre-ffff90d805219800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff90d805219800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m48.190s user 0m0.295s sys 0m14.479s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff90d805219800.batch_stats= snapshot_time: 1787149835.531051828 secs.nsecs start_time: 1787149777.410389229 secs.nsecs elapsed_time: 58.120662599 secs.nsecs subreqs per batch batches %% cum %% 1: 82 38 38 2: 26 12 50 4: 16 7 58 8: 15 7 65 16: 14 6 72 32: 18 8 80 64: 5 2 83 128: 2 0 83 256: 34 16 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff90d805219800.statahead_batch_max=64 llite.lustre-ffff90d805219800.statahead_max=128