== sanity test 123ad: Verify batching statahead works correctly ========================================================== 14:38:59 (1783449539) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats=0 llite.lustre-ffff97aa50a38800.statahead_max=32 llite.lustre-ffff97aa50a38800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats=0 striped dir -i1 -c2 -H crush /mnt/lustre/d123ad.sanity total: 100 open/close in 1.07 seconds: 93.84 ops/second llite.lustre-ffff97aa50a38800.statahead_max=0 101 real 0m1.089s user 0m0.006s sys 0m0.312s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff97aa50a38800.statahead_max=32 llite.lustre-ffff97aa50a38800.statahead_max=32 101 real 0m0.436s user 0m0.007s sys 0m0.217s 'ls -l' 100 files with statahead: 1 sec statahead total: 143 statahead wrong: 2 agl total: 136 list_total: 30 fname_total: 108 hit_total: 3780 miss_total: 1670 swrong=2 ewrong=2 total: 900 open/close in 3.03 seconds: 297.13 ops/second llite.lustre-ffff97aa50a38800.statahead_max=0 1001 real 0m8.847s user 0m0.027s sys 0m2.924s 'ls -l' 1000 files without statahead: 9 sec llite.lustre-ffff97aa50a38800.statahead_max=32 llite.lustre-ffff97aa50a38800.statahead_max=32 1001 real 0m4.074s user 0m0.017s sys 0m1.878s 'ls -l' 1000 files with statahead: 4 sec statahead total: 144 statahead wrong: 2 agl total: 137 list_total: 31 fname_total: 108 hit_total: 4779 miss_total: 1671 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff97aa50a38800.statahead_stats= statahead total: 144 statahead wrong: 2 agl total: 137 list_total: 31 fname_total: 108 hit_total: 4779 miss_total: 1671 mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats= snapshot_time: 1783449573.547390390 secs.nsecs start_time: 1783449540.732700180 secs.nsecs elapsed_time: 32.814690210 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 2 5 5 4: 3 8 13 8: 2 5 19 16: 23 63 83 32: 6 16 100 mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats= snapshot_time: 1783449573.547450866 secs.nsecs start_time: 1783449540.732776469 secs.nsecs elapsed_time: 32.814674397 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 1 2 5 4: 1 2 7 8: 2 5 12 16: 13 32 45 32: 22 55 100 - open/close 2108 (time 1783449584.79 total 10.00 last 210.77) - open/close 4538 (time 1783449594.79 total 20.00 last 242.99) - open/close 6340 (time 1783449604.79 total 30.00 last 180.18) - open/close 7819 (time 1783449614.80 total 40.01 last 147.83) - open/close 9625 (time 1783449624.80 total 50.01 last 180.55) total: 10000 open/close in 52.23 seconds: 191.46 ops/second llite.lustre-ffff97aa50a38800.statahead_batch_max=0 llite.lustre-ffff97aa50a38800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97aa50a38800.stats=clear mdc.lustre-MDT0001-mdc-ffff97aa50a38800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.282s user 0m0.247s sys 0m30.712s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff97aa50a38800.statahead_batch_max=32 llite.lustre-ffff97aa50a38800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff97aa50a38800.stats=clear mdc.lustre-MDT0001-mdc-ffff97aa50a38800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.270s user 0m0.222s sys 0m20.621s batched statahead RPC= hit count=9992 mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats= snapshot_time: 1783449713.178884031 secs.nsecs start_time: 1783449665.101324968 secs.nsecs elapsed_time: 48.077559063 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats= snapshot_time: 1783449713.178960728 secs.nsecs start_time: 1783449665.101423680 secs.nsecs elapsed_time: 48.077537048 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats=0 llite.lustre-ffff97aa50a38800.statahead_max=2048 llite.lustre-ffff97aa50a38800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats=0 striped dir -i1 -c2 -H all_char /mnt/lustre/d123ad.sanity total: 100 open/close in 0.97 seconds: 102.95 ops/second llite.lustre-ffff97aa50a38800.statahead_max=0 101 real 0m0.827s user 0m0.004s sys 0m0.274s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff97aa50a38800.statahead_max=2048 llite.lustre-ffff97aa50a38800.statahead_max=2048 101 real 0m0.451s user 0m0.002s sys 0m0.230s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10091 miss_total: 9 swrong=0 ewrong=0 total: 900 open/close in 4.24 seconds: 212.30 ops/second llite.lustre-ffff97aa50a38800.statahead_max=0 1001 real 0m8.778s user 0m0.034s sys 0m2.795s 'ls -l' 1000 files without statahead: 9 sec llite.lustre-ffff97aa50a38800.statahead_max=2048 llite.lustre-ffff97aa50a38800.statahead_max=2048 1001 real 0m3.536s user 0m0.010s sys 0m1.575s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11090 miss_total: 10 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff97aa50a38800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11090 miss_total: 10 mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats= snapshot_time: 1783449861.051000620 secs.nsecs start_time: 1783449714.176426609 secs.nsecs elapsed_time: 146.874574011 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 12 12 4: 2 25 37 8: 2 25 62 16: 0 0 62 32: 0 0 62 64: 1 12 75 128: 0 0 75 256: 2 25 100 mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats= snapshot_time: 1783449861.051063274 secs.nsecs start_time: 1783449714.176584541 secs.nsecs elapsed_time: 146.874478733 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 12 12 8: 3 37 50 16: 1 12 62 32: 1 12 75 64: 0 0 75 128: 0 0 75 256: 2 25 100 - open/close 2534 (time 1783449872.06 total 10.00 last 253.30) - open/close 4294 (time 1783449882.06 total 20.01 last 175.95) - open/close 6361 (time 1783449892.06 total 30.01 last 206.69) - open/close 8328 (time 1783449902.06 total 40.01 last 196.67) total: 10000 open/close in 48.27 seconds: 207.19 ops/second llite.lustre-ffff97aa50a38800.statahead_batch_max=0 llite.lustre-ffff97aa50a38800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97aa50a38800.stats=clear mdc.lustre-MDT0001-mdc-ffff97aa50a38800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m37.583s user 0m0.216s sys 0m30.836s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff97aa50a38800.statahead_batch_max=256 llite.lustre-ffff97aa50a38800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff97aa50a38800.stats=clear mdc.lustre-MDT0001-mdc-ffff97aa50a38800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m29.213s user 0m0.197s sys 0m21.070s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff97aa50a38800.batch_stats= snapshot_time: 1783449987.694479509 secs.nsecs start_time: 1783449951.753699774 secs.nsecs elapsed_time: 35.940779735 secs.nsecs subreqs per batch batches %% cum %% 1: 283 65 65 2: 45 10 75 4: 27 6 81 8: 15 3 85 16: 4 0 86 32: 20 4 90 64: 5 1 92 128: 0 0 92 256: 34 7 100 mdc.lustre-MDT0001-mdc-ffff97aa50a38800.batch_stats= snapshot_time: 1783449987.694542261 secs.nsecs start_time: 1783449951.753752714 secs.nsecs elapsed_time: 35.940789547 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff97aa50a38800.statahead_batch_max=64 llite.lustre-ffff97aa50a38800.statahead_max=128