== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:55:09 (1787619309) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats=0 llite.lustre-ffff9cd9b9c06000.statahead_max=32 llite.lustre-ffff9cd9b9c06000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats=0 total: 100 open/close in 3.27 seconds: 30.57 ops/second llite.lustre-ffff9cd9b9c06000.statahead_max=0 101 real 0m3.100s user 0m0.006s sys 0m0.306s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9cd9b9c06000.statahead_max=32 llite.lustre-ffff9cd9b9c06000.statahead_max=32 101 real 0m1.179s user 0m0.004s sys 0m0.150s 'ls -l' 100 files with statahead: 1 sec statahead total: 131 statahead wrong: 2 agl total: 125 list_total: 30 fname_total: 98 hit_total: 4003 miss_total: 1309 swrong=2 ewrong=2 - open/close 720 (time 1787619339.25 total 10.01 last 71.92) total: 900 open/close in 12.80 seconds: 70.32 ops/second llite.lustre-ffff9cd9b9c06000.statahead_max=0 1001 real 0m20.213s user 0m0.034s sys 0m3.002s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9cd9b9c06000.statahead_max=32 llite.lustre-ffff9cd9b9c06000.statahead_max=32 1001 real 0m7.703s user 0m0.026s sys 0m1.528s 'ls -l' 1000 files with statahead: 7 sec statahead total: 132 statahead wrong: 2 agl total: 126 list_total: 31 fname_total: 98 hit_total: 5000 miss_total: 1312 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff9cd9b9c06000.statahead_stats= statahead total: 132 statahead wrong: 2 agl total: 126 list_total: 31 fname_total: 98 hit_total: 5000 miss_total: 1312 mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats= snapshot_time: 1787619401.030522533 secs.nsecs start_time: 1787619315.354082533 secs.nsecs elapsed_time: 85.676440000 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 653 (time 1787619414.46 total 10.02 last 65.18) - open/close 1353 (time 1787619424.47 total 20.02 last 69.97) - open/close 1938 (time 1787619434.48 total 30.04 last 58.41) - open/close 2531 (time 1787619444.51 total 40.07 last 59.12) - open/close 3286 (time 1787619454.52 total 50.08 last 75.40) - open/close 4105 (time 1787619464.53 total 60.09 last 81.87) - open/close 4824 (time 1787619474.54 total 70.10 last 71.82) - open/close 5462 (time 1787619484.55 total 80.11 last 63.74) - open/close 6065 (time 1787619494.56 total 90.12 last 60.24) - open/close 6793 (time 1787619504.58 total 100.14 last 72.66) - open/close 7563 (time 1787619514.59 total 110.15 last 76.92) - open/close 8348 (time 1787619524.59 total 120.15 last 78.45) - open/close 9053 (time 1787619534.60 total 130.16 last 70.46) - open/close 9775 (time 1787619544.61 total 140.16 last 72.16) total: 10000 open/close in 143.08 seconds: 69.89 ops/second llite.lustre-ffff9cd9b9c06000.statahead_batch_max=0 llite.lustre-ffff9cd9b9c06000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.097s user 0m0.328s sys 0m16.458s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cd9b9c06000.statahead_batch_max=32 llite.lustre-ffff9cd9b9c06000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m28.809s user 0m0.302s sys 0m14.066s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats= snapshot_time: 1787619704.851709861 secs.nsecs start_time: 1787619608.939296040 secs.nsecs elapsed_time: 95.912413821 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 0 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats=0 llite.lustre-ffff9cd9b9c06000.statahead_max=2048 llite.lustre-ffff9cd9b9c06000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats=0 total: 100 open/close in 3.05 seconds: 32.77 ops/second llite.lustre-ffff9cd9b9c06000.statahead_max=0 101 real 0m2.466s user 0m0.004s sys 0m0.293s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9cd9b9c06000.statahead_max=2048 llite.lustre-ffff9cd9b9c06000.statahead_max=2048 101 real 0m1.549s user 0m0.007s sys 0m0.190s 'ls -l' 100 files with statahead: 2 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 401 (time 1787620060.78 total 10.01 last 40.06) total: 900 open/close in 19.77 seconds: 45.53 ops/second llite.lustre-ffff9cd9b9c06000.statahead_max=0 1001 real 0m22.197s user 0m0.039s sys 0m2.873s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff9cd9b9c06000.statahead_max=2048 llite.lustre-ffff9cd9b9c06000.statahead_max=2048 1001 real 0m6.292s user 0m0.025s sys 0m1.392s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff9cd9b9c06000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats= snapshot_time: 1787620136.148082284 secs.nsecs start_time: 1787619707.639868362 secs.nsecs elapsed_time: 428.508213922 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 640 (time 1787620148.07 total 10.04 last 63.76) - open/close 1207 (time 1787620158.07 total 20.04 last 56.70) - open/close 1799 (time 1787620168.07 total 30.04 last 59.18) - open/close 2444 (time 1787620178.08 total 40.05 last 64.41) - open/close 3066 (time 1787620188.08 total 50.05 last 62.20) - open/close 3659 (time 1787620198.14 total 60.11 last 59.00) - open/close 4332 (time 1787620208.14 total 70.11 last 67.29) - open/close 5034 (time 1787620218.14 total 80.11 last 70.15) - open/close 5602 (time 1787620228.16 total 90.13 last 56.71) - open/close 6178 (time 1787620238.17 total 100.14 last 57.55) - open/close 6676 (time 1787620248.18 total 110.15 last 49.74) - open/close 7272 (time 1787620258.22 total 120.19 last 59.36) - open/close 7927 (time 1787620268.23 total 130.20 last 65.42) - open/close 8486 (time 1787620278.24 total 140.21 last 55.85) - open/close 9043 (time 1787620288.27 total 150.24 last 55.55) - open/close 9551 (time 1787620298.29 total 160.26 last 50.72) total: 10000 open/close in 169.57 seconds: 58.97 ops/second llite.lustre-ffff9cd9b9c06000.statahead_batch_max=0 llite.lustre-ffff9cd9b9c06000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.784s user 0m0.336s sys 0m14.970s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9cd9b9c06000.statahead_batch_max=256 llite.lustre-ffff9cd9b9c06000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.161s user 0m0.264s sys 0m14.271s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9cd9b9c06000.batch_stats= snapshot_time: 1787620448.934513092 secs.nsecs start_time: 1787620389.596239044 secs.nsecs elapsed_time: 59.338274048 secs.nsecs subreqs per batch batches %% cum %% 1: 98 46 46 2: 18 8 54 4: 15 7 62 8: 15 7 69 16: 12 5 74 32: 9 4 79 64: 8 3 82 128: 0 0 82 256: 36 17 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9cd9b9c06000.statahead_batch_max=64 llite.lustre-ffff9cd9b9c06000.statahead_max=128