== sanity test 123ad: Verify batching statahead works correctly ========================================================== 08:17:11 (1787141831) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats=0 llite.lustre-ffff973b43491800.statahead_max=32 llite.lustre-ffff973b43491800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats=0 total: 100 open/close in 3.41 seconds: 29.29 ops/second llite.lustre-ffff973b43491800.statahead_max=0 101 real 0m2.602s user 0m0.004s sys 0m0.321s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff973b43491800.statahead_max=32 llite.lustre-ffff973b43491800.statahead_max=32 101 real 0m1.630s user 0m0.004s sys 0m0.179s 'ls -l' 100 files with statahead: 2 sec statahead total: 120 statahead wrong: 2 agl total: 114 list_total: 30 fname_total: 89 hit_total: 4466 miss_total: 774 swrong=2 ewrong=2 - open/close 645 (time 1787141861.53 total 10.00 last 64.50) total: 900 open/close in 14.28 seconds: 63.02 ops/second llite.lustre-ffff973b43491800.statahead_max=0 1001 real 0m24.658s user 0m0.025s sys 0m3.216s 'ls -l' 1000 files without statahead: 24 sec llite.lustre-ffff973b43491800.statahead_max=32 llite.lustre-ffff973b43491800.statahead_max=32 1001 real 0m12.346s user 0m0.028s sys 0m1.652s 'ls -l' 1000 files with statahead: 13 sec statahead total: 121 statahead wrong: 2 agl total: 115 list_total: 31 fname_total: 89 hit_total: 5462 miss_total: 778 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 29 seconds llite.lustre-ffff973b43491800.statahead_stats= statahead total: 121 statahead wrong: 2 agl total: 115 list_total: 31 fname_total: 89 hit_total: 5462 miss_total: 778 mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats= snapshot_time: 1787141945.688621693 secs.nsecs start_time: 1787141836.167574911 secs.nsecs elapsed_time: 109.521046782 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 1 2 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 587 (time 1787141958.48 total 10.00 last 58.69) - open/close 1216 (time 1787141968.49 total 20.01 last 62.84) - open/close 1887 (time 1787141978.50 total 30.02 last 67.02) - open/close 2517 (time 1787141988.53 total 40.05 last 62.82) - open/close 3163 (time 1787141998.55 total 50.07 last 64.49) - open/close 3802 (time 1787142008.55 total 60.07 last 63.87) - open/close 4475 (time 1787142018.57 total 70.08 last 67.22) - open/close 5140 (time 1787142028.57 total 80.09 last 66.46) - open/close 5723 (time 1787142038.57 total 90.09 last 58.30) - open/close 6309 (time 1787142048.58 total 100.10 last 58.57) - open/close 6922 (time 1787142058.58 total 110.10 last 61.29) - open/close 7496 (time 1787142068.58 total 120.10 last 57.39) - open/close 8091 (time 1787142078.58 total 130.10 last 59.49) - open/close 8694 (time 1787142088.59 total 140.11 last 60.27) - open/close 9293 (time 1787142098.62 total 150.13 last 59.74) - open/close 9912 (time 1787142108.63 total 160.15 last 61.83) total: 10000 open/close in 161.59 seconds: 61.89 ops/second llite.lustre-ffff973b43491800.statahead_batch_max=0 llite.lustre-ffff973b43491800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff973b43491800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.682s user 0m0.348s sys 0m18.373s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff973b43491800.statahead_batch_max=32 llite.lustre-ffff973b43491800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff973b43491800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m50.916s user 0m0.315s sys 0m15.959s batched statahead RPC= hit count=9995 mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats= snapshot_time: 1787142311.924017872 secs.nsecs start_time: 1787142185.617268872 secs.nsecs elapsed_time: 126.306749000 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats=0 llite.lustre-ffff973b43491800.statahead_max=2048 llite.lustre-ffff973b43491800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats=0 total: 100 open/close in 3.88 seconds: 25.76 ops/second llite.lustre-ffff973b43491800.statahead_max=0 101 real 0m3.078s user 0m0.005s sys 0m0.417s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff973b43491800.statahead_max=2048 llite.lustre-ffff973b43491800.statahead_max=2048 101 real 0m1.337s user 0m0.007s sys 0m0.210s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10094 miss_total: 6 swrong=0 ewrong=0 - open/close 568 (time 1787142688.67 total 10.01 last 56.74) total: 900 open/close in 15.32 seconds: 58.76 ops/second llite.lustre-ffff973b43491800.statahead_max=0 1001 real 0m24.406s user 0m0.035s sys 0m3.262s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff973b43491800.statahead_max=2048 llite.lustre-ffff973b43491800.statahead_max=2048 1001 real 0m7.833s user 0m0.033s sys 0m1.472s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11093 miss_total: 7 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff973b43491800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11093 miss_total: 7 mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats= snapshot_time: 1787142763.439057169 secs.nsecs start_time: 1787142314.620022409 secs.nsecs elapsed_time: 448.819034760 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 656 (time 1787142775.91 total 10.01 last 65.55) - open/close 1283 (time 1787142785.91 total 20.01 last 62.69) - open/close 1935 (time 1787142795.93 total 30.02 last 65.10) - open/close 2607 (time 1787142805.94 total 40.03 last 67.15) - open/close 3260 (time 1787142815.94 total 50.03 last 65.30) - open/close 3921 (time 1787142825.94 total 60.04 last 66.07) - open/close 4600 (time 1787142835.96 total 70.05 last 67.80) - open/close 5269 (time 1787142845.97 total 80.07 last 66.79) - open/close 5953 (time 1787142855.98 total 90.08 last 68.32) - open/close 6610 (time 1787142865.99 total 100.09 last 65.65) - open/close 7308 (time 1787142875.99 total 110.09 last 69.79) - open/close 7942 (time 1787142886.00 total 120.09 last 63.38) - open/close 8606 (time 1787142896.01 total 130.10 last 66.32) - open/close 9266 (time 1787142906.01 total 140.10 last 65.99) - open/close 9871 (time 1787142916.01 total 150.11 last 60.48) total: 10000 open/close in 152.41 seconds: 65.61 ops/second llite.lustre-ffff973b43491800.statahead_batch_max=0 llite.lustre-ffff973b43491800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff973b43491800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.165s user 0m0.330s sys 0m17.744s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff973b43491800.statahead_batch_max=256 llite.lustre-ffff973b43491800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff973b43491800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.529s user 0m0.315s sys 0m17.495s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff973b43491800.batch_stats= snapshot_time: 1787143069.598526434 secs.nsecs start_time: 1787142997.573059466 secs.nsecs elapsed_time: 72.025466968 secs.nsecs subreqs per batch batches %% cum %% 1: 130 43 43 2: 44 14 58 4: 36 12 70 8: 18 6 77 16: 17 5 82 32: 14 4 87 64: 2 0 88 128: 0 0 88 256: 35 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff973b43491800.statahead_batch_max=64 llite.lustre-ffff973b43491800.statahead_max=128