== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:08:00 (1786637280) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats=0 llite.lustre-ffff9d64058ba000.statahead_max=32 llite.lustre-ffff9d64058ba000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats=0 total: 100 open/close in 2.48 seconds: 40.39 ops/second llite.lustre-ffff9d64058ba000.statahead_max=0 101 real 0m2.739s user 0m0.008s sys 0m0.367s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9d64058ba000.statahead_max=32 llite.lustre-ffff9d64058ba000.statahead_max=32 101 real 0m1.036s user 0m0.003s sys 0m0.174s 'ls -l' 100 files with statahead: 1 sec statahead total: 141 statahead wrong: 2 agl total: 135 list_total: 29 fname_total: 112 hit_total: 3636 miss_total: 1442 swrong=2 ewrong=2 - open/close 744 (time 1786637307.65 total 10.00 last 74.38) total: 900 open/close in 12.09 seconds: 74.42 ops/second llite.lustre-ffff9d64058ba000.statahead_max=0 1001 real 0m22.285s user 0m0.027s sys 0m3.280s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff9d64058ba000.statahead_max=32 llite.lustre-ffff9d64058ba000.statahead_max=32 1001 real 0m11.656s user 0m0.019s sys 0m1.598s 'ls -l' 1000 files with statahead: 12 sec statahead total: 142 statahead wrong: 2 agl total: 136 list_total: 30 fname_total: 112 hit_total: 4635 miss_total: 1443 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff9d64058ba000.statahead_stats= statahead total: 142 statahead wrong: 2 agl total: 136 list_total: 30 fname_total: 112 hit_total: 4635 miss_total: 1443 mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats= snapshot_time: 1786637381.968519797 secs.nsecs start_time: 1786637285.599129116 secs.nsecs elapsed_time: 96.369390681 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 2 5 10 16: 2 5 15 32: 34 85 100 - open/close 676 (time 1786637394.46 total 10.02 last 67.49) - open/close 1429 (time 1786637404.46 total 20.02 last 75.28) - open/close 2127 (time 1786637414.48 total 30.04 last 69.68) - open/close 2900 (time 1786637424.49 total 40.04 last 77.27) - open/close 3611 (time 1786637434.50 total 50.06 last 70.98) - open/close 4340 (time 1786637444.51 total 60.06 last 72.84) - open/close 5063 (time 1786637454.52 total 70.07 last 72.25) - open/close 5746 (time 1786637464.54 total 80.10 last 68.12) - open/close 6295 (time 1786637474.56 total 90.11 last 54.82) - open/close 6994 (time 1786637484.57 total 100.12 last 69.81) - open/close 7646 (time 1786637494.58 total 110.14 last 65.12) - open/close 8364 (time 1786637504.62 total 120.18 last 71.50) - open/close 8963 (time 1786637514.63 total 130.18 last 59.86) - open/close 9522 (time 1786637524.64 total 140.19 last 55.86) total: 10000 open/close in 148.89 seconds: 67.17 ops/second llite.lustre-ffff9d64058ba000.statahead_batch_max=0 llite.lustre-ffff9d64058ba000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d64058ba000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m7.549s user 0m0.371s sys 0m17.137s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9d64058ba000.statahead_batch_max=32 llite.lustre-ffff9d64058ba000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9d64058ba000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m59.283s user 0m0.353s sys 0m15.765s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats= snapshot_time: 1786637750.056854443 secs.nsecs start_time: 1786637613.718264038 secs.nsecs elapsed_time: 136.338590405 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats=0 llite.lustre-ffff9d64058ba000.statahead_max=2048 llite.lustre-ffff9d64058ba000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats=0 total: 100 open/close in 2.71 seconds: 36.94 ops/second llite.lustre-ffff9d64058ba000.statahead_max=0 101 real 0m3.045s user 0m0.006s sys 0m0.354s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9d64058ba000.statahead_max=2048 llite.lustre-ffff9d64058ba000.statahead_max=2048 101 real 0m1.009s user 0m0.003s sys 0m0.171s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 691 (time 1786638097.32 total 10.02 last 68.93) total: 900 open/close in 13.13 seconds: 68.54 ops/second llite.lustre-ffff9d64058ba000.statahead_max=0 1001 real 0m22.858s user 0m0.033s sys 0m3.269s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff9d64058ba000.statahead_max=2048 llite.lustre-ffff9d64058ba000.statahead_max=2048 1001 real 0m7.938s user 0m0.027s sys 0m1.632s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 27 seconds llite.lustre-ffff9d64058ba000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats= snapshot_time: 1786638172.904288941 secs.nsecs start_time: 1786637753.151891536 secs.nsecs elapsed_time: 419.752397405 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 682 (time 1786638185.53 total 10.00 last 68.17) - open/close 1320 (time 1786638195.53 total 20.01 last 63.78) - open/close 1942 (time 1786638205.54 total 30.02 last 62.16) - open/close 2628 (time 1786638215.55 total 40.02 last 68.56) - open/close 3275 (time 1786638225.56 total 50.04 last 64.60) - open/close 3853 (time 1786638235.57 total 60.05 last 57.75) - open/close 4326 (time 1786638245.57 total 70.05 last 47.29) - open/close 4817 (time 1786638255.60 total 80.07 last 48.99) - open/close 5331 (time 1786638265.60 total 90.08 last 51.37) - open/close 5963 (time 1786638275.62 total 100.10 last 63.08) - open/close 6688 (time 1786638285.63 total 110.10 last 72.43) - open/close 7491 (time 1786638295.66 total 120.13 last 80.09) - open/close 8264 (time 1786638305.67 total 130.14 last 77.22) - open/close 9048 (time 1786638315.67 total 140.14 last 78.39) - open/close 9805 (time 1786638325.67 total 150.14 last 75.69) total: 10000 open/close in 153.02 seconds: 65.35 ops/second llite.lustre-ffff9d64058ba000.statahead_batch_max=0 llite.lustre-ffff9d64058ba000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d64058ba000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.070s user 0m0.335s sys 0m16.461s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9d64058ba000.statahead_batch_max=256 llite.lustre-ffff9d64058ba000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9d64058ba000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m5.813s user 0m0.328s sys 0m17.260s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9d64058ba000.batch_stats= snapshot_time: 1786638486.228226407 secs.nsecs start_time: 1786638403.149721912 secs.nsecs elapsed_time: 83.078504495 secs.nsecs subreqs per batch batches %% cum %% 1: 136 48 48 2: 45 16 64 4: 21 7 71 8: 15 5 77 16: 10 3 80 32: 14 4 85 64: 4 1 87 128: 1 0 87 256: 35 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9d64058ba000.statahead_batch_max=64 llite.lustre-ffff9d64058ba000.statahead_max=128