== sanity test 123ad: Verify batching statahead works correctly ========================================================== 04:59:32 (1787389172) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats=0 llite.lustre-ffff964c42e78000.statahead_max=32 llite.lustre-ffff964c42e78000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats=0 total: 100 open/close in 2.89 seconds: 34.63 ops/second llite.lustre-ffff964c42e78000.statahead_max=0 101 real 0m2.727s user 0m0.004s sys 0m0.323s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff964c42e78000.statahead_max=32 llite.lustre-ffff964c42e78000.statahead_max=32 101 real 0m1.005s user 0m0.006s sys 0m0.170s 'ls -l' 100 files with statahead: 1 sec statahead total: 158 statahead wrong: 2 agl total: 152 list_total: 44 fname_total: 112 hit_total: 3693 miss_total: 1560 swrong=2 ewrong=2 - open/close 789 (time 1787389200.64 total 10.00 last 78.88) total: 900 open/close in 11.64 seconds: 77.32 ops/second llite.lustre-ffff964c42e78000.statahead_max=0 1001 real 0m19.923s user 0m0.024s sys 0m3.079s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff964c42e78000.statahead_max=32 llite.lustre-ffff964c42e78000.statahead_max=32 1001 real 0m8.406s user 0m0.028s sys 0m1.639s 'ls -l' 1000 files with statahead: 8 sec statahead total: 159 statahead wrong: 2 agl total: 153 list_total: 45 fname_total: 112 hit_total: 4692 miss_total: 1561 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff964c42e78000.statahead_stats= statahead total: 159 statahead wrong: 2 agl total: 153 list_total: 45 fname_total: 112 hit_total: 4692 miss_total: 1561 mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats= snapshot_time: 1787389258.918077426 secs.nsecs start_time: 1787389177.440429220 secs.nsecs elapsed_time: 81.477648206 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 2 5 10 16: 2 5 15 32: 34 85 100 - open/close 846 (time 1787389271.02 total 10.01 last 84.55) - open/close 1700 (time 1787389281.03 total 20.02 last 85.27) - open/close 2500 (time 1787389291.04 total 30.03 last 79.93) - open/close 3345 (time 1787389301.05 total 40.03 last 84.46) - open/close 4256 (time 1787389311.05 total 50.04 last 91.03) - open/close 5031 (time 1787389321.06 total 60.04 last 77.47) - open/close 5882 (time 1787389331.06 total 70.05 last 85.10) - open/close 6706 (time 1787389341.06 total 80.05 last 82.38) - open/close 7469 (time 1787389351.06 total 90.05 last 76.26) - open/close 8238 (time 1787389361.08 total 100.07 last 76.76) - open/close 9031 (time 1787389371.09 total 110.08 last 79.23) - open/close 9837 (time 1787389381.09 total 120.08 last 80.59) total: 10000 open/close in 121.99 seconds: 81.97 ops/second llite.lustre-ffff964c42e78000.statahead_batch_max=0 llite.lustre-ffff964c42e78000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff964c42e78000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m53.679s user 0m0.291s sys 0m18.323s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff964c42e78000.statahead_batch_max=32 llite.lustre-ffff964c42e78000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff964c42e78000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m37.897s user 0m0.284s sys 0m15.713s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats= snapshot_time: 1787389556.027616911 secs.nsecs start_time: 1787389445.206800854 secs.nsecs elapsed_time: 110.820816057 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats=0 llite.lustre-ffff964c42e78000.statahead_max=2048 llite.lustre-ffff964c42e78000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats=0 total: 100 open/close in 2.36 seconds: 42.36 ops/second llite.lustre-ffff964c42e78000.statahead_max=0 101 real 0m2.047s user 0m0.004s sys 0m0.326s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff964c42e78000.statahead_max=2048 llite.lustre-ffff964c42e78000.statahead_max=2048 101 real 0m1.160s user 0m0.005s sys 0m0.127s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 - open/close 762 (time 1787389852.85 total 10.01 last 76.15) total: 900 open/close in 11.86 seconds: 75.90 ops/second llite.lustre-ffff964c42e78000.statahead_max=0 1001 real 0m18.505s user 0m0.026s sys 0m3.006s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff964c42e78000.statahead_max=2048 llite.lustre-ffff964c42e78000.statahead_max=2048 1001 real 0m6.575s user 0m0.026s sys 0m1.559s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff964c42e78000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats= snapshot_time: 1787389907.334453964 secs.nsecs start_time: 1787389558.226574477 secs.nsecs elapsed_time: 349.107879487 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 2 22 44 32: 0 0 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 884 (time 1787389919.24 total 10.00 last 88.36) - open/close 1677 (time 1787389929.24 total 20.01 last 79.29) - open/close 2446 (time 1787389939.24 total 30.01 last 76.90) - open/close 3175 (time 1787389949.25 total 40.01 last 72.86) - open/close 4025 (time 1787389959.26 total 50.03 last 84.86) - open/close 4912 (time 1787389969.27 total 60.03 last 88.64) - open/close 5773 (time 1787389979.28 total 70.05 last 85.98) - open/close 6603 (time 1787389989.29 total 80.06 last 82.94) - open/close 7403 (time 1787389999.30 total 90.07 last 79.91) - open/close 8201 (time 1787390009.32 total 100.08 last 79.67) - open/close 9024 (time 1787390019.32 total 110.08 last 82.29) - open/close 9862 (time 1787390029.33 total 120.09 last 83.73) total: 10000 open/close in 121.71 seconds: 82.16 ops/second llite.lustre-ffff964c42e78000.statahead_batch_max=0 llite.lustre-ffff964c42e78000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff964c42e78000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m50.146s user 0m0.314s sys 0m19.440s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff964c42e78000.statahead_batch_max=256 llite.lustre-ffff964c42e78000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff964c42e78000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m47.454s user 0m0.292s sys 0m17.521s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff964c42e78000.batch_stats= snapshot_time: 1787390146.887580526 secs.nsecs start_time: 1787390089.972377532 secs.nsecs elapsed_time: 56.915202994 secs.nsecs subreqs per batch batches %% cum %% 1: 200 53 53 2: 56 14 68 4: 35 9 77 8: 16 4 81 16: 15 3 85 32: 17 4 90 64: 2 0 90 128: 1 0 90 256: 34 9 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff964c42e78000.statahead_batch_max=64 llite.lustre-ffff964c42e78000.statahead_max=128