== sanity test 123ad: Verify batching statahead works correctly ========================================================== 16:30:18 (1778617818) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats=0 llite.lustre-ffff91ece04d2000.statahead_max=32 llite.lustre-ffff91ece04d2000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats=0 total: 100 open/close in 2.57 seconds: 38.98 ops/second llite.lustre-ffff91ece04d2000.statahead_max=0 101 real 0m3.071s user 0m0.005s sys 0m0.342s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff91ece04d2000.statahead_max=32 llite.lustre-ffff91ece04d2000.statahead_max=32 101 real 0m0.899s user 0m0.004s sys 0m0.146s 'ls -l' 100 files with statahead: 1 sec statahead total: 133 statahead wrong: 2 agl total: 112 list_total: 30 fname_total: 103 hit_total: 4019 miss_total: 1438 swrong=2 ewrong=2 - open/close 699 (time 1778617850.69 total 10.00 last 69.88) total: 900 open/close in 12.71 seconds: 70.79 ops/second llite.lustre-ffff91ece04d2000.statahead_max=0 1001 real 0m20.635s user 0m0.028s sys 0m3.023s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff91ece04d2000.statahead_max=32 llite.lustre-ffff91ece04d2000.statahead_max=32 1001 real 0m11.808s user 0m0.030s sys 0m1.463s 'ls -l' 1000 files with statahead: 11 sec statahead total: 134 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 103 hit_total: 5015 miss_total: 1442 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff91ece04d2000.statahead_stats= statahead total: 134 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 103 hit_total: 5015 miss_total: 1442 mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats= snapshot_time: 1778617925.425786800 secs.nsecs start_time: 1778617825.167176332 secs.nsecs elapsed_time: 100.258610468 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 716 (time 1778617938.69 total 10.00 last 71.58) - open/close 1443 (time 1778617948.70 total 20.01 last 72.62) - open/close 2272 (time 1778617958.71 total 30.02 last 82.85) - open/close 3062 (time 1778617968.71 total 40.02 last 78.98) - open/close 3896 (time 1778617978.72 total 50.03 last 83.33) - open/close 4650 (time 1778617988.72 total 60.04 last 75.35) - open/close 5374 (time 1778617998.73 total 70.04 last 72.37) - open/close 5978 (time 1778618008.73 total 80.04 last 60.40) - open/close 6737 (time 1778618018.73 total 90.04 last 75.89) - open/close 7371 (time 1778618028.75 total 100.07 last 63.26) - open/close 8175 (time 1778618038.75 total 110.07 last 80.38) - open/close 8984 (time 1778618048.78 total 120.09 last 80.71) - open/close 9621 (time 1778618058.78 total 130.09 last 63.70) total: 10000 open/close in 135.26 seconds: 73.93 ops/second llite.lustre-ffff91ece04d2000.statahead_batch_max=0 llite.lustre-ffff91ece04d2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91ece04d2000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.255s user 0m0.325s sys 0m14.985s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff91ece04d2000.statahead_batch_max=32 llite.lustre-ffff91ece04d2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff91ece04d2000.stats=clear ls -l files in d123ad.sanity: 10001 real 2m0.677s user 0m0.321s sys 0m14.509s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats= snapshot_time: 1778618281.835060925 secs.nsecs start_time: 1778618143.219667698 secs.nsecs elapsed_time: 138.615393227 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats=0 llite.lustre-ffff91ece04d2000.statahead_max=2048 llite.lustre-ffff91ece04d2000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats=0 total: 100 open/close in 3.00 seconds: 33.39 ops/second llite.lustre-ffff91ece04d2000.statahead_max=0 101 real 0m2.323s user 0m0.003s sys 0m0.323s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff91ece04d2000.statahead_max=2048 llite.lustre-ffff91ece04d2000.statahead_max=2048 101 real 0m0.987s user 0m0.007s sys 0m0.154s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 - open/close 744 (time 1778618607.41 total 10.00 last 74.38) total: 900 open/close in 12.17 seconds: 73.94 ops/second llite.lustre-ffff91ece04d2000.statahead_max=0 1001 real 0m21.682s user 0m0.023s sys 0m2.930s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff91ece04d2000.statahead_max=2048 llite.lustre-ffff91ece04d2000.statahead_max=2048 1001 real 0m11.664s user 0m0.033s sys 0m1.556s 'ls -l' 1000 files with statahead: 11 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff91ece04d2000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats= snapshot_time: 1778618682.664535287 secs.nsecs start_time: 1778618285.418852539 secs.nsecs elapsed_time: 397.245682748 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 1 9 27 32: 2 18 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 725 (time 1778618695.24 total 10.02 last 72.37) - open/close 1440 (time 1778618705.24 total 20.02 last 71.50) - open/close 2055 (time 1778618715.25 total 30.03 last 61.44) - open/close 2665 (time 1778618725.26 total 40.03 last 60.97) - open/close 3243 (time 1778618735.26 total 50.04 last 57.78) - open/close 4045 (time 1778618745.27 total 60.04 last 80.18) - open/close 4694 (time 1778618755.28 total 70.05 last 64.81) - open/close 5353 (time 1778618765.28 total 80.05 last 65.89) - open/close 6049 (time 1778618775.30 total 90.07 last 69.50) - open/close 6631 (time 1778618785.33 total 100.10 last 58.03) - open/close 7003 (time 1778618795.34 total 110.11 last 37.16) - open/close 7556 (time 1778618805.35 total 120.12 last 55.22) - open/close 8295 (time 1778618815.36 total 130.14 last 73.81) - open/close 9125 (time 1778618825.37 total 140.14 last 82.95) - open/close 9900 (time 1778618835.37 total 150.15 last 77.45) total: 10000 open/close in 151.62 seconds: 65.96 ops/second llite.lustre-ffff91ece04d2000.statahead_batch_max=0 llite.lustre-ffff91ece04d2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91ece04d2000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.929s user 0m0.311s sys 0m14.882s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff91ece04d2000.statahead_batch_max=256 llite.lustre-ffff91ece04d2000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff91ece04d2000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.101s user 0m0.342s sys 0m14.581s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff91ece04d2000.batch_stats= snapshot_time: 1778618998.418785792 secs.nsecs start_time: 1778618920.127672872 secs.nsecs elapsed_time: 78.291112920 secs.nsecs subreqs per batch batches % cum % 1: 150 47 47 2: 55 17 64 4: 27 8 72 8: 19 5 78 16: 18 5 84 32: 12 3 88 64: 3 0 89 128: 0 0 89 256: 35 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff91ece04d2000.statahead_batch_max=64 llite.lustre-ffff91ece04d2000.statahead_max=128