== sanity test 123ad: Verify batching statahead works correctly ========================================================== 04:57:15 (1781686635) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats=0 llite.lustre-ffff9f666015d800.statahead_max=32 llite.lustre-ffff9f666015d800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats=0 total: 100 open/close in 2.10 seconds: 47.73 ops/second llite.lustre-ffff9f666015d800.statahead_max=0 101 real 0m1.678s user 0m0.004s sys 0m0.320s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9f666015d800.statahead_max=32 llite.lustre-ffff9f666015d800.statahead_max=32 101 real 0m0.637s user 0m0.007s sys 0m0.192s 'ls -l' 100 files with statahead: 1 sec statahead total: 57 statahead wrong: 2 agl total: 52 list_total: 25 fname_total: 32 hit_total: 13710 miss_total: 1009 swrong=2 ewrong=2 total: 900 open/close in 9.93 seconds: 90.62 ops/second llite.lustre-ffff9f666015d800.statahead_max=0 1001 real 0m18.732s user 0m0.039s sys 0m3.113s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff9f666015d800.statahead_max=32 llite.lustre-ffff9f666015d800.statahead_max=32 1001 real 0m6.990s user 0m0.025s sys 0m1.703s 'ls -l' 1000 files with statahead: 7 sec statahead total: 58 statahead wrong: 2 agl total: 53 list_total: 26 fname_total: 32 hit_total: 14707 miss_total: 1012 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 15 seconds llite.lustre-ffff9f666015d800.statahead_stats= statahead total: 58 statahead wrong: 2 agl total: 53 list_total: 26 fname_total: 32 hit_total: 14707 miss_total: 1012 mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats= snapshot_time: 1781686706.458946506 secs.nsecs start_time: 1781686638.580098118 secs.nsecs elapsed_time: 67.878848388 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 876 (time 1781686718.17 total 10.02 last 87.45) - open/close 1758 (time 1781686728.17 total 20.02 last 88.18) - open/close 2641 (time 1781686738.18 total 30.03 last 88.24) - open/close 3537 (time 1781686748.18 total 40.03 last 89.59) - open/close 4439 (time 1781686758.19 total 50.03 last 90.13) - open/close 5384 (time 1781686768.20 total 60.04 last 94.42) - open/close 6279 (time 1781686778.21 total 70.06 last 89.36) - open/close 7188 (time 1781686788.22 total 80.07 last 90.83) - open/close 8109 (time 1781686798.22 total 90.07 last 92.08) - open/close 9057 (time 1781686808.23 total 100.07 last 94.75) - open/close 9957 (time 1781686818.23 total 110.08 last 89.97) total: 10000 open/close in 110.55 seconds: 90.46 ops/second llite.lustre-ffff9f666015d800.statahead_batch_max=0 llite.lustre-ffff9f666015d800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f666015d800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m42.574s user 0m0.307s sys 0m22.051s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9f666015d800.statahead_batch_max=32 llite.lustre-ffff9f666015d800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9f666015d800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.822s user 0m0.243s sys 0m17.243s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats= snapshot_time: 1781686938.335836818 secs.nsecs start_time: 1781686868.277539719 secs.nsecs elapsed_time: 70.058297099 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats=0 llite.lustre-ffff9f666015d800.statahead_max=2048 llite.lustre-ffff9f666015d800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats=0 total: 100 open/close in 2.18 seconds: 45.83 ops/second llite.lustre-ffff9f666015d800.statahead_max=0 101 real 0m1.763s user 0m0.003s sys 0m0.319s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9f666015d800.statahead_max=2048 llite.lustre-ffff9f666015d800.statahead_max=2048 101 real 0m0.548s user 0m0.005s sys 0m0.207s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 total: 900 open/close in 9.32 seconds: 96.61 ops/second llite.lustre-ffff9f666015d800.statahead_max=0 1001 real 0m16.034s user 0m0.029s sys 0m2.995s 'ls -l' 1000 files without statahead: 16 sec llite.lustre-ffff9f666015d800.statahead_max=2048 llite.lustre-ffff9f666015d800.statahead_max=2048 1001 real 0m3.952s user 0m0.024s sys 0m2.127s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 11 seconds llite.lustre-ffff9f666015d800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats= snapshot_time: 1781687189.693434853 secs.nsecs start_time: 1781686939.949774323 secs.nsecs elapsed_time: 249.743660530 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 1225 (time 1781687201.28 total 10.01 last 122.40) - open/close 2410 (time 1781687211.28 total 20.01 last 118.43) - open/close 3410 (time 1781687221.29 total 30.02 last 99.96) - open/close 4396 (time 1781687231.29 total 40.03 last 98.53) - open/close 5542 (time 1781687241.29 total 50.03 last 114.58) - open/close 6705 (time 1781687251.30 total 60.03 last 116.22) - open/close 7802 (time 1781687261.30 total 70.04 last 109.67) - open/close 8908 (time 1781687271.31 total 80.04 last 110.58) total: 10000 open/close in 89.63 seconds: 111.57 ops/second llite.lustre-ffff9f666015d800.statahead_batch_max=0 llite.lustre-ffff9f666015d800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f666015d800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m36.188s user 0m0.286s sys 0m24.914s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9f666015d800.statahead_batch_max=256 llite.lustre-ffff9f666015d800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9f666015d800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.198s user 0m0.236s sys 0m20.570s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9f666015d800.batch_stats= snapshot_time: 1781687362.092157036 secs.nsecs start_time: 1781687322.199700494 secs.nsecs elapsed_time: 39.892456542 secs.nsecs subreqs per batch batches %% cum %% 1: 238 53 53 2: 74 16 70 4: 52 11 82 8: 17 3 86 16: 3 0 86 32: 22 4 91 64: 2 0 92 128: 0 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9f666015d800.statahead_batch_max=64 llite.lustre-ffff9f666015d800.statahead_max=128