== sanity test 123ad: Verify batching statahead works correctly ========================================================== 11:40:41 (1789141241) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats=0 llite.lustre-ffff8ba7c4645800.statahead_max=32 llite.lustre-ffff8ba7c4645800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats=0 total: 100 open/close in 2.41 seconds: 41.55 ops/second llite.lustre-ffff8ba7c4645800.statahead_max=0 101 real 0m1.858s user 0m0.001s sys 0m0.301s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8ba7c4645800.statahead_max=32 llite.lustre-ffff8ba7c4645800.statahead_max=32 101 real 0m1.033s user 0m0.004s sys 0m0.158s 'ls -l' 100 files with statahead: 1 sec statahead total: 112 statahead wrong: 2 agl total: 106 list_total: 30 fname_total: 77 hit_total: 3962 miss_total: 1456 swrong=2 ewrong=2 - open/close 784 (time 1789141268.70 total 10.01 last 78.32) total: 900 open/close in 11.73 seconds: 76.70 ops/second llite.lustre-ffff8ba7c4645800.statahead_max=0 1001 real 0m20.532s user 0m0.039s sys 0m2.806s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff8ba7c4645800.statahead_max=32 llite.lustre-ffff8ba7c4645800.statahead_max=32 1001 real 0m8.799s user 0m0.029s sys 0m1.359s 'ls -l' 1000 files with statahead: 9 sec statahead total: 113 statahead wrong: 2 agl total: 107 list_total: 31 fname_total: 77 hit_total: 4958 miss_total: 1460 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff8ba7c4645800.statahead_stats= statahead total: 113 statahead wrong: 2 agl total: 107 list_total: 31 fname_total: 77 hit_total: 4958 miss_total: 1460 mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats= snapshot_time: 1789141333.202635549 secs.nsecs start_time: 1789141246.867481572 secs.nsecs elapsed_time: 86.335153977 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 733 (time 1789141345.50 total 10.00 last 73.27) - open/close 1539 (time 1789141355.51 total 20.02 last 80.50) - open/close 2367 (time 1789141365.51 total 30.02 last 82.80) - open/close 3206 (time 1789141375.52 total 40.02 last 83.84) - open/close 4038 (time 1789141385.52 total 50.03 last 83.15) - open/close 4872 (time 1789141395.53 total 60.04 last 83.31) - open/close 5624 (time 1789141405.57 total 70.08 last 74.92) - open/close 6428 (time 1789141415.57 total 80.08 last 80.37) - open/close 7158 (time 1789141425.58 total 90.09 last 72.94) - open/close 7919 (time 1789141435.60 total 100.10 last 76.00) - open/close 8700 (time 1789141445.61 total 110.12 last 78.00) - open/close 9501 (time 1789141455.61 total 120.12 last 80.07) total: 10000 open/close in 126.72 seconds: 78.91 ops/second llite.lustre-ffff8ba7c4645800.statahead_batch_max=0 llite.lustre-ffff8ba7c4645800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.977s user 0m0.296s sys 0m14.113s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ba7c4645800.statahead_batch_max=32 llite.lustre-ffff8ba7c4645800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m49.073s user 0m0.278s sys 0m13.049s batched statahead RPC= hit count=9973 mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats= snapshot_time: 1789141652.004074821 secs.nsecs start_time: 1789141528.598190898 secs.nsecs elapsed_time: 123.405883923 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats=0 llite.lustre-ffff8ba7c4645800.statahead_max=2048 llite.lustre-ffff8ba7c4645800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats=0 total: 100 open/close in 2.56 seconds: 39.06 ops/second llite.lustre-ffff8ba7c4645800.statahead_max=0 101 real 0m2.203s user 0m0.002s sys 0m0.296s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8ba7c4645800.statahead_max=2048 llite.lustre-ffff8ba7c4645800.statahead_max=2048 101 real 0m1.330s user 0m0.004s sys 0m0.161s 'ls -l' 100 files with statahead: 2 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10072 miss_total: 28 swrong=0 ewrong=0 - open/close 653 (time 1789141958.94 total 10.00 last 65.27) total: 900 open/close in 13.35 seconds: 67.42 ops/second llite.lustre-ffff8ba7c4645800.statahead_max=0 1001 real 0m20.096s user 0m0.036s sys 0m2.829s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff8ba7c4645800.statahead_max=2048 llite.lustre-ffff8ba7c4645800.statahead_max=2048 1001 real 0m6.157s user 0m0.031s sys 0m1.435s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11071 miss_total: 29 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 18 seconds llite.lustre-ffff8ba7c4645800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11071 miss_total: 29 mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats= snapshot_time: 1789142017.154474416 secs.nsecs start_time: 1789141654.416442515 secs.nsecs elapsed_time: 362.738031901 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 765 (time 1789142029.12 total 10.01 last 76.43) - open/close 1631 (time 1789142039.13 total 20.01 last 86.57) - open/close 2450 (time 1789142049.14 total 30.03 last 81.76) - open/close 3214 (time 1789142059.15 total 40.04 last 76.33) - open/close 3938 (time 1789142069.16 total 50.04 last 72.37) - open/close 4701 (time 1789142079.17 total 60.05 last 76.23) - open/close 5428 (time 1789142089.17 total 70.05 last 72.69) - open/close 6042 (time 1789142099.17 total 80.06 last 61.36) - open/close 6735 (time 1789142109.18 total 90.07 last 69.24) - open/close 7526 (time 1789142119.19 total 100.08 last 79.04) - open/close 8282 (time 1789142129.19 total 110.08 last 75.59) - open/close 8971 (time 1789142139.20 total 120.08 last 68.86) - open/close 9718 (time 1789142149.21 total 130.09 last 74.64) total: 10000 open/close in 134.17 seconds: 74.53 ops/second llite.lustre-ffff8ba7c4645800.statahead_batch_max=0 llite.lustre-ffff8ba7c4645800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m5.607s user 0m0.353s sys 0m14.815s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8ba7c4645800.statahead_batch_max=256 llite.lustre-ffff8ba7c4645800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.192s user 0m0.269s sys 0m12.836s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8ba7c4645800.batch_stats= snapshot_time: 1789142295.191617472 secs.nsecs start_time: 1789142227.414039571 secs.nsecs elapsed_time: 67.777577901 secs.nsecs subreqs per batch batches %% cum %% 1: 148 48 48 2: 47 15 63 4: 27 8 72 8: 16 5 77 16: 15 4 82 32: 17 5 87 64: 2 0 88 128: 0 0 88 256: 35 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8ba7c4645800.statahead_batch_max=64 llite.lustre-ffff8ba7c4645800.statahead_max=128