== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:09:55 (1787702995) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats=0 llite.lustre-ffff94ae087ed800.statahead_max=32 llite.lustre-ffff94ae087ed800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats=0 total: 100 open/close in 2.70 seconds: 37.03 ops/second llite.lustre-ffff94ae087ed800.statahead_max=0 101 real 0m2.178s user 0m0.004s sys 0m0.303s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff94ae087ed800.statahead_max=32 llite.lustre-ffff94ae087ed800.statahead_max=32 101 real 0m1.394s user 0m0.002s sys 0m0.108s 'ls -l' 100 files with statahead: 1 sec statahead total: 124 statahead wrong: 2 agl total: 118 list_total: 29 fname_total: 95 hit_total: 3822 miss_total: 1147 swrong=2 ewrong=2 - open/close 732 (time 1787703021.85 total 10.01 last 73.13) total: 900 open/close in 11.72 seconds: 76.82 ops/second llite.lustre-ffff94ae087ed800.statahead_max=0 1001 real 0m19.407s user 0m0.033s sys 0m2.920s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff94ae087ed800.statahead_max=32 llite.lustre-ffff94ae087ed800.statahead_max=32 1001 real 0m9.502s user 0m0.027s sys 0m1.267s 'ls -l' 1000 files with statahead: 9 sec statahead total: 125 statahead wrong: 2 agl total: 119 list_total: 30 fname_total: 95 hit_total: 4819 miss_total: 1150 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff94ae087ed800.statahead_stats= statahead total: 125 statahead wrong: 2 agl total: 119 list_total: 30 fname_total: 95 hit_total: 4819 miss_total: 1150 mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats= snapshot_time: 1787703087.108775269 secs.nsecs start_time: 1787702999.386562086 secs.nsecs elapsed_time: 87.722213183 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 766 (time 1787703099.74 total 10.01 last 76.53) - open/close 1475 (time 1787703109.74 total 20.01 last 70.90) - open/close 2136 (time 1787703119.74 total 30.01 last 66.09) - open/close 3005 (time 1787703129.74 total 40.01 last 86.88) - open/close 4024 (time 1787703139.74 total 50.01 last 101.90) - open/close 4888 (time 1787703149.75 total 60.02 last 86.36) - open/close 5698 (time 1787703159.75 total 70.02 last 80.96) - open/close 6496 (time 1787703169.76 total 80.03 last 79.78) - open/close 7278 (time 1787703179.76 total 90.03 last 78.17) - open/close 8001 (time 1787703189.78 total 100.05 last 72.16) - open/close 8666 (time 1787703199.79 total 110.06 last 66.43) - open/close 9413 (time 1787703209.80 total 120.07 last 74.65) total: 10000 open/close in 128.69 seconds: 77.71 ops/second llite.lustre-ffff94ae087ed800.statahead_batch_max=0 llite.lustre-ffff94ae087ed800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94ae087ed800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.258s user 0m0.314s sys 0m13.890s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff94ae087ed800.statahead_batch_max=32 llite.lustre-ffff94ae087ed800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff94ae087ed800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m33.671s user 0m0.256s sys 0m12.776s batched statahead RPC= hit count=9977 mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats= snapshot_time: 1787703395.926798046 secs.nsecs start_time: 1787703290.980206353 secs.nsecs elapsed_time: 104.946591693 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 1 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats=0 llite.lustre-ffff94ae087ed800.statahead_max=2048 llite.lustre-ffff94ae087ed800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats=0 total: 100 open/close in 2.49 seconds: 40.17 ops/second llite.lustre-ffff94ae087ed800.statahead_max=0 101 real 0m2.760s user 0m0.004s sys 0m0.330s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff94ae087ed800.statahead_max=2048 llite.lustre-ffff94ae087ed800.statahead_max=2048 101 real 0m0.985s user 0m0.004s sys 0m0.135s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10076 miss_total: 24 swrong=0 ewrong=0 - open/close 653 (time 1787703696.17 total 10.00 last 65.27) total: 900 open/close in 13.01 seconds: 69.16 ops/second llite.lustre-ffff94ae087ed800.statahead_max=0 1001 real 0m21.824s user 0m0.032s sys 0m2.952s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff94ae087ed800.statahead_max=2048 llite.lustre-ffff94ae087ed800.statahead_max=2048 1001 real 0m6.190s user 0m0.030s sys 0m1.335s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11075 miss_total: 25 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff94ae087ed800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11075 miss_total: 25 mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats= snapshot_time: 1787703764.658131794 secs.nsecs start_time: 1787703398.125505332 secs.nsecs elapsed_time: 366.532626462 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 0 0 50 128: 3 25 75 256: 3 25 100 - open/close 826 (time 1787703777.06 total 10.01 last 82.55) - open/close 1649 (time 1787703787.06 total 20.01 last 82.24) - open/close 2364 (time 1787703797.07 total 30.02 last 71.45) - open/close 3186 (time 1787703807.08 total 40.03 last 82.10) - open/close 3901 (time 1787703817.08 total 50.03 last 71.49) - open/close 4559 (time 1787703827.09 total 60.04 last 65.78) - open/close 5498 (time 1787703837.10 total 70.05 last 93.79) - open/close 6222 (time 1787703847.11 total 80.06 last 72.32) - open/close 7004 (time 1787703857.12 total 90.07 last 78.15) - open/close 7890 (time 1787703867.12 total 100.07 last 88.55) - open/close 8722 (time 1787703877.13 total 110.08 last 83.12) - open/close 9392 (time 1787703887.14 total 120.09 last 66.95) total: 10000 open/close in 127.45 seconds: 78.46 ops/second llite.lustre-ffff94ae087ed800.statahead_batch_max=0 llite.lustre-ffff94ae087ed800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94ae087ed800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.232s user 0m0.319s sys 0m13.583s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff94ae087ed800.statahead_batch_max=256 llite.lustre-ffff94ae087ed800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff94ae087ed800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.147s user 0m0.333s sys 0m13.885s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff94ae087ed800.batch_stats= snapshot_time: 1787704038.947465294 secs.nsecs start_time: 1787703971.025756702 secs.nsecs elapsed_time: 67.921708592 secs.nsecs subreqs per batch batches %% cum %% 1: 77 40 40 2: 23 11 52 4: 14 7 59 8: 14 7 66 16: 8 4 70 32: 15 7 78 64: 5 2 81 128: 0 0 81 256: 36 18 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff94ae087ed800.statahead_batch_max=64 llite.lustre-ffff94ae087ed800.statahead_max=128