== sanity test 123ad: Verify batching statahead works correctly ========================================================== 18:31:45 (1781217105) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats=0 llite.lustre-ffff8e0c53338800.statahead_max=32 llite.lustre-ffff8e0c53338800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats=0 total: 100 open/close in 3.45 seconds: 28.99 ops/second llite.lustre-ffff8e0c53338800.statahead_max=0 101 real 0m2.973s user 0m0.007s sys 0m0.403s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8e0c53338800.statahead_max=32 llite.lustre-ffff8e0c53338800.statahead_max=32 101 real 0m1.237s user 0m0.003s sys 0m0.181s 'ls -l' 100 files with statahead: 2 sec statahead total: 152 statahead wrong: 2 agl total: 145 list_total: 33 fname_total: 114 hit_total: 4064 miss_total: 1411 swrong=2 ewrong=2 - open/close 595 (time 1781217135.02 total 10.01 last 59.46) total: 900 open/close in 15.50 seconds: 58.07 ops/second llite.lustre-ffff8e0c53338800.statahead_max=0 1001 real 0m24.628s user 0m0.038s sys 0m3.386s 'ls -l' 1000 files without statahead: 25 sec llite.lustre-ffff8e0c53338800.statahead_max=32 llite.lustre-ffff8e0c53338800.statahead_max=32 1001 real 0m10.449s user 0m0.052s sys 0m1.804s 'ls -l' 1000 files with statahead: 10 sec statahead total: 153 statahead wrong: 2 agl total: 146 list_total: 34 fname_total: 114 hit_total: 5060 miss_total: 1415 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff8e0c53338800.statahead_stats= statahead total: 153 statahead wrong: 2 agl total: 146 list_total: 34 fname_total: 114 hit_total: 5060 miss_total: 1415 mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats= snapshot_time: 1781217215.871727669 secs.nsecs start_time: 1781217110.787706582 secs.nsecs elapsed_time: 105.084021087 secs.nsecs subreqs per batch batches % cum % 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 570 (time 1781217228.75 total 10.01 last 56.93) - open/close 1120 (time 1781217238.77 total 20.02 last 54.94) - open/close 1705 (time 1781217248.79 total 30.05 last 58.38) - open/close 2290 (time 1781217258.80 total 40.05 last 58.45) - open/close 2841 (time 1781217268.81 total 50.07 last 55.04) - open/close 3401 (time 1781217278.81 total 60.07 last 55.98) - open/close 3987 (time 1781217288.82 total 70.08 last 58.55) - open/close 4580 (time 1781217298.83 total 80.09 last 59.23) - open/close 5137 (time 1781217308.85 total 90.11 last 55.60) - open/close 5671 (time 1781217318.89 total 100.15 last 53.19) - open/close 6197 (time 1781217328.91 total 110.16 last 52.51) - open/close 6743 (time 1781217338.91 total 120.17 last 54.56) - open/close 7302 (time 1781217348.93 total 130.18 last 55.84) - open/close 7838 (time 1781217358.94 total 140.20 last 53.52) - open/close 8377 (time 1781217368.96 total 150.21 last 53.81) - open/close 8912 (time 1781217378.96 total 160.22 last 53.48) - open/close 9380 (time 1781217388.97 total 170.23 last 46.74) - open/close 9885 (time 1781217398.98 total 180.24 last 50.47) total: 10000 open/close in 182.11 seconds: 54.91 ops/second llite.lustre-ffff8e0c53338800.statahead_batch_max=0 llite.lustre-ffff8e0c53338800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e0c53338800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m12.567s user 0m0.394s sys 0m18.224s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e0c53338800.statahead_batch_max=32 llite.lustre-ffff8e0c53338800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e0c53338800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m52.972s user 0m0.346s sys 0m16.513s batched statahead RPC= hit count=9986 mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats= snapshot_time: 1781217614.600604563 secs.nsecs start_time: 1781217483.660238398 secs.nsecs elapsed_time: 130.940366165 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats=0 llite.lustre-ffff8e0c53338800.statahead_max=2048 llite.lustre-ffff8e0c53338800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats=0 total: 100 open/close in 3.83 seconds: 26.11 ops/second llite.lustre-ffff8e0c53338800.statahead_max=0 101 real 0m2.230s user 0m0.003s sys 0m0.372s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8e0c53338800.statahead_max=2048 llite.lustre-ffff8e0c53338800.statahead_max=2048 101 real 0m0.907s user 0m0.006s sys 0m0.221s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10085 miss_total: 15 swrong=0 ewrong=0 - open/close 589 (time 1781218007.59 total 10.00 last 58.88) total: 900 open/close in 15.34 seconds: 58.66 ops/second llite.lustre-ffff8e0c53338800.statahead_max=0 1001 real 0m29.118s user 0m0.034s sys 0m3.421s 'ls -l' 1000 files without statahead: 29 sec llite.lustre-ffff8e0c53338800.statahead_max=2048 llite.lustre-ffff8e0c53338800.statahead_max=2048 1001 real 0m6.735s user 0m0.023s sys 0m1.622s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff8e0c53338800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11084 miss_total: 16 mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats= snapshot_time: 1781218086.324192274 secs.nsecs start_time: 1781217617.849385204 secs.nsecs elapsed_time: 468.474807070 secs.nsecs subreqs per batch batches % cum % 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 25 25 16: 1 12 37 32: 0 0 37 64: 0 0 37 128: 1 12 50 256: 4 50 100 - open/close 600 (time 1781218098.81 total 10.02 last 59.91) - open/close 1269 (time 1781218108.83 total 20.03 last 66.81) - open/close 1909 (time 1781218118.83 total 30.04 last 63.95) - open/close 2484 (time 1781218128.85 total 40.05 last 57.42) - open/close 3073 (time 1781218138.87 total 50.07 last 58.79) - open/close 3621 (time 1781218148.87 total 60.07 last 54.78) - open/close 4211 (time 1781218158.88 total 70.08 last 58.94) - open/close 4874 (time 1781218168.88 total 80.08 last 66.30) - open/close 5469 (time 1781218178.88 total 90.09 last 59.48) - open/close 6071 (time 1781218188.88 total 100.09 last 60.19) - open/close 6637 (time 1781218198.90 total 110.10 last 56.54) - open/close 7254 (time 1781218208.91 total 120.11 last 61.61) - open/close 7843 (time 1781218218.91 total 130.12 last 58.88) - open/close 8411 (time 1781218228.92 total 140.13 last 56.74) - open/close 8931 (time 1781218238.93 total 150.13 last 51.98) - open/close 9530 (time 1781218248.93 total 160.14 last 59.87) total: 10000 open/close in 168.19 seconds: 59.46 ops/second llite.lustre-ffff8e0c53338800.statahead_batch_max=0 llite.lustre-ffff8e0c53338800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e0c53338800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m11.048s user 0m0.366s sys 0m19.928s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e0c53338800.statahead_batch_max=256 llite.lustre-ffff8e0c53338800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e0c53338800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.256s user 0m0.368s sys 0m18.120s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8e0c53338800.batch_stats= snapshot_time: 1781218413.198289299 secs.nsecs start_time: 1781218338.113023715 secs.nsecs elapsed_time: 75.085265584 secs.nsecs subreqs per batch batches % cum % 1: 170 50 50 2: 51 15 66 4: 30 8 75 8: 16 4 79 16: 10 2 82 32: 20 5 88 64: 2 0 89 128: 0 0 89 256: 35 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8e0c53338800.statahead_batch_max=64 llite.lustre-ffff8e0c53338800.statahead_max=128