== sanity test 123ad: Verify batching statahead works correctly ========================================================== 01:53:07 (1788846787) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats=0 llite.lustre-ffff8c7af183f000.statahead_max=32 llite.lustre-ffff8c7af183f000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats=0 total: 100 open/close in 2.40 seconds: 41.70 ops/second llite.lustre-ffff8c7af183f000.statahead_max=0 101 real 0m1.766s user 0m0.006s sys 0m0.309s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8c7af183f000.statahead_max=32 llite.lustre-ffff8c7af183f000.statahead_max=32 101 real 0m1.234s user 0m0.006s sys 0m0.147s 'ls -l' 100 files with statahead: 1 sec statahead total: 121 statahead wrong: 2 agl total: 116 list_total: 30 fname_total: 89 hit_total: 4430 miss_total: 1288 swrong=2 ewrong=2 - open/close 616 (time 1788846814.45 total 10.01 last 61.53) total: 900 open/close in 14.66 seconds: 61.37 ops/second llite.lustre-ffff8c7af183f000.statahead_max=0 1001 real 0m27.957s user 0m0.046s sys 0m2.866s 'ls -l' 1000 files without statahead: 28 sec llite.lustre-ffff8c7af183f000.statahead_max=32 llite.lustre-ffff8c7af183f000.statahead_max=32 1001 real 0m10.884s user 0m0.030s sys 0m1.288s 'ls -l' 1000 files with statahead: 11 sec statahead total: 122 statahead wrong: 2 agl total: 117 list_total: 31 fname_total: 89 hit_total: 5427 miss_total: 1291 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff8c7af183f000.statahead_stats= statahead total: 122 statahead wrong: 2 agl total: 117 list_total: 31 fname_total: 89 hit_total: 5427 miss_total: 1291 mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats= snapshot_time: 1788846896.094036759 secs.nsecs start_time: 1788846792.330283965 secs.nsecs elapsed_time: 103.763752794 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 669 (time 1788846909.19 total 10.03 last 66.68) - open/close 1401 (time 1788846919.20 total 20.04 last 73.19) - open/close 2122 (time 1788846929.21 total 30.04 last 72.03) - open/close 2903 (time 1788846939.21 total 40.05 last 78.09) - open/close 3730 (time 1788846949.21 total 50.05 last 82.69) - open/close 4375 (time 1788846959.24 total 60.08 last 64.27) - open/close 5109 (time 1788846969.25 total 70.09 last 73.33) - open/close 5840 (time 1788846979.27 total 80.11 last 72.96) - open/close 6736 (time 1788846989.27 total 90.11 last 89.58) - open/close 7483 (time 1788846999.29 total 100.13 last 74.57) - open/close 8319 (time 1788847009.30 total 110.14 last 83.54) - open/close 9084 (time 1788847019.32 total 120.16 last 76.31) - open/close 9817 (time 1788847029.33 total 130.17 last 73.26) total: 10000 open/close in 132.51 seconds: 75.47 ops/second llite.lustre-ffff8c7af183f000.statahead_batch_max=0 llite.lustre-ffff8c7af183f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c7af183f000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m5.609s user 0m0.295s sys 0m13.417s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c7af183f000.statahead_batch_max=32 llite.lustre-ffff8c7af183f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c7af183f000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m29.728s user 0m0.297s sys 0m12.473s batched statahead RPC= hit count=9980 mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats= snapshot_time: 1788847204.631417523 secs.nsecs start_time: 1788847105.681918595 secs.nsecs elapsed_time: 98.949498928 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats=0 llite.lustre-ffff8c7af183f000.statahead_max=2048 llite.lustre-ffff8c7af183f000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats=0 total: 100 open/close in 3.44 seconds: 29.04 ops/second llite.lustre-ffff8c7af183f000.statahead_max=0 101 real 0m2.289s user 0m0.004s sys 0m0.312s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8c7af183f000.statahead_max=2048 llite.lustre-ffff8c7af183f000.statahead_max=2048 101 real 0m1.306s user 0m0.001s sys 0m0.160s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10079 miss_total: 21 swrong=0 ewrong=0 - open/close 740 (time 1788847495.49 total 10.00 last 73.98) total: 900 open/close in 12.04 seconds: 74.77 ops/second llite.lustre-ffff8c7af183f000.statahead_max=0 1001 real 0m18.725s user 0m0.034s sys 0m2.772s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff8c7af183f000.statahead_max=2048 llite.lustre-ffff8c7af183f000.statahead_max=2048 1001 real 0m8.681s user 0m0.032s sys 0m1.384s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 25 seconds llite.lustre-ffff8c7af183f000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11078 miss_total: 22 mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats= snapshot_time: 1788847566.383714534 secs.nsecs start_time: 1788847206.903885246 secs.nsecs elapsed_time: 359.479829288 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 1 9 54 128: 1 9 63 256: 4 36 100 - open/close 801 (time 1788847579.26 total 10.01 last 80.04) - open/close 1670 (time 1788847589.27 total 20.01 last 86.87) - open/close 2499 (time 1788847599.28 total 30.02 last 82.79) - open/close 3433 (time 1788847609.28 total 40.03 last 93.36) - open/close 4248 (time 1788847619.29 total 50.04 last 81.40) - open/close 5106 (time 1788847629.31 total 60.05 last 85.68) - open/close 5863 (time 1788847639.33 total 70.08 last 75.53) - open/close 6745 (time 1788847649.33 total 80.08 last 88.18) - open/close 7480 (time 1788847659.36 total 90.10 last 73.33) - open/close 8068 (time 1788847669.36 total 100.11 last 58.78) - open/close 8564 (time 1788847679.38 total 110.12 last 49.51) - open/close 9085 (time 1788847689.39 total 120.13 last 52.06) - open/close 9922 (time 1788847699.40 total 130.15 last 83.58) total: 10000 open/close in 131.18 seconds: 76.23 ops/second llite.lustre-ffff8c7af183f000.statahead_batch_max=0 llite.lustre-ffff8c7af183f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c7af183f000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m8.748s user 0m0.314s sys 0m13.377s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8c7af183f000.statahead_batch_max=256 llite.lustre-ffff8c7af183f000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8c7af183f000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.838s user 0m0.270s sys 0m13.076s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8c7af183f000.batch_stats= snapshot_time: 1788847843.497603528 secs.nsecs start_time: 1788847778.906515943 secs.nsecs elapsed_time: 64.591087585 secs.nsecs subreqs per batch batches %% cum %% 1: 126 44 44 2: 31 10 55 4: 30 10 66 8: 23 8 74 16: 14 4 79 32: 20 7 86 64: 4 1 87 128: 1 0 87 256: 34 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8c7af183f000.statahead_batch_max=64 llite.lustre-ffff8c7af183f000.statahead_max=128