== sanity test 123ad: Verify batching statahead works correctly ========================================================== 04:04:15 (1787472255) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats=0 llite.lustre-ffff90af08a59000.statahead_max=32 llite.lustre-ffff90af08a59000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats=0 total: 100 open/close in 2.40 seconds: 41.64 ops/second llite.lustre-ffff90af08a59000.statahead_max=0 101 real 0m1.992s user 0m0.004s sys 0m0.321s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff90af08a59000.statahead_max=32 llite.lustre-ffff90af08a59000.statahead_max=32 101 real 0m1.508s user 0m0.003s sys 0m0.205s 'ls -l' 100 files with statahead: 2 sec statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 31 fname_total: 87 hit_total: 4212 miss_total: 1294 swrong=2 ewrong=2 total: 900 open/close in 9.63 seconds: 93.49 ops/second llite.lustre-ffff90af08a59000.statahead_max=0 1001 real 0m19.434s user 0m0.038s sys 0m2.967s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff90af08a59000.statahead_max=32 llite.lustre-ffff90af08a59000.statahead_max=32 1001 real 0m10.363s user 0m0.030s sys 0m1.495s 'ls -l' 1000 files with statahead: 11 sec statahead total: 120 statahead wrong: 2 agl total: 114 list_total: 32 fname_total: 87 hit_total: 5211 miss_total: 1295 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff90af08a59000.statahead_stats= statahead total: 120 statahead wrong: 2 agl total: 114 list_total: 32 fname_total: 87 hit_total: 5211 miss_total: 1295 mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats= snapshot_time: 1787472351.400206455 secs.nsecs start_time: 1787472261.328010551 secs.nsecs elapsed_time: 90.072195904 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 1 2 12 32: 34 87 100 - open/close 738 (time 1787472363.84 total 10.02 last 73.68) - open/close 1402 (time 1787472373.85 total 20.03 last 66.31) - open/close 2283 (time 1787472383.86 total 30.03 last 88.09) - open/close 3025 (time 1787472393.87 total 40.04 last 74.11) - open/close 3629 (time 1787472403.88 total 50.06 last 60.31) - open/close 4313 (time 1787472413.88 total 60.06 last 68.40) - open/close 5178 (time 1787472423.89 total 70.06 last 86.44) - open/close 6102 (time 1787472433.89 total 80.06 last 92.39) - open/close 6831 (time 1787472443.90 total 90.07 last 72.86) - open/close 7668 (time 1787472453.90 total 100.07 last 83.68) - open/close 8511 (time 1787472463.90 total 110.08 last 84.25) - open/close 9318 (time 1787472473.91 total 120.08 last 80.65) total: 10000 open/close in 128.34 seconds: 77.92 ops/second llite.lustre-ffff90af08a59000.statahead_batch_max=0 llite.lustre-ffff90af08a59000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90af08a59000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.547s user 0m0.295s sys 0m14.887s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff90af08a59000.statahead_batch_max=32 llite.lustre-ffff90af08a59000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff90af08a59000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m44.621s user 0m0.318s sys 0m14.694s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats= snapshot_time: 1787472674.989558029 secs.nsecs start_time: 1787472553.414489005 secs.nsecs elapsed_time: 121.575069024 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats=0 llite.lustre-ffff90af08a59000.statahead_max=2048 llite.lustre-ffff90af08a59000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats=0 total: 100 open/close in 2.48 seconds: 40.39 ops/second llite.lustre-ffff90af08a59000.statahead_max=0 101 real 0m2.346s user 0m0.006s sys 0m0.341s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff90af08a59000.statahead_max=2048 llite.lustre-ffff90af08a59000.statahead_max=2048 101 real 0m1.278s user 0m0.002s sys 0m0.186s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 710 (time 1787472991.90 total 10.01 last 70.96) total: 900 open/close in 13.34 seconds: 67.48 ops/second llite.lustre-ffff90af08a59000.statahead_max=0 1001 real 0m20.868s user 0m0.033s sys 0m3.033s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff90af08a59000.statahead_max=2048 llite.lustre-ffff90af08a59000.statahead_max=2048 1001 real 0m5.917s user 0m0.022s sys 0m1.431s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff90af08a59000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats= snapshot_time: 1787473055.321871095 secs.nsecs start_time: 1787472677.401886191 secs.nsecs elapsed_time: 377.919984904 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 1 9 45 64: 2 18 63 128: 0 0 63 256: 4 36 100 - open/close 774 (time 1787473068.63 total 10.01 last 77.36) - open/close 1736 (time 1787473078.63 total 20.01 last 96.18) - open/close 2611 (time 1787473088.67 total 30.05 last 87.15) - open/close 3314 (time 1787473098.67 total 40.05 last 70.25) - open/close 4023 (time 1787473108.68 total 50.06 last 70.89) - open/close 4705 (time 1787473118.70 total 60.08 last 68.05) - open/close 5062 (time 1787473128.73 total 70.11 last 35.60) - open/close 5541 (time 1787473138.77 total 80.15 last 47.71) - open/close 6325 (time 1787473148.77 total 90.15 last 78.36) - open/close 7157 (time 1787473158.79 total 100.17 last 83.03) - open/close 8037 (time 1787473168.80 total 110.18 last 87.94) - open/close 8932 (time 1787473178.81 total 120.19 last 89.35) - open/close 9903 (time 1787473188.82 total 130.20 last 97.06) total: 10000 open/close in 131.26 seconds: 76.18 ops/second llite.lustre-ffff90af08a59000.statahead_batch_max=0 llite.lustre-ffff90af08a59000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90af08a59000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m13.177s user 0m0.319s sys 0m15.905s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff90af08a59000.statahead_batch_max=256 llite.lustre-ffff90af08a59000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff90af08a59000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.501s user 0m0.304s sys 0m15.348s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff90af08a59000.batch_stats= snapshot_time: 1787473354.078714269 secs.nsecs start_time: 1787473273.791462642 secs.nsecs elapsed_time: 80.287251627 secs.nsecs subreqs per batch batches %% cum %% 1: 139 43 43 2: 54 16 60 4: 44 13 73 8: 13 4 77 16: 14 4 82 32: 14 4 86 64: 8 2 89 128: 1 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff90af08a59000.statahead_batch_max=64 llite.lustre-ffff90af08a59000.statahead_max=128