== sanity test 123ad: Verify batching statahead works correctly ========================================================== 21:55:39 (1787104539) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats=0 llite.lustre-ffff93503a7a2800.statahead_max=32 llite.lustre-ffff93503a7a2800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats=0 total: 100 open/close in 1.29 seconds: 77.54 ops/second llite.lustre-ffff93503a7a2800.statahead_max=0 101 real 0m1.245s user 0m0.006s sys 0m0.291s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff93503a7a2800.statahead_max=32 llite.lustre-ffff93503a7a2800.statahead_max=32 101 real 0m0.546s user 0m0.005s sys 0m0.162s 'ls -l' 100 files with statahead: 0 sec statahead total: 95 statahead wrong: 2 agl total: 90 list_total: 30 fname_total: 55 hit_total: 13865 miss_total: 1738 swrong=2 ewrong=2 total: 900 open/close in 5.26 seconds: 171.09 ops/second llite.lustre-ffff93503a7a2800.statahead_max=0 1001 real 0m10.213s user 0m0.033s sys 0m2.794s 'ls -l' 1000 files without statahead: 10 sec llite.lustre-ffff93503a7a2800.statahead_max=32 llite.lustre-ffff93503a7a2800.statahead_max=32 1001 real 0m4.383s user 0m0.025s sys 0m1.860s 'ls -l' 1000 files with statahead: 4 sec statahead total: 96 statahead wrong: 2 agl total: 91 list_total: 31 fname_total: 55 hit_total: 14863 miss_total: 1740 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff93503a7a2800.statahead_stats= statahead total: 96 statahead wrong: 2 agl total: 91 list_total: 31 fname_total: 55 hit_total: 14863 miss_total: 1740 mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats= snapshot_time: 1787104580.830142588 secs.nsecs start_time: 1787104541.542955535 secs.nsecs elapsed_time: 39.287187053 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 2 5 10 16: 2 5 15 32: 34 85 100 - open/close 1625 (time 1787104591.78 total 10.00 last 162.42) - open/close 2902 (time 1787104601.78 total 20.01 last 127.70) - open/close 4424 (time 1787104611.78 total 30.01 last 152.14) - open/close 5725 (time 1787104621.79 total 40.01 last 130.02) - open/close 7059 (time 1787104631.79 total 50.02 last 133.36) - open/close 8365 (time 1787104641.79 total 60.02 last 130.59) - open/close 9723 (time 1787104651.79 total 70.02 last 135.79) total: 10000 open/close in 72.07 seconds: 138.75 ops/second llite.lustre-ffff93503a7a2800.statahead_batch_max=0 llite.lustre-ffff93503a7a2800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93503a7a2800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.896s user 0m0.274s sys 0m21.655s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93503a7a2800.statahead_batch_max=32 llite.lustre-ffff93503a7a2800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93503a7a2800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.517s user 0m0.231s sys 0m18.316s batched statahead RPC= hit count=9985 mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats= snapshot_time: 1787104745.173478161 secs.nsecs start_time: 1787104693.174749853 secs.nsecs elapsed_time: 51.998728308 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats=0 llite.lustre-ffff93503a7a2800.statahead_max=2048 llite.lustre-ffff93503a7a2800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats=0 total: 100 open/close in 1.28 seconds: 78.41 ops/second llite.lustre-ffff93503a7a2800.statahead_max=0 101 real 0m1.039s user 0m0.004s sys 0m0.314s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff93503a7a2800.statahead_max=2048 llite.lustre-ffff93503a7a2800.statahead_max=2048 101 real 0m0.357s user 0m0.001s sys 0m0.228s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10084 miss_total: 16 swrong=0 ewrong=0 total: 900 open/close in 5.23 seconds: 172.03 ops/second llite.lustre-ffff93503a7a2800.statahead_max=0 1001 real 0m8.853s user 0m0.023s sys 0m2.788s 'ls -l' 1000 files without statahead: 9 sec llite.lustre-ffff93503a7a2800.statahead_max=2048 llite.lustre-ffff93503a7a2800.statahead_max=2048 1001 real 0m3.495s user 0m0.022s sys 0m1.410s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff93503a7a2800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11083 miss_total: 17 mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats= snapshot_time: 1787104925.184143842 secs.nsecs start_time: 1787104746.161986971 secs.nsecs elapsed_time: 179.022156871 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 2317 (time 1787104936.48 total 10.00 last 231.64) - open/close 4335 (time 1787104946.49 total 20.01 last 201.68) - open/close 6134 (time 1787104956.49 total 30.01 last 179.83) - open/close 7591 (time 1787104966.50 total 40.02 last 145.62) - open/close 9009 (time 1787104976.50 total 50.02 last 141.76) total: 10000 open/close in 56.68 seconds: 176.43 ops/second llite.lustre-ffff93503a7a2800.statahead_batch_max=0 llite.lustre-ffff93503a7a2800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93503a7a2800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m32.903s user 0m0.242s sys 0m23.627s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93503a7a2800.statahead_batch_max=256 llite.lustre-ffff93503a7a2800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93503a7a2800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m27.871s user 0m0.206s sys 0m19.232s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff93503a7a2800.batch_stats= snapshot_time: 1787105055.069605512 secs.nsecs start_time: 1787105020.224476105 secs.nsecs elapsed_time: 34.845129407 secs.nsecs subreqs per batch batches %% cum %% 1: 238 62 62 2: 43 11 73 4: 34 8 82 8: 3 0 83 16: 5 1 84 32: 20 5 90 64: 2 0 90 128: 1 0 90 256: 35 9 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff93503a7a2800.statahead_batch_max=64 llite.lustre-ffff93503a7a2800.statahead_max=128