== sanity test 123ad: Verify batching statahead works correctly ========================================================== 19:12:19 (1784416339) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats=0 llite.lustre-ffff9a998619e800.statahead_max=32 llite.lustre-ffff9a998619e800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.65 seconds: 155.03 ops/second llite.lustre-ffff9a998619e800.statahead_max=0 101 real 0m0.665s user 0m0.004s sys 0m0.256s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff9a998619e800.statahead_max=32 llite.lustre-ffff9a998619e800.statahead_max=32 101 real 0m0.433s user 0m0.002s sys 0m0.251s 'ls -l' 100 files with statahead: 0 sec statahead total: 56 statahead wrong: 2 agl total: 52 list_total: 24 fname_total: 32 hit_total: 13928 miss_total: 1526 swrong=2 ewrong=2 total: 900 open/close in 2.96 seconds: 303.71 ops/second llite.lustre-ffff9a998619e800.statahead_max=0 1001 real 0m8.066s user 0m0.023s sys 0m2.999s 'ls -l' 1000 files without statahead: 9 sec llite.lustre-ffff9a998619e800.statahead_max=32 llite.lustre-ffff9a998619e800.statahead_max=32 1001 real 0m4.202s user 0m0.017s sys 0m2.058s 'ls -l' 1000 files with statahead: 4 sec statahead total: 57 statahead wrong: 2 agl total: 53 list_total: 25 fname_total: 32 hit_total: 14927 miss_total: 1527 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 5 seconds llite.lustre-ffff9a998619e800.statahead_stats= statahead total: 57 statahead wrong: 2 agl total: 53 list_total: 25 fname_total: 32 hit_total: 14927 miss_total: 1527 mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats= snapshot_time: 1784416368.758957700 secs.nsecs start_time: 1784416341.201805345 secs.nsecs elapsed_time: 27.557152355 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 3 7 10 8: 3 7 17 16: 19 48 66 32: 13 33 100 mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats= snapshot_time: 1784416368.759025892 secs.nsecs start_time: 1784416341.201858295 secs.nsecs elapsed_time: 27.557167597 secs.nsecs subreqs per batch batches %% cum %% 1: 2 5 5 2: 0 0 5 4: 2 5 10 8: 2 5 15 16: 19 47 62 32: 15 37 100 - open/close 2607 (time 1784416380.84 total 10.00 last 260.65) - open/close 5671 (time 1784416390.85 total 20.00 last 306.36) total: 10000 open/close in 29.84 seconds: 335.13 ops/second llite.lustre-ffff9a998619e800.statahead_batch_max=0 llite.lustre-ffff9a998619e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a998619e800.stats=clear mdc.lustre-MDT0001-mdc-ffff9a998619e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m52.160s user 0m0.177s sys 0m50.076s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a998619e800.statahead_batch_max=32 llite.lustre-ffff9a998619e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a998619e800.stats=clear mdc.lustre-MDT0001-mdc-ffff9a998619e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m41.637s user 0m0.174s sys 0m23.565s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats= snapshot_time: 1784416504.772331106 secs.nsecs start_time: 1784416456.168976624 secs.nsecs elapsed_time: 48.603354482 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 2 0 0 32: 312 99 100 mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats= snapshot_time: 1784416504.772370375 secs.nsecs start_time: 1784416456.169051890 secs.nsecs elapsed_time: 48.603318485 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats=0 llite.lustre-ffff9a998619e800.statahead_max=2048 llite.lustre-ffff9a998619e800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats=0 mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats=0 striped dir -i1 -c2 -H fnv_1a_64 /mnt/lustre/d123ad.sanity total: 100 open/close in 0.85 seconds: 117.19 ops/second llite.lustre-ffff9a998619e800.statahead_max=0 101 real 0m1.038s user 0m0.007s sys 0m0.385s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff9a998619e800.statahead_max=2048 llite.lustre-ffff9a998619e800.statahead_max=2048 101 real 0m0.505s user 0m0.005s sys 0m0.217s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 3.89 seconds: 231.40 ops/second llite.lustre-ffff9a998619e800.statahead_max=0 1001 real 0m8.018s user 0m0.022s sys 0m2.959s 'ls -l' 1000 files without statahead: 8 sec llite.lustre-ffff9a998619e800.statahead_max=2048 llite.lustre-ffff9a998619e800.statahead_max=2048 1001 real 0m3.381s user 0m0.014s sys 0m1.303s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 8 seconds llite.lustre-ffff9a998619e800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats= snapshot_time: 1784416649.423974765 secs.nsecs start_time: 1784416505.742018880 secs.nsecs elapsed_time: 143.681955885 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 3 42 42 8: 1 14 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats= snapshot_time: 1784416649.424092039 secs.nsecs start_time: 1784416505.742159225 secs.nsecs elapsed_time: 143.681932814 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 2 28 28 8: 2 28 57 16: 0 0 57 32: 0 0 57 64: 1 14 71 128: 0 0 71 256: 2 28 100 - open/close 2622 (time 1784416660.59 total 10.00 last 262.14) - open/close 4866 (time 1784416670.59 total 20.01 last 224.34) - open/close 7500 (time 1784416680.59 total 30.01 last 263.39) total: 10000 open/close in 36.60 seconds: 273.22 ops/second llite.lustre-ffff9a998619e800.statahead_batch_max=0 llite.lustre-ffff9a998619e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a998619e800.stats=clear mdc.lustre-MDT0001-mdc-ffff9a998619e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.300s user 0m0.140s sys 0m37.381s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9a998619e800.statahead_batch_max=256 llite.lustre-ffff9a998619e800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats=clear mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9a998619e800.stats=clear mdc.lustre-MDT0001-mdc-ffff9a998619e800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m30.288s user 0m0.133s sys 0m21.211s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9a998619e800.batch_stats= snapshot_time: 1784416771.390757121 secs.nsecs start_time: 1784416734.932935352 secs.nsecs elapsed_time: 36.457821769 secs.nsecs subreqs per batch batches %% cum %% 1: 487 69 69 2: 76 10 80 4: 56 8 88 8: 18 2 91 16: 4 0 91 32: 19 2 94 64: 4 0 95 128: 0 0 95 256: 33 4 100 mdc.lustre-MDT0001-mdc-ffff9a998619e800.batch_stats= snapshot_time: 1784416771.390819326 secs.nsecs start_time: 1784416734.932989057 secs.nsecs elapsed_time: 36.457830269 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9a998619e800.statahead_batch_max=64 llite.lustre-ffff9a998619e800.statahead_max=128