== sanity test 123ad: Verify batching statahead works correctly ========================================================== 09:43:42 (1790775822) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats=0 llite.lustre-ffff9b79be669000.statahead_max=32 llite.lustre-ffff9b79be669000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats=0 total: 100 open/close in 2.82 seconds: 35.42 ops/second llite.lustre-ffff9b79be669000.statahead_max=0 101 real 0m2.946s user 0m0.003s sys 0m0.294s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9b79be669000.statahead_max=32 llite.lustre-ffff9b79be669000.statahead_max=32 101 real 0m1.665s user 0m0.005s sys 0m0.135s 'ls -l' 100 files with statahead: 1 sec statahead total: 134 statahead wrong: 2 agl total: 129 list_total: 31 fname_total: 88 hit_total: 3751 miss_total: 1526 swrong=2 ewrong=2 - open/close 644 (time 1790775854.15 total 10.01 last 64.34) total: 900 open/close in 13.45 seconds: 66.93 ops/second llite.lustre-ffff9b79be669000.statahead_max=0 1001 real 0m19.892s user 0m0.033s sys 0m2.731s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff9b79be669000.statahead_max=32 llite.lustre-ffff9b79be669000.statahead_max=32 1001 real 0m9.579s user 0m0.028s sys 0m1.293s 'ls -l' 1000 files with statahead: 10 sec statahead total: 135 statahead wrong: 2 agl total: 130 list_total: 32 fname_total: 88 hit_total: 4748 miss_total: 1529 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff9b79be669000.statahead_stats= statahead total: 135 statahead wrong: 2 agl total: 130 list_total: 32 fname_total: 88 hit_total: 4748 miss_total: 1529 mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats= snapshot_time: 1790775921.457036815 secs.nsecs start_time: 1790775827.548546224 secs.nsecs elapsed_time: 93.908490591 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 787 (time 1790775933.61 total 10.00 last 78.69) - open/close 1600 (time 1790775943.63 total 20.03 last 81.09) - open/close 2389 (time 1790775953.64 total 30.03 last 78.86) - open/close 3220 (time 1790775963.65 total 40.05 last 82.98) - open/close 4051 (time 1790775973.66 total 50.05 last 83.03) - open/close 4908 (time 1790775983.67 total 60.06 last 85.65) - open/close 5737 (time 1790775993.67 total 70.07 last 82.86) - open/close 6526 (time 1790776003.68 total 80.07 last 78.88) - open/close 7318 (time 1790776013.68 total 90.07 last 79.19) - open/close 8160 (time 1790776023.68 total 100.07 last 84.19) - open/close 8900 (time 1790776033.69 total 110.08 last 73.93) - open/close 9632 (time 1790776043.70 total 120.09 last 73.13) total: 10000 open/close in 126.26 seconds: 79.20 ops/second llite.lustre-ffff9b79be669000.statahead_batch_max=0 llite.lustre-ffff9b79be669000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9b79be669000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.099s user 0m0.288s sys 0m14.676s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9b79be669000.statahead_batch_max=32 llite.lustre-ffff9b79be669000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9b79be669000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m41.209s user 0m0.244s sys 0m12.827s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats= snapshot_time: 1790776227.845739084 secs.nsecs start_time: 1790776116.832376276 secs.nsecs elapsed_time: 111.013362808 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats=0 llite.lustre-ffff9b79be669000.statahead_max=2048 llite.lustre-ffff9b79be669000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats=0 total: 100 open/close in 2.47 seconds: 40.43 ops/second llite.lustre-ffff9b79be669000.statahead_max=0 101 real 0m2.673s user 0m0.007s sys 0m0.308s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff9b79be669000.statahead_max=2048 llite.lustre-ffff9b79be669000.statahead_max=2048 101 real 0m1.020s user 0m0.006s sys 0m0.169s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 605 (time 1790776536.28 total 10.01 last 60.46) total: 900 open/close in 14.81 seconds: 60.75 ops/second llite.lustre-ffff9b79be669000.statahead_max=0 1001 real 0m26.368s user 0m0.031s sys 0m2.773s 'ls -l' 1000 files without statahead: 27 sec llite.lustre-ffff9b79be669000.statahead_max=2048 llite.lustre-ffff9b79be669000.statahead_max=2048 1001 real 0m7.387s user 0m0.026s sys 0m1.358s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 24 seconds llite.lustre-ffff9b79be669000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats= snapshot_time: 1790776610.538490892 secs.nsecs start_time: 1790776230.346029449 secs.nsecs elapsed_time: 380.192461443 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 16 16 16: 2 16 33 32: 2 16 50 64: 2 16 66 128: 0 0 66 256: 4 33 100 - open/close 696 (time 1790776623.29 total 10.02 last 69.49) - open/close 1399 (time 1790776633.30 total 20.03 last 70.22) - open/close 2083 (time 1790776643.30 total 30.03 last 68.36) - open/close 2756 (time 1790776653.31 total 40.04 last 67.29) - open/close 3396 (time 1790776663.33 total 50.06 last 63.84) - open/close 4056 (time 1790776673.34 total 60.07 last 65.95) - open/close 4669 (time 1790776683.34 total 70.07 last 61.27) - open/close 5445 (time 1790776693.35 total 80.08 last 77.52) - open/close 6127 (time 1790776703.43 total 90.16 last 67.70) - open/close 6636 (time 1790776713.44 total 100.17 last 50.82) - open/close 7208 (time 1790776723.45 total 110.18 last 57.16) - open/close 7900 (time 1790776733.46 total 120.19 last 69.15) - open/close 8647 (time 1790776743.46 total 130.19 last 74.70) - open/close 9261 (time 1790776753.46 total 140.19 last 61.39) - open/close 9988 (time 1790776763.47 total 150.20 last 72.64) total: 10000 open/close in 150.31 seconds: 66.53 ops/second llite.lustre-ffff9b79be669000.statahead_batch_max=0 llite.lustre-ffff9b79be669000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9b79be669000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.425s user 0m0.324s sys 0m14.359s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9b79be669000.statahead_batch_max=256 llite.lustre-ffff9b79be669000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9b79be669000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.003s user 0m0.305s sys 0m14.125s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9b79be669000.batch_stats= snapshot_time: 1790776899.943548081 secs.nsecs start_time: 1790776834.464823988 secs.nsecs elapsed_time: 65.478724093 secs.nsecs subreqs per batch batches %% cum %% 1: 67 39 39 2: 15 8 48 4: 11 6 54 8: 7 4 58 16: 12 7 65 32: 18 10 76 64: 4 2 78 128: 0 0 78 256: 36 21 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9b79be669000.statahead_batch_max=64 llite.lustre-ffff9b79be669000.statahead_max=128