== sanity test 123ad: Verify batching statahead works correctly ========================================================== 03:40:19 (1787384419) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats=0 llite.lustre-ffff88b0612cf800.statahead_max=32 llite.lustre-ffff88b0612cf800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats=0 total: 100 open/close in 3.78 seconds: 26.43 ops/second llite.lustre-ffff88b0612cf800.statahead_max=0 101 real 0m2.445s user 0m0.004s sys 0m0.368s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff88b0612cf800.statahead_max=32 llite.lustre-ffff88b0612cf800.statahead_max=32 101 real 0m1.134s user 0m0.004s sys 0m0.195s 'ls -l' 100 files with statahead: 1 sec statahead total: 127 statahead wrong: 2 agl total: 121 list_total: 30 fname_total: 94 hit_total: 3807 miss_total: 1581 swrong=2 ewrong=2 - open/close 626 (time 1787384448.38 total 10.00 last 62.59) total: 900 open/close in 13.97 seconds: 64.43 ops/second llite.lustre-ffff88b0612cf800.statahead_max=0 1001 real 0m22.654s user 0m0.031s sys 0m3.439s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff88b0612cf800.statahead_max=32 llite.lustre-ffff88b0612cf800.statahead_max=32 1001 real 0m10.560s user 0m0.032s sys 0m1.763s 'ls -l' 1000 files with statahead: 11 sec statahead total: 128 statahead wrong: 2 agl total: 122 list_total: 31 fname_total: 94 hit_total: 4803 miss_total: 1585 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff88b0612cf800.statahead_stats= statahead total: 128 statahead wrong: 2 agl total: 122 list_total: 31 fname_total: 94 hit_total: 4803 miss_total: 1585 mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats= snapshot_time: 1787384519.922809969 secs.nsecs start_time: 1787384423.827577889 secs.nsecs elapsed_time: 96.095232080 secs.nsecs subreqs per batch batches %% cum %% 1: 4 9 9 2: 1 2 11 4: 0 0 11 8: 2 4 16 16: 2 4 20 32: 34 79 100 - open/close 711 (time 1787384532.07 total 10.01 last 71.03) - open/close 1396 (time 1787384542.08 total 20.01 last 68.48) - open/close 2100 (time 1787384552.08 total 30.01 last 70.40) - open/close 2763 (time 1787384562.08 total 40.02 last 66.27) - open/close 3486 (time 1787384572.09 total 50.03 last 72.22) - open/close 4154 (time 1787384582.10 total 60.03 last 66.76) - open/close 4858 (time 1787384592.10 total 70.04 last 70.38) - open/close 5548 (time 1787384602.10 total 80.04 last 69.00) - open/close 6275 (time 1787384612.11 total 90.05 last 72.63) - open/close 6925 (time 1787384622.11 total 100.05 last 64.99) - open/close 7579 (time 1787384632.12 total 110.06 last 65.32) - open/close 8213 (time 1787384642.13 total 120.07 last 63.35) - open/close 8868 (time 1787384652.14 total 130.07 last 65.48) - open/close 9497 (time 1787384662.14 total 140.08 last 62.87) total: 10000 open/close in 147.46 seconds: 67.82 ops/second llite.lustre-ffff88b0612cf800.statahead_batch_max=0 llite.lustre-ffff88b0612cf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88b0612cf800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.522s user 0m0.379s sys 0m19.648s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff88b0612cf800.statahead_batch_max=32 llite.lustre-ffff88b0612cf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff88b0612cf800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m37.634s user 0m0.327s sys 0m16.931s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats= snapshot_time: 1787384853.146706688 secs.nsecs start_time: 1787384741.097829234 secs.nsecs elapsed_time: 112.048877454 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats=0 llite.lustre-ffff88b0612cf800.statahead_max=2048 llite.lustre-ffff88b0612cf800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats=0 total: 100 open/close in 2.86 seconds: 35.01 ops/second llite.lustre-ffff88b0612cf800.statahead_max=0 101 real 0m2.952s user 0m0.007s sys 0m0.372s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff88b0612cf800.statahead_max=2048 llite.lustre-ffff88b0612cf800.statahead_max=2048 101 real 0m1.283s user 0m0.005s sys 0m0.192s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 724 (time 1787385208.07 total 10.02 last 72.25) total: 900 open/close in 13.00 seconds: 69.22 ops/second llite.lustre-ffff88b0612cf800.statahead_max=0 1001 real 0m22.525s user 0m0.032s sys 0m3.349s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff88b0612cf800.statahead_max=2048 llite.lustre-ffff88b0612cf800.statahead_max=2048 1001 real 0m6.914s user 0m0.033s sys 0m1.740s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff88b0612cf800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats= snapshot_time: 1787385274.880703397 secs.nsecs start_time: 1787384855.210531559 secs.nsecs elapsed_time: 419.670171838 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 627 (time 1787385288.18 total 10.02 last 62.57) - open/close 1341 (time 1787385298.18 total 20.02 last 71.39) - open/close 2001 (time 1787385308.19 total 30.03 last 65.95) - open/close 2621 (time 1787385318.19 total 40.03 last 61.98) - open/close 3329 (time 1787385328.20 total 50.04 last 70.76) - open/close 3981 (time 1787385338.20 total 60.04 last 65.19) - open/close 4635 (time 1787385348.21 total 70.05 last 65.33) - open/close 5316 (time 1787385358.21 total 80.05 last 68.10) - open/close 5994 (time 1787385368.23 total 90.07 last 67.67) - open/close 6669 (time 1787385378.26 total 100.10 last 67.26) - open/close 7400 (time 1787385388.29 total 110.13 last 72.91) - open/close 8036 (time 1787385398.30 total 120.15 last 63.51) - open/close 8695 (time 1787385408.32 total 130.16 last 65.80) - open/close 9349 (time 1787385418.33 total 140.17 last 65.33) total: 10000 open/close in 149.40 seconds: 66.94 ops/second llite.lustre-ffff88b0612cf800.statahead_batch_max=0 llite.lustre-ffff88b0612cf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88b0612cf800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m59.122s user 0m0.387s sys 0m19.533s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff88b0612cf800.statahead_batch_max=256 llite.lustre-ffff88b0612cf800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff88b0612cf800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.396s user 0m0.335s sys 0m18.751s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff88b0612cf800.batch_stats= snapshot_time: 1787385572.379515363 secs.nsecs start_time: 1787385497.628854816 secs.nsecs elapsed_time: 74.750660547 secs.nsecs subreqs per batch batches %% cum %% 1: 136 48 48 2: 42 14 62 4: 26 9 72 8: 10 3 75 16: 16 5 81 32: 8 2 84 64: 9 3 87 128: 2 0 87 256: 34 12 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff88b0612cf800.statahead_batch_max=64 llite.lustre-ffff88b0612cf800.statahead_max=128