== sanity test 123ad: Verify batching statahead works correctly ========================================================== 10:17:33 (1789309053) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats=0 llite.lustre-ffff93e39178e000.statahead_max=32 llite.lustre-ffff93e39178e000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats=0 total: 100 open/close in 0.77 seconds: 130.10 ops/second llite.lustre-ffff93e39178e000.statahead_max=0 101 real 0m0.809s user 0m0.003s sys 0m0.255s 'ls -l' 100 files without statahead: 0 sec llite.lustre-ffff93e39178e000.statahead_max=32 llite.lustre-ffff93e39178e000.statahead_max=32 101 real 0m0.440s user 0m0.007s sys 0m0.238s 'ls -l' 100 files with statahead: 1 sec statahead total: 125 statahead wrong: 2 agl total: 120 list_total: 30 fname_total: 95 hit_total: 3617 miss_total: 1458 swrong=2 ewrong=2 total: 900 open/close in 3.03 seconds: 297.09 ops/second llite.lustre-ffff93e39178e000.statahead_max=0 1001 real 0m7.197s user 0m0.025s sys 0m2.296s 'ls -l' 1000 files without statahead: 7 sec llite.lustre-ffff93e39178e000.statahead_max=32 llite.lustre-ffff93e39178e000.statahead_max=32 1001 real 0m3.768s user 0m0.015s sys 0m1.762s 'ls -l' 1000 files with statahead: 4 sec statahead total: 126 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 95 hit_total: 4613 miss_total: 1462 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 9 seconds llite.lustre-ffff93e39178e000.statahead_stats= statahead total: 126 statahead wrong: 2 agl total: 121 list_total: 31 fname_total: 95 hit_total: 4613 miss_total: 1462 mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats= snapshot_time: 1789309085.687800198 secs.nsecs start_time: 1789309055.240138240 secs.nsecs elapsed_time: 30.447661958 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 2678 (time 1789309096.62 total 10.00 last 267.70) - open/close 5004 (time 1789309106.63 total 20.01 last 232.50) - open/close 7150 (time 1789309116.64 total 30.02 last 214.37) - open/close 9100 (time 1789309126.64 total 40.02 last 194.98) total: 10000 open/close in 44.40 seconds: 225.25 ops/second llite.lustre-ffff93e39178e000.statahead_batch_max=0 llite.lustre-ffff93e39178e000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93e39178e000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m45.328s user 0m0.250s sys 0m17.316s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93e39178e000.statahead_batch_max=32 llite.lustre-ffff93e39178e000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93e39178e000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m30.335s user 0m0.243s sys 0m12.085s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats= snapshot_time: 1789309277.154880406 secs.nsecs start_time: 1789309179.851625521 secs.nsecs elapsed_time: 97.303254885 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats=0 llite.lustre-ffff93e39178e000.statahead_max=2048 llite.lustre-ffff93e39178e000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats=0 total: 100 open/close in 3.07 seconds: 32.60 ops/second llite.lustre-ffff93e39178e000.statahead_max=0 101 real 0m2.399s user 0m0.008s sys 0m0.307s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff93e39178e000.statahead_max=2048 llite.lustre-ffff93e39178e000.statahead_max=2048 101 real 0m0.827s user 0m0.006s sys 0m0.150s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 612 (time 1789309602.01 total 10.00 last 61.18) total: 900 open/close in 14.16 seconds: 63.56 ops/second llite.lustre-ffff93e39178e000.statahead_max=0 1001 real 0m20.960s user 0m0.034s sys 0m2.868s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff93e39178e000.statahead_max=2048 llite.lustre-ffff93e39178e000.statahead_max=2048 1001 real 0m9.067s user 0m0.029s sys 0m1.322s 'ls -l' 1000 files with statahead: 9 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff93e39178e000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats= snapshot_time: 1789309675.757743095 secs.nsecs start_time: 1789309281.881507381 secs.nsecs elapsed_time: 393.876235714 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 728 (time 1789309688.81 total 10.00 last 72.77) - open/close 1301 (time 1789309698.81 total 20.01 last 57.29) - open/close 2001 (time 1789309708.82 total 30.02 last 69.90) - open/close 2762 (time 1789309718.83 total 40.03 last 76.03) - open/close 3546 (time 1789309728.84 total 50.04 last 78.34) - open/close 4324 (time 1789309738.84 total 60.04 last 77.77) - open/close 5029 (time 1789309748.85 total 70.04 last 70.48) - open/close 5774 (time 1789309758.85 total 80.05 last 74.46) - open/close 6563 (time 1789309768.85 total 90.05 last 78.88) - open/close 7290 (time 1789309778.86 total 100.06 last 72.64) - open/close 8088 (time 1789309788.88 total 110.07 last 79.69) - open/close 8790 (time 1789309798.88 total 120.08 last 70.17) - open/close 9514 (time 1789309808.90 total 130.09 last 72.28) total: 10000 open/close in 136.94 seconds: 73.02 ops/second llite.lustre-ffff93e39178e000.statahead_batch_max=0 llite.lustre-ffff93e39178e000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93e39178e000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.387s user 0m0.305s sys 0m13.360s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff93e39178e000.statahead_batch_max=256 llite.lustre-ffff93e39178e000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff93e39178e000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.083s user 0m0.334s sys 0m13.330s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff93e39178e000.batch_stats= snapshot_time: 1789309959.524955355 secs.nsecs start_time: 1789309890.327612235 secs.nsecs elapsed_time: 69.197343120 secs.nsecs subreqs per batch batches %% cum %% 1: 120 41 41 2: 45 15 57 4: 38 13 70 8: 17 5 76 16: 11 3 79 32: 17 5 85 64: 6 2 87 128: 1 0 88 256: 34 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff93e39178e000.statahead_batch_max=64 llite.lustre-ffff93e39178e000.statahead_max=128