== sanity test 123ad: Verify batching statahead works correctly ========================================================== 20:19:09 (1788567549) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats=0 llite.lustre-ffff9195431af800.statahead_max=32 llite.lustre-ffff9195431af800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats=0 total: 100 open/close in 3.29 seconds: 30.38 ops/second llite.lustre-ffff9195431af800.statahead_max=0 101 real 0m3.327s user 0m0.007s sys 0m0.348s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9195431af800.statahead_max=32 llite.lustre-ffff9195431af800.statahead_max=32 101 real 0m1.306s user 0m0.003s sys 0m0.166s 'ls -l' 100 files with statahead: 2 sec statahead total: 144 statahead wrong: 2 agl total: 138 list_total: 31 fname_total: 99 hit_total: 4065 miss_total: 1280 swrong=2 ewrong=2 - open/close 454 (time 1788567584.53 total 10.00 last 45.40) total: 900 open/close in 16.29 seconds: 55.24 ops/second llite.lustre-ffff9195431af800.statahead_max=0 1001 real 0m38.744s user 0m0.043s sys 0m3.172s 'ls -l' 1000 files without statahead: 39 sec llite.lustre-ffff9195431af800.statahead_max=32 llite.lustre-ffff9195431af800.statahead_max=32 1001 real 0m13.780s user 0m0.031s sys 0m1.548s 'ls -l' 1000 files with statahead: 13 sec statahead total: 145 statahead wrong: 2 agl total: 139 list_total: 32 fname_total: 99 hit_total: 5061 miss_total: 1284 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 27 seconds llite.lustre-ffff9195431af800.statahead_stats= statahead total: 145 statahead wrong: 2 agl total: 139 list_total: 32 fname_total: 99 hit_total: 5061 miss_total: 1284 mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats= snapshot_time: 1788567689.052691668 secs.nsecs start_time: 1788567555.340990688 secs.nsecs elapsed_time: 133.711700980 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 3 7 7 16: 2 5 12 32: 34 87 100 - open/close 500 (time 1788567702.34 total 10.01 last 49.94) - open/close 1043 (time 1788567712.35 total 20.02 last 54.28) - open/close 1611 (time 1788567722.35 total 30.02 last 56.79) - open/close 2124 (time 1788567732.38 total 40.05 last 51.15) - open/close 2669 (time 1788567742.39 total 50.06 last 54.41) - open/close 3222 (time 1788567752.42 total 60.09 last 55.17) - open/close 3752 (time 1788567762.42 total 70.09 last 52.98) - open/close 4365 (time 1788567772.43 total 80.10 last 61.28) - open/close 4957 (time 1788567782.43 total 90.10 last 59.16) - open/close 5473 (time 1788567792.44 total 100.11 last 51.55) - open/close 5964 (time 1788567802.44 total 110.11 last 49.10) - open/close 6491 (time 1788567812.44 total 120.11 last 52.70) - open/close 7027 (time 1788567822.46 total 130.13 last 53.53) - open/close 7575 (time 1788567832.47 total 140.14 last 54.73) - open/close 8117 (time 1788567842.48 total 150.15 last 54.12) - open/close 8659 (time 1788567852.48 total 160.15 last 54.19) - open/close 9178 (time 1788567862.50 total 170.17 last 51.82) - open/close 9671 (time 1788567872.53 total 180.20 last 49.16) total: 10000 open/close in 185.80 seconds: 53.82 ops/second llite.lustre-ffff9195431af800.statahead_batch_max=0 llite.lustre-ffff9195431af800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9195431af800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m36.523s user 0m0.450s sys 0m15.929s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9195431af800.statahead_batch_max=32 llite.lustre-ffff9195431af800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9195431af800.stats=clear ls -l files in d123ad.sanity: 10001 real 2m31.638s user 0m0.373s sys 0m14.709s batched statahead RPC= hit count=9970 mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats= snapshot_time: 1788568155.661324238 secs.nsecs start_time: 1788567987.759313580 secs.nsecs elapsed_time: 167.902010658 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats=0 llite.lustre-ffff9195431af800.statahead_max=2048 llite.lustre-ffff9195431af800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats=0 total: 100 open/close in 4.07 seconds: 24.59 ops/second llite.lustre-ffff9195431af800.statahead_max=0 101 real 0m3.409s user 0m0.005s sys 0m0.360s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff9195431af800.statahead_max=2048 llite.lustre-ffff9195431af800.statahead_max=2048 101 real 0m1.255s user 0m0.008s sys 0m0.180s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10069 miss_total: 31 swrong=0 ewrong=0 - open/close 725 (time 1788568536.36 total 10.01 last 72.45) total: 900 open/close in 13.42 seconds: 67.07 ops/second llite.lustre-ffff9195431af800.statahead_max=0 1001 real 0m25.926s user 0m0.038s sys 0m3.218s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff9195431af800.statahead_max=2048 llite.lustre-ffff9195431af800.statahead_max=2048 1001 real 0m8.945s user 0m0.036s sys 0m1.615s 'ls -l' 1000 files with statahead: 9 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11068 miss_total: 32 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 29 seconds llite.lustre-ffff9195431af800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11068 miss_total: 32 mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats= snapshot_time: 1788568621.963188460 secs.nsecs start_time: 1788568160.341828990 secs.nsecs elapsed_time: 461.621359470 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 0 0 40 64: 1 10 50 128: 1 10 60 256: 4 40 100 - open/close 628 (time 1788568634.94 total 10.00 last 62.77) - open/close 1328 (time 1788568644.96 total 20.02 last 69.88) - open/close 2085 (time 1788568654.96 total 30.03 last 75.65) - open/close 2778 (time 1788568664.97 total 40.04 last 69.25) - open/close 3383 (time 1788568674.98 total 50.04 last 60.45) - open/close 3992 (time 1788568685.01 total 60.07 last 60.73) - open/close 4580 (time 1788568695.03 total 70.09 last 58.67) - open/close 5118 (time 1788568705.05 total 80.12 last 53.68) - open/close 5615 (time 1788568715.05 total 90.12 last 49.70) - open/close 6072 (time 1788568725.10 total 100.17 last 45.47) - open/close 6538 (time 1788568735.11 total 110.17 last 46.58) - open/close 7079 (time 1788568745.11 total 120.18 last 54.07) - open/close 7749 (time 1788568755.12 total 130.18 last 66.97) - open/close 8323 (time 1788568765.12 total 140.18 last 57.39) - open/close 8878 (time 1788568775.12 total 150.19 last 55.48) - open/close 9324 (time 1788568785.13 total 160.19 last 44.57) - open/close 9842 (time 1788568795.14 total 170.21 last 51.72) total: 10000 open/close in 173.95 seconds: 57.49 ops/second llite.lustre-ffff9195431af800.statahead_batch_max=0 llite.lustre-ffff9195431af800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9195431af800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m18.391s user 0m0.414s sys 0m15.280s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff9195431af800.statahead_batch_max=256 llite.lustre-ffff9195431af800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff9195431af800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.974s user 0m0.318s sys 0m14.205s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff9195431af800.batch_stats= snapshot_time: 1788568964.817988320 secs.nsecs start_time: 1788568889.213009417 secs.nsecs elapsed_time: 75.604978903 secs.nsecs subreqs per batch batches %% cum %% 1: 94 37 37 2: 31 12 50 4: 33 13 63 8: 22 8 72 16: 9 3 75 32: 20 8 83 64: 5 2 85 128: 0 0 85 256: 35 14 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff9195431af800.statahead_batch_max=64 llite.lustre-ffff9195431af800.statahead_max=128