== sanity test 123ad: Verify batching statahead works correctly ========================================================== 02:34:15 (1788935655) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats=0 llite.lustre-ffff8f5760fd7800.statahead_max=32 llite.lustre-ffff8f5760fd7800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats=0 total: 100 open/close in 2.61 seconds: 38.29 ops/second llite.lustre-ffff8f5760fd7800.statahead_max=0 101 real 0m2.303s user 0m0.003s sys 0m0.303s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8f5760fd7800.statahead_max=32 llite.lustre-ffff8f5760fd7800.statahead_max=32 101 real 0m0.987s user 0m0.004s sys 0m0.139s 'ls -l' 100 files with statahead: 1 sec statahead total: 153 statahead wrong: 2 agl total: 147 list_total: 30 fname_total: 123 hit_total: 3613 miss_total: 1426 swrong=2 ewrong=2 - open/close 869 (time 1788935683.21 total 10.03 last 86.60) total: 900 open/close in 10.52 seconds: 85.58 ops/second llite.lustre-ffff8f5760fd7800.statahead_max=0 1001 real 0m19.690s user 0m0.030s sys 0m2.709s 'ls -l' 1000 files without statahead: 19 sec llite.lustre-ffff8f5760fd7800.statahead_max=32 llite.lustre-ffff8f5760fd7800.statahead_max=32 1001 real 0m8.467s user 0m0.027s sys 0m1.332s 'ls -l' 1000 files with statahead: 9 sec statahead total: 154 statahead wrong: 2 agl total: 148 list_total: 31 fname_total: 123 hit_total: 4610 miss_total: 1429 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 19 seconds llite.lustre-ffff8f5760fd7800.statahead_stats= statahead total: 154 statahead wrong: 2 agl total: 148 list_total: 31 fname_total: 123 hit_total: 4610 miss_total: 1429 mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats= snapshot_time: 1788935743.094965595 secs.nsecs start_time: 1788935660.769784387 secs.nsecs elapsed_time: 82.325181208 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 823 (time 1788935755.46 total 10.00 last 82.28) - open/close 1643 (time 1788935765.47 total 20.01 last 81.93) - open/close 2375 (time 1788935775.48 total 30.02 last 73.13) - open/close 3171 (time 1788935785.49 total 40.03 last 79.55) - open/close 3978 (time 1788935795.49 total 50.03 last 80.68) - open/close 4718 (time 1788935805.50 total 60.04 last 73.93) - open/close 5285 (time 1788935815.50 total 70.04 last 56.69) - open/close 6019 (time 1788935825.50 total 80.04 last 73.38) - open/close 6695 (time 1788935835.51 total 90.05 last 67.57) - open/close 7411 (time 1788935845.51 total 100.05 last 71.60) - open/close 8165 (time 1788935855.52 total 110.06 last 75.28) - open/close 9027 (time 1788935865.53 total 120.07 last 86.11) - open/close 9758 (time 1788935875.54 total 130.08 last 73.08) total: 10000 open/close in 132.45 seconds: 75.50 ops/second llite.lustre-ffff8f5760fd7800.statahead_batch_max=0 llite.lustre-ffff8f5760fd7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m1.667s user 0m0.299s sys 0m13.596s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f5760fd7800.statahead_batch_max=32 llite.lustre-ffff8f5760fd7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m33.693s user 0m0.285s sys 0m13.054s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats= snapshot_time: 1788936054.169489635 secs.nsecs start_time: 1788935949.462125289 secs.nsecs elapsed_time: 104.707364346 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats=0 llite.lustre-ffff8f5760fd7800.statahead_max=2048 llite.lustre-ffff8f5760fd7800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats=0 total: 100 open/close in 2.73 seconds: 36.62 ops/second llite.lustre-ffff8f5760fd7800.statahead_max=0 101 real 0m1.606s user 0m0.005s sys 0m0.282s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8f5760fd7800.statahead_max=2048 llite.lustre-ffff8f5760fd7800.statahead_max=2048 101 real 0m0.969s user 0m0.002s sys 0m0.144s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 806 (time 1788936353.80 total 10.01 last 80.55) total: 900 open/close in 11.24 seconds: 80.07 ops/second llite.lustre-ffff8f5760fd7800.statahead_max=0 1001 real 0m19.750s user 0m0.030s sys 0m2.662s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff8f5760fd7800.statahead_max=2048 llite.lustre-ffff8f5760fd7800.statahead_max=2048 1001 real 0m5.087s user 0m0.023s sys 0m1.394s 'ls -l' 1000 files with statahead: 5 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 17 seconds llite.lustre-ffff8f5760fd7800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats= snapshot_time: 1788936408.185116783 secs.nsecs start_time: 1788936056.504979136 secs.nsecs elapsed_time: 351.680137647 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 828 (time 1788936420.24 total 10.01 last 82.73) - open/close 1649 (time 1788936430.25 total 20.02 last 82.03) - open/close 2508 (time 1788936440.26 total 30.03 last 85.80) - open/close 3330 (time 1788936450.26 total 40.03 last 82.17) - open/close 4195 (time 1788936460.26 total 50.03 last 86.50) - open/close 5040 (time 1788936470.28 total 60.04 last 84.40) - open/close 5889 (time 1788936480.29 total 70.05 last 84.82) - open/close 6745 (time 1788936490.29 total 80.05 last 85.59) - open/close 7522 (time 1788936500.29 total 90.06 last 77.67) - open/close 8335 (time 1788936510.30 total 100.06 last 81.27) - open/close 9099 (time 1788936520.30 total 110.06 last 76.39) - open/close 9942 (time 1788936530.31 total 120.07 last 84.23) total: 10000 open/close in 120.82 seconds: 82.77 ops/second llite.lustre-ffff8f5760fd7800.statahead_batch_max=0 llite.lustre-ffff8f5760fd7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.900s user 0m0.297s sys 0m14.786s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f5760fd7800.statahead_batch_max=256 llite.lustre-ffff8f5760fd7800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.469s user 0m0.296s sys 0m13.130s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8f5760fd7800.batch_stats= snapshot_time: 1788936657.326747246 secs.nsecs start_time: 1788936590.300448786 secs.nsecs elapsed_time: 67.026298460 secs.nsecs subreqs per batch batches %% cum %% 1: 52 29 29 2: 29 16 45 4: 25 14 59 8: 6 3 62 16: 8 4 67 32: 14 7 75 64: 8 4 79 128: 1 0 80 256: 35 19 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8f5760fd7800.statahead_batch_max=64 llite.lustre-ffff8f5760fd7800.statahead_max=128