== sanity test 123ad: Verify batching statahead works correctly ========================================================== 10:33:44 (1790951624) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats=0 llite.lustre-ffff8e3ed1241800.statahead_max=32 llite.lustre-ffff8e3ed1241800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats=0 total: 100 open/close in 2.29 seconds: 43.71 ops/second llite.lustre-ffff8e3ed1241800.statahead_max=0 101 real 0m2.016s user 0m0.005s sys 0m0.307s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8e3ed1241800.statahead_max=32 llite.lustre-ffff8e3ed1241800.statahead_max=32 101 real 0m0.868s user 0m0.001s sys 0m0.147s 'ls -l' 100 files with statahead: 1 sec statahead total: 134 statahead wrong: 2 agl total: 128 list_total: 30 fname_total: 74 hit_total: 3986 miss_total: 1599 swrong=2 ewrong=2 - open/close 834 (time 1790951648.77 total 10.00 last 83.40) total: 900 open/close in 10.77 seconds: 83.58 ops/second llite.lustre-ffff8e3ed1241800.statahead_max=0 1001 real 0m20.408s user 0m0.033s sys 0m2.780s 'ls -l' 1000 files without statahead: 20 sec llite.lustre-ffff8e3ed1241800.statahead_max=32 llite.lustre-ffff8e3ed1241800.statahead_max=32 1001 real 0m8.376s user 0m0.026s sys 0m1.333s 'ls -l' 1000 files with statahead: 8 sec statahead total: 135 statahead wrong: 2 agl total: 129 list_total: 31 fname_total: 74 hit_total: 4983 miss_total: 1602 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 29 seconds llite.lustre-ffff8e3ed1241800.statahead_stats= statahead total: 135 statahead wrong: 2 agl total: 129 list_total: 31 fname_total: 74 hit_total: 4983 miss_total: 1602 mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats= snapshot_time: 1790951721.441851052 secs.nsecs start_time: 1790951628.656352398 secs.nsecs elapsed_time: 92.785498654 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 575 (time 1790951734.90 total 10.03 last 57.34) - open/close 1195 (time 1790951744.93 total 20.06 last 61.81) - open/close 1935 (time 1790951754.94 total 30.06 last 73.96) - open/close 2692 (time 1790951764.95 total 40.08 last 75.61) - open/close 3434 (time 1790951774.96 total 50.09 last 74.11) - open/close 4196 (time 1790951784.98 total 60.11 last 76.02) - open/close 5030 (time 1790951794.99 total 70.11 last 83.40) - open/close 5911 (time 1790951804.99 total 80.12 last 88.02) - open/close 6664 (time 1790951815.00 total 90.13 last 75.27) - open/close 7447 (time 1790951825.01 total 100.14 last 78.19) - open/close 8239 (time 1790951835.02 total 110.15 last 79.14) - open/close 8985 (time 1790951845.03 total 120.15 last 74.55) - open/close 9435 (time 1790951855.06 total 130.18 last 44.87) total: 10000 open/close in 138.74 seconds: 72.08 ops/second llite.lustre-ffff8e3ed1241800.statahead_batch_max=0 llite.lustre-ffff8e3ed1241800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m55.659s user 0m0.285s sys 0m15.169s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e3ed1241800.statahead_batch_max=32 llite.lustre-ffff8e3ed1241800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m36.578s user 0m0.275s sys 0m13.037s batched statahead RPC= hit count=9973 mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats= snapshot_time: 1790952032.837898361 secs.nsecs start_time: 1790951927.015156084 secs.nsecs elapsed_time: 105.822742277 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats=0 llite.lustre-ffff8e3ed1241800.statahead_max=2048 llite.lustre-ffff8e3ed1241800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats=0 total: 100 open/close in 2.74 seconds: 36.55 ops/second llite.lustre-ffff8e3ed1241800.statahead_max=0 101 real 0m2.514s user 0m0.007s sys 0m0.322s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8e3ed1241800.statahead_max=2048 llite.lustre-ffff8e3ed1241800.statahead_max=2048 101 real 0m0.792s user 0m0.004s sys 0m0.158s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10072 miss_total: 28 swrong=0 ewrong=0 - open/close 745 (time 1790952341.68 total 10.00 last 74.49) total: 900 open/close in 11.95 seconds: 75.31 ops/second llite.lustre-ffff8e3ed1241800.statahead_max=0 1001 real 0m21.520s user 0m0.032s sys 0m2.770s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff8e3ed1241800.statahead_max=2048 llite.lustre-ffff8e3ed1241800.statahead_max=2048 1001 real 0m7.525s user 0m0.029s sys 0m1.413s 'ls -l' 1000 files with statahead: 8 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11071 miss_total: 29 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff8e3ed1241800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11071 miss_total: 29 mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats= snapshot_time: 1790952404.807519342 secs.nsecs start_time: 1790952035.113971900 secs.nsecs elapsed_time: 369.693547442 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 761 (time 1790952417.38 total 10.01 last 76.06) - open/close 1550 (time 1790952427.38 total 20.01 last 78.89) - open/close 2378 (time 1790952437.39 total 30.02 last 82.68) - open/close 3219 (time 1790952447.40 total 40.03 last 84.06) - open/close 4034 (time 1790952457.40 total 50.03 last 81.48) - open/close 4887 (time 1790952467.41 total 60.04 last 85.19) - open/close 5660 (time 1790952477.41 total 70.04 last 77.30) - open/close 6386 (time 1790952487.42 total 80.05 last 72.54) - open/close 6927 (time 1790952497.43 total 90.06 last 54.03) - open/close 7464 (time 1790952507.44 total 100.07 last 53.65) - open/close 8014 (time 1790952517.46 total 110.09 last 54.88) - open/close 8663 (time 1790952527.46 total 120.09 last 64.89) - open/close 9390 (time 1790952537.47 total 130.10 last 72.66) total: 10000 open/close in 138.94 seconds: 71.97 ops/second llite.lustre-ffff8e3ed1241800.statahead_batch_max=0 llite.lustre-ffff8e3ed1241800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.588s user 0m0.298s sys 0m14.154s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e3ed1241800.statahead_batch_max=256 llite.lustre-ffff8e3ed1241800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m6.067s user 0m0.267s sys 0m14.066s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8e3ed1241800.batch_stats= snapshot_time: 1790952695.047709120 secs.nsecs start_time: 1790952617.667032156 secs.nsecs elapsed_time: 77.380676964 secs.nsecs subreqs per batch batches %% cum %% 1: 84 42 42 2: 22 11 54 4: 16 8 62 8: 9 4 66 16: 8 4 70 32: 15 7 78 64: 4 2 80 128: 2 1 81 256: 36 18 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8e3ed1241800.statahead_batch_max=64 llite.lustre-ffff8e3ed1241800.statahead_max=128