== sanity test 123ad: Verify batching statahead works correctly ========================================================== 14:17:20 (1788545840) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats=0 llite.lustre-ffff957543633800.statahead_max=32 llite.lustre-ffff957543633800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats=0 total: 100 open/close in 2.70 seconds: 37.05 ops/second llite.lustre-ffff957543633800.statahead_max=0 101 real 0m2.643s user 0m0.005s sys 0m0.314s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff957543633800.statahead_max=32 llite.lustre-ffff957543633800.statahead_max=32 101 real 0m1.234s user 0m0.004s sys 0m0.155s 'ls -l' 100 files with statahead: 1 sec statahead total: 131 statahead wrong: 2 agl total: 125 list_total: 30 fname_total: 77 hit_total: 3673 miss_total: 1498 swrong=2 ewrong=2 - open/close 638 (time 1788545869.29 total 10.01 last 63.75) total: 900 open/close in 14.43 seconds: 62.36 ops/second llite.lustre-ffff957543633800.statahead_max=0 1001 real 0m23.436s user 0m0.034s sys 0m2.999s 'ls -l' 1000 files without statahead: 24 sec llite.lustre-ffff957543633800.statahead_max=32 llite.lustre-ffff957543633800.statahead_max=32 1001 real 0m11.495s user 0m0.042s sys 0m1.415s 'ls -l' 1000 files with statahead: 12 sec statahead total: 132 statahead wrong: 2 agl total: 126 list_total: 31 fname_total: 77 hit_total: 4671 miss_total: 1500 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 23 seconds llite.lustre-ffff957543633800.statahead_stats= statahead total: 132 statahead wrong: 2 agl total: 126 list_total: 31 fname_total: 77 hit_total: 4671 miss_total: 1500 mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats= snapshot_time: 1788545945.572295777 secs.nsecs start_time: 1788545845.616012476 secs.nsecs elapsed_time: 99.956283301 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 2 5 10 16: 2 5 15 32: 34 85 100 - open/close 717 (time 1788545958.54 total 10.01 last 71.66) - open/close 1360 (time 1788545968.54 total 20.01 last 64.27) - open/close 2061 (time 1788545978.57 total 30.04 last 69.90) - open/close 2790 (time 1788545988.58 total 40.05 last 72.83) - open/close 3482 (time 1788545998.58 total 50.05 last 69.18) - open/close 4245 (time 1788546008.60 total 60.07 last 76.16) - open/close 5031 (time 1788546018.61 total 70.08 last 78.51) - open/close 5738 (time 1788546028.62 total 80.08 last 70.68) - open/close 6449 (time 1788546038.63 total 90.10 last 71.00) - open/close 7159 (time 1788546048.63 total 100.10 last 71.00) - open/close 7869 (time 1788546058.64 total 110.11 last 70.95) - open/close 8599 (time 1788546068.66 total 120.13 last 72.82) - open/close 9278 (time 1788546078.67 total 130.13 last 67.89) - open/close 9790 (time 1788546088.70 total 140.17 last 51.02) total: 10000 open/close in 143.27 seconds: 69.80 ops/second llite.lustre-ffff957543633800.statahead_batch_max=0 llite.lustre-ffff957543633800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff957543633800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m2.151s user 0m0.298s sys 0m13.993s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff957543633800.statahead_batch_max=32 llite.lustre-ffff957543633800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff957543633800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m58.585s user 0m0.321s sys 0m13.331s batched statahead RPC= hit count=9974 mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats= snapshot_time: 1788546294.482461312 secs.nsecs start_time: 1788546164.648358584 secs.nsecs elapsed_time: 129.834102728 secs.nsecs subreqs per batch batches %% cum %% 1: 1 0 0 2: 0 0 0 4: 0 0 0 8: 2 0 0 16: 1 0 1 32: 313 98 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats=0 llite.lustre-ffff957543633800.statahead_max=2048 llite.lustre-ffff957543633800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats=0 total: 100 open/close in 2.59 seconds: 38.65 ops/second llite.lustre-ffff957543633800.statahead_max=0 101 real 0m2.839s user 0m0.003s sys 0m0.329s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff957543633800.statahead_max=2048 llite.lustre-ffff957543633800.statahead_max=2048 101 real 0m1.215s user 0m0.005s sys 0m0.187s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10073 miss_total: 27 swrong=0 ewrong=0 - open/close 559 (time 1788546622.33 total 10.01 last 55.85) total: 900 open/close in 15.88 seconds: 56.69 ops/second llite.lustre-ffff957543633800.statahead_max=0 1001 real 0m26.043s user 0m0.041s sys 0m2.976s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff957543633800.statahead_max=2048 llite.lustre-ffff957543633800.statahead_max=2048 1001 real 0m6.562s user 0m0.023s sys 0m1.257s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11072 miss_total: 28 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff957543633800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11072 miss_total: 28 mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats= snapshot_time: 1788546695.082815007 secs.nsecs start_time: 1788546296.937901842 secs.nsecs elapsed_time: 398.144913165 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 22 22 16: 1 11 33 32: 1 11 44 64: 0 0 44 128: 1 11 55 256: 4 44 100 - open/close 730 (time 1788546707.50 total 10.01 last 72.94) - open/close 1442 (time 1788546717.51 total 20.01 last 71.18) - open/close 2066 (time 1788546727.52 total 30.02 last 62.33) - open/close 2641 (time 1788546737.55 total 40.05 last 57.35) - open/close 3167 (time 1788546747.56 total 50.06 last 52.54) - open/close 3867 (time 1788546757.56 total 60.06 last 69.98) - open/close 4580 (time 1788546767.57 total 70.07 last 71.23) - open/close 5248 (time 1788546777.58 total 80.08 last 66.76) - open/close 5956 (time 1788546787.58 total 90.08 last 70.79) - open/close 6665 (time 1788546797.58 total 100.09 last 70.86) - open/close 7411 (time 1788546807.59 total 110.09 last 74.58) - open/close 8076 (time 1788546817.59 total 120.10 last 66.44) - open/close 8807 (time 1788546827.60 total 130.10 last 73.09) - open/close 9499 (time 1788546837.61 total 140.11 last 69.13) total: 10000 open/close in 146.98 seconds: 68.04 ops/second llite.lustre-ffff957543633800.statahead_batch_max=0 llite.lustre-ffff957543633800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff957543633800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m56.498s user 0m0.321s sys 0m14.654s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff957543633800.statahead_batch_max=256 llite.lustre-ffff957543633800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff957543633800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m48.052s user 0m0.300s sys 0m15.360s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff957543633800.batch_stats= snapshot_time: 1788546967.377740553 secs.nsecs start_time: 1788546908.903835595 secs.nsecs elapsed_time: 58.473904958 secs.nsecs subreqs per batch batches %% cum %% 1: 123 46 46 2: 35 13 59 4: 19 7 66 8: 21 7 74 16: 14 5 80 32: 11 4 84 64: 6 2 86 128: 1 0 86 256: 35 13 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff957543633800.statahead_batch_max=64 llite.lustre-ffff957543633800.statahead_max=128