== sanity test 123ad: Verify batching statahead works correctly ========================================================== 22:47:06 (1782614826) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats=0 llite.lustre-ffff8e7d02ac9800.statahead_max=32 llite.lustre-ffff8e7d02ac9800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats=0 total: 100 open/close in 3.63 seconds: 27.52 ops/second llite.lustre-ffff8e7d02ac9800.statahead_max=0 101 real 0m3.088s user 0m0.004s sys 0m0.331s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8e7d02ac9800.statahead_max=32 llite.lustre-ffff8e7d02ac9800.statahead_max=32 101 real 0m1.169s user 0m0.003s sys 0m0.192s 'ls -l' 100 files with statahead: 1 sec statahead total: 169 statahead wrong: 2 agl total: 162 list_total: 30 fname_total: 127 hit_total: 3843 miss_total: 1553 swrong=2 ewrong=2 - open/close 552 (time 1782614858.36 total 10.01 last 55.16) total: 900 open/close in 15.96 seconds: 56.39 ops/second llite.lustre-ffff8e7d02ac9800.statahead_max=0 1001 real 0m30.638s user 0m0.040s sys 0m3.587s 'ls -l' 1000 files without statahead: 31 sec llite.lustre-ffff8e7d02ac9800.statahead_max=32 llite.lustre-ffff8e7d02ac9800.statahead_max=32 1001 real 0m13.891s user 0m0.041s sys 0m1.604s 'ls -l' 1000 files with statahead: 14 sec statahead total: 170 statahead wrong: 2 agl total: 163 list_total: 31 fname_total: 127 hit_total: 4841 miss_total: 1555 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 31 seconds llite.lustre-ffff8e7d02ac9800.statahead_stats= statahead total: 170 statahead wrong: 2 agl total: 163 list_total: 31 fname_total: 127 hit_total: 4841 miss_total: 1555 mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats= snapshot_time: 1782614956.935337962 secs.nsecs start_time: 1782614832.221067592 secs.nsecs elapsed_time: 124.714270370 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 388 (time 1782614971.62 total 10.03 last 38.67) - open/close 889 (time 1782614981.64 total 20.06 last 49.98) - open/close 1402 (time 1782614991.65 total 30.07 last 51.24) - open/close 1959 (time 1782615001.67 total 40.09 last 55.60) - open/close 2585 (time 1782615011.68 total 50.09 last 62.58) - open/close 3106 (time 1782615021.70 total 60.12 last 51.96) - open/close 3640 (time 1782615031.72 total 70.14 last 53.28) - open/close 4166 (time 1782615041.73 total 80.15 last 52.55) - open/close 4689 (time 1782615051.75 total 90.17 last 52.21) - open/close 5258 (time 1782615061.75 total 100.17 last 56.89) - open/close 5848 (time 1782615071.76 total 110.18 last 58.96) - open/close 6434 (time 1782615081.76 total 120.18 last 58.56) - open/close 7008 (time 1782615091.77 total 130.19 last 57.34) - open/close 7565 (time 1782615101.80 total 140.22 last 55.56) - open/close 8089 (time 1782615111.80 total 150.22 last 52.38) - open/close 8665 (time 1782615121.81 total 160.23 last 57.56) - open/close 9218 (time 1782615131.81 total 170.23 last 55.30) - open/close 9724 (time 1782615141.83 total 180.24 last 50.53) total: 10000 open/close in 186.54 seconds: 53.61 ops/second llite.lustre-ffff8e7d02ac9800.statahead_batch_max=0 llite.lustre-ffff8e7d02ac9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m11.321s user 0m0.386s sys 0m17.921s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e7d02ac9800.statahead_batch_max=32 llite.lustre-ffff8e7d02ac9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.stats=clear ls -l files in d123ad.sanity: 10001 real 2m14.396s user 0m0.379s sys 0m16.503s batched statahead RPC= hit count=9982 mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats= snapshot_time: 1782615381.985858959 secs.nsecs start_time: 1782615231.524300135 secs.nsecs elapsed_time: 150.461558824 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats=0 llite.lustre-ffff8e7d02ac9800.statahead_max=2048 llite.lustre-ffff8e7d02ac9800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats=0 total: 100 open/close in 3.12 seconds: 32.05 ops/second llite.lustre-ffff8e7d02ac9800.statahead_max=0 101 real 0m2.751s user 0m0.005s sys 0m0.404s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff8e7d02ac9800.statahead_max=2048 llite.lustre-ffff8e7d02ac9800.statahead_max=2048 101 real 0m1.016s user 0m0.006s sys 0m0.175s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10081 miss_total: 19 swrong=0 ewrong=0 - open/close 546 (time 1782615785.72 total 10.01 last 54.56) total: 900 open/close in 16.22 seconds: 55.50 ops/second llite.lustre-ffff8e7d02ac9800.statahead_max=0 1001 real 0m32.678s user 0m0.041s sys 0m3.578s 'ls -l' 1000 files without statahead: 33 sec llite.lustre-ffff8e7d02ac9800.statahead_max=2048 llite.lustre-ffff8e7d02ac9800.statahead_max=2048 1001 real 0m9.675s user 0m0.033s sys 0m1.697s 'ls -l' 1000 files with statahead: 10 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 28 seconds llite.lustre-ffff8e7d02ac9800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11080 miss_total: 20 mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats= snapshot_time: 1782615877.480243132 secs.nsecs start_time: 1782615385.549070460 secs.nsecs elapsed_time: 491.931172672 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 15 15 16: 2 15 30 32: 3 23 53 64: 2 15 69 128: 0 0 69 256: 4 30 100 - open/close 515 (time 1782615890.48 total 10.00 last 51.49) - open/close 1071 (time 1782615900.49 total 20.01 last 55.55) - open/close 1624 (time 1782615910.50 total 30.02 last 55.27) - open/close 2146 (time 1782615920.51 total 40.03 last 52.15) - open/close 2685 (time 1782615930.51 total 50.03 last 53.87) - open/close 3252 (time 1782615940.52 total 60.04 last 56.65) - open/close 3807 (time 1782615950.54 total 70.06 last 55.37) - open/close 4374 (time 1782615960.55 total 80.07 last 56.66) - open/close 5020 (time 1782615970.57 total 90.09 last 64.49) - open/close 5635 (time 1782615980.58 total 100.10 last 61.41) - open/close 6212 (time 1782615990.59 total 110.11 last 57.66) - open/close 6746 (time 1782616000.60 total 120.12 last 53.34) - open/close 7349 (time 1782616010.60 total 130.12 last 60.28) - open/close 7867 (time 1782616020.62 total 140.14 last 51.71) - open/close 8473 (time 1782616030.63 total 150.15 last 60.57) - open/close 9075 (time 1782616040.64 total 160.16 last 60.14) - open/close 9647 (time 1782616050.65 total 170.17 last 57.11) total: 10000 open/close in 176.06 seconds: 56.80 ops/second llite.lustre-ffff8e7d02ac9800.statahead_batch_max=0 llite.lustre-ffff8e7d02ac9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m3.475s user 0m0.361s sys 0m18.262s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8e7d02ac9800.statahead_batch_max=256 llite.lustre-ffff8e7d02ac9800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m54.507s user 0m0.348s sys 0m17.645s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8e7d02ac9800.batch_stats= snapshot_time: 1782616197.739947422 secs.nsecs start_time: 1782616129.982794827 secs.nsecs elapsed_time: 67.757152595 secs.nsecs subreqs per batch batches %% cum %% 1: 273 58 58 2: 76 16 74 4: 31 6 80 8: 25 5 86 16: 15 3 89 32: 13 2 92 64: 2 0 92 128: 1 0 92 256: 34 7 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8e7d02ac9800.statahead_batch_max=64 llite.lustre-ffff8e7d02ac9800.statahead_max=128