== sanity test 123ad: Verify batching statahead works correctly ========================================================== 08:31:58 (1786105918) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats=0 llite.lustre-ffff984d032b6000.statahead_max=32 llite.lustre-ffff984d032b6000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats=0 total: 100 open/close in 2.71 seconds: 36.96 ops/second llite.lustre-ffff984d032b6000.statahead_max=0 101 real 0m2.122s user 0m0.004s sys 0m0.343s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff984d032b6000.statahead_max=32 llite.lustre-ffff984d032b6000.statahead_max=32 101 real 0m1.082s user 0m0.006s sys 0m0.172s 'ls -l' 100 files with statahead: 1 sec statahead total: 125 statahead wrong: 2 agl total: 120 list_total: 29 fname_total: 95 hit_total: 3979 miss_total: 1129 swrong=2 ewrong=2 - open/close 874 (time 1786105944.69 total 10.01 last 87.29) total: 900 open/close in 10.41 seconds: 86.43 ops/second llite.lustre-ffff984d032b6000.statahead_max=0 1001 real 0m21.188s user 0m0.028s sys 0m3.113s 'ls -l' 1000 files without statahead: 21 sec llite.lustre-ffff984d032b6000.statahead_max=32 llite.lustre-ffff984d032b6000.statahead_max=32 1001 real 0m8.695s user 0m0.030s sys 0m1.577s 'ls -l' 1000 files with statahead: 9 sec statahead total: 126 statahead wrong: 2 agl total: 121 list_total: 30 fname_total: 95 hit_total: 4975 miss_total: 1133 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 22 seconds llite.lustre-ffff984d032b6000.statahead_stats= statahead total: 126 statahead wrong: 2 agl total: 121 list_total: 30 fname_total: 95 hit_total: 4975 miss_total: 1133 mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats= snapshot_time: 1786106008.386536766 secs.nsecs start_time: 1786105923.653532956 secs.nsecs elapsed_time: 84.733003810 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 784 (time 1786106020.75 total 10.00 last 78.39) - open/close 1649 (time 1786106030.76 total 20.01 last 86.42) - open/close 2480 (time 1786106040.77 total 30.02 last 83.03) - open/close 3367 (time 1786106050.77 total 40.02 last 88.68) - open/close 4081 (time 1786106060.78 total 50.03 last 71.37) - open/close 4801 (time 1786106070.78 total 60.03 last 71.98) - open/close 5512 (time 1786106080.79 total 70.04 last 71.05) - open/close 6278 (time 1786106090.79 total 80.05 last 76.53) - open/close 6870 (time 1786106100.81 total 90.06 last 59.13) - open/close 7662 (time 1786106110.82 total 100.07 last 79.12) - open/close 8389 (time 1786106120.83 total 110.08 last 72.63) - open/close 9075 (time 1786106130.84 total 120.09 last 68.52) - open/close 9785 (time 1786106140.85 total 130.10 last 70.95) total: 10000 open/close in 133.03 seconds: 75.17 ops/second llite.lustre-ffff984d032b6000.statahead_batch_max=0 llite.lustre-ffff984d032b6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff984d032b6000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m58.577s user 0m0.300s sys 0m17.056s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff984d032b6000.statahead_batch_max=32 llite.lustre-ffff984d032b6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff984d032b6000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m38.313s user 0m0.263s sys 0m15.732s batched statahead RPC= hit count=9983 mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats= snapshot_time: 1786106325.631965758 secs.nsecs start_time: 1786106211.490606658 secs.nsecs elapsed_time: 114.141359100 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 0 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats=0 llite.lustre-ffff984d032b6000.statahead_max=2048 llite.lustre-ffff984d032b6000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats=0 total: 100 open/close in 2.85 seconds: 35.07 ops/second llite.lustre-ffff984d032b6000.statahead_max=0 101 real 0m2.704s user 0m0.006s sys 0m0.325s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff984d032b6000.statahead_max=2048 llite.lustre-ffff984d032b6000.statahead_max=2048 101 real 0m0.862s user 0m0.006s sys 0m0.196s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10082 miss_total: 18 swrong=0 ewrong=0 - open/close 765 (time 1786106645.25 total 10.00 last 76.50) total: 900 open/close in 12.33 seconds: 72.97 ops/second llite.lustre-ffff984d032b6000.statahead_max=0 1001 real 0m22.036s user 0m0.030s sys 0m3.122s 'ls -l' 1000 files without statahead: 22 sec llite.lustre-ffff984d032b6000.statahead_max=2048 llite.lustre-ffff984d032b6000.statahead_max=2048 1001 real 0m6.291s user 0m0.022s sys 0m1.479s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff984d032b6000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11081 miss_total: 19 mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats= snapshot_time: 1786106709.617893323 secs.nsecs start_time: 1786106328.022629346 secs.nsecs elapsed_time: 381.595263977 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 18 18 16: 2 18 36 32: 2 18 54 64: 0 0 54 128: 1 9 63 256: 4 36 100 - open/close 736 (time 1786106722.52 total 10.00 last 73.58) - open/close 1364 (time 1786106732.53 total 20.01 last 62.78) - open/close 2145 (time 1786106742.54 total 30.02 last 77.96) - open/close 2956 (time 1786106752.55 total 40.03 last 81.07) - open/close 3705 (time 1786106762.55 total 50.03 last 74.90) - open/close 4348 (time 1786106772.56 total 60.04 last 64.25) - open/close 5000 (time 1786106782.56 total 70.04 last 65.20) - open/close 5662 (time 1786106792.57 total 80.05 last 66.13) - open/close 6276 (time 1786106802.57 total 90.05 last 61.39) - open/close 6994 (time 1786106812.57 total 100.05 last 71.78) - open/close 7776 (time 1786106822.60 total 110.07 last 78.01) - open/close 8687 (time 1786106832.60 total 120.08 last 91.09) - open/close 9565 (time 1786106842.61 total 130.09 last 87.67) total: 10000 open/close in 135.22 seconds: 73.95 ops/second llite.lustre-ffff984d032b6000.statahead_batch_max=0 llite.lustre-ffff984d032b6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff984d032b6000.stats=clear ls -l files in d123ad.sanity: 10001 real 1m5.008s user 0m0.284s sys 0m15.867s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff984d032b6000.statahead_batch_max=256 llite.lustre-ffff984d032b6000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff984d032b6000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m49.868s user 0m0.279s sys 0m16.604s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff984d032b6000.batch_stats= snapshot_time: 1786106986.350195836 secs.nsecs start_time: 1786106922.272492627 secs.nsecs elapsed_time: 64.077703209 secs.nsecs subreqs per batch batches %% cum %% 1: 257 60 60 2: 54 12 73 4: 35 8 81 8: 13 3 84 16: 10 2 86 32: 16 3 90 64: 6 1 92 128: 0 0 92 256: 34 8 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff984d032b6000.statahead_batch_max=64 llite.lustre-ffff984d032b6000.statahead_max=128