== sanity test 123ad: Verify batching statahead works correctly ========================================================== 19:08:57 (1786316937) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats=0 llite.lustre-ffff955e914f3800.statahead_max=32 llite.lustre-ffff955e914f3800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats=0 total: 100 open/close in 3.14 seconds: 31.80 ops/second llite.lustre-ffff955e914f3800.statahead_max=0 101 real 0m3.296s user 0m0.006s sys 0m0.409s 'ls -l' 100 files without statahead: 3 sec llite.lustre-ffff955e914f3800.statahead_max=32 llite.lustre-ffff955e914f3800.statahead_max=32 101 real 0m1.081s user 0m0.009s sys 0m0.195s 'ls -l' 100 files with statahead: 1 sec statahead total: 119 statahead wrong: 2 agl total: 113 list_total: 30 fname_total: 84 hit_total: 4307 miss_total: 1288 swrong=2 ewrong=2 - open/close 711 (time 1786316966.18 total 10.01 last 71.04) total: 900 open/close in 12.63 seconds: 71.27 ops/second llite.lustre-ffff955e914f3800.statahead_max=0 1001 real 0m17.276s user 0m0.034s sys 0m3.241s 'ls -l' 1000 files without statahead: 17 sec llite.lustre-ffff955e914f3800.statahead_max=32 llite.lustre-ffff955e914f3800.statahead_max=32 1001 real 0m9.699s user 0m0.031s sys 0m1.586s 'ls -l' 1000 files with statahead: 10 sec statahead total: 120 statahead wrong: 2 agl total: 114 list_total: 31 fname_total: 84 hit_total: 5306 miss_total: 1289 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 21 seconds llite.lustre-ffff955e914f3800.statahead_stats= statahead total: 120 statahead wrong: 2 agl total: 114 list_total: 31 fname_total: 84 hit_total: 5306 miss_total: 1289 mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats= snapshot_time: 1786317031.133047199 secs.nsecs start_time: 1786316941.719853165 secs.nsecs elapsed_time: 89.413194034 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 871 (time 1786317043.31 total 10.01 last 87.05) - open/close 1741 (time 1786317053.31 total 20.01 last 86.94) - open/close 2493 (time 1786317063.33 total 30.03 last 75.10) - open/close 3258 (time 1786317073.33 total 40.03 last 76.45) - open/close 4088 (time 1786317083.34 total 50.04 last 82.93) - open/close 4937 (time 1786317093.35 total 60.05 last 84.79) - open/close 5780 (time 1786317103.36 total 70.06 last 84.28) - open/close 6418 (time 1786317113.36 total 80.06 last 63.76) - open/close 7119 (time 1786317123.37 total 90.07 last 70.05) - open/close 7893 (time 1786317133.37 total 100.08 last 77.36) - open/close 8706 (time 1786317143.38 total 110.09 last 81.22) - open/close 9474 (time 1786317153.39 total 120.09 last 76.77) total: 10000 open/close in 126.54 seconds: 79.02 ops/second llite.lustre-ffff955e914f3800.statahead_batch_max=0 llite.lustre-ffff955e914f3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff955e914f3800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m4.620s user 0m0.363s sys 0m16.612s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff955e914f3800.statahead_batch_max=32 llite.lustre-ffff955e914f3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff955e914f3800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m47.025s user 0m0.311s sys 0m15.325s batched statahead RPC= hit count=9984 mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats= snapshot_time: 1786317355.502669616 secs.nsecs start_time: 1786317235.064288552 secs.nsecs elapsed_time: 120.438381064 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats=0 llite.lustre-ffff955e914f3800.statahead_max=2048 llite.lustre-ffff955e914f3800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats=0 total: 100 open/close in 2.90 seconds: 34.50 ops/second llite.lustre-ffff955e914f3800.statahead_max=0 101 real 0m1.977s user 0m0.009s sys 0m0.301s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff955e914f3800.statahead_max=2048 llite.lustre-ffff955e914f3800.statahead_max=2048 101 real 0m1.071s user 0m0.006s sys 0m0.187s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10083 miss_total: 17 swrong=0 ewrong=0 - open/close 851 (time 1786317661.78 total 10.01 last 85.03) total: 900 open/close in 10.67 seconds: 84.34 ops/second llite.lustre-ffff955e914f3800.statahead_max=0 1001 real 0m22.642s user 0m0.043s sys 0m3.466s 'ls -l' 1000 files without statahead: 23 sec llite.lustre-ffff955e914f3800.statahead_max=2048 llite.lustre-ffff955e914f3800.statahead_max=2048 1001 real 0m7.332s user 0m0.021s sys 0m1.605s 'ls -l' 1000 files with statahead: 7 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff955e914f3800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11082 miss_total: 18 mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats= snapshot_time: 1786317725.765310043 secs.nsecs start_time: 1786317358.600045813 secs.nsecs elapsed_time: 367.165264230 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 729 (time 1786317738.99 total 10.02 last 72.78) - open/close 1490 (time 1786317749.00 total 20.02 last 76.06) - open/close 2002 (time 1786317759.00 total 30.02 last 51.20) - open/close 2723 (time 1786317769.01 total 40.03 last 72.03) - open/close 3412 (time 1786317779.01 total 50.04 last 68.88) - open/close 4132 (time 1786317789.02 total 60.05 last 71.90) - open/close 4893 (time 1786317799.03 total 70.05 last 76.08) - open/close 5654 (time 1786317809.03 total 80.05 last 76.09) - open/close 6341 (time 1786317819.04 total 90.06 last 68.63) - open/close 7155 (time 1786317829.04 total 100.07 last 81.37) - open/close 7860 (time 1786317839.05 total 110.07 last 70.44) - open/close 8833 (time 1786317849.06 total 120.08 last 97.20) - open/close 9732 (time 1786317859.08 total 130.10 last 89.73) total: 10000 open/close in 133.15 seconds: 75.10 ops/second llite.lustre-ffff955e914f3800.statahead_batch_max=0 llite.lustre-ffff955e914f3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff955e914f3800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m12.247s user 0m0.309s sys 0m16.140s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff955e914f3800.statahead_batch_max=256 llite.lustre-ffff955e914f3800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff955e914f3800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m57.497s user 0m0.311s sys 0m15.123s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff955e914f3800.batch_stats= snapshot_time: 1786318017.577554379 secs.nsecs start_time: 1786317944.549362990 secs.nsecs elapsed_time: 73.028191389 secs.nsecs subreqs per batch batches %% cum %% 1: 125 43 43 2: 38 13 56 4: 37 12 68 8: 22 7 76 16: 12 4 80 32: 14 4 85 64: 8 2 88 128: 0 0 88 256: 34 11 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff955e914f3800.statahead_batch_max=64 llite.lustre-ffff955e914f3800.statahead_max=128