== sanity test 123ad: Verify batching statahead works correctly ========================================================== 12:06:26 (1788365186) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats=0 llite.lustre-ffff8f5c52359000.statahead_max=32 llite.lustre-ffff8f5c52359000.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats=0 total: 100 open/close in 0.65 seconds: 154.65 ops/second llite.lustre-ffff8f5c52359000.statahead_max=0 101 real 0m0.599s user 0m0.002s sys 0m0.243s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8f5c52359000.statahead_max=32 llite.lustre-ffff8f5c52359000.statahead_max=32 101 real 0m0.453s user 0m0.003s sys 0m0.268s 'ls -l' 100 files with statahead: 1 sec statahead total: 108 statahead wrong: 2 agl total: 100 list_total: 28 fname_total: 65 hit_total: 14543 miss_total: 1258 swrong=2 ewrong=2 total: 900 open/close in 1.86 seconds: 484.01 ops/second llite.lustre-ffff8f5c52359000.statahead_max=0 1001 real 0m5.325s user 0m0.020s sys 0m2.114s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8f5c52359000.statahead_max=32 llite.lustre-ffff8f5c52359000.statahead_max=32 1001 real 0m4.331s user 0m0.013s sys 0m2.571s 'ls -l' 1000 files with statahead: 4 sec statahead total: 109 statahead wrong: 2 agl total: 101 list_total: 29 fname_total: 65 hit_total: 15542 miss_total: 1259 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 7 seconds llite.lustre-ffff8f5c52359000.statahead_stats= statahead total: 109 statahead wrong: 2 agl total: 101 list_total: 29 fname_total: 65 hit_total: 15542 miss_total: 1259 mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats= snapshot_time: 1788365212.877674159 secs.nsecs start_time: 1788365187.789973923 secs.nsecs elapsed_time: 25.087700236 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 1 2 5 8: 2 5 10 16: 2 5 15 32: 34 85 100 - open/close 4694 (time 1788365223.71 total 10.00 last 469.33) - open/close 9318 (time 1788365233.71 total 20.00 last 462.40) total: 10000 open/close in 21.63 seconds: 462.37 ops/second llite.lustre-ffff8f5c52359000.statahead_batch_max=0 llite.lustre-ffff8f5c52359000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5c52359000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m33.041s user 0m0.165s sys 0m30.208s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f5c52359000.statahead_batch_max=32 llite.lustre-ffff8f5c52359000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5c52359000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m38.508s user 0m0.170s sys 0m22.370s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats= snapshot_time: 1788365315.644980978 secs.nsecs start_time: 1788365271.378507122 secs.nsecs elapsed_time: 44.266473856 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 312 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats=0 llite.lustre-ffff8f5c52359000.statahead_max=2048 llite.lustre-ffff8f5c52359000.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats=0 total: 100 open/close in 0.72 seconds: 138.76 ops/second llite.lustre-ffff8f5c52359000.statahead_max=0 101 real 0m0.976s user 0m0.006s sys 0m0.276s 'ls -l' 100 files without statahead: 1 sec llite.lustre-ffff8f5c52359000.statahead_max=2048 llite.lustre-ffff8f5c52359000.statahead_max=2048 101 real 0m0.415s user 0m0.003s sys 0m0.242s 'ls -l' 100 files with statahead: 0 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10098 miss_total: 2 swrong=0 ewrong=0 total: 900 open/close in 1.98 seconds: 453.73 ops/second llite.lustre-ffff8f5c52359000.statahead_max=0 1001 real 0m5.996s user 0m0.019s sys 0m2.347s 'ls -l' 1000 files without statahead: 6 sec llite.lustre-ffff8f5c52359000.statahead_max=2048 llite.lustre-ffff8f5c52359000.statahead_max=2048 1001 real 0m4.570s user 0m0.015s sys 0m1.669s 'ls -l' 1000 files with statahead: 4 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 6 seconds llite.lustre-ffff8f5c52359000.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11097 miss_total: 3 mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats= snapshot_time: 1788365429.105780175 secs.nsecs start_time: 1788365316.478954742 secs.nsecs elapsed_time: 112.626825433 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 2 20 40 32: 1 10 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 2637 (time 1788365440.60 total 10.01 last 263.50) - open/close 3299 (time 1788365450.61 total 20.02 last 66.10) - open/close 4243 (time 1788365460.62 total 30.03 last 94.29) - open/close 5195 (time 1788365470.63 total 40.04 last 95.12) - open/close 6122 (time 1788365480.64 total 50.05 last 92.61) - open/close 7332 (time 1788365490.64 total 60.06 last 120.96) - open/close 8749 (time 1788365500.65 total 70.06 last 141.64) total: 10000 open/close in 79.03 seconds: 126.54 ops/second llite.lustre-ffff8f5c52359000.statahead_batch_max=0 llite.lustre-ffff8f5c52359000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5c52359000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m34.621s user 0m0.273s sys 0m27.428s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8f5c52359000.statahead_batch_max=256 llite.lustre-ffff8f5c52359000.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8f5c52359000.stats=clear ls -l files in d123ad.sanity: 10001 real 0m31.409s user 0m0.233s sys 0m21.629s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8f5c52359000.batch_stats= snapshot_time: 1788365585.523817099 secs.nsecs start_time: 1788365548.440140015 secs.nsecs elapsed_time: 37.083677084 secs.nsecs subreqs per batch batches %% cum %% 1: 326 60 60 2: 80 14 75 4: 60 11 86 8: 7 1 88 16: 9 1 89 32: 20 3 93 64: 1 0 93 128: 0 0 93 256: 34 6 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8f5c52359000.statahead_batch_max=64 llite.lustre-ffff8f5c52359000.statahead_max=128