== sanity test 123ad: Verify batching statahead works correctly ========================================================== 23:33:40 (1788752020) batch: statahead_max=32 statahead_batch_max=32 mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats=0 llite.lustre-ffff8a28bd55f800.statahead_max=32 llite.lustre-ffff8a28bd55f800.statahead_batch_max=32 seq.cli-lustre-OST0000-super.width=0x1ffffff seq.cli-lustre-OST0001-super.width=0x1ffffff kvm mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats=0 total: 100 open/close in 2.32 seconds: 43.19 ops/second llite.lustre-ffff8a28bd55f800.statahead_max=0 101 real 0m1.889s user 0m0.006s sys 0m0.300s 'ls -l' 100 files without statahead: 2 sec llite.lustre-ffff8a28bd55f800.statahead_max=32 llite.lustre-ffff8a28bd55f800.statahead_max=32 101 real 0m0.720s user 0m0.002s sys 0m0.157s 'ls -l' 100 files with statahead: 1 sec statahead total: 135 statahead wrong: 2 agl total: 128 list_total: 29 fname_total: 91 hit_total: 3895 miss_total: 1331 swrong=2 ewrong=2 total: 900 open/close in 9.88 seconds: 91.10 ops/second llite.lustre-ffff8a28bd55f800.statahead_max=0 1001 real 0m17.497s user 0m0.034s sys 0m2.808s 'ls -l' 1000 files without statahead: 18 sec llite.lustre-ffff8a28bd55f800.statahead_max=32 llite.lustre-ffff8a28bd55f800.statahead_max=32 1001 real 0m7.315s user 0m0.021s sys 0m1.473s 'ls -l' 1000 files with statahead: 8 sec statahead total: 136 statahead wrong: 2 agl total: 129 list_total: 30 fname_total: 91 hit_total: 4893 miss_total: 1333 swrong=2 ewrong=2 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 14 seconds llite.lustre-ffff8a28bd55f800.statahead_stats= statahead total: 136 statahead wrong: 2 agl total: 129 list_total: 30 fname_total: 91 hit_total: 4893 miss_total: 1333 mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats= snapshot_time: 1788752090.853952275 secs.nsecs start_time: 1788752023.700765941 secs.nsecs elapsed_time: 67.153186334 secs.nsecs subreqs per batch batches %% cum %% 1: 1 2 2 2: 0 0 2 4: 0 0 2 8: 3 7 10 16: 2 5 15 32: 34 85 100 - open/close 902 (time 1788752102.47 total 10.01 last 90.15) - open/close 1835 (time 1788752112.47 total 20.01 last 93.24) - open/close 2789 (time 1788752122.48 total 30.02 last 95.35) - open/close 3708 (time 1788752132.48 total 40.02 last 91.86) - open/close 4636 (time 1788752142.49 total 50.03 last 92.72) - open/close 5569 (time 1788752152.50 total 60.04 last 93.23) - open/close 6491 (time 1788752162.51 total 70.05 last 92.09) - open/close 7332 (time 1788752172.52 total 80.06 last 84.06) - open/close 8232 (time 1788752182.52 total 90.06 last 89.93) - open/close 9121 (time 1788752192.53 total 100.07 last 88.88) total: 10000 open/close in 109.52 seconds: 91.30 ops/second llite.lustre-ffff8a28bd55f800.statahead_batch_max=0 llite.lustre-ffff8a28bd55f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m44.990s user 0m0.289s sys 0m17.365s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a28bd55f800.statahead_batch_max=32 llite.lustre-ffff8a28bd55f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m9.309s user 0m0.286s sys 0m14.333s batched statahead RPC= hit count=9988 mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats= snapshot_time: 1788752331.557827600 secs.nsecs start_time: 1788752253.262738861 secs.nsecs elapsed_time: 78.295088739 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 1 0 0 16: 1 0 0 32: 313 99 100 batch: statahead_max=2048 statahead_batch_max=256 mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats=0 llite.lustre-ffff8a28bd55f800.statahead_max=2048 llite.lustre-ffff8a28bd55f800.statahead_batch_max=256 kvm mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats=0 total: 100 open/close in 5.41 seconds: 18.49 ops/second llite.lustre-ffff8a28bd55f800.statahead_max=0 101 real 0m4.048s user 0m0.007s sys 0m0.329s 'ls -l' 100 files without statahead: 4 sec llite.lustre-ffff8a28bd55f800.statahead_max=2048 llite.lustre-ffff8a28bd55f800.statahead_max=2048 101 real 0m1.136s user 0m0.007s sys 0m0.155s 'ls -l' 100 files with statahead: 1 sec statahead total: 2 statahead wrong: 0 agl total: 2 list_total: 2 fname_total: 0 hit_total: 10087 miss_total: 13 swrong=0 ewrong=0 - open/close 643 (time 1788752617.56 total 10.01 last 64.25) total: 900 open/close in 13.05 seconds: 68.96 ops/second llite.lustre-ffff8a28bd55f800.statahead_max=0 1001 real 0m26.304s user 0m0.040s sys 0m2.967s 'ls -l' 1000 files without statahead: 26 sec llite.lustre-ffff8a28bd55f800.statahead_max=2048 llite.lustre-ffff8a28bd55f800.statahead_max=2048 1001 real 0m6.589s user 0m0.033s sys 0m1.342s 'ls -l' 1000 files with statahead: 6 sec statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 swrong=0 ewrong=0 'ls -l' done unlink + rm -r /mnt/lustre/d123ad.sanity: 20 seconds llite.lustre-ffff8a28bd55f800.statahead_stats= statahead total: 3 statahead wrong: 0 agl total: 3 list_total: 3 fname_total: 0 hit_total: 11086 miss_total: 14 mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats= snapshot_time: 1788752685.108928823 secs.nsecs start_time: 1788752333.406622927 secs.nsecs elapsed_time: 351.702305896 secs.nsecs subreqs per batch batches %% cum %% 1: 0 0 0 2: 0 0 0 4: 0 0 0 8: 2 20 20 16: 1 10 30 32: 2 20 50 64: 0 0 50 128: 1 10 60 256: 4 40 100 - open/close 738 (time 1788752697.70 total 10.01 last 73.71) - open/close 1392 (time 1788752707.70 total 20.02 last 65.36) - open/close 2060 (time 1788752717.72 total 30.04 last 66.66) - open/close 2752 (time 1788752727.73 total 40.05 last 69.15) - open/close 3470 (time 1788752737.73 total 50.05 last 71.78) - open/close 4176 (time 1788752747.74 total 60.06 last 70.53) - open/close 4866 (time 1788752757.75 total 70.07 last 68.94) - open/close 5546 (time 1788752767.75 total 80.07 last 68.00) - open/close 6213 (time 1788752777.76 total 90.08 last 66.62) - open/close 6905 (time 1788752787.77 total 100.08 last 69.19) - open/close 7611 (time 1788752797.77 total 110.09 last 70.57) - open/close 8335 (time 1788752807.78 total 120.10 last 72.34) - open/close 9002 (time 1788752817.78 total 130.10 last 66.67) - open/close 9667 (time 1788752827.79 total 140.11 last 66.46) total: 10000 open/close in 144.68 seconds: 69.12 ops/second llite.lustre-ffff8a28bd55f800.statahead_batch_max=0 llite.lustre-ffff8a28bd55f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.stats=clear ls -l files in d123ad.sanity: 10001 real 1m0.088s user 0m0.360s sys 0m15.490s unbatched statahead RPC=10004 hit count=9999 llite.lustre-ffff8a28bd55f800.statahead_batch_max=256 llite.lustre-ffff8a28bd55f800.statahead_stats=clear mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats=clear mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.stats=clear ls -l files in d123ad.sanity: 10001 real 0m51.039s user 0m0.334s sys 0m15.521s batched statahead RPC= hit count=9999 mdc.lustre-MDT0000-mdc-ffff8a28bd55f800.batch_stats= snapshot_time: 1788752964.525815395 secs.nsecs start_time: 1788752901.746658959 secs.nsecs elapsed_time: 62.779156436 secs.nsecs subreqs per batch batches %% cum %% 1: 170 52 52 2: 33 10 62 4: 26 7 70 8: 29 8 79 16: 12 3 82 32: 18 5 88 64: 3 0 89 128: 1 0 89 256: 34 10 100 unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second unlink(/mnt/lustre/d123ad.sanity/f123ad.sanity0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second seq.cli-lustre-OST0000-super.width=65536 seq.cli-lustre-OST0001-super.width=65536 llite.lustre-ffff8a28bd55f800.statahead_batch_max=64 llite.lustre-ffff8a28bd55f800.statahead_max=128