The Scriptures are clear that we are to grow. We are to add to our faith the qualities of goodness, knowledge, self-control, perseverance, godliness, brotherly kindness, and love (2 Peter 1). Elsewhere, Paul instructs that while we were children we acted like children, but at some point we will be expected to grow up spiritually. However, we must be sure that the original product, the foundation of the building we are constructing, is Faith in Jesus Christ. Paul once said (in 1 Cor. 2:2) that he decided for a time to forget everything but Jesus Christ. Why? Because ultimately that is all that can or will matter. Furthermore, it is sometimes necessary to lay aside all that we build up (not destroy, not leave behind, not forget, but lay aside), so that the essence of who we are, the Faith that we are built upon, can shine with the light of Heaven into our situation.
"Add to your faith..." Just make sure that you are starting there, and not somewhere else.