Changing our mind

Society seem to make a big deal when people change their mind. Scripture tells us of non-believers who became believers and God was glorified. So what's wrong with changing our mind? Amen.