The standard for holding a belief isn't "can you prove it is not so?", but "on the balance of evidence, is it likely to be so?".
If you believe everything you can't disprove, you'll hold an awful lot of bizarre and contradictory beliefs.
In the past I have spent some time believing some things simply because I couldn't disprove them, it is not good for the soul.