I would uninstall the homebrew Python versions and instead install pyenv [1], via homebrew, and then install whatever Python versions you want. They will run happily side-by-side.
Well-organized virtual environments AND python versions. Simply amazing!
"brew install pyenv-virtualenv" has me up and running with everything I ever wanted in one line