Non competes are becoming less and less enforceable in the US.
I left my old company and wanted to start a competing business in a different vertical in the e-commerce space. What actually stopped me was the privacy and inventions and non disclosure agreements.
Pretty much it prevented me from using any know how I learned while at my last company and disallowed me from using any of the same suppliers and marketplaces to buy and sell on (of which there are few in my business domain).
In my experience, these types of agreements can be the actual thing that stops you from doing your own thing.