Some employers will not hire you if you have a non-compete that might impact your work for them. It's never been an issue for me, I've only read stories online. But I have been asked while applying for a job whether I have any non-competes.
It's a risk for you. Even if unlikely, there's a non-zero chance that it could screw up your career and hurt you badly. That risk has very real value attached to it. Just like insurance and out-of-money options have real value to them.