There is a huge difference between contributing to open source and delivering business value where you have to deal with stakeholders, work with a known set of requirements and deal with organizational and time constraints
So if you're "just" volunteering and don't deliver you possibly risk as much as your career.
The time constraints you're under are the time constraints of your free time in your life.