You never start completely new, you always carry your previous experiences and knowledge you gained. This will be valuable to your progress even if it doesn't seem relevant right now.
Speaking from experience, switching career at 28 was the best decision of my life.