Ditching it for building comes with a bunch of pros and cons. Pros, works interesting, massive demand, jobs last 20+ weeks instead of a few hours/days making it way less effort to chase a dollar. I've got a six pack again after being sedentary for 5 years, my health is the best its ever been and i dont spend a dollar on a gym.
Cons, wage dropped by about 50% until I get licensed. The whole industry in Aus is plagued with bad actors and shit businesses. It's rife with sexism, racism, bullying and just generally horrible people and companies. There are basically bugger all companies offering apprenticeships. The unnecessary hazing onsite is a pita too. Old fellas get grumpy watching IT workers pump jobs it took them 20 years to learn in less than a week. Turns out youtube builders will teach you more tricks than the grumpy old dogs have learnt in their lifetime. Age and experience do not always correlate in a positive fashion.
I still do IT on the side, it helps me fulfill some inner wants and needs (I really like helping folks get the best our of tech).
I would love to try get into building IT infra like datacenters. Mix the two job realms together.
Don't be afraid to make big changes, you got one life, might aswell "send it".