You need to do compound exercises with a barbell, namely low back squat and deadlift. These target the so called posterior chain, which is all those crucial muscles you don’t see in the mirror. Mindlessly “working out” is not going to target all that to a sufficient extent.
I was where you are now, started lifting and my back pain was completely gone within 2 months. I have been totally free of back pain for over 5 years now, going from not being able to lift a 60lbs barbell without pain to deadlifting 500lbs.