Well, it certainly sounds like you're more than capable of working really hard and achieving good grades. Having to struggle isn't a bad thing - the key is learning to enjoy the feeling (not easy, I'll admit).

At least where I went to school they had family student housing for grad students who were married. Going to grad school would likely involve you taking a student loan, but then you'd be able to make more money afterwards.

Keep in mind that while you're under 30 (and assuming you don't yet have kids and a mortgage) you have a lot more room and leeway to take risks than later in life. Don't lock yourself into misery too early in life. :)