That's the way the Senate was (essentially) until we explicitly changed it with the 17th Amendment.
I think we could improve upon on current system by adding a vice-governor to the governor's ticket, and subjecting the ticket to the popular vote. Then the governor could send the vice-governor, his popularly elected subordinate, to Congress, which would help shift power back to the states. As it currently stands, senators do not feel a need to pay heed to their states' governors.