Take all the affront you like, it's true. You can indeed get around the cities kinda-sorta okay on public transport, but if you can't even
rent a car on occasion, vast swathes of the country are effectively off limits.
Compare this with, say, Japan or Germany, where you can reach any point in the entire country quite comfortably on public transport. Now, given its vast size and the low population density outside the cities, I'm not saying it's feasible for Australia to ever have Japanese or German-style PT... but for better or worse, that's the situation today.