Political parties are constantly proposing to build a fast rail link between Melbourne, Sydney and Brisbane.
But at this stage the populations of the cities are just too low to make it economically feasible.
Melbourne and Sydney are about 4M each, and Brisbane is 2M.
By comparison, the Northeastern United States [1] has a population of 55M, in a smaller geographic area. And Japan has a population of 130M in an area about half the size of Sydney's state of New South Wales.
I wish it could be done. It would be so much better to be able to board and disembark in the centre of town rather than having to drive/commute to and from airports. I'm hopeful that Hyperloop may be the answer, but we'll see.
[1] https://en.wikipedia.org/wiki/Northeastern_United_States