I'm not sure where you are looking but there are Australian VPS providers with comparable pricing to overseas vendors. A$20 will get you 2GB memory easily enough.