Tokyo has a great subway system (for the most part--there are locations that aren't that well served) and there's good train service between many moderate-sized cities in Japan. But my experience is that, once you get to a city outside of Tokyo, the public transportation options aren't great.