I find that in the big cities (Tokyo, Osaka, etc) this isn't an issue anymore but it still is an issue in more rural parts of Japan. We were visiting friends in Akita prefecture recently and found fairly nice baths that did not accept tattooed folks.