Yep, that's the case. You get a "Sorry! Music on Google Play is not available in your country yet." when you try to shop for music.

The rest of Google Music, however, appears to work well once the account is setup by US VPN. Even the Android app works without problems.