Not at all. As long as you know the ones you'll be using a lot (food, water, thank you, how much, etc.) you'll be more than fine. Honestly, all you need is body language. I actually have a couple of Korean friends whom I whent out to eat with and without us having a common language. This was back when I knew very little mandarin.

Book your flight and go. Hit me up if you need anything!