Biggest worry for me is impostor syndrome. I'd be terrified of turning up and being absolutely useless and achieving nothing. I don't go to conferences for the same reason.
My best recommendation is to go there anyway, and you will see that you can more than you will ever imagine (useful advice, right? just telling you to do it anyway). Also remember that it is absolutely okay to be scared out of your wits (relevant blog post http://headrush.typepad.com/creating_passionate_users/2007/0...) and do it anyway.
Even if you don't have full mastery of the tech being used, asking the _right_ questions can help a lot!