Whilst I don't know the ins and outs of your business or the implications of non-EU/EEA businesses selling to member state consumers... I'm wondering how such a requirement would be enforceable, given that you are outside the EU? I've yet to see anything that declares a requirement that you must collect VAT - but I have seen HMRC guidance saying that member state businesses selling outside the EU are not affected and don't have to charge/collect VAT, so I'm inclined to believe that it's reciprocal.
A question that occurs for me is how TTIP would affect this situation, though. If TTIP was established, would the EU then require US businesses to collect VAT in the same fashion? Because that would be really sucky for you.