EU VAT doesn't work like that, Estonia is in the EU sigle market (and the Euro).
http://en.m.wikipedia.org/wiki/European_Union_value_added_ta...
You may be right in the income and social tax, but I suspect establishing a business in Estonia may require visiting the country at some point.