For example, many powerful free-trade Libertarian think-tanks backed Brexit: the Hoover Institution [0], the Cato Institute [1], the Adam Smith Institute [2], etc.
These certainly aren't racist dumb-dumbs or protectionist "little Englanders", and their opinions are well worth a read. While bigots exist and certainly voted 'Leave' that does not mean that there are not good, open, free-market reasons to leave the EU.
[0] http://www.hoover.org/research/cautious-yes-brexit
[1] http://www.cato.org/publications/economic-development-bullet...