I don't know about legal restrictions, but I frequently see the claim that people empirically don't move within the EU as much as they move within the US. I'd guess that variability of language/culture probably plays a role...
There are no internal customs controls in the continental EU; the UK and Ireland reserve an exception, partly due to historical problems with terrorism.
I'd certainly be pretty happy to work in some parts of France!