I think that's key.
One really needs an imperative reason to move a business from the UK to France considering how much more business-friendly and, well, sensible, the UK is.
The biggest problem now is discoverability as government programs are still habitually arcane and UI/UX grammar. Some countries, I'm thinking especially of Germany, have national standards that make services appear uniform whereas in France every administration is still its own little shop.
Bureaucracy is Kafkaesque because of the complicated and seemingly random rules, because of the abundance of taxes, etc. There really needs to be a drastic reset of everything.
A good example: The attestation people had to print and fill in if they wanted to leave home during the lockdown. Why? This is bonkers even if it eventually became digital.
Another good example: Starting a business. I don't know if it can be simpler and faster than the way it works in the UK. In France, on the other hand...
Simply not true.
Expect bank accounts in other countries (like Revolut, Transferwise etc) to be closed suddenly because "Malta".