The regulatory "burden" is also a benefit, in general, which a lot of people fail to understand and is also the reason Brexit Britain hasn't significantly diverged from EU rules.
Yes, it's hard to explain to people just how much of a saving being in the EU makes on regulations. It outweighs having the odd regulation that you don't agree with. If the UK does move away from EU regulations then they'll have to duplicate a lot of effort.
Northern Ireland is still de-facto part of the EU. So unless the UK rejoins the EU or recognises United Ireland - they are stuck in this limbo.
It's because people also think of directives, which are the EU thing of "do this, but write all your own slightly different laws." All the EU stuff in total is not as useful as you're making it sound. It's getting better now, but it's taking a long time.