I think the Leavers were dissatisfied from the beginning. You can directly trace the formation of UKIP from the Maastricht Rebels. https://en.wikipedia.org/wiki/Maastricht_Rebels in the Major government.
UKIP was formed out of protest at what they saw as the EU going off in a highly political direction (i.e. becoming a lot more than just an economic area).
They may be wrong but the objections are based on fundamentals.