Middle-aged and older people are not going to study abroad, they don't need an interesting job in a multinational organisation 20 years from now, they cannot imagine a single digital market or a single financial market anyways, and they don't care about it, they don't care about reserving the option of working abroad one day somewhere in Europe and they are not going to befriend or marry any foreigners anyway.
Had you asked the old people in the 1960s whether rock music should be banned, the likely answer would have been "yes".
The median age has increased from 34 in 1974 to 40 in 2015 and older people now constitute a majority. That's not a big issue when you let a parliament decide on political issues, since politicians would usually trade favors. But referendums are a crude form of democracy with no room for political bargaining. Matters are presented as either A or B and the winner takes it all.