And this is why we see companies scooping up people's data and saving it with no regard to the individuals. We need to move to companies seeing that data as a liability, not an asset.
this could lead to serious limitations on legitimate future progress including on anything built using statistical methods that require large training data sets.
If protecting personal information limits or slows some progress, so be it. Also it could still be done, just more carefully.
[1] https://research.googleblog.com/2017/04/federated-learning-c...
Some level of public education is also required I think, to make people aware of the value/threat of just giving everything up every time someone asks for it.
If companies were trustworthy with data, than that wouldn't be an issue. Why should they get a free lunch on my dime?
Most machine learning is done against anonymous dataset and works fine.