update: if I log in via incognito mode, the toggle is set to "improve the model for everyone"=Off. So I guess somebody deployed a bug in the frontend.