Wouldn't doing so detach past activity I do want aggregated?
How is a site I'm interacting with supposed to know it can use my previously-configured settings if I'm showing up with a new public key every time I authenticate?
I read this as essentially a single origin supercookie. So each origin (web site) has a unique public key for you, but it’s immutable.
So, you want privacy but without privacy?
Yes. I get that in the current ecosystem via doing business with sites I trust, and ceasing to do so when I cease to trust them. It's not impregnable (sites get hacked, companies get sold), but it's preferable to an alternative where I must either stay one-time-padded continuously or have my activity recorded in a global public ledger.
You could use a public blockchain key to log in to a site you trust which stores all of its data somewhere private and have this same functionality. It is only transactions you write to a public blockchain that are public. The act of authenticating using a key stored there does not write anything down.
Privacy as in having control over who gets what information, and being able to change who and what over time
If you want activity aggregated, use the same address. Not sure what the complaint is.