This has been slowly growing as a topic in the back of my mind lately. The past couple days I had some awkward interactions with ChatGPT that made me realize how it can remember conversations from last year, and certainly everything is logged.
I hope that local models will become efficient enough that more private llms will become available without heavy GPUs, but that seems a long ways off still.