I personally would only do it if I need it to solve a highly specialized problem that requires every inch of privacy I can get. Otherwise there are better options out there
Yeah, I did it for my app that specializes in privacy.
Basically I used qwen2.5 for the mobile use and the case I was solving is user's most private thoughts - smth like a private diary
But I am thinking about how can I fine-tune the model on the users' data and keep them private? Maybe like improve the model directly on the phone ahhaha