What you describe looks like a Fairphone, and by choosing carefully what to install on it I think it'd be a good solution.