If you haven't already you should check out uv: https://github.com/astral-sh/uv

It solves a lot of the package management headaches for me.