I've given up on trying to manage runtime dependencies with language specific tooling. Instead, I've moved to mise which handles the majority of them (Python, Node, Ruby, Terraform, etc.) the same way. It will also activate Python virtual envs:

https://mise.jdx.dev/lang/python.html

It has other nice helpers for development environments (tasks, env variables, etc.).