simonw got me interested in the idea after I ran into one of his blogposts talking about how ziglang does it, and then studying ruff + maturin helped me reverse engineer how to accomplish this without any python intermediary in a "python package".
I put together a cruft template (https://github.com/justin-yan/templates-cruft/tree/main/pack...) since I had the exact same thought as you once I got it working - why not do this with a bunch of different tools? I did it with a couple of my favorites (just, lazydocker) but haven't gone back to clean things up/make things a bit more systematic. So it's a pretty messy weekend project (caveat emptor) but hopefully it's a helpful starting point if you want to try it!