It sounds like you're trying to package an entire application, not a python package. If thats the case, maintaining and distributing it may be simplest to do with a git repository.
You just need a quickly whipped up Fabric script, and then you deploy remotely from the command line.