I like to think I am thick skinned, open minded and easy to get along with. No one is perfect though. I've never complained to a boss about eccentric or awkward coworkers. However, no company could ever pay me enough to be sworn at or threatened.
I was going to suggest to you that you switch to all communications via email as you mentioned but given that you have to work closely with him it's not really viable.
That leaves you 3 choices: 1. switch to another role where you don't have to deal with his shit. 2. get another job. 3. stand up to him, give it back to him 3x what he gives you. I'm guessing option 1 is unlikely in a startup, option 3 is only going to get your colleagues annoyed with you.
Anyway, polish that resume and next time he blows up tell him to get lost. If your managers are too weak to deal with the situation then you're better off out of there. A good manager would realise that Jerry is having a corrosive affect and for everything that he brings to the company, there is a cost.