Well two things. The company I'd be joining is run by a friend, so I'm unsure if he'd let me do both. He'd likely want me to focus on just his thing, especially if he's paying so much.
Then #2, the industry my company is in is moving very fast and is very competitive. If I slow down too much, the company might get left behind.