Emotional imbalance and lessened productivity. More startups should really let their hackers work odd hours occasionally, or from home sometimes.
As co's get bigger they tend to enforce stricter day schedules, killing any potential for late night hackfests and flexibility to run errands, etc.