That's not startup normal. Maybe having beer and liquor bottles in the kitchen or snack room or whatever but half empty bottles littering the CEO's desk and every employee or even every team having their own mini-fridge is odd.
I've worked at startups with a "drinking culture" and startups with a "board game culture" and I'll take the board game culture every time. Doesn't mean you can't let loose and drink, too - but drinking as the central activity quickly turns a business into a frat house. I do have some great memories celebrating milestones, new hires, etc with early stage coworkers :D