Even moderate drinking has significant lasting physiological effects like elevated heart rate as well as reduced sleep quality and emotional disquiet. It’s just if you drink regularly that all starts to feel normal.
I do drink by the way, although very infrequently. I judge that the pleasure I can get from a top shelf bourbon on rare occasions is worth the harm. But when you don’t drink regularly if you’re at all in tune with your body the effects are quite noticeable.