So people who drink coffee are doubly impacted due to the acrylamide and the sugar.
Milk sugars (lactose, glucose, galactose) don't affect leptin or ghrelin, so there's no risk of overeating as a result. (I also tend reduce my intake of these healthy milk sugars by using heavy whipping cream instead of whole milk.)