Milk is homogenized so I am not sure how close 3.5% is to ideal. But I would say that humans are probably pretty well adapted to drinking their milk because they've been doing it for millennia.
The thing about fat is that it can increase feelings of satiety.