Most utilitarians turn out not to actually think that way in real-life situations so I wouldn't worry about it. Moral realism is tied to religion for a lot of people and so some non-religious folks just reject it out of hand, which I think is a mistake.
IMO, moral truth exists as much as scientific truth we just interact with/discover it differently. The Stanford Encyclopedia of Philosophy is a good place to start if the topic interests you: