The water is drinkable but in many places not what I would call tasty.
Due to the age of many places in Europe there is also still a lot of copper pipe used for tap water. Not deadly but also not very healthy. In Amsterdam over 20 percent of homes have copper pipes.
Much of the US has great tasting tap water.