Usually the elephant in a room is something very evident about which no one wants to discuss about
(Thinking about it a bit more, I actually think that the phrase's meaning could have really gone that other way. Nothing in the phrase itself suggests that the elephant is being deliberately ignored -- we only learn that critical part "in the background" via culture. For comparison, the similarly structured "bull in a China shop" means exactly what you would expect, without any implied reversal.)