In particular, the lack of a "status quo" option for Crimea (the referendum only had two options, go independent or join Russia) and the lack of international observers (OSCE observers currently in the Crimea were asked to leave by the Russian authorities in the area) made the whole thing iffy from the get go.
And that's not even getting into the fraud allegations ...