Modell announced the move, and _the_ _very_ _next_ _day_ Cleveland voters approved funding to remodel Cleveland Municipal Stadium. It didn't work, Modell still wanted to move the team. The city of Cleveland sued Modell and a bunch of other entities with the result being Cleveland retained the Browns legacy and the franchise was considered dormant for three years [0].
The upshot of the whole affair was the passage of The Art Modell Law [1] which Save The Crew supporters invoked when Precourt Sports Ventures tried to pull the same trick on the Columbus Crew.
[0] https://en.wikipedia.org/wiki/Cleveland_Browns_relocation_co... [1] https://www.natlawreview.com/article/ohio-art-modell-law-sav...
You might be conflating the football stadium with Jacobs Field, which was built for the Indians. (American League Baseball)
The original Browns played at Cleveland Municipal Stadium until they became the Baltimore Ravens.