I was definitely clicking the correct x. And I resolved it by refreshing the page and trying again.