Belgium absolutely is a nation state. They're as sovereign as the United States is. In some ways more sovereign.
That said, a lot of people use nation state as a synonym for sovereign state, and Belgium is as much a sovereign state as the US is.
There are many other countries in Europe (and outside of it) that are multi-lingual and for the most part having a single language is not a core requirement for being a nation state.