I bought a korg micro key for my kids. Cheap enough, and with a good sound font on my computer it sounds better than my old piano.
There are stand alone hardware synthesizers of varying sound quality, and keyboards with built in synthesizers, and varying quality. In both cases the best is great sound. I personally prefer to use a computer, but that is preference, nothing is wrong with other choices.