WordPress has improved a lot in the past few years in terms of security, "worpdress is insecure" is an old meme. Sure if you just go on installing any plugin under the sun, there can be a risk. But the stock installation of WordPress with just a handful of reputable plugins should be good. Much of the slowness comes from the oodles of plugins that people install.
For speed, there are many great and free caching plugins available for WordPress which can considerably speed up your site.