I wwould love to get started, I've been looking for a new hobby and thought that is perfect. How should I start? :)
Good synths: https://www.kvraudio.com/product/firebird-by-tone2-audiosoft...
https://www.kvraudio.com/product/synth1-by-ichiro-toda
Good all-purpose instrument: https://www.kvraudio.com/product/orion-sound-module-by-sampl...
Good orchestral instruments: http://vis.versilstudios.net/vsco-community.html
A helpful article I wrote with links and basic advice for new musicians: https://blog.rileyreverb.com/how-to-be-a-musician-58511c4e18...
Personally, I love and recommend Ableton Live which features an easy to use interface, workflow, lots of options for experimentation and extensions, great and large community as well. Good choice for beginners and experts alike. Plus, with Ableton Push you have the option to get an excellent hardware controller that is tailored to your DAW, but it isn't something you'd need from the start.
Alternatively, you almost can't beat Logic on price considering its features and performance. I'd say it is more complex, but that's subjective.
Both Logic and Live (Suite version) offer a complete solution, including high quality instruments, synths and effects.
Hardware is optional, but a simple midi keyboard for less than a 100 bucks will help a lot.
For now, Reaper and a few free VSTs will do. I find myself bumping up against the fact that Reaper was made for live music and its devs are understandably keeping the focus there, even though they do good work on the MIDI roll. They always nail down a few irritants in each release.
You'll go further and have an easier time if the community around your tools makes the same kind of music. Choosing tools mostly comes down to what you want to do. If you want to do electronic, Ableton is a good bet.
By the way, if Ableton remains too expensive for your taste, there's always Bitwig, which isn't quite as mature and has a much smaller, but growing community, yet it's very similar to Ableton's approach to music production.