That's my understanding as well. If you are writing a new Notepad.exe, you probably don't care about Spectre.
Until someone uses it to keep the plaintext files with their passwords in it open.
Hope your users do not try to open an ssl private key...
Well, if they already have malware on their machine, they are screwed anyway. Since the browsers have mitigations built in already, I'm not worried about a remote attack over the web. What's left?
How about games?
I thought for Intel processors it leaked across all processes, including outside user-space.
Or was that meltdown?
Meltdown allows information to leak across ring boundaries. Spectre by itself doesn't. Meltdown is relatively easy to fix whereas Spectre is a more fundamental issue with how most modern chips are designed.