I had the same annoying outcome as well. You can turn off just notifications from Google Now by clicking on the bell icon in your menubar (if you're on a Mac - do the equivalent on Windows/Linux) then clicking on the settings (gear icon) and then in there you can untick Google Now