The exact opposite works for me.
Note taking massively helps me on both remembering and the level of attention I pay to the lecture itself. Without notes, my attention drifts and I might as well just be passively watching TV.
Like Hermitian909, I don't particularly care about the notes afterwards. They're sometimes handy for skimming over when prepping for an exam or reworking through an example of a half-understood concept, but for the most part I don't use them.