Google has responded correctly to "never play that song again" for me in the past. Same with "hey google, fuck this song". I don't know if it explicitly "downvoted" the song or not, but the song was immediately skipped and I hadn't heard it any time soon after.
That said, I've refrained from using my google puck in recent months and it had been regressing pretty heavily when I did, so I can't guarantee that still works.