YT has hidden tags that tie it to your account after viewing a video, removing the video from played/history does not affect this and has been an issue with YT for nearly 6-7 years at this point.
It, unsurprisingly, has a history of _lots_ of different things, you'll be shocked about how much Google knows about you. Probably things you yourself have forgotten.