I disabled the allow push notifications checkbox in Safari, but still get prompted with the native Safari modal. I'm not sure how this is done, and it's infrequent, but I'm guessing Safari left a hole in their notifications web API that is being exploited.

Safari's implementation could also be improved. The modal forces you to chose without the ability to cancel, and saves the website into your preferences, even if you just want to immediately close the tab.