Pretty much. If Ads were without JS and videos (or, at least autoplaying videos) I really wouldn't care. Hell, if they were relevant ads to the website, I'd probably even click on them and buy things occasionally.
But when a modal pops up or I get redirected, or your ad floats over your content and tries to follow my scrolling not only are you not going to sell to me, but I'm going to leave your website.