Tracking and targeting are just two possible reasons why people dislike ads. Invasiveness is another one - think popups, popunders, layers, interstitials, pre-/postrolls etc.
So even if they don't do "tracking", injecting ads surely isn't something the average user "signed up for" when downloading the browser.