The Buddha rejected the authority of the Vedas entirely and this infuriated the Brahmins of that time. He had both philosophical and pragmatic objections to the theistic stance of Brahminical groups, along with a total rejection of their focus on mass animal slaughter in the name of rituals.
From the original Pali canon, this discourse captures the Buddha's position:
https://suttacentral.net/an3.61/en/sujato
And, Adi Sankara wrote an entire polemic trashing the Buddha as an insignificant man who should be shunned by everybody. Here is a passage straight from the Vedanta Sutras written by Sankara:
Moreover, Buddha by propounding the three mutually contradictory systems, teaching respectively the reality of the external world, the reality of ideas only, and general nothingness, has himself made it clear either that he was a man given to make incoherent assertions, or else that hatred of all beings induced him to propound absurd doctrines by accepting which they would become thoroughly confused.--So that--and this the Sutra means to indicate--Buddha's doctrine has to be entirely disregarded by all those who have a regard for their own happiness.