They are perceived as faster because they automatically skip binary and VCS-ignored files. grep is faster.
I also seem to recall the ripgrep author recently trying to optimise towards grep in another HN post.
Love ag ever since I discovered it, though you have to be careful every so often it doesn't look in a filetype that mattered.
If it does less work, and takes less time, then isn't that faster?