This is a major ranking factor, in some situations moving sites that would be on page 13! to the #1 spot in search. In other cases, the effect is less visible.
That is what keeps people from not implementing AMP.
And you get this ranking benefit not for using AMP, or for a certain performance, but it is given to everyone that uses Google’s AMP version, from Google’s CDN, with Google’s tracking solutions. If I want to run AMP from my own CDN, I can’t do it, and if I want to avoid Google’s cache, because I have my own CDN, I also don’t get the ranking boost.