Is it really a common problem?

I've had a Rav4 for 3 years. I use the adaptive cruise control a lot on highway/freeway and I have never, ever had it exhibit phantom braking. It will sometimes brake a little longer than you expect for cars that are exiting on off ramps, or changing lanes, but it's always for a real car that's really going slower than I am.