Basically this is a claim that there's a massive amount of graphical quality that will be unleashed once we're unchained from the tyranny of the fixed function GPU behavior that remains, and that this is worth whatever loss in computational power we'll have when we increase the sizes of caches to cover the less-coherent memory access.
I'm not sure if I buy that. Games look quite nice already, and I'm not sure if I could personally tell the difference between what we see in something like Crysis and something like Toy Story, which didn't have the shackles of fixed function pipelines.
An easier explanation that's long been a pet theory of mine is that Larrabee is essentially a thread parallel FP-heavy processor for the scientific market motivated by GPGPU's encroachment on that market segment, and necessarily labeled a "CPU/GPU" in order to not step on toes in the wrong places at Intel.
It's definitely going to be an interesting next couple years in graphics, though.