Regarding the memory argument: better implementations of infinite scrolling, like Facebook, actually replace content with a single element of the same size when out of view, to decrease the DOM size. Content in and just around the viewport is still in memory.

I do agree with many of the other arguments though, especially bookmarking/history.