That's some sort of anomaly. They took everything else, and murdered half a million civilians. I guess the remaining marbles were in locations too difficult to easily loot? Or too weighty.

Anyway, Elgin 'rescued' the marbles after a period of particularly egregious destruction of Greek history. Much was lost, blown up or deliberately demolished. If the Greeks didn't give a damn, why should Elgin be blamed for caring?