SpaceX simply didn't have the resource to fully invest in Starship until much later. Even by the early presentations around 2016 it was a tiny part of SpaceX and was prototyping with limited resources. Real ramp up of spending happened significantly later.
Your understanding of Apollo is also flawed. The F-1 engine started development as early as 1955, not 1961. So if anything your 2012 date would be more like 1955.
Starship is also twice as powerful as Saturn V and designed to be reusable in both stages. That's a significantly harder task. Had SpaceX just wanted to match Saturn V, that would have been significantly easier.