I've seen more performance problems caused by people not having clean code than I ever have from people not thinking about performance from the get go.
I've also seen plenty of performance issues ironically caused by performance hacks wedged in early on.