The problem with looking at Manhattan's value inflation is that nobody at the time knew what Manhattan would become.
What was the going rate for similarly occupied land that didn't become Manhattan further north or south? What's that land worth today?