As the parent indicated, this stuff is surprisingly standardised in London.
Distance is measured from Charing Cross.
The Cross is near Nelson's Column, but I would be surprised if the column was actually the central point.
As others have pointed out, this leads to some weirdness, as lots assume that the City (old London & older Roman London) would be the obvious place to measure things from.