I've got memories of an experiment we did in undergraduate physics labs, which involved a directional array of Geiger tubes. Pointing them at the view through the window gave a low count, but pointing them at the concrete structure of the building gave an elevated count. My understanding at the time was that it was due to naturally occurring uranium and thorium in the raw materials of the concrete.
Given that fly ash is a common component of concrete [1], I wonder how much of the elevated radiation from concrete can be put down to the concentrating effects of coal combustion that you mentioned in one of your comments?
[1] http://www.cementaustralia.com.au/wps/wcm/connect/website/bu...