Combustion concentrates radioactivity by a factor of 5x to 10x [1]. Fly ash can replace 25-50% of cement [2]. A typical concrete is 16% cement (1 part cement, 2 parts sand and 3 parts gravel) [3].
Hence a concrete might be 4%-8% fly ash. If the ratio of fly ash is 'A', the concentrating caused by combustion is 'C' and the background radiation of other concrete ingredients is uniformly taken to be 'B', then the radiation count of concrete without fly ash will be:
B
and the radiation count of concrete with fly ash will be
A.C.B + (1-A).B
Plugging in values for A (0.04 to 0.08) and C (5 to 10), we find that fly ash increases the radiation from concrete by a factor of 20% to 70%. That strikes me as a significant proportion of the radiation from concrete.
[1] https://phys.org/news/2015-09-radioactive-contaminants-coal-...
[2] http://www.theconcreteproducer.com/how-to/concrete-productio...
[3] http://www.cementaustralia.com.au/wps/wcm/connect/website/pa...