No, a significant part of it (in the UK) has definitely been stereotypes around Chinese food being somehow 'dodgy'.
Clearly racism doesn't 'explain everything' and the forces you mention played a part, but you're the only one who brought up that strawman. (You should think carefully about why you're so desperate to disingenuously downplay the effects of racism on modern attitudes.)