Your hypothesis is supported to some extent by this: https://stpauls.vxcommunity.com/Issue/Us-Experiment-On-Infan...
TL;DR if you feed new born babies but don't give them any human affection they die.
(I heard about this a long time ago but have never found the actual research so there's a chance this isn't true.)