From my memory what mainly lost his backing from the general public was the horrendous antics of Dianne Abbot and her place at the front bench of the labour government.
Everything that woman said and did leeched coherence and unity from the shadow government.