If he gave up on ideas because other people moved on, he would never have done the work that won the prize. It took someone very stubborn to continue working on neural nets back then.