People aren't mathematical entities. On average, you're a fool, because most people are fools. But if I start out treating you that way, you're right to be upset.
In evaluating a feature, it's important to have a global view. But it's also important to have a local view. If you choose features at random, they're generally used by a small number of people, but they get made because they're important to somebody.
In this case, you can't think just about the people trying to view the video responses. You also have to think about the people who have been making them. Content creators are a vital part of the YouTube ecosystem, and getting non-creators to cross over and become creators is an important engine for content growth.
To somebody who has been using this feature, this is a fuck-you twice over. The first time is shutting down a feature they were using. The second time is the recognition that YouTube was having them do something that didn't work well, but that YouTube doesn't really care.
Can YouTube get away with offending a bunch of people? Sure. But treating people like they only matter when they are currently useful to you? That's for sociopaths and supervillians. When you're building things for people, it's important to treat them as people. They'll remember when you don't.