We also take qualitative metrics pretty seriously and found that this experience was well received on a more subjective level, high csat in particular. It surpassed the success criteria we set out for the feature and I'm happy about where it landed. Of course it's not going to be ideal for everyone, so we have a setting to disable.

To be clearer on our metrics: In addition to qual there's also a precision/recall tradeoff, so saying ctr alone was an oversimplification. We have coverage targets, but that doesn't really impact the positivity of the suggestions.