"All the other feedback I got from my team was overwhelmingly positive."

If this is true, then you have nothing to worry about. The complaining person is an underperforming outlier and the rest of the team would be eager to use your feedback to get rid of them.

However, something about this story feels off. It could be a Byzantine fault - multiple parts of the story being untrue, creating a false overall picture. It could well be that you're actually creating an atmosphere of fear where others agree with you because that's the easiest form of conflict resolution.

If your manager is saying "resolve your differences" and not taking sides, it could be that you're both seen as troublesome.