I do agree that in the case of benchmarking, it's a bit silly to put the onus on the benchmark runner to try and pick the right plugin for each capability that won't make someone point to /that/ as the reason Pi didn't do as well as expected.
[1] https://pi.dev/packages/pi-mcp-adapter?name=pi-mcp-adapter