For most GraphQL API requirements in terms of performance there's no real value in using Rust if you're not already very proficient in it.
That said, 520ms is extremely pessimistic for most GraphQL servers.
The API to a project I'm running is built using the Node / Apollo GraphQL server and its response times are well under 90ms; that's with a CDN in between: https://api.psychonautwiki.org. [server in Germany; US mileage may vary]
(btw -- I'm not affiliated with Juniper)