I don't think it's just about (or even mainly) functional programmers.
Look on something like java or kotlin, that are inherently slowing down EVERY.SINGLE.VARRIABLE. access by boxing them into objects.
On other hand there is rust, which takes quite a bit of inspiration from fp aproach but obviously still cares about the performance.