They're called both in the U.S. I think "food bank" is at least as common. E.g. SF-Marin food bank (https://www.sfmfoodbank.org/) and the nearby Berkeley Food Pantry (https://www.berkeleyfoodpantry.org/).
The word "pantry" alone has the same meaning in both countries.
It probably makes sense to change terms if one is more universal.