Don’t count where? If a person looks like they are from a warmer region and speaks Portuguese - unless they object - they will be classified as a PoC by most people in the US. Maybe the government disagrees but that is relevant only in very few specific situations.
Also, if their parents moved to Brazil in the 1960s they somehow became a PoC? Does the actual ancestry matter or are we just assuming that everyone who is not from Europe is a PoC?