I think there are extra fees as a foreigner. You are not prohibited of having a bank account, insurance, using credit, etc. But most systems will prevent the CPF of being used without some sort of special approval.