Sort of. The GSM providers don't know/care if you use a random GSM phone on their network. Of course, if you rent their GSM phone, they are not going to let you use it on a different GSM network.
(People seem to want free phones, and then seem confused when the person that gave you the free phone doesn't want you to use it on the competitor's network. If you buy your own phone, you can use it wherever you want.)