Buy Openmoko Neo Freerunner for a fully free smartphone, or some old Motorola listed on http://bb.osmocom.org/trac/wiki/Hardware/Phones for a free dumbphone.
Keep in mind however that using OsmocomBB based phone on public network without proper permission is illegal. http://bb.osmocom.org/trac/wiki/LegalAspects
Also, just to state the obvious, OsmocomBB is limited to Calypso, which is limited to 2G.