Yes, that's the idea. At least in the place I live, you just need to go to a convenience store, tell the cashier the phone number and pay cash.
Not to say there isn't SOME anonymity by paying cash for a burner phone, but it's not even remotely fool-proof for anyone really wanting to figure out who you are.