Not all. Computer-based services like Skype often don't support calling 911, even though they can call other landlines. (They're pretty clear about this when you sign up for an account.)

I have an ObiHai box at home that lets me use Google Voice as a my landline VoIP provider for free. However, I still have to pay a second SIP provider about $15/year just for 911 access.