What you are describing sounds like https://www.car2go.com, which is available in some US cities.
We have it in Toronto and it's super useful sometimes to quickly get somewhere within the downtown when transit would be slower and cabs more expensive.