True, but it does create a lot of waste.
I'd attack the horrifyingly wasteful, and deceptively un-recyclable bottling industry. Depending on the recycling capabilities of your area, if you throw away plastic soda bottles with the cap on, it very well could go into the landfill.