You have to invent a whole lot more to have a plastic bottle or even a paper drinking cup, at that point, it'd be simpler to just invent pottery, instead.

Neanderthals were practically swimming in those.