They can all be recycled in a much more meaningful way than plastic. Paper can biodegrade. Empty metal and glass bottles are easy to use as raw materials.
During communism we used to recycle all food and drink glass containers, but one would only get a few glass shapes and a few jar shapes. They only took back the containers clean and without labels. Most of the work was washing off the paper labels and bone glue. Kids were earning ice cream money doing the cleaning and recycling.