There are even so-called "Black-Ops Plastics" specifically designed to be fully IR transparent: http://qwonn.com/black-ops-plastics.html