There are some materials like this, it's called negative thermal expansion in materials science, the wikipedia page [0] on it has some examples of materials where this is the case.

[0] https://en.wikipedia.org/wiki/Negative_thermal_expansion