Regardless of your anecdotal experience, adaption to cold is certainly genetic to a large extent and the literature seems to support that hypothesis.
https://link.springer.com/article/10.1007/s00421-014-2962-2#...
https://link.springer.com/article/10.1007/s00421-014-2962-2#...