Christer Ericson's 'Real Time Collision Detection' is a killer reference on the topic, and he used to run a super interesting blog [1] on various mathy things related to game development.

[1] http://realtimecollisiondetection.net/blog/