I took a course[0] this semester on computer vision with Python, and all of the course material is public on GitHub. It assumes you have experience with Python, basic linear algebra, statistical methods. The projects included stitching panoramas, creating depth maps from stereo images, and tracking objects in a video.
[0]: https://github.com/ut-cs378-vision-2014fall/course-info