http://en.wikipedia.org/wiki/Structure_and_Interpretation_of...
http://www.amazon.com/Feynman-Lectures-Physics-Set/dp/020102...
he pretty much covers every topic in that wonderful feynman way. For optics i'd also suggest hecht's book.
Also for a more theoretical coverage of physics, reading the first few books from the landau lifschitz series is highly recommended.
The Mechanics book most closely matched the experience I had with SICP. It uses a small number of powerful, primitive concepts to construct all the major results of mechanics. The book is extremely dense, but the writing is so elegant and lucid that it does not feel forbidding. The only prerequisite is comfort with calculus, though prior knowledge of physics will help, and make the book's achievement that much more impressive.
http://www.amazon.com/Course-Theoretical-Physics-Davidovich-...